Age | Commit message (Collapse) | Author | Files | Lines |
|
Set the result of refstack_defcore as failed if there were skipped testcases
in a run.
Change-Id: Id782c2dee511cefbafd5b4440f386fd66f934a47
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit cfd79ec4c39e215a25fc3d99fc5368e7d874f7bf)
|
|
It adds xunit reports for rally-based and tempest-based testcases.
It completes the reports provided by snaps (thanks to Xtesting).
All rally related operations are moved to rally.
It allows removing the rally dependency to tempest which was false.
Change-Id: Ia7d2476f58f4f68b7c88442e50cad844037a36e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3393f2016483555c27d612c69ec11274cc8aa72a)
|
|
It conforms with best programming practices.
It allows muting console and increasing log level (debug).
Change-Id: I0e0cfef6abe3b354a43817fcb242c71da701e237
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit b482b494ce695e83cca0a10e7750200fd1be42ea)
|
|
It converts html_file to str and raises all possible exceptions.
It sometimes fails when locally generating reports.
Change-Id: Idf6a12aaac4561800cd5e364f8bcc495aabbee1d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4d3627e56d333e313b67bbf1e7880b11883b5652)
|
|
It removes useless spaces and now conforms with oslo.conf dict.
New helpers and unit tests are available.
Change-Id: I20335c5e5c3840cc872e158c6072d97a3f2cb98c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 904377462f58464937d4cafeb8c432f024a85bd4)
|
|
|
|
https://github.com/openstack/oslo.config/blob/master/oslo_config/types.py#L600
https://build.opnfv.org/ci/view/fuel/job/functest-fuel-virtual-daily-master/817/consoleFull
Change-Id: Icde9938bb9f6c0c37d2504317f31b0af4ef9ee8e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Return a reasonable value for caller to process.
Change-Id: I5a83544aaebb4e53db37ddaa13033d77848722b8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It's required at least by Barbican tempest plugin.
Change-Id: I46a65ee5fee044917c5375adaa8ebb529efe86ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-1009
Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Enables utilization of blacklist also on non-OPNFV environments since
there is no link to installer type.
JIRA: FUNCTEST-1008
Change-Id: I3a012b8b7e7dbd049f8794dff3c9d56dcc1cadad
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
FUNCTEST-1002
Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: If63c228f2844194279b560515f4ab24a4ee88be0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The default value doesn't conform with our image names.
Else it downloads the image from internet which may be not possible
(offline testing, proxy or deployment l3 issues [1])
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console
Change-Id: I7d951967784d591e7155fe8582299aaa9b680b10
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also renames two testcases and updates all docs because tests
run in parallel in case of tempest smoke.
To force one thread as before:
run:
module: 'functest.opnfv_tests.openstack.tempest.tempest'
class: 'TempestCommon'
args:
mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$'
option:
- '--concurrency=1'
JIRA: FUNCTEST-989
Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also copies tempest.conf due to side effects raised by
Barbican plugins.
Change-Id: Ie87680f5d2e68527a5a61aac302838afc339dde8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I009d38a0db409ab4ec641cba9173ab2386d0ce2a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also set endpoint_type to public in tempest.conf if unset.
JIRA: FUNCTEST-975
Change-Id: I91bd1d7171b4bcf58dbe818696d5b864d5036619
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now leverages on OpenStack Shade to allow gating OpenStack master
as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky)
requires to change only one line.
It stops dedicating the network to the user possibly created because
the support is incomplete (the users have to be registed in
tempest.conf and the multiprocessing has to be enforced).
It also writes the second image and the second flavor in tempest.conf.
Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It also updates rally and installs rally-openstack.
It completes the update to OpenStack Queens.
Change-Id: Iabf436ac6e7facfa21a3d7c8a3dfaffa9142da98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Role has to be listed in tempest.conf before calling testr.
It also saves the right config file.
Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The are now printed in functest.log only.
JIRA: FUNCTEST-950
Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops running neutron tests which matched the former regex.
Change-Id: Ica5a0d1f4858d01533156c98da87f9ed4662489f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Also
1. remove the obsolete function: generate_test_accounts_file
2. Use patch mechanism to get config
Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Change-Id: I8d265b6939861fd9d02a3d0f31aef53b9bfcb035
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The tempest testcases have been integrated from Neutron trunk
testcases. It also enables every Neutron extension which may raise
side effects [1].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
JIRA: FUNCTEST-926
Change-Id: I05015acf119f504ce0a5539d677719de874594ad
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
Calling apply_tempest_blacklist() is no longer mandatory.
Change-Id: Id9a4e970c8acca066a36be89920745127867cd63
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I31a5d2772bab168b3cb4e6b0713d6e95aa5b6fd7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It removes all the files which have moved to Xtesting.
Vnf inheritances and env management will be improved in other
changes.
It keeps the same tree thanks to a symlink to allow publishing
artifacts.
Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops writing files in Functest package dirs and cleans instance
variables in refstack modules too.
Change-Id: Iaddbe4fbaf12d1af207b86d4e44258efdc6d6f3a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also removes constants.CONST and env.Environment which are now
useless.
Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e
Depends-On: I6cfa832466dcefd737314633d807512e46267a69
Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-934
Change-Id: I2befbd3f2b2311f69b24321c7e9544fb43df3a9d
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Else full mode could run tests defined in tempest plugins too [1].
[1] https://docs.openstack.org/tempest/latest/plugin-registry.html
Change-Id: I4355b03ba1b9ba47938f748c4f1a8822fd412142
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Use getattr/setattr to read/write CONST.
JIRA: FUNCTEST-932
Change-Id: Ic9a944100c60563b16f5d89b622ef7f04183cceb
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
keystone_utils.keystone_client() and keystone_utils.get_project()
have to be mocked when unit testing flavor creation since [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/52157/
Change-Id: I898cde1001c14d0b450c3dd43ade7dca47b1ffb3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It defines env.get() as an unique way to get Functest env vars or
their default values. It can be considered as a wrapper above os.environ.
It enforces backward compatibility via CONST which mustn't be used
for that purpose. It should be noted that it also stops using CONST
for getting OpenStack env vars.
Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Change-Id: I58726d0fec5b2da4ea8ac1f9925fe56d2f9d7ce0
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Do not suppress pylint invalid-name warnings but conform the naming
convention.
Change-Id: I324d25b3081fe8a366249559b343c1b9cacadb21
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
JIRA: FUNCTEST-913
Change-Id: I37b25bbcf43fb1d6f7de0c815ad49070d1e1af12
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: I4d699481fdc63058c12ca9cfe18138e87025e9b3
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: I1d240d5edd536d71c87a7dff4e2676715697d0e2
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
And also, remove the params "tempest_use_custom_images" and
"unique_names" of vping, rally and tempest.
Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Mainly, update "rally deployment create --file=rally_conf.json"
to "rally deployment create --fromenv"
Change-Id: I6dd4c7ea2d9d6f47dee49a4fd416e62bd557f45e
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: FUNCTEST-889
Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
|
|
When generating refstack client reference tempest conf file,
the step of tempest.conf backup is necessary.
So if the dir results/tempest is absent, error shows:
[Errno 2] No such file or directory:
'/home/opnfv/functest/results/tempest/tempest.conf'
Change-Id: I7aba5baff55a51881d125b28f99d71d0cc0a5c72
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|