summaryrefslogtreecommitdiffstats
path: root/functest/tests/unit/openstack/tempest
AgeCommit message (Collapse)AuthorFilesLines
2018-02-27Clean all OpenStack related modulesCédric Ollivier3-581/+0
Xtesting is only focused on the framework and entry points. Change-Id: I1a4146ed8519438b13810a20ddf1140c35bb6ecd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Automatically download defcore.txtCédric Ollivier2-43/+2
It stops writing files in Functest package dirs and cleans instance variables in refstack modules too. Change-Id: Iaddbe4fbaf12d1af207b86d4e44258efdc6d6f3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-22Switch from CONST to CONFCédric Ollivier1-16/+16
It also removes constants.CONST and env.Environment which are now useless. Depends-On: I764a0a2a24447c941d1e726f3116593b29dd1c1e Depends-On: I6cfa832466dcefd737314633d807512e46267a69 Change-Id: Ife41c59d9f2e6ec4e49df38af962039f99554bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Generate tempest verification report (HTML)Juha Kosonen1-4/+19
JIRA: FUNCTEST-934 Change-Id: I2befbd3f2b2311f69b24321c7e9544fb43df3a9d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-19Precise Tempest tests listCédric Ollivier1-2/+2
Else full mode could run tests defined in tempest plugins too [1]. [1] https://docs.openstack.org/tempest/latest/plugin-registry.html Change-Id: I4355b03ba1b9ba47938f748c4f1a8822fd412142 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Enhance variable manipulation in tempestJuha Kosonen1-12/+13
Use getattr/setattr to read/write CONST. JIRA: FUNCTEST-932 Change-Id: Ic9a944100c60563b16f5d89b622ef7f04183cceb Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-16Mock additional methods related to OpenStackFlavorCédric Ollivier1-0/+2
keystone_utils.keystone_client() and keystone_utils.get_project() have to be mocked when unit testing flavor creation since [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/52157/ Change-Id: I898cde1001c14d0b450c3dd43ade7dca47b1ffb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-16Get properly env vars or their default valuesCédric Ollivier1-5/+5
It defines env.get() as an unique way to get Functest env vars or their default values. It can be considered as a wrapper above os.environ. It enforces backward compatibility via CONST which mustn't be used for that purpose. It should be noted that it also stops using CONST for getting OpenStack env vars. Change-Id: I333dc1afbc0123166a7eaff8b551370098efa341 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Merge "Fix the config of fixed_network_name in tempest"Cedric Ollivier1-2/+3
2018-02-13Fix the config of fixed_network_name in tempestLinda Wang1-2/+3
Change-Id: I58726d0fec5b2da4ea8ac1f9925fe56d2f9d7ce0 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-12Enable invalid-name warnings in tempest modulesJuha Kosonen2-55/+56
Do not suppress pylint invalid-name warnings but conform the naming convention. Change-Id: I324d25b3081fe8a366249559b343c1b9cacadb21 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-09Fix pylint errors/warnings in tempest modulesJuha Kosonen2-47/+56
JIRA: FUNCTEST-913 Change-Id: I37b25bbcf43fb1d6f7de0c815ad49070d1e1af12 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-02Do not use shell to execute commands in tempestJuha Kosonen1-4/+3
Change-Id: I4d699481fdc63058c12ca9cfe18138e87025e9b3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-31Use snaps_utils to get credentials in tempestJuha Kosonen2-3/+6
Change-Id: I1d240d5edd536d71c87a7dff4e2676715697d0e2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-01-21Disable all missing-docstring warnings in unit testsCédric Ollivier2-0/+4
Change-Id: I22b7bbdab5f000b4ade6c2ba3a4029c146887cbd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-06Fix the yamllint errors in functest/ciLinda Wang1-19/+6
And also, remove the params "tempest_use_custom_images" and "unique_names" of vping, rally and tempest. Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-23Remove openstack utils calls in rally and tempestLinda Wang1-11/+2
Mainly, update "rally deployment create --file=rally_conf.json" to "rally deployment create --fromenv" Change-Id: I6dd4c7ea2d9d6f47dee49a4fd416e62bd557f45e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-13Move rally and tempest out of functest-coreLinda Wang1-8/+66
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-11Merge "Remove get_repo_tag"Cedric Ollivier1-11/+0
2017-09-05Merge "Create results/tempest dir for refstack config"Cedric Ollivier1-1/+15
2017-09-05Create results/tempest dir for refstack configLinda Wang1-1/+15
When generating refstack client reference tempest conf file, the step of tempest.conf backup is necessary. So if the dir results/tempest is absent, error shows: [Errno 2] No such file or directory: '/home/opnfv/functest/results/tempest/tempest.conf' Change-Id: I7aba5baff55a51881d125b28f99d71d0cc0a5c72 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-04Remove get_repo_tagJuha Kosonen1-11/+0
Not in use after removal of multisite support [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/39569/ Change-Id: I1346c78743690a2e5279d3b1883501dfe19078e3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-02Enable tempest multinode testsJuha Kosonen1-0/+15
JIRA: FUNCTEST-774 Change-Id: I259a9a37e40dba6a6594941d989e5aa1858e4a04 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-24Fix the tempest error when creating snapshotLinda Wang1-15/+1
Change-Id: I9682f174a835d2bdf1ef3da01e369037e5ad7247 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-23Refactor resource creation and cleanup in TempestMartin Kulhavy2-122/+92
Use Snaps to create resources before running a testcase and to clean up afterwards. Use Tempest Cleanup utility to clean other resources. Change-Id: Ic0f69d3bafb60dfb283d18ac507e9f5992e9ae38 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-08-22Config test_accounts_file for refstack_defcoreLinda Wang1-13/+69
Tenant and user are required by refstack_defcore, which could be configured in the test_accounts_file. [1] [1]: https://github.com/openstack/refstack-client/blob/master/refstack_client/refstack_client.py#L170-L193 Change-Id: I9c920b6f15f491d671ebf222976305bedf4dd747 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-18Remove the tenant and user created for tempestLinda Wang1-18/+0
According to the module [1] in tempest to parse tempest.conf, the three params in session idenity are invalid: [identity] tenant_name = tempest username = tempest password = Tempest123! Then there is no need to create tenant and user before running tempest and refstack_defcore. [1]: https://github.com/openstack/tempest/blob/14.0.0/tempest/config.py#L120 JIRA: FUNCTEST-864 Change-Id: Idac46e1e620324c584c8021c0bdf843f8823155a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-18Remove multisite supportJuha Kosonen2-65/+0
JIRA: FUNCTEST-866 Change-Id: I55a4416688b2aca0897910cac69b33e154e73095 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-10Fix the logic of adding/updating tempest.confLinda Wang1-3/+2
Change-Id: I850311a9306607106836f24594019e98d2fd9499 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-10Add/Update tempest.conf via a specific fileLinda Wang1-1/+4
Provides a convenient way to configure all params which users required. JIRA: FUNCTEST-860 Change-Id: Iadfb704285f94530e1023ee780138f22dd672d33 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-06-20Remove all references to /home/opnfv/repos/functestCédric Ollivier1-3/+0
It also removes relative (and incomplete) references which could be defined in modules instead of this global configuration. Change-Id: Ie20dc3547e49b6224aa8100cd380d37b87ece5a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Merge "Replace CONST.* by getattribute/setattr for rally and tempest"Jose Lausuch2-22/+22
2017-05-19Replace CONST.* by getattribute/setattr for rally and tempestLinda Wang2-22/+22
Directories affected: - functest/opnfv_tests/openstack/rally - functest/opnfv_tests/openstack/tempest and respective unit test JIRA: FUNCTEST-796 Change-Id: I963f5947663f0b660337f3304defb697f5d338f3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Merge "Modify how to disable logging in unit test."Jose Lausuch2-4/+2
2017-05-18Modify how to disable logging in unit test.Cédric Ollivier2-4/+2
Logs are only disabled when the unit tests are run from cmdline. It allows running them via pytest_suite_runner.py and printing their results to functest.log. You should notice that the unit test must disable the logger of the tested TestCase (e.g. testcase.TestCase.logger.disabled = 1). Otherwise false logs will be printed in console. Change-Id: Ic171e4575c8bab2e52db1897ae026b61a03b6247 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Remove check_success_ratejose.lausuch1-18/+0
After the introduction of is_successful method in TestCase class, this is not needed anymore. Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-04-26Fix false positives in test_tempestCédric Ollivier1-92/+74
It fixes the return values and the side effects expected from the next methods: - configure_tempest - create_tempest_resources - generate_test_list - apply_tempest_blacklist - run_verifier_tests - parse_verifier_result JIRA: FUNCTEST-803 Change-Id: Ib7dbd28e003cf0f27f497ad8e63cf7ae5ce564de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Manage criteria in TestCaseCédric Ollivier1-1/+1
It converts all criteria values to the corresponding percent in functest/ci/testcases.yaml. Result is expected to be equal or greater than criteria. If both are 0, result is considered as false. It is compatible with the old behavior but warns to update. It will allow a safer remove. It also fixes a bug in test_tempest to allow merging [1] and tier_handler.py which required that type criteria was str. [1] https://gerrit.opnfv.org/gerrit/#/c/27949/ Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-24Remove the useless opnfv_tests dir in testsCédric Ollivier3-0/+643
Change-Id: I41a8db181adf6c0c67b9de8380c3ccdd1ad3b529 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>