aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack/tempest
AgeCommit message (Collapse)AuthorFilesLines
2017-11-13Move rally and tempest out of functest-coreLinda Wang1-1/+61
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-15Enable tempest run concurrentlyLinda Wang1-8/+19
Append a guid to the end of names of resources created for tempest, including project, user, network, images and flavors. Change-Id: I01fc7c5cb45cd5724a99ba1d220c3f3f7d6639cf Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-11Allow live migration related tests to runLinda Wang1-0/+1
For tempest or rally, if there are more than 1 compute node, live migration related tests should not be skipped or blacklisted if shared storage is enabled via ceph. Change-Id: Ic93e4f508b597c657abe8d246f0cf9c2b5dfd020 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-11Merge "Remove get_repo_tag"Cedric Ollivier1-11/+0
2017-09-07Remove redundant tempest cleanup utilityLinda Wang1-41/+0
All the resources including the project, user, network, images and flavors to enable tempest running, are created by snaps-OO, which will definitely clean up those finally. Change-Id: Iea3e3f275cc6cfd2cee421fcafef90aaf2e6cf3e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-05Merge "Create results/tempest dir for refstack config"Cedric Ollivier1-0/+2
2017-09-05Create results/tempest dir for refstack configLinda Wang1-0/+2
When generating refstack client reference tempest conf file, the step of tempest.conf backup is necessary. So if the dir results/tempest is absent, error shows: [Errno 2] No such file or directory: '/home/opnfv/functest/results/tempest/tempest.conf' Change-Id: I7aba5baff55a51881d125b28f99d71d0cc0a5c72 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-04Remove get_repo_tagJuha Kosonen1-11/+0
Not in use after removal of multisite support [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/39569/ Change-Id: I1346c78743690a2e5279d3b1883501dfe19078e3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-02Enable tempest multinode testsJuha Kosonen2-5/+13
JIRA: FUNCTEST-774 Change-Id: I259a9a37e40dba6a6594941d989e5aa1858e4a04 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-28Merge "Obtain scenario by CONST instead of get function"Cedric Ollivier1-2/+2
2017-08-28Avoid exiting when snapshot initialization failedLinda Wang1-5/+8
Change-Id: Ia8162d6c64847090d94f97fdab92cad2b5f059f1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-28Obtain scenario by CONST instead of get functionLinda Wang1-2/+2
JIRA: FUNCTEST-763 Change-Id: Ic9fa3243b50a09de8a5e531fed8298997367dd84 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-24Fix the tempest error when creating snapshotLinda Wang2-6/+6
Change-Id: I9682f174a835d2bdf1ef3da01e369037e5ad7247 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-23Refactor resource creation and cleanup in TempestMartin Kulhavy2-121/+238
Use Snaps to create resources before running a testcase and to clean up afterwards. Use Tempest Cleanup utility to clean other resources. Change-Id: Ic0f69d3bafb60dfb283d18ac507e9f5992e9ae38 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-08-23Merge "Add the skipped testcases into details"Cedric Ollivier1-2/+5
2017-08-22Config test_accounts_file for refstack_defcoreLinda Wang1-0/+51
Tenant and user are required by refstack_defcore, which could be configured in the test_accounts_file. [1] [1]: https://github.com/openstack/refstack-client/blob/master/refstack_client/refstack_client.py#L170-L193 Change-Id: I9c920b6f15f491d671ebf222976305bedf4dd747 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-22Add the skipped testcases into detailsLinda Wang1-2/+5
When running tempest_custom, if all tests are skipped, record them in details. Change-Id: Ie18ec0911ff298f91c524a9cd039929c2d0f6425 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-18Remove the tenant and user created for tempestLinda Wang1-25/+0
According to the module [1] in tempest to parse tempest.conf, the three params in session idenity are invalid: [identity] tenant_name = tempest username = tempest password = Tempest123! Then there is no need to create tenant and user before running tempest and refstack_defcore. [1]: https://github.com/openstack/tempest/blob/14.0.0/tempest/config.py#L120 JIRA: FUNCTEST-864 Change-Id: Idac46e1e620324c584c8021c0bdf843f8823155a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-18Remove multisite supportJuha Kosonen2-108/+0
JIRA: FUNCTEST-866 Change-Id: I55a4416688b2aca0897910cac69b33e154e73095 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-15Remove timestamp in the details for tempestLinda Wang1-3/+3
Example: "success": ["2017-08-15 06:59:30.445 1180 INFO opnfv-tempest [-] {0} tempest.sce nario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops"] which is updated to: "success": ["tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_serv er_basic_ops"] Change-Id: Iad13e380b3a1fdc37b7742929512098bccc6d460 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-10Fix the logic of adding/updating tempest.confLinda Wang1-1/+1
Change-Id: I850311a9306607106836f24594019e98d2fd9499 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-10Merge "Record the test cases passed in tempest"Cedric Ollivier1-6/+10
2017-08-10Add/Update tempest.conf via a specific fileLinda Wang2-0/+30
Provides a convenient way to configure all params which users required. JIRA: FUNCTEST-860 Change-Id: Iadfb704285f94530e1023ee780138f22dd672d33 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-09Record the test cases passed in tempestLinda Wang1-6/+10
Also, convert the test cases recorded with string into list Change-Id: Ie3980a555b4042e6fe9706320d33d4ec4c06ea0c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-19Add id to test_list for tempest_customLinda Wang1-2/+2
Tempest_custom will fail if only the test name is provided without id. Change-Id: I170eff4215bcb09c6469072079091670aabaad5b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-17Conform the RefStack testcase with the Rally contextCédric Ollivier1-4/+9
If the RefStack testcase relies on the Tempest configuration generated by Rally, it must conforms with the related context [1]. [1] https://raw.githubusercontent.com/openstack/rally/0.9.1/rally/plugins/openstack/verification/tempest/context.py Change-Id: Ia62c0a328c53a1541aeaf8668e1f34ae67898eed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-04Cleanup Tempest blacklist for Euphratesjose.lausuch1-62/+0
This list hasn't been updated in Danube. The idea is to clean it up and allow all the test cases to be run. If bugs are detected in Euphrates and there is an upstream bug report, the affected tests can be added again here. Change-Id: I44c8b4e8ae78dee7f13f761b6f7f6d8c09b2d0b0 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-06-26Remove obsolete repos in functest/ci/config_functest.yamlCédric Ollivier1-1/+2
It completes "Use directly OpenStack project packages" [1]. kingbird becomes a dependency. [1] https://gerrit.opnfv.org/gerrit/#/c/36125/ Change-Id: I2cb9e3a2146a2b2bbae89dde9917c5ace70048a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-20Remove all references to /home/opnfv/repos/functestCédric Ollivier1-11/+11
It also removes relative (and incomplete) references which could be defined in modules instead of this global configuration. Change-Id: Ie20dc3547e49b6224aa8100cd380d37b87ece5a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-07Configure the param auth_version in tempest.confLinda Wang1-0/+5
1. If the auth_url is "https://192.168.31.222:443/identity-admin/v3", the auth_version in tempest.conf is supposed to be "v3", not "id". 2. For rally 0.8.1. it is a bug when obtaining the auth_version, please see [1], which has been fixed in rally master. [1]: https://review.openstack.org/#/c/468599/ Change-Id: Ia7474938a741a0954f17f7c7650544dbc0a28853 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-30Merge "Define create_snapshot() and clean() in TestCase"Cedric Ollivier1-1/+1
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier1-1/+1
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-28Switch shebangs to /usr/bin/env pythonCédric Ollivier2-2/+2
It modified the shebang to /usr/bin/env which is considered as more flexible. Change-Id: I9c8cdb4243d41a83d524499cc91060d3700e008b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-23Bugfix: fix two typosLinda Wang1-1/+1
1. In run_tests.py, test case name is shown before running: logger.error(kwargs['test']) -> logger.info(kwargs['test']) 2. In tempest.py, Verication -> Verification Change-Id: I117838cdb4b0f920c4cf855645d910e623e06868 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Replace CONST.* by getattribute/setattr for rally and tempestLinda Wang2-69/+82
Directories affected: - functest/opnfv_tests/openstack/rally - functest/opnfv_tests/openstack/tempest and respective unit test JIRA: FUNCTEST-796 Change-Id: I963f5947663f0b660337f3304defb697f5d338f3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Merge "Add a new directory to hold pre-downloaded images"Helen Yao1-1/+1
2017-05-18Remove check_success_ratejose.lausuch1-6/+12
After the introduction of is_successful method in TestCase class, this is not needed anymore. Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-18Add a new directory to hold pre-downloaded imageshelenyao1-1/+1
Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch2-4/+4
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier2-4/+4
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-03Update tempest.conf to enable tempest from external serverLinda Wang1-1/+8
1. The endpoint type to use for OpenStack Identity API v3 "v3_endpoint_type" is set to be "adminURL" by default, which should be updated to the env OS_ENDPOINT_TYPE with the value "publicURL" 2. Reset the identity region name to "RegionOne" 3. For keystone api v3 in Newton, 5 testcases aimming at identity admin v2 test should be omitted. JIRA: FUNCTEST-801 Change-Id: I47ae41a80de0a52d32d25c9783860955f465099c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-26Catch os.makedirs() exceptions in tempest.pyCédric Ollivier1-4/+2
It can raise an error exception if the leaf directory already exists or cannot be created [1]. [1] https://docs.python.org/2/library/os.html JIRA: FUNCTEST-804 Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier1-2/+2
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier1-14/+26
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-07Bugfixing the testcases execusionNikolas Hermanns1-2/+1
tempest.api.compute.servers.test_server_actions\ .ServerActionsTestJSON.test_reboot_server_hard is working in fuel so do test it. The "-" was missing so tempest.scenario.test_server_basic_ops .TestServerBasicOps.test_server_basic_ops was executed on fuel which is known to be not working since metadata service is not available. That was added already long ago but through the not adding of the "-" it got added again. Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-04-04Merge "Add case_name as constructor arg"valentin boucher1-20/+14
2017-04-04Add case_name as constructor argCédric Ollivier1-20/+14
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-30Merge "Clean up Tempest blacklist"Jose Lausuch1-20/+0
2017-03-30Clean up Tempest blacklistjose.lausuch1-20/+0
This list has been generated in Colorado and there are some scenarios that are deprecated and there is no need to list them here. Change-Id: I62a30b5026ed1df65ebdb7a68a6acf3364469865 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-29Disable tempest server reboot test for SDNVPN and GluonGeorg Kunz1-0/+12
Bug report: https://bugs.opendaylight.org/show_bug.cgi?id=5586 As a result, floating IPs are not working in Apex at the moment. Change-Id: I437c10b53dc01810ed757f040d3378c92320274b Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>