aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2017-08-23Refactor resource creation and cleanup in TempestMartin Kulhavy4-128/+296
Use Snaps to create resources before running a testcase and to clean up afterwards. Use Tempest Cleanup utility to clean other resources. Change-Id: Ic0f69d3bafb60dfb283d18ac507e9f5992e9ae38 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-08-23Merge "Add the skipped testcases into details"Cedric Ollivier1-2/+5
2017-08-23Merge "Specify physical_network when creating network"Cedric Ollivier1-4/+23
2017-08-22Config test_accounts_file for refstack_defcoreLinda Wang1-0/+51
Tenant and user are required by refstack_defcore, which could be configured in the test_accounts_file. [1] [1]: https://github.com/openstack/refstack-client/blob/master/refstack_client/refstack_client.py#L170-L193 Change-Id: I9c920b6f15f491d671ebf222976305bedf4dd747 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-22Specify physical_network when creating networkLinda Wang1-4/+23
When the network_type is vlan, it is necessary to specify physical_network and segmentation_id. JIRA: FUNCTEST-863 Change-Id: Ia1acb0181e4f78654ecf5500c4c0366b143a91f5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-22Add the skipped testcases into detailsLinda Wang1-2/+5
When running tempest_custom, if all tests are skipped, record them in details. Change-Id: Ie18ec0911ff298f91c524a9cd039929c2d0f6425 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-18Remove the tenant and user created for tempestLinda Wang1-25/+0
According to the module [1] in tempest to parse tempest.conf, the three params in session idenity are invalid: [identity] tenant_name = tempest username = tempest password = Tempest123! Then there is no need to create tenant and user before running tempest and refstack_defcore. [1]: https://github.com/openstack/tempest/blob/14.0.0/tempest/config.py#L120 JIRA: FUNCTEST-864 Change-Id: Idac46e1e620324c584c8021c0bdf843f8823155a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-18Remove multisite supportJuha Kosonen2-108/+0
JIRA: FUNCTEST-866 Change-Id: I55a4416688b2aca0897910cac69b33e154e73095 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-15Remove timestamp in the details for tempestLinda Wang2-6/+6
Example: "success": ["2017-08-15 06:59:30.445 1180 INFO opnfv-tempest [-] {0} tempest.sce nario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops"] which is updated to: "success": ["tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_serv er_basic_ops"] Change-Id: Iad13e380b3a1fdc37b7742929512098bccc6d460 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-10Fix the logic of adding/updating tempest.confLinda Wang1-1/+1
Change-Id: I850311a9306607106836f24594019e98d2fd9499 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-10Merge "Record the test cases passed in tempest"Cedric Ollivier2-12/+16
2017-08-10Merge "Add/Update tempest.conf via a specific file"Morgan Richomme2-0/+30
2017-08-10Add/Update tempest.conf via a specific fileLinda Wang2-0/+30
Provides a convenient way to configure all params which users required. JIRA: FUNCTEST-860 Change-Id: Iadfb704285f94530e1023ee780138f22dd672d33 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-09Record the test cases passed in tempestLinda Wang2-12/+16
Also, convert the test cases recorded with string into list Change-Id: Ie3980a555b4042e6fe9706320d33d4ec4c06ea0c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-29Restrict ping only once in ping.shLinda Wang1-11/+8
Otherwise, it makes no sense to configure ping_timeout as 200 times. Change-Id: I6e15f5149f24a4316f6d5b70bcda9a46418d1522 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-19Add id to test_list for tempest_customLinda Wang1-2/+2
Tempest_custom will fail if only the test name is provided without id. Change-Id: I170eff4215bcb09c6469072079091670aabaad5b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-18Merge "Change calls to SNAPS library exposing OpenStack instance objects."Jose Lausuch2-2/+2
2017-07-17Conform the RefStack testcase with the Rally contextCédric Ollivier1-4/+9
If the RefStack testcase relies on the Tempest configuration generated by Rally, it must conforms with the related context [1]. [1] https://raw.githubusercontent.com/openstack/rally/0.9.1/rally/plugins/openstack/verification/tempest/context.py Change-Id: Ia62c0a328c53a1541aeaf8668e1f34ae67898eed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-17Wait for refstack-client to finishCédric Ollivier1-31/+18
The previous implementation waited for /bin/sh to finish instead of refstack-client. Then tempest still ran in background even if the tescase was considered as finished. Now all tempest logs are only printed in the dedicated file. Change-Id: I94cd7c6fe68f3bc21782d8d9c43feee338c103ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-14Change calls to SNAPS library exposing OpenStack instance objects.spisarski2-2/+2
Openstack object structures can change when new API versions are released and SNAPS no longer is exposing OpenStack object implementations as this makes the library brittle. The only two SNAPS method calls affected are when functest needs to query for external networks and when vPing Userdata needs to obtain the console logs. JIRA: SNAPS-125 Change-Id: If6000e50eaa274713d9a6c964eabd1f73ded684e Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-07-11Add decorators in testcases for energy recording.Benoit HERARD3-152/+223
Test cases are: - rally (sanity and full) - refstack - cloudify_ims - vping_ssh It also fix a bug on "energy_recording" decorator of energy module. Change-Id: I625c214552ad1b89eaf7e196e706d7c69b37da33 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-07-10Allow regex for blacklist scenarios/installersMartin Kulhavy2-11/+36
Reasoning: Some blacklisted test cases apply to a range of scenarios, e.g. both 'ha' and 'noha' and possibly even to all scenarios for a specific installer -- therefore the list of excluded scenarios can get long and unclear. For consistency with rally test case scenarios also allow regex for installers specification. Additionally, log the excluded test cases (if any) to debug log. Change-Id: Ie0bec35d1a6443203d4719ea5428c437c12e5e12 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-07-06Fix logger name in vping_base.pyCédric Ollivier1-1/+1
It conforms with logging.ini which requires qualnames. Change-Id: Ic2f849009c31a3a7bc406fc44c4917d19ccf2424 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-05Merge "bugfix: vping support not_hugepage_configured pod"valentin boucher1-1/+1
2017-07-05Enable refstack work on https without SSL checksLinda Wang1-8/+9
When refstack is run in https environment, SSL checks will be skipped if no cacert file is provided. JIRA: FUNCTEST-828 Change-Id: Ib44582b4f2f508c7a255a1510dbdc33110fe0f14 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-05bugfix: vping support not_hugepage_configured podSerenaFeng1-1/+1
this bug was fixed in https://gerrit.opnfv.org/gerrit/#/c/35181/ but was reverted in https://gerrit.opnfv.org/gerrit/#/c/35671/ Change-Id: I5cbbd61ac196dc39c073ffc69254d987e4807130 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-07-04Cleanup Tempest blacklist for Euphratesjose.lausuch1-62/+0
This list hasn't been updated in Danube. The idea is to clean it up and allow all the test cases to be run. If bugs are detected in Euphrates and there is an upstream bug report, the affected tests can be added again here. Change-Id: I44c8b4e8ae78dee7f13f761b6f7f6d8c09b2d0b0 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-07-02Apply restrictive file permissionsCédric Ollivier1-0/+0
It conforms with [1] by creating a new venv which checks the unix permissions. As jjobs call Functest console scripts [2], all perms can be 644. Dockerfiles are updated as well. [1] https://security.openstack.org/guidelines/dg_apply-restrictive-file-permissions.html [2] https://gerrit.opnfv.org/gerrit/#/c/36805/ Depends-On: I9209e6efa1b493e24135402a46df72aaa14115d1 Change-Id: I31bc7f12b775928845e23b6b40288b0a50b87219 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-30Define download_images.sh and check_os.sh as scriptsCédric Ollivier2-263/+0
It also updates all python scripts which call check_os.sh. The former healthcheck.sh is removed. No shell script must be executable in git. Change-Id: If4e8deb50ebd635a9091e3bb79ef61c07b9660dc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-30Define console_scriptsCédric Ollivier4-20/+7
Only prepare_env.py and run_tests.py remain executable to avoid breaking the gate. As soon as the jenkins jobs are updated to run them from $PATH, tox will be updated to protect against chmod a+x py files. Dockerfile will be simplified as well. Change-Id: Iac1a7ceb6b344e800177226ea39919826f6d3735 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-30Merge "Added unit tests for vping."Jose Lausuch2-99/+55
2017-06-29Merge "SNAPS tests now support offline testing."Jose Lausuch5-26/+13
2017-06-28Fix refstack_defcoreLinda Wang1-20/+5
As refstack-client is reinstalled only by the shell setup_env, the path of .venv and .tempest have been changed. Change-Id: Id50d0c6384295c2448705961942104abbd799b9b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-06-27Added unit tests for vping.spisarski2-100/+56
Also removed some instance variables and unnecessary methods. JIRA: FUNCTEST-813 Change-Id: I13895674a9fd3de16c6a19410661440c5380c2f8 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-06-27SNAPS tests now support offline testing.spisarski5-26/+13
Images by type (cirros, centos, ubuntu) can now have the download URL be overridden, told to leverage a local file, or have custom configuration when using the snaps.openstack.tests.openstack_tests.py image settings helper functions. JIRA: FUNCTEST-809 Change-Id: I790094a7a26eb5a55f53d6e875c658dc5e7ac2f9 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-06-27Remove Rally requests scenarioJuha Kosonen3-19/+1
HttpRequests scenario is not directly related to OpenStack and not supported by Rally in https environment. Change-Id: I2e91d129d82dfaba62eca25e3e4890ff54f52ac6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-06-27Merge "Remove obsolete repos in functest/ci/config_functest.yaml"Jose Lausuch1-1/+2
2017-06-27Merge "Added unit tests for api_check, health_check, and smoke tests."Jose Lausuch3-3/+27
2017-06-26Fixed problem to vping userdata introducted by SNAPS-OO patch.spisarski1-1/+1
Changed get_vm_inst() to return a domain object forgot to change the call in vping_userdata.py. JIRA: SNAPS-92 Change-Id: I7585dcde483c39fa850e5184686f42bbf2e8f3c5 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-06-26Remove obsolete repos in functest/ci/config_functest.yamlCédric Ollivier1-1/+2
It completes "Use directly OpenStack project packages" [1]. kingbird becomes a dependency. [1] https://gerrit.opnfv.org/gerrit/#/c/36125/ Change-Id: I2cb9e3a2146a2b2bbae89dde9917c5ace70048a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-20Added unit tests for api_check, health_check, and smoke tests.spisarski3-3/+27
In addition to the creation of the unit tests, this patch simplifies the mocks for connection check as there was an unused annotation. This patch also refactors the building of the test suite from the constructor to the run() method. JIRA: FUNCTEST-813 Change-Id: I7ff5d0389db36141a33ee3a8f76e04b922f8a95f Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-06-20Remove all references to /home/opnfv/repos/functestCédric Ollivier6-35/+46
It also removes relative (and incomplete) references which could be defined in modules instead of this global configuration. Change-Id: Ie20dc3547e49b6224aa8100cd380d37b87ece5a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-07Configure the param auth_version in tempest.confLinda Wang1-0/+5
1. If the auth_url is "https://192.168.31.222:443/identity-admin/v3", the auth_version in tempest.conf is supposed to be "v3", not "id". 2. For rally 0.8.1. it is a bug when obtaining the auth_version, please see [1], which has been fixed in rally master. [1]: https://review.openstack.org/#/c/468599/ Change-Id: Ia7474938a741a0954f17f7c7650544dbc0a28853 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-31Added unit tests for the connection_check test case.spisarski2-6/+22
JIRA: FUNCTEST-813 Change-Id: Ib851a3942e181b1a91cad695504613868a340d15 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-30Merge "Define create_snapshot() and clean() in TestCase"Cedric Ollivier4-8/+8
2017-05-30Merge "vping&snaps_xxx support not_hugepage_supported pod"Serena Feng2-2/+2
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier4-8/+8
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-28Switch shebangs to /usr/bin/env pythonCédric Ollivier6-6/+6
It modified the shebang to /usr/bin/env which is considered as more flexible. Change-Id: I9c8cdb4243d41a83d524499cc91060d3700e008b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-25vping&snaps_xxx support not_hugepage_supported podSerenaFeng2-2/+2
if flavor_metadata is set to {'hw:mem_page_size': 'any'}, it means hugepage must be support by pod. but actually hugepage is not supported by all pods Change-Id: Ib0b716ecedacf7eeba2c0d0080be2707b1a87e73 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-05-24Merge "Rename the class TestSuiteRunner to Suite"valentin boucher1-1/+1