aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2017-09-15Merge "Refactor resource creation and cleanup in rally"Cedric Ollivier1-33/+79
2017-09-15Refactor resource creation and cleanup in rallyJuha Kosonen1-33/+79
Use SNAPS to create and delete resources. Change-Id: Ic4d390382acea2be196e8a7518cb8cce25276a45 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-15Enable tempest run concurrentlyLinda Wang1-8/+19
Append a guid to the end of names of resources created for tempest, including project, user, network, images and flavors. Change-Id: I01fc7c5cb45cd5724a99ba1d220c3f3f7d6639cf Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-11Remove volume type handlingJuha Kosonen2-42/+0
Rally scenarios don't require volume type to exist as a precondition. Change-Id: Id735346e062af084635fd8f76f3686005b9b8add Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-11Allow live migration related tests to runLinda Wang2-1/+2
For tempest or rally, if there are more than 1 compute node, live migration related tests should not be skipped or blacklisted if shared storage is enabled via ceph. Change-Id: Ic93e4f508b597c657abe8d246f0cf9c2b5dfd020 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-11Merge "Remove get_repo_tag"Cedric Ollivier1-11/+0
2017-09-08Fix pylint errors in test_refstack_clientLinda Wang1-2/+5
Change-Id: Ia53ac75c913f351412180b9b71a56b4c5fbbe4a5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-07Remove redundant tempest cleanup utilityLinda Wang2-82/+1
All the resources including the project, user, network, images and flavors to enable tempest running, are created by snaps-OO, which will definitely clean up those finally. Change-Id: Iea3e3f275cc6cfd2cee421fcafef90aaf2e6cf3e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-06Merge "Add UEFI support in functest"Morgan Richomme1-1/+6
2017-09-05Merge "Create results/tempest dir for refstack config"Cedric Ollivier1-0/+2
2017-09-05Merge "Enable tempest multinode tests"valentin boucher3-6/+25
2017-09-05Create results/tempest dir for refstack configLinda Wang1-0/+2
When generating refstack client reference tempest conf file, the step of tempest.conf backup is necessary. So if the dir results/tempest is absent, error shows: [Errno 2] No such file or directory: '/home/opnfv/functest/results/tempest/tempest.conf' Change-Id: I7aba5baff55a51881d125b28f99d71d0cc0a5c72 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-04Remove get_repo_tagJuha Kosonen1-11/+0
Not in use after removal of multisite support [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/39569/ Change-Id: I1346c78743690a2e5279d3b1883501dfe19078e3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-04Blacklist CeilometerTraits testsJuha Kosonen1-0/+1
Requires a deprecated Ceilometer API which was removed in ocata. Panko provides the API but is not yet supported by OPNFV installers. Change-Id: I85ab97099b8adfa1d15fe4195bc5703f2f4e83b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-02Enable tempest multinode testsJuha Kosonen3-6/+25
JIRA: FUNCTEST-774 Change-Id: I259a9a37e40dba6a6594941d989e5aa1858e4a04 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-01Add UEFI support in functestCatalina Focsa1-1/+6
Add extra properties to the cirros image for ARM architecture. In the glanceclient repository, the create method expects **kwargs as parameters, thus an extra_properties variable containing a dictionary of property-value pairs can be added (if given) to the image to be created. If the properties do not appear, the call should not affect the image properties because the dictionary is initialized as empty. Change-Id: I690da90e6c6f250bd0a3d99cce39aa250e19b9c2 Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>
2017-08-31Blacklist CeilometerEvents testsJuha Kosonen1-0/+10
Ceilometer Events API is deprecated and removed in ocata. Panko provides the API but is not yet supported by OPNFV installers. Change-Id: I4bf29ca9371fa87a43df3ce32ac206a5e9363468 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-28Merge "Obtain scenario by CONST instead of get function"Cedric Ollivier3-6/+4
2017-08-28Avoid exiting when snapshot initialization failedLinda Wang2-10/+16
Change-Id: Ia8162d6c64847090d94f97fdab92cad2b5f059f1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-28Obtain scenario by CONST instead of get functionLinda Wang3-6/+4
JIRA: FUNCTEST-763 Change-Id: Ic9fa3243b50a09de8a5e531fed8298997367dd84 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-26Add log info of refstack tests into functest.logLinda Wang1-0/+8
Change-Id: I9edf555ba17b491768fbe298e65c3b11b341d76e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-25Fix the config of vping netLinda Wang1-3/+3
Change-Id: I71cea850985c67cf4c4e42a29600f9d63291fc94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-24Merge "Added means to override the RC file credentials."Linda Wang2-2/+13
2017-08-24Merge "Fix the tempest error when creating snapshot"Cedric Ollivier3-17/+23
2017-08-24Fix the tempest error when creating snapshotLinda Wang3-17/+23
Change-Id: I9682f174a835d2bdf1ef3da01e369037e5ad7247 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-24Merge "Add Rally scenarios for telemetry"Morgan Richomme5-2/+743
2017-08-24Add Rally scenarios for telemetryMartin Kulhavy5-2/+743
Ceilometer scenarios were added. Reasons for testcase blacklisting: - Deprecated ceilometer client used by Rally. This depends on the confuguration of the system, currently it seems to affect all installers. - A bug in ceilometer client (already fixed and merged in OpenStack repository). JIRA: FUNCTEST-849 Change-Id: I0bd7e1e9817538165b7b9705bcec213d7d275359 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-08-23Refactor resource creation and cleanup in TempestMartin Kulhavy4-128/+296
Use Snaps to create resources before running a testcase and to clean up afterwards. Use Tempest Cleanup utility to clean other resources. Change-Id: Ic0f69d3bafb60dfb283d18ac507e9f5992e9ae38 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-08-23Merge "Add the skipped testcases into details"Cedric Ollivier1-2/+5
2017-08-23Merge "Specify physical_network when creating network"Cedric Ollivier1-4/+23
2017-08-22Config test_accounts_file for refstack_defcoreLinda Wang1-0/+51
Tenant and user are required by refstack_defcore, which could be configured in the test_accounts_file. [1] [1]: https://github.com/openstack/refstack-client/blob/master/refstack_client/refstack_client.py#L170-L193 Change-Id: I9c920b6f15f491d671ebf222976305bedf4dd747 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-22Specify physical_network when creating networkLinda Wang1-4/+23
When the network_type is vlan, it is necessary to specify physical_network and segmentation_id. JIRA: FUNCTEST-863 Change-Id: Ia1acb0181e4f78654ecf5500c4c0366b143a91f5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-22Add the skipped testcases into detailsLinda Wang1-2/+5
When running tempest_custom, if all tests are skipped, record them in details. Change-Id: Ie18ec0911ff298f91c524a9cd039929c2d0f6425 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-21Added means to override the RC file credentials.spisarski2-2/+13
This has been done primarily to support tests using SNAPS-OO JIRA: FUNCTEST-847 Change-Id: Icf02c085a95c20d4088e5aafd6380c70689a4ee0 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-08-18Remove the tenant and user created for tempestLinda Wang1-25/+0
According to the module [1] in tempest to parse tempest.conf, the three params in session idenity are invalid: [identity] tenant_name = tempest username = tempest password = Tempest123! Then there is no need to create tenant and user before running tempest and refstack_defcore. [1]: https://github.com/openstack/tempest/blob/14.0.0/tempest/config.py#L120 JIRA: FUNCTEST-864 Change-Id: Idac46e1e620324c584c8021c0bdf843f8823155a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-18Remove multisite supportJuha Kosonen2-108/+0
JIRA: FUNCTEST-866 Change-Id: I55a4416688b2aca0897910cac69b33e154e73095 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-15Remove timestamp in the details for tempestLinda Wang2-6/+6
Example: "success": ["2017-08-15 06:59:30.445 1180 INFO opnfv-tempest [-] {0} tempest.sce nario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops"] which is updated to: "success": ["tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_serv er_basic_ops"] Change-Id: Iad13e380b3a1fdc37b7742929512098bccc6d460 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-10Fix the logic of adding/updating tempest.confLinda Wang1-1/+1
Change-Id: I850311a9306607106836f24594019e98d2fd9499 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-10Merge "Record the test cases passed in tempest"Cedric Ollivier2-12/+16
2017-08-10Merge "Add/Update tempest.conf via a specific file"Morgan Richomme2-0/+30
2017-08-10Add/Update tempest.conf via a specific fileLinda Wang2-0/+30
Provides a convenient way to configure all params which users required. JIRA: FUNCTEST-860 Change-Id: Iadfb704285f94530e1023ee780138f22dd672d33 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-09Record the test cases passed in tempestLinda Wang2-12/+16
Also, convert the test cases recorded with string into list Change-Id: Ie3980a555b4042e6fe9706320d33d4ec4c06ea0c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-29Restrict ping only once in ping.shLinda Wang1-11/+8
Otherwise, it makes no sense to configure ping_timeout as 200 times. Change-Id: I6e15f5149f24a4316f6d5b70bcda9a46418d1522 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-19Add id to test_list for tempest_customLinda Wang1-2/+2
Tempest_custom will fail if only the test name is provided without id. Change-Id: I170eff4215bcb09c6469072079091670aabaad5b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-07-18Merge "Change calls to SNAPS library exposing OpenStack instance objects."Jose Lausuch2-2/+2
2017-07-17Conform the RefStack testcase with the Rally contextCédric Ollivier1-4/+9
If the RefStack testcase relies on the Tempest configuration generated by Rally, it must conforms with the related context [1]. [1] https://raw.githubusercontent.com/openstack/rally/0.9.1/rally/plugins/openstack/verification/tempest/context.py Change-Id: Ia62c0a328c53a1541aeaf8668e1f34ae67898eed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-17Wait for refstack-client to finishCédric Ollivier1-31/+18
The previous implementation waited for /bin/sh to finish instead of refstack-client. Then tempest still ran in background even if the tescase was considered as finished. Now all tempest logs are only printed in the dedicated file. Change-Id: I94cd7c6fe68f3bc21782d8d9c43feee338c103ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-14Change calls to SNAPS library exposing OpenStack instance objects.spisarski2-2/+2
Openstack object structures can change when new API versions are released and SNAPS no longer is exposing OpenStack object implementations as this makes the library brittle. The only two SNAPS method calls affected are when functest needs to query for external networks and when vPing Userdata needs to obtain the console logs. JIRA: SNAPS-125 Change-Id: If6000e50eaa274713d9a6c964eabd1f73ded684e Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-07-11Add decorators in testcases for energy recording.Benoit HERARD3-152/+223
Test cases are: - rally (sanity and full) - refstack - cloudify_ims - vping_ssh It also fix a bug on "energy_recording" decorator of energy module. Change-Id: I625c214552ad1b89eaf7e196e706d7c69b37da33 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-07-10Allow regex for blacklist scenarios/installersMartin Kulhavy2-11/+36
Reasoning: Some blacklisted test cases apply to a range of scenarios, e.g. both 'ha' and 'noha' and possibly even to all scenarios for a specific installer -- therefore the list of excluded scenarios can get long and unclear. For consistency with rally test case scenarios also allow regex for installers specification. Additionally, log the excluded test cases (if any) to debug log. Change-Id: Ie0bec35d1a6443203d4719ea5428c437c12e5e12 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>