aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2017-11-15Fix the regular expression for refstackLinda Wang1-3/+3
Otherwise, this line could not be matched: {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.143237s] ... ok -> the matched result: tempest.api.identity.v3.test_t Change-Id: I97282a9c98a889a015a40f9ad2d700906bb88fb1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-13Move rally and tempest out of functest-coreLinda Wang2-1/+63
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-10Select the subset of snaps test casesLinda Wang4-9/+434
Change-Id: I03e422d5dae0ced9cd7a5477c31359ffc7795c42 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-06Protect vs exceptions when ext_nets is emptyCédric Ollivier1-1/+1
Otherwise several exceptions are raised in TestCase constructors (those defined in heathcheck). Change-Id: I4cb054f7092ea9db02cb8c4469e99848533c556b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-05Merge "Add new cinder scenarios for rally sanity/full"Cedric Ollivier2-0/+157
2017-11-04Fix rally cinder scenariosJuha Kosonen1-10/+2
Remove network and servers context and set image and flavor as a scenario parameters. Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-03Add new cinder scenarios for rally sanity/fullJuha Kosonen2-0/+157
Included several CinderQos and CinderVolumeTypes scenarios introduced by the recent Rally version. Change-Id: Ibd2affa2e0d24ec79d3b4518456ca0f0457ace9f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-02Add new neutron scenarios for rally sanity/fullJuha Kosonen2-0/+168
Included several new NeutronNetworks and NeutronSecurityGroup scenarios introduced by the recent Rally version. Change-Id: I87ad0947ab6b4e1faf8fcad9006dbe34251c313b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Add new nova scenarios for rally sanity/fullJuha Kosonen2-0/+123
Several new NovaServers and NovaServerGroups scenarios available along with the recent Rally update. Change-Id: Iee27174923da5a1a25991d8ab5e18f1d404b09ef Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Merge "Add new glance scenarios for rally 0.10"Linda Wang2-1/+92
2017-10-31Add new glance scenarios for rally 0.10Linda Wang2-1/+92
Some new glance scenarios have been added in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I91ffe31b8cc5c94991c9bdd6e33b756c447d82ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-31Remove some obsolete scenarios for rally 0.10Linda Wang2-72/+0
Nova-Network are not alive any more and have been removed in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 JIRA: FUNCTEST-883 Change-Id: I45a20504589003a39ff27770709de6881e69aee3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-17Update blacklist about migration tests for rallyLinda Wang2-5/+6
The test NovaServers.boot_and_migrate_server needs at least 2 compute nodes: https://github.com/openstack/rally/blob/stable/0.9/rally/plugins/openstack/scenarios/nova/servers.py#L763-L765 Change-Id: I4ddf99188094ced57225d886037b00e91f3b68e6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-05Live migration support determination in rallyJuha Kosonen1-20/+11
Live migration test cases were excluded if tempest was not executed before rally since tempest config file is created during the execution of tempest. Remove the dependency to config file and define the support based on the number of computes as done in tempest. Change-Id: I57c18b7c57e6a4bc8bfbdfb4beb5f8d67c6269c4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-10-03Report duration and result when vping failsCédric Ollivier1-1/+3
It completes "Bug fix: vping_userdata test status was not properly reported" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/43911/ Change-Id: I7e8be6cd564a24ca174e63cfc295861c51cae8ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-03Create a router in both vping scenariiCédric Ollivier2-19/+17
It fixes vping_userdata as it allows getting metadata due to the gateway defined for the subnet. It could be noted that DHCP can add the route needed if no gateway is defined and if force_metadata is set in dhcp_agent.ini. Change-Id: Ia62e0f00e3d2caee6262dd9cd9966d1f21fe40d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-02Bug fix: vping_userdata test status was not properly reportedMorgan Richomme1-1/+1
vping_base is calling vping_userdata vping_user data could return only EX_TESTCASE_FAILED or EX_OK by default vping_base always returns EX_OK (based on self.result=100..) it returned EX_RUN_ERROR only if upper class report EX_RUN_ERROR that is why vping_userdata was always PASS even if the trace "Ping OK" cannot be retrieved from the Nova console it seems that when running the vping_userdata, we systematically got Failed to read iid from metadata Change-Id: If72441dd93bffada5c7a5399c87db68d7ebeebed Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-30Fix userdata issue for vping and orchestraLinda Wang2-4/+4
1. When creating VM, the type of the param userdata should be str, to conform with that in snaps [1]. 2. Remove the infinite loop for vping in userdata 3. Fix the criteria for vping_userdata and vping_ssh [1]: https://git.opnfv.org/snaps/tree/snaps/openstack/utils/nova_utils.py#n92 Change-Id: I262a7ebb93ec90bb6f8f3acb5d564f210abcfc4b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-20Dedicated flavors for rally testsJuha Kosonen2-3/+31
Create flavors and use them in rally scenarios instead of expecting certain flavors to pre-exist. Change-Id: I77c94ab80fcabd7b80ffb36f9856a48121858009 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-18Fix image name in rally scenariosJuha Kosonen1-6/+6
Change-Id: I0a78a16d44c1e0e0b2edec2e43954c1f08e8bb09 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-15Merge "Refactor resource creation and cleanup in rally"Cedric Ollivier1-33/+79
2017-09-15Refactor resource creation and cleanup in rallyJuha Kosonen1-33/+79
Use SNAPS to create and delete resources. Change-Id: Ic4d390382acea2be196e8a7518cb8cce25276a45 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-15Enable tempest run concurrentlyLinda Wang1-8/+19
Append a guid to the end of names of resources created for tempest, including project, user, network, images and flavors. Change-Id: I01fc7c5cb45cd5724a99ba1d220c3f3f7d6639cf Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-11Remove volume type handlingJuha Kosonen2-42/+0
Rally scenarios don't require volume type to exist as a precondition. Change-Id: Id735346e062af084635fd8f76f3686005b9b8add Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-11Allow live migration related tests to runLinda Wang2-1/+2
For tempest or rally, if there are more than 1 compute node, live migration related tests should not be skipped or blacklisted if shared storage is enabled via ceph. Change-Id: Ic93e4f508b597c657abe8d246f0cf9c2b5dfd020 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-11Merge "Remove get_repo_tag"Cedric Ollivier1-11/+0
2017-09-08Fix pylint errors in test_refstack_clientLinda Wang1-2/+5
Change-Id: Ia53ac75c913f351412180b9b71a56b4c5fbbe4a5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-07Remove redundant tempest cleanup utilityLinda Wang2-82/+1
All the resources including the project, user, network, images and flavors to enable tempest running, are created by snaps-OO, which will definitely clean up those finally. Change-Id: Iea3e3f275cc6cfd2cee421fcafef90aaf2e6cf3e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-06Merge "Add UEFI support in functest"Morgan Richomme1-1/+6
2017-09-05Merge "Create results/tempest dir for refstack config"Cedric Ollivier1-0/+2
2017-09-05Merge "Enable tempest multinode tests"valentin boucher3-6/+25
2017-09-05Create results/tempest dir for refstack configLinda Wang1-0/+2
When generating refstack client reference tempest conf file, the step of tempest.conf backup is necessary. So if the dir results/tempest is absent, error shows: [Errno 2] No such file or directory: '/home/opnfv/functest/results/tempest/tempest.conf' Change-Id: I7aba5baff55a51881d125b28f99d71d0cc0a5c72 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-04Remove get_repo_tagJuha Kosonen1-11/+0
Not in use after removal of multisite support [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/39569/ Change-Id: I1346c78743690a2e5279d3b1883501dfe19078e3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-04Blacklist CeilometerTraits testsJuha Kosonen1-0/+1
Requires a deprecated Ceilometer API which was removed in ocata. Panko provides the API but is not yet supported by OPNFV installers. Change-Id: I85ab97099b8adfa1d15fe4195bc5703f2f4e83b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-02Enable tempest multinode testsJuha Kosonen3-6/+25
JIRA: FUNCTEST-774 Change-Id: I259a9a37e40dba6a6594941d989e5aa1858e4a04 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-01Add UEFI support in functestCatalina Focsa1-1/+6
Add extra properties to the cirros image for ARM architecture. In the glanceclient repository, the create method expects **kwargs as parameters, thus an extra_properties variable containing a dictionary of property-value pairs can be added (if given) to the image to be created. If the properties do not appear, the call should not affect the image properties because the dictionary is initialized as empty. Change-Id: I690da90e6c6f250bd0a3d99cce39aa250e19b9c2 Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>
2017-08-31Blacklist CeilometerEvents testsJuha Kosonen1-0/+10
Ceilometer Events API is deprecated and removed in ocata. Panko provides the API but is not yet supported by OPNFV installers. Change-Id: I4bf29ca9371fa87a43df3ce32ac206a5e9363468 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-28Merge "Obtain scenario by CONST instead of get function"Cedric Ollivier3-6/+4
2017-08-28Avoid exiting when snapshot initialization failedLinda Wang2-10/+16
Change-Id: Ia8162d6c64847090d94f97fdab92cad2b5f059f1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-28Obtain scenario by CONST instead of get functionLinda Wang3-6/+4
JIRA: FUNCTEST-763 Change-Id: Ic9fa3243b50a09de8a5e531fed8298997367dd84 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-26Add log info of refstack tests into functest.logLinda Wang1-0/+8
Change-Id: I9edf555ba17b491768fbe298e65c3b11b341d76e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-25Fix the config of vping netLinda Wang1-3/+3
Change-Id: I71cea850985c67cf4c4e42a29600f9d63291fc94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-24Merge "Added means to override the RC file credentials."Linda Wang2-2/+13
2017-08-24Merge "Fix the tempest error when creating snapshot"Cedric Ollivier3-17/+23
2017-08-24Fix the tempest error when creating snapshotLinda Wang3-17/+23
Change-Id: I9682f174a835d2bdf1ef3da01e369037e5ad7247 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-08-24Merge "Add Rally scenarios for telemetry"Morgan Richomme5-2/+743
2017-08-24Add Rally scenarios for telemetryMartin Kulhavy5-2/+743
Ceilometer scenarios were added. Reasons for testcase blacklisting: - Deprecated ceilometer client used by Rally. This depends on the confuguration of the system, currently it seems to affect all installers. - A bug in ceilometer client (already fixed and merged in OpenStack repository). JIRA: FUNCTEST-849 Change-Id: I0bd7e1e9817538165b7b9705bcec213d7d275359 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-08-23Refactor resource creation and cleanup in TempestMartin Kulhavy4-128/+296
Use Snaps to create resources before running a testcase and to clean up afterwards. Use Tempest Cleanup utility to clean other resources. Change-Id: Ic0f69d3bafb60dfb283d18ac507e9f5992e9ae38 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-08-23Merge "Add the skipped testcases into details"Cedric Ollivier1-2/+5
2017-08-23Merge "Specify physical_network when creating network"Cedric Ollivier1-4/+23