aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests
AgeCommit message (Collapse)AuthorFilesLines
2017-12-06Fix the yamllint errors in functest/ciLinda Wang5-33/+27
And also, remove the params "tempest_use_custom_images" and "unique_names" of vping, rally and tempest. Change-Id: Ic4243ef2f5e965910e5befa87db8d585cad34fa2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-05Fix pylint errors of vpingLinda Wang3-22/+25
Change-Id: I272f0eb6fb0f2a274484a3dcfacd8ed65e4a5b23 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-30Adjust timeouts in VnfsCédric Ollivier3-6/+6
When testcases fail, the jjobs is aborted and the result isn't printed. Change-Id: Ibda6268873303e631705c695a41c50980a3d29e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Skip modifying creds if Variables.robot is missingCédric Ollivier1-12/+15
Variable.robot is missing in functest-features [1]. As it's related to ODL csit suites, modifying it could be safely skipped as odl.py is designed for testing multiple ODL testcases. [1] https://gerrit.opnfv.org/gerrit/#/c/46225/ Change-Id: Id5f1947a073d251ef7480f418218a4c85fe078c1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-27Create RobotFramework classCédric Ollivier1-88/+25
It moves the capability to run any robot script from ODL TestCase into a new class: RobotFramework. It updates ODL TestCase and the related unit tests to inherit from the new parent class. Change-Id: I73e59ee9652fb63d9d89d7c75c58cce9cf62b0d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-25Remove os_utils call from cloudify ims and vrouterLinda Wang2-6/+9
Change-Id: I333551125616113484ad275820f2176dae79da6e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-23Fix relative imports in cloudify_ims_perfCédric Ollivier2-46/+35
It also fixes wrong indents. JIRA: FUNCTEST-893 Change-Id: Ic54e01c03c14f39c69242c41922fc124c1b45c23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-23Remove openstack utils calls in rally and tempestLinda Wang1-9/+5
Mainly, update "rally deployment create --file=rally_conf.json" to "rally deployment create --fromenv" Change-Id: I6dd4c7ea2d9d6f47dee49a4fd416e62bd557f45e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-22Merge "Removal of deprecated SNAPS-OO classes."Cedric Ollivier10-265/+270
2017-11-21Removal of deprecated SNAPS-OO classes.spisarski10-265/+270
JIRA: SNAPS-202 Change-Id: I115b4927b287a5525f4c1b95128d91f5229c7856 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-11-21Merge "Fix "Broken pipe" IOErrors of rally run"Linda Wang1-23/+21
2017-11-21Fix "Broken pipe" IOErrors of rally runJuha Kosonen1-23/+21
Replace obsolete os.popen with subprocess module usage in command output retrieval. Do not use shell as the program to execute. Change-Id: Ic63bb0f393750c3b85a35a37fecd46c1c1b96602 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-20Support to specify the valid external network nameLinda Wang1-1/+9
In some deployments, the retrieved external network by the def get_external_networks in Snaps checked by "router:external" is not available. So it is necessary to specify the available external network as an env by user. Change-Id: I333e91dd106ed307541a9a197280199fde86bd30 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Merge "Update the version of refstack set to 2017.09"Jose Lausuch1-10/+68
2017-11-15Merge "Fix the regular expression for refstack"Jose Lausuch1-3/+3
2017-11-15Update the version of refstack set to 2017.09Linda Wang1-10/+68
JIRA: FUNCTEST-890 Change-Id: Iac2f833fa2b704cd7caa6083e39e48e2df315890 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Fix the regular expression for refstackLinda Wang1-3/+3
Otherwise, this line could not be matched: {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.143237s] ... ok -> the matched result: tempest.api.identity.v3.test_t Change-Id: I97282a9c98a889a015a40f9ad2d700906bb88fb1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Add shebang in snaps_suite_builder.pyCédric Ollivier1-0/+2
Change-Id: I3392068b4a47d35bf0d91fe6d93f2de268f198bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-13Move rally and tempest out of functest-coreLinda Wang2-1/+63
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-10Select the subset of snaps test casesLinda Wang4-9/+434
Change-Id: I03e422d5dae0ced9cd7a5477c31359ffc7795c42 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-06Protect vs exceptions when ext_nets is emptyCédric Ollivier1-1/+1
Otherwise several exceptions are raised in TestCase constructors (those defined in heathcheck). Change-Id: I4cb054f7092ea9db02cb8c4469e99848533c556b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-05Merge "Add new cinder scenarios for rally sanity/full"Cedric Ollivier2-0/+157
2017-11-04Fix rally cinder scenariosJuha Kosonen1-10/+2
Remove network and servers context and set image and flavor as a scenario parameters. Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-03Add new cinder scenarios for rally sanity/fullJuha Kosonen2-0/+157
Included several CinderQos and CinderVolumeTypes scenarios introduced by the recent Rally version. Change-Id: Ibd2affa2e0d24ec79d3b4518456ca0f0457ace9f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-02Add new neutron scenarios for rally sanity/fullJuha Kosonen2-0/+168
Included several new NeutronNetworks and NeutronSecurityGroup scenarios introduced by the recent Rally version. Change-Id: I87ad0947ab6b4e1faf8fcad9006dbe34251c313b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Add new nova scenarios for rally sanity/fullJuha Kosonen2-0/+123
Several new NovaServers and NovaServerGroups scenarios available along with the recent Rally update. Change-Id: Iee27174923da5a1a25991d8ab5e18f1d404b09ef Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Merge "Add new glance scenarios for rally 0.10"Linda Wang2-1/+92
2017-10-31Add new glance scenarios for rally 0.10Linda Wang2-1/+92
Some new glance scenarios have been added in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I91ffe31b8cc5c94991c9bdd6e33b756c447d82ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-31Remove some obsolete scenarios for rally 0.10Linda Wang2-72/+0
Nova-Network are not alive any more and have been removed in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 JIRA: FUNCTEST-883 Change-Id: I45a20504589003a39ff27770709de6881e69aee3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-17Update blacklist about migration tests for rallyLinda Wang2-5/+6
The test NovaServers.boot_and_migrate_server needs at least 2 compute nodes: https://github.com/openstack/rally/blob/stable/0.9/rally/plugins/openstack/scenarios/nova/servers.py#L763-L765 Change-Id: I4ddf99188094ced57225d886037b00e91f3b68e6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-11Fix fail of vRouter on Orange PODroot4-13/+11
1. Functest docker container environment has no attribute 'OS_REGION_NAME' 2. vRouter was get the 'OS_REGION_NAME' but not used it. 3. Deleting use 'OS_REGION_NAME' part of vRouter. 4. Utility lib of vRouter use Nova client. 5. Modifying Nova client authentication step for auth api v3. 6. Doing test of modified vRouter on Orange POD. Change-Id: I062549e5ca48fb4825b53448a4e2ffc8c1f8ec40 Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-10-05Live migration support determination in rallyJuha Kosonen1-20/+11
Live migration test cases were excluded if tempest was not executed before rally since tempest config file is created during the execution of tempest. Remove the dependency to config file and define the support based on the number of computes as done in tempest. Change-Id: I57c18b7c57e6a4bc8bfbdfb4beb5f8d67c6269c4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-10-03Merge changes Ic06d47b4,I7e8be6cd,Ia62e0f00Morgan Richomme2-20/+20
* changes: Disable vyos_vrouter Report duration and result when vping fails Create a router in both vping scenarii
2017-10-03Report duration and result when vping failsCédric Ollivier1-1/+3
It completes "Bug fix: vping_userdata test status was not properly reported" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/43911/ Change-Id: I7e8be6cd564a24ca174e63cfc295861c51cae8ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-03Create a router in both vping scenariiCédric Ollivier2-19/+17
It fixes vping_userdata as it allows getting metadata due to the gateway defined for the subnet. It could be noted that DHCP can add the route needed if no gateway is defined and if force_metadata is set in dhcp_agent.ini. Change-Id: Ia62e0f00e3d2caee6262dd9cd9966d1f21fe40d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-02Add icmp rules for clearwaterims caseMichael Pauls1-0/+10
icmp rules must be enabled since a ping is used internally to check that other components are up and reachable Change-Id: I1ae3c301f30455c57193ddfe1757e971f5612c18 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-10-02Bug fix: vping_userdata test status was not properly reportedMorgan Richomme1-1/+1
vping_base is calling vping_userdata vping_user data could return only EX_TESTCASE_FAILED or EX_OK by default vping_base always returns EX_OK (based on self.result=100..) it returned EX_RUN_ERROR only if upper class report EX_RUN_ERROR that is why vping_userdata was always PASS even if the trace "Ping OK" cannot be retrieved from the Nova console it seems that when running the vping_userdata, we systematically got Failed to read iid from metadata Change-Id: If72441dd93bffada5c7a5399c87db68d7ebeebed Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-01Merge "remove icmp rules from secgroups"Morgan Richomme2-50/+0
2017-09-30Fix userdata issue for vping and orchestraLinda Wang4-6/+6
1. When creating VM, the type of the param userdata should be str, to conform with that in snaps [1]. 2. Remove the infinite loop for vping in userdata 3. Fix the criteria for vping_userdata and vping_ssh [1]: https://git.opnfv.org/snaps/tree/snaps/openstack/utils/nova_utils.py#n92 Change-Id: I262a7ebb93ec90bb6f8f3acb5d564f210abcfc4b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-29remove icmp rules from secgroupsMichael Pauls2-50/+0
Change-Id: I8f7d2170eee9777be6455d38eaff703338b155fa Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-09-28Switch to OS_PROJECT_NAMECédric Ollivier1-4/+4
It simply conforms with OpenStack keystone v3. JIRA: FUNCTEST-877 Change-Id: I989a6eb4d8564948927c184a899b62ca763ef824 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-25Merge "Fix creds still used by vrouter"Morgan Richomme1-4/+4
2017-09-25Fix creds still used by vrouterroot1-4/+4
1. 'CloudifyVrouter' object has no attribute 'creds' 2. 'CloudifyVrouter' object was still use 'creds' 3. Doing test of modified vyos_vrouter on our labs. Refer to following commit. https://gerrit.opnfv.org/gerrit/#/c/41249/ Change-Id: Id1b4dfa4c35aba9bbb4fd64ef58446d3e99468df Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-09-22Support https when testing ODLCédric Ollivier1-16/+18
It conforms with the last change on ODL tests [1]. Neutron endpoint is passed via robot args instead of Neutron ip. Keystone url (based on OS_AUTH_URL) is passed too to replace Keystone ip. [1] https://git.opendaylight.org/gerrit/#/c/63293/ Change-Id: Ie44f55304a438b1b0289ec69ac2241664be70e80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-20Dedicated flavors for rally testsJuha Kosonen2-3/+31
Create flavors and use them in rally scenarios instead of expecting certain flavors to pre-exist. Change-Id: I77c94ab80fcabd7b80ffb36f9856a48121858009 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-19Merge "Fix image name in rally scenarios"Cedric Ollivier1-6/+6
2017-09-18Fix image name in rally scenariosJuha Kosonen1-6/+6
Change-Id: I0a78a16d44c1e0e0b2edec2e43954c1f08e8bb09 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-18increase timeout of NFVO installationMichael Pauls2-16/+16
some pods are less powerful and require more time for the installation of the orchestrator Change-Id: Iebd39c0ef8f3dcfa7fecb1e507b2f05890b5c490 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-09-15Merge "Refactor resource creation and cleanup in rally"Cedric Ollivier1-33/+79
2017-09-15Refactor resource creation and cleanup in rallyJuha Kosonen1-33/+79
Use SNAPS to create and delete resources. Change-Id: Ic4d390382acea2be196e8a7518cb8cce25276a45 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>