aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-11-15Fix the regular expression for refstackLinda Wang1-3/+3
Otherwise, this line could not be matched: {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.143237s] ... ok -> the matched result: tempest.api.identity.v3.test_t Change-Id: I97282a9c98a889a015a40f9ad2d700906bb88fb1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-13Move rally and tempest out of functest-coreLinda Wang7-166/+144
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-10Select the subset of snaps test casesLinda Wang5-21/+458
Change-Id: I03e422d5dae0ced9cd7a5477c31359ffc7795c42 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-06Move fds to features tierLinda Wang1-19/+19
Change-Id: I7aa9d73c7ffbfdad7d5a929968fb640d9a8de62e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-06Merge "Update Functest to OpenStack stable/pike"Morgan Richomme1-0/+6
2017-11-06Protect vs exceptions when ext_nets is emptyCédric Ollivier1-1/+1
Otherwise several exceptions are raised in TestCase constructors (those defined in heathcheck). Change-Id: I4cb054f7092ea9db02cb8c4469e99848533c556b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-05Merge "Add new cinder scenarios for rally sanity/full"Cedric Ollivier2-0/+157
2017-11-05Update Functest to OpenStack stable/pikeCédric Ollivier1-0/+6
It updates setup.py, (test-)requirement.txt and upper-constraints.txt according to OpenStack requirements [1]. It disables all Features testcases as they are not synchronized with OpenStack stable/pike yet [2]. The docker functest-parser is simplified as it can be based on functest-core as both Functest and Parser leverage on OpenStack stable/pike. ODL_TAG and REFSTACK_TAG variables are set to master again. [1] http://git.openstack.org/cgit/openstack/requirements/log/?h=stable/pike [2] https://wiki.opnfv.org/display/functest/Requirements+management Change-Id: I23fa84f35244c1f4026abd89414b99576f042ee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-04Fix rally cinder scenariosJuha Kosonen1-10/+2
Remove network and servers context and set image and flavor as a scenario parameters. Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-03Add new cinder scenarios for rally sanity/fullJuha Kosonen2-0/+157
Included several CinderQos and CinderVolumeTypes scenarios introduced by the recent Rally version. Change-Id: Ibd2affa2e0d24ec79d3b4518456ca0f0457ace9f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-03Remove the constraint of INSTALLER_TYPELinda Wang1-3/+0
Revert the patch: https://gerrit.opnfv.org/gerrit/#/c/45167 When run on non-opnfv deployment, there is no such concept of INSTALLER_TYPE. Change-Id: I3d420334c9329f7565cf22a0c314a4ffdb410d36 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-02Add new neutron scenarios for rally sanity/fullJuha Kosonen2-0/+168
Included several new NeutronNetworks and NeutronSecurityGroup scenarios introduced by the recent Rally version. Change-Id: I87ad0947ab6b4e1faf8fcad9006dbe34251c313b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-02Adopt new config schema for rally 0.10Linda Wang1-1/+2
The new config schema is used by Rally 0.10: https://raw.githubusercontent.com/openstack/rally/master/samples/deployments/existing-keystone-v3.json JIRA: FUNCTEST-883 Change-Id: I67c0081e23d7a763934ef2f8ce09f122c33af902 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-01Add new nova scenarios for rally sanity/fullJuha Kosonen2-0/+123
Several new NovaServers and NovaServerGroups scenarios available along with the recent Rally update. Change-Id: Iee27174923da5a1a25991d8ab5e18f1d404b09ef Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Merge "Add new glance scenarios for rally 0.10"Linda Wang2-1/+92
2017-10-31Add new glance scenarios for rally 0.10Linda Wang2-1/+92
Some new glance scenarios have been added in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I91ffe31b8cc5c94991c9bdd6e33b756c447d82ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-31Remove some obsolete scenarios for rally 0.10Linda Wang2-72/+0
Nova-Network are not alive any more and have been removed in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 JIRA: FUNCTEST-883 Change-Id: I45a20504589003a39ff27770709de6881e69aee3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-18Switch from BashFeature to Feature of bgpvpn testcaseJose Lausuch1-4/+2
With the adaptation in SDNVPN project [1], Functest can run the tests within python instead of a bash call. This also fixes pushing the details section to the DB: JIRA: SDNVPN-183 [1] https://gerrit.opnfv.org/gerrit/#/c/45491/ Change-Id: I7116aa9d5ffe2a816719997771e4f4ecebbcd083 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-17Update blacklist about migration tests for rallyLinda Wang3-7/+8
The test NovaServers.boot_and_migrate_server needs at least 2 compute nodes: https://github.com/openstack/rally/blob/stable/0.9/rally/plugins/openstack/scenarios/nova/servers.py#L763-L765 Change-Id: I4ddf99188094ced57225d886037b00e91f3b68e6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-17Merge "Enhance the compatibility judgement of INSTALLER"Cedric Ollivier1-0/+3
2017-10-16Enhance the compatibility judgement of INSTALLERLinda Wang1-0/+3
When the env INSTALLER_TYPE is None, while the var installer in dependencies is not None, the current test case should not be run. Change-Id: If1b67f16f39d5c44b2c3729819dd665faed41b73 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-14Update project field of fds testcase to fastdatastacksjuraj.linkes1-1/+1
Fds testcases is defined under project fastdatastacks, not functest. The fix is required for testcase results uploads. Change-Id: Ided0701048d0b4c0257c62d600893672960d83df Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2017-10-11Merge "Fix fail of vRouter on Orange POD"Morgan Richomme5-14/+11
2017-10-11Fix fail of vRouter on Orange PODroot5-14/+11
1. Functest docker container environment has no attribute 'OS_REGION_NAME' 2. vRouter was get the 'OS_REGION_NAME' but not used it. 3. Deleting use 'OS_REGION_NAME' part of vRouter. 4. Utility lib of vRouter use Nova client. 5. Modifying Nova client authentication step for auth api v3. 6. Doing test of modified vRouter on Orange POD. Change-Id: I062549e5ca48fb4825b53448a4e2ffc8c1f8ec40 Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-10-10Merge "Complete framework documentation part for VNF"Jose Lausuch1-11/+8
2017-10-10Complete framework documentation part for VNFMorgan Richomme1-11/+8
Change-Id: I4c59adfe1cfec278e0b267cc7a05e8addd45d034 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-09Add UEFI image extra properties for CentOS image for aarch64Delia Popescu1-0/+3
Add extra properties for CentOS image when using aarch64 architecture with UEFI boot mode Signed-off-by: Delia Popescu <delia.popescu@enea.com> Change-Id: Ie8aa7482627cbb3c31c6c72a31a0e37e86a409c4
2017-10-05Live migration support determination in rallyJuha Kosonen2-27/+35
Live migration test cases were excluded if tempest was not executed before rally since tempest config file is created during the execution of tempest. Remove the dependency to config file and define the support based on the number of computes as done in tempest. Change-Id: I57c18b7c57e6a4bc8bfbdfb4beb5f8d67c6269c4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-10-03Merge changes Ic06d47b4,I7e8be6cd,Ia62e0f00Morgan Richomme3-20/+21
* changes: Disable vyos_vrouter Report duration and result when vping fails Create a router in both vping scenarii
2017-10-03Disable vyos_vrouterCédric Ollivier1-0/+1
It's postponed to 5.1. Change-Id: Ic06d47b4b5df167044363b40aea0c7932b550be7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-03Report duration and result when vping failsCédric Ollivier1-1/+3
It completes "Bug fix: vping_userdata test status was not properly reported" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/43911/ Change-Id: I7e8be6cd564a24ca174e63cfc295861c51cae8ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-03Create a router in both vping scenariiCédric Ollivier2-19/+17
It fixes vping_userdata as it allows getting metadata due to the gateway defined for the subnet. It could be noted that DHCP can add the route needed if no gateway is defined and if force_metadata is set in dhcp_agent.ini. Change-Id: Ia62e0f00e3d2caee6262dd9cd9966d1f21fe40d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-02Add icmp rules for clearwaterims caseMichael Pauls1-0/+10
icmp rules must be enabled since a ping is used internally to check that other components are up and reachable Change-Id: I1ae3c301f30455c57193ddfe1757e971f5612c18 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-10-02Bug fix: vping_userdata test status was not properly reportedMorgan Richomme1-1/+1
vping_base is calling vping_userdata vping_user data could return only EX_TESTCASE_FAILED or EX_OK by default vping_base always returns EX_OK (based on self.result=100..) it returned EX_RUN_ERROR only if upper class report EX_RUN_ERROR that is why vping_userdata was always PASS even if the trace "Ping OK" cannot be retrieved from the Nova console it seems that when running the vping_userdata, we systematically got Failed to read iid from metadata Change-Id: If72441dd93bffada5c7a5399c87db68d7ebeebed Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-02Enable promise on all fuel and joid scenariiCédric Ollivier1-2/+2
Change-Id: I9735788fbbe715968560570543d1dc9d55e065b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-01Merge "remove icmp rules from secgroups"Morgan Richomme2-50/+0
2017-09-30Remove tempest_custom from testcases configsCédric Ollivier1-18/+0
Change-Id: I1237eaada5257a8c01753837a5820d840b51bff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-30Fix userdata issue for vping and orchestraLinda Wang4-6/+6
1. When creating VM, the type of the param userdata should be str, to conform with that in snaps [1]. 2. Remove the infinite loop for vping in userdata 3. Fix the criteria for vping_userdata and vping_ssh [1]: https://git.opnfv.org/snaps/tree/snaps/openstack/utils/nova_utils.py#n92 Change-Id: I262a7ebb93ec90bb6f8f3acb5d564f210abcfc4b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-29remove icmp rules from secgroupsMichael Pauls2-50/+0
Change-Id: I8f7d2170eee9777be6455d38eaff703338b155fa Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-09-28Merge "Switch to OS_PROJECT_NAME"Cedric Ollivier2-17/+19
2017-09-28Fix connection error due to invalid lib version usage.Benoit HERARD2-6/+10
Connection timeouts on "requests" objects was developped with requests 2.18 but target runtime is 2.12. Advanced timeout management of 2.18 is not available in 2.12. Change-Id: Ie6d81b91d4bcc0d73cffd007d9e46cdb19e47597 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-09-28Switch to OS_PROJECT_NAMECédric Ollivier2-17/+19
It simply conforms with OpenStack keystone v3. JIRA: FUNCTEST-877 Change-Id: I989a6eb4d8564948927c184a899b62ca763ef824 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-27Add log details on SDK first connection.Benoit HERARD2-18/+19
On first call to energy recording API, if API is unreachable, SDK don't do anything anymore. This change add logs on error for this first connection. Change-Id: I88892c769d6208c6ddf5d714d438ab584826844e Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-09-26Fix timeout for socket connectionLinda Wang1-13/+8
Change-Id: I0688761ba7224f40f79310295efadd9b40bfeefb Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-25Disable Promise testsuite on Fuel installerCharalampos Kominos1-2/+2
When promise reads API v3.0 from the creds file it automatically uses v2.0. which is deprecated and not used by fuel. Therefore promise is removed from the functest suite JIRA: ARMBAND-314 Change-Id: I22b875c198c1922fd4ddb06c81c05884b5248eb4 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
2017-09-25Merge "Fix creds still used by vrouter"Morgan Richomme1-4/+4
2017-09-25Fix creds still used by vrouterroot1-4/+4
1. 'CloudifyVrouter' object has no attribute 'creds' 2. 'CloudifyVrouter' object was still use 'creds' 3. Doing test of modified vyos_vrouter on our labs. Refer to following commit. https://gerrit.opnfv.org/gerrit/#/c/41249/ Change-Id: Id1b4dfa4c35aba9bbb4fd64ef58446d3e99468df Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-09-22Merge "Support https when testing ODL"Cedric Ollivier2-70/+73
2017-09-22Support https when testing ODLCédric Ollivier2-70/+73
It conforms with the last change on ODL tests [1]. Neutron endpoint is passed via robot args instead of Neutron ip. Keystone url (based on OS_AUTH_URL) is passed too to replace Keystone ip. [1] https://git.opendaylight.org/gerrit/#/c/63293/ Change-Id: Ie44f55304a438b1b0289ec69ac2241664be70e80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-21Merge "Adding orchestra test cases to orchestra project"Morgan Richomme1-2/+2