aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-11-30Adjust timeouts in VnfsCédric Ollivier3-6/+6
When testcases fail, the jjobs is aborted and the result isn't printed. Change-Id: Ibda6268873303e631705c695a41c50980a3d29e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit abd9c1d00cb48a620317e50dd459cb0db2b5f0c5)
2017-11-30Reorder Vnf testcasesCédric Ollivier1-14/+15
Cloudify IMS testcases could easily tigger jjob timeouts. Vyos_router should run before as it ends much quickier. Change-Id: Icd4323a7216615e75613e5fb241ae144f727d4fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c38d87b9a57466a5663395926a576a87623eb2f4)
2017-11-30Fix fail of vRouter on Orange PODroot5-14/+11
1. Functest docker container environment has no attribute 'OS_REGION_NAME' 2. vRouter was get the 'OS_REGION_NAME' but not used it. 3. Deleting use 'OS_REGION_NAME' part of vRouter. 4. Utility lib of vRouter use Nova client. 5. Modifying Nova client authentication step for auth api v3. 6. Doing test of modified vRouter on Orange POD. Change-Id: I062549e5ca48fb4825b53448a4e2ffc8c1f8ec40 Signed-off-by: root <shuya.nakama@okinawaopenlabs.org> (cherry picked from commit 3fa62219bb5a9e928fe94d95314c7c00d5f06e66)
2017-11-30Filter installers for cloudify_vrouterCédric Ollivier1-1/+1
As cloudify_vrouter doesn't support SSL endpoints [1], it shouldn't be executed if compass or fuel. [1] https://jira.opnfv.org/browse/FUNCTEST-881 Change-Id: Ieedc0d5eca57f00da2121c9e07dd5cc57f978ef6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b5c7a96a1eb523e1c89f3ea9d143ddf39c518022)
2017-11-28Fix the regular expression for refstackLinda Wang1-3/+3
Otherwise, this line could not be matched: {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.143237s] ... ok -> the matched result: tempest.api.identity.v3.test_t Change-Id: I97282a9c98a889a015a40f9ad2d700906bb88fb1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 843de6db7838dc20fa4a1f44731ea47cbcffa250)
2017-11-24Fix relative imports in cloudify_ims_perfCédric Ollivier2-54/+42
It also fixes wrong indents. Conflicts: functest/opnfv_tests/vnf/ims/cloudify_ims_perf.py JIRA: FUNCTEST-893 Change-Id: Ic54e01c03c14f39c69242c41922fc124c1b45c23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0ddd33f9a1e6e41f1b768c6326983f902598d4c)
2017-11-23Merge "Fix how tier_handler is imported" into stable/euphratesCedric Ollivier1-1/+2
2017-11-23Fix how tier_handler is importedCédric Ollivier1-1/+2
Change-Id: I36577ca73042b181b4634c4d6bf3ac5d905fd560 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c44aaac86d7423ab2836d67989104321e12a7316)
2017-11-21Fix "Broken pipe" IOErrors of rally runJuha Kosonen2-27/+22
Replace obsolete os.popen with subprocess module usage in command output retrieval. Do not use shell as the program to execute. Change-Id: Ic63bb0f393750c3b85a35a37fecd46c1c1b96602 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 8335acdf080e4d31fd1dd70f11aa456b4795833a)
2017-11-21Fix the way of getting endpoint portLinda Wang2-12/+14
It will fail if the endpoint does not contain any port value when executing self.os_auth_url.rsplit("/")[2].rsplit(":")[1] JIRA: FUNCTEST-892 Change-Id: Iba4103884b7c6e3b157bb95d775fac02c32ae728 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 45ad7723d0e40e7c5475584fc2a5bc0b5ad3ef56)
2017-11-20Support to specify the valid external network nameLinda Wang1-1/+9
In some deployments, the retrieved external network by the def get_external_networks in Snaps checked by "router:external" is not available. So it is necessary to specify the available external network as an env by user. Change-Id: I333e91dd106ed307541a9a197280199fde86bd30 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit aa7109d038a86f6a19a9fb4af96bd1199cd81330)
2017-11-15Add shebang in snaps_suite_builder.pyCédric Ollivier1-0/+2
Change-Id: I3392068b4a47d35bf0d91fe6d93f2de268f198bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 798e5c472b6ac53bbf3b0b800f16069c50657df7)
2017-11-15Select the subset of snaps test casesLinda Wang5-21/+325
Conflicts: functest/opnfv_tests/openstack/snaps/snaps_suite_builder.py Change-Id: I03e422d5dae0ced9cd7a5477c31359ffc7795c42 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-07Merge "Fix rally cinder scenarios" into stable/euphratesCedric Ollivier1-10/+2
2017-11-06Protect vs exceptions when ext_nets is emptyCédric Ollivier1-1/+1
Otherwise several exceptions are raised in TestCase constructors (those defined in heathcheck). Change-Id: I4cb054f7092ea9db02cb8c4469e99848533c556b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e491334942083a81dab0f3450a809e29b0687c31)
2017-11-06Fix rally cinder scenariosJuha Kosonen1-10/+2
Remove network and servers context and set image and flavor as a scenario parameters. Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit a9337bc5618bb90cd9502f1ec9dc409e18eae0f7)
2017-11-03Remove the constraint of INSTALLER_TYPELinda Wang1-3/+0
Revert the patch: https://gerrit.opnfv.org/gerrit/#/c/45167 When run on non-opnfv deployment, there is no such concept of INSTALLER_TYPE. Change-Id: I3d420334c9329f7565cf22a0c314a4ffdb410d36 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 4d95f152cda9c7a44df13025341d3d7d472d57c6)
2017-10-30Switch from BashFeature to Feature of bgpvpn testcaseJose Lausuch1-4/+2
With the adaptation in SDNVPN project [1], Functest can run the tests within python instead of a bash call. This also fixes pushing the details section to the DB: JIRA: SDNVPN-183 [1] https://gerrit.opnfv.org/gerrit/#/c/45491/ Change-Id: I7116aa9d5ffe2a816719997771e4f4ecebbcd083 Signed-off-by: Jose Lausuch <jalausuch@suse.com> (cherry picked from commit 3774d9d027c0229c7bec52b247b656a846921369)
2017-10-18Update blacklist about migration tests for rallyLinda Wang3-7/+8
The test NovaServers.boot_and_migrate_server needs at least 2 compute nodes: https://github.com/openstack/rally/blob/stable/0.9/rally/plugins/openstack/scenarios/nova/servers.py#L763-L765 Change-Id: I4ddf99188094ced57225d886037b00e91f3b68e6 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 613c672ac166ca92ce1284131ec06446e07e0023)
2017-10-17Enhance the compatibility judgement of INSTALLERLinda Wang1-0/+3
When the env INSTALLER_TYPE is None, while the var installer in dependencies is not None, the current test case should not be run. Change-Id: If1b67f16f39d5c44b2c3729819dd665faed41b73 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 801a53baa1229fd4a88bb1aad692b86f536d970d)
2017-10-16Update project field of fds testcase to fastdatastacksjuraj.linkes1-1/+1
Fds testcases is defined under project fastdatastacks, not functest. The fix is required for testcase results uploads. Change-Id: Ided0701048d0b4c0257c62d600893672960d83df Signed-off-by: juraj.linkes <jlinkes@cisco.com> (cherry picked from commit 8797d07d0be8309a1cdcc3c1c67b20ba064a4420)
2017-10-10Complete framework documentation part for VNFMorgan Richomme1-11/+8
Change-Id: I4c59adfe1cfec278e0b267cc7a05e8addd45d034 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit ee2eb17dbe52418f6bdc6201f78b9f1e8858fdcc)
2017-10-09Add UEFI image extra properties for CentOS image for aarch64Delia Popescu1-0/+3
Add extra properties for CentOS image when using aarch64 architecture with UEFI boot mode Signed-off-by: Delia Popescu <delia.popescu@enea.com> Change-Id: Ie8aa7482627cbb3c31c6c72a31a0e37e86a409c4
2017-10-05Live migration support determination in rallyJuha Kosonen2-27/+35
Live migration test cases were excluded if tempest was not executed before rally since tempest config file is created during the execution of tempest. Remove the dependency to config file and define the support based on the number of computes as done in tempest. Change-Id: I57c18b7c57e6a4bc8bfbdfb4beb5f8d67c6269c4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit da2f6a0aabf3b5473e1d2d3f55a5f6c9bb6c8559)
2017-10-03Merge "Select euphrates zip in cloudify_ims*.yaml" into stable/euphratesCedric Ollivier2-2/+2
2017-10-03Merge "Create a router in both vping scenarii" into stable/euphratesCedric Ollivier2-19/+17
2017-10-03Merge "Report duration and result when vping fails" into stable/euphratesCedric Ollivier1-1/+3
2017-10-03Select euphrates zip in cloudify_ims*.yamlCédric Ollivier2-2/+2
Co-Authored-By: valentin boucher <valentin.boucher@orange.com> Change-Id: Ie7c3d10952662888718c70a3f8055ebca9e85d4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-03Merge "Disable vyos_vrouter" into stable/euphratesCedric Ollivier1-0/+1
2017-10-03Merge "Fix timeout for socket connection" into stable/euphratesJose Lausuch1-13/+8
2017-10-03Create a router in both vping scenariiCédric Ollivier2-19/+17
It fixes vping_userdata as it allows getting metadata due to the gateway defined for the subnet. It could be noted that DHCP can add the route needed if no gateway is defined and if force_metadata is set in dhcp_agent.ini. Change-Id: Ia62e0f00e3d2caee6262dd9cd9966d1f21fe40d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a691a8c2868d3f8af531e0bff513023c3a704aaf)
2017-10-03Report duration and result when vping failsCédric Ollivier1-1/+3
It completes "Bug fix: vping_userdata test status was not properly reported" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/43911/ Change-Id: I7e8be6cd564a24ca174e63cfc295861c51cae8ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5ffb995c110be39364535f56c86c46d092b8cea0)
2017-10-03Disable vyos_vrouterCédric Ollivier1-0/+1
It's postponed to 5.1. Change-Id: Ic06d47b4b5df167044363b40aea0c7932b550be7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ef034e78a6a3cfe90da77a60ae88d0d6bfddfb2e)
2017-10-03Add icmp rules for clearwaterims caseMichael Pauls1-0/+10
icmp rules must be enabled since a ping is used internally to check that other components are up and reachable Change-Id: I1ae3c301f30455c57193ddfe1757e971f5612c18 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de> (cherry picked from commit 4a27c90843abd3a8d002e37f0f9f22307f2ec9fc)
2017-10-03Fix timeout for socket connectionLinda Wang1-13/+8
Change-Id: I0688761ba7224f40f79310295efadd9b40bfeefb Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 112e652af2b2f61192d3f1bd903522a14be06b94)
2017-10-02Bug fix: vping_userdata test status was not properly reportedMorgan Richomme1-1/+1
vping_base is calling vping_userdata vping_user data could return only EX_TESTCASE_FAILED or EX_OK by default vping_base always returns EX_OK (based on self.result=100..) it returned EX_RUN_ERROR only if upper class report EX_RUN_ERROR that is why vping_userdata was always PASS even if the trace "Ping OK" cannot be retrieved from the Nova console it seems that when running the vping_userdata, we systematically got Failed to read iid from metadata Change-Id: If72441dd93bffada5c7a5399c87db68d7ebeebed Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit e36a14f6db0bc5ac93469bb553810de506f29bef)
2017-10-02Enable promise on all fuel and joid scenariiCédric Ollivier1-2/+2
Change-Id: I9735788fbbe715968560570543d1dc9d55e065b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 36b648a6e928ac0819a607cd2231faa803418b7a)
2017-10-01remove icmp rules from secgroupsMichael Pauls2-50/+0
Change-Id: I8f7d2170eee9777be6455d38eaff703338b155fa Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de> (cherry picked from commit c93ae73855ba928eb6661ac2468c5a0bae7c5506)
2017-10-01Remove tempest_custom from testcases configsCédric Ollivier1-18/+0
Change-Id: I1237eaada5257a8c01753837a5820d840b51bff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a8f1d8ea374c9538b1d7a223116d8d7d9b783c89)
2017-09-30Fix userdata issue for vping and orchestraLinda Wang4-6/+6
1. When creating VM, the type of the param userdata should be str, to conform with that in snaps [1]. 2. Remove the infinite loop for vping in userdata 3. Fix the criteria for vping_userdata and vping_ssh [1]: https://git.opnfv.org/snaps/tree/snaps/openstack/utils/nova_utils.py#n92 Change-Id: I262a7ebb93ec90bb6f8f3acb5d564f210abcfc4b Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 5a24cb4a7db33e693a063f5c2a66406283aa5cfb)
2017-09-28Merge "Fix connection error due to invalid lib version usage." into ↵Cedric Ollivier2-6/+10
stable/euphrates
2017-09-28Merge "Add log details on SDK first connection." into stable/euphratesCedric Ollivier2-18/+19
2017-09-28Switch to OS_PROJECT_NAMECédric Ollivier2-17/+19
It simply conforms with OpenStack keystone v3. JIRA: FUNCTEST-877 Change-Id: I989a6eb4d8564948927c184a899b62ca763ef824 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5c178f0d30f0701dee0d0a629023f05edfde338e)
2017-09-28Fix connection error due to invalid lib version usage.Benoit HERARD2-6/+10
Connection timeouts on "requests" objects was developped with requests 2.18 but target runtime is 2.12. Advanced timeout management of 2.18 is not available in 2.12. Change-Id: Ie6d81b91d4bcc0d73cffd007d9e46cdb19e47597 Signed-off-by: Benoit HERARD <benoit.herard@orange.com> (cherry picked from commit 86d5c31424187329f69a7e0efaa9dbe0dac98e56)
2017-09-28Add log details on SDK first connection.Benoit HERARD2-18/+19
On first call to energy recording API, if API is unreachable, SDK don't do anything anymore. This change add logs on error for this first connection. Change-Id: I88892c769d6208c6ddf5d714d438ab584826844e Signed-off-by: Benoit HERARD <benoit.herard@orange.com> (cherry picked from commit 405a0872282f5b29bb9e60ba19b11b17c8047647)
2017-09-25Disable Promise testsuite on Fuel installerCharalampos Kominos1-2/+2
When promise reads API v3.0 from the creds file it automatically uses v2.0. which is deprecated and not used by fuel. Therefore promise is removed from the functest suite JIRA: ARMBAND-314 Change-Id: I22b875c198c1922fd4ddb06c81c05884b5248eb4 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com> (cherry picked from commit 8c3791f730effbf09fc95ef2bc66ff0d0a37e87b)
2017-09-25Fix creds still used by vrouterroot1-4/+4
1. 'CloudifyVrouter' object has no attribute 'creds' 2. 'CloudifyVrouter' object was still use 'creds' 3. Doing test of modified vyos_vrouter on our labs. Refer to following commit. https://gerrit.opnfv.org/gerrit/#/c/41249/ Change-Id: Id1b4dfa4c35aba9bbb4fd64ef58446d3e99468df Signed-off-by: root <shuya.nakama@okinawaopenlabs.org> (cherry picked from commit 233a9bf775c1e9fe66e588ec45266c15bdb142b1)
2017-09-22Merge "Support https when testing ODL" into stable/euphratesMorgan Richomme2-70/+73
2017-09-22Support https when testing ODLCédric Ollivier2-70/+73
It conforms with the last change on ODL tests [1]. Neutron endpoint is passed via robot args instead of Neutron ip. Keystone url (based on OS_AUTH_URL) is passed too to replace Keystone ip. [1] https://git.opendaylight.org/gerrit/#/c/63293/ Conflicts: docker/restapi/Dockerfile docker/smoke/Dockerfile Change-Id: Ie44f55304a438b1b0289ec69ac2241664be70e80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dd99f5356ef08f3a2a1ed18d63492391390df752)
2017-09-21Adding orchestra test cases to orchestra projectMorgan Richomme1-2/+2
Orchestra introduced 2 VNF test cases: * orchestra_openims * orchestra_clearwaterims In the configuration, the 2 projects are still assigned to functest project This patch associate the cases with their real project Change-Id: I81f6d6fb473916f0f91a5b3795b3ed433c283fb4 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 2aa38f32b9ea0cb248f25d52f100240b2a002bc6)