aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-10-05Live migration support determination in rallyJuha Kosonen2-27/+35
Live migration test cases were excluded if tempest was not executed before rally since tempest config file is created during the execution of tempest. Remove the dependency to config file and define the support based on the number of computes as done in tempest. Change-Id: I57c18b7c57e6a4bc8bfbdfb4beb5f8d67c6269c4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-10-03Merge changes Ic06d47b4,I7e8be6cd,Ia62e0f00Morgan Richomme3-20/+21
* changes: Disable vyos_vrouter Report duration and result when vping fails Create a router in both vping scenarii
2017-10-03Disable vyos_vrouterCédric Ollivier1-0/+1
It's postponed to 5.1. Change-Id: Ic06d47b4b5df167044363b40aea0c7932b550be7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-03Report duration and result when vping failsCédric Ollivier1-1/+3
It completes "Bug fix: vping_userdata test status was not properly reported" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/43911/ Change-Id: I7e8be6cd564a24ca174e63cfc295861c51cae8ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-03Create a router in both vping scenariiCédric Ollivier2-19/+17
It fixes vping_userdata as it allows getting metadata due to the gateway defined for the subnet. It could be noted that DHCP can add the route needed if no gateway is defined and if force_metadata is set in dhcp_agent.ini. Change-Id: Ia62e0f00e3d2caee6262dd9cd9966d1f21fe40d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-02Add icmp rules for clearwaterims caseMichael Pauls1-0/+10
icmp rules must be enabled since a ping is used internally to check that other components are up and reachable Change-Id: I1ae3c301f30455c57193ddfe1757e971f5612c18 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-10-02Bug fix: vping_userdata test status was not properly reportedMorgan Richomme1-1/+1
vping_base is calling vping_userdata vping_user data could return only EX_TESTCASE_FAILED or EX_OK by default vping_base always returns EX_OK (based on self.result=100..) it returned EX_RUN_ERROR only if upper class report EX_RUN_ERROR that is why vping_userdata was always PASS even if the trace "Ping OK" cannot be retrieved from the Nova console it seems that when running the vping_userdata, we systematically got Failed to read iid from metadata Change-Id: If72441dd93bffada5c7a5399c87db68d7ebeebed Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-02Enable promise on all fuel and joid scenariiCédric Ollivier1-2/+2
Change-Id: I9735788fbbe715968560570543d1dc9d55e065b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-01Merge "remove icmp rules from secgroups"Morgan Richomme2-50/+0
2017-09-30Remove tempest_custom from testcases configsCédric Ollivier1-18/+0
Change-Id: I1237eaada5257a8c01753837a5820d840b51bff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-30Fix userdata issue for vping and orchestraLinda Wang4-6/+6
1. When creating VM, the type of the param userdata should be str, to conform with that in snaps [1]. 2. Remove the infinite loop for vping in userdata 3. Fix the criteria for vping_userdata and vping_ssh [1]: https://git.opnfv.org/snaps/tree/snaps/openstack/utils/nova_utils.py#n92 Change-Id: I262a7ebb93ec90bb6f8f3acb5d564f210abcfc4b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-29remove icmp rules from secgroupsMichael Pauls2-50/+0
Change-Id: I8f7d2170eee9777be6455d38eaff703338b155fa Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-09-28Merge "Switch to OS_PROJECT_NAME"Cedric Ollivier2-17/+19
2017-09-28Fix connection error due to invalid lib version usage.Benoit HERARD2-6/+10
Connection timeouts on "requests" objects was developped with requests 2.18 but target runtime is 2.12. Advanced timeout management of 2.18 is not available in 2.12. Change-Id: Ie6d81b91d4bcc0d73cffd007d9e46cdb19e47597 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-09-28Switch to OS_PROJECT_NAMECédric Ollivier2-17/+19
It simply conforms with OpenStack keystone v3. JIRA: FUNCTEST-877 Change-Id: I989a6eb4d8564948927c184a899b62ca763ef824 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-27Add log details on SDK first connection.Benoit HERARD2-18/+19
On first call to energy recording API, if API is unreachable, SDK don't do anything anymore. This change add logs on error for this first connection. Change-Id: I88892c769d6208c6ddf5d714d438ab584826844e Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-09-26Fix timeout for socket connectionLinda Wang1-13/+8
Change-Id: I0688761ba7224f40f79310295efadd9b40bfeefb Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-25Disable Promise testsuite on Fuel installerCharalampos Kominos1-2/+2
When promise reads API v3.0 from the creds file it automatically uses v2.0. which is deprecated and not used by fuel. Therefore promise is removed from the functest suite JIRA: ARMBAND-314 Change-Id: I22b875c198c1922fd4ddb06c81c05884b5248eb4 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
2017-09-25Merge "Fix creds still used by vrouter"Morgan Richomme1-4/+4
2017-09-25Fix creds still used by vrouterroot1-4/+4
1. 'CloudifyVrouter' object has no attribute 'creds' 2. 'CloudifyVrouter' object was still use 'creds' 3. Doing test of modified vyos_vrouter on our labs. Refer to following commit. https://gerrit.opnfv.org/gerrit/#/c/41249/ Change-Id: Id1b4dfa4c35aba9bbb4fd64ef58446d3e99468df Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-09-22Merge "Support https when testing ODL"Cedric Ollivier2-70/+73
2017-09-22Support https when testing ODLCédric Ollivier2-70/+73
It conforms with the last change on ODL tests [1]. Neutron endpoint is passed via robot args instead of Neutron ip. Keystone url (based on OS_AUTH_URL) is passed too to replace Keystone ip. [1] https://git.opendaylight.org/gerrit/#/c/63293/ Change-Id: Ie44f55304a438b1b0289ec69ac2241664be70e80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-21Merge "Adding orchestra test cases to orchestra project"Morgan Richomme1-2/+2
2017-09-21Adding orchestra test cases to orchestra projectMorgan Richomme1-2/+2
Orchestra introduced 2 VNF test cases: * orchestra_openims * orchestra_clearwaterims In the configuration, the 2 projects are still assigned to functest project This patch associate the cases with their real project Change-Id: I81f6d6fb473916f0f91a5b3795b3ed433c283fb4 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-21Remove void return value mocks in rally unit testsJuha Kosonen1-27/+16
Change-Id: I369b98fb9120830b1868f438c7da2a039a60d890 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-20Merge "Enable Doctor testcase"Cedric Ollivier1-3/+2
2017-09-20Merge "Dedicated flavors for rally tests"Jose Lausuch4-3/+79
2017-09-20Remove white space when listing testcasesLinda Wang1-1/+2
Change-Id: I2f3c7a9301a6b2dcb03a90175be23223f6a6229a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-20Dedicated flavors for rally testsJuha Kosonen4-3/+79
Create flavors and use them in rally scenarios instead of expecting certain flavors to pre-exist. Change-Id: I77c94ab80fcabd7b80ffb36f9856a48121858009 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-19Add swagger support for Rest APILinda Wang18-0/+475
JIRA: FUNCTEST-854 Change-Id: Ic010604d3ba0cc46092cf2a1ae8bb41afa73c920 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-19Merge "Return Functest status to Jenkins"Cedric Ollivier2-11/+21
2017-09-19Merge "Fix image name in rally scenarios"Cedric Ollivier1-6/+6
2017-09-18Return Functest status to JenkinsCédric Ollivier2-11/+21
It avoids mixing Functest and Features CI issues by simply exiting the status of Functest testcases. The result of third-party testcases are printed into console but are no longer taken into account into the global status. Change-Id: I040ff54780db2ddb6d81993839fee09f5e472323 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-18Fix image name in rally scenariosJuha Kosonen1-6/+6
Change-Id: I0a78a16d44c1e0e0b2edec2e43954c1f08e8bb09 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-18increase timeout of NFVO installationMichael Pauls2-16/+16
some pods are less powerful and require more time for the installation of the orchestrator Change-Id: Iebd39c0ef8f3dcfa7fecb1e507b2f05890b5c490 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-09-16Enable Doctor testcasedongwenjuan1-3/+2
It upates upper-constraints.txt and thirdparty-requirements.txt as doctor-test was renamed to doctor-tests. It installs the doctor packages and its requirements via python3. Then python_version>='3.0' conditions are added to avoid installing them for python2. It also calls the new console scripts and modifies the installer list supporting it. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Icd855f4534d9d9591165e99aa0eed6b1030018e0 Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-16Enable Domino testcaseCédric Ollivier1-1/+0
Domino is part of the OPNFV projects released for E [1]. As now Domino is ready for Functest integration (package and requirements), the testcase can be enabled. If the testcase fails, the issues should be related to Domino. [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-September/017951.html Change-Id: I26f3d3ae338def0f77c46c2cbda1baf3d55c1a41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-16Remove securityscanning testcaseCédric Ollivier1-17/+0
As the project is no longer released [1], security_scan is removed from testcases config files. It stops installing the related python package too. [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-September/017951.html Change-Id: Ieb9ff4c2975fbf2c85b875a088b0ec18503a3722 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-15Remove useless enabled: true in testcases.yamlCédric Ollivier1-2/+0
Change-Id: Ief2f4f580b4daef74e64d203fa1fc2be8f7e50c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-15Merge "Bug fix: wrong dependency filter for lxd scenarios"Morgan Richomme1-2/+2
2017-09-15Merge "Refactor resource creation and cleanup in rally"Cedric Ollivier3-71/+137
2017-09-15Bug fix: wrong dependency filter for lxd scenariosMorgan Richomme1-2/+2
lxd scenario cannot run all the api_check tests, a regex has been set but on the wrong dependency (installer instead of scenario) Change-Id: I313e8d1ed3fa30488c100549f574a0cded08768f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-15Refactor resource creation and cleanup in rallyJuha Kosonen3-71/+137
Use SNAPS to create and delete resources. Change-Id: Ic4d390382acea2be196e8a7518cb8cce25276a45 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-15Enable tempest run concurrentlyLinda Wang2-8/+20
Append a guid to the end of names of resources created for tempest, including project, user, network, images and flavors. Change-Id: I01fc7c5cb45cd5724a99ba1d220c3f3f7d6639cf Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-14Merge "New testcase creation named "cloudify_ims_perf""Cedric Ollivier11-1/+18067
2017-09-14New testcase creation named "cloudify_ims_perf"boucherv11-1/+18067
* IMS deployment with "cloudify_ims" testcase * IXIA infrastructure creation with SNAPS * Module configuration with REST API * Configure and run the perf tests with REST API Change-Id: I3dfddda87f9e9f4f03df375f6a032ded26a627b3 Signed-off-by: boucherv <valentin.boucher@orange.com> Co-Authored-By: Arturo Sordo Miralles <asordo@ixiacom.com>
2017-09-14Merge "Allow reading log file with byte offset"Cedric Ollivier1-1/+5
2017-09-13Allow reading log file with byte offsetLinda Wang1-1/+5
Change-Id: I8cd6acef66d798fa43e20ca9d885dcbaa99a5b42 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-13Disable urllib3 warningsLinda Wang5-4/+9
1. When running in compass OSA, lots of SubjectAltNameWarnings are shown in console, so just disable the warnings here. See https://github.com/shazow/urllib3/issues/497 for details 2. Redirect warnings issued by the warnings module to the logging system via logging.captureWarnings(True) 3. But urllib3 warning is still there for two cmds about rally/tempest. Change-Id: Ic22cf8e2babc10c9d55a7ed46b841312a4e430a7 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-12Merge "Fix some errors about getting tiers resources"Jose Lausuch1-6/+8