aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2018-05-20Simplify vping_sshCédric Ollivier1-2/+2
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 213ca8e4e4d155ed6d5626020e56c3a241d1dace)
2018-04-15Remove odl_netvirt testcaseCédric Ollivier1-22/+0
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 13e4c5838b732bf9fd246cd4f97cb9b4e2b8e0b9)
2018-04-15Filter only on scenarios if possibleCédric Ollivier1-3/+3
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 38c67396839738cb319c797aa35fb50ec892b053)
2018-04-15Set same dependencies for all vping test casesCédric Ollivier1-1/+1
It allows a fair comparison between odl and nosdn scenarios. Gluon could also be safely removed as scenario filter. https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7c8d58fbe548f94c6cecfef7afc66270b395d6e9)
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit abfdf1d28292198ef94059b5812a5987887404e0)
2018-04-03Remove NetVirt from installer dependenciesCédric Ollivier1-7/+7
Change-Id: Idb937b3ed4896208048b90b705dc3e6db6104b60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ef44d1c12fcde4cb3cea4a23078e0a984f1a7336)
2018-03-16Disable features in nofeature scenarioCédric Ollivier1-1/+1
Only Funtest testcases are verifying the referent scenarios. Change-Id: I29dfa012e9cba39216fdd58e5fd59255844f335b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Set blocking of patrole falseLinda Wang1-1/+1
Change-Id: Ia6f0c6fec30af5c4124f21b2bdaa3084bced6f9e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis1-0/+17
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-12Remove orchestra testcasesCédric Ollivier1-31/+0
They are incompatible with Pike and they have to be removed without any deep update. The testcases will be re-renabled if updated before 03/16/18. Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Rewrite refstack testcaseCédric Ollivier1-3/+3
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Add patrole in opnfv/functest-restapiCédric Ollivier1-0/+22
Change-Id: I983898c27477986d9a5610e1df966fd00a8bc785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-05Load SfcFunctest instead of running a bash scriptCédric Ollivier1-4/+2
It allows publishing tests details. Change-Id: Iffc49f8258cdd2c145750343003f21921ac7ff67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-02Merge "Leverage on Xtesting"valentin boucher1-2/+2
2018-03-02Leverage on XtestingCédric Ollivier1-2/+2
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Enable barometer run on compassLinda Wang1-1/+1
Change-Id: Ic6f4f2a2d06dc70338da3bad53deca0a62a03232 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-14Enable doctor-notificationCédric Ollivier1-1/+0
The testcase has been expected to work since the nova bug [1] was bypassed [2]. [1] https://bugs.launchpad.net/nova/+bug/1742827 [2] https://gerrit.opnfv.org/gerrit/#/c/52075/ Change-Id: If53da6313381cf69a0093a6677db3d9033fb8f48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Test vnf in all os-nosdn-nofeature scenariosCédric Ollivier1-7/+7
It allows setting os-nosdn-nofeature-noha as default value if DEPLOY_SCENARIO is unset. As orchestra* testcases are already disabled, it's useless to ask a specific installer. All vnf testcases should work vs any installer. Change-Id: Ia388f96348f9d06745f8d1669962d7f1c4e47d84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Temporarily disable doctor-notificationCédric Ollivier1-1/+1
It's currently forbidding gating all APEX' scenarios [1] (even os-nosdn-nofeature-* [2]). It will be enabled when it's fixed or when functest jobs are rewritten [3] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/772/console [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/770/console [3] https://gerrit.opnfv.org/gerrit/#/c/51853/ Change-Id: I571c464aabe02f67a9e98ca1ab42d8a7efc672ee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-06Disable orchestra_* testcasesCédric Ollivier1-0/+2
They can be simply disabled and they unsuccessfully run vs Daily only. In a second step, moving the related python modules in a new orchestra repository could be a good solution simply because they don't reach our coding criteria. The best way is still to update them according to our rules and to check all installers thanks to these two vnfs. Change-Id: If36b16f0ed95d7039db9455a32c18f7fd1a739ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Increase Rally full criteriaCédric Ollivier1-1/+1
Even if several tests are currently under investigation, it seems relevant to expect a full success here. Change-Id: I6a8c5fb5a7dd4bfb5c3a2e7a93de1c0bec77c878 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-21Enable orchestra testcases for Daisy onlyCédric Ollivier1-2/+2
The current testcases have several issues which limit the possible successful runs to Daisy [1]. [1] https://jira.opnfv.org/browse/ORCHESTRA-17 Change-Id: Iecaf21738e19aae6a88171385f11afcffd28a348 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-15Filter out orchestra for ssl enabled deploymentsMichael Polenchuk1-2/+2
Skip orchestra tests for the Compass & Fuel/MCP installers until OpenBaton have updated to version 4.x+ with SSL support. JIRA: ORCHESTRA-17 Change-Id: I894a08fb5ac83a6b1d59d7bcf3a681a8d596968f Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-14[vyos_vrouter] Support https endpointsShuyaNakama1-1/+1
JIRA: FUNCTEST-881 vyos_vrouter did not support https endpoints [1]. I fixed the following two points. 1. Modifying blueprint of Cloudify. 2. Changing nova client of utilvnf module. Point 1 I added command of support https endpoint to blueprint of vyos_vrouter. The Blueprint of vyos_vrouter is on our github repository [2]. I updated our repository. Point 2 I changed nova client of utilvnf module. Utilvnf module is utility module of vyos_vrouter. Nova client of utilvnf module did not support https endpoints. So, I changed to use nova client of snaps. After fixed the source code, I confirmed the vyos_vrouter was succeeded in the following two environments. 1. Our labs (Instoller:fuel, environment of https endpoints) 2. Orange POD (Instoller:compass, environment of http endpoints) [1] https://jira.opnfv.org/browse/FUNCTEST-881 [2] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/blob/master/function-test-openstack-blueprint.yaml Change-Id: I468df0f2486a34bc558ad161eb7de44264549006 Signed-off-by: ShuyaNakama <shuya.nakama@okinawaopenlabs.org>
2017-12-11vEPC tests with juju as an VNF managersoumaya1-0/+16
juju_epc testcase validate EPC setup with the help of ABoT which acting as test executor. Functest-abot-epc-bundle deploys OAI charms alongwith mysql and ABoT. JUJU is acting as a VNF manager. Change-Id: I45d7b37f21f6b8c7049ab2bf42a4678e30b67a72 Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-04Create a tox env to check yaml filesCédric Ollivier1-23/+30
It also fixes all testcases config files. Change-Id: I81a6ffb8b7acf4239c79129dc842e283d3d32b35 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Reorder Vnf testcasesCédric Ollivier1-14/+15
Cloudify IMS testcases could easily tigger jjob timeouts. Vyos_router should run before as it ends much quickier. Change-Id: Icd4323a7216615e75613e5fb241ae144f727d4fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Filter installers for cloudify_vrouterCédric Ollivier1-1/+1
As cloudify_vrouter doesn't support SSL endpoints [1], it shouldn't be executed if compass or fuel. [1] https://jira.opnfv.org/browse/FUNCTEST-881 Change-Id: Ieedc0d5eca57f00da2121c9e07dd5cc57f978ef6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-27Create RobotFramework classCédric Ollivier1-5/+5
It moves the capability to run any robot script from ODL TestCase into a new class: RobotFramework. It updates ODL TestCase and the related unit tests to inherit from the new parent class. Change-Id: I73e59ee9652fb63d9d89d7c75c58cce9cf62b0d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-24Enable Doctor testcase for F-releaseCédric Ollivier1-1/+0
doctor conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47283/ Change-Id: I82135a64cf0aac5ebf5b56260ede24b592fca41b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-24Enable baro_tests testcase for F-releaseCédric Ollivier1-1/+0
barometer conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47281/ Change-Id: Iee17bd17192db53075dd8ff8d020d18306394cfa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-20Enable sdnvpn testcase for F-releaseCédric Ollivier1-1/+0
sdnvpn conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47277/ Change-Id: Iedcb645d897684f169e4cf536838bf1f0951b6d9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-16Enable sfc testcase for F-releaseCédric Ollivier1-1/+0
sfc conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47279/ Change-Id: I2b79f918dc4f6ca89c2dca18bf64a4bb184bf8b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-15Remove Domino and Promise testcasesCédric Ollivier1-34/+0
Domino and Promise won't participate in the Fraser Release [1]. [1] https://wiki.opnfv.org/display/SWREL/Projects+Intending+to+Participate+in+the+Fraser+Release Change-Id: Ib06411769439015549cac9353fa92cebd2f61193 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-06Move fds to features tierLinda Wang1-19/+19
Change-Id: I7aa9d73c7ffbfdad7d5a929968fb640d9a8de62e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-05Update Functest to OpenStack stable/pikeCédric Ollivier1-0/+6
It updates setup.py, (test-)requirement.txt and upper-constraints.txt according to OpenStack requirements [1]. It disables all Features testcases as they are not synchronized with OpenStack stable/pike yet [2]. The docker functest-parser is simplified as it can be based on functest-core as both Functest and Parser leverage on OpenStack stable/pike. ODL_TAG and REFSTACK_TAG variables are set to master again. [1] http://git.openstack.org/cgit/openstack/requirements/log/?h=stable/pike [2] https://wiki.opnfv.org/display/functest/Requirements+management Change-Id: I23fa84f35244c1f4026abd89414b99576f042ee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-18Switch from BashFeature to Feature of bgpvpn testcaseJose Lausuch1-4/+2
With the adaptation in SDNVPN project [1], Functest can run the tests within python instead of a bash call. This also fixes pushing the details section to the DB: JIRA: SDNVPN-183 [1] https://gerrit.opnfv.org/gerrit/#/c/45491/ Change-Id: I7116aa9d5ffe2a816719997771e4f4ecebbcd083 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-14Update project field of fds testcase to fastdatastacksjuraj.linkes1-1/+1
Fds testcases is defined under project fastdatastacks, not functest. The fix is required for testcase results uploads. Change-Id: Ided0701048d0b4c0257c62d600893672960d83df Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2017-10-11Fix fail of vRouter on Orange PODroot1-1/+0
1. Functest docker container environment has no attribute 'OS_REGION_NAME' 2. vRouter was get the 'OS_REGION_NAME' but not used it. 3. Deleting use 'OS_REGION_NAME' part of vRouter. 4. Utility lib of vRouter use Nova client. 5. Modifying Nova client authentication step for auth api v3. 6. Doing test of modified vRouter on Orange POD. Change-Id: I062549e5ca48fb4825b53448a4e2ffc8c1f8ec40 Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-10-03Disable vyos_vrouterCédric Ollivier1-0/+1
It's postponed to 5.1. Change-Id: Ic06d47b4b5df167044363b40aea0c7932b550be7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-02Enable promise on all fuel and joid scenariiCédric Ollivier1-2/+2
Change-Id: I9735788fbbe715968560570543d1dc9d55e065b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-30Remove tempest_custom from testcases configsCédric Ollivier1-18/+0
Change-Id: I1237eaada5257a8c01753837a5820d840b51bff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-25Disable Promise testsuite on Fuel installerCharalampos Kominos1-2/+2
When promise reads API v3.0 from the creds file it automatically uses v2.0. which is deprecated and not used by fuel. Therefore promise is removed from the functest suite JIRA: ARMBAND-314 Change-Id: I22b875c198c1922fd4ddb06c81c05884b5248eb4 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
2017-09-21Adding orchestra test cases to orchestra projectMorgan Richomme1-2/+2
Orchestra introduced 2 VNF test cases: * orchestra_openims * orchestra_clearwaterims In the configuration, the 2 projects are still assigned to functest project This patch associate the cases with their real project Change-Id: I81f6d6fb473916f0f91a5b3795b3ed433c283fb4 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-16Enable Doctor testcasedongwenjuan1-3/+2
It upates upper-constraints.txt and thirdparty-requirements.txt as doctor-test was renamed to doctor-tests. It installs the doctor packages and its requirements via python3. Then python_version>='3.0' conditions are added to avoid installing them for python2. It also calls the new console scripts and modifies the installer list supporting it. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Icd855f4534d9d9591165e99aa0eed6b1030018e0 Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-16Enable Domino testcaseCédric Ollivier1-1/+0
Domino is part of the OPNFV projects released for E [1]. As now Domino is ready for Functest integration (package and requirements), the testcase can be enabled. If the testcase fails, the issues should be related to Domino. [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-September/017951.html Change-Id: I26f3d3ae338def0f77c46c2cbda1baf3d55c1a41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-16Remove securityscanning testcaseCédric Ollivier1-17/+0
As the project is no longer released [1], security_scan is removed from testcases config files. It stops installing the related python package too. [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-September/017951.html Change-Id: Ieb9ff4c2975fbf2c85b875a088b0ec18503a3722 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-15Remove useless enabled: true in testcases.yamlCédric Ollivier1-2/+0
Change-Id: Ief2f4f580b4daef74e64d203fa1fc2be8f7e50c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-15Bug fix: wrong dependency filter for lxd scenariosMorgan Richomme1-2/+2
lxd scenario cannot run all the api_check tests, a regex has been set but on the wrong dependency (installer instead of scenario) Change-Id: I313e8d1ed3fa30488c100549f574a0cded08768f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-12Merge "Re-enable orchestra tests (VNF)"Cedric Ollivier1-2/+0