aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2018-03-05Load SfcFunctest instead of running a bash scriptCédric Ollivier1-4/+2
It allows publishing tests details. Change-Id: Iffc49f8258cdd2c145750343003f21921ac7ff67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-02Merge "Leverage on Xtesting"valentin boucher1-2/+2
2018-03-02Leverage on XtestingCédric Ollivier1-2/+2
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Enable barometer run on compassLinda Wang1-1/+1
Change-Id: Ic6f4f2a2d06dc70338da3bad53deca0a62a03232 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-14Enable doctor-notificationCédric Ollivier1-1/+0
The testcase has been expected to work since the nova bug [1] was bypassed [2]. [1] https://bugs.launchpad.net/nova/+bug/1742827 [2] https://gerrit.opnfv.org/gerrit/#/c/52075/ Change-Id: If53da6313381cf69a0093a6677db3d9033fb8f48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Test vnf in all os-nosdn-nofeature scenariosCédric Ollivier1-7/+7
It allows setting os-nosdn-nofeature-noha as default value if DEPLOY_SCENARIO is unset. As orchestra* testcases are already disabled, it's useless to ask a specific installer. All vnf testcases should work vs any installer. Change-Id: Ia388f96348f9d06745f8d1669962d7f1c4e47d84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Temporarily disable doctor-notificationCédric Ollivier1-1/+1
It's currently forbidding gating all APEX' scenarios [1] (even os-nosdn-nofeature-* [2]). It will be enabled when it's fixed or when functest jobs are rewritten [3] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/772/console [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/770/console [3] https://gerrit.opnfv.org/gerrit/#/c/51853/ Change-Id: I571c464aabe02f67a9e98ca1ab42d8a7efc672ee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-06Disable orchestra_* testcasesCédric Ollivier1-0/+2
They can be simply disabled and they unsuccessfully run vs Daily only. In a second step, moving the related python modules in a new orchestra repository could be a good solution simply because they don't reach our coding criteria. The best way is still to update them according to our rules and to check all installers thanks to these two vnfs. Change-Id: If36b16f0ed95d7039db9455a32c18f7fd1a739ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-05Increase Rally full criteriaCédric Ollivier1-1/+1
Even if several tests are currently under investigation, it seems relevant to expect a full success here. Change-Id: I6a8c5fb5a7dd4bfb5c3a2e7a93de1c0bec77c878 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-21Enable orchestra testcases for Daisy onlyCédric Ollivier1-2/+2
The current testcases have several issues which limit the possible successful runs to Daisy [1]. [1] https://jira.opnfv.org/browse/ORCHESTRA-17 Change-Id: Iecaf21738e19aae6a88171385f11afcffd28a348 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-15Filter out orchestra for ssl enabled deploymentsMichael Polenchuk1-2/+2
Skip orchestra tests for the Compass & Fuel/MCP installers until OpenBaton have updated to version 4.x+ with SSL support. JIRA: ORCHESTRA-17 Change-Id: I894a08fb5ac83a6b1d59d7bcf3a681a8d596968f Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-14[vyos_vrouter] Support https endpointsShuyaNakama1-1/+1
JIRA: FUNCTEST-881 vyos_vrouter did not support https endpoints [1]. I fixed the following two points. 1. Modifying blueprint of Cloudify. 2. Changing nova client of utilvnf module. Point 1 I added command of support https endpoint to blueprint of vyos_vrouter. The Blueprint of vyos_vrouter is on our github repository [2]. I updated our repository. Point 2 I changed nova client of utilvnf module. Utilvnf module is utility module of vyos_vrouter. Nova client of utilvnf module did not support https endpoints. So, I changed to use nova client of snaps. After fixed the source code, I confirmed the vyos_vrouter was succeeded in the following two environments. 1. Our labs (Instoller:fuel, environment of https endpoints) 2. Orange POD (Instoller:compass, environment of http endpoints) [1] https://jira.opnfv.org/browse/FUNCTEST-881 [2] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/blob/master/function-test-openstack-blueprint.yaml Change-Id: I468df0f2486a34bc558ad161eb7de44264549006 Signed-off-by: ShuyaNakama <shuya.nakama@okinawaopenlabs.org>
2017-12-11vEPC tests with juju as an VNF managersoumaya1-0/+16
juju_epc testcase validate EPC setup with the help of ABoT which acting as test executor. Functest-abot-epc-bundle deploys OAI charms alongwith mysql and ABoT. JUJU is acting as a VNF manager. Change-Id: I45d7b37f21f6b8c7049ab2bf42a4678e30b67a72 Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-04Create a tox env to check yaml filesCédric Ollivier1-23/+30
It also fixes all testcases config files. Change-Id: I81a6ffb8b7acf4239c79129dc842e283d3d32b35 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Reorder Vnf testcasesCédric Ollivier1-14/+15
Cloudify IMS testcases could easily tigger jjob timeouts. Vyos_router should run before as it ends much quickier. Change-Id: Icd4323a7216615e75613e5fb241ae144f727d4fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Filter installers for cloudify_vrouterCédric Ollivier1-1/+1
As cloudify_vrouter doesn't support SSL endpoints [1], it shouldn't be executed if compass or fuel. [1] https://jira.opnfv.org/browse/FUNCTEST-881 Change-Id: Ieedc0d5eca57f00da2121c9e07dd5cc57f978ef6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-27Create RobotFramework classCédric Ollivier1-5/+5
It moves the capability to run any robot script from ODL TestCase into a new class: RobotFramework. It updates ODL TestCase and the related unit tests to inherit from the new parent class. Change-Id: I73e59ee9652fb63d9d89d7c75c58cce9cf62b0d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-24Enable Doctor testcase for F-releaseCédric Ollivier1-1/+0
doctor conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47283/ Change-Id: I82135a64cf0aac5ebf5b56260ede24b592fca41b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-24Enable baro_tests testcase for F-releaseCédric Ollivier1-1/+0
barometer conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47281/ Change-Id: Iee17bd17192db53075dd8ff8d020d18306394cfa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-20Enable sdnvpn testcase for F-releaseCédric Ollivier1-1/+0
sdnvpn conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47277/ Change-Id: Iedcb645d897684f169e4cf536838bf1f0951b6d9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-16Enable sfc testcase for F-releaseCédric Ollivier1-1/+0
sfc conforms with OpenStack Pike requirements then it could be enabled in functest-features and functest-restapi (master) [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/47279/ Change-Id: I2b79f918dc4f6ca89c2dca18bf64a4bb184bf8b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-15Remove Domino and Promise testcasesCédric Ollivier1-34/+0
Domino and Promise won't participate in the Fraser Release [1]. [1] https://wiki.opnfv.org/display/SWREL/Projects+Intending+to+Participate+in+the+Fraser+Release Change-Id: Ib06411769439015549cac9353fa92cebd2f61193 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-06Move fds to features tierLinda Wang1-19/+19
Change-Id: I7aa9d73c7ffbfdad7d5a929968fb640d9a8de62e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-05Update Functest to OpenStack stable/pikeCédric Ollivier1-0/+6
It updates setup.py, (test-)requirement.txt and upper-constraints.txt according to OpenStack requirements [1]. It disables all Features testcases as they are not synchronized with OpenStack stable/pike yet [2]. The docker functest-parser is simplified as it can be based on functest-core as both Functest and Parser leverage on OpenStack stable/pike. ODL_TAG and REFSTACK_TAG variables are set to master again. [1] http://git.openstack.org/cgit/openstack/requirements/log/?h=stable/pike [2] https://wiki.opnfv.org/display/functest/Requirements+management Change-Id: I23fa84f35244c1f4026abd89414b99576f042ee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-18Switch from BashFeature to Feature of bgpvpn testcaseJose Lausuch1-4/+2
With the adaptation in SDNVPN project [1], Functest can run the tests within python instead of a bash call. This also fixes pushing the details section to the DB: JIRA: SDNVPN-183 [1] https://gerrit.opnfv.org/gerrit/#/c/45491/ Change-Id: I7116aa9d5ffe2a816719997771e4f4ecebbcd083 Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-10-14Update project field of fds testcase to fastdatastacksjuraj.linkes1-1/+1
Fds testcases is defined under project fastdatastacks, not functest. The fix is required for testcase results uploads. Change-Id: Ided0701048d0b4c0257c62d600893672960d83df Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2017-10-11Fix fail of vRouter on Orange PODroot1-1/+0
1. Functest docker container environment has no attribute 'OS_REGION_NAME' 2. vRouter was get the 'OS_REGION_NAME' but not used it. 3. Deleting use 'OS_REGION_NAME' part of vRouter. 4. Utility lib of vRouter use Nova client. 5. Modifying Nova client authentication step for auth api v3. 6. Doing test of modified vRouter on Orange POD. Change-Id: I062549e5ca48fb4825b53448a4e2ffc8c1f8ec40 Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-10-03Disable vyos_vrouterCédric Ollivier1-0/+1
It's postponed to 5.1. Change-Id: Ic06d47b4b5df167044363b40aea0c7932b550be7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-02Enable promise on all fuel and joid scenariiCédric Ollivier1-2/+2
Change-Id: I9735788fbbe715968560570543d1dc9d55e065b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-30Remove tempest_custom from testcases configsCédric Ollivier1-18/+0
Change-Id: I1237eaada5257a8c01753837a5820d840b51bff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-25Disable Promise testsuite on Fuel installerCharalampos Kominos1-2/+2
When promise reads API v3.0 from the creds file it automatically uses v2.0. which is deprecated and not used by fuel. Therefore promise is removed from the functest suite JIRA: ARMBAND-314 Change-Id: I22b875c198c1922fd4ddb06c81c05884b5248eb4 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
2017-09-21Adding orchestra test cases to orchestra projectMorgan Richomme1-2/+2
Orchestra introduced 2 VNF test cases: * orchestra_openims * orchestra_clearwaterims In the configuration, the 2 projects are still assigned to functest project This patch associate the cases with their real project Change-Id: I81f6d6fb473916f0f91a5b3795b3ed433c283fb4 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-16Enable Doctor testcasedongwenjuan1-3/+2
It upates upper-constraints.txt and thirdparty-requirements.txt as doctor-test was renamed to doctor-tests. It installs the doctor packages and its requirements via python3. Then python_version>='3.0' conditions are added to avoid installing them for python2. It also calls the new console scripts and modifies the installer list supporting it. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Icd855f4534d9d9591165e99aa0eed6b1030018e0 Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-16Enable Domino testcaseCédric Ollivier1-1/+0
Domino is part of the OPNFV projects released for E [1]. As now Domino is ready for Functest integration (package and requirements), the testcase can be enabled. If the testcase fails, the issues should be related to Domino. [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-September/017951.html Change-Id: I26f3d3ae338def0f77c46c2cbda1baf3d55c1a41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-16Remove securityscanning testcaseCédric Ollivier1-17/+0
As the project is no longer released [1], security_scan is removed from testcases config files. It stops installing the related python package too. [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-September/017951.html Change-Id: Ieb9ff4c2975fbf2c85b875a088b0ec18503a3722 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-15Remove useless enabled: true in testcases.yamlCédric Ollivier1-2/+0
Change-Id: Ief2f4f580b4daef74e64d203fa1fc2be8f7e50c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-15Bug fix: wrong dependency filter for lxd scenariosMorgan Richomme1-2/+2
lxd scenario cannot run all the api_check tests, a regex has been set but on the wrong dependency (installer instead of scenario) Change-Id: I313e8d1ed3fa30488c100549f574a0cded08768f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-12Merge "Re-enable orchestra tests (VNF)"Cedric Ollivier1-2/+0
2017-09-11Re-enable orchestra tests (VNF)Morgan Richomme1-2/+0
"Marketplace is now running on port 8080. In addition, we have extended the marketplace backend in order to return the last modified header so that images are not re-downloaded all the time tests are executed. It should be done by Monday EOB" [1] [1]: https://jira.opnfv.org/browse/ORCHESTRA-17?jql=project%20%3D%20ORCHESTRA JIRA: ORCHESTRA-17 Change-Id: I17f6316003be9c2c3131ed640e6a32e482d1a174 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-09Remove Parser from the former ContainerCédric Ollivier1-17/+0
A dedicated Alpine container has been built for running the Parser testcase as it requires stable/pike instead of stable/ocata. Change-Id: Ifece75c64c1ed860eca7d0524ca581f41fc89276 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-08Exclude api_check on lxd scenariosMorgan Richomme1-1/+1
Most of the tests are OK but the last tests deal with qcow2 images the testcase is therefore not compatible with lxd sceanrio Change-Id: Ie67e5e1a67673c5d2076ef306bd7d29f46e6977f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-06Integrate doctor-test packagedongwenjuan1-1/+1
It updates tescases.yaml as run.sh is located in $PATH. repo_doctor is removed as it's now useless. It must be noted that doctor-test imports modules fom a relative path which can break the integration. Pylint warms them (W0403) [1]. [1] https://docs.pylint.org/en/1.6.0/features.html Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Icd3071a8e371048370bd3e07e08b6b52ddb35c13 Depends-On: I2091cfe4751640bf83d77e1fdd713af1e31fa89d Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-06Merge "Integrate new Domino package"Cedric Ollivier1-1/+1
2017-09-05Stop downloading openbaton image.Cédric Ollivier1-0/+2
It's downloaded in all CI runs and forbids several ones (timeout). Change-Id: I2f269d941990b7235eba7cc6d58ad17072495176 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-05Integrate new Domino packageCédric Ollivier1-1/+1
Change-Id: Iada952e3356fa89a122503c2a71aa31a9731469e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-01Merge "Activate SFC testcases in CI"Morgan Richomme1-1/+1
2017-09-01Activate SFC testcases in CIManuel Buil1-1/+1
SFC project is ready to run its tests in CI Change-Id: I337af8685d78e34af00eb86776bd3a44f423f2dd Signed-off-by: Manuel Buil <mbuil@suse.com>
2017-08-30Remove installer constraint on vyos_vrouter test caseMorgan Richomme1-2/+2
Change-Id: I44bdffc76fd2ee842c63b8fcddbe1696f23958a8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-29Merge "Put vnf_test pass if more than 80% of vnf test result are OK"Cedric Ollivier1-1/+1
2017-08-29Put vnf_test pass if more than 80% of vnf test result are OKboucherv1-1/+1
Change-Id: I1042176c587ef2bf1197c724cb5b1b6d67ffba3d Signed-off-by: boucherv <valentin.boucher@orange.com>