aboutsummaryrefslogtreecommitdiffstats
path: root/docker/vnf/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6d1302779501918acdbbd4047a67a010901814b1)
2020-07-15Update functest/ci/testcases.yamlCédric Ollivier1-1/+1
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f36cc92bb628b53ed3a58fa84a24f94f006d6f30)
2019-02-11Merge "Update and enable Cloudify-based testcases"Juha Kosonen1-2/+0
2019-02-11Update and enable Cloudify-based testcasesCédric Ollivier1-2/+0
It switches from the Cloudify virtual machine to the community container which allows deploying vyos_vrouter and cloudify_ims. Last stable Cloudify OpenStack plugin (2.4.17) is now deployed. It also updates the Cloudify python package to latest release. It adds a delay before deleting the blueprint which may be improved in a second change (it allows enabling the testcase in the stable release). Change-Id: Ie48a2c9d2badab0d7ba0b9e7845f453fad335ef7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Move rally_full in benchmarkingCédric Ollivier1-1/+1
It allows merging all benchmarking testcases in one tiers and saves lots of time as they could all run in parallel. Change-Id: I551179709d2ce862056c1f5fcc1e16ef0b776dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Update Cloudify imagesCédric Ollivier1-0/+2
The former image can't be downloaded and then breaks all gates. It will be completed by changes in vnf if needed. Change-Id: Ie364aa2315257157a5e09eb4ba121926a60e7b26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-06Run vnfs in all scenariosCédric Ollivier1-10/+0
It allows fair comparisons between scenarios (e.g. ovs dpdk). os-nosdn-calipso-noha could be verified VNFs as well [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/32/console Change-Id: I0490eade81c531e38ce7156a61446a9fccaffb17 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Move shaker and vmtp into functest-benchmarkingCédric Ollivier1-1/+1
It also updates all jobs and fixes Dockerhub hooks. Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Update Xtesting to 0.60Cédric Ollivier1-10/+5
Xtesting leverages on stevedore [1] which will bring much more flexibility (discovery, module or class renaming, etc). OPNFV Features have to be updated as well: - https://gerrit.opnfv.org/gerrit/61713 - https://gerrit.opnfv.org/gerrit/61715 - https://gerrit.opnfv.org/gerrit/61717 - https://gerrit.opnfv.org/gerrit/61719 [1] https://docs.openstack.org/stevedore/latest/ Change-Id: I0ce45eb6c9af66546c2c020eb962fa457f6c7e1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-23New Heat IMS testcaseValentin Boucher1-1/+16
In order to validate OpenStack Master deployment we create this new testcase using OpenStack Heat as an Orchestrator for Clearwater VNF JIRA: FUNCTEST-995 Change-Id: I8b7b74a3753c2d4d4614e9a2798283bd3f99d5d2 Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-07-13Fix components and vnf testcase dependenciesCédric Ollivier1-9/+4
It completes "Leverage to Xtesting 0.51" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/59755/ Change-Id: Id36f1d84c305829d14e069b6ec5d056256f42fe1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-10Publish cloudify scenarioCédric Ollivier1-0/+13
It eases deploying any vnf via Cloudify. It also stops duplicating code between vims and vrouter. Co-Authored-By: Valentin Boucher <valentin.boucher@kontron.com> Change-Id: I5fe06d91804f4781f6b1301da12862bac793ffbb Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Remove orchestra testcasesCédric Ollivier1-31/+0
They are incompatible with Pike and they have to be removed without any deep update. The testcases will be re-renabled if updated before 03/16/18. Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-19Disable orchestra_clearwaterims in functest-vnfCédric Ollivier1-1/+1
It fixes a typo. Change-Id: I684eab0ed74e2ebcb6f72442d0b3012d1b5de7aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Test vnf in all os-nosdn-nofeature scenariosCédric Ollivier1-7/+7
It allows setting os-nosdn-nofeature-noha as default value if DEPLOY_SCENARIO is unset. As orchestra* testcases are already disabled, it's useless to ask a specific installer. All vnf testcases should work vs any installer. Change-Id: Ia388f96348f9d06745f8d1669962d7f1c4e47d84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-13Temporarily disable doctor-notificationCédric Ollivier1-1/+0
It's currently forbidding gating all APEX' scenarios [1] (even os-nosdn-nofeature-* [2]). It will be enabled when it's fixed or when functest jobs are rewritten [3] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/772/console [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/770/console [3] https://gerrit.opnfv.org/gerrit/#/c/51853/ Change-Id: I571c464aabe02f67a9e98ca1ab42d8a7efc672ee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-06Disable orchestra_* testcasesCédric Ollivier1-0/+2
They can be simply disabled and they unsuccessfully run vs Daily only. In a second step, moving the related python modules in a new orchestra repository could be a good solution simply because they don't reach our coding criteria. The best way is still to update them according to our rules and to check all installers thanks to these two vnfs. Change-Id: If36b16f0ed95d7039db9455a32c18f7fd1a739ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-21Enable orchestra testcases for Daisy onlyCédric Ollivier1-2/+2
The current testcases have several issues which limit the possible successful runs to Daisy [1]. [1] https://jira.opnfv.org/browse/ORCHESTRA-17 Change-Id: Iecaf21738e19aae6a88171385f11afcffd28a348 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-15Filter out orchestra for ssl enabled deploymentsMichael Polenchuk1-2/+2
Skip orchestra tests for the Compass & Fuel/MCP installers until OpenBaton have updated to version 4.x+ with SSL support. JIRA: ORCHESTRA-17 Change-Id: I894a08fb5ac83a6b1d59d7bcf3a681a8d596968f Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-14[vyos_vrouter] Support https endpointsShuyaNakama1-1/+1
JIRA: FUNCTEST-881 vyos_vrouter did not support https endpoints [1]. I fixed the following two points. 1. Modifying blueprint of Cloudify. 2. Changing nova client of utilvnf module. Point 1 I added command of support https endpoint to blueprint of vyos_vrouter. The Blueprint of vyos_vrouter is on our github repository [2]. I updated our repository. Point 2 I changed nova client of utilvnf module. Utilvnf module is utility module of vyos_vrouter. Nova client of utilvnf module did not support https endpoints. So, I changed to use nova client of snaps. After fixed the source code, I confirmed the vyos_vrouter was succeeded in the following two environments. 1. Our labs (Instoller:fuel, environment of https endpoints) 2. Orange POD (Instoller:compass, environment of http endpoints) [1] https://jira.opnfv.org/browse/FUNCTEST-881 [2] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/blob/master/function-test-openstack-blueprint.yaml Change-Id: I468df0f2486a34bc558ad161eb7de44264549006 Signed-off-by: ShuyaNakama <shuya.nakama@okinawaopenlabs.org>
2017-12-11vEPC tests with juju as an VNF managersoumaya1-0/+16
juju_epc testcase validate EPC setup with the help of ABoT which acting as test executor. Functest-abot-epc-bundle deploys OAI charms alongwith mysql and ABoT. JUJU is acting as a VNF manager. Change-Id: I45d7b37f21f6b8c7049ab2bf42a4678e30b67a72 Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2017-12-04Create a tox env to check yaml filesCédric Ollivier1-4/+7
It also fixes all testcases config files. Change-Id: I81a6ffb8b7acf4239c79129dc842e283d3d32b35 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Reorder Vnf testcasesCédric Ollivier1-14/+15
Cloudify IMS testcases could easily tigger jjob timeouts. Vyos_router should run before as it ends much quickier. Change-Id: Icd4323a7216615e75613e5fb241ae144f727d4fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Filter installers for cloudify_vrouterCédric Ollivier1-1/+1
As cloudify_vrouter doesn't support SSL endpoints [1], it shouldn't be executed if compass or fuel. [1] https://jira.opnfv.org/browse/FUNCTEST-881 Change-Id: Ieedc0d5eca57f00da2121c9e07dd5cc57f978ef6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-10-11Fix fail of vRouter on Orange PODroot1-2/+1
1. Functest docker container environment has no attribute 'OS_REGION_NAME' 2. vRouter was get the 'OS_REGION_NAME' but not used it. 3. Deleting use 'OS_REGION_NAME' part of vRouter. 4. Utility lib of vRouter use Nova client. 5. Modifying Nova client authentication step for auth api v3. 6. Doing test of modified vRouter on Orange POD. Change-Id: I062549e5ca48fb4825b53448a4e2ffc8c1f8ec40 Signed-off-by: root <shuya.nakama@okinawaopenlabs.org>
2017-10-03Disable vyos_vrouterCédric Ollivier1-0/+1
It's postponed to 5.1. Change-Id: Ic06d47b4b5df167044363b40aea0c7932b550be7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-09-21Adding orchestra test cases to orchestra projectMorgan Richomme1-2/+2
Orchestra introduced 2 VNF test cases: * orchestra_openims * orchestra_clearwaterims In the configuration, the 2 projects are still assigned to functest project This patch associate the cases with their real project Change-Id: I81f6d6fb473916f0f91a5b3795b3ed433c283fb4 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-19Remove restriction to fuel on vyosvrouter case in AlpineMorgan Richomme1-1/+1
It was done in old docker but not reported in Alpine Change-Id: I3479ad996b64187f58e97cc3b4a4b2ceefeec287 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-11Re-enable orchestra tests (VNF)Morgan Richomme1-2/+0
"Marketplace is now running on port 8080. In addition, we have extended the marketplace backend in order to return the last modified header so that images are not re-downloaded all the time tests are executed. It should be done by Monday EOB" [1] [1]: https://jira.opnfv.org/browse/ORCHESTRA-17?jql=project%20%3D%20ORCHESTRA JIRA: ORCHESTRA-17 Change-Id: I17f6316003be9c2c3131ed640e6a32e482d1a174 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-05Stop downloading openbaton image.Cédric Ollivier1-0/+2
It's downloaded in all CI runs and forbids several ones (timeout). Change-Id: I2f269d941990b7235eba7cc6d58ad17072495176 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-29Merge "Put vnf_test pass if more than 80% of vnf test result are OK"Cedric Ollivier1-1/+1
2017-08-29Put vnf_test pass if more than 80% of vnf test result are OKboucherv1-1/+1
Change-Id: I1042176c587ef2bf1197c724cb5b1b6d67ffba3d Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-08-29Refactor the vyos_vrouter to adopt VNF abstractionShuya Nakama1-0/+14
JIRA: FUNCTEST-788 1.Modifying code of vyos_vrouter to inherit vnf abstraction class. 2.Adding vyos_vrouter code from our repo to functest. 3.Adding unit test of vyos_vrouter. 4.Doing test of modified vyos_vrouter codes on our labs. Change-Id: I77e4be8b2a140ea0176c607f2be736599f893ace Signed-off-by: Shuya Nakama <shuya.nakama@okinawaopenlabs.org>
2017-08-21Euphrates cleaning: remove any reference to aaa vnfMorgan Richomme1-16/+0
aaa vnf was created in Danube to illustrate the vnf abstraction as real implementations are now available and nobody really implements a real aaa test case, it is better to remove any reference to aaa vnf Note modification on the documentation will be done accordingly Change-Id: Iab6d96c955a6a7dc178588592382e42d68ec604c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-20Complete the container opnfv-vnfCédric Ollivier1-0/+43
It adds the following testcases: - aaa - orchestra_openims - orchestra_clearwaterims opera_vims is not yet integrated as it depends on Opera [1] and its package must be fixed before being installed in Functest [2]. vyos_vrouter will be added when a package is available for installing opnfv-functest-vrouter [3]. [1] https://wiki.opnfv.org/display/OPERA/Opera+Home [2] https://git.opnfv.org/opera/tree/requirements.txt [3] https://github.com/oolorg/opnfv-functest-vrouter Change-Id: Iccd4626ec29c1e9eb1c2accc81fdf1a9ae1e613f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-20Fix ci_loop conditions for vnfCédric Ollivier1-1/+1
Weekly jobs should run all tests (vnf included). Change-Id: I25b43654d48e9ae5df5c18fd565423a310d4c68b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-18Integrate cloudify_ims in functest-featuresCédric Ollivier1-0/+22
We only rely on system libraries in case of Alpine. It's not possible in case of Ubuntu 14.04 because libxml is too old. Change-Id: I304f8ea5e9a6541e9719210db9d07949107bf193 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>