aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2018-08-08Conform with OpenStack gatesCédric Ollivier1-5/+46
It adds testcases and updates regexes to conform with OpenStack gates: - tempest-full - neutron-tempest-plugin-api It should be noted that tempest-smoke is no longer run in gates and two testcases are available for tempest-full as we can't manage Tempest combine. Criteria is set to 100% for tempest_full (it works in OpenStack gates). JIRA: FUNCTEST-1000 Change-Id: I77a0f533255483bdf61f0a5f60c9c437ce843591 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-23New Heat IMS testcaseValentin Boucher1-1/+16
In order to validate OpenStack Master deployment we create this new testcase using OpenStack Heat as an Orchestrator for Clearwater VNF JIRA: FUNCTEST-995 Change-Id: I8b7b74a3753c2d4d4614e9a2798283bd3f99d5d2 Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-07-18Temporarily disable test_image_signing testsCédric Ollivier1-1/+2
They don't pass in two different Queens deployments. The topic will continue upstream. Change-Id: I43d6b8306aee6934fa1545ec3ed8130bb9b23ee4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-16Fix typos in trunk-detailsCédric Ollivier1-1/+1
Else neutron_trunk is skipped [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/184/console Change-Id: I5d63e84414d8fc3af3ef2ac5b4d023fc5e59ef81 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-16Rename Patrole config fieldsCédric Ollivier1-2/+2
Else it conflicts with the new tempest config fields [1]. It makes sense to switch to includes here. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/566/console Change-Id: If7b3025b4003ea5704c6a3cdeae8cd00f1c5509e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Dynamically skip neutron_trunk and barbicanCédric Ollivier1-6/+7
It avoids fasly testcases in failure for end users. It also removes the neutron_trunk class which is now useless (Queens). Change-Id: I3f5a1ac84a50e061da6eadcc5c9bafb2e99050db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15TypoCédric Ollivier1-1/+1
Change-Id: I55064f83d2a97eaae2a2861d4451ae34e547c40c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-15Include neutron_tempest_plugin in tempest-[smoke,full]Cédric Ollivier1-3/+4
Change-Id: I19f9a6ff2f76a4684bf341b2f22ffc4d09dca1cc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-12Leverage to Xtesting 0.51Cédric Ollivier1-90/+16
It removes ci_loop which has been useless from Docker slicing. It can filter now on any env var (e.g. CI_LOOP if required by XCI). Change-Id: Ibd685edf4636bd251c85466e8b4febcd1e20d312 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-10Publish cloudify scenarioCédric Ollivier1-0/+13
It eases deploying any vnf via Cloudify. It also stops duplicating code between vims and vrouter. Co-Authored-By: Valentin Boucher <valentin.boucher@kontron.com> Change-Id: I5fe06d91804f4781f6b1301da12862bac793ffbb Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2018-07-09Merge "Refactor tempest common"Cedric Ollivier1-6/+14
2018-07-09Add Vmtp as a new testcaseCédric Ollivier1-0/+17
VMTP is a small python application that will automatically perform ping connectivity, round trip time measurement (latency) and TCP/UDP throughput. JIRA: FUNCTEST-980 Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-08Refactor tempest commonCédric Ollivier1-6/+14
It also renames two testcases and updates all docs because tests run in parallel in case of tempest smoke. To force one thread as before: run: module: 'functest.opnfv_tests.openstack.tempest.tempest' class: 'TempestCommon' args: mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' option: - '--concurrency=1' JIRA: FUNCTEST-989 Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-03Revert "Disable all new testcases for MS3.1"Cédric Ollivier1-10/+10
This reverts commit 0ff1a51fa53cb74f7a671edc3f1502838294d5c9. Change-Id: I1ff9cb23978cbfcec6a3284654aaf6b153214a19 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-26Disable all new testcases for MS3.1Cédric Ollivier1-11/+11
It has been decided in TSC release meeting. Change-Id: I0a62f18c5b11fe31ac72fc301c5444e8d89b6fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Move odl into healthcheckCédric Ollivier1-20/+20
It should be included in healthcheck as all basic tests. Change-Id: I48439fe6385a9056eed8b779290f20633d59b0fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Implement connection_check via shade tooCédric Ollivier1-4/+2
SNAPS connection_check tests are merged into api_check. It would ease debugging deployment as well [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console Change-Id: I30254a46c3dc6874881d687e36903c6b7878d63d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Move vping_* and cinder_test into healthcheckCédric Ollivier1-45/+44
Change-Id: I193c6dcdf90fe8eac46884fe5a5a329b0e5a7322 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-22Publish vmready scenariosCédric Ollivier1-0/+32
It will simplify code in juju_epc, tempest, etc. Change-Id: I195ae1d7d75f1c2f2eba76ae3c5307153e9b9759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Add the Barbican test suiteCédric Ollivier1-0/+15
It eases verifying the functionality of a barbican installation. Change-Id: Iac2144ae6ba4d61b2b37bb5c7a0359edb3f222a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Integrate Shaker as a new testcaseCédric Ollivier1-0/+18
Shaker wraps around popular system network testing tools like iperf, iperf3 and netperf (with help of flent). Change-Id: Idd82ffd9642c90335ad156e899c0330473260f15 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Publish singlevm scenariosCédric Ollivier1-30/+62
They ease creating all ressources to execute command in a new VM reachable via ssh. This scenarios should be reused by other more advanced ones (shaker, vping, cinder, etc.). Change-Id: If23866827c64a7afbdd8ff596dbc33710ee4ee20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-20Publish tenantnetwork scenariosCédric Ollivier1-0/+32
They ease creating all tenant network ressources. These scenarios should be reused by other more complex ones. Change-Id: I4ce1872065bde92408d34f2ca8823ce98275d8d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-25Add cinder_test testcaseDelia Popescu1-0/+18
Create 2 instances with Floating IPs Attach data volume to instance 1 Write data on the volume Detach volume from instance 1 Attach volume to instance 2 Read data from volume JIRA: FUNCTEST-908 Change-Id: I10efdfb3b7f9d7e6ab5c6a538052437585d52fb0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-07Simplify vping_sshCédric Ollivier1-2/+2
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Enable sdnvpn (Gambia Release)Cédric Ollivier1-1/+0
sdnvpn has been synced to OpenStack Queens [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/55531/ Change-Id: I468752394da12023083d83f92c91b09ecf964a26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Remove odl_netvirt testcaseCédric Ollivier1-22/+0
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Filter only on scenarios if possibleCédric Ollivier1-3/+3
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Set same dependencies for all vping test casesCédric Ollivier1-1/+1
It allows a fair comparison between odl and nosdn scenarios. Gluon could also be safely removed as scenario filter. https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable refstack_defcore due to testrCédric Ollivier1-0/+1
refstack_client is hardcoded to testr when normalizing tests list. It's disabled till refstack_client conforms with OpenStack Queens (.testr.conf was removed from tempest). Change-Id: I10c7059e049017db994003eb5d42da83e1d5a839 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable volume in Patrole 0.3 by defaultCédric Ollivier1-1/+0
Else it fails without /etc/cinder/policy.json. Change-Id: Iaa5fb5b42626f2fbe00c3a89fa3edf4eae4ac166 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable sfcCédric Ollivier1-1/+0
Sfc has been synchronized to OpenStack queens. Change-Id: I144d2c96777a3fc2c1b84101f1b7cdb085f90d50 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable Doctor and BarometerCédric Ollivier1-2/+0
They are now synchronized with OpenStack stable/queens. Change-Id: Ia333268e17e997c32d0f8f0b658397048c64c0ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Update to stable/queensCédric Ollivier1-0/+4
It allows getting first results before the blackout between MS0 and MS2.1. Testcases could work thanks to backward compatibility provided by openstack clients. It disables all features which are not synced (patches are under review). It will ease verifying installers which are following master because it reduces the gap between releases. Change-Id: If0893f6dbaed76d4bafbd10a4f0934e6c5057477 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Merge "support fuel&daisy for doctor in functest"Linda Wang1-1/+1
2018-04-12support fuel&daisy for doctor in functestdongwenjuan1-1/+1
Change-Id: Ibfce5a21517e52bb5b2ea7a2d34bd22037e6964e Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-03Remove NetVirt from installer dependenciesCédric Ollivier1-7/+7
Change-Id: Idb937b3ed4896208048b90b705dc3e6db6104b60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-27Allow check and verify as CI_LOOP valuesCédric Ollivier1-1/+1
It's required by the new promotion model [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/54501/ Change-Id: Ie12aae1c24e05a61b2afd5bbf92a97f2c71fd395 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Disable features in nofeature scenarioCédric Ollivier1-1/+1
Only Funtest testcases are verifying the referent scenarios. Change-Id: I29dfa012e9cba39216fdd58e5fd59255844f335b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Set blocking of patrole falseLinda Wang1-1/+1
Change-Id: Ia6f0c6fec30af5c4124f21b2bdaa3084bced6f9e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis1-0/+17
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-12Remove orchestra testcasesCédric Ollivier1-31/+0
They are incompatible with Pike and they have to be removed without any deep update. The testcases will be re-renabled if updated before 03/16/18. Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Rewrite refstack testcaseCédric Ollivier1-3/+3
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Add patrole in opnfv/functest-restapiCédric Ollivier1-0/+22
Change-Id: I983898c27477986d9a5610e1df966fd00a8bc785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-05Load SfcFunctest instead of running a bash scriptCédric Ollivier1-4/+2
It allows publishing tests details. Change-Id: Iffc49f8258cdd2c145750343003f21921ac7ff67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-02Merge "Leverage on Xtesting"valentin boucher1-2/+2
2018-03-02Leverage on XtestingCédric Ollivier1-2/+2
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Enable barometer run on compassLinda Wang1-1/+1
Change-Id: Ic6f4f2a2d06dc70338da3bad53deca0a62a03232 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-02-14Enable doctor-notificationCédric Ollivier1-1/+0
The testcase has been expected to work since the nova bug [1] was bypassed [2]. [1] https://bugs.launchpad.net/nova/+bug/1742827 [2] https://gerrit.opnfv.org/gerrit/#/c/52075/ Change-Id: If53da6313381cf69a0093a6677db3d9033fb8f48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>