aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2018-06-22Update tempest to inherit from VmReady1Cédric Ollivier1-0/+48
It also copies tempest.conf due to side effects raised by Barbican plugins. Change-Id: Ie87680f5d2e68527a5a61aac302838afc339dde8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-22Publish vmready scenariosCédric Ollivier3-0/+60
It will simplify code in juju_epc, tempest, etc. Change-Id: I195ae1d7d75f1c2f2eba76ae3c5307153e9b9759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Merge "Update patches"Cedric Ollivier2-0/+30
2018-06-21Update patchesCédric Ollivier2-0/+30
It patches specific values for singlevm1 and singlevm2 (arm64, ovs and fdio). Change-Id: Ibbd827b52520410bbbfa231eec23b08aeb511e0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Add the Barbican test suiteCédric Ollivier1-0/+15
It eases verifying the functionality of a barbican installation. Change-Id: Iac2144ae6ba4d61b2b37bb5c7a0359edb3f222a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Integrate Shaker as a new testcaseCédric Ollivier2-0/+19
Shaker wraps around popular system network testing tools like iperf, iperf3 and netperf (with help of flent). Change-Id: Idd82ffd9642c90335ad156e899c0330473260f15 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Publish singlevm scenariosCédric Ollivier1-30/+62
They ease creating all ressources to execute command in a new VM reachable via ssh. This scenarios should be reused by other more advanced ones (shaker, vping, cinder, etc.). Change-Id: If23866827c64a7afbdd8ff596dbc33710ee4ee20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-20Publish tenantnetwork scenariosCédric Ollivier1-0/+32
They ease creating all tenant network ressources. These scenarios should be reused by other more complex ones. Change-Id: I4ce1872065bde92408d34f2ca8823ce98275d8d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-12SNAPS via functest with flavor metadata configurablePanagiotis Karalis1-0/+1
The required data for the SNAPS flavors are sent through the config_functest yaml file in order for the SNAPS scenarios to be configured accordingly. If the config_functest yaml file includes empty flavor_extra_specs or there is not included this parameter, the SNAPS scenarios will be executed using the hardcoded value. Change-Id: I4ef46d1fe93497d658414170a72c4520d8f37808 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-05-29Simplify loggingPanagiotis Karalis1-49/+3
In order to collect logs from features running through functest framework (mainly for troubleshooting purposes), the logging mechanism has been updated accordingly. It should be noted that feature logs are printed in functest.log. All logs are now printed in functest.log whatever the namespace. JIRA: SFC-125 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I6cb32e5553749023d490d553ae4653750c52e844 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-26Merge "Add cinder_test testcase"Cedric Ollivier2-0/+37
2018-05-25Add cinder_test testcaseDelia Popescu2-0/+37
Create 2 instances with Floating IPs Attach data volume to instance 1 Write data on the volume Detach volume from instance 1 Attach volume to instance 2 Read data from volume JIRA: FUNCTEST-908 Change-Id: I10efdfb3b7f9d7e6ab5c6a538052437585d52fb0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-14Update cirros image version for ARM architectureDelia Popescu3-8/+6
Change-Id: Ia7a65a4f83798cb80ca7470d475c2c2d8c9fb6ea Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-10Add image extra properties back in vping_baseDelia Popescu1-0/+2
Image extra properties are missing for ARM Set image_url for ARM JIRA: ARMBAND-383 Change-Id: I0e2730c3f22214ad61d72424ea76173f1783d0ca Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-07Merge "Make volumes appear as SCSI devices in aarch64"Cedric Ollivier1-0/+8
2018-05-07Simplify vping_sshCédric Ollivier2-4/+4
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-02Make volumes appear as SCSI devices in aarch64Charalampos Kominos1-0/+8
Adding volumes in openstack by default uses virtio_blk and the devices appear as /dev/vdX. In aarch64 however a qemu pci slot is already in use so the tests cannot assign more than one volume to a VM. Forcing the drives to use virtio-scsi solves the issue and allows more volumes to be attached as /dev/sdX. The variable defining the drive is VOLUME_DEVICE_NAME and is passed as environmental variable when the container is created. JIRA: ARMBAND-376 Change-Id: Ia688cff338ff319e22a3b26796fa197297c23ce0 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
2018-04-30Rewrite TempestResourcesManagerCédric Ollivier1-1/+0
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-27Set image_url as filenameCédric Ollivier1-2/+1
It will be reused as soon as vping switches to openstacksdk. Change-Id: Ib84f4b35b22ead1741579ec9140d3626f9102469 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Check shell scripts via bashateCédric Ollivier1-1/+2
It also removes functest/cli/functest-complete.sh. Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Enable sdnvpn (Gambia Release)Cédric Ollivier1-1/+0
sdnvpn has been synced to OpenStack Queens [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/55531/ Change-Id: I468752394da12023083d83f92c91b09ecf964a26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Remove odl_netvirt testcaseCédric Ollivier1-22/+0
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Filter only on scenarios if possibleCédric Ollivier1-3/+3
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Set same dependencies for all vping test casesCédric Ollivier1-1/+1
It allows a fair comparison between odl and nosdn scenarios. Gluon could also be safely removed as scenario filter. https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable refstack_defcore due to testrCédric Ollivier1-0/+1
refstack_client is hardcoded to testr when normalizing tests list. It's disabled till refstack_client conforms with OpenStack Queens (.testr.conf was removed from tempest). Change-Id: I10c7059e049017db994003eb5d42da83e1d5a839 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable volume in Patrole 0.3 by defaultCédric Ollivier1-1/+0
Else it fails without /etc/cinder/policy.json. Change-Id: Iaa5fb5b42626f2fbe00c3a89fa3edf4eae4ac166 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable sfcCédric Ollivier1-1/+0
Sfc has been synchronized to OpenStack queens. Change-Id: I144d2c96777a3fc2c1b84101f1b7cdb085f90d50 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable Doctor and BarometerCédric Ollivier1-2/+0
They are now synchronized with OpenStack stable/queens. Change-Id: Ia333268e17e997c32d0f8f0b658397048c64c0ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Update to stable/queensCédric Ollivier1-0/+4
It allows getting first results before the blackout between MS0 and MS2.1. Testcases could work thanks to backward compatibility provided by openstack clients. It disables all features which are not synced (patches are under review). It will ease verifying installers which are following master because it reduces the gap between releases. Change-Id: If0893f6dbaed76d4bafbd10a4f0934e6c5057477 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Merge "support fuel&daisy for doctor in functest"Linda Wang1-1/+1
2018-04-12support fuel&daisy for doctor in functestdongwenjuan1-1/+1
Change-Id: Ibfce5a21517e52bb5b2ea7a2d34bd22037e6964e Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-03Remove NetVirt from installer dependenciesCédric Ollivier1-7/+7
Change-Id: Idb937b3ed4896208048b90b705dc3e6db6104b60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-27Allow check and verify as CI_LOOP valuesCédric Ollivier1-1/+1
It's required by the new promotion model [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/54501/ Change-Id: Ie12aae1c24e05a61b2afd5bbf92a97f2c71fd395 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-16Disable features in nofeature scenarioCédric Ollivier1-1/+1
Only Funtest testcases are verifying the referent scenarios. Change-Id: I29dfa012e9cba39216fdd58e5fd59255844f335b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-15Merge "Create 2 images and flavors for tempest tests"Cedric Ollivier1-4/+4
2018-03-15Remove the image for orchestra testsLinda Wang1-1/+0
Change-Id: I80797fc08c03795c6e1ec604306f77da7ecefc19 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Create 2 images and flavors for tempest testsLinda Wang1-4/+4
Also 1. remove the obsolete function: generate_test_accounts_file 2. Use patch mechanism to get config Change-Id: I455ac37de71519bcaf9a51e5f1de1b9bc83b9ba6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-15Set blocking of patrole falseLinda Wang1-1/+1
Change-Id: Ia6f0c6fec30af5c4124f21b2bdaa3084bced6f9e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-13Implement trunk ports testcasePanagiotis Karalis1-0/+17
The tempest testcases have been integrated from Neutron trunk testcases. It also enables every Neutron extension which may raise side effects [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html JIRA: FUNCTEST-926 Change-Id: I05015acf119f504ce0a5539d677719de874594ad Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-03-12Remove orchestra testcasesCédric Ollivier1-31/+0
They are incompatible with Pike and they have to be removed without any deep update. The testcases will be re-renabled if updated before 03/16/18. Change-Id: Ibf656db6ba4177eae44feb41cd5d314b7408d4de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-12Rewrite refstack testcaseCédric Ollivier1-3/+3
It now leverages on rally to factorize code between all tempest-based testcases. refstack-client is also added as requirement. JIRA: FUNCTEST-942 Change-Id: Ieee845327f8736582d77b898edd6c9edd00667e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-10Add patrole in opnfv/functest-restapiCédric Ollivier1-0/+22
Change-Id: I983898c27477986d9a5610e1df966fd00a8bc785 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-08Remove duplicate ubuntu trusty/14.04 os imageValentin Boucher1-1/+0
VNF testcase use some Operating System image 2 of those are the same but not with the same name Change-Id: Ide5ae683f606f7f58535c0a59cec45e4a30d225c Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-03-07Define a new env var for volume device nameCédric Ollivier1-1/+0
It eases modifying the volume device name written in tempest config. Fuel jobs should be adapted to set the right value (vdc) which differs from default (vdb). Change-Id: I09212018f94daa800ede815bd3586cceed0d54e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-05Load SfcFunctest instead of running a bash scriptCédric Ollivier1-4/+2
It allows publishing tests details. Change-Id: Iffc49f8258cdd2c145750343003f21921ac7ff67 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-03Set default volume_device_name = vdbCédric Ollivier1-1/+1
refstack_defcore is currently failing on all installers. It will highlight the right value per installer. A better way is to manage the device name by a new env var set by all installers (it may depend on kdrive configurations) JIRA: FUNCTEST-947 Change-Id: If1c12bc6798bc89136715bc78f2ac0b798e669e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-02Merge "Leverage on Xtesting"valentin boucher5-592/+30
2018-03-02Leverage on XtestingCédric Ollivier5-592/+30
It removes all the files which have moved to Xtesting. Vnf inheritances and env management will be improved in other changes. It keeps the same tree thanks to a symlink to allow publishing artifacts. Change-Id: I551bbd3f344cdab0158a50b7b09e541576695631 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-01Enable barometer run on compassLinda Wang1-1/+1
Change-Id: Ic6f4f2a2d06dc70338da3bad53deca0a62a03232 Signed-off-by: Linda Wang <wangwulin@huawei.com>