aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2018-07-11Print all debug messages in a second fileCédric Ollivier1-8/+8
All modules are allowed to print in functest.debug.log. Change-Id: I9c0be258dba985c9d3171bc2d324464e41e1c584 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-10Define one logger per key moduleCédric Ollivier1-3/+69
Snaps is printing lots of error messages which makes user confused. It will decrease the size of functest.log. Change-Id: I2c7d8ec968350563fbfbd62dcc2fc39b13b39a78 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2018-07-10Publish cloudify scenarioCédric Ollivier1-0/+13
It eases deploying any vnf via Cloudify. It also stops duplicating code between vims and vrouter. Co-Authored-By: Valentin Boucher <valentin.boucher@kontron.com> Change-Id: I5fe06d91804f4781f6b1301da12862bac793ffbb Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2018-07-09Merge "Refactor tempest common"Cedric Ollivier1-6/+14
2018-07-09Add Vmtp as a new testcaseCédric Ollivier3-0/+34
VMTP is a small python application that will automatically perform ping connectivity, round trip time measurement (latency) and TCP/UDP throughput. JIRA: FUNCTEST-980 Change-Id: I8e94fc52a429f505ac14e14bbb9d0a3b20996ba4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-08Refactor tempest commonCédric Ollivier1-6/+14
It also renames two testcases and updates all docs because tests run in parallel in case of tempest smoke. To force one thread as before: run: module: 'functest.opnfv_tests.openstack.tempest.tempest' class: 'TempestCommon' args: mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' option: - '--concurrency=1' JIRA: FUNCTEST-989 Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-03Merge "Revert "Disable all new testcases for MS3.1""valentin boucher1-10/+10
2018-07-03Revert "Disable all new testcases for MS3.1"Cédric Ollivier1-10/+10
This reverts commit 0ff1a51fa53cb74f7a671edc3f1502838294d5c9. Change-Id: I1ff9cb23978cbfcec6a3284654aaf6b153214a19 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-30Inherit rally from VmReady1Cédric Ollivier3-8/+60
It also fixes clean(). Change-Id: I42d1305d5cdb5a717cfa7fce26798ac7102310f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-29Update patches for all tests based on scenariosCédric Ollivier1-0/+60
Change-Id: Iff7fd8e6c14bdfb67ae146c5be1e073673a951d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-28Get aarch64 image metadata for cinder and vping testcaseDelia Popescu1-0/+24
Image metadata for cinder and vping tests is no longer set for ARM Change-Id: I2ab8e6ce55c6e619b96e49ecec7afe727a902345 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-06-27Merge "Modify config_patch.yaml according to the new snaps config"Cedric Ollivier1-0/+4
2018-06-27Modify config_patch.yaml according to the new snaps configCédric Ollivier1-0/+4
It allows verifying ovs scenarios via snaps. JIRA: FUNCTEST-984 Change-Id: I0fedadc0b9e265c424ae3221469b8d28b9a68afa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-26Take shaker arm64 image into accountCédric Ollivier2-0/+9
Change-Id: Ia1da6e97027df2cfa923f5ba076731e4a2817b1f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-26Disable all new testcases for MS3.1Cédric Ollivier1-11/+11
It has been decided in TSC release meeting. Change-Id: I0a62f18c5b11fe31ac72fc301c5444e8d89b6fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Move odl into healthcheckCédric Ollivier1-20/+20
It should be included in healthcheck as all basic tests. Change-Id: I48439fe6385a9056eed8b779290f20633d59b0fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Implement connection_check via shade tooCédric Ollivier1-4/+2
SNAPS connection_check tests are merged into api_check. It would ease debugging deployment as well [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/127/console Change-Id: I30254a46c3dc6874881d687e36903c6b7878d63d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-25Move vping_* and cinder_test into healthcheckCédric Ollivier1-45/+44
Change-Id: I193c6dcdf90fe8eac46884fe5a5a329b0e5a7322 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-22Update tempest to inherit from VmReady1Cédric Ollivier1-0/+48
It also copies tempest.conf due to side effects raised by Barbican plugins. Change-Id: Ie87680f5d2e68527a5a61aac302838afc339dde8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-22Publish vmready scenariosCédric Ollivier3-0/+60
It will simplify code in juju_epc, tempest, etc. Change-Id: I195ae1d7d75f1c2f2eba76ae3c5307153e9b9759 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Merge "Update patches"Cedric Ollivier2-0/+30
2018-06-21Update patchesCédric Ollivier2-0/+30
It patches specific values for singlevm1 and singlevm2 (arm64, ovs and fdio). Change-Id: Ibbd827b52520410bbbfa231eec23b08aeb511e0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Add the Barbican test suiteCédric Ollivier1-0/+15
It eases verifying the functionality of a barbican installation. Change-Id: Iac2144ae6ba4d61b2b37bb5c7a0359edb3f222a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Integrate Shaker as a new testcaseCédric Ollivier2-0/+19
Shaker wraps around popular system network testing tools like iperf, iperf3 and netperf (with help of flent). Change-Id: Idd82ffd9642c90335ad156e899c0330473260f15 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-21Publish singlevm scenariosCédric Ollivier1-30/+62
They ease creating all ressources to execute command in a new VM reachable via ssh. This scenarios should be reused by other more advanced ones (shaker, vping, cinder, etc.). Change-Id: If23866827c64a7afbdd8ff596dbc33710ee4ee20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-20Publish tenantnetwork scenariosCédric Ollivier1-0/+32
They ease creating all tenant network ressources. These scenarios should be reused by other more complex ones. Change-Id: I4ce1872065bde92408d34f2ca8823ce98275d8d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-12SNAPS via functest with flavor metadata configurablePanagiotis Karalis1-0/+1
The required data for the SNAPS flavors are sent through the config_functest yaml file in order for the SNAPS scenarios to be configured accordingly. If the config_functest yaml file includes empty flavor_extra_specs or there is not included this parameter, the SNAPS scenarios will be executed using the hardcoded value. Change-Id: I4ef46d1fe93497d658414170a72c4520d8f37808 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-05-29Simplify loggingPanagiotis Karalis1-49/+3
In order to collect logs from features running through functest framework (mainly for troubleshooting purposes), the logging mechanism has been updated accordingly. It should be noted that feature logs are printed in functest.log. All logs are now printed in functest.log whatever the namespace. JIRA: SFC-125 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I6cb32e5553749023d490d553ae4653750c52e844 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-26Merge "Add cinder_test testcase"Cedric Ollivier2-0/+37
2018-05-25Add cinder_test testcaseDelia Popescu2-0/+37
Create 2 instances with Floating IPs Attach data volume to instance 1 Write data on the volume Detach volume from instance 1 Attach volume to instance 2 Read data from volume JIRA: FUNCTEST-908 Change-Id: I10efdfb3b7f9d7e6ab5c6a538052437585d52fb0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-14Update cirros image version for ARM architectureDelia Popescu3-8/+6
Change-Id: Ia7a65a4f83798cb80ca7470d475c2c2d8c9fb6ea Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-10Add image extra properties back in vping_baseDelia Popescu1-0/+2
Image extra properties are missing for ARM Set image_url for ARM JIRA: ARMBAND-383 Change-Id: I0e2730c3f22214ad61d72424ea76173f1783d0ca Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-07Merge "Make volumes appear as SCSI devices in aarch64"Cedric Ollivier1-0/+8
2018-05-07Simplify vping_sshCédric Ollivier2-4/+4
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-02Make volumes appear as SCSI devices in aarch64Charalampos Kominos1-0/+8
Adding volumes in openstack by default uses virtio_blk and the devices appear as /dev/vdX. In aarch64 however a qemu pci slot is already in use so the tests cannot assign more than one volume to a VM. Forcing the drives to use virtio-scsi solves the issue and allows more volumes to be attached as /dev/sdX. The variable defining the drive is VOLUME_DEVICE_NAME and is passed as environmental variable when the container is created. JIRA: ARMBAND-376 Change-Id: Ia688cff338ff319e22a3b26796fa197297c23ce0 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com>
2018-04-30Rewrite TempestResourcesManagerCédric Ollivier1-1/+0
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-27Set image_url as filenameCédric Ollivier1-2/+1
It will be reused as soon as vping switches to openstacksdk. Change-Id: Ib84f4b35b22ead1741579ec9140d3626f9102469 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Check shell scripts via bashateCédric Ollivier1-1/+2
It also removes functest/cli/functest-complete.sh. Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Enable sdnvpn (Gambia Release)Cédric Ollivier1-1/+0
sdnvpn has been synced to OpenStack Queens [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/55531/ Change-Id: I468752394da12023083d83f92c91b09ecf964a26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Remove odl_netvirt testcaseCédric Ollivier1-22/+0
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Filter only on scenarios if possibleCédric Ollivier1-3/+3
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-15Set same dependencies for all vping test casesCédric Ollivier1-1/+1
It allows a fair comparison between odl and nosdn scenarios. Gluon could also be safely removed as scenario filter. https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable refstack_defcore due to testrCédric Ollivier1-0/+1
refstack_client is hardcoded to testr when normalizing tests list. It's disabled till refstack_client conforms with OpenStack Queens (.testr.conf was removed from tempest). Change-Id: I10c7059e049017db994003eb5d42da83e1d5a839 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Disable volume in Patrole 0.3 by defaultCédric Ollivier1-1/+0
Else it fails without /etc/cinder/policy.json. Change-Id: Iaa5fb5b42626f2fbe00c3a89fa3edf4eae4ac166 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable sfcCédric Ollivier1-1/+0
Sfc has been synchronized to OpenStack queens. Change-Id: I144d2c96777a3fc2c1b84101f1b7cdb085f90d50 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Enable Doctor and BarometerCédric Ollivier1-2/+0
They are now synchronized with OpenStack stable/queens. Change-Id: Ia333268e17e997c32d0f8f0b658397048c64c0ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Update to stable/queensCédric Ollivier1-0/+4
It allows getting first results before the blackout between MS0 and MS2.1. Testcases could work thanks to backward compatibility provided by openstack clients. It disables all features which are not synced (patches are under review). It will ease verifying installers which are following master because it reduces the gap between releases. Change-Id: If0893f6dbaed76d4bafbd10a4f0934e6c5057477 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Merge "support fuel&daisy for doctor in functest"Linda Wang1-1/+1
2018-04-12support fuel&daisy for doctor in functestdongwenjuan1-1/+1
Change-Id: Ibfce5a21517e52bb5b2ea7a2d34bd22037e6964e Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>