summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-11-19Fix a nit in functest-virtual.yamlCédric Ollivier1-1/+1
Change-Id: I993bac8545d896d1ead25c5f33c9645c52c5d208 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Fix functest-virtual (sudo + current dirs)Cédric Ollivier1-3/+3
It completes the previous commit [1] pulling all images. [1] https://gerrit.opnfv.org/gerrit/#/c/65203/ Change-Id: Id32aabf107064689a38d5ffb719ba5023c40296d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Pull all containers before running testsCédric Ollivier1-1/+34
Else we might test previous containers. Change-Id: I53b98f99f7fe5db8ea2087c93cfc58a03103db9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Enable vnf testing when gating FunctestCédric Ollivier1-3/+21
It adds rally_sanity and vnfs. From the time being, only rally_full is excluded (all-in-one). Change-Id: I451d1503a0a1633f4e3e68ed272742981f04eb36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Protect vs build-args not consumedCédric Ollivier1-4/+8
BRANCH is useless in case of components which only inherits from tempest. The build could simply fail depending on the docker version [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-components-latest-build/1/console Change-Id: I8ced7282c77463de9684904d141b2f18ae45d3c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Publish Functest gate jobCédric Ollivier1-70/+245
It mainly conforms with the first jjbs published in functest. It only differs regarding the numbers of multijobs (limited to 1 in releng) and the branch management. From the time being, rally-based testcases and vnfs are excluded to avoid falsy false. The next patch will update the gerrit trigger part. Change-Id: Ie1d2acbd9c4f2ad41ecd4cc43d0c13f855251349 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-12Verify Functest on functest-virtualCédric Ollivier1-0/+123
It runs most of healthcheck and tempest-based test cases as a first step. All benchmarking tools and all vnfs are not executed yet. All active Functest versions are verified thanks to backward compatibility ensured by Tempest and then by Functest. The jobs are designed to be run in parallel (we could also run all Functest versions in parallel instead of separated steps). It will be switched to a verify gate in a second step. Change-Id: I07cada848dd90f70da8741269692de8646813bdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-08RTD: Enable Gambia streamAric Gardner1-0/+8
Enable Gambia read the docs stream for all projects that have a gambia branch Also added edgecloud rtd job as it was missing Change-Id: I64d159cde0200871cd4ba3d2c071853c9bd502c1 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-10-30Revert "Avoid jenkins substitutions"Cédric Ollivier1-13/+10
This reverts commit 00431827b1a41f55fb700e69bfb229ccebc9c3f0. Change-Id: I77f0500b5e712745799dc9a7c7b94ce840e1f148 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-30Merge "Fix ODL restconf port if Compass"Aric Gardner1-0/+4
2018-10-30Avoid jenkins substitutionsCédric Ollivier1-10/+13
It's currently failing as DOCKER_TAG is replaced by '' [1]. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-gambia/21/console Change-Id: I3737c683fd85f6c426fdf2720b016f3452eab0b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-30Fix ODL restconf port if CompassCédric Ollivier1-0/+4
It conforms with the previous port which was hardcoded in odl.py. The default value (8181) seems wrong [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-gambia/7/console Change-Id: I9142d4f20a29b1f46b06bb1fed5569a299f55eff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-29Merge "Write tempest_conf.yaml for all OPNFV installers"Tim Rozet1-5/+82
2018-10-29Define DOCKER_TAG in Functest daily jobCédric Ollivier1-0/+3
It defines DOCKER_TAG as parameter in Functest daily job. It also fixes DOCKER_TAG default value in properties files and then complete the previous commit [1]. It should fix the current gate issues [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/64069/ [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/18/console Change-Id: Ia531ca68a455cc20294e123286062265b9b79d6f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-27Write tempest_conf.yaml for all OPNFV installersCédric Ollivier1-5/+82
It follows "Move tempest logics in tempest_conf.yaml" [1] and then allows passing tempest_full and tempest_scenario in OPNFV gates. It set all params for all OPNFV installers according to their last runs [2][3][4]. Live migration is out of that custom params as it's currently considered as a key feature [5]. tempest_conf.yaml should be installer-centric and shouldn't take scenarios into account. It's unclear which installers support glance API v1 which is deprecated. Any installer can ask for testing it if supported. At least Apex doesn't support it [6]. Shelve is currenlty disabled because testing it could fail the whole tempest run if unsupported. We are missing data about which installer may support it. [1] https://gerrit.opnfv.org/gerrit/#/c/64067 [2] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [3] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [4] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html [5] https://artifacts.opnfv.org/logs/functest/ericsson-pod1/gambia/2018-10-27_06-10-07/tempest_full/tempest-report.html [6] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I17c8a2d738daaf1c2e97755c99f8886da8a531aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Set STORAGE_PROTOCOL=ceph if compassCédric Ollivier1-1/+1
Change-Id: If5b25041933cb7f16793d440783ec14122f568e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-22Merge "Stop running tempest full and scenario if healthcheck fails"Aric Gardner1-3/+7
2018-10-22Stop running tempest full and scenario if healthcheck failsCédric Ollivier1-3/+7
JIRA: FUNCTEST-1010 Change-Id: I7a39fb38ecfb325c249224a9283d7db353668ccf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-22Merge "Allow overriding DOCKER_TAG in functest-alpine.sh"Tim Rozet1-1/+1
2018-10-22Merge "[Compass4nfv]add missing jobs"mei mei1-0/+12
2018-10-21Allow overriding DOCKER_TAG in functest-alpine.shCédric Ollivier1-1/+1
It's mainly required by functest-apex-baremetal-daily-master which runs vs OpenStack master and OpenStack Rocky. Change-Id: I5e32f5b507fbe79a02bf5c61e67aa7f8c24f7789 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Set STORAGE_PROTOCOL=ceph if ApexCédric Ollivier1-0/+3
It should fix most of errors raised by tempest_full [1]. [1] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-20_12-23-41/tempest_full/tempest-report.html Change-Id: Ie93fe14d687a28185ac28b8c35636265a4fb4be2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-20Increase verify jobs timeoutCédric Ollivier1-1/+1
Verify durations have mostly been doubled without changes in Functest. Increasing the timeout allows bypassing the releng issues and falsy -1. Change-Id: I8e6244f358f18705716cf379f4ddfe8d6014a578 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19[Compass4nfv]add missing jobswutianwei1-0/+12
This patch add the Functest and Yardstick jobs for compass Gambia branch. Change-Id: Icf4504841b7fe28b7ec29ae44aad01be24a691ef Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-10-18RTD jobs for all projectsAric Gardner1-0/+13
RTD jobs for all active projects All jobs start as non-voting. All rtd jobs are in their own file to faciliate future bulk changes: jjb/$project/$project-rtd-jobs.yaml All project have rtd pages https://opnfv-$project.readthedocs.io Change-Id: I776e41f968d38f08cb3187f743f69d5d6b697e8e Signed-off-by: Aric Gardner <agardner@linuxfoundation.org> Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-18Functest, Yardstick, Apex: Fix missing jobsTim Rozet1-0/+8
Functest/yardstick jobs are missing for Gambia. This patch adds them. Change-Id: If65bc5927dba745ff5dbd858b4e612c0f48e1ab1 Signed-off-by: Tim Rozet <trozet@redhat.com>
2018-10-17Fix duplicate IMAGE_PROPERTIES env variable in functest runDelia Popescu1-5/+8
Update envs only once with IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS if installer type is fuel or deploy scenario is ovs or fdio Change-Id: I7c1e997cf95d30972688e697574458a3a0f1e55c Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-16Merge "Correctly set IMAGE_PROPERTIES in functest-alpine.sh"Tim Rozet1-2/+2
2018-10-16Merge "Provide libvirt credentials"Tim Rozet1-1/+5
2018-10-16Functest: Sets max concurrent jobs to 10Tim Rozet1-0/+1
In Apex, some random jobs are queueing to intel-pod11 which does not exist anymore. The problem is, when these jobs queue they are blocking apex daily functest, as it looks like the job is only set to allow 1 job globally at a time. This change bumps the max concurrent global jobs to 10. Change-Id: I62d458a92abfa35bb0d1c459ccf4ffedfd51e66d Signed-off-by: Tim Rozet <trozet@redhat.com>
2018-10-15Ensure jobs don't get queued on offline buildersTrevor Bramwell3-0/+12
A change to the NodeLabelParameter config in JJB caused any jobs using the plugin to possibly have their jobs triggered on builders which weren't online. This in turn caused the queue to backup and newer jobs are blocked waiting for older ones to complete, which never happens as they're never queued on an online builder. The 'all-nodes' parameter ensure jobs that are set to run concurrently don't trigger across all available nodes at once, as this will include offline nodes as well. As this is the default of the plugin, projects which need it can enable it individually. Change-Id: Ia690eef078209b6b056dad85613dda6868b18271 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-14Correctly set IMAGE_PROPERTIES in functest-alpine.shCédric Ollivier1-2/+2
Change-Id: I4cecaf7302fa1f39aa1e8b2c3e34f11ee49b4359 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-04Provide libvirt credentialsStamatis Katsaounis1-1/+5
JIRA: FUNCTEST-1004 This patch provides lbivirt credentials which are required by intel testcases run only in fuel at os-nosdn-nofeature-noha scenario. Change-Id: I18eeb5dd78c09ea88a0ad49428584824547b6a89 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-09-26Increase functest job timeoutDelia Popescu1-1/+1
Functest job timeout is not enough Functest jobs are aborted after 480 min Change-Id: I74dfe12b08e322aad53e10d5808b5b739b8d9ce2 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-10Merge "Set image and flavor env variables functest for ovs|fdio"Trevor Bramwell1-0/+9
2018-10-09Set image and flavor env variables functest for ovs|fdioDelia Popescu1-0/+9
Set IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS environment variables for functest CI run for ovs and fdio scenarios. Change-Id: Ib2be311ee28d4ae633ec5496a12e741f701cc7ab Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-09Fix docker run command for functest on fuel installerDelia Popescu1-1/+1
Fix docker error because of environment variable IMAGE_PROPERTIES for fuel installer in functest Change-Id: I916f965f8432216104b767e5aa62dc93a8f6ce72 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-06Add image extra properties for fuel installer in functest testDelia Popescu1-1/+2
With using scsi volume device type, additional image extra_properties are needed. Set environment variable IMAGE_PROPERTIES when installer is fuel for functest test run. Related to: https://gerrit.opnfv.org/gerrit/#/c/61913/ https://gerrit.opnfv.org/gerrit/#/c/63225/ Change-Id: If35aa282abaf5dab1a5bacc2f26fe89292b09605 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-03Configure functest daily gambia jobs for fuel installerDelia Popescu1-0/+16
Add fuel CI PODs and armband CI PODs for gambia stream in functest-daily jobs Change-Id: I5d3405a8c8d19dd472738fdddb03fe09bc61df2e Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-09-23Fix Functest return valuesCédric Ollivier1-6/+3
The current impl doesn't exit as expected when running both tiers and testcases [1][2]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/284/console Change-Id: I934c3f54313522011ed87ebebe77fbb285b8ab49 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-16Add former testcase names as casesCédric Ollivier1-2/+2
Else Fraser jobs are wrong [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-fraser/lastFailedBuild/console Change-Id: I4b3e1cacb9da3a3c51ec5b1be615bd2049b6a6e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-13Merge "Add functest-k8 job for arm platform"mei mei1-0/+8
2018-09-12Merge "Update Functest jobs to manage new branches"Serena Feng7-0/+54
2018-09-11Update Functest jobs to manage new branchesCédric Ollivier7-0/+54
It manages stable/gambia and stable/hunter as well. Change-Id: Ib259995f8f0e45767a51204c4eb6fd239e66ed92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-08Fix tempest_full name when running Functest fraserCédric Ollivier1-2/+2
https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-fraser/373/console Change-Id: I8c76620c67c28ea3f14ff79aef98ad2815a3aaa9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-06Add functest-k8 job for arm platformJingzhao Ni1-0/+8
Create functest-k8 job for arm platform. It will be triggerd by container4nfv jobs. Add 2 arm pods to functest-daily pod list. Change-Id: If8209574263b863f2a907cd962f9511cc3db74ea Signed-off-by: Jingzhao Ni <jingzhao.ni@arm.com>
2018-09-04Run tempest_full and tempest_scenario in daily jjbsCédric Ollivier1-4/+10
It simply adds OpenStack jobs in OPNFV daily gates. OPNFV Installers seem good enough to meet the OpenStack merge criteria. Rally is still excluded as it ends after 3 hours. Change-Id: I16ea72c1ca49f485d81f9b06b435e9731b56083a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Build and run functest-benchmarkingCédric Ollivier3-3/+17
Change-Id: If2597ae36a2c6599b524543b67aac7f6272b384a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Build arm images and publish manifestsCédric Ollivier1-6/+97
It mainly follows the Functest docker jjb. Change-Id: Ia86082cfd5d2f19496e7801441e005ffc88595a3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-09Update Functest testcase list per tierCédric Ollivier2-7/+5
Change-Id: I905527d509597218927908be7752ca16b6ea2cc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>