summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-12-11[utils, functest] Fix SSL-enabled Fuel conditionAlexandru Avadanii1-1/+1
Fuel enables SSL based on scenario type (only for HA), not based on cluster type (baremetal or virtual). Change-Id: I3dc94f953e9a8ee0e94028577270ac05c9318ad6 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-12-07Disable blocking on buildable queue (Functest)Cédric Ollivier1-3/+0
Else daily jjbs could be dead blocked as they are triggered at the same time. Change-Id: I3f3c4bc96b603fbaa76806238191fbce240220f9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-03Temporarily disable perm (tox)Cédric Ollivier1-1/+1
The permissions are incorrect in functest-virtual [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-latest-ut-gate/2/console Change-Id: I18b0bc3361b99316c0f77207e3c060333f8fcc74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-28Merge "Run tox in functest-virtual"Morgan Richomme1-0/+46
2018-11-27Switch from block-level to blocking-level (former)Cédric Ollivier1-3/+3
[1] https://docs.openstack.org/infra/jenkins-job-builder/properties.html Change-Id: Ic9e20f28ab3093ff29c1cc1681e75812db7ed949 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Run tox in functest-virtualCédric Ollivier1-0/+46
It will replace the former jjb and avoids running functional tests if the patchset is wrong. Change-Id: I4264780180d953b0dac0febf1f1c2dc2d08f93c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Clean all containers as first stepCédric Ollivier1-90/+82
It overprotects vs aborted jobs or failures in CI. It fixes few urls printed in console. Change-Id: Ibbaacfd9d51c5424c5632fcdeaedf619fd946006 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Clean Functest containers even if failureCédric Ollivier1-40/+160
It creates an additional multijob to ensure all containers are removed. It also publishes logs via gsutil. Change-Id: I45bd8aec3569e3257b94ea978c5bf2fd703649be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Disable vnf testing in daily gatesCédric Ollivier1-3/+3
heat_ims sometimes fails. It mainly eases saving time when developping the workflow. Change-Id: I230461a3bae508bf60771df3f01a8271a2735065 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Fix latest tag in functest-virtual.yamlCédric Ollivier1-1/+1
Change-Id: If3df5a002db5157dea423f3acac6c47b78d9b4ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Avoid possible deadblocks in Functest jjbsCédric Ollivier1-1/+24
From the time being, only 2 executors are allowed and then it may lead to deadblocks if two multijobs are executed. Normally we should only forbid gate and daily jobs at the time (tags are hardcoded). It reverts to new patchset triggers as on core approval is buggy. Daily jobs are now triggered once a day. Change-Id: Iaa1ae73f8baeed037dd2f20f05ec3b15d1643b3b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-24Gate Functest tests when +2Cédric Ollivier1-1/+1
It will update to Workflow as soon as possible. Change-Id: Id12afa6836b4cc0129666480eb92c36132c32823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-24Add check mode in Functest jjbsCédric Ollivier1-28/+114
It allows checking one specific change on LF resources. It completes the two modes already defined: daily and gate. Change-Id: I7ccadf1ef07533bb549ee365b4f3deedd3d457fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-22Add triggers to verify FunctestCédric Ollivier1-25/+30
It runs testcases for all new patchset. Change-Id: Ida99e2f40cf3a7a6bc002e81cee27eb67ea62ff0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Fix a nit in functest-virtual.yamlCédric Ollivier1-1/+1
Change-Id: I993bac8545d896d1ead25c5f33c9645c52c5d208 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Fix functest-virtual (sudo + current dirs)Cédric Ollivier1-3/+3
It completes the previous commit [1] pulling all images. [1] https://gerrit.opnfv.org/gerrit/#/c/65203/ Change-Id: Id32aabf107064689a38d5ffb719ba5023c40296d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Pull all containers before running testsCédric Ollivier1-1/+34
Else we might test previous containers. Change-Id: I53b98f99f7fe5db8ea2087c93cfc58a03103db9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Enable vnf testing when gating FunctestCédric Ollivier1-3/+21
It adds rally_sanity and vnfs. From the time being, only rally_full is excluded (all-in-one). Change-Id: I451d1503a0a1633f4e3e68ed272742981f04eb36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Protect vs build-args not consumedCédric Ollivier1-4/+8
BRANCH is useless in case of components which only inherits from tempest. The build could simply fail depending on the docker version [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-components-latest-build/1/console Change-Id: I8ced7282c77463de9684904d141b2f18ae45d3c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Publish Functest gate jobCédric Ollivier1-70/+245
It mainly conforms with the first jjbs published in functest. It only differs regarding the numbers of multijobs (limited to 1 in releng) and the branch management. From the time being, rally-based testcases and vnfs are excluded to avoid falsy false. The next patch will update the gerrit trigger part. Change-Id: Ie1d2acbd9c4f2ad41ecd4cc43d0c13f855251349 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-12Verify Functest on functest-virtualCédric Ollivier1-0/+123
It runs most of healthcheck and tempest-based test cases as a first step. All benchmarking tools and all vnfs are not executed yet. All active Functest versions are verified thanks to backward compatibility ensured by Tempest and then by Functest. The jobs are designed to be run in parallel (we could also run all Functest versions in parallel instead of separated steps). It will be switched to a verify gate in a second step. Change-Id: I07cada848dd90f70da8741269692de8646813bdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-08RTD: Enable Gambia streamAric Gardner1-0/+8
Enable Gambia read the docs stream for all projects that have a gambia branch Also added edgecloud rtd job as it was missing Change-Id: I64d159cde0200871cd4ba3d2c071853c9bd502c1 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-10-30Revert "Avoid jenkins substitutions"Cédric Ollivier1-13/+10
This reverts commit 00431827b1a41f55fb700e69bfb229ccebc9c3f0. Change-Id: I77f0500b5e712745799dc9a7c7b94ce840e1f148 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-30Merge "Fix ODL restconf port if Compass"Aric Gardner1-0/+4
2018-10-30Avoid jenkins substitutionsCédric Ollivier1-10/+13
It's currently failing as DOCKER_TAG is replaced by '' [1]. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-gambia/21/console Change-Id: I3737c683fd85f6c426fdf2720b016f3452eab0b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-30Fix ODL restconf port if CompassCédric Ollivier1-0/+4
It conforms with the previous port which was hardcoded in odl.py. The default value (8181) seems wrong [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-gambia/7/console Change-Id: I9142d4f20a29b1f46b06bb1fed5569a299f55eff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-29Merge "Write tempest_conf.yaml for all OPNFV installers"Tim Rozet1-5/+82
2018-10-29Define DOCKER_TAG in Functest daily jobCédric Ollivier1-0/+3
It defines DOCKER_TAG as parameter in Functest daily job. It also fixes DOCKER_TAG default value in properties files and then complete the previous commit [1]. It should fix the current gate issues [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/64069/ [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/18/console Change-Id: Ia531ca68a455cc20294e123286062265b9b79d6f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-27Write tempest_conf.yaml for all OPNFV installersCédric Ollivier1-5/+82
It follows "Move tempest logics in tempest_conf.yaml" [1] and then allows passing tempest_full and tempest_scenario in OPNFV gates. It set all params for all OPNFV installers according to their last runs [2][3][4]. Live migration is out of that custom params as it's currently considered as a key feature [5]. tempest_conf.yaml should be installer-centric and shouldn't take scenarios into account. It's unclear which installers support glance API v1 which is deprecated. Any installer can ask for testing it if supported. At least Apex doesn't support it [6]. Shelve is currenlty disabled because testing it could fail the whole tempest run if unsupported. We are missing data about which installer may support it. [1] https://gerrit.opnfv.org/gerrit/#/c/64067 [2] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [3] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [4] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html [5] https://artifacts.opnfv.org/logs/functest/ericsson-pod1/gambia/2018-10-27_06-10-07/tempest_full/tempest-report.html [6] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I17c8a2d738daaf1c2e97755c99f8886da8a531aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Set STORAGE_PROTOCOL=ceph if compassCédric Ollivier1-1/+1
Change-Id: If5b25041933cb7f16793d440783ec14122f568e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-22Merge "Stop running tempest full and scenario if healthcheck fails"Aric Gardner1-3/+7
2018-10-22Stop running tempest full and scenario if healthcheck failsCédric Ollivier1-3/+7
JIRA: FUNCTEST-1010 Change-Id: I7a39fb38ecfb325c249224a9283d7db353668ccf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-22Merge "Allow overriding DOCKER_TAG in functest-alpine.sh"Tim Rozet1-1/+1
2018-10-22Merge "[Compass4nfv]add missing jobs"mei mei1-0/+12
2018-10-21Allow overriding DOCKER_TAG in functest-alpine.shCédric Ollivier1-1/+1
It's mainly required by functest-apex-baremetal-daily-master which runs vs OpenStack master and OpenStack Rocky. Change-Id: I5e32f5b507fbe79a02bf5c61e67aa7f8c24f7789 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Set STORAGE_PROTOCOL=ceph if ApexCédric Ollivier1-0/+3
It should fix most of errors raised by tempest_full [1]. [1] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-20_12-23-41/tempest_full/tempest-report.html Change-Id: Ie93fe14d687a28185ac28b8c35636265a4fb4be2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-20Increase verify jobs timeoutCédric Ollivier1-1/+1
Verify durations have mostly been doubled without changes in Functest. Increasing the timeout allows bypassing the releng issues and falsy -1. Change-Id: I8e6244f358f18705716cf379f4ddfe8d6014a578 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19[Compass4nfv]add missing jobswutianwei1-0/+12
This patch add the Functest and Yardstick jobs for compass Gambia branch. Change-Id: Icf4504841b7fe28b7ec29ae44aad01be24a691ef Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-10-18RTD jobs for all projectsAric Gardner1-0/+13
RTD jobs for all active projects All jobs start as non-voting. All rtd jobs are in their own file to faciliate future bulk changes: jjb/$project/$project-rtd-jobs.yaml All project have rtd pages https://opnfv-$project.readthedocs.io Change-Id: I776e41f968d38f08cb3187f743f69d5d6b697e8e Signed-off-by: Aric Gardner <agardner@linuxfoundation.org> Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-18Functest, Yardstick, Apex: Fix missing jobsTim Rozet1-0/+8
Functest/yardstick jobs are missing for Gambia. This patch adds them. Change-Id: If65bc5927dba745ff5dbd858b4e612c0f48e1ab1 Signed-off-by: Tim Rozet <trozet@redhat.com>
2018-10-17Fix duplicate IMAGE_PROPERTIES env variable in functest runDelia Popescu1-5/+8
Update envs only once with IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS if installer type is fuel or deploy scenario is ovs or fdio Change-Id: I7c1e997cf95d30972688e697574458a3a0f1e55c Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-16Merge "Correctly set IMAGE_PROPERTIES in functest-alpine.sh"Tim Rozet1-2/+2
2018-10-16Merge "Provide libvirt credentials"Tim Rozet1-1/+5
2018-10-16Functest: Sets max concurrent jobs to 10Tim Rozet1-0/+1
In Apex, some random jobs are queueing to intel-pod11 which does not exist anymore. The problem is, when these jobs queue they are blocking apex daily functest, as it looks like the job is only set to allow 1 job globally at a time. This change bumps the max concurrent global jobs to 10. Change-Id: I62d458a92abfa35bb0d1c459ccf4ffedfd51e66d Signed-off-by: Tim Rozet <trozet@redhat.com>
2018-10-15Ensure jobs don't get queued on offline buildersTrevor Bramwell3-0/+12
A change to the NodeLabelParameter config in JJB caused any jobs using the plugin to possibly have their jobs triggered on builders which weren't online. This in turn caused the queue to backup and newer jobs are blocked waiting for older ones to complete, which never happens as they're never queued on an online builder. The 'all-nodes' parameter ensure jobs that are set to run concurrently don't trigger across all available nodes at once, as this will include offline nodes as well. As this is the default of the plugin, projects which need it can enable it individually. Change-Id: Ia690eef078209b6b056dad85613dda6868b18271 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-14Correctly set IMAGE_PROPERTIES in functest-alpine.shCédric Ollivier1-2/+2
Change-Id: I4cecaf7302fa1f39aa1e8b2c3e34f11ee49b4359 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-04Provide libvirt credentialsStamatis Katsaounis1-1/+5
JIRA: FUNCTEST-1004 This patch provides lbivirt credentials which are required by intel testcases run only in fuel at os-nosdn-nofeature-noha scenario. Change-Id: I18eeb5dd78c09ea88a0ad49428584824547b6a89 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-09-26Increase functest job timeoutDelia Popescu1-1/+1
Functest job timeout is not enough Functest jobs are aborted after 480 min Change-Id: I74dfe12b08e322aad53e10d5808b5b739b8d9ce2 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-10Merge "Set image and flavor env variables functest for ovs|fdio"Trevor Bramwell1-0/+9
2018-10-09Set image and flavor env variables functest for ovs|fdioDelia Popescu1-0/+9
Set IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS environment variables for functest CI run for ovs and fdio scenarios. Change-Id: Ib2be311ee28d4ae633ec5496a12e741f701cc7ab Signed-off-by: Delia Popescu <delia.popescu@enea.com>