summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-10-27Write tempest_conf.yaml for all OPNFV installersCédric Ollivier1-5/+82
It follows "Move tempest logics in tempest_conf.yaml" [1] and then allows passing tempest_full and tempest_scenario in OPNFV gates. It set all params for all OPNFV installers according to their last runs [2][3][4]. Live migration is out of that custom params as it's currently considered as a key feature [5]. tempest_conf.yaml should be installer-centric and shouldn't take scenarios into account. It's unclear which installers support glance API v1 which is deprecated. Any installer can ask for testing it if supported. At least Apex doesn't support it [6]. Shelve is currenlty disabled because testing it could fail the whole tempest run if unsupported. We are missing data about which installer may support it. [1] https://gerrit.opnfv.org/gerrit/#/c/64067 [2] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [3] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [4] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html [5] https://artifacts.opnfv.org/logs/functest/ericsson-pod1/gambia/2018-10-27_06-10-07/tempest_full/tempest-report.html [6] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I17c8a2d738daaf1c2e97755c99f8886da8a531aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Set STORAGE_PROTOCOL=ceph if compassCédric Ollivier1-1/+1
Change-Id: If5b25041933cb7f16793d440783ec14122f568e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-22Merge "Stop running tempest full and scenario if healthcheck fails"Aric Gardner1-3/+7
2018-10-22Stop running tempest full and scenario if healthcheck failsCédric Ollivier1-3/+7
JIRA: FUNCTEST-1010 Change-Id: I7a39fb38ecfb325c249224a9283d7db353668ccf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-22Merge "Allow overriding DOCKER_TAG in functest-alpine.sh"Tim Rozet1-1/+1
2018-10-22Merge "[Compass4nfv]add missing jobs"mei mei1-0/+12
2018-10-21Allow overriding DOCKER_TAG in functest-alpine.shCédric Ollivier1-1/+1
It's mainly required by functest-apex-baremetal-daily-master which runs vs OpenStack master and OpenStack Rocky. Change-Id: I5e32f5b507fbe79a02bf5c61e67aa7f8c24f7789 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Set STORAGE_PROTOCOL=ceph if ApexCédric Ollivier1-0/+3
It should fix most of errors raised by tempest_full [1]. [1] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-20_12-23-41/tempest_full/tempest-report.html Change-Id: Ie93fe14d687a28185ac28b8c35636265a4fb4be2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-20Increase verify jobs timeoutCédric Ollivier1-1/+1
Verify durations have mostly been doubled without changes in Functest. Increasing the timeout allows bypassing the releng issues and falsy -1. Change-Id: I8e6244f358f18705716cf379f4ddfe8d6014a578 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-19[Compass4nfv]add missing jobswutianwei1-0/+12
This patch add the Functest and Yardstick jobs for compass Gambia branch. Change-Id: Icf4504841b7fe28b7ec29ae44aad01be24a691ef Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-10-18RTD jobs for all projectsAric Gardner1-0/+13
RTD jobs for all active projects All jobs start as non-voting. All rtd jobs are in their own file to faciliate future bulk changes: jjb/$project/$project-rtd-jobs.yaml All project have rtd pages https://opnfv-$project.readthedocs.io Change-Id: I776e41f968d38f08cb3187f743f69d5d6b697e8e Signed-off-by: Aric Gardner <agardner@linuxfoundation.org> Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-18Functest, Yardstick, Apex: Fix missing jobsTim Rozet1-0/+8
Functest/yardstick jobs are missing for Gambia. This patch adds them. Change-Id: If65bc5927dba745ff5dbd858b4e612c0f48e1ab1 Signed-off-by: Tim Rozet <trozet@redhat.com>
2018-10-17Fix duplicate IMAGE_PROPERTIES env variable in functest runDelia Popescu1-5/+8
Update envs only once with IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS if installer type is fuel or deploy scenario is ovs or fdio Change-Id: I7c1e997cf95d30972688e697574458a3a0f1e55c Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-16Merge "Correctly set IMAGE_PROPERTIES in functest-alpine.sh"Tim Rozet1-2/+2
2018-10-16Merge "Provide libvirt credentials"Tim Rozet1-1/+5
2018-10-16Functest: Sets max concurrent jobs to 10Tim Rozet1-0/+1
In Apex, some random jobs are queueing to intel-pod11 which does not exist anymore. The problem is, when these jobs queue they are blocking apex daily functest, as it looks like the job is only set to allow 1 job globally at a time. This change bumps the max concurrent global jobs to 10. Change-Id: I62d458a92abfa35bb0d1c459ccf4ffedfd51e66d Signed-off-by: Tim Rozet <trozet@redhat.com>
2018-10-15Ensure jobs don't get queued on offline buildersTrevor Bramwell3-0/+12
A change to the NodeLabelParameter config in JJB caused any jobs using the plugin to possibly have their jobs triggered on builders which weren't online. This in turn caused the queue to backup and newer jobs are blocked waiting for older ones to complete, which never happens as they're never queued on an online builder. The 'all-nodes' parameter ensure jobs that are set to run concurrently don't trigger across all available nodes at once, as this will include offline nodes as well. As this is the default of the plugin, projects which need it can enable it individually. Change-Id: Ia690eef078209b6b056dad85613dda6868b18271 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-14Correctly set IMAGE_PROPERTIES in functest-alpine.shCédric Ollivier1-2/+2
Change-Id: I4cecaf7302fa1f39aa1e8b2c3e34f11ee49b4359 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-04Provide libvirt credentialsStamatis Katsaounis1-1/+5
JIRA: FUNCTEST-1004 This patch provides lbivirt credentials which are required by intel testcases run only in fuel at os-nosdn-nofeature-noha scenario. Change-Id: I18eeb5dd78c09ea88a0ad49428584824547b6a89 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-09-26Increase functest job timeoutDelia Popescu1-1/+1
Functest job timeout is not enough Functest jobs are aborted after 480 min Change-Id: I74dfe12b08e322aad53e10d5808b5b739b8d9ce2 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-10Merge "Set image and flavor env variables functest for ovs|fdio"Trevor Bramwell1-0/+9
2018-10-09Set image and flavor env variables functest for ovs|fdioDelia Popescu1-0/+9
Set IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS environment variables for functest CI run for ovs and fdio scenarios. Change-Id: Ib2be311ee28d4ae633ec5496a12e741f701cc7ab Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-09Fix docker run command for functest on fuel installerDelia Popescu1-1/+1
Fix docker error because of environment variable IMAGE_PROPERTIES for fuel installer in functest Change-Id: I916f965f8432216104b767e5aa62dc93a8f6ce72 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-06Add image extra properties for fuel installer in functest testDelia Popescu1-1/+2
With using scsi volume device type, additional image extra_properties are needed. Set environment variable IMAGE_PROPERTIES when installer is fuel for functest test run. Related to: https://gerrit.opnfv.org/gerrit/#/c/61913/ https://gerrit.opnfv.org/gerrit/#/c/63225/ Change-Id: If35aa282abaf5dab1a5bacc2f26fe89292b09605 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-03Configure functest daily gambia jobs for fuel installerDelia Popescu1-0/+16
Add fuel CI PODs and armband CI PODs for gambia stream in functest-daily jobs Change-Id: I5d3405a8c8d19dd472738fdddb03fe09bc61df2e Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-09-23Fix Functest return valuesCédric Ollivier1-6/+3
The current impl doesn't exit as expected when running both tiers and testcases [1][2]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/284/console Change-Id: I934c3f54313522011ed87ebebe77fbb285b8ab49 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-16Add former testcase names as casesCédric Ollivier1-2/+2
Else Fraser jobs are wrong [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-fraser/lastFailedBuild/console Change-Id: I4b3e1cacb9da3a3c51ec5b1be615bd2049b6a6e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-13Merge "Add functest-k8 job for arm platform"mei mei1-0/+8
2018-09-12Merge "Update Functest jobs to manage new branches"Serena Feng7-0/+54
2018-09-11Update Functest jobs to manage new branchesCédric Ollivier7-0/+54
It manages stable/gambia and stable/hunter as well. Change-Id: Ib259995f8f0e45767a51204c4eb6fd239e66ed92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-08Fix tempest_full name when running Functest fraserCédric Ollivier1-2/+2
https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-fraser/373/console Change-Id: I8c76620c67c28ea3f14ff79aef98ad2815a3aaa9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-06Add functest-k8 job for arm platformJingzhao Ni1-0/+8
Create functest-k8 job for arm platform. It will be triggerd by container4nfv jobs. Add 2 arm pods to functest-daily pod list. Change-Id: If8209574263b863f2a907cd962f9511cc3db74ea Signed-off-by: Jingzhao Ni <jingzhao.ni@arm.com>
2018-09-04Run tempest_full and tempest_scenario in daily jjbsCédric Ollivier1-4/+10
It simply adds OpenStack jobs in OPNFV daily gates. OPNFV Installers seem good enough to meet the OpenStack merge criteria. Rally is still excluded as it ends after 3 hours. Change-Id: I16ea72c1ca49f485d81f9b06b435e9731b56083a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Build and run functest-benchmarkingCédric Ollivier3-3/+17
Change-Id: If2597ae36a2c6599b524543b67aac7f6272b384a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-17Build arm images and publish manifestsCédric Ollivier1-6/+97
It mainly follows the Functest docker jjb. Change-Id: Ia86082cfd5d2f19496e7801441e005ffc88595a3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-09Update Functest testcase list per tierCédric Ollivier2-7/+5
Change-Id: I905527d509597218927908be7752ca16b6ea2cc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-28Fix unset RC_FILE_PATH in ScriptsTrevor Bramwell1-1/+0
Even though RC_FILE_PATH is defined in Jenkins as passed in as a parameter, bash still sees it as unset. Removing the 'nounset' option from these scripts should allow the check to success (RC_FILE_PATH set to blank). Change-Id: Ibcfdcf0d2a12c8119d2fe3ec3b354be782338bd5 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-27Functest: Restores ability to run with pre-defined credsTim Rozet1-19/+23
This patch is needed for the case where there are provided OS credentials to functest, and there is no need to find the installer VM and copy the credentials to the host. In the Apex snapshot case, there is no installer VM on the slave, so we must provide the credentials file. Also includes a fix to use tempest_smoke_serial for the snapshot netvirt verification until CSIT suite is working correctly. Change-Id: Ic84955f527e3f84bb0d8579a377b4a1883fe3eb2 Signed-off-by: Tim Rozet <trozet@redhat.com>
2018-06-17Add functest-tempest jjbsCédric Ollivier1-0/+17
Change-Id: I235be16a5f6818801cc1ba2ba2f67ec27e43a90c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-17Update FUNCTEST suite and tier namesCédric Ollivier1-11/+14
Change-Id: I0bef73cf17e845faf3e1da42a07c5ada767fd731 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-16Update Functest testcase listCédric Ollivier1-3/+3
Change-Id: I1f9d2d594d1bd0e09edf4dd51cae2355623de7c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-16Run opnfv/functest-parser in Fraser daily jobsCédric Ollivier1-4/+12
Change-Id: I0a114482bdcb09beb634afd747b7c32f29d356cf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-16Stop running containers in privileged modeCédric Ollivier1-3/+5
It should be useless in case of Functest. Change-Id: Iac214dc484079bf17bbbfc08c28554835fac3f69 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-15Remove functest-parserCédric Ollivier2-4/+6
Parser should be fixed and then added to functest-smoke. Change-Id: I4f9e6fa736589b1ed01feae580df18c93de168cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-11Remove obsolete iptable rulesCédric Ollivier1-5/+0
It simply breaks parallel testing and seems useless/deprecated. Change-Id: I7dafa65f4acfdabb089cf0e10c66d5eb632500c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-05Stop hardcoding Docker repositoryCédric Ollivier2-8/+13
Change-Id: I7c8a131b4f80b58ee136e63c547c4fe55822a134 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-23Cleanup functest jobsDelia Popescu1-29/+0
Remove unnecessary arm-daily testsuite arm-daily does not require special builder or parameter changes Increase job-timeout to fit both architectures JIRA: FUNCTEST-917 Change-Id: Id31709740906fa9ea3918c8694d04fd88191f03f Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-16Rename files under jjb from 'yml' to 'yaml'Trevor Bramwell8-0/+0
global-jjb only supports the .yaml file ending for jjb jobs. Instead of waiting for a release we're going to rename the files. Change-Id: Icf3339eacd2320c583333e02250998cf6b1881f7 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-05-04Disable vnf runs for aarch64Delia Popescu1-2/+2
Functest VNF tests are not adapted for aarch64. The tests can be reactivated when they are adapted to execute on aarch64. JIRA: FUNCTEST-964 Change-Id: I2413a6eff831c8dd2751b7bc73ad583f55a00dcf Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-04-24Fix functest 'api/build' docs pathTrevor Bramwell1-1/+1
This is incorrectly listed as 'api/_build' which is causing the functest-docs-upload-master job to fail. Change-Id: I555b6e5e059712d501835d6e335a4de40bab255f Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>