summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2019-01-31Stop running rally_jobs and neutron-tempest-plugin-api in //Cédric Ollivier1-7/+24
It moves rally_jobs into a separate multijob step. The next two testcases can raise timeout (1 min) if Routers related workloads are executed at the same time [1]. - test_routers.RoutersIpV6Test.test_router_interface_status - test_routers.RoutersTest.test_router_interface_status [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-neutron-tempest-plugin-api-run-35/results/neutron-tempest-plugin-api/tempest-report.html Change-Id: Id631a9d9b27effe67cd7a0e7cba3943f9e734278 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-29Add rally_full in all gatesCédric Ollivier1-3/+3
rally full is fully verified in Functest gates (all OS versions). It's so relevant to add this key testcase. Functest gates end in 4 hours (all testcases included). Change-Id: I595b02bc4e06a893853b5c49b610e1fd28d8cec7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Stop blacklisting tempest testsCédric Ollivier1-3/+0
functest-virtual is fully verified by latest tempest_full. Change-Id: I212e3aa83c74d58945c9057a104db4a9fabd403b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Fix a nitCédric Ollivier1-1/+1
Change-Id: I919b065e69515a75f3be90ee9d01437e9fe83449 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Generate functest.yaml to verify OS masterCédric Ollivier1-5/+11
Change-Id: If39c18e0b9f5578b0e42b6e57cec10474d0fec5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-21Fix typos in functest-kubernetes (container names)Cédric Ollivier1-12/+12
Change-Id: Ieb701c9e80115a7f492f0dd80cf3603593d04e70 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-17Remove unused BRANCH when building functest k8s featuresCédric Ollivier1-1/+1
Change-Id: Ia6dc8cc368837e7c8db3b61d92b76340782dead8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-17Remove unused Docker build argsCédric Ollivier1-2/+2
Docker installed in OPNFV releng build servers doesn't allow unused args. Change-Id: I904d0542a8a9fd881ae66d65757a7b9bc8b74757 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-15Generate functest-kubernetes.yaml via collivier.xtestingCédric Ollivier1-0/+541
Change-Id: I30a504fbf052d5ce24a470e3c255fc33d1df65d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-14Update Functest jobsCédric Ollivier1-14/+0
rally_full fails due to the SUT (functest-virtual). fds was not part of Gambia and shouldn't be ready yet. Change-Id: I372eb933e9aa78ddd962bd7477e83eb62f87ae97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-14Generate xtesting.yaml via collivier.xtestingCédric Ollivier1-47/+47
It adds project in jjb names to allow loading xtesting and functest jobs in one command. Change-Id: I120ab713cb73abc1f6aaf195e60fbcec9e45f740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-12Set docker_args as expected by functest-virtualCédric Ollivier1-0/+3
Change-Id: Ia30c5bc380898f8bacb32c74b19092faf504bfbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-12Update Functest gate jobsCédric Ollivier2-622/+971
It conforms with the last updates of collivier.xtesting [1]. [1] https://galaxy.ansible.com/collivier/xtesting Change-Id: Idd2c1599d161d558961fb5b3509c565593f7fc07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-05Allow conditional docker build argsCédric Ollivier1-1/+6
It allows managing xtesting and functest jjbs via the same role. functest-component doesn't take BRANCH into account. Change-Id: If487e8350bca6b37d585a4ed16214e77df6170ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Precise Xtesting view filterCédric Ollivier1-4/+4
Change-Id: Ib2488e32b766b1a3c1ec68797b9d510397517b0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Add Xtesting gate jobsCédric Ollivier1-36/+294
It conforms with the last updates of collivier.xtesting [1]. [1] https://galaxy.ansible.com/collivier/xtesting Change-Id: Ie94990c872f079735a87ce67c8ffb9378559c016 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Clean Xtesting logs as privilegedCédric Ollivier1-3/+3
It also mutes gsutils and precises Xtesting view regex. Change-Id: Idf0457205dc53e9cca2befc139b65715511e8ebf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Leverage on $WORKSPACE in xtesting.yamlCédric Ollivier1-4/+6
It also forces the right slave when pulling/removing the docker images. Change-Id: I36c4b0d7f046c25d51458ec6dee0da163eb3ee2d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Fix Xtesting workspaceCédric Ollivier1-6/+5
It completes "Publish Xtesting daily jobs" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66131/ Change-Id: I82cd92f8ad3fd777868eba9875793846662cfddf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Publish Xtesting daily jobsCédric Ollivier1-0/+150
They verify the rolling containers. xtesting.yaml has been generated via collivier.xtesting (ansible role). Change-Id: Idf7cce42bee15174e4242891a102f6599026b3b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-11[utils, functest] Fix SSL-enabled Fuel conditionAlexandru Avadanii1-1/+1
Fuel enables SSL based on scenario type (only for HA), not based on cluster type (baremetal or virtual). Change-Id: I3dc94f953e9a8ee0e94028577270ac05c9318ad6 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-12-07Disable blocking on buildable queue (Functest)Cédric Ollivier1-3/+0
Else daily jjbs could be dead blocked as they are triggered at the same time. Change-Id: I3f3c4bc96b603fbaa76806238191fbce240220f9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-03Temporarily disable perm (tox)Cédric Ollivier1-1/+1
The permissions are incorrect in functest-virtual [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-latest-ut-gate/2/console Change-Id: I18b0bc3361b99316c0f77207e3c060333f8fcc74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-28Merge "Run tox in functest-virtual"Morgan Richomme1-0/+46
2018-11-27Switch from block-level to blocking-level (former)Cédric Ollivier1-3/+3
[1] https://docs.openstack.org/infra/jenkins-job-builder/properties.html Change-Id: Ic9e20f28ab3093ff29c1cc1681e75812db7ed949 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Run tox in functest-virtualCédric Ollivier1-0/+46
It will replace the former jjb and avoids running functional tests if the patchset is wrong. Change-Id: I4264780180d953b0dac0febf1f1c2dc2d08f93c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Clean all containers as first stepCédric Ollivier1-90/+82
It overprotects vs aborted jobs or failures in CI. It fixes few urls printed in console. Change-Id: Ibbaacfd9d51c5424c5632fcdeaedf619fd946006 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Clean Functest containers even if failureCédric Ollivier1-40/+160
It creates an additional multijob to ensure all containers are removed. It also publishes logs via gsutil. Change-Id: I45bd8aec3569e3257b94ea978c5bf2fd703649be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Disable vnf testing in daily gatesCédric Ollivier1-3/+3
heat_ims sometimes fails. It mainly eases saving time when developping the workflow. Change-Id: I230461a3bae508bf60771df3f01a8271a2735065 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Fix latest tag in functest-virtual.yamlCédric Ollivier1-1/+1
Change-Id: If3df5a002db5157dea423f3acac6c47b78d9b4ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Avoid possible deadblocks in Functest jjbsCédric Ollivier1-1/+24
From the time being, only 2 executors are allowed and then it may lead to deadblocks if two multijobs are executed. Normally we should only forbid gate and daily jobs at the time (tags are hardcoded). It reverts to new patchset triggers as on core approval is buggy. Daily jobs are now triggered once a day. Change-Id: Iaa1ae73f8baeed037dd2f20f05ec3b15d1643b3b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-24Gate Functest tests when +2Cédric Ollivier1-1/+1
It will update to Workflow as soon as possible. Change-Id: Id12afa6836b4cc0129666480eb92c36132c32823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-24Add check mode in Functest jjbsCédric Ollivier1-28/+114
It allows checking one specific change on LF resources. It completes the two modes already defined: daily and gate. Change-Id: I7ccadf1ef07533bb549ee365b4f3deedd3d457fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-22Add triggers to verify FunctestCédric Ollivier1-25/+30
It runs testcases for all new patchset. Change-Id: Ida99e2f40cf3a7a6bc002e81cee27eb67ea62ff0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Fix a nit in functest-virtual.yamlCédric Ollivier1-1/+1
Change-Id: I993bac8545d896d1ead25c5f33c9645c52c5d208 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Fix functest-virtual (sudo + current dirs)Cédric Ollivier1-3/+3
It completes the previous commit [1] pulling all images. [1] https://gerrit.opnfv.org/gerrit/#/c/65203/ Change-Id: Id32aabf107064689a38d5ffb719ba5023c40296d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Pull all containers before running testsCédric Ollivier1-1/+34
Else we might test previous containers. Change-Id: I53b98f99f7fe5db8ea2087c93cfc58a03103db9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Enable vnf testing when gating FunctestCédric Ollivier1-3/+21
It adds rally_sanity and vnfs. From the time being, only rally_full is excluded (all-in-one). Change-Id: I451d1503a0a1633f4e3e68ed272742981f04eb36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Protect vs build-args not consumedCédric Ollivier1-4/+8
BRANCH is useless in case of components which only inherits from tempest. The build could simply fail depending on the docker version [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-components-latest-build/1/console Change-Id: I8ced7282c77463de9684904d141b2f18ae45d3c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Publish Functest gate jobCédric Ollivier1-70/+245
It mainly conforms with the first jjbs published in functest. It only differs regarding the numbers of multijobs (limited to 1 in releng) and the branch management. From the time being, rally-based testcases and vnfs are excluded to avoid falsy false. The next patch will update the gerrit trigger part. Change-Id: Ie1d2acbd9c4f2ad41ecd4cc43d0c13f855251349 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-12Verify Functest on functest-virtualCédric Ollivier1-0/+123
It runs most of healthcheck and tempest-based test cases as a first step. All benchmarking tools and all vnfs are not executed yet. All active Functest versions are verified thanks to backward compatibility ensured by Tempest and then by Functest. The jobs are designed to be run in parallel (we could also run all Functest versions in parallel instead of separated steps). It will be switched to a verify gate in a second step. Change-Id: I07cada848dd90f70da8741269692de8646813bdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-08RTD: Enable Gambia streamAric Gardner1-0/+8
Enable Gambia read the docs stream for all projects that have a gambia branch Also added edgecloud rtd job as it was missing Change-Id: I64d159cde0200871cd4ba3d2c071853c9bd502c1 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-10-30Revert "Avoid jenkins substitutions"Cédric Ollivier1-13/+10
This reverts commit 00431827b1a41f55fb700e69bfb229ccebc9c3f0. Change-Id: I77f0500b5e712745799dc9a7c7b94ce840e1f148 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-30Merge "Fix ODL restconf port if Compass"Aric Gardner1-0/+4
2018-10-30Avoid jenkins substitutionsCédric Ollivier1-10/+13
It's currently failing as DOCKER_TAG is replaced by '' [1]. [1] https://build.opnfv.org/ci/job/functest-apex-baremetal-daily-gambia/21/console Change-Id: I3737c683fd85f6c426fdf2720b016f3452eab0b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-30Fix ODL restconf port if CompassCédric Ollivier1-0/+4
It conforms with the previous port which was hardcoded in odl.py. The default value (8181) seems wrong [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-gambia/7/console Change-Id: I9142d4f20a29b1f46b06bb1fed5569a299f55eff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-29Merge "Write tempest_conf.yaml for all OPNFV installers"Tim Rozet1-5/+82
2018-10-29Define DOCKER_TAG in Functest daily jobCédric Ollivier1-0/+3
It defines DOCKER_TAG as parameter in Functest daily job. It also fixes DOCKER_TAG default value in properties files and then complete the previous commit [1]. It should fix the current gate issues [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/64069/ [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/18/console Change-Id: Ia531ca68a455cc20294e123286062265b9b79d6f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-27Write tempest_conf.yaml for all OPNFV installersCédric Ollivier1-5/+82
It follows "Move tempest logics in tempest_conf.yaml" [1] and then allows passing tempest_full and tempest_scenario in OPNFV gates. It set all params for all OPNFV installers according to their last runs [2][3][4]. Live migration is out of that custom params as it's currently considered as a key feature [5]. tempest_conf.yaml should be installer-centric and shouldn't take scenarios into account. It's unclear which installers support glance API v1 which is deprecated. Any installer can ask for testing it if supported. At least Apex doesn't support it [6]. Shelve is currenlty disabled because testing it could fail the whole tempest run if unsupported. We are missing data about which installer may support it. [1] https://gerrit.opnfv.org/gerrit/#/c/64067 [2] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [3] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [4] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html [5] https://artifacts.opnfv.org/logs/functest/ericsson-pod1/gambia/2018-10-27_06-10-07/tempest_full/tempest-report.html [6] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I17c8a2d738daaf1c2e97755c99f8886da8a531aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Set STORAGE_PROTOCOL=ceph if compassCédric Ollivier1-1/+1
Change-Id: If5b25041933cb7f16793d440783ec14122f568e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>