summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2019-02-06Conform with new Functest test listCédric Ollivier1-62/+28
It conforms with "Move testcases in the right tiers" [1]. This patch has to be merged first to ensure the right gating in Functest (chicken & egg situation). [1] https://gerrit.opnfv.org/gerrit/#/c/66863/ Change-Id: I13e36dc9fbc3b6fa2bae91df1af28020ebd37bbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Isolate rally_full from functional testsCédric Ollivier1-0/+17
The next 2 tempest tests fails when all components run in parallel -ServerActionsTestJSON.test_resize_volume_backed_server_confirm -DeleteServersTestJSON.test_delete_server_while_in_attached_volume Change-Id: I838c5d2ee7ade29ffc91fa4146b48d479b1781f8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Temporarily redirect to /dev/stdout in functest-alpine.shCédric Ollivier1-0/+1
Change-Id: I7cb738d1f351df557846270bb176870bc9d11d92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Add debug data in functest-alpine.shCédric Ollivier1-4/+3
It hasn't run since latest Jenkins maintainance. It will help finding the side effect. It also removes a former condition. Change-Id: I46b68ca65df43435f6ed96933c87111d9cfc2f7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Revert "Enable Functest hunter gates"Cédric Ollivier1-2/+0
Releng is in an incorrect state (missing jobs). Let's revert commit 7db145c97ba66078dae7402f9372df259150a9d2 and enable it back later. Change-Id: I3b0668d0628cfd40f115b6a5625c505ae983de5c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-01Enable Functest hunter gatesCédric Ollivier1-0/+2
OpenStack Rocky was installed in functest-virtual. Change-Id: I9c47e62d0af627f6db46be375eadcefc969d664d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-31Stop running rally_jobs and neutron-tempest-plugin-api in //Cédric Ollivier1-7/+24
It moves rally_jobs into a separate multijob step. The next two testcases can raise timeout (1 min) if Routers related workloads are executed at the same time [1]. - test_routers.RoutersIpV6Test.test_router_interface_status - test_routers.RoutersTest.test_router_interface_status [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-neutron-tempest-plugin-api-run-35/results/neutron-tempest-plugin-api/tempest-report.html Change-Id: Id631a9d9b27effe67cd7a0e7cba3943f9e734278 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-29Add rally_full in all gatesCédric Ollivier1-3/+3
rally full is fully verified in Functest gates (all OS versions). It's so relevant to add this key testcase. Functest gates end in 4 hours (all testcases included). Change-Id: I595b02bc4e06a893853b5c49b610e1fd28d8cec7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Stop blacklisting tempest testsCédric Ollivier1-3/+0
functest-virtual is fully verified by latest tempest_full. Change-Id: I212e3aa83c74d58945c9057a104db4a9fabd403b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Fix a nitCédric Ollivier1-1/+1
Change-Id: I919b065e69515a75f3be90ee9d01437e9fe83449 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Generate functest.yaml to verify OS masterCédric Ollivier1-5/+11
Change-Id: If39c18e0b9f5578b0e42b6e57cec10474d0fec5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-21Fix typos in functest-kubernetes (container names)Cédric Ollivier1-12/+12
Change-Id: Ieb701c9e80115a7f492f0dd80cf3603593d04e70 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-17Remove unused BRANCH when building functest k8s featuresCédric Ollivier1-1/+1
Change-Id: Ia6dc8cc368837e7c8db3b61d92b76340782dead8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-17Remove unused Docker build argsCédric Ollivier1-2/+2
Docker installed in OPNFV releng build servers doesn't allow unused args. Change-Id: I904d0542a8a9fd881ae66d65757a7b9bc8b74757 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-15Generate functest-kubernetes.yaml via collivier.xtestingCédric Ollivier1-0/+541
Change-Id: I30a504fbf052d5ce24a470e3c255fc33d1df65d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-14Update Functest jobsCédric Ollivier1-14/+0
rally_full fails due to the SUT (functest-virtual). fds was not part of Gambia and shouldn't be ready yet. Change-Id: I372eb933e9aa78ddd962bd7477e83eb62f87ae97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-14Generate xtesting.yaml via collivier.xtestingCédric Ollivier1-47/+47
It adds project in jjb names to allow loading xtesting and functest jobs in one command. Change-Id: I120ab713cb73abc1f6aaf195e60fbcec9e45f740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-12Set docker_args as expected by functest-virtualCédric Ollivier1-0/+3
Change-Id: Ia30c5bc380898f8bacb32c74b19092faf504bfbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-12Update Functest gate jobsCédric Ollivier2-622/+971
It conforms with the last updates of collivier.xtesting [1]. [1] https://galaxy.ansible.com/collivier/xtesting Change-Id: Idd2c1599d161d558961fb5b3509c565593f7fc07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-05Allow conditional docker build argsCédric Ollivier1-1/+6
It allows managing xtesting and functest jjbs via the same role. functest-component doesn't take BRANCH into account. Change-Id: If487e8350bca6b37d585a4ed16214e77df6170ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Precise Xtesting view filterCédric Ollivier1-4/+4
Change-Id: Ib2488e32b766b1a3c1ec68797b9d510397517b0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Add Xtesting gate jobsCédric Ollivier1-36/+294
It conforms with the last updates of collivier.xtesting [1]. [1] https://galaxy.ansible.com/collivier/xtesting Change-Id: Ie94990c872f079735a87ce67c8ffb9378559c016 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Clean Xtesting logs as privilegedCédric Ollivier1-3/+3
It also mutes gsutils and precises Xtesting view regex. Change-Id: Idf0457205dc53e9cca2befc139b65715511e8ebf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Leverage on $WORKSPACE in xtesting.yamlCédric Ollivier1-4/+6
It also forces the right slave when pulling/removing the docker images. Change-Id: I36c4b0d7f046c25d51458ec6dee0da163eb3ee2d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Fix Xtesting workspaceCédric Ollivier1-6/+5
It completes "Publish Xtesting daily jobs" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66131/ Change-Id: I82cd92f8ad3fd777868eba9875793846662cfddf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Publish Xtesting daily jobsCédric Ollivier1-0/+150
They verify the rolling containers. xtesting.yaml has been generated via collivier.xtesting (ansible role). Change-Id: Idf7cce42bee15174e4242891a102f6599026b3b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-11[utils, functest] Fix SSL-enabled Fuel conditionAlexandru Avadanii1-1/+1
Fuel enables SSL based on scenario type (only for HA), not based on cluster type (baremetal or virtual). Change-Id: I3dc94f953e9a8ee0e94028577270ac05c9318ad6 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-12-07Disable blocking on buildable queue (Functest)Cédric Ollivier1-3/+0
Else daily jjbs could be dead blocked as they are triggered at the same time. Change-Id: I3f3c4bc96b603fbaa76806238191fbce240220f9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-03Temporarily disable perm (tox)Cédric Ollivier1-1/+1
The permissions are incorrect in functest-virtual [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-latest-ut-gate/2/console Change-Id: I18b0bc3361b99316c0f77207e3c060333f8fcc74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-28Merge "Run tox in functest-virtual"Morgan Richomme1-0/+46
2018-11-27Switch from block-level to blocking-level (former)Cédric Ollivier1-3/+3
[1] https://docs.openstack.org/infra/jenkins-job-builder/properties.html Change-Id: Ic9e20f28ab3093ff29c1cc1681e75812db7ed949 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Run tox in functest-virtualCédric Ollivier1-0/+46
It will replace the former jjb and avoids running functional tests if the patchset is wrong. Change-Id: I4264780180d953b0dac0febf1f1c2dc2d08f93c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Clean all containers as first stepCédric Ollivier1-90/+82
It overprotects vs aborted jobs or failures in CI. It fixes few urls printed in console. Change-Id: Ibbaacfd9d51c5424c5632fcdeaedf619fd946006 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Clean Functest containers even if failureCédric Ollivier1-40/+160
It creates an additional multijob to ensure all containers are removed. It also publishes logs via gsutil. Change-Id: I45bd8aec3569e3257b94ea978c5bf2fd703649be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Disable vnf testing in daily gatesCédric Ollivier1-3/+3
heat_ims sometimes fails. It mainly eases saving time when developping the workflow. Change-Id: I230461a3bae508bf60771df3f01a8271a2735065 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Fix latest tag in functest-virtual.yamlCédric Ollivier1-1/+1
Change-Id: If3df5a002db5157dea423f3acac6c47b78d9b4ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Avoid possible deadblocks in Functest jjbsCédric Ollivier1-1/+24
From the time being, only 2 executors are allowed and then it may lead to deadblocks if two multijobs are executed. Normally we should only forbid gate and daily jobs at the time (tags are hardcoded). It reverts to new patchset triggers as on core approval is buggy. Daily jobs are now triggered once a day. Change-Id: Iaa1ae73f8baeed037dd2f20f05ec3b15d1643b3b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-24Gate Functest tests when +2Cédric Ollivier1-1/+1
It will update to Workflow as soon as possible. Change-Id: Id12afa6836b4cc0129666480eb92c36132c32823 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-24Add check mode in Functest jjbsCédric Ollivier1-28/+114
It allows checking one specific change on LF resources. It completes the two modes already defined: daily and gate. Change-Id: I7ccadf1ef07533bb549ee365b4f3deedd3d457fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-22Add triggers to verify FunctestCédric Ollivier1-25/+30
It runs testcases for all new patchset. Change-Id: Ida99e2f40cf3a7a6bc002e81cee27eb67ea62ff0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Fix a nit in functest-virtual.yamlCédric Ollivier1-1/+1
Change-Id: I993bac8545d896d1ead25c5f33c9645c52c5d208 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Fix functest-virtual (sudo + current dirs)Cédric Ollivier1-3/+3
It completes the previous commit [1] pulling all images. [1] https://gerrit.opnfv.org/gerrit/#/c/65203/ Change-Id: Id32aabf107064689a38d5ffb719ba5023c40296d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Pull all containers before running testsCédric Ollivier1-1/+34
Else we might test previous containers. Change-Id: I53b98f99f7fe5db8ea2087c93cfc58a03103db9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-19Enable vnf testing when gating FunctestCédric Ollivier1-3/+21
It adds rally_sanity and vnfs. From the time being, only rally_full is excluded (all-in-one). Change-Id: I451d1503a0a1633f4e3e68ed272742981f04eb36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Protect vs build-args not consumedCédric Ollivier1-4/+8
BRANCH is useless in case of components which only inherits from tempest. The build could simply fail depending on the docker version [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-components-latest-build/1/console Change-Id: I8ced7282c77463de9684904d141b2f18ae45d3c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-14Publish Functest gate jobCédric Ollivier1-70/+245
It mainly conforms with the first jjbs published in functest. It only differs regarding the numbers of multijobs (limited to 1 in releng) and the branch management. From the time being, rally-based testcases and vnfs are excluded to avoid falsy false. The next patch will update the gerrit trigger part. Change-Id: Ie1d2acbd9c4f2ad41ecd4cc43d0c13f855251349 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-12Verify Functest on functest-virtualCédric Ollivier1-0/+123
It runs most of healthcheck and tempest-based test cases as a first step. All benchmarking tools and all vnfs are not executed yet. All active Functest versions are verified thanks to backward compatibility ensured by Tempest and then by Functest. The jobs are designed to be run in parallel (we could also run all Functest versions in parallel instead of separated steps). It will be switched to a verify gate in a second step. Change-Id: I07cada848dd90f70da8741269692de8646813bdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-08RTD: Enable Gambia streamAric Gardner1-0/+8
Enable Gambia read the docs stream for all projects that have a gambia branch Also added edgecloud rtd job as it was missing Change-Id: I64d159cde0200871cd4ba3d2c071853c9bd502c1 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-10-30Revert "Avoid jenkins substitutions"Cédric Ollivier1-13/+10
This reverts commit 00431827b1a41f55fb700e69bfb229ccebc9c3f0. Change-Id: I77f0500b5e712745799dc9a7c7b94ce840e1f148 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-30Merge "Fix ODL restconf port if Compass"Aric Gardner1-0/+4