summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2019-03-09Remove Functest Kubernetes Gambia gatesCédric Ollivier1-2/+0
Change-Id: I275992cdf37d58a20ee7ae2e3e5661f57df8165c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-08Remove the sdnvpn testcase in Functest gatesCédric Ollivier1-7/+0
SDNVPN doesn't participate to Hunter. Change-Id: I9ee5ca28dc568370da54375ddf1669261f3fc0d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-07Revert "Disable heat_ims in gate"Cédric Ollivier1-0/+2
This reverts commit 4a21590cb5d2d1338f0b39e0298fefa939e6b7e7. Change-Id: I6fb80a9cb565f41f40e8f3f2a113d2bb17256839 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-06Disable heat_ims in gateCédric Ollivier1-2/+0
It may hide other issues as it sometimes fails. It will be executed in daily jobs as before. Change-Id: I4f6c50e717773dce0539eeed38d3dd3e75d70b2d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-18Revert "Run Functest Gambia verify jobs"Cédric Ollivier1-2/+0
This reverts commit 2b4c8b6f9fb1117e44c63804126d2999053a2185. testcase list orders differ between Gambia and Hunter/Latest. Change-Id: Icbd5c2c5328c80a99c3ee50758ee2114f48c38cc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-18Run Functest Gambia verify jobsCédric Ollivier1-0/+2
It ensures that the current release is always stable. Change-Id: I6a9d479c9c2664493e5685651254c3fca358aec2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-16Always redirect debug to /dev/stdoutCédric Ollivier1-1/+1
It's mostly impossible to analyse issues without stdout. Change-Id: I05b908d6d0bac2afa524745d205c8050d6f43ec5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-13Run vnfs sequentially in gatesCédric Ollivier1-0/+3
We are facing with issues due to shared bandwidth and the number of vms. Change-Id: I84dc188db08455f01ac6a9046cd8fd95645853cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-12Revert "Temporarily redirect to /dev/stdout in functest-alpine.sh"Cédric Ollivier1-4/+0
This reverts commit 24b6e10c5a67814a39a492914ec77fb10f4b52e3. Change-Id: I7631dff6f57d8580158aac3090f2ed415d4f27ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-12Stop running functest-component if hunter or newerCédric Ollivier2-5/+9
It conforms with [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66911/ Change-Id: I07a2aabb4027f4dcf766b01a4cdb326316c2a398 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Remove functest-components from gatesCédric Ollivier1-60/+7
It conforms with "Move rally_full in benchmarking" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66911/ Change-Id: I6118630ec0957b12e5af1786ba93c8e7c114ca12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Exclude functest-components (master)Cédric Ollivier1-0/+2
Change-Id: Id5df1a67b77711b172e8943c59866c8c3853e87f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-07Add Functest Hunter gatesCédric Ollivier1-0/+2
The system under test (functest-virtual) is downgraded to Rocky. It allows verifying Rocky and next Stein till the split of Functest POD. Change-Id: Ia161b30d9a97f517e487b3dc0f751adcc9059234 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-07Merge "Run tests from the new tiers"Cedric Ollivier1-4/+4
2019-02-07Run tests from the new tiersCédric Ollivier1-4/+4
It conforms with the new test tiers [1] [1] https://gerrit.opnfv.org/gerrit/#/c/66863/ Change-Id: I615277c4525b6dbc24442668c5179dd34952dc43 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-06Conform with new Functest test listCédric Ollivier1-62/+28
It conforms with "Move testcases in the right tiers" [1]. This patch has to be merged first to ensure the right gating in Functest (chicken & egg situation). [1] https://gerrit.opnfv.org/gerrit/#/c/66863/ Change-Id: I13e36dc9fbc3b6fa2bae91df1af28020ebd37bbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Isolate rally_full from functional testsCédric Ollivier1-0/+17
The next 2 tempest tests fails when all components run in parallel -ServerActionsTestJSON.test_resize_volume_backed_server_confirm -DeleteServersTestJSON.test_delete_server_while_in_attached_volume Change-Id: I838c5d2ee7ade29ffc91fa4146b48d479b1781f8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Temporarily redirect to /dev/stdout in functest-alpine.shCédric Ollivier1-0/+1
Change-Id: I7cb738d1f351df557846270bb176870bc9d11d92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Add debug data in functest-alpine.shCédric Ollivier1-4/+3
It hasn't run since latest Jenkins maintainance. It will help finding the side effect. It also removes a former condition. Change-Id: I46b68ca65df43435f6ed96933c87111d9cfc2f7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Revert "Enable Functest hunter gates"Cédric Ollivier1-2/+0
Releng is in an incorrect state (missing jobs). Let's revert commit 7db145c97ba66078dae7402f9372df259150a9d2 and enable it back later. Change-Id: I3b0668d0628cfd40f115b6a5625c505ae983de5c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-01Enable Functest hunter gatesCédric Ollivier1-0/+2
OpenStack Rocky was installed in functest-virtual. Change-Id: I9c47e62d0af627f6db46be375eadcefc969d664d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-31Stop running rally_jobs and neutron-tempest-plugin-api in //Cédric Ollivier1-7/+24
It moves rally_jobs into a separate multijob step. The next two testcases can raise timeout (1 min) if Routers related workloads are executed at the same time [1]. - test_routers.RoutersIpV6Test.test_router_interface_status - test_routers.RoutersTest.test_router_interface_status [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-neutron-tempest-plugin-api-run-35/results/neutron-tempest-plugin-api/tempest-report.html Change-Id: Id631a9d9b27effe67cd7a0e7cba3943f9e734278 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-29Add rally_full in all gatesCédric Ollivier1-3/+3
rally full is fully verified in Functest gates (all OS versions). It's so relevant to add this key testcase. Functest gates end in 4 hours (all testcases included). Change-Id: I595b02bc4e06a893853b5c49b610e1fd28d8cec7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Stop blacklisting tempest testsCédric Ollivier1-3/+0
functest-virtual is fully verified by latest tempest_full. Change-Id: I212e3aa83c74d58945c9057a104db4a9fabd403b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Fix a nitCédric Ollivier1-1/+1
Change-Id: I919b065e69515a75f3be90ee9d01437e9fe83449 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Generate functest.yaml to verify OS masterCédric Ollivier1-5/+11
Change-Id: If39c18e0b9f5578b0e42b6e57cec10474d0fec5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-21Fix typos in functest-kubernetes (container names)Cédric Ollivier1-12/+12
Change-Id: Ieb701c9e80115a7f492f0dd80cf3603593d04e70 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-17Remove unused BRANCH when building functest k8s featuresCédric Ollivier1-1/+1
Change-Id: Ia6dc8cc368837e7c8db3b61d92b76340782dead8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-17Remove unused Docker build argsCédric Ollivier1-2/+2
Docker installed in OPNFV releng build servers doesn't allow unused args. Change-Id: I904d0542a8a9fd881ae66d65757a7b9bc8b74757 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-15Generate functest-kubernetes.yaml via collivier.xtestingCédric Ollivier1-0/+541
Change-Id: I30a504fbf052d5ce24a470e3c255fc33d1df65d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-14Update Functest jobsCédric Ollivier1-14/+0
rally_full fails due to the SUT (functest-virtual). fds was not part of Gambia and shouldn't be ready yet. Change-Id: I372eb933e9aa78ddd962bd7477e83eb62f87ae97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-14Generate xtesting.yaml via collivier.xtestingCédric Ollivier1-47/+47
It adds project in jjb names to allow loading xtesting and functest jobs in one command. Change-Id: I120ab713cb73abc1f6aaf195e60fbcec9e45f740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-12Set docker_args as expected by functest-virtualCédric Ollivier1-0/+3
Change-Id: Ia30c5bc380898f8bacb32c74b19092faf504bfbb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-12Update Functest gate jobsCédric Ollivier2-622/+971
It conforms with the last updates of collivier.xtesting [1]. [1] https://galaxy.ansible.com/collivier/xtesting Change-Id: Idd2c1599d161d558961fb5b3509c565593f7fc07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-05Allow conditional docker build argsCédric Ollivier1-1/+6
It allows managing xtesting and functest jjbs via the same role. functest-component doesn't take BRANCH into account. Change-Id: If487e8350bca6b37d585a4ed16214e77df6170ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Precise Xtesting view filterCédric Ollivier1-4/+4
Change-Id: Ib2488e32b766b1a3c1ec68797b9d510397517b0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-04Add Xtesting gate jobsCédric Ollivier1-36/+294
It conforms with the last updates of collivier.xtesting [1]. [1] https://galaxy.ansible.com/collivier/xtesting Change-Id: Ie94990c872f079735a87ce67c8ffb9378559c016 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Clean Xtesting logs as privilegedCédric Ollivier1-3/+3
It also mutes gsutils and precises Xtesting view regex. Change-Id: Idf0457205dc53e9cca2befc139b65715511e8ebf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Leverage on $WORKSPACE in xtesting.yamlCédric Ollivier1-4/+6
It also forces the right slave when pulling/removing the docker images. Change-Id: I36c4b0d7f046c25d51458ec6dee0da163eb3ee2d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Fix Xtesting workspaceCédric Ollivier1-6/+5
It completes "Publish Xtesting daily jobs" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66131/ Change-Id: I82cd92f8ad3fd777868eba9875793846662cfddf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-02Publish Xtesting daily jobsCédric Ollivier1-0/+150
They verify the rolling containers. xtesting.yaml has been generated via collivier.xtesting (ansible role). Change-Id: Idf7cce42bee15174e4242891a102f6599026b3b7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-11[utils, functest] Fix SSL-enabled Fuel conditionAlexandru Avadanii1-1/+1
Fuel enables SSL based on scenario type (only for HA), not based on cluster type (baremetal or virtual). Change-Id: I3dc94f953e9a8ee0e94028577270ac05c9318ad6 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-12-07Disable blocking on buildable queue (Functest)Cédric Ollivier1-3/+0
Else daily jjbs could be dead blocked as they are triggered at the same time. Change-Id: I3f3c4bc96b603fbaa76806238191fbce240220f9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-03Temporarily disable perm (tox)Cédric Ollivier1-1/+1
The permissions are incorrect in functest-virtual [1]. [1] https://build.opnfv.org/ci/job/opnfv-functest-latest-ut-gate/2/console Change-Id: I18b0bc3361b99316c0f77207e3c060333f8fcc74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-28Merge "Run tox in functest-virtual"Morgan Richomme1-0/+46
2018-11-27Switch from block-level to blocking-level (former)Cédric Ollivier1-3/+3
[1] https://docs.openstack.org/infra/jenkins-job-builder/properties.html Change-Id: Ic9e20f28ab3093ff29c1cc1681e75812db7ed949 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Run tox in functest-virtualCédric Ollivier1-0/+46
It will replace the former jjb and avoids running functional tests if the patchset is wrong. Change-Id: I4264780180d953b0dac0febf1f1c2dc2d08f93c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-27Clean all containers as first stepCédric Ollivier1-90/+82
It overprotects vs aborted jobs or failures in CI. It fixes few urls printed in console. Change-Id: Ibbaacfd9d51c5424c5632fcdeaedf619fd946006 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Clean Functest containers even if failureCédric Ollivier1-40/+160
It creates an additional multijob to ensure all containers are removed. It also publishes logs via gsutil. Change-Id: I45bd8aec3569e3257b94ea978c5bf2fd703649be Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-26Disable vnf testing in daily gatesCédric Ollivier1-3/+3
heat_ims sometimes fails. It mainly eases saving time when developping the workflow. Change-Id: I230461a3bae508bf60771df3f01a8271a2735065 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>