summaryrefslogtreecommitdiffstats
path: root/jjb/functest/functest.yaml
AgeCommit message (Collapse)AuthorFilesLines
2019-11-14Leverage on S3 support provided XtestingCédric Ollivier1-9/+6
It avoids using gsutil in Jenkins (extra logics). Change-Id: I2f3d69b88b115469e25b1452590e9ffc66266455 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-30Conform with latest Functest backportsCédric Ollivier1-12/+0
New tempest plugins were backported to Jerma and Iruya. Change-Id: I1e8d4fef110609657d179aa978b2b4441200abde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-29Replace few false healthcheck by smokeCédric Ollivier1-6/+6
It completes the previous change "Add latest tempest plugins integrated into Functest" [1]. [1] https://gerrit.opnfv.org/gerrit/c/releng/+/68700 Change-Id: If58d1d560e103b59ececb0f31ef47e052ca4105a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-29Add latest tempest plugins integrated into FunctestCédric Ollivier1-0/+46
Change-Id: Ic820f7d558be5e5425d2d3b165a8188c1eca13d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-08Add Jerma in blacklist logicsCédric Ollivier1-0/+2
https://build.opnfv.org/ci/job/functest-jerma-gate/5/ Change-Id: I6f970f36256b5c07dea32f7cbb630e695eb226e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-07Publish Functest Jerma jobsCédric Ollivier1-0/+6
Change-Id: Ie3970ea3e5b64130d73985a31ed16505e191c0f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-14Select 3.6 if iruyaCédric Ollivier1-0/+2
It conforms with "Select python 3.6 as default" [1]. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/68471 Change-Id: Ibc4ae81597ce9ed3d12ab27c6eae796870f6a2d4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-31Remove Functest (OS and K8s) features containersCédric Ollivier1-88/+0
Change-Id: I0391b15adc9f5a8f36d340f6970fe731ff10bcc1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-29Run tempest_slow in Functest Iruya gatesCédric Ollivier1-2/+0
tempest_slow was backported to Iruya [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/68409 Change-Id: I3305d8db5a3dcd19769aef726557866cb03396b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-29Add tempest_slow in Functest gatesCédric Ollivier1-0/+14
It disables few ipv6 testcases due to possible SUT misconfigurations. It seems better than fully skipping ipv6 via tempest config [1] because it's already well covered in tempest_full. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Change-Id: If1160dc68f5e53dffdfdd6722bdc557683243bde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-28Add Octavia in Functest gatesCédric Ollivier1-0/+11
It's now avaible in functest-smoke:latest Change-Id: Ib6d5313d63c92a5e760714001a1b8ca670fa261f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-21Protect tag in functest.yamlCédric Ollivier1-2/+2
Else 3.10 becomes falsy 3.1. Change-Id: I84045769d062f184f2f7020b9613cf06abc4af3e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Update to python 3.7 and alpine 3.10Cédric Ollivier1-9/+9
Change-Id: Id800208e148190ee10e4cfcb2a48a2dff00c35a7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-21Stop blacklisting tempest tests in gatesCédric Ollivier1-2/+0
It reverts "Allow blacklisting tempest tests" [1] as all volume leaks were solved [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/68020/ [2] https://bugs.launchpad.net/tempest/+bug/1829613 This reverts commit f90b8b66834b81b1022a05e14392857e77fccfca. Change-Id: Ic87de200482eb6c7aef878a1f23dcd43b79d1b10 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-20Revert "Exclude latest rally_full and rally_jobs"Cédric Ollivier1-5/+0
This reverts commit f0b74187ee9e26a6b0be9976b1c5d35d9c96523b. Change-Id: I97466016e6cf296996558a45d4e4a5354d349e6f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-09Exclude functest-tempest from master gatesCédric Ollivier1-0/+2
Change-Id: I09bde2d35769c0045f72e3da56a085db6426e4b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-06Exclude latest rally_full and rally_jobsCédric Ollivier1-0/+5
Rally is sometimes failing when running vs python3. It will be excluded during the investigation to allow checking changes and containers. Change-Id: Ifbd02629e618b9a6969b321b4862fc76df3f3bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-08Allow blacklisting tempest testsCédric Ollivier1-27/+2
It will avoid volume leaks in gates [1]. Here is the blacklist: - tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details - tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers [1] https://bugs.launchpad.net/tempest/+bug/1829613 Change-Id: I9de07c77a2f307e0fdf872cdd7ff7be35409b484 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-03Override the right rally blacklistsCédric Ollivier1-1/+6
Latest containers now leverage on python3.6. Change-Id: Ib3b3c02497b85dd210713baed345c4a64a0add5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-16Add new Functest testcases in gatesCédric Ollivier1-1/+59
It takes the new refstack testcase into account [1] [1] https://gerrit.opnfv.org/gerrit/#/c/67833/ Change-Id: I9eca54d4dbe5b685e821ee56270c1dbb2de54e57 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-04Disable cold migration in Functest gatesCédric Ollivier1-0/+2
Change-Id: I092baa82bd22cc19c0786a14f962db9bcb7deadb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Revert "Turn debug on in gsutil (Functest jjbs)"Cédric Ollivier1-2/+2
This reverts commit f1fb034fd7421bcda973b08517b79a4cf28db040. Change-Id: I44be2b4c48713af1a844c748c7d50454052f8c91 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Revert "Add debug when running Functest jjbs"Cédric Ollivier1-2/+1
This reverts commit 02d9a5f0d62c16a72139291463703c86a80bffb7. Change-Id: I56b87660ba9d2e18042d5da6f3de2e9de2ed7b53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Turn debug on in gsutil (Functest jjbs)Cédric Ollivier1-2/+2
Change-Id: Ib387b3c7c6aeaf82283b95e522514c60a0b1eac8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Add debug when running Functest jjbsCédric Ollivier1-1/+2
It will ease debugging gsutil config. Change-Id: Id37cfa9132ae327714535a68ed1611da9a71f25c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-01Merge "Update Functest slaves"Cedric Ollivier1-1/+1
2019-05-01Update Functest slavesCédric Ollivier1-1/+1
Change-Id: I301bd833e70be9057d9a93956bb631661277dc93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-28Merge "Manage multiple slaves for functest"Cedric Ollivier1-12/+26
2019-04-28Manage multiple slaves for functestCédric Ollivier1-12/+26
It allows testing multiple Functest tags in parallel. Change-Id: I29708953095cfd93724c593b6af02f151c68e202 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-26Take DEBUG into account in gatesCédric Ollivier1-0/+1
It completes [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/67700/ Change-Id: I11a6850c8cbfc02bb0717945e78f35f0e8cefc83 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-28Publish Functest Iruya jobsCédric Ollivier1-0/+2
Change-Id: I90fc2ac1a299d9107e095db306b11fdae6fc420e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-26Revert "Run vnfs in parallel in gates"Cédric Ollivier1-0/+3
Our AIO doesn't have enough resources to run all VNFs in parallel [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-latest-heat_ims-run/98/console This reverts commit 2fed59b78a0ccf62364a6af8722c194a0160375f. Change-Id: Ibf7cd31460bb8d1fb3e560694829a913e1cec1c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-25Update Functest jjbs (Alpine 3.9)Cédric Ollivier1-8/+8
Change-Id: If636802e410e27e6d3811a7d959ce5dbf12d17ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-24Avoid verifying kubernetes and OS in //Cédric Ollivier1-3/+3
It raises side effects when verifying OS. It will ease finding the root causes. Change-Id: I76a474d051aa426010a1216ee9061ab9d281e824 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-21Run vnfs in parallel in gatesCédric Ollivier1-3/+0
All the vnfs are now running well in gates. Let's try to run them in parallel again to save time. Change-Id: I1bddf4ba28566a3ba28ffa07ad05bced8a4235b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-12Remove snaps testcases in gateCédric Ollivier1-21/+0
Snaps is outdated regarding requirements and snaps won't be updated. Change-Id: Ifa4005f5b26bcdda6347dc169914e7369fd1d4c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-08Remove the sdnvpn testcase in Functest gatesCédric Ollivier1-7/+0
SDNVPN doesn't participate to Hunter. Change-Id: I9ee5ca28dc568370da54375ddf1669261f3fc0d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-07Revert "Disable heat_ims in gate"Cédric Ollivier1-0/+2
This reverts commit 4a21590cb5d2d1338f0b39e0298fefa939e6b7e7. Change-Id: I6fb80a9cb565f41f40e8f3f2a113d2bb17256839 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-06Disable heat_ims in gateCédric Ollivier1-2/+0
It may hide other issues as it sometimes fails. It will be executed in daily jobs as before. Change-Id: I4f6c50e717773dce0539eeed38d3dd3e75d70b2d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-18Revert "Run Functest Gambia verify jobs"Cédric Ollivier1-2/+0
This reverts commit 2b4c8b6f9fb1117e44c63804126d2999053a2185. testcase list orders differ between Gambia and Hunter/Latest. Change-Id: Icbd5c2c5328c80a99c3ee50758ee2114f48c38cc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-18Run Functest Gambia verify jobsCédric Ollivier1-0/+2
It ensures that the current release is always stable. Change-Id: I6a9d479c9c2664493e5685651254c3fca358aec2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-13Run vnfs sequentially in gatesCédric Ollivier1-0/+3
We are facing with issues due to shared bandwidth and the number of vms. Change-Id: I84dc188db08455f01ac6a9046cd8fd95645853cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Remove functest-components from gatesCédric Ollivier1-60/+7
It conforms with "Move rally_full in benchmarking" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/66911/ Change-Id: I6118630ec0957b12e5af1786ba93c8e7c114ca12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-07Add Functest Hunter gatesCédric Ollivier1-0/+2
The system under test (functest-virtual) is downgraded to Rocky. It allows verifying Rocky and next Stein till the split of Functest POD. Change-Id: Ia161b30d9a97f517e487b3dc0f751adcc9059234 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-06Conform with new Functest test listCédric Ollivier1-62/+28
It conforms with "Move testcases in the right tiers" [1]. This patch has to be merged first to ensure the right gating in Functest (chicken & egg situation). [1] https://gerrit.opnfv.org/gerrit/#/c/66863/ Change-Id: I13e36dc9fbc3b6fa2bae91df1af28020ebd37bbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Isolate rally_full from functional testsCédric Ollivier1-0/+17
The next 2 tempest tests fails when all components run in parallel -ServerActionsTestJSON.test_resize_volume_backed_server_confirm -DeleteServersTestJSON.test_delete_server_while_in_attached_volume Change-Id: I838c5d2ee7ade29ffc91fa4146b48d479b1781f8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-02Revert "Enable Functest hunter gates"Cédric Ollivier1-2/+0
Releng is in an incorrect state (missing jobs). Let's revert commit 7db145c97ba66078dae7402f9372df259150a9d2 and enable it back later. Change-Id: I3b0668d0628cfd40f115b6a5625c505ae983de5c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-01Enable Functest hunter gatesCédric Ollivier1-0/+2
OpenStack Rocky was installed in functest-virtual. Change-Id: I9c47e62d0af627f6db46be375eadcefc969d664d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-31Stop running rally_jobs and neutron-tempest-plugin-api in //Cédric Ollivier1-7/+24
It moves rally_jobs into a separate multijob step. The next two testcases can raise timeout (1 min) if Routers related workloads are executed at the same time [1]. - test_routers.RoutersIpV6Test.test_router_interface_status - test_routers.RoutersTest.test_router_interface_status [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-neutron-tempest-plugin-api-run-35/results/neutron-tempest-plugin-api/tempest-report.html Change-Id: Id631a9d9b27effe67cd7a0e7cba3943f9e734278 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Stop blacklisting tempest testsCédric Ollivier1-3/+0
functest-virtual is fully verified by latest tempest_full. Change-Id: I212e3aa83c74d58945c9057a104db4a9fabd403b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>