summaryrefslogtreecommitdiffstats
path: root/jjb/functest/functest.yaml
AgeCommit message (Collapse)AuthorFilesLines
2020-04-28Fix exclude rules in Functest jjbsCédric Ollivier1-0/+3
It has to be updated for Kali Change-Id: I4b5cf222528aacc152fdebf29c1acc03ed03b939 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publish all Functest Kali jobsCédric Ollivier1-0/+4
Change-Id: I30100f94b753cbf7893c8a5ebcb91c7f76f97971 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28tempest_neutron-cntt -> tempest_neutron_cnttCédric Ollivier1-4/+4
Change-Id: I6247f4c43a0e152646a011b0dc7cbcfa219b7cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Rename neutron-tempest-plugin-api-cntt to tempest_neutronCédric Ollivier1-8/+8
Change-Id: I70ea285ab1611ab4d5bd3ff3209a45094950838e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert "Revert security-opt seccomp=unconfined"Cédric Ollivier1-0/+1
This reverts commit 3e7ab349e3911c85b1307798f767282c4fc41a5d. Change-Id: I59c28b5b61d54ab47a7cd1e3a511ddd3608d27a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Add tempest_heat_cntt in all gatesCédric Ollivier1-0/+7
Change-Id: I1f186f5cc68732aedee416619d49085407f5529d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert security-opt seccomp=unconfinedCédric Ollivier1-1/+0
It still fails [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run/16/console Change-Id: I693b1b76f4872993f2bc61179b1bd9ffe1edee5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-26Try bypassing libseccomp performance issuesCédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I17502628ccaa7868f0605c649f0549d9fd6f9dd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier1-3/+0
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier1-6/+0
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Clean workspace with sudoCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Run smoke in parallel backCédric Ollivier1-6/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier1-0/+13
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier1-0/+6
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier1-2/+2
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier1-2/+2
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier1-2/+2
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier1-0/+67
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Update Functest Jenking view regexCédric Ollivier1-1/+1
It takes the new ovn jobs into account. Change-Id: Ie029f803bf06ef569c347f8b94fd19ca779ebd9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-25Use pod4 to verify Functest JermaCédric Ollivier1-2/+2
Change-Id: I38d9c34830f58ab24e765a7f2e72d192f6fd292b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Functest jobsCédric Ollivier1-8/+8
Change-Id: Ic3564f8feca430bffb1e655688f9f5d219c7bec3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-03Configure our images for VirtIO-SCSICédric Ollivier1-0/+2
https://ceph.io/planet/more-recommendations-for-ceph-and-openstack/ Change-Id: I772aa68e6414e4bee77848bc6d5200918e95aee8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-23Fix container name when dumpin Functest resultsCédric Ollivier1-1/+1
Change-Id: I3345116682238aab3b593c49dd79dea6f451cdaf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all artifacts as last stepsCédric Ollivier1-1/+47
Change-Id: I55497311520f7fc2583bfa36fb1cb595cf5f1fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Stop overriding default Rally blacklistsCédric Ollivier1-2/+0
The default Rally blacklist has been used asis for a while. Change-Id: Idc84935ec2bbc31a841764499c29c5cb1923b3c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Add buid_tag in Functest jobsCédric Ollivier1-2/+17
It eases archiving all logs (third-party certification). Change-Id: Ief9c89ac9cf5a748fb8f6965078c9651fd0066ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-27Run tempest_slow in Functest Hunter jobsCédric Ollivier1-2/+0
It was backported to fullfill CNTT needs. Change-Id: Ifec797b6943e2ab941625548686adc00208fb77c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Publish latest CNTT-related testsCédric Ollivier1-0/+14
Change-Id: I3cf00e1f96c6a7daa5291b555a339043661d8119 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add tempest_full in CNTT compliance gatingCédric Ollivier1-0/+7
Change-Id: I9f9be8d912eded2e17b6ead257bf778e5468afff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add rally_sanity in API ComplianceCédric Ollivier1-0/+7
Change-Id: I8ad65a75a5db61c555810f7cbb5612db88c8d651 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-18Add Compliance tests in Functest jobsCédric Ollivier1-12/+122
Change-Id: I620f24f689731a20456b1153f88fb5c0a47bb557 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Run tempest_cinder and tempest_keystone in hunterCédric Ollivier1-4/+0
They have been backported for the best CNTT compliance. Change-Id: I8d8d19fc350af7804899ce91a58ca4b42b699c47 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Correct volume bindings in functest.yamlCédric Ollivier1-1/+1
It also adds -p in run_tests call Change-Id: I6e765407ba62678241a9ad2c62fcf0c2ca64e431 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Leverage on S3 support provided XtestingCédric Ollivier1-9/+6
It avoids using gsutil in Jenkins (extra logics). Change-Id: I2f3d69b88b115469e25b1452590e9ffc66266455 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-30Conform with latest Functest backportsCédric Ollivier1-12/+0
New tempest plugins were backported to Jerma and Iruya. Change-Id: I1e8d4fef110609657d179aa978b2b4441200abde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-29Replace few false healthcheck by smokeCédric Ollivier1-6/+6
It completes the previous change "Add latest tempest plugins integrated into Functest" [1]. [1] https://gerrit.opnfv.org/gerrit/c/releng/+/68700 Change-Id: If58d1d560e103b59ececb0f31ef47e052ca4105a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-29Add latest tempest plugins integrated into FunctestCédric Ollivier1-0/+46
Change-Id: Ic820f7d558be5e5425d2d3b165a8188c1eca13d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-08Add Jerma in blacklist logicsCédric Ollivier1-0/+2
https://build.opnfv.org/ci/job/functest-jerma-gate/5/ Change-Id: I6f970f36256b5c07dea32f7cbb630e695eb226e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-07Publish Functest Jerma jobsCédric Ollivier1-0/+6
Change-Id: Ie3970ea3e5b64130d73985a31ed16505e191c0f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-14Select 3.6 if iruyaCédric Ollivier1-0/+2
It conforms with "Select python 3.6 as default" [1]. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/68471 Change-Id: Ibc4ae81597ce9ed3d12ab27c6eae796870f6a2d4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-31Remove Functest (OS and K8s) features containersCédric Ollivier1-88/+0
Change-Id: I0391b15adc9f5a8f36d340f6970fe731ff10bcc1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-29Run tempest_slow in Functest Iruya gatesCédric Ollivier1-2/+0
tempest_slow was backported to Iruya [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/68409 Change-Id: I3305d8db5a3dcd19769aef726557866cb03396b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-29Add tempest_slow in Functest gatesCédric Ollivier1-0/+14
It disables few ipv6 testcases due to possible SUT misconfigurations. It seems better than fully skipping ipv6 via tempest config [1] because it's already well covered in tempest_full. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Change-Id: If1160dc68f5e53dffdfdd6722bdc557683243bde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-28Add Octavia in Functest gatesCédric Ollivier1-0/+11
It's now avaible in functest-smoke:latest Change-Id: Ib6d5313d63c92a5e760714001a1b8ca670fa261f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-21Protect tag in functest.yamlCédric Ollivier1-2/+2
Else 3.10 becomes falsy 3.1. Change-Id: I84045769d062f184f2f7020b9613cf06abc4af3e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Update to python 3.7 and alpine 3.10Cédric Ollivier1-9/+9
Change-Id: Id800208e148190ee10e4cfcb2a48a2dff00c35a7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-21Stop blacklisting tempest tests in gatesCédric Ollivier1-2/+0
It reverts "Allow blacklisting tempest tests" [1] as all volume leaks were solved [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/68020/ [2] https://bugs.launchpad.net/tempest/+bug/1829613 This reverts commit f90b8b66834b81b1022a05e14392857e77fccfca. Change-Id: Ic87de200482eb6c7aef878a1f23dcd43b79d1b10 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-20Revert "Exclude latest rally_full and rally_jobs"Cédric Ollivier1-5/+0
This reverts commit f0b74187ee9e26a6b0be9976b1c5d35d9c96523b. Change-Id: I97466016e6cf296996558a45d4e4a5354d349e6f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-09Exclude functest-tempest from master gatesCédric Ollivier1-0/+2
Change-Id: I09bde2d35769c0045f72e3da56a085db6426e4b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>