summaryrefslogtreecommitdiffstats
path: root/jjb/functest/functest.yaml
AgeCommit message (Collapse)AuthorFilesLines
2020-06-07Update to alpine 3.12 in jjbsCédric Ollivier1-8/+8
https://alpinelinux.org/posts/Alpine-3.12.0-released.html Change-Id: I403aaae4168db8a22ad269daf1d6469ca73926a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-04Run Vnf testing in parallelCédric Ollivier1-3/+0
If it works, it will save an hour in all runs. Change-Id: I0f83d46c803538abdbf14d08e4188cd7f9737b85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-02Run Functest Benchmarking testcases in parallelCédric Ollivier1-6/+0
Change-Id: If4efb6c1563ccef39b5bdbebec367e58418428e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-01Run Functest Benchmarking testcases sequentiallyCédric Ollivier1-0/+6
Change-Id: I9c263d4178f1ea829d5d3229b495e57df29f6b7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-01Run Functest Benchmarking testcases in parallelCédric Ollivier1-6/+0
Change-Id: If80365f10751fc18eefdff7a6b621de0b46276e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-30Run Functest Benchmarking testcases sequentiallyCédric Ollivier1-0/+6
Change-Id: I0d9cab9e5ae474e1f594591e4269f4e5ece776c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-13Run Functest Benchmarking testcases in parallelCédric Ollivier1-6/+0
Change-Id: If1457bc1a4735d5623f4eeaecd4f1a9bba45c1cf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-10Enable daily jobsCédric Ollivier1-1/+0
Change-Id: If4ddd1b66fb73a4405d25e5e85090435b3b6e6e1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-08Disable daily jobsCédric Ollivier1-0/+1
It eases debugging SUT. Change-Id: I630e3a2b6e1b1ae96311712ab33255c82c291825 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-05Run Functest Benchmarking testcases sequentiallyCédric Ollivier1-0/+6
Change-Id: I2447088ec7a507b94fec4bf03b8efed6dd56fc4a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-04Enable tempest_telemetry if jerma and iruyaCédric Ollivier1-4/+0
Change-Id: Ie66b3838a0ac6ba5f041163291bbeb9fc67db42e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-04Enable tempest_octavia if IruyaCédric Ollivier1-2/+0
Change-Id: I90e77bc6abc9a76b37470583555a222c1c0a7a99 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-03Remove blacklist.yaml overrides.Cédric Ollivier1-12/+0
All SUTs now pass IPv6 testing. Change-Id: Ic202cff2a43702258f2e43ab435189edbe3c500d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Add tempest_telemetry in Functest jjbsCédric Ollivier1-0/+13
Change-Id: Icbebf51408c4f7fe84db26d26ff381080b5c301c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Update all Functest test case namesCédric Ollivier1-10/+32
Change-Id: I0cb2208c38ae9af085c9061f102d178ba44c4611 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Remove security-opt seccomp=unconfinedCédric Ollivier1-1/+0
Change-Id: I3b67ba0e7d3b9b36d2b7b681d52a2ea8938a5891 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Enable Kali ocatavia and tempest_heatCédric Ollivier1-4/+0
Change-Id: Ibbf78d566dbbd3787af4ddd6b0e8257186b999af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-30Temporarily exclude Kali ocatavia and tempest_heatCédric Ollivier1-0/+4
We are adding features in SUT in //. Change-Id: If7a830cec5b8168647fbb10d96a24b7e29e98b9d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Fix exclude rules in Functest jjbsCédric Ollivier1-0/+3
It has to be updated for Kali Change-Id: I4b5cf222528aacc152fdebf29c1acc03ed03b939 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publish all Functest Kali jobsCédric Ollivier1-0/+4
Change-Id: I30100f94b753cbf7893c8a5ebcb91c7f76f97971 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28tempest_neutron-cntt -> tempest_neutron_cnttCédric Ollivier1-4/+4
Change-Id: I6247f4c43a0e152646a011b0dc7cbcfa219b7cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Rename neutron-tempest-plugin-api-cntt to tempest_neutronCédric Ollivier1-8/+8
Change-Id: I70ea285ab1611ab4d5bd3ff3209a45094950838e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert "Revert security-opt seccomp=unconfined"Cédric Ollivier1-0/+1
This reverts commit 3e7ab349e3911c85b1307798f767282c4fc41a5d. Change-Id: I59c28b5b61d54ab47a7cd1e3a511ddd3608d27a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Add tempest_heat_cntt in all gatesCédric Ollivier1-0/+7
Change-Id: I1f186f5cc68732aedee416619d49085407f5529d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert security-opt seccomp=unconfinedCédric Ollivier1-1/+0
It still fails [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run/16/console Change-Id: I693b1b76f4872993f2bc61179b1bd9ffe1edee5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-26Try bypassing libseccomp performance issuesCédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I17502628ccaa7868f0605c649f0549d9fd6f9dd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier1-3/+0
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier1-6/+0
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Clean workspace with sudoCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Run smoke in parallel backCédric Ollivier1-6/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier1-0/+13
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier1-0/+6
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier1-2/+2
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier1-2/+2
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier1-2/+2
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier1-0/+67
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Update Functest Jenking view regexCédric Ollivier1-1/+1
It takes the new ovn jobs into account. Change-Id: Ie029f803bf06ef569c347f8b94fd19ca779ebd9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-25Use pod4 to verify Functest JermaCédric Ollivier1-2/+2
Change-Id: I38d9c34830f58ab24e765a7f2e72d192f6fd292b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Functest jobsCédric Ollivier1-8/+8
Change-Id: Ic3564f8feca430bffb1e655688f9f5d219c7bec3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-03Configure our images for VirtIO-SCSICédric Ollivier1-0/+2
https://ceph.io/planet/more-recommendations-for-ceph-and-openstack/ Change-Id: I772aa68e6414e4bee77848bc6d5200918e95aee8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-23Fix container name when dumpin Functest resultsCédric Ollivier1-1/+1
Change-Id: I3345116682238aab3b593c49dd79dea6f451cdaf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all artifacts as last stepsCédric Ollivier1-1/+47
Change-Id: I55497311520f7fc2583bfa36fb1cb595cf5f1fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Stop overriding default Rally blacklistsCédric Ollivier1-2/+0
The default Rally blacklist has been used asis for a while. Change-Id: Idc84935ec2bbc31a841764499c29c5cb1923b3c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Add buid_tag in Functest jobsCédric Ollivier1-2/+17
It eases archiving all logs (third-party certification). Change-Id: Ief9c89ac9cf5a748fb8f6965078c9651fd0066ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-27Run tempest_slow in Functest Hunter jobsCédric Ollivier1-2/+0
It was backported to fullfill CNTT needs. Change-Id: Ifec797b6943e2ab941625548686adc00208fb77c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Publish latest CNTT-related testsCédric Ollivier1-0/+14
Change-Id: I3cf00e1f96c6a7daa5291b555a339043661d8119 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add tempest_full in CNTT compliance gatingCédric Ollivier1-0/+7
Change-Id: I9f9be8d912eded2e17b6ead257bf778e5468afff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add rally_sanity in API ComplianceCédric Ollivier1-0/+7
Change-Id: I8ad65a75a5db61c555810f7cbb5612db88c8d651 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-18Add Compliance tests in Functest jobsCédric Ollivier1-12/+122
Change-Id: I620f24f689731a20456b1153f88fb5c0a47bb557 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>