summaryrefslogtreecommitdiffstats
path: root/jjb/functest/functest.yaml
AgeCommit message (Collapse)AuthorFilesLines
2020-08-09Verify all Functest Raspberry PI containersCédric Ollivier1-3/+3
Change-Id: Ie29cade3b67d8bc46f0f860e61ca3434400bc59a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-09Slightly update the classical Functest jobsCédric Ollivier1-32/+104
It leverages latest XtestingCI changes. Change-Id: I18edf6d08ad838bfec4c0f8439b9314177e1f061 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-09Fix extra volumes logic in Functest Hunter jjbsCédric Ollivier1-3/+4
Change-Id: I9b7930bf83eb48f3535a81f14aca7b5f690cadb8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-09Precise tag regexCédric Ollivier1-4/+5
Change-Id: Ic1201c58bf9c85e2c5148da7d29b56e5fcbf7420 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-09Fix tag regexCédric Ollivier1-1/+1
Change-Id: If2ce41ef2e6be3e8c4a2a7630feaa9d5089c471f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-09Bind qemu static files if HunterCédric Ollivier1-1/+6
Hunter pod forces this binds as the kernel is 4.4.0. Change-Id: I216a333dfcd3890a126f0ba753e67cab66c96ec7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-07Fix blocker regexesCédric Ollivier1-3/+3
Change-Id: Idfd7e9723194b3226a9ec3f5271c4960114b6657 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-07Verify all Functest containersCédric Ollivier1-3/+153
It also checks the arm4 containers built in OPNFV. Change-Id: I0202f5a0d89b9a4d268c3e66bda25291a7b60887 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-21Run all smoke tests in //Cédric Ollivier1-7/+0
This reverts commit 1fb593c79d1b5523f94a3930bd76fa6e12e24805. Change-Id: Ia4865d5438ea29ecd68a8492e79f872cbe97d7d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-21Run tempest_full by itselfCédric Ollivier1-0/+7
Change-Id: Ie842ab6a62e555afff4934aa2ae8d67441c64bc0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-16Run tempest_cyborg if kaliCédric Ollivier1-2/+0
https://gerrit.opnfv.org/gerrit/c/functest/+/70553 Change-Id: I95fd86104906df65155f42e2639b6eb6738ab592 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Add tempest_cyborg in Functest gatesCédric Ollivier1-0/+15
Change-Id: Ie799b57b05d239370d72f7e00f3180eb2bb0b01c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Fix Patrole jobs in Functest multijobsCédric Ollivier1-0/+18
Change-Id: Ib026ec978353835ba64eea4523b5949416cfc115 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Prepare new Patrole-based testcasesCédric Ollivier1-0/+29
Change-Id: I6f84402dc534d141225d48f71b12bb47a91ee964 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Add functest-gate viewCédric Ollivier1-0/+12
It allows quickly filtering on gates. Change-Id: I862c8711a58926cde2a2ec651fba8e7f7e7e40ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-09Only show daily jobs in main viewCédric Ollivier1-1/+1
Gates mostly fail due LFN IT issues (network outages). Change-Id: I504060f032523307064b9a62120beb846f6dde99 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Update to alpine 3.12 in jjbsCédric Ollivier1-8/+8
https://alpinelinux.org/posts/Alpine-3.12.0-released.html Change-Id: I403aaae4168db8a22ad269daf1d6469ca73926a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-04Run Vnf testing in parallelCédric Ollivier1-3/+0
If it works, it will save an hour in all runs. Change-Id: I0f83d46c803538abdbf14d08e4188cd7f9737b85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-02Run Functest Benchmarking testcases in parallelCédric Ollivier1-6/+0
Change-Id: If4efb6c1563ccef39b5bdbebec367e58418428e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-01Run Functest Benchmarking testcases sequentiallyCédric Ollivier1-0/+6
Change-Id: I9c263d4178f1ea829d5d3229b495e57df29f6b7a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-01Run Functest Benchmarking testcases in parallelCédric Ollivier1-6/+0
Change-Id: If80365f10751fc18eefdff7a6b621de0b46276e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-30Run Functest Benchmarking testcases sequentiallyCédric Ollivier1-0/+6
Change-Id: I0d9cab9e5ae474e1f594591e4269f4e5ece776c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-13Run Functest Benchmarking testcases in parallelCédric Ollivier1-6/+0
Change-Id: If1457bc1a4735d5623f4eeaecd4f1a9bba45c1cf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-10Enable daily jobsCédric Ollivier1-1/+0
Change-Id: If4ddd1b66fb73a4405d25e5e85090435b3b6e6e1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-08Disable daily jobsCédric Ollivier1-0/+1
It eases debugging SUT. Change-Id: I630e3a2b6e1b1ae96311712ab33255c82c291825 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-05Run Functest Benchmarking testcases sequentiallyCédric Ollivier1-0/+6
Change-Id: I2447088ec7a507b94fec4bf03b8efed6dd56fc4a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-04Enable tempest_telemetry if jerma and iruyaCédric Ollivier1-4/+0
Change-Id: Ie66b3838a0ac6ba5f041163291bbeb9fc67db42e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-04Enable tempest_octavia if IruyaCédric Ollivier1-2/+0
Change-Id: I90e77bc6abc9a76b37470583555a222c1c0a7a99 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-03Remove blacklist.yaml overrides.Cédric Ollivier1-12/+0
All SUTs now pass IPv6 testing. Change-Id: Ic202cff2a43702258f2e43ab435189edbe3c500d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Add tempest_telemetry in Functest jjbsCédric Ollivier1-0/+13
Change-Id: Icbebf51408c4f7fe84db26d26ff381080b5c301c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Update all Functest test case namesCédric Ollivier1-10/+32
Change-Id: I0cb2208c38ae9af085c9061f102d178ba44c4611 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Remove security-opt seccomp=unconfinedCédric Ollivier1-1/+0
Change-Id: I3b67ba0e7d3b9b36d2b7b681d52a2ea8938a5891 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Enable Kali ocatavia and tempest_heatCédric Ollivier1-4/+0
Change-Id: Ibbf78d566dbbd3787af4ddd6b0e8257186b999af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-30Temporarily exclude Kali ocatavia and tempest_heatCédric Ollivier1-0/+4
We are adding features in SUT in //. Change-Id: If7a830cec5b8168647fbb10d96a24b7e29e98b9d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Fix exclude rules in Functest jjbsCédric Ollivier1-0/+3
It has to be updated for Kali Change-Id: I4b5cf222528aacc152fdebf29c1acc03ed03b939 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publish all Functest Kali jobsCédric Ollivier1-0/+4
Change-Id: I30100f94b753cbf7893c8a5ebcb91c7f76f97971 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28tempest_neutron-cntt -> tempest_neutron_cnttCédric Ollivier1-4/+4
Change-Id: I6247f4c43a0e152646a011b0dc7cbcfa219b7cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Rename neutron-tempest-plugin-api-cntt to tempest_neutronCédric Ollivier1-8/+8
Change-Id: I70ea285ab1611ab4d5bd3ff3209a45094950838e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert "Revert security-opt seccomp=unconfined"Cédric Ollivier1-0/+1
This reverts commit 3e7ab349e3911c85b1307798f767282c4fc41a5d. Change-Id: I59c28b5b61d54ab47a7cd1e3a511ddd3608d27a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Add tempest_heat_cntt in all gatesCédric Ollivier1-0/+7
Change-Id: I1f186f5cc68732aedee416619d49085407f5529d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert security-opt seccomp=unconfinedCédric Ollivier1-1/+0
It still fails [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run/16/console Change-Id: I693b1b76f4872993f2bc61179b1bd9ffe1edee5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-26Try bypassing libseccomp performance issuesCédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I17502628ccaa7868f0605c649f0549d9fd6f9dd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier1-3/+0
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier1-6/+0
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Clean workspace with sudoCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Run smoke in parallel backCédric Ollivier1-6/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier1-0/+13
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier1-0/+6
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier1-2/+2
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier1-2/+2
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>