summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2020-05-03Remove blacklist.yaml overrides.Cédric Ollivier2-15/+2
All SUTs now pass IPv6 testing. Change-Id: Ic202cff2a43702258f2e43ab435189edbe3c500d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-02Stop OVN daily job when first failureCédric Ollivier1-7/+0
OVN successfully passed IaaS verification and CNTT RC Compliance. Change-Id: I9aee27d63e03bdb6ce45372bb7b441258bb14d77 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Add tempest_telemetry in Functest jjbsCédric Ollivier2-0/+26
Change-Id: Icbebf51408c4f7fe84db26d26ff381080b5c301c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Update all Functest test case namesCédric Ollivier2-20/+64
Change-Id: I0cb2208c38ae9af085c9061f102d178ba44c4611 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Remove security-opt seccomp=unconfinedCédric Ollivier2-2/+0
Change-Id: I3b67ba0e7d3b9b36d2b7b681d52a2ea8938a5891 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Enable Kali ocatavia and tempest_heatCédric Ollivier1-4/+0
Change-Id: Ibbf78d566dbbd3787af4ddd6b0e8257186b999af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-30Temporarily exclude Kali ocatavia and tempest_heatCédric Ollivier1-0/+4
We are adding features in SUT in //. Change-Id: If7a830cec5b8168647fbb10d96a24b7e29e98b9d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-29Publish all Functest K8s gatesCédric Ollivier2-4/+10
It also renames the build servers. Change-Id: I66de1c15ba7ada3f8c13133fae9423c8c106c938 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-29Publish Functest Kali project jobsCédric Ollivier1-0/+3
Change-Id: I881b78291049b94b53650adb19bf6174854952b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-29Exclude functest-features if kaliCédric Ollivier1-0/+2
Change-Id: I23fe4ba837ebdb48d4cb5eb260fa728f450387b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Fix exclude rules in Functest docker jjbsCédric Ollivier1-0/+2
It has to be updated for Kali Change-Id: Ic2f7e6440e748ceaff761d39d0d520bd98efafc6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Fix exclude rules in Functest jjbsCédric Ollivier2-0/+6
It has to be updated for Kali Change-Id: I4b5cf222528aacc152fdebf29c1acc03ed03b939 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publish all Functest Kali jobsCédric Ollivier2-0/+7
Change-Id: I30100f94b753cbf7893c8a5ebcb91c7f76f97971 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publish Functest Kali project jobsCédric Ollivier1-0/+3
Change-Id: Iba0edd01739f498211394d569fd62f9f1ffd45b5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28tempest_neutron-cntt -> tempest_neutron_cnttCédric Ollivier2-7/+7
Change-Id: I6247f4c43a0e152646a011b0dc7cbcfa219b7cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Rename neutron-tempest-plugin-api-cntt to tempest_neutronCédric Ollivier2-16/+16
Change-Id: I70ea285ab1611ab4d5bd3ff3209a45094950838e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publisk Xtesting Kali jobsCédric Ollivier3-0/+9
Change-Id: Iacf6f52e3b4d8052d9fea69bc29747693f3b8c1c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert "Revert security-opt seccomp=unconfined"Cédric Ollivier2-0/+2
This reverts commit 3e7ab349e3911c85b1307798f767282c4fc41a5d. Change-Id: I59c28b5b61d54ab47a7cd1e3a511ddd3608d27a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Add tempest_heat_cntt in all gatesCédric Ollivier2-0/+14
Change-Id: I1f186f5cc68732aedee416619d49085407f5529d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert security-opt seccomp=unconfinedCédric Ollivier2-2/+0
It still fails [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run/16/console Change-Id: I693b1b76f4872993f2bc61179b1bd9ffe1edee5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Try bypassing libseccomp performance issues (OVN)Cédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I892fba7d96b7fc957b7368009ab56b3e0a2ee1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-26Try bypassing libseccomp performance issuesCédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I17502628ccaa7868f0605c649f0549d9fd6f9dd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-21Revert Functest Docker calls if OVNCédric Ollivier1-1/+0
Change-Id: I3ddbc084931cd08c04343025e801171a43d15b74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Increase memlock for Functest containersCédric Ollivier1-1/+1
Change-Id: I8b37de54baa2a7c8c091f5f51abce67b334af8c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Complete commit "Try Functest containers as privileged"Cédric Ollivier1-1/+1
Change-Id: I14779ac07f49a3fe2b5a281095880d5ecacf943c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Try Functest containers as privilegedCédric Ollivier1-0/+1
Rally threads sometimes loops with futex connection timeout. Let's if privileged works and then dive into ulimit. https://build.opnfv.org/ci/view/functest/job/functest-ovn-latest-daily/15/ Change-Id: Idede3c860dfd19cc605516f98af0e8c977b57c97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Fix docker smoke-cntt build dir if ovnCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-ovn-latest-gate/3/ Change-Id: I1d8bb762ee9786ba776948bc1577b5a9ec51f3a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Allow overriding blacklist.yaml if OVNCédric Ollivier1-0/+3
Change-Id: I3335e485a2c844b9035dd574546167ccc52b66a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Update Functest containers for OVN gatesCédric Ollivier1-2/+2
It has been updated to OpenStack master. OVN was merged in Neutron tree and the last tempest tests was fixed in master (to Full CNTT Compliance). Change-Id: I76e78cfa09c9398ef074456424041b9d689c0801 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier2-6/+0
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier2-12/+0
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Clean workspace with sudoCédric Ollivier3-3/+3
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Run smoke in parallel backCédric Ollivier2-12/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier2-0/+26
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier2-0/+12
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-03Revert "use lf-virtual1 instead of lf-build2 which is failing"Cédric Ollivier3-6/+6
This reverts commit 2c2babc8b92352fe13b54ba473a920da60f0d9f1. Change-Id: I98ea2bf682c09d2ed2de7ab11c166044ef71428b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02use lf-virtual1 instead of lf-build2 which is failingCédric Ollivier3-6/+6
Change-Id: I9f6b6823886a1b0dd473757bb2c0f957d4beff53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix latest test case names in OVNCédric Ollivier1-14/+14
Change-Id: I0b44942fc01822adfd49b92c89dae09bcf208ce1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier2-9/+9
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier2-19/+87
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier1-2/+2
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier1-0/+67
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-15Exclude security and cnf dockers if not latestCédric Ollivier1-0/+24
Change-Id: Id0c3fb9581f3c4614b4a6480cb119eb39c5ebe9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add new testcases in gatesCédric Ollivier1-18/+165
Change-Id: I09a11fd3848a901c20f83d81dbf3cdd72d9c2889 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Build new Functest K8s containersCédric Ollivier1-4/+32
It adds security and cnf [1][2]. [1] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69775 [2] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69663 Change-Id: I870cf4913f60e2f0e3587459c3d343dbf96a9ae2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Don't stop on first failuresCédric Ollivier1-0/+6
Functest OVN SUT is not fully verified or CNTT compliant yet. It allows checking all testcases. Change-Id: I1e2efd4b9add81bbc777aee3a8a9989a7b8874bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-25functest: Fix zte/itri PODs slave-labelAlexandru Avadanii1-2/+2
This fixes the wrong parameters being sources for these pods, in the case of zte-pod1 resulting in a different (wrong) INSTALLER_IP. Change-Id: I55d36a3c75ff18e0c045271ca1fb157899b72457 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2020-02-21Dont override blacklist if OVNCédric Ollivier1-3/+0
It's still in-use in ovs because of ip_v6 (SUT). Change-Id: I8f129fee677b72d5cbb78f55367f11b861e7d84f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Set DEPLOY_SCENARIO=os-ovn-nofeature-noha in Functest ovn jjbsCédric Ollivier1-0/+1
Change-Id: I54027a8f0c78e86ee4f5ef11c5942dcd7430753c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>