summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2020-04-28Publish all Functest Kali jobsCédric Ollivier2-0/+7
Change-Id: I30100f94b753cbf7893c8a5ebcb91c7f76f97971 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publish Functest Kali project jobsCédric Ollivier1-0/+3
Change-Id: Iba0edd01739f498211394d569fd62f9f1ffd45b5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28tempest_neutron-cntt -> tempest_neutron_cnttCédric Ollivier2-7/+7
Change-Id: I6247f4c43a0e152646a011b0dc7cbcfa219b7cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Rename neutron-tempest-plugin-api-cntt to tempest_neutronCédric Ollivier2-16/+16
Change-Id: I70ea285ab1611ab4d5bd3ff3209a45094950838e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publisk Xtesting Kali jobsCédric Ollivier3-0/+9
Change-Id: Iacf6f52e3b4d8052d9fea69bc29747693f3b8c1c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert "Revert security-opt seccomp=unconfined"Cédric Ollivier2-0/+2
This reverts commit 3e7ab349e3911c85b1307798f767282c4fc41a5d. Change-Id: I59c28b5b61d54ab47a7cd1e3a511ddd3608d27a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Add tempest_heat_cntt in all gatesCédric Ollivier2-0/+14
Change-Id: I1f186f5cc68732aedee416619d49085407f5529d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert security-opt seccomp=unconfinedCédric Ollivier2-2/+0
It still fails [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run/16/console Change-Id: I693b1b76f4872993f2bc61179b1bd9ffe1edee5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Try bypassing libseccomp performance issues (OVN)Cédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I892fba7d96b7fc957b7368009ab56b3e0a2ee1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-26Try bypassing libseccomp performance issuesCédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I17502628ccaa7868f0605c649f0549d9fd6f9dd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-21Revert Functest Docker calls if OVNCédric Ollivier1-1/+0
Change-Id: I3ddbc084931cd08c04343025e801171a43d15b74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Increase memlock for Functest containersCédric Ollivier1-1/+1
Change-Id: I8b37de54baa2a7c8c091f5f51abce67b334af8c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Complete commit "Try Functest containers as privileged"Cédric Ollivier1-1/+1
Change-Id: I14779ac07f49a3fe2b5a281095880d5ecacf943c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Try Functest containers as privilegedCédric Ollivier1-0/+1
Rally threads sometimes loops with futex connection timeout. Let's if privileged works and then dive into ulimit. https://build.opnfv.org/ci/view/functest/job/functest-ovn-latest-daily/15/ Change-Id: Idede3c860dfd19cc605516f98af0e8c977b57c97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Fix docker smoke-cntt build dir if ovnCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-ovn-latest-gate/3/ Change-Id: I1d8bb762ee9786ba776948bc1577b5a9ec51f3a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Allow overriding blacklist.yaml if OVNCédric Ollivier1-0/+3
Change-Id: I3335e485a2c844b9035dd574546167ccc52b66a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Update Functest containers for OVN gatesCédric Ollivier1-2/+2
It has been updated to OpenStack master. OVN was merged in Neutron tree and the last tempest tests was fixed in master (to Full CNTT Compliance). Change-Id: I76e78cfa09c9398ef074456424041b9d689c0801 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier2-6/+0
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier2-12/+0
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Clean workspace with sudoCédric Ollivier3-3/+3
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Run smoke in parallel backCédric Ollivier2-12/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier2-0/+26
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier2-0/+12
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-03Revert "use lf-virtual1 instead of lf-build2 which is failing"Cédric Ollivier3-6/+6
This reverts commit 2c2babc8b92352fe13b54ba473a920da60f0d9f1. Change-Id: I98ea2bf682c09d2ed2de7ab11c166044ef71428b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02use lf-virtual1 instead of lf-build2 which is failingCédric Ollivier3-6/+6
Change-Id: I9f6b6823886a1b0dd473757bb2c0f957d4beff53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix latest test case names in OVNCédric Ollivier1-14/+14
Change-Id: I0b44942fc01822adfd49b92c89dae09bcf208ce1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier2-9/+9
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier2-19/+87
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier1-2/+2
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier1-0/+67
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-15Exclude security and cnf dockers if not latestCédric Ollivier1-0/+24
Change-Id: Id0c3fb9581f3c4614b4a6480cb119eb39c5ebe9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add new testcases in gatesCédric Ollivier1-18/+165
Change-Id: I09a11fd3848a901c20f83d81dbf3cdd72d9c2889 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Build new Functest K8s containersCédric Ollivier1-4/+32
It adds security and cnf [1][2]. [1] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69775 [2] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69663 Change-Id: I870cf4913f60e2f0e3587459c3d343dbf96a9ae2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Don't stop on first failuresCédric Ollivier1-0/+6
Functest OVN SUT is not fully verified or CNTT compliant yet. It allows checking all testcases. Change-Id: I1e2efd4b9add81bbc777aee3a8a9989a7b8874bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-25functest: Fix zte/itri PODs slave-labelAlexandru Avadanii1-2/+2
This fixes the wrong parameters being sources for these pods, in the case of zte-pod1 resulting in a different (wrong) INSTALLER_IP. Change-Id: I55d36a3c75ff18e0c045271ca1fb157899b72457 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2020-02-21Dont override blacklist if OVNCédric Ollivier1-3/+0
It's still in-use in ovs because of ip_v6 (SUT). Change-Id: I8f129fee677b72d5cbb78f55367f11b861e7d84f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Set DEPLOY_SCENARIO=os-ovn-nofeature-noha in Functest ovn jjbsCédric Ollivier1-0/+1
Change-Id: I54027a8f0c78e86ee4f5ef11c5942dcd7430753c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Update Functest Jenking view regexCédric Ollivier1-1/+1
It takes the new ovn jobs into account. Change-Id: Ie029f803bf06ef569c347f8b94fd19ca779ebd9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Fix Functest name if OVNCédric Ollivier1-226/+226
Change-Id: I3da531933716c627c01f73de28035defcacd5548 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Gate Functest and then CNTT RC vs OVNCédric Ollivier1-0/+1092
It allows verifying Functest Jerma vs OVN. It's directly linked to RC verification. Once it passes sucessfully, an new Hunter SUT may be setup too. Change-Id: I1d7fc55547eb2b961c42df15463689f5b0993f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Build docker container on lf-build2 (2/2)Cédric Ollivier3-6/+6
ericsson-build4 seems in a bad shape Change-Id: Ia7868f656f0c1a363074bd8e4e739b4f2f568cf8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Build docker container on lf-build2Cédric Ollivier3-3/+3
ericsson-build4 seems in a bad shape Change-Id: I0083308cda1c33f8a750387641d1e7d7dfcba3e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-25Use pod4 to verify Functest JermaCédric Ollivier1-2/+2
Change-Id: I38d9c34830f58ab24e765a7f2e72d192f6fd292b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Functest jobsCédric Ollivier2-16/+16
Change-Id: Ic3564f8feca430bffb1e655688f9f5d219c7bec3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Xtesting jobsCédric Ollivier1-8/+8
Change-Id: I15b72dfd13f7a7eb4c07fa5d426e0d9b23deef60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-03Configure our images for VirtIO-SCSICédric Ollivier1-0/+2
https://ceph.io/planet/more-recommendations-for-ceph-and-openstack/ Change-Id: I772aa68e6414e4bee77848bc6d5200918e95aee8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Generate Functest K8s jobs via latest Xtesting CICédric Ollivier1-42/+84
Change-Id: If7a64219caafb49ae67672548019d26c3b101da2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Fix container name when dumping K8s logsCédric Ollivier1-1/+1
Change-Id: Idbdd90b8ac193cacc1ca314493f5b970799930db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Reorder build operations in xtesting jjbsCédric Ollivier1-28/+28
It eases conditional instructions (they are useless if only daily jjbs are setup). Change-Id: I270dcdddc12a1621cb40505bd5ba21e569810627 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>