summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-04-28tempest_neutron-cntt -> tempest_neutron_cnttCédric Ollivier4-14/+14
Change-Id: I6247f4c43a0e152646a011b0dc7cbcfa219b7cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Rename neutron-tempest-plugin-api-cntt to tempest_neutronCédric Ollivier3-18/+18
Change-Id: I70ea285ab1611ab4d5bd3ff3209a45094950838e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Publisk Xtesting Kali jobsCédric Ollivier3-0/+9
Change-Id: Iacf6f52e3b4d8052d9fea69bc29747693f3b8c1c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Create Xtesting Kali branchCédric Ollivier2-0/+10
Change-Id: Ibb8a277bd47a1207245dfcdeb94f68ede3283025 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert "Revert security-opt seccomp=unconfined"Cédric Ollivier2-0/+2
This reverts commit 3e7ab349e3911c85b1307798f767282c4fc41a5d. Change-Id: I59c28b5b61d54ab47a7cd1e3a511ddd3608d27a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Add tempest_heat_cntt in all gatesCédric Ollivier3-0/+17
Change-Id: I1f186f5cc68732aedee416619d49085407f5529d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Revert security-opt seccomp=unconfinedCédric Ollivier2-2/+0
It still fails [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run/16/console Change-Id: I693b1b76f4872993f2bc61179b1bd9ffe1edee5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Try bypassing libseccomp performance issues (OVN)Cédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I892fba7d96b7fc957b7368009ab56b3e0a2ee1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-26Try bypassing libseccomp performance issuesCédric Ollivier1-0/+1
https://github.com/docker/for-linux/issues/738 https://forums.docker.com/t/performance-issues-after-dist-upgrade-on-ubuntu-16-04lts/76998 Change-Id: I17502628ccaa7868f0605c649f0549d9fd6f9dd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-21Revert Functest Docker calls if OVNCédric Ollivier1-1/+0
Change-Id: I3ddbc084931cd08c04343025e801171a43d15b74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Increase memlock for Functest containersCédric Ollivier1-1/+1
Change-Id: I8b37de54baa2a7c8c091f5f51abce67b334af8c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Complete commit "Try Functest containers as privileged"Cédric Ollivier1-1/+1
Change-Id: I14779ac07f49a3fe2b5a281095880d5ecacf943c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Try Functest containers as privilegedCédric Ollivier1-0/+1
Rally threads sometimes loops with futex connection timeout. Let's if privileged works and then dive into ulimit. https://build.opnfv.org/ci/view/functest/job/functest-ovn-latest-daily/15/ Change-Id: Idede3c860dfd19cc605516f98af0e8c977b57c97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-20Fix docker smoke-cntt build dir if ovnCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-ovn-latest-gate/3/ Change-Id: I1d8bb762ee9786ba776948bc1577b5a9ec51f3a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Allow overriding blacklist.yaml if OVNCédric Ollivier1-0/+3
Change-Id: I3335e485a2c844b9035dd574546167ccc52b66a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Update Functest containers for OVN gatesCédric Ollivier1-2/+2
It has been updated to OpenStack master. OVN was merged in Neutron tree and the last tempest tests was fixed in master (to Full CNTT Compliance). Change-Id: I76e78cfa09c9398ef074456424041b9d689c0801 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Merge "Add tempest_horizon in Hunter gates"Cedric Ollivier4-6/+6
2020-04-11Merge "Add tempest_heat in gates"Cedric Ollivier4-12/+6
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier4-6/+6
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier4-12/+6
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-10Merge "Clean workspace with sudo"Cedric Ollivier3-3/+3
2020-04-07Clean workspace with sudoCédric Ollivier3-3/+3
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Merge "Update security scan mail publisher for releng utils and xci"Trevor Bramwell1-1/+1
2020-04-07Run smoke in parallel backCédric Ollivier2-12/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier2-0/+26
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier2-0/+12
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-03Update security scan mail publisher for releng utils and xciFatih Degirmenci1-1/+1
Change-Id: Id235b477c3c69aef214943c6a3eb2dd559814e7d Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2020-04-03Revert "use lf-virtual1 instead of lf-build2 which is failing"Cédric Ollivier3-6/+6
This reverts commit 2c2babc8b92352fe13b54ba473a920da60f0d9f1. Change-Id: I98ea2bf682c09d2ed2de7ab11c166044ef71428b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02use lf-virtual1 instead of lf-build2 which is failingCédric Ollivier3-6/+6
Change-Id: I9f6b6823886a1b0dd473757bb2c0f957d4beff53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix latest test case names in OVNCédric Ollivier1-14/+14
Change-Id: I0b44942fc01822adfd49b92c89dae09bcf208ce1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier2-9/+9
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier2-19/+87
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier2-4/+4
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier2-0/+107
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcases in RICédric Ollivier1-14/+14
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I5c805c2d321d25343724da862fbf367d68ddecde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-29Enable Airship jobsCédric Ollivier2-4/+0
Swift testing and vping_ssh seems good vs CNTT. CNTT RI needs to be updated to fully pass swift testing [1][2][3]. Airship sometimes failed vs vping_ssh because DHCP responds are far too long. [1] https://jira.opnfv.org/browse/AIRSHIP-39 [2] https://jira.opnfv.org/browse/AIRSHIP-40 [3] https://jira.opnfv.org/browse/AIRSHIP-41 Change-Id: I84a46d14f8c9e7c78f3a6a1e8452114030dcf997 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-28Disable Airship jobsCédric Ollivier2-0/+4
It allows verifying vping_ssh and latest tempest patches vs radosgw. https://review.opendev.org/#/c/692375/ Change-Id: I41496b57926c4ab9c4a9d39eb0eaeff5158442d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-23Fix S3 url in CNTT RI jobsCédric Ollivier1-2/+2
Else the files are not dumped in archive [1] [1] http://artifacts.opnfv.org/airship/GCSZTAF7OVFH.zip Change-Id: I920aa83a20290e93f56973490b40743e0b8b6220 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-17Remove debug data in CIRVCédric Ollivier1-4/+4
It will create archives conformed with RC Cookbook. Change-Id: I6238ced872982484f239e78ee39f5b6a12ff8a1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-16Merge "Switch to lf-build2"Cedric Ollivier1-1/+1
2020-03-16Switch to lf-build2Cédric Ollivier1-1/+1
There is no slave called intel-pod15. Change-Id: Ib03ef798ac117090f408ca9d562a6efc09e48340 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-16Merge "JJB: Added Jenkins build job for CIRV."Cedric Ollivier2-0/+77
2020-03-16JJB: Added Jenkins build job for CIRV.opensource-tnbt2-0/+77
This patch adds verify job for CIRV. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: I4d24f76b122429ff10f6e80ec35e6c2fcb0da3e6
2020-03-15Exclude security and cnf dockers if not latestCédric Ollivier1-0/+24
Change-Id: Id0c3fb9581f3c4614b4a6480cb119eb39c5ebe9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add new testcases in gatesCédric Ollivier1-18/+165
Change-Id: I09a11fd3848a901c20f83d81dbf3cdd72d9c2889 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Build new Functest K8s containersCédric Ollivier1-4/+32
It adds security and cnf [1][2]. [1] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69775 [2] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69663 Change-Id: I870cf4913f60e2f0e3587459c3d343dbf96a9ae2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-08Remove neutron_trunk in Airship and CIRV gatesCédric Ollivier2-4/+0
Else it would always fail until endpoints are fixed (pagination) Change-Id: Ib5c41ce7f6bc2c59d51d440da2d9eb96b7c9ed71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Merge "Revert "Disable CNTT jobs""Cedric Ollivier1-2/+0
2020-02-28Don't stop on first failuresCédric Ollivier1-0/+6
Functest OVN SUT is not fully verified or CNTT compliant yet. It allows checking all testcases. Change-Id: I1e2efd4b9add81bbc777aee3a8a9989a7b8874bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>