summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2020-04-20Fix docker smoke-cntt build dir if ovnCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-ovn-latest-gate/3/ Change-Id: I1d8bb762ee9786ba776948bc1577b5a9ec51f3a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Allow overriding blacklist.yaml if OVNCédric Ollivier1-0/+3
Change-Id: I3335e485a2c844b9035dd574546167ccc52b66a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-13Update Functest containers for OVN gatesCédric Ollivier1-2/+2
It has been updated to OpenStack master. OVN was merged in Neutron tree and the last tempest tests was fixed in master (to Full CNTT Compliance). Change-Id: I76e78cfa09c9398ef074456424041b9d689c0801 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier2-6/+0
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier2-12/+0
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Clean workspace with sudoCédric Ollivier3-3/+3
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Run smoke in parallel backCédric Ollivier2-12/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier2-0/+26
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier2-0/+12
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-03Revert "use lf-virtual1 instead of lf-build2 which is failing"Cédric Ollivier3-6/+6
This reverts commit 2c2babc8b92352fe13b54ba473a920da60f0d9f1. Change-Id: I98ea2bf682c09d2ed2de7ab11c166044ef71428b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02use lf-virtual1 instead of lf-build2 which is failingCédric Ollivier3-6/+6
Change-Id: I9f6b6823886a1b0dd473757bb2c0f957d4beff53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix latest test case names in OVNCédric Ollivier1-14/+14
Change-Id: I0b44942fc01822adfd49b92c89dae09bcf208ce1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier2-9/+9
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier2-19/+87
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier1-2/+2
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier1-0/+67
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-15Exclude security and cnf dockers if not latestCédric Ollivier1-0/+24
Change-Id: Id0c3fb9581f3c4614b4a6480cb119eb39c5ebe9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add new testcases in gatesCédric Ollivier1-18/+165
Change-Id: I09a11fd3848a901c20f83d81dbf3cdd72d9c2889 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Build new Functest K8s containersCédric Ollivier1-4/+32
It adds security and cnf [1][2]. [1] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69775 [2] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69663 Change-Id: I870cf4913f60e2f0e3587459c3d343dbf96a9ae2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Don't stop on first failuresCédric Ollivier1-0/+6
Functest OVN SUT is not fully verified or CNTT compliant yet. It allows checking all testcases. Change-Id: I1e2efd4b9add81bbc777aee3a8a9989a7b8874bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-25functest: Fix zte/itri PODs slave-labelAlexandru Avadanii1-2/+2
This fixes the wrong parameters being sources for these pods, in the case of zte-pod1 resulting in a different (wrong) INSTALLER_IP. Change-Id: I55d36a3c75ff18e0c045271ca1fb157899b72457 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2020-02-21Dont override blacklist if OVNCédric Ollivier1-3/+0
It's still in-use in ovs because of ip_v6 (SUT). Change-Id: I8f129fee677b72d5cbb78f55367f11b861e7d84f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Set DEPLOY_SCENARIO=os-ovn-nofeature-noha in Functest ovn jjbsCédric Ollivier1-0/+1
Change-Id: I54027a8f0c78e86ee4f5ef11c5942dcd7430753c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Update Functest Jenking view regexCédric Ollivier1-1/+1
It takes the new ovn jobs into account. Change-Id: Ie029f803bf06ef569c347f8b94fd19ca779ebd9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Fix Functest name if OVNCédric Ollivier1-226/+226
Change-Id: I3da531933716c627c01f73de28035defcacd5548 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Gate Functest and then CNTT RC vs OVNCédric Ollivier1-0/+1092
It allows verifying Functest Jerma vs OVN. It's directly linked to RC verification. Once it passes sucessfully, an new Hunter SUT may be setup too. Change-Id: I1d7fc55547eb2b961c42df15463689f5b0993f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Build docker container on lf-build2 (2/2)Cédric Ollivier3-6/+6
ericsson-build4 seems in a bad shape Change-Id: Ia7868f656f0c1a363074bd8e4e739b4f2f568cf8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Build docker container on lf-build2Cédric Ollivier3-3/+3
ericsson-build4 seems in a bad shape Change-Id: I0083308cda1c33f8a750387641d1e7d7dfcba3e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-25Use pod4 to verify Functest JermaCédric Ollivier1-2/+2
Change-Id: I38d9c34830f58ab24e765a7f2e72d192f6fd292b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Functest jobsCédric Ollivier2-16/+16
Change-Id: Ic3564f8feca430bffb1e655688f9f5d219c7bec3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Xtesting jobsCédric Ollivier1-8/+8
Change-Id: I15b72dfd13f7a7eb4c07fa5d426e0d9b23deef60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-03Configure our images for VirtIO-SCSICédric Ollivier1-0/+2
https://ceph.io/planet/more-recommendations-for-ceph-and-openstack/ Change-Id: I772aa68e6414e4bee77848bc6d5200918e95aee8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Generate Functest K8s jobs via latest Xtesting CICédric Ollivier1-42/+84
Change-Id: If7a64219caafb49ae67672548019d26c3b101da2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Fix container name when dumping K8s logsCédric Ollivier1-1/+1
Change-Id: Idbdd90b8ac193cacc1ca314493f5b970799930db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Reorder build operations in xtesting jjbsCédric Ollivier1-28/+28
It eases conditional instructions (they are useless if only daily jjbs are setup). Change-Id: I270dcdddc12a1621cb40505bd5ba21e569810627 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Generate Xtesting jobs via latest Xtesting CICédric Ollivier1-4/+27
Change-Id: I6c96b3d020e45e1fba64340616e689923e140ead Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Remove falsy sudo in Functest K8sCédric Ollivier1-1/+1
Change-Id: I349605b0622fe23be412dd250aff9d0278ab9f0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-26Run tox on lf-virtual1Cédric Ollivier1-4/+4
It improves Functest slave management. Change-Id: I4d8a27e51b4989f0deb6fd15a7a3390cf975ad69 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-23Fix container name when dumpin Functest resultsCédric Ollivier1-1/+1
Change-Id: I3345116682238aab3b593c49dd79dea6f451cdaf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all artifacts as last stepsCédric Ollivier1-1/+47
Change-Id: I55497311520f7fc2583bfa36fb1cb595cf5f1fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all artifacts as last stepsCédric Ollivier1-1/+47
Change-Id: Ia444ec9da0ddf82cdb4c7447d3e27021a36fb210 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Add missing sudo callsCédric Ollivier1-1/+1
It modifies airship, cntt and xtesting jjbs. Change-Id: If9f8d301262764312a46b7fa6e24220d96fc30bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all logs as last Xtesting stepCédric Ollivier1-1/+47
Change-Id: I6a1353446f34a97307aeda322893006c833018b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-19functest: fuel: Switch hunter jobs to iruya streamAlexandru Avadanii1-5/+5
Change-Id: Iaa812a79a3ecb7b08cc8db16a342125c38849fab Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2019-12-17Build functest-features in HunterCédric Ollivier1-0/+13
functest-features:hunter is not updated (latest Xtesting changes) Change-Id: Ic3b62c9b8e0b59a2127186bd5f38b7ca72cf2633 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Stop overriding default Rally blacklistsCédric Ollivier1-2/+0
The default Rally blacklist has been used asis for a while. Change-Id: Idc84935ec2bbc31a841764499c29c5cb1923b3c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Add buid_tag in Functest jobsCédric Ollivier3-6/+51
It eases archiving all logs (third-party certification). Change-Id: Ief9c89ac9cf5a748fb8f6965078c9651fd0066ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-27Run tempest_slow in Functest Hunter jobsCédric Ollivier1-2/+0
It was backported to fullfill CNTT needs. Change-Id: Ifec797b6943e2ab941625548686adc00208fb77c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Publish latest CNTT-related testsCédric Ollivier1-0/+14
Change-Id: I3cf00e1f96c6a7daa5291b555a339043661d8119 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>