summaryrefslogtreecommitdiffstats
path: root/jjb/functest
AgeCommit message (Collapse)AuthorFilesLines
2020-04-07Run smoke in parallel backCédric Ollivier2-12/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier2-0/+26
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier2-0/+12
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-03Revert "use lf-virtual1 instead of lf-build2 which is failing"Cédric Ollivier3-6/+6
This reverts commit 2c2babc8b92352fe13b54ba473a920da60f0d9f1. Change-Id: I98ea2bf682c09d2ed2de7ab11c166044ef71428b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02use lf-virtual1 instead of lf-build2 which is failingCédric Ollivier3-6/+6
Change-Id: I9f6b6823886a1b0dd473757bb2c0f957d4beff53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix latest test case names in OVNCédric Ollivier1-14/+14
Change-Id: I0b44942fc01822adfd49b92c89dae09bcf208ce1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier2-9/+9
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier2-19/+87
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier1-2/+2
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier1-0/+67
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-15Exclude security and cnf dockers if not latestCédric Ollivier1-0/+24
Change-Id: Id0c3fb9581f3c4614b4a6480cb119eb39c5ebe9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Add new testcases in gatesCédric Ollivier1-18/+165
Change-Id: I09a11fd3848a901c20f83d81dbf3cdd72d9c2889 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-13Build new Functest K8s containersCédric Ollivier1-4/+32
It adds security and cnf [1][2]. [1] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69775 [2] https://gerrit.opnfv.org/gerrit/c/functest-kubernetes/+/69663 Change-Id: I870cf4913f60e2f0e3587459c3d343dbf96a9ae2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Don't stop on first failuresCédric Ollivier1-0/+6
Functest OVN SUT is not fully verified or CNTT compliant yet. It allows checking all testcases. Change-Id: I1e2efd4b9add81bbc777aee3a8a9989a7b8874bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-25functest: Fix zte/itri PODs slave-labelAlexandru Avadanii1-2/+2
This fixes the wrong parameters being sources for these pods, in the case of zte-pod1 resulting in a different (wrong) INSTALLER_IP. Change-Id: I55d36a3c75ff18e0c045271ca1fb157899b72457 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2020-02-21Dont override blacklist if OVNCédric Ollivier1-3/+0
It's still in-use in ovs because of ip_v6 (SUT). Change-Id: I8f129fee677b72d5cbb78f55367f11b861e7d84f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Set DEPLOY_SCENARIO=os-ovn-nofeature-noha in Functest ovn jjbsCédric Ollivier1-0/+1
Change-Id: I54027a8f0c78e86ee4f5ef11c5942dcd7430753c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Update Functest Jenking view regexCédric Ollivier1-1/+1
It takes the new ovn jobs into account. Change-Id: Ie029f803bf06ef569c347f8b94fd19ca779ebd9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Fix Functest name if OVNCédric Ollivier1-226/+226
Change-Id: I3da531933716c627c01f73de28035defcacd5548 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Gate Functest and then CNTT RC vs OVNCédric Ollivier1-0/+1092
It allows verifying Functest Jerma vs OVN. It's directly linked to RC verification. Once it passes sucessfully, an new Hunter SUT may be setup too. Change-Id: I1d7fc55547eb2b961c42df15463689f5b0993f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Build docker container on lf-build2 (2/2)Cédric Ollivier3-6/+6
ericsson-build4 seems in a bad shape Change-Id: Ia7868f656f0c1a363074bd8e4e739b4f2f568cf8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Build docker container on lf-build2Cédric Ollivier3-3/+3
ericsson-build4 seems in a bad shape Change-Id: I0083308cda1c33f8a750387641d1e7d7dfcba3e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-25Use pod4 to verify Functest JermaCédric Ollivier1-2/+2
Change-Id: I38d9c34830f58ab24e765a7f2e72d192f6fd292b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Functest jobsCédric Ollivier2-16/+16
Change-Id: Ic3564f8feca430bffb1e655688f9f5d219c7bec3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Xtesting jobsCédric Ollivier1-8/+8
Change-Id: I15b72dfd13f7a7eb4c07fa5d426e0d9b23deef60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-03Configure our images for VirtIO-SCSICédric Ollivier1-0/+2
https://ceph.io/planet/more-recommendations-for-ceph-and-openstack/ Change-Id: I772aa68e6414e4bee77848bc6d5200918e95aee8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Generate Functest K8s jobs via latest Xtesting CICédric Ollivier1-42/+84
Change-Id: If7a64219caafb49ae67672548019d26c3b101da2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Fix container name when dumping K8s logsCédric Ollivier1-1/+1
Change-Id: Idbdd90b8ac193cacc1ca314493f5b970799930db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Reorder build operations in xtesting jjbsCédric Ollivier1-28/+28
It eases conditional instructions (they are useless if only daily jjbs are setup). Change-Id: I270dcdddc12a1621cb40505bd5ba21e569810627 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Generate Xtesting jobs via latest Xtesting CICédric Ollivier1-4/+27
Change-Id: I6c96b3d020e45e1fba64340616e689923e140ead Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-02Remove falsy sudo in Functest K8sCédric Ollivier1-1/+1
Change-Id: I349605b0622fe23be412dd250aff9d0278ab9f0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-26Run tox on lf-virtual1Cédric Ollivier1-4/+4
It improves Functest slave management. Change-Id: I4d8a27e51b4989f0deb6fd15a7a3390cf975ad69 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-23Fix container name when dumpin Functest resultsCédric Ollivier1-1/+1
Change-Id: I3345116682238aab3b593c49dd79dea6f451cdaf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all artifacts as last stepsCédric Ollivier1-1/+47
Change-Id: I55497311520f7fc2583bfa36fb1cb595cf5f1fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all artifacts as last stepsCédric Ollivier1-1/+47
Change-Id: Ia444ec9da0ddf82cdb4c7447d3e27021a36fb210 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Add missing sudo callsCédric Ollivier1-1/+1
It modifies airship, cntt and xtesting jjbs. Change-Id: If9f8d301262764312a46b7fa6e24220d96fc30bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all logs as last Xtesting stepCédric Ollivier1-1/+47
Change-Id: I6a1353446f34a97307aeda322893006c833018b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-19functest: fuel: Switch hunter jobs to iruya streamAlexandru Avadanii1-5/+5
Change-Id: Iaa812a79a3ecb7b08cc8db16a342125c38849fab Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2019-12-17Build functest-features in HunterCédric Ollivier1-0/+13
functest-features:hunter is not updated (latest Xtesting changes) Change-Id: Ic3b62c9b8e0b59a2127186bd5f38b7ca72cf2633 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Stop overriding default Rally blacklistsCédric Ollivier1-2/+0
The default Rally blacklist has been used asis for a while. Change-Id: Idc84935ec2bbc31a841764499c29c5cb1923b3c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Add buid_tag in Functest jobsCédric Ollivier3-6/+51
It eases archiving all logs (third-party certification). Change-Id: Ief9c89ac9cf5a748fb8f6965078c9651fd0066ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-27Run tempest_slow in Functest Hunter jobsCédric Ollivier1-2/+0
It was backported to fullfill CNTT needs. Change-Id: Ifec797b6943e2ab941625548686adc00208fb77c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Publish latest CNTT-related testsCédric Ollivier1-0/+14
Change-Id: I3cf00e1f96c6a7daa5291b555a339043661d8119 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Build the new CNTT-related Functest benchmarking containersCédric Ollivier1-0/+7
Change-Id: Id742f2ff0b6db3bddd8cc588a2a20b56066c669b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add tempest_full in CNTT compliance gatingCédric Ollivier1-0/+7
Change-Id: I9f9be8d912eded2e17b6ead257bf778e5468afff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add rally_sanity in API ComplianceCédric Ollivier1-0/+7
Change-Id: I8ad65a75a5db61c555810f7cbb5612db88c8d651 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-18Add Compliance tests in Functest jobsCédric Ollivier1-12/+122
Change-Id: I620f24f689731a20456b1153f88fb5c0a47bb557 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Run tempest_cinder and tempest_keystone in hunterCédric Ollivier1-4/+0
They have been backported for the best CNTT compliance. Change-Id: I8d8d19fc350af7804899ce91a58ca4b42b699c47 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Correct volume bindings in functest.yamlCédric Ollivier2-2/+2
It also adds -p in run_tests call Change-Id: I6e765407ba62678241a9ad2c62fcf0c2ca64e431 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>