summaryrefslogtreecommitdiffstats
path: root/jjb/functest/functest.yaml
AgeCommit message (Collapse)AuthorFilesLines
2020-04-11Add tempest_horizon in Hunter gatesCédric Ollivier1-3/+0
Horizon is mandatory in CNTT [1] [1] https://github.com/cntt-n/CNTT/issues/1417 Change-Id: I25a4b1c22a31941fbd240b5c9d39a181fae19177 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-11Add tempest_heat in gatesCédric Ollivier1-6/+0
It was backported in all Functest active branches (CNTT). Change-Id: I996912fd1677838f4513fd77566eb3ee8702c90a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Clean workspace with sudoCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-hunter-zip/33/console Change-Id: I40d1bf2dda46a81f6ef1870ae4b2f66bfc362ce5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Run smoke in parallel backCédric Ollivier1-6/+0
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. The SUT has been improved regarding the workers (divided by 2). The default value was too high due to the number of cpus. Change-Id: I09be861b9ec369f36447ac9e9c09d14f2b7da1a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heatCédric Ollivier1-0/+13
It completes "Add tempest_heat (heat-tempest-plugin)" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/69910 Change-Id: Ie603cbdf07fb67c0cf1298fe958316a5e559d8ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Try to get best parallel testing valuesCédric Ollivier1-0/+6
It's no simple to get the best threads (test cases and tempest) values and then guarantee Functest vs: - test flapping - backend limitations As opposed to the OpenStack gates, Jenkins runs all test cases in parallel which indirectly increases the number of threads. Let's run smoke sequentially which is closed to the OpenStack model. Change-Id: I6172568b915d49e2723173b7c428970110f63620 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix a few test case namesCédric Ollivier1-2/+2
Change-Id: I7ff4df37354549da48b39ef0e6eabd976560fa24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcases in OVNCédric Ollivier1-2/+2
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: Ibab8b037e8e6ef6ecf52c67dd1159792b880f865 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Fix Functest CNTT benchmarking test case namesCédric Ollivier1-2/+2
Change-Id: I4fd59cdff2cb0bcdbc73a1badba8d79ea7a6f765 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Add Functest CNTT benchmarking testcasesCédric Ollivier1-0/+67
It doesn't run shaker and vtmp which are equal in IaaS verification and CNTT conformance. CNTT benchmarking testcase costs time for quite nothing but it verifies both processes (IaaS verification and CNTT conformance). Change-Id: I793a9ca12fc13a19dd7d672010b4149f3cd82452 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Rename Functest CNTT testcasesCédric Ollivier1-28/+28
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Change-Id: I29b2558f6e001ebf8826c889858be9d53784144b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Update Functest Jenking view regexCédric Ollivier1-1/+1
It takes the new ovn jobs into account. Change-Id: Ie029f803bf06ef569c347f8b94fd19ca779ebd9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-25Use pod4 to verify Functest JermaCédric Ollivier1-2/+2
Change-Id: I38d9c34830f58ab24e765a7f2e72d192f6fd292b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-04Update Alpine to 3.11 in Functest jobsCédric Ollivier1-8/+8
Change-Id: Ic3564f8feca430bffb1e655688f9f5d219c7bec3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-03Configure our images for VirtIO-SCSICédric Ollivier1-0/+2
https://ceph.io/planet/more-recommendations-for-ceph-and-openstack/ Change-Id: I772aa68e6414e4bee77848bc6d5200918e95aee8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-23Fix container name when dumpin Functest resultsCédric Ollivier1-1/+1
Change-Id: I3345116682238aab3b593c49dd79dea6f451cdaf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-22Dump all artifacts as last stepsCédric Ollivier1-1/+47
Change-Id: I55497311520f7fc2583bfa36fb1cb595cf5f1fff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Stop overriding default Rally blacklistsCédric Ollivier1-2/+0
The default Rally blacklist has been used asis for a while. Change-Id: Idc84935ec2bbc31a841764499c29c5cb1923b3c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-15Add buid_tag in Functest jobsCédric Ollivier1-2/+17
It eases archiving all logs (third-party certification). Change-Id: Ief9c89ac9cf5a748fb8f6965078c9651fd0066ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-27Run tempest_slow in Functest Hunter jobsCédric Ollivier1-2/+0
It was backported to fullfill CNTT needs. Change-Id: Ifec797b6943e2ab941625548686adc00208fb77c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Publish latest CNTT-related testsCédric Ollivier1-0/+14
Change-Id: I3cf00e1f96c6a7daa5291b555a339043661d8119 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add tempest_full in CNTT compliance gatingCédric Ollivier1-0/+7
Change-Id: I9f9be8d912eded2e17b6ead257bf778e5468afff Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add rally_sanity in API ComplianceCédric Ollivier1-0/+7
Change-Id: I8ad65a75a5db61c555810f7cbb5612db88c8d651 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-18Add Compliance tests in Functest jobsCédric Ollivier1-12/+122
Change-Id: I620f24f689731a20456b1153f88fb5c0a47bb557 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Run tempest_cinder and tempest_keystone in hunterCédric Ollivier1-4/+0
They have been backported for the best CNTT compliance. Change-Id: I8d8d19fc350af7804899ce91a58ca4b42b699c47 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Correct volume bindings in functest.yamlCédric Ollivier1-1/+1
It also adds -p in run_tests call Change-Id: I6e765407ba62678241a9ad2c62fcf0c2ca64e431 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-14Leverage on S3 support provided XtestingCédric Ollivier1-9/+6
It avoids using gsutil in Jenkins (extra logics). Change-Id: I2f3d69b88b115469e25b1452590e9ffc66266455 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-30Conform with latest Functest backportsCédric Ollivier1-12/+0
New tempest plugins were backported to Jerma and Iruya. Change-Id: I1e8d4fef110609657d179aa978b2b4441200abde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-29Replace few false healthcheck by smokeCédric Ollivier1-6/+6
It completes the previous change "Add latest tempest plugins integrated into Functest" [1]. [1] https://gerrit.opnfv.org/gerrit/c/releng/+/68700 Change-Id: If58d1d560e103b59ececb0f31ef47e052ca4105a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-29Add latest tempest plugins integrated into FunctestCédric Ollivier1-0/+46
Change-Id: Ic820f7d558be5e5425d2d3b165a8188c1eca13d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-08Add Jerma in blacklist logicsCédric Ollivier1-0/+2
https://build.opnfv.org/ci/job/functest-jerma-gate/5/ Change-Id: I6f970f36256b5c07dea32f7cbb630e695eb226e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-07Publish Functest Jerma jobsCédric Ollivier1-0/+6
Change-Id: Ie3970ea3e5b64130d73985a31ed16505e191c0f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-14Select 3.6 if iruyaCédric Ollivier1-0/+2
It conforms with "Select python 3.6 as default" [1]. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/68471 Change-Id: Ibc4ae81597ce9ed3d12ab27c6eae796870f6a2d4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-31Remove Functest (OS and K8s) features containersCédric Ollivier1-88/+0
Change-Id: I0391b15adc9f5a8f36d340f6970fe731ff10bcc1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-29Run tempest_slow in Functest Iruya gatesCédric Ollivier1-2/+0
tempest_slow was backported to Iruya [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/68409 Change-Id: I3305d8db5a3dcd19769aef726557866cb03396b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-29Add tempest_slow in Functest gatesCédric Ollivier1-0/+14
It disables few ipv6 testcases due to possible SUT misconfigurations. It seems better than fully skipping ipv6 via tempest config [1] because it's already well covered in tempest_full. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Change-Id: If1160dc68f5e53dffdfdd6722bdc557683243bde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-28Add Octavia in Functest gatesCédric Ollivier1-0/+11
It's now avaible in functest-smoke:latest Change-Id: Ib6d5313d63c92a5e760714001a1b8ca670fa261f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-21Protect tag in functest.yamlCédric Ollivier1-2/+2
Else 3.10 becomes falsy 3.1. Change-Id: I84045769d062f184f2f7020b9613cf06abc4af3e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Update to python 3.7 and alpine 3.10Cédric Ollivier1-9/+9
Change-Id: Id800208e148190ee10e4cfcb2a48a2dff00c35a7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-21Stop blacklisting tempest tests in gatesCédric Ollivier1-2/+0
It reverts "Allow blacklisting tempest tests" [1] as all volume leaks were solved [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/68020/ [2] https://bugs.launchpad.net/tempest/+bug/1829613 This reverts commit f90b8b66834b81b1022a05e14392857e77fccfca. Change-Id: Ic87de200482eb6c7aef878a1f23dcd43b79d1b10 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-20Revert "Exclude latest rally_full and rally_jobs"Cédric Ollivier1-5/+0
This reverts commit f0b74187ee9e26a6b0be9976b1c5d35d9c96523b. Change-Id: I97466016e6cf296996558a45d4e4a5354d349e6f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-09Exclude functest-tempest from master gatesCédric Ollivier1-0/+2
Change-Id: I09bde2d35769c0045f72e3da56a085db6426e4b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-06Exclude latest rally_full and rally_jobsCédric Ollivier1-0/+5
Rally is sometimes failing when running vs python3. It will be excluded during the investigation to allow checking changes and containers. Change-Id: Ifbd02629e618b9a6969b321b4862fc76df3f3bc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-08Allow blacklisting tempest testsCédric Ollivier1-27/+2
It will avoid volume leaks in gates [1]. Here is the blacklist: - tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details - tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers [1] https://bugs.launchpad.net/tempest/+bug/1829613 Change-Id: I9de07c77a2f307e0fdf872cdd7ff7be35409b484 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-03Override the right rally blacklistsCédric Ollivier1-1/+6
Latest containers now leverage on python3.6. Change-Id: Ib3b3c02497b85dd210713baed345c4a64a0add5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-16Add new Functest testcases in gatesCédric Ollivier1-1/+59
It takes the new refstack testcase into account [1] [1] https://gerrit.opnfv.org/gerrit/#/c/67833/ Change-Id: I9eca54d4dbe5b685e821ee56270c1dbb2de54e57 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-04Disable cold migration in Functest gatesCédric Ollivier1-0/+2
Change-Id: I092baa82bd22cc19c0786a14f962db9bcb7deadb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Revert "Turn debug on in gsutil (Functest jjbs)"Cédric Ollivier1-2/+2
This reverts commit f1fb034fd7421bcda973b08517b79a4cf28db040. Change-Id: I44be2b4c48713af1a844c748c7d50454052f8c91 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Revert "Add debug when running Functest jjbs"Cédric Ollivier1-2/+1
This reverts commit 02d9a5f0d62c16a72139291463703c86a80bffb7. Change-Id: I56b87660ba9d2e18042d5da6f3de2e9de2ed7b53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Turn debug on in gsutil (Functest jjbs)Cédric Ollivier1-2/+2
Change-Id: Ib387b3c7c6aeaf82283b95e522514c60a0b1eac8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>