aboutsummaryrefslogtreecommitdiffstats
path: root/docker/smoke-cntt/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2022-11-07Skip test_compute_unified_limits in tempest_scenario_cnttCédric Ollivier1-1/+2
All new features are skipped until RA1 put it as mandatory https://artifacts.opnfv.org/functest/3LQT9SQ6HYCM/functest-opnfv-functest-smoke-cntt-yoga-tempest_scenario_cntt-run-1/tempest_scenario_cntt/tempest-report.html Change-Id: I5f2deeee408703ff2d82e0ca26dc0cdd5ef765ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-11-07Decrease test count in tempest_heat_cnttCédric Ollivier1-1/+1
https://artifacts.opnfv.org/functest/Z5NOKCLXQA25/functest-opnfv-functest-smoke-cntt-yoga-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html Change-Id: I95be34b107bc6e731031abae304f3acc6f090244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-05-02Filter local_ip testingCédric Ollivier1-1/+2
It's a new feature which has not been set as mandatory by Anuket Change-Id: Ib5d4cdc266b9db6c798dc3a1f27dc6c99012d534 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Skip ZaqarSignalTransportTest in tempest_heat_cnttCédric Ollivier1-0/+1
CNTT doesn't ask for messaging service. http://artifacts.opnfv.org/functest/Y2DWN1R2YMHV/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-171/tempest_heat_cntt/tempest-report.html Change-Id: Ia51a195fc937184932a6daabf670e4646f300f53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Skip test_network_qos_placement in tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/RWGPS2N4S9AK/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-198/tempest_scenario_cntt/tempest-report.html Change-Id: Ife673af908294d9aaff3fcb08ea7569ad3f43bce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Increase tempest_full_cntt test_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/KZZNYVZ3KXTC/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-201/tempest_full_cntt/tempest-report.html Change-Id: I4be720dfca3af4961951f095f834a1453e4d92a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Skip tempest_heat tests asking for messaging serviceCédric Ollivier1-0/+3
http://artifacts.opnfv.org/functest/JVAWH4X6HW5U/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-170/tempest_heat_cntt/tempest-report.html Change-Id: I69b5c796490447f4d6a271190c7b02c561d3bd25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Increase tempest_neutron_cntt test_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/3JQK2X84WTCX/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-165/tempest_neutron_cntt/tempest-report.html Change-Id: I0b534e096f13c3096e4c04cecf463deb245d99e8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-25Increate test_count in tempest_slow_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html Change-Id: I88446714338e46188f61bcac8967196c421f0edd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-25Increate test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-20Skip new image import related tests in CNTTCédric Ollivier1-0/+2
This feature is optional in CNTT. Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-20Take hostname_fqdn_sanitization into accountCédric Ollivier1-0/+1
It's skipped in CNTT as it's not enabled yet. Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Cinder rbac testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Glance testing in CNTTCédric Ollivier1-1/+4
They ask for features not mandatory in CNTT Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Keystone RBAC testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)
2021-05-19Update test case countsCédric Ollivier1-2/+2
Change-Id: I5a10da026a98218496de36beb0a92d668514e336 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-17Update test case counts in CNTTCédric Ollivier1-2/+3
Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)
2020-12-10Update tempest_neutron test_count to 529Cédric Ollivier1-1/+1
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Skip test_minbw_allocation_placement added to tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier1-0/+1
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-29Skip the tests now marked as buggyCédric Ollivier1-0/+1
tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding Skipped until bug: https://launchpad.net/bugs/1905432 is resolved. http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier1-2/+17
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier1-1/+3
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Update tempest_full_cntt regexesCédric Ollivier1-1/+5
http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html https://review.opendev.org/#/c/737634/ Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-02Reduce ImportImagesTest regexCédric Ollivier1-1/+1
It fits last change in ImportImagesTest [1]. [1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-30Update tempest_cinder_cntt test_counts to 11Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-28Skip ImportImagesTest.test_image_import in CNTTCédric Ollivier1-0/+1
ImportImagesTest skipped as image import is not available [1] [1] http://artifacts.opnfv.org/functest/S9ABQ628T5IG/functest-opnfv-functest-smoke-latest-tempest_full-run-850/tempest_full/tempest-report.html Change-Id: I1999ed96f546ac7bf2115d205382b3b7f4dfe9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Increate neutron_tempest count to 517Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back manage_snapshot testing in CNTTCédric Ollivier1-2/+1
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back RemoteStack testing from tempest_heat_cnttCédric Ollivier1-3/+1
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Fix tempest_scenarioCédric Ollivier1-1/+1
It completes "min_computes_nodes is also used as max values". Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-29Update tempest_neutron_cntt regex and test countCédric Ollivier1-0/+1
It takes latest updates into account [1][2]. [1] http://artifacts.opnfv.org/functest/4W4YF3954M7H/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-85/tempest_neutron_cntt/tempest-report.html [2] http://artifacts.opnfv.org/functest/K4DV91F2Y9V0/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-76/tempest_neutron_cntt/tempest-report.html Change-Id: Ia9b57e708522926fde9f8c44e6a0e936e97f304f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Skip EncryptionVolTypeTest in Iaas verification and CNTT ConformanceCédric Ollivier1-1/+2
Attaching an encryted volume is optional in CNTT [1]. This test fails if the volume type already exists and if it runs twice in parallel [2]. As this single test doesn't fullfil the Functest requirements, it's skiped in the classical verification as well. [1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md [2] https://storyboard.openstack.org/#!/story/2007804 Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Remove RemoteStack testing from tempest_heat_cnttCédric Ollivier1-1/+3
Trusts redelegation is supported by Train [1][2] which forces to skip RemoteStack as CNTT Baldy is designed for Pike (the support is incomplete in case of trust [3]). [1] https://docs.openstack.org/releasenotes/heat/train.html#relnotes-13-0-0-stable-train [2] https://github.com/openstack/heat/commit/e377658586c737150dad1bfd80b7b2267d46be51 [3] https://bugs.launchpad.net/heat/+bug/1701498 Change-Id: Ib4f66170b9b1f50b8224705edb4820e5a4cb0167 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Update functest/ci/testcases.yamlCédric Ollivier1-2/+2
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-06Increase tempest_neutron's tests_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/Q3047D5AS3HJ/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-40/tempest_neutron_cntt/tempest-report.html http://artifacts.opnfv.org/functest/03PRDE6TZC14/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-49/tempest_neutron_cntt/tempest-report.html Change-Id: I4be6d2f58e50572a3e8b90ede0055f36bc1d6886 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-05Switch back to concurrency = 4 in tempest testcasesCédric Ollivier1-4/+4
3 seems good enough and stable which allows trying 4 as before Change-Id: Id1f17ebf73f9faa13ed3ceb327ccb4ecf88c2bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Increase tests_count into tempest_neutron_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/KJSOWXFF5CIQ/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-41/tempest_neutron_cntt/tempest-report.html Change-Id: I04f0c3ae695f17e2bd56add11410e24ee25967d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-28Take last upstream changes into account in the regexesCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/1NCC8YUFKE7X/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-64/tempest_slow_cntt/tempest-report.html Change-Id: I196421d96ada3ec1eb8fc718f72c3e796a0bd3b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-27Skip manage_snapshot in CNTTCédric Ollivier1-1/+2
As detected by Orange's RC Field trial, Ceph doesn't support this feature before Rocky [1]. "AttributeError: 'RBDDriver' object has no attribute 'unmanage_snapshot'" manage_snapshot testing is fully passing in Functest SUT because CNTT is verified vs OpenStack Rocky and newer. Ceph is selected by RI as backend and is widely reused by the ecosytem. It's similar to [2]. [1] https://bugs.launchpad.net/cinder/+bug/1645288 [2] https://gerrit.opnfv.org/gerrit/c/functest/+/69888 Change-Id: I3b7f88f5bed9a47a1e26e16bbbf74fea24ca76c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-25Update tests_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/R1927JRCFJR5/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-62/tempest_full_cntt/tempest-report.html Change-Id: Ia4b5bbdb92e7877d81acdcf9c4f3a9745badfb36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-14Prevent microversion conflictsCédric Ollivier1-1/+6
CNTT selects Pike as baseline and Hunter matches Rocky. Change-Id: I8a1aa8385adce1ebb9d74bcb897effaf5b434e5a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 82ceefd8f1609508a476aa2e4573e59926653165)
2020-05-10Increase tempest_neutron test_count to 512Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/V0A7B0J1PIRL/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-17/tempest_neutron_cntt/tempest-report.html Change-Id: I95dc0d8dec370dedb501878cbedfe5567ab86afd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-04Enable network_v6 testing in CNTTCédric Ollivier1-3/+2
req.inf.ntw.16 is a MUST requirement. Fixes cntt-n/CNTT#1556 Change-Id: Id48595f5f4710ea9cbf31edaa4ae0ed31f5278ba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-02Skip latest tests in tempest_full_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NQ4IHN2NFL69/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-41/tempest_full_cntt/tempest-report.html Change-Id: Ia2a4e4229f02f5909ac87b5f6175230b194bc205 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Exclude tests.scenario.test_octavia_lbaas in CNTT regexesCédric Ollivier1-0/+1
It may be skipped as well (the behavior differs if it's enabled or not via config). Change-Id: Ic23119001b7478e466782a58d8757117bf16e5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>