aboutsummaryrefslogtreecommitdiffstats
path: root/docker/smoke-cntt/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2021-11-20Take hostname_fqdn_sanitization into accountCédric Ollivier1-0/+1
It's skipped in CNTT as it's not enabled yet. Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Cinder rbac testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Glance testing in CNTTCédric Ollivier1-1/+4
They ask for features not mandatory in CNTT Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Keystone RBAC testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)
2021-05-19Update test case countsCédric Ollivier1-2/+2
Change-Id: I5a10da026a98218496de36beb0a92d668514e336 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-17Update test case counts in CNTTCédric Ollivier1-2/+3
Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)
2020-12-10Update tempest_neutron test_count to 529Cédric Ollivier1-1/+1
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Skip test_minbw_allocation_placement added to tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier1-0/+1
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-29Skip the tests now marked as buggyCédric Ollivier1-0/+1
tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding Skipped until bug: https://launchpad.net/bugs/1905432 is resolved. http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier1-2/+17
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier1-1/+3
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier1-1/+0
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Update tempest_full_cntt regexesCédric Ollivier1-1/+5
http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html https://review.opendev.org/#/c/737634/ Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-02Reduce ImportImagesTest regexCédric Ollivier1-1/+1
It fits last change in ImportImagesTest [1]. [1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-30Update tempest_cinder_cntt test_counts to 11Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-28Skip ImportImagesTest.test_image_import in CNTTCédric Ollivier1-0/+1
ImportImagesTest skipped as image import is not available [1] [1] http://artifacts.opnfv.org/functest/S9ABQ628T5IG/functest-opnfv-functest-smoke-latest-tempest_full-run-850/tempest_full/tempest-report.html Change-Id: I1999ed96f546ac7bf2115d205382b3b7f4dfe9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Increate neutron_tempest count to 517Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back manage_snapshot testing in CNTTCédric Ollivier1-2/+1
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back RemoteStack testing from tempest_heat_cnttCédric Ollivier1-3/+1
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Fix tempest_scenarioCédric Ollivier1-1/+1
It completes "min_computes_nodes is also used as max values". Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-29Update tempest_neutron_cntt regex and test countCédric Ollivier1-0/+1
It takes latest updates into account [1][2]. [1] http://artifacts.opnfv.org/functest/4W4YF3954M7H/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-85/tempest_neutron_cntt/tempest-report.html [2] http://artifacts.opnfv.org/functest/K4DV91F2Y9V0/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-76/tempest_neutron_cntt/tempest-report.html Change-Id: Ia9b57e708522926fde9f8c44e6a0e936e97f304f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Skip EncryptionVolTypeTest in Iaas verification and CNTT ConformanceCédric Ollivier1-1/+2
Attaching an encryted volume is optional in CNTT [1]. This test fails if the volume type already exists and if it runs twice in parallel [2]. As this single test doesn't fullfil the Functest requirements, it's skiped in the classical verification as well. [1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md [2] https://storyboard.openstack.org/#!/story/2007804 Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Remove RemoteStack testing from tempest_heat_cnttCédric Ollivier1-1/+3
Trusts redelegation is supported by Train [1][2] which forces to skip RemoteStack as CNTT Baldy is designed for Pike (the support is incomplete in case of trust [3]). [1] https://docs.openstack.org/releasenotes/heat/train.html#relnotes-13-0-0-stable-train [2] https://github.com/openstack/heat/commit/e377658586c737150dad1bfd80b7b2267d46be51 [3] https://bugs.launchpad.net/heat/+bug/1701498 Change-Id: Ib4f66170b9b1f50b8224705edb4820e5a4cb0167 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Update functest/ci/testcases.yamlCédric Ollivier1-2/+2
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-06Increase tempest_neutron's tests_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/Q3047D5AS3HJ/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-40/tempest_neutron_cntt/tempest-report.html http://artifacts.opnfv.org/functest/03PRDE6TZC14/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-49/tempest_neutron_cntt/tempest-report.html Change-Id: I4be6d2f58e50572a3e8b90ede0055f36bc1d6886 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-05Switch back to concurrency = 4 in tempest testcasesCédric Ollivier1-4/+4
3 seems good enough and stable which allows trying 4 as before Change-Id: Id1f17ebf73f9faa13ed3ceb327ccb4ecf88c2bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Increase tests_count into tempest_neutron_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/KJSOWXFF5CIQ/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-41/tempest_neutron_cntt/tempest-report.html Change-Id: I04f0c3ae695f17e2bd56add11410e24ee25967d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-28Take last upstream changes into account in the regexesCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/1NCC8YUFKE7X/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-64/tempest_slow_cntt/tempest-report.html Change-Id: I196421d96ada3ec1eb8fc718f72c3e796a0bd3b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-27Skip manage_snapshot in CNTTCédric Ollivier1-1/+2
As detected by Orange's RC Field trial, Ceph doesn't support this feature before Rocky [1]. "AttributeError: 'RBDDriver' object has no attribute 'unmanage_snapshot'" manage_snapshot testing is fully passing in Functest SUT because CNTT is verified vs OpenStack Rocky and newer. Ceph is selected by RI as backend and is widely reused by the ecosytem. It's similar to [2]. [1] https://bugs.launchpad.net/cinder/+bug/1645288 [2] https://gerrit.opnfv.org/gerrit/c/functest/+/69888 Change-Id: I3b7f88f5bed9a47a1e26e16bbbf74fea24ca76c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-25Update tests_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/R1927JRCFJR5/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-62/tempest_full_cntt/tempest-report.html Change-Id: Ia4b5bbdb92e7877d81acdcf9c4f3a9745badfb36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-14Prevent microversion conflictsCédric Ollivier1-1/+6
CNTT selects Pike as baseline and Hunter matches Rocky. Change-Id: I8a1aa8385adce1ebb9d74bcb897effaf5b434e5a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 82ceefd8f1609508a476aa2e4573e59926653165)
2020-05-10Increase tempest_neutron test_count to 512Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/V0A7B0J1PIRL/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-17/tempest_neutron_cntt/tempest-report.html Change-Id: I95dc0d8dec370dedb501878cbedfe5567ab86afd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-04Enable network_v6 testing in CNTTCédric Ollivier1-3/+2
req.inf.ntw.16 is a MUST requirement. Fixes cntt-n/CNTT#1556 Change-Id: Id48595f5f4710ea9cbf31edaa4ae0ed31f5278ba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-02Skip latest tests in tempest_full_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NQ4IHN2NFL69/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-41/tempest_full_cntt/tempest-report.html Change-Id: Ia2a4e4229f02f5909ac87b5f6175230b194bc205 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-01Exclude tests.scenario.test_octavia_lbaas in CNTT regexesCédric Ollivier1-0/+1
It may be skipped as well (the behavior differs if it's enabled or not via config). Change-Id: Ic23119001b7478e466782a58d8757117bf16e5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Rename neutron_tempest_plugin_api to tempest_neutronCédric Ollivier1-1/+1
It conforms with the other test case names Change-Id: Ia8836375c26ea4f1bff3637f7078e5f70f83c5fb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Complete "Skip CfnInitIntegrationTest in tempest_heat"Cédric Ollivier1-1/+2
http://artifacts.opnfv.org/functest/SXA8X2BBP3L4/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html Change-Id: Ie26d561fbb490bcaafe7c8ffddebc28bd72ff51c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-28Increase neutron-tempest-api test_count to 510Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/3L7CL8K6CU2N/functest-ovn-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-29/neutron-tempest-plugin-api-cntt/tempest-report.html Change-Id: I077464ed0fc734b97de089f549fb66ab137fccdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-27Add tempest_heat in CNTT smokeCédric Ollivier1-0/+24
It increases Heat coverage [1]. [1] http://artifacts.opnfv.org/functest/24ELW4C5RKD4/functest-ovn-opnfv-functest-smoke-latest-tempest_heat-run-34/tempest_heat/tempest-report.html Change-Id: I6630e4827a59b2ded34e5c271b9155df3b25f588 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-24Increase test_count in tempest_cinderCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/C5BKAKPJIZVJ/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-26/tempest_cinder_cntt/tempest-report.html Change-Id: I5c0a7db033024259180610b83b07c055f0393e4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-19Skip new tempest_full tests (CNTT)Cédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/53FYHR0Q9VVJ/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-20/tempest_full_cntt/tempest-report.html Change-Id: Ia4bba0b14ed1d1058f0461e90207aa7530f2e0f3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-17Take the last neutron tempest tests into accountCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/U0Y127OQNBF4/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-17/neutron-tempest-plugin-api-cntt/tempest-report.html Change-Id: Ib19c63e1a7f6e4c050c19b520fe149ff7c81b156 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-16Update Neutron regexCédric Ollivier1-0/+1
It skips the latest tests added in neutron-tempest-plugin [1][2] [1] https://review.opendev.org/#/c/711656/ [2] http://artifacts.opnfv.org/functest/CQY2GVXZ1NTU/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-13/neutron-tempest-plugin-api-cntt/tempest-report.html Change-Id: Iae9cd7a45f908c310133bf354b205a623f4c7476 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-10Update CNTT regexes and countsCédric Ollivier1-1/+2
It increases neutron-tempest-plugin-api test count to 502. It skips test_multiattach_rw_volume_update_failure which depends on volume multi-attach. http://artifacts.opnfv.org/functest/BVDINIZ8P8UC/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-6/neutron-tempest-plugin-api-cntt/tempest-report.html http://artifacts.opnfv.org/functest/BVDINIZ8P8UC/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-5/tempest_full_cntt/tempest-report.html Change-Id: Id4d4918ee24ef15f9610e706d6e90dfa3ae2cc43 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Remove last skipped tests in neutron-tempest-plugin-api-cnttCédric Ollivier1-0/+2
It takes into account last results [1] [1] http://artifacts.opnfv.org/functest/LIF2Y3SVUWLD/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-2/neutron-tempest-plugin-api-cntt/tempest-report.html Change-Id: Idd03c5aa42309eb5f254d6a99ea7e7206ee705ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-04Reduce Tempest multi threadsCédric Ollivier1-4/+4
It decreases the threads from 4 to 3 to allow running the testcases in parallel. Else a few tests sometimes fail. Change-Id: I268eff5a72d5de5b26d7549ac74ee0e2a05cb61e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>