aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2023-05-13Update to RefStack 2022.11Cédric Ollivier1-2/+0
Change-Id: I7b7667987cb6369b27f2d15c670987ea99812335 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-11-07Skip test_compute_unified_limits in tempest_scenario_cnttCédric Ollivier1-1/+2
All new features are skipped until RA1 put it as mandatory https://artifacts.opnfv.org/functest/3LQT9SQ6HYCM/functest-opnfv-functest-smoke-cntt-yoga-tempest_scenario_cntt-run-1/tempest_scenario_cntt/tempest-report.html Change-Id: I5f2deeee408703ff2d82e0ca26dc0cdd5ef765ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-11-07Decrease test count in tempest_heat_cnttCédric Ollivier1-1/+1
https://artifacts.opnfv.org/functest/Z5NOKCLXQA25/functest-opnfv-functest-smoke-cntt-yoga-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html Change-Id: I95be34b107bc6e731031abae304f3acc6f090244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2022-05-02Filter local_ip testingCédric Ollivier1-1/+2
It's a new feature which has not been set as mandatory by Anuket Change-Id: Ib5d4cdc266b9db6c798dc3a1f27dc6c99012d534 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Skip test_volume_actions_rbac.VolumesActionsV310RbacTestCédric Ollivier1-0/+3
It completes the previous patch. http://artifacts.opnfv.org/functest/2BTYC9OZVCC2/functest-opnfv-functest-smoke-latest-patrole_member-run-188/patrole_member/tempest-report.html Change-Id: I03d3a21e72c5bc5335d77b8ce972601f8d2d273a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Skip ZaqarSignalTransportTest in tempest_heat_cnttCédric Ollivier1-0/+1
CNTT doesn't ask for messaging service. http://artifacts.opnfv.org/functest/Y2DWN1R2YMHV/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-171/tempest_heat_cntt/tempest-report.html Change-Id: Ia51a195fc937184932a6daabf670e4646f300f53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Exlude programming issues in Patrole test casesCédric Ollivier1-0/+27
http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_admin-run-187/patrole_admin/tempest-report.html http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_member-run-187/patrole_member/tempest-report.html http://artifacts.opnfv.org/functest/5R496QTS4IFG/functest-opnfv-functest-smoke-latest-patrole_reader-run-187/patrole_reader/tempest-report.html Change-Id: Icd494ed69efaea37818d5b63a9772c4625aa8e08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Skip test_network_qos_placement in tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/RWGPS2N4S9AK/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-198/tempest_scenario_cntt/tempest-report.html Change-Id: Ife673af908294d9aaff3fcb08ea7569ad3f43bce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Increase tempest_full_cntt test_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/KZZNYVZ3KXTC/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-201/tempest_full_cntt/tempest-report.html Change-Id: I4be720dfca3af4961951f095f834a1453e4d92a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Skip tempest_heat tests asking for messaging serviceCédric Ollivier1-0/+3
http://artifacts.opnfv.org/functest/JVAWH4X6HW5U/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-170/tempest_heat_cntt/tempest-report.html Change-Id: I69b5c796490447f4d6a271190c7b02c561d3bd25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-06Increase tempest_neutron_cntt test_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/3JQK2X84WTCX/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-165/tempest_neutron_cntt/tempest-report.html Change-Id: I0b534e096f13c3096e4c04cecf463deb245d99e8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-25Filter test_policy_minimum_bandwidth_rule_rbac in PatroleCédric Ollivier1-0/+3
https://artifacts.opnfv.org/functest/H5LU90NKXLQX/functest-opnfv-functest-smoke-xena-patrole_admin-run-13/patrole_admin/tempest-report.html Change-Id: Id4477c52b71147f47c590369a9030dd997c69da6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-25Reduce Patrole test case listsCédric Ollivier1-0/+33
They seem related to Patrole obsolescence patrole_tempest_plugin.rbac_exceptions.RbacParsingException: Attempted to test an invalid policy file or action Details: Policy action "volume_extension:types_manage" not found in policy files: [] or among registered policy in code defaults for cinder service. Change-Id: I2e0bfeb150c8835b47bddac7130021963850397a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-25Increate test_count in tempest_slow_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html Change-Id: I88446714338e46188f61bcac8967196c421f0edd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-25Increate test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-20Skip new image import related tests in CNTTCédric Ollivier1-0/+2
This feature is optional in CNTT. Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-20Take hostname_fqdn_sanitization into accountCédric Ollivier1-0/+1
It's skipped in CNTT as it's not enabled yet. Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-10-15Update RefStack test case descriptionsCédric Ollivier1-6/+0
RefStack now allows skip tests. Change-Id: I32f57388be81e3ace326c76320a33ca16c01bdba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Cinder rbac testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Glance testing in CNTTCédric Ollivier1-1/+5
They ask for features not mandatory in CNTT Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Keystone RBAC testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)
2021-05-21Skip test_get_network_ip_availabilitiesCédric Ollivier1-0/+3
http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-19Update test case countsCédric Ollivier1-2/+2
Change-Id: I5a10da026a98218496de36beb0a92d668514e336 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-19Configure dashboard.dashboard_url if tempest_slowCédric Ollivier1-1/+1
Tempest Horizon is now also executed in tempest_slow. Change-Id: I910adc68eeb067d089b705feb794911afd1747e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-17Update test case counts in CNTTCédric Ollivier1-2/+3
Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)
2021-02-11tempest_horizon has been merged into openstack/tempestCédric Ollivier1-1/+1
https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035 Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Update tempest_neutron test_count to 529Cédric Ollivier1-1/+1
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier1-0/+2
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Skip test_minbw_allocation_placement added to tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip Restack compute and platform if NO_TENANT_NETWORKCédric Ollivier1-0/+4
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Remove test_reset_network from Patrole test casesCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier1-0/+1
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier1-2/+2
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier1-1/+7
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier1-2/+17
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Disable refstack platform and computeCédric Ollivier1-0/+2
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1] "Metadata is read-only on non-Xen-based deployments." [1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier1-0/+4
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Enable back Patrole volume testingCédric Ollivier1-3/+9
It skips test_create_network_provider_segmentation_id as it can run in parallel (200 is hardcoded) and test_create_image_from_volume_backed_server which doesn't clean its resources. Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip patrole volume testingCédric Ollivier1-3/+3
They don't clean volume and snapshot which raises side effects after lots of iterations. They may be obsolete too [1] [1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier1-3/+7
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier1-6/+0
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Skip obsolete Patrole testsCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Fix functest/ci/testcases.yamlCédric Ollivier1-0/+5
Even if it's unused, it's keep synced by docker files. Change-Id: Ia98164c361017392542073745c37b441ec2216d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Increate neutron_tempest count to 517Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Add Patrole compute testingCédric Ollivier1-3/+3
It stops leveraging on policy json files as it fails for Nova. Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Skip Patrole test_show_auto_allocated_topologyCédric Ollivier1-0/+3
test_show_auto_allocated_topology doesn't clean its resources: - network: auto_allocated_network - subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6 - router: auto_allocated_router This bug easily breaks testing in a quick run when allocating the subnet due to insufficient prefix space to allocate subnet size /26. https://build.opnfv.org/ci/job/functest-latest-daily/746/ Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier1-0/+17
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>