aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2021-05-21Skip new Cinder rbac testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Glance testing in CNTTCédric Ollivier1-1/+5
They ask for features not mandatory in CNTT Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Keystone RBAC testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)
2021-05-21Skip test_get_network_ip_availabilitiesCédric Ollivier1-0/+3
http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-19Update test case countsCédric Ollivier1-2/+2
Change-Id: I5a10da026a98218496de36beb0a92d668514e336 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-19Configure dashboard.dashboard_url if tempest_slowCédric Ollivier2-16/+15
Tempest Horizon is now also executed in tempest_slow. Change-Id: I910adc68eeb067d089b705feb794911afd1747e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-18Fix mkfs.ext4 path if Cirros 0.5Cédric Ollivier1-1/+1
Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-17Detect OpenStack ussuriCédric Ollivier2-1/+19
Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-17Update test case counts in CNTTCédric Ollivier1-2/+3
Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)
2021-05-17Update scenario img_file in tempest.confCédric Ollivier2-4/+3
It's now an absolute filename [1]. It also updates the cirros version. [1] https://github.com/openstack/barbican-tempest-plugin/commit/3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49 Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c068c042c8a9c02a7ba9c30257e897dab7705b2d)
2021-04-20Refactor test_run_verifier_tests_defaultCédric Ollivier1-13/+10
https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/4e3262ab-3adf-4539-839c-eddd49bcc2c1/jobs/809 Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-11tempest_horizon has been merged into openstack/tempestCédric Ollivier1-1/+1
https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035 Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Update tempest_neutron test_count to 529Cédric Ollivier1-1/+1
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Set NEW_USER ROLE in tempest_heat classic userCédric Ollivier1-0/+3
Else it fails when member is not the default role. Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Remove all network data in Rally full tasksCédric Ollivier1-24/+0
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Update Rally sanity tasks and blacklists for L2 onlyCédric Ollivier2-9/+2
This issues were hidden by Airship limitation (live-migration fails) Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier1-0/+2
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Skip test_minbw_allocation_placement added to tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Rather use rconfig.has_option() insteadCédric Ollivier1-1/+1
It slightly increases py2 and py3 to ease next backports. Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip create_and_update_routers if NO_TENANT_NETWORKCédric Ollivier1-0/+1
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip Restack compute and platform if NO_TENANT_NETWORKCédric Ollivier1-0/+4
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Concat both dynamic and static roles in tempest.confCédric Ollivier1-13/+28
It also moves all auth logic in a specific method. Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Remove test_reset_network from Patrole test casesCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Update NovaServers.boot_server_associate_and_dissociate_floating_ipCédric Ollivier2-6/+3
It conforms with "Fix nova scenarios for assiciating fips" [1] http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html [1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460 Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Stop setting floating_ips in tempest_conf.yamlCédric Ollivier3-2/+1
It's now handled by tempest.py Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Remove list_routers call if no tenant networkCédric Ollivier1-0/+1
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Update Shaker image as proposed in download.shCédric Ollivier1-1/+1
Change-Id: I408a462274245e927b382e008ba146603d82b2e2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier1-0/+1
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-28Stop duplicating connect_methodCédric Ollivier2-2/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier1-2/+2
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier2-2/+9
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Slightly update tempest_confCédric Ollivier2-2/+8
It completes "Update CNTT regex according to latest tempest changes" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464 Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier1-2/+17
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Disable refstack platform and computeCédric Ollivier1-0/+2
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1] "Metadata is read-only on non-Xen-based deployments." [1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier2-1/+9
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier5-9/+23
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Enable back Patrole volume testingCédric Ollivier1-3/+9
It skips test_create_network_provider_segmentation_id as it can run in parallel (200 is hardcoded) and test_create_image_from_volume_backed_server which doesn't clean its resources. Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip patrole volume testingCédric Ollivier1-3/+3
They don't clean volume and snapshot which raises side effects after lots of iterations. They may be obsolete too [1] [1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier1-3/+7
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier3-8/+2
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Skip obsolete Patrole testsCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Fix functest/ci/testcases.yamlCédric Ollivier1-0/+5
Even if it's unused, it's keep synced by docker files. Change-Id: Ia98164c361017392542073745c37b441ec2216d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>