aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2023-03-13test_openstack_version14 -> test_openstack_version15Cédric Ollivier1-1/+1
Change-Id: I155a00e46762b6710baf30f47bf19730e0be1238 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2023-03-13Detect OpenStack XenaCédric Ollivier1-0/+8
Change-Id: I3b0c9e030f2d31a6151d9ba44f2a06a627b3d913 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0e1b036ed4f4527c09cf1355a707875f640ee569)
2022-11-08Stop using docker install scriptCédric Ollivier2-4/+4
As this script fails vs xenial, let's update ubuntu and install the official package. Change-Id: Iba4124429bcd80280f6c5d128758ca72f00bb8f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 587d560e6685ed7460d5f51dbaa1edde1fc27175) (cherry picked from commit ed537f467b3dfabc7a6abb05a96f9b4d52c7a8eb)
2022-01-28Update rally-openstack to latest crucial changesCédric Ollivier1-0/+27
It fixes cinder "update_volume_type() got an unexpected keyword and the bugs detected by CI (here Cinder v3) Then it also reverts: - Temporarily remove CinderVolumeTypes.create_and_update_volume_type - Temporarily blacklist CinderVolumeTypes.create_volume_type_add_and_list_type_access Change-Id: I3bdcc6891da25728453a80903aa18c113f81fd81 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-04Temporarily blacklist ↵Cédric Ollivier1-13/+0
CinderVolumeTypes.create_volume_type_add_and_list_type_access Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-03Temporarily remove CinderVolumeTypes.create_and_update_volume_typeCédric Ollivier1-14/+0
A few tests are linked to Cinder v2 which was dropped in Xena Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-25Filter test_policy_minimum_bandwidth_rule_rbac in PatroleCédric Ollivier1-0/+3
https://artifacts.opnfv.org/functest/H5LU90NKXLQX/functest-opnfv-functest-smoke-xena-patrole_admin-run-13/patrole_admin/tempest-report.html Change-Id: Id4477c52b71147f47c590369a9030dd997c69da6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c21b9453d34bac7be124b4133fb8a1501e92770b)
2021-11-25Reduce Patrole test case listsCédric Ollivier1-0/+33
They seem related to Patrole obsolescence patrole_tempest_plugin.rbac_exceptions.RbacParsingException: Attempted to test an invalid policy file or action Details: Policy action "volume_extension:types_manage" not found in policy files: [] or among registered policy in code defaults for cinder service. Change-Id: I2e0bfeb150c8835b47bddac7130021963850397a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c7a5cf97160a6b980249da846cd8c40430d42073)
2021-11-25Increate test_count in tempest_slow_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/6ULJF575WVG6/functest-opnfv-functest-smoke-cntt-xena-tempest_scenario_cntt-run-3/tempest_scenario_cntt/tempest-report.html Change-Id: I88446714338e46188f61bcac8967196c421f0edd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 70b49c093c683170f38b6ef822053d82bc5f9486)
2021-11-25Increate test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/4PVT7P9NXUD4/functest-opnfv-functest-smoke-cntt-xena-tempest_full_cntt-run-3/tempest_full_cntt/tempest-report.html Change-Id: I1e25aa3ca73c52cf30d69bf6e3932b3505175ea2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 00c6cecbb618183aaebfef85ca3fe83c9c291062)
2021-11-22Skip new image import related tests in CNTTCédric Ollivier1-0/+2
This feature is optional in CNTT. Change-Id: Iaf2cd7bf8cbba7d4b1f69d51cd41c37842d7bbcd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2ec8656ca144af77462faaa80bc990255faf6488)
2021-11-22Take hostname_fqdn_sanitization into accountCédric Ollivier3-0/+3
It's skipped in CNTT as it's not enabled yet. Change-Id: Iac3976f4a5fbc2a1e32934bcb4c49877c5753ed4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f3bfdf806216930da4da656684f8955503ba3538)
2021-11-15Update linters and fix all new issuesCédric Ollivier33-336/+329
It mostly add encoding in open calls and leverage f-strings. Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4fdbdd34fb5fea55571a18b2438ececa953928ff)
2021-10-15Update RefStack test case descriptionsCédric Ollivier1-6/+0
RefStack now allows skip tests. Change-Id: I32f57388be81e3ace326c76320a33ca16c01bdba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-10-12Update tempest plugin test countsCédric Ollivier1-1/+4
http://artifacts.opnfv.org/functest/0V6VK1CX6MXV/functest-opnfv-functest-smoke-cntt-xena-tempest_neutron_cntt-run-1/tempest_neutron_cntt/tempest-report.html http://artifacts.opnfv.org/functest/39VVHMHL4G7J/functest-opnfv-functest-smoke-cntt-xena-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html Change-Id: I62c76e4d34f4bf840f0e6e0b4b201b16f3ab4d8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-10-11Prepare all Functest stable/xena containersCédric Ollivier3-7/+9
Change-Id: Ic843ba12132bf25ad7c339bd483f0a211ac2d003 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Switch to provider_vlans publicCédric Ollivier1-1/+1
It follows the new OpenStack gate configs. Change-Id: I74ae08bf857f092012abab59e108128fc54ddea4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Update to Alpine 3.14Cédric Ollivier28-252/+220
It also fixes lots of new pylint warnings. Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Cinder rbac testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ic497f405fd60edeb9a19180de8002ebeee81d3cb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Glance testing in CNTTCédric Ollivier1-1/+5
They ask for features not mandatory in CNTT Change-Id: I8c1017d2ca76cde90dc8dc66b51d42511bd54ce2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-21Skip new Keystone RBAC testing in CNTTCédric Ollivier1-0/+1
Change-Id: Ieb0b1992658cc559447e0d5777683c3cac66a766 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c2d68b7235efca6743350b362daf63cc9960775b)
2021-05-21Skip test_get_network_ip_availabilitiesCédric Ollivier1-0/+3
http://artifacts.opnfv.org/functest/T5HYYAOA3L02/functest-opnfv-functest-smoke-wallaby-patrole_admin-run-7/patrole_admin/tempest-report.html http://artifacts.opnfv.org/functest/H3A87GU7QKXC/functest-opnfv-functest-smoke-latest-patrole_reader-run-153/patrole_reader/tempest-report.html Change-Id: I7b2aabdec4bed6928e0672d73627f6ea67f811df Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-19Update test case countsCédric Ollivier1-2/+2
Change-Id: I5a10da026a98218496de36beb0a92d668514e336 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-19Configure dashboard.dashboard_url if tempest_slowCédric Ollivier2-16/+15
Tempest Horizon is now also executed in tempest_slow. Change-Id: I910adc68eeb067d089b705feb794911afd1747e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-18Fix mkfs.ext4 path if Cirros 0.5Cédric Ollivier1-1/+1
Change-Id: I22300ceba2c5ab19fe9912a68d2163f32193c976 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-17Detect OpenStack ussuriCédric Ollivier2-1/+19
Change-Id: I645913aba06fc87a89fbb5a1a7c090777ca1be7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-05-17Update test case counts in CNTTCédric Ollivier1-2/+3
Change-Id: I8cab1ced6babcc8969d4500784d1fa10dc8f8b6e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e0af292db068072a1b08879e32fd871237009fcf)
2021-05-17Update scenario img_file in tempest.confCédric Ollivier2-4/+3
It's now an absolute filename [1]. It also updates the cirros version. [1] https://github.com/openstack/barbican-tempest-plugin/commit/3f35bff1e19e9ff20bec6d5bbebcd5bb2b10fb49 Change-Id: I6c88b2a6347094466359304d99a2e8195f7ae049 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c068c042c8a9c02a7ba9c30257e897dab7705b2d)
2021-04-20Refactor test_run_verifier_tests_defaultCédric Ollivier1-13/+10
https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/4e3262ab-3adf-4539-839c-eddd49bcc2c1/jobs/809 Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-11tempest_horizon has been merged into openstack/tempestCédric Ollivier1-1/+1
https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035 Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Update tempest_neutron test_count to 529Cédric Ollivier1-1/+1
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Set NEW_USER ROLE in tempest_heat classic userCédric Ollivier1-0/+3
Else it fails when member is not the default role. Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Remove all network data in Rally full tasksCédric Ollivier1-24/+0
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Update Rally sanity tasks and blacklists for L2 onlyCédric Ollivier2-9/+2
This issues were hidden by Airship limitation (live-migration fails) Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier1-0/+2
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Skip test_minbw_allocation_placement added to tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Rather use rconfig.has_option() insteadCédric Ollivier1-1/+1
It slightly increases py2 and py3 to ease next backports. Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip create_and_update_routers if NO_TENANT_NETWORKCédric Ollivier1-0/+1
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip Restack compute and platform if NO_TENANT_NETWORKCédric Ollivier1-0/+4
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Concat both dynamic and static roles in tempest.confCédric Ollivier1-13/+28
It also moves all auth logic in a specific method. Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Remove test_reset_network from Patrole test casesCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Update NovaServers.boot_server_associate_and_dissociate_floating_ipCédric Ollivier2-6/+3
It conforms with "Fix nova scenarios for assiciating fips" [1] http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html [1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460 Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Stop setting floating_ips in tempest_conf.yamlCédric Ollivier3-2/+1
It's now handled by tempest.py Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Remove list_routers call if no tenant networkCédric Ollivier1-0/+1
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Update Shaker image as proposed in download.shCédric Ollivier1-1/+1
Change-Id: I408a462274245e927b382e008ba146603d82b2e2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier1-0/+1
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-28Stop duplicating connect_methodCédric Ollivier2-2/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>