aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2020-12-09Remove all network data in Rally full tasksCédric Ollivier1-24/+0
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Update Rally sanity tasks and blacklists for L2 onlyCédric Ollivier2-9/+2
This issues were hidden by Airship limitation (live-migration fails) Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier1-0/+2
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Skip test_minbw_allocation_placement added to tempest_scenario_cnttCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Rather use rconfig.has_option() insteadCédric Ollivier1-1/+1
It slightly increases py2 and py3 to ease next backports. Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip create_and_update_routers if NO_TENANT_NETWORKCédric Ollivier1-0/+1
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip Restack compute and platform if NO_TENANT_NETWORKCédric Ollivier1-0/+4
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Concat both dynamic and static roles in tempest.confCédric Ollivier1-13/+28
It also moves all auth logic in a specific method. Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Remove test_reset_network from Patrole test casesCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Update NovaServers.boot_server_associate_and_dissociate_floating_ipCédric Ollivier2-6/+3
It conforms with "Fix nova scenarios for assiciating fips" [1] http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html [1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460 Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Stop setting floating_ips in tempest_conf.yamlCédric Ollivier3-2/+1
It's now handled by tempest.py Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Remove list_routers call if no tenant networkCédric Ollivier1-0/+1
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Update Shaker image as proposed in download.shCédric Ollivier1-1/+1
Change-Id: I408a462274245e927b382e008ba146603d82b2e2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier1-0/+1
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-28Stop duplicating connect_methodCédric Ollivier2-2/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier1-2/+2
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier2-2/+9
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Slightly update tempest_confCédric Ollivier2-2/+8
It completes "Update CNTT regex according to latest tempest changes" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464 Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier1-2/+17
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Disable refstack platform and computeCédric Ollivier1-0/+2
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1] "Metadata is read-only on non-Xen-based deployments." [1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier2-1/+9
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier5-9/+23
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Enable back Patrole volume testingCédric Ollivier1-3/+9
It skips test_create_network_provider_segmentation_id as it can run in parallel (200 is hardcoded) and test_create_image_from_volume_backed_server which doesn't clean its resources. Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip patrole volume testingCédric Ollivier1-3/+3
They don't clean volume and snapshot which raises side effects after lots of iterations. They may be obsolete too [1] [1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier1-3/+7
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier3-8/+2
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Skip obsolete Patrole testsCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Fix functest/ci/testcases.yamlCédric Ollivier1-0/+5
Even if it's unused, it's keep synced by docker files. Change-Id: Ia98164c361017392542073745c37b441ec2216d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Delete vgpu testcaseCédric Ollivier2-53/+0
It's not longer executed and offered in any Functest container. Change-Id: I9805eca1e0d7203fecc396398469bccc38458888 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Boot a VM to run jujuCédric Ollivier6-186/+190
It allows running juju_epc vs arm32 and arm64. It stops offering juju in functest-vnf and rather installs it in a VM. It also adds a couple of missing output decode() Change-Id: I2218742b2824c8328823051bde32422e56784e90 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Revert ssh_timeout to 196 in FunctestCédric Ollivier2-2/+2
The race condition has been fixed [1] and we can try the timeout used in OpenStack gates. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606 Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Increase check_console_loop to 12Cédric Ollivier1-0/+2
It failed once when deeply testing in parallel [1]. https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-27Add nics net-id when booting dd load testCédric Ollivier1-0/+2
http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-24Rename ext_network to floating_network in Rally tasksCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Increate neutron_tempest count to 517Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Add VMTasks.dd_load_test in Rally test casesCédric Ollivier3-1/+25
It allows running dd in VM (simple disk benchmarking). https://github.com/cntt-n/CNTT/issues/1477 Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Rename ext_network to floating_network in Rally tasksCédric Ollivier2-2/+2
It now fails [1]: Traceback (most recent call last): File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run floatingip = self.neutron.create_floatingip(**create_floating_ip_args) File "/src/rally/rally/task/service.py", line 114, in wrapper return func(instance, *args, **kwargs) File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) TypeError: create_floatingip() got an unexpected keyword argument 'ext_network' [1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Add Patrole compute testingCédric Ollivier1-3/+3
It stops leveraging on policy json files as it fails for Nova. Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Skip Patrole test_show_auto_allocated_topologyCédric Ollivier1-0/+3
test_show_auto_allocated_topology doesn't clean its resources: - network: auto_allocated_network - subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6 - router: auto_allocated_router This bug easily breaks testing in a quick run when allocating the subnet due to insufficient prefix space to allocate subnet size /26. https://build.opnfv.org/ci/job/functest-latest-daily/746/ Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier2-2/+2
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier1-0/+17
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Update Cirros to O.5.1Cédric Ollivier7-123/+123
It conforms to the OpenStack gates which have just updated to Cirros 0.5.1 Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>