aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2020-11-28Stop duplicating connect_methodCédric Ollivier2-2/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier1-2/+2
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier2-2/+9
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Slightly update tempest_confCédric Ollivier2-2/+8
It completes "Update CNTT regex according to latest tempest changes" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464 Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier1-2/+17
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Disable refstack platform and computeCédric Ollivier1-0/+2
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1] "Metadata is read-only on non-Xen-based deployments." [1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier2-1/+9
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier5-9/+23
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Enable back Patrole volume testingCédric Ollivier1-3/+9
It skips test_create_network_provider_segmentation_id as it can run in parallel (200 is hardcoded) and test_create_image_from_volume_backed_server which doesn't clean its resources. Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip patrole volume testingCédric Ollivier1-3/+3
They don't clean volume and snapshot which raises side effects after lots of iterations. They may be obsolete too [1] [1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier1-3/+7
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier3-8/+2
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Skip obsolete Patrole testsCédric Ollivier1-0/+3
Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Fix functest/ci/testcases.yamlCédric Ollivier1-0/+5
Even if it's unused, it's keep synced by docker files. Change-Id: Ia98164c361017392542073745c37b441ec2216d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Delete vgpu testcaseCédric Ollivier2-53/+0
It's not longer executed and offered in any Functest container. Change-Id: I9805eca1e0d7203fecc396398469bccc38458888 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Boot a VM to run jujuCédric Ollivier6-186/+190
It allows running juju_epc vs arm32 and arm64. It stops offering juju in functest-vnf and rather installs it in a VM. It also adds a couple of missing output decode() Change-Id: I2218742b2824c8328823051bde32422e56784e90 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Revert ssh_timeout to 196 in FunctestCédric Ollivier2-2/+2
The race condition has been fixed [1] and we can try the timeout used in OpenStack gates. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606 Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Increase check_console_loop to 12Cédric Ollivier1-0/+2
It failed once when deeply testing in parallel [1]. https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-27Add nics net-id when booting dd load testCédric Ollivier1-0/+2
http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-24Rename ext_network to floating_network in Rally tasksCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Increate neutron_tempest count to 517Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Add VMTasks.dd_load_test in Rally test casesCédric Ollivier3-1/+25
It allows running dd in VM (simple disk benchmarking). https://github.com/cntt-n/CNTT/issues/1477 Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Rename ext_network to floating_network in Rally tasksCédric Ollivier2-2/+2
It now fails [1]: Traceback (most recent call last): File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run floatingip = self.neutron.create_floatingip(**create_floating_ip_args) File "/src/rally/rally/task/service.py", line 114, in wrapper return func(instance, *args, **kwargs) File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) TypeError: create_floatingip() got an unexpected keyword argument 'ext_network' [1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Add Patrole compute testingCédric Ollivier1-3/+3
It stops leveraging on policy json files as it fails for Nova. Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Skip Patrole test_show_auto_allocated_topologyCédric Ollivier1-0/+3
test_show_auto_allocated_topology doesn't clean its resources: - network: auto_allocated_network - subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6 - router: auto_allocated_router This bug easily breaks testing in a quick run when allocating the subnet due to insufficient prefix space to allocate subnet size /26. https://build.opnfv.org/ci/job/functest-latest-daily/746/ Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier2-2/+2
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier1-0/+17
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Update Cirros to O.5.1Cédric Ollivier7-123/+123
It conforms to the OpenStack gates which have just updated to Cirros 0.5.1 Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back manage_snapshot testing in CNTTCédric Ollivier1-2/+1
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back RemoteStack testing from tempest_heat_cnttCédric Ollivier1-1/+2
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Update Patrole tempest list if OVNCédric Ollivier1-0/+4
Change-Id: I66811c31fac4a83ed9634e928b9af8fa6e633034 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-06Update tempest blacklist if OVNCédric Ollivier1-5/+0
It takes into account last Patrole changes. Change-Id: I552442864297b51a1cd7885b357b139b664e536a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-05Reduce Patrole extra logicCédric Ollivier4-53/+28
It also reduces the skipped test list taking into account Patrole improvements. Change-Id: I23a8c0610a8a4258aa806451f52796f3e7bc46ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Patrole user -> memberCédric Ollivier1-2/+2
Change-Id: I050caff2d255118edff48403a87305cfe336e20a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Fix tempest_scenarioCédric Ollivier1-1/+1
It completes "min_computes_nodes is also used as max values". Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03min_computes_nodes is also used as max valuesCédric Ollivier1-15/+2
Its max value is now 10 according to the default quota. Change-Id: Ie7bfcb224e821c15d38d0cba1d9f080548613e79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Add patrole user and reader testingCédric Ollivier2-2/+52
The regexes will be updated in a second change (chicken and egg between Functest and Releng) Change-Id: I4273a80799730fe30c941a7b2966cfee46f24d4a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-29Simplify hypervisor list logic in vmtpCédric Ollivier1-5/+4
It completes the previous change "Allow listing hypervisors in VMTP" [1]. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70359 Change-Id: I12a19fd473076cfc3262f096cac1615c183710b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-18Allow listing hypervisors in VMTPCédric Ollivier2-2/+11
It allows listing the compute under tests via VMTP_HYPERVISORS. They are no additional log in Functest and the note in VMTP is still valid [1]. [1] https://opendev.org/x/vmtp/src/branch/master/vmtp/vmtp.py#L833 Change-Id: Ic9fbda3901d796c0ed94e42e2a14c468598f4311 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Increase timeout in shaker and vmtpCédric Ollivier2-0/+3
Running them in parallel of rally full and jobs asks for a increase. Change-Id: Ib2369d384ac839fb46031411e1985ac402da0c1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Stop leveraging on neutron plugins and extraCédric Ollivier1-20/+0
Neutron leverages on the upstream Rally task in Stein and newer. Leveraging on the upstream task may fix the side effects which sometimes occured on Vmtp and Shaker [1] and filled better the CNTT model. [1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/ Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Skip EncryptionVolTypeTest in Iaas verification and CNTT ConformanceCédric Ollivier2-0/+2
Attaching an encryted volume is optional in CNTT [1]. This test fails if the volume type already exists and if it runs twice in parallel [2]. As this single test doesn't fullfil the Functest requirements, it's skiped in the classical verification as well. [1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md [2] https://storyboard.openstack.org/#!/story/2007804 Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Add missing tempest_octavia in patchesCédric Ollivier1-0/+9
Change-Id: I0fae7487955895bf8f41046043425849f8fd0bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Update all patches proposed by FunctestCédric Ollivier2-73/+245
It mostly takes into account the last changes in test case names and new cntt-related test cases. Change-Id: I271fd02095b57f3b19b5ff95299fb4b257163c1f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>