aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-10-06Update upper-constraintsCédric Ollivier2-2/+2
It takes the new requirements just published into account. Change-Id: I27619b9deb68d72c9727df669ec413cd383a8c3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-06Include key tempest 25.0 fixCédric Ollivier1-1/+1
https://review.opendev.org/#/c/750360/ http://artifacts.opnfv.org/functest/ICQE70OHFZHY/functest-opnfv-functest-smoke-leguer-patrole_admin-run-1/patrole_admin/tempest-report.html Change-Id: I881a86c72132e18d5d1a753ece6550cd1d978bf6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-06Add Victoria in OpenStack release detectionCédric Ollivier3-7/+7
Change-Id: I0e2b02f6ce5b315da090a5a04ae1c0e40ec114aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-04Modify smoke and benchmarking in Docker FromCédric Ollivier1-6/+12
Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e59aaac6625fcc78de636c90d0738aaf899f2757)
2020-10-04Set Rally and Tempest plugin versionsCédric Ollivier5-22/+22
Change-Id: I26016de521694971327d85919ae2f5b0498f9192 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-04Prepare Functest Leguer containersCédric Ollivier10-38/+50
Change-Id: I23363d11cdbe565dfa19e9246afd372756041381 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-04Set default branch in .gitreviewCédric Ollivier1-1/+1
Change-Id: I4ce3d804e26a76c489a3a9df74c48c326356426f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Enable back Patrole volume testingCédric Ollivier2-6/+18
It skips test_create_network_provider_segmentation_id as it can run in parallel (200 is hardcoded) and test_create_image_from_volume_backed_server which doesn't clean its resources. Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Add helm_vims in release notes and console outputsCédric Ollivier3-5/+8
Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-13Update kube_bench split in docCédric Ollivier3-13/+16
Change-Id: Id4d934f0330bd3338498435a884e33df12850c64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip patrole volume testingCédric Ollivier2-6/+6
They don't clean volume and snapshot which raises side effects after lots of iterations. They may be obsolete too [1] [1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier3-6/+14
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Functest Kubernetes outputsCédric Ollivier3-12/+18
Change-Id: I314e232838204f1fb1595cf884957cdf77969615 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Remove build date which fails spellcheckCédric Ollivier1-2/+0
https://travis-ci.org/github/collivier/functest/jobs/724612517 Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier10-15/+3
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Skip obsolete Patrole testsCédric Ollivier2-0/+6
Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Fix functest/ci/testcases.yamlCédric Ollivier1-0/+5
Even if it's unused, it's keep synced by docker files. Change-Id: Ia98164c361017392542073745c37b441ec2216d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Update tempest_full_cntt regexesCédric Ollivier1-1/+5
http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html https://review.opendev.org/#/c/737634/ Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-23Update K8s test case results in docCédric Ollivier4-7/+94
Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Delete vgpu testcaseCédric Ollivier6-79/+0
It's not longer executed and offered in any Functest container. Change-Id: I9805eca1e0d7203fecc396398469bccc38458888 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Use lower bound for py3-distlib versionCédric Ollivier1-1/+1
Change-Id: I3a97b0cb5fb9c75e7e675370c656325d4c536e8b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Boot a VM to run jujuCédric Ollivier8-218/+196
It allows running juju_epc vs arm32 and arm64. It stops offering juju in functest-vnf and rather installs it in a VM. It also adds a couple of missing output decode() Change-Id: I2218742b2824c8328823051bde32422e56784e90 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Merge "Only upgrade py3-distlib"Cedric Ollivier1-1/+1
2020-08-06Only upgrade py3-distlibCédric Ollivier1-1/+1
https://travis-ci.org/github/collivier/functest/jobs/715442363 Change-Id: Ie34cae67df56b23581e90488c5fa70757efc4b61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Merge "Use alpine edge for py3-distlib only"Cedric Ollivier3-8/+9
2020-08-06Use alpine edge for py3-distlib onlyCédric Ollivier3-8/+9
Alpine 3.12 doesn't offer a version compatible with latest OpenStack constraints. It may fix all issues when compiling Functest for arm [1]. [1] https://travis-ci.org/github/collivier/functest/jobs/715229717 Change-Id: I7f55cafff2c7a34909440c5ca1d1f641194761c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Updated from global requirementsCédric Ollivier3-13/+3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ibcac0888c7b62d6f59cea7dea021cf64610d38c1
2020-08-05Update docs linksCédric Ollivier3-19/+2
It takes into account Bitergia EOL. Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-02Reduce ImportImagesTest regexCédric Ollivier1-1/+1
It fits last change in ImportImagesTest [1]. [1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Conform with git format-patch for last tempest patchCédric Ollivier2-3/+3
The patch name must conform with the last commit update. Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Revert ssh_timeout to 196 in FunctestCédric Ollivier3-3/+3
The race condition has been fixed [1] and we can try the timeout used in OpenStack gates. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606 Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Increase check_console_loop to 12Cédric Ollivier1-0/+2
It failed once when deeply testing in parallel [1]. https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-30Update tempest_cinder_cntt test_counts to 11Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-30Apply new Create-new-server-test_reboot_server_hard.patchCédric Ollivier1-47/+63
test_reboot_server_hard sometimes fail in all gates [1]. This hack could highlight if they are side effects between test_create_backup and test_reboot_server_hard. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-28Skip ImportImagesTest.test_image_import in CNTTCédric Ollivier1-0/+1
ImportImagesTest skipped as image import is not available [1] [1] http://artifacts.opnfv.org/functest/S9ABQ628T5IG/functest-opnfv-functest-smoke-latest-tempest_full-run-850/tempest_full/tempest-report.html Change-Id: I1999ed96f546ac7bf2115d205382b3b7f4dfe9af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-27Add nics net-id when booting dd load testCédric Ollivier1-0/+2
http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-26Print data to debug ServerActionsTestJSON.test_reboot_server_hardCédric Ollivier1-5/+7
Change-Id: Ib3142be2d6f04315c51831d06e35cc086223603e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-25Create new server test_reboot_server_hardCédric Ollivier2-1/+76
It sometimes fail in all gates [1] This hack could highlight if it's a timeout issue or race conditions between all tempest tests. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I8d03aa10c3d822dacb983e5ca019f79e1c582c9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-24Rename ext_network to floating_network in Rally tasksCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Increate neutron_tempest count to 517Cédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/UM6QD3YXHAAC/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-104/tempest_neutron_cntt/tempest-report.html Change-Id: If7df0bcd08629ffca60fcb20eb45847199b28e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Add VMTasks.dd_load_test in Rally test casesCédric Ollivier3-1/+25
It allows running dd in VM (simple disk benchmarking). https://github.com/cntt-n/CNTT/issues/1477 Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Rename ext_network to floating_network in Rally tasksCédric Ollivier2-2/+2
It now fails [1]: Traceback (most recent call last): File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run floatingip = self.neutron.create_floatingip(**create_floating_ip_args) File "/src/rally/rally/task/service.py", line 114, in wrapper return func(instance, *args, **kwargs) File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) TypeError: create_floatingip() got an unexpected keyword argument 'ext_network' [1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Add Patrole compute testingCédric Ollivier3-22/+13
It stops leveraging on policy json files as it fails for Nova. Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Skip Patrole test_show_auto_allocated_topologyCédric Ollivier2-0/+6
test_show_auto_allocated_topology doesn't clean its resources: - network: auto_allocated_network - subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6 - router: auto_allocated_router This bug easily breaks testing in a quick run when allocating the subnet due to insufficient prefix space to allocate subnet size /26. https://build.opnfv.org/ci/job/functest-latest-daily/746/ Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use alpine edgeCédric Ollivier3-7/+7
Last upper-constraints updates force Alpine edge. https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/941/console Change-Id: If2c7d434cfa45e676e3d236a2f59f916b43b5cd1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier3-3/+3
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-16Add tempest_cyborg in Functest ansible roleCédric Ollivier1-0/+1
Change-Id: I58ae820e10af29be757616fb5faf716453169e25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier4-3/+45
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Update Cirros to O.5.1Cédric Ollivier9-127/+127
It conforms to the OpenStack gates which have just updated to Cirros 0.5.1 Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>