aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier3-6/+6
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0cac210e048bae9b33180a799af041def5bfb05)
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e28706a10c20bcb359f7d2283802ea9b4ef4bc66)
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier3-2/+17
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 09be8310be708661f2782e6af1d1d84ac0a52946)
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d88bd86e9e5b00f0c5bbbe9df0cb6f3002cb06b0)
2020-11-24Remove rtd-requirements.txtCédric Ollivier1-2/+0
It's now useless (snaps was removed). Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9927d482b35c20fe4d5d227b05f49febf42d6ead)
2020-11-23Remove snaps from rtd requirementsCédric Ollivier1-1/+0
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 47b5749a1356251f7808e558cd77cfca4d89f6e1)
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bbad4b86cfcbe87b4dc5a3c57cb9f0a747a92f1c)
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier2-1/+9
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5b96694ec402cede3e0ce3b57fa7e7cff281f179)
2020-11-15Fix branch when calling download_images.shCédric Ollivier1-1/+1
Change-Id: Id73f5daab2e4c410e1cc0cfdb0d75b090d6b1c0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier6-9/+27
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d99e61f9eb1c4a582b71eb304259ddd3fdeb748f)
2020-11-12Add timeout as needed by Gitlab CI/CDCédric Ollivier3-0/+9
Gitlab CI/CD sets 1h as default timeout. The timeout is valid for all test cases in tiers (current XtestingCI design). Change-Id: I1ffae060ee8fd26426a9ee9a2ad2cd131ff9abe9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 19ccc35303f0626a9d62dbbf2be9d8afe3152ea0)
2020-11-09Run vnfs in parallelCédric Ollivier1-2/+0
Jenkins slaves must be limited to 2 (default setup) if needed. Change-Id: Ic05552085988efda0ff4a283ff84942e263750ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 03df88bbbb0481ab054343b7304df14037934c66)
2020-11-09Split Gates in a dedicated site.ymlCédric Ollivier2-27/+85
Change-Id: I4bcd2c62923288301713b710ac738c81a83375b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-03Update tempest_custom in userguideCédric Ollivier1-26/+14
It was mostly only used by OVP (Functest leverages regexes). It's now up-to-date about stevedore. Functest users are free to overwrite any refstack list (e.g. /home/opnfv/functest/data/refstack/platform.txt) if they want the same behavior [1]. [1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com> Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5d3e55c9eec208276121b0c4929de568244a7330)
2020-10-10Update all results in docsCédric Ollivier4-128/+136
It also updates the release notes. Change-Id: I7413c45c7bf5a85070970f159fb770284e772a6c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-10Swith to active abot_charm repoCédric Ollivier1-1/+1
We keep syncing both repos but it helps quickly integrating patches. Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit caf48eebae6c3ffadf1589c5f34d4a272fb09b92)
2020-10-06Update upper-constraintsCédric Ollivier2-2/+2
It takes the new requirements just published into account. Change-Id: I27619b9deb68d72c9727df669ec413cd383a8c3d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-06Include key tempest 25.0 fixCédric Ollivier1-1/+1
https://review.opendev.org/#/c/750360/ http://artifacts.opnfv.org/functest/ICQE70OHFZHY/functest-opnfv-functest-smoke-leguer-patrole_admin-run-1/patrole_admin/tempest-report.html Change-Id: I881a86c72132e18d5d1a753ece6550cd1d978bf6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-06Add Victoria in OpenStack release detectionCédric Ollivier3-7/+7
Change-Id: I0e2b02f6ce5b315da090a5a04ae1c0e40ec114aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-04Modify smoke and benchmarking in Docker FromCédric Ollivier1-6/+12
Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e59aaac6625fcc78de636c90d0738aaf899f2757)
2020-10-04Set Rally and Tempest plugin versionsCédric Ollivier5-22/+22
Change-Id: I26016de521694971327d85919ae2f5b0498f9192 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-04Prepare Functest Leguer containersCédric Ollivier10-38/+50
Change-Id: I23363d11cdbe565dfa19e9246afd372756041381 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-04Set default branch in .gitreviewCédric Ollivier1-1/+1
Change-Id: I4ce3d804e26a76c489a3a9df74c48c326356426f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Enable back Patrole volume testingCédric Ollivier2-6/+18
It skips test_create_network_provider_segmentation_id as it can run in parallel (200 is hardcoded) and test_create_image_from_volume_backed_server which doesn't clean its resources. Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Add helm_vims in release notes and console outputsCédric Ollivier3-5/+8
Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-13Update kube_bench split in docCédric Ollivier3-13/+16
Change-Id: Id4d934f0330bd3338498435a884e33df12850c64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip patrole volume testingCédric Ollivier2-6/+6
They don't clean volume and snapshot which raises side effects after lots of iterations. They may be obsolete too [1] [1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier3-6/+14
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Functest Kubernetes outputsCédric Ollivier3-12/+18
Change-Id: I314e232838204f1fb1595cf884957cdf77969615 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Remove build date which fails spellcheckCédric Ollivier1-2/+0
https://travis-ci.org/github/collivier/functest/jobs/724612517 Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier10-15/+3
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Skip obsolete Patrole testsCédric Ollivier2-0/+6
Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Fix functest/ci/testcases.yamlCédric Ollivier1-0/+5
Even if it's unused, it's keep synced by docker files. Change-Id: Ia98164c361017392542073745c37b441ec2216d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Update tempest_full_cntt regexesCédric Ollivier1-1/+5
http://artifacts.opnfv.org/functest/VX7Y4UA8F07W/functest-pi-ollivier-functest-smoke-cntt-latest-tempest_full_cntt-run-2/tempest_full_cntt/tempest-report.html https://review.opendev.org/#/c/737634/ Change-Id: I31ea1f30c06cf9cc8c44933a4f1db954db037c53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-23Update K8s test case results in docCédric Ollivier4-7/+94
Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Delete vgpu testcaseCédric Ollivier6-79/+0
It's not longer executed and offered in any Functest container. Change-Id: I9805eca1e0d7203fecc396398469bccc38458888 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Use lower bound for py3-distlib versionCédric Ollivier1-1/+1
Change-Id: I3a97b0cb5fb9c75e7e675370c656325d4c536e8b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-17Boot a VM to run jujuCédric Ollivier8-218/+196
It allows running juju_epc vs arm32 and arm64. It stops offering juju in functest-vnf and rather installs it in a VM. It also adds a couple of missing output decode() Change-Id: I2218742b2824c8328823051bde32422e56784e90 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Merge "Only upgrade py3-distlib"Cedric Ollivier1-1/+1
2020-08-06Only upgrade py3-distlibCédric Ollivier1-1/+1
https://travis-ci.org/github/collivier/functest/jobs/715442363 Change-Id: Ie34cae67df56b23581e90488c5fa70757efc4b61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Merge "Use alpine edge for py3-distlib only"Cedric Ollivier3-8/+9
2020-08-06Use alpine edge for py3-distlib onlyCédric Ollivier3-8/+9
Alpine 3.12 doesn't offer a version compatible with latest OpenStack constraints. It may fix all issues when compiling Functest for arm [1]. [1] https://travis-ci.org/github/collivier/functest/jobs/715229717 Change-Id: I7f55cafff2c7a34909440c5ca1d1f641194761c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-06Updated from global requirementsCédric Ollivier3-13/+3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ibcac0888c7b62d6f59cea7dea021cf64610d38c1
2020-08-05Update docs linksCédric Ollivier3-19/+2
It takes into account Bitergia EOL. Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-02Reduce ImportImagesTest regexCédric Ollivier1-1/+1
It fits last change in ImportImagesTest [1]. [1] http://artifacts.opnfv.org/functest/7WDODZD71WX9/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-159/tempest_full_cntt/tempest-report.html Change-Id: Ic4e3ca5d0c83696be75b97edb09c4d9a2be7ab30 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Conform with git format-patch for last tempest patchCédric Ollivier2-3/+3
The patch name must conform with the last commit update. Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Revert ssh_timeout to 196 in FunctestCédric Ollivier3-3/+3
The race condition has been fixed [1] and we can try the timeout used in OpenStack gates. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606 Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Increase check_console_loop to 12Cédric Ollivier1-0/+2
It failed once when deeply testing in parallel [1]. https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-30Update tempest_cinder_cntt test_counts to 11Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/81YZ7LMI0PUW/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-149/tempest_cinder_cntt/tempest-report.html Change-Id: Ibe7c5ce70262c6fb604bab05038fbd6c408d23f5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>