aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier2-0/+4
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f380502edf592015df1adf542b6a143da98e7d)
2020-12-08Rather use rconfig.has_option() insteadCédric Ollivier1-1/+1
It slightly increases py2 and py3 to ease next backports. Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 859359c0a4b2afce87beb8ad34fb72c1e3241d4b)
2020-12-08Skip create_and_update_routers if NO_TENANT_NETWORKCédric Ollivier1-0/+1
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2d782c0e7238308e8c2503e00b8e6e299e210855)
2020-12-08Skip Restack compute and platform if NO_TENANT_NETWORKCédric Ollivier2-0/+8
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8351a852c23fd68b04b037ff4d53980a85e896ab)
2020-12-08Concat both dynamic and static roles in tempest.confCédric Ollivier1-13/+28
It also moves all auth logic in a specific method. Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8852b2d0128ddde3e45cacf6163000745b00b175)
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cdc613aba932c61c7c3250f12a8c7fd76db4b70e)
2020-12-04Stop setting floating_ips in tempest_conf.yamlCédric Ollivier4-3/+1
It's now handled by tempest.py Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 47e7b7c59998dfaa76ac8e4c48b47a75538ac90a)
2020-12-02Remove list_routers call if no tenant networkCédric Ollivier1-0/+1
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dec0d59da6b90afc2e0f385f3573479d6843bb99)
2020-11-29Clean obsolete OPNFV contraints.Cédric Ollivier1-10/+0
Most of the projects are closed or at best no longer integrated in Functest features. Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1c6c02c8287789d9cd70596628953840014d8d3f)
2020-11-28Stop duplicating connect_methodCédric Ollivier3-3/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 02297608ff5450df9f4efe936c0fc3140be14dfc)
2020-11-27Replace git.openstack.org by opendev.orgCédric Ollivier1-6/+6
https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a8c884cef8b760183ad08f6034ecdc4ef1fdd4ac) (cherry picked from commit 8d86d75198960168772c5afa5bcda2b059567222)
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3ab6d5693cb303fb73049287e772713a99f84be7)
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier3-6/+6
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0cac210e048bae9b33180a799af041def5bfb05)
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e28706a10c20bcb359f7d2283802ea9b4ef4bc66)
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier3-1/+18
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 09be8310be708661f2782e6af1d1d84ac0a52946)
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d88bd86e9e5b00f0c5bbbe9df0cb6f3002cb06b0)
2020-11-24Remove rtd-requirements.txtCédric Ollivier1-2/+0
It's now useless (snaps was removed). Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9927d482b35c20fe4d5d227b05f49febf42d6ead)
2020-11-23Remove snaps from rtd requirementsCédric Ollivier1-1/+0
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 47b5749a1356251f7808e558cd77cfca4d89f6e1)
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bbad4b86cfcbe87b4dc5a3c57cb9f0a747a92f1c)
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier1-1/+8
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5b96694ec402cede3e0ce3b57fa7e7cff281f179)
2020-11-14Allow connecting vm to the external networkCédric Ollivier6-9/+27
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d99e61f9eb1c4a582b71eb304259ddd3fdeb748f)
2020-11-12Add timeout as needed by Gitlab CI/CDCédric Ollivier3-0/+9
Gitlab CI/CD sets 1h as default timeout. The timeout is valid for all test cases in tiers (current XtestingCI design). Change-Id: I1ffae060ee8fd26426a9ee9a2ad2cd131ff9abe9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 19ccc35303f0626a9d62dbbf2be9d8afe3152ea0)
2020-11-11Add rally and xrally_kubernetes in upper-constraints.txtCédric Ollivier7-3/+17
It's needed by functest_kubernetes. Change-Id: I2ebd730a1d9f84a63026e8cf03cf27367d0bcfde Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-09Run vnfs in parallelCédric Ollivier1-2/+0
Jenkins slaves must be limited to 2 (default setup) if needed. Change-Id: Ic05552085988efda0ff4a283ff84942e263750ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 03df88bbbb0481ab054343b7304df14037934c66)
2020-11-09Split Gates in a dedicated site.ymlCédric Ollivier2-32/+90
Change-Id: I55391e7ac051bc8f9c20da56fc92f6e714257272 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-03Update tempest_custom in userguideCédric Ollivier1-25/+13
It was mostly only used by OVP (Functest leverages regexes). It's now up-to-date about stevedore. Functest users are free to overwrite any refstack list (e.g. /home/opnfv/functest/data/refstack/platform.txt) if they want the same behavior [1]. [1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com> Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5d3e55c9eec208276121b0c4929de568244a7330)
2020-10-05Swith to active abot_charm repoCédric Ollivier1-1/+1
We keep syncing both repos but it helps quickly integrating patches. Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit caf48eebae6c3ffadf1589c5f34d4a272fb09b92)
2020-10-04Modify smoke and benchmarking in Docker FromCédric Ollivier1-0/+15
Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e50c0a670fa1dadd49ce6070bcdd2228d9478a7d)
2020-09-16Add helm_vims in release notes and console outputsCédric Ollivier3-5/+8
Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3c18972e21ddd4662d35f36c421ec771997a8442)
2020-09-13Update kube_bench split in docCédric Ollivier3-13/+16
Change-Id: Id4d934f0330bd3338498435a884e33df12850c64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2e291f74dab972b963ec6040521648c793dabdee)
2020-09-09Fi docker tags in site.cntt.yamlCédric Ollivier1-0/+3
Change-Id: Ie6a017e203d9a552c62987578cca41f96ed76843 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Functest Kubernetes outputsCédric Ollivier3-12/+18
Change-Id: I314e232838204f1fb1595cf884957cdf77969615 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b2c8d05d03d42e75407fa06472ddd29f2f649677)
2020-09-06Remove build date which fails spellcheckCédric Ollivier1-2/+0
https://travis-ci.org/github/collivier/functest/jobs/724612517 Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5ba58f6d5f3dc2ef370504e02252a4a2f4d30f17)
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier10-15/+3
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6d1302779501918acdbbd4047a67a010901814b1)
2020-08-23Update K8s test case results in docCédric Ollivier4-12/+103
Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5b1a05cdea1d7e0a3c9e6bd8f81473f4be845b39)
2020-08-17Delete vgpu testcaseCédric Ollivier6-79/+0
It's not longer executed and offered in any Functest container. Change-Id: I9805eca1e0d7203fecc396398469bccc38458888 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3a15322d7398db08341943291e45aba611c59e87)
2020-08-17Boot a VM to run jujuCédric Ollivier8-218/+196
It allows running juju_epc vs arm32 and arm64. It stops offering juju in functest-vnf and rather installs it in a VM. It also adds a couple of missing output decode() Change-Id: I2218742b2824c8328823051bde32422e56784e90 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c4db06b2254e075af242965bec70a9b4c0c0ba38)
2020-08-05Update docs linksCédric Ollivier3-19/+2
It takes into account Bitergia EOL. Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 41d8a752c2c1d2dc2d6c7f9e465891ae725195ed)
2020-08-01Conform with git format-patch for last tempest patchCédric Ollivier2-3/+3
The patch name must conform with the last commit update. Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-01Revert ssh_timeout to 196 in FunctestCédric Ollivier3-3/+3
The race condition has been fixed [1] and we can try the timeout used in OpenStack gates. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606 Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b9dab9d9dcff803b71ce42ad26578f14ed448cb3) (cherry picked from commit aa2f20598c42a4235bb85b6a8f9dc262bb791465)
2020-08-01Increase check_console_loop to 12Cédric Ollivier1-0/+2
It failed once when deeply testing in parallel [1]. https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 74ef88c1884bb0283236eeba82da834402928a40) (cherry picked from commit c6006d9fee0fadc339f63a5eeb234584866cc59f)
2020-07-30Apply new Create-new-server-test_reboot_server_hard.patchCédric Ollivier1-47/+63
test_reboot_server_hard sometimes fail in all gates [1]. This hack could highlight if they are side effects between test_create_backup and test_reboot_server_hard. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-26Print data to debug ServerActionsTestJSON.test_reboot_server_hardCédric Ollivier1-5/+7
Change-Id: I8443e800a8c4165748457fdddff645515f3bbe68 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-25Create new server test_reboot_server_hardCédric Ollivier2-1/+70
It sometimes fail in all gates [1] This hack could highlight if it's a timeout issue or race conditions between all tempest tests. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I8d03aa10c3d822dacb983e5ca019f79e1c582c9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c29cdcb448cf0d61f4c48acb939d5a943c138a48)
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier3-3/+3
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7c999385a25e77fa0603a962b0fbc9824e5139ae)
2020-07-15Update functest/ci/testcases.yamlCédric Ollivier5-10/+328
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f36cc92bb628b53ed3a58fa84a24f94f006d6f30)
2020-07-03Fix tempest_scenarioCédric Ollivier3-3/+3
It completes "min_computes_nodes is also used as max values". Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b765cf825b1a0d0853420b4a4bb7a154063f117e)
2020-07-03min_computes_nodes is also used as max valuesCédric Ollivier2-16/+2
Its max value is now 10 according to the default quota. Change-Id: Ie7bfcb224e821c15d38d0cba1d9f080548613e79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f21f139f9d24d282310d0830a053169532e75596)
2020-07-02Merge "Apply "object storage: fix and cleanup header checks"" into stable/iruyaCedric Ollivier2-2/+176
2020-07-02Select Kubernetes client 1.10Cédric Ollivier1-1/+1
It avoids side effect on rally/tempest versions as used in Iruya and Hunter. Change-Id: I5dcd3259b80b7bcd2fdf4159a70204e8f90fd4db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>