aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-02-10Force ansible-lint===4.2.0Cédric Ollivier1-0/+1
Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4ddf4381275c2fd040dad08ea233b126b8acb19b)
2020-12-10Use pip==20.2.4 in tox venvCédric Ollivier3-3/+4
pip 20.3 is disruptive and would lead to big changes in stable branches. Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 622f1921e9d3850b4d190fe8c8508c196fcf450b)
2020-12-10Set NEW_USER ROLE in tempest_heat classic userCédric Ollivier1-0/+3
Else it fails when member is not the default role. Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8d5ddfc2405ec2c454869708e4c020d4e361dd69)
2020-12-09Update Rally sanity tasks and blacklists for L2 onlyCédric Ollivier2-9/+2
This issues were hidden by Airship limitation (live-migration fails) Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ab616724dabf3fb55205b269916a915821111c55)
2020-12-09Remove all network data in Rally full tasksCédric Ollivier1-24/+0
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 23e6bacad91047d1e9db676eab55a276b7c062ad)
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier2-0/+4
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 80f380502edf592015df1adf542b6a143da98e7d)
2020-12-09Don't filter vs NO_TENANT_NETWORK in CNTT testcasesCédric Ollivier1-4/+0
This param is incorrect from a CNTT point of view. It only filters test cases in classical IaaS verification containers. Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d96dde8a04a7787a44a9b4fd5d447f6ffb6acb2b)
2020-12-08Rather use rconfig.has_option() insteadCédric Ollivier1-1/+1
It slightly increases py2 and py3 to ease next backports. Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 859359c0a4b2afce87beb8ad34fb72c1e3241d4b)
2020-12-08Skip create_and_update_routers if NO_TENANT_NETWORKCédric Ollivier1-0/+1
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2d782c0e7238308e8c2503e00b8e6e299e210855)
2020-12-08Skip Restack compute and platform if NO_TENANT_NETWORKCédric Ollivier2-0/+8
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8351a852c23fd68b04b037ff4d53980a85e896ab)
2020-12-08Concat both dynamic and static roles in tempest.confCédric Ollivier1-13/+28
It also moves all auth logic in a specific method. Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8852b2d0128ddde3e45cacf6163000745b00b175)
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cdc613aba932c61c7c3250f12a8c7fd76db4b70e)
2020-12-04Stop setting floating_ips in tempest_conf.yamlCédric Ollivier4-3/+1
It's now handled by tempest.py Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 47e7b7c59998dfaa76ac8e4c48b47a75538ac90a)
2020-11-29Clean obsolete OPNFV contraints.Cédric Ollivier1-11/+1
Most of the projects are closed or at best no longer integrated in Functest features. Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1c6c02c8287789d9cd70596628953840014d8d3f)
2020-11-28Stop duplicating connect_methodCédric Ollivier3-3/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 02297608ff5450df9f4efe936c0fc3140be14dfc)
2020-11-27Replace git.openstack.org by opendev.orgCédric Ollivier1-7/+7
https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a8c884cef8b760183ad08f6034ecdc4ef1fdd4ac)
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3ab6d5693cb303fb73049287e772713a99f84be7)
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier3-6/+6
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0cac210e048bae9b33180a799af041def5bfb05)
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e28706a10c20bcb359f7d2283802ea9b4ef4bc66)
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier3-1/+18
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 09be8310be708661f2782e6af1d1d84ac0a52946)
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d88bd86e9e5b00f0c5bbbe9df0cb6f3002cb06b0)
2020-11-24Remove rtd-requirements.txtCédric Ollivier1-2/+0
It's now useless (snaps was removed). Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9927d482b35c20fe4d5d227b05f49febf42d6ead)
2020-11-23Remove snaps from rtd requirementsCédric Ollivier1-1/+0
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 47b5749a1356251f7808e558cd77cfca4d89f6e1)
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bbad4b86cfcbe87b4dc5a3c57cb9f0a747a92f1c)
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier1-1/+8
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5b96694ec402cede3e0ce3b57fa7e7cff281f179)
2020-11-15Fix branch when calling download_images.shCédric Ollivier1-1/+1
Change-Id: Idc5e7580194c63b50897d0b58d3a10df90eaede3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier6-9/+27
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d99e61f9eb1c4a582b71eb304259ddd3fdeb748f)
2020-11-03Update tempest_custom in userguideCédric Ollivier1-26/+14
It was mostly only used by OVP (Functest leverages regexes). It's now up-to-date about stevedore. Functest users are free to overwrite any refstack list (e.g. /home/opnfv/functest/data/refstack/platform.txt) if they want the same behavior [1]. [1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com> Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5d3e55c9eec208276121b0c4929de568244a7330)
2020-10-05Swith to active abot_charm repoCédric Ollivier1-1/+1
We keep syncing both repos but it helps quickly integrating patches. Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit caf48eebae6c3ffadf1589c5f34d4a272fb09b92)
2020-10-04Modify smoke and benchmarking in Docker FromCédric Ollivier1-0/+15
Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e59aaac6625fcc78de636c90d0738aaf899f2757)
2020-09-16Add helm_vims in release notes and console outputsCédric Ollivier3-5/+8
Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3c18972e21ddd4662d35f36c421ec771997a8442)
2020-09-13Update kube_bench split in docCédric Ollivier3-13/+16
Change-Id: Id4d934f0330bd3338498435a884e33df12850c64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2e291f74dab972b963ec6040521648c793dabdee)
2020-09-09Fi docker tags in site.cntt.yamlCédric Ollivier1-0/+3
Change-Id: Ie6a017e203d9a552c62987578cca41f96ed76843 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Functest Kubernetes outputsCédric Ollivier3-12/+18
Change-Id: I314e232838204f1fb1595cf884957cdf77969615 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b2c8d05d03d42e75407fa06472ddd29f2f649677)
2020-09-06Remove build date which fails spellcheckCédric Ollivier1-2/+0
https://travis-ci.org/github/collivier/functest/jobs/724612517 Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5ba58f6d5f3dc2ef370504e02252a4a2f4d30f17)
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier10-15/+3
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6d1302779501918acdbbd4047a67a010901814b1)
2020-08-23Update K8s test case results in docCédric Ollivier4-14/+102
Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5b1a05cdea1d7e0a3c9e6bd8f81473f4be845b39)
2020-08-17Delete vgpu testcaseCédric Ollivier6-79/+0
It's not longer executed and offered in any Functest container. Change-Id: I9805eca1e0d7203fecc396398469bccc38458888 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3a15322d7398db08341943291e45aba611c59e87)
2020-08-17Boot a VM to run jujuCédric Ollivier8-218/+196
It allows running juju_epc vs arm32 and arm64. It stops offering juju in functest-vnf and rather installs it in a VM. It also adds a couple of missing output decode() Change-Id: I2218742b2824c8328823051bde32422e56784e90 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c4db06b2254e075af242965bec70a9b4c0c0ba38)
2020-08-05Update docs linksCédric Ollivier3-19/+2
It takes into account Bitergia EOL. Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 41d8a752c2c1d2dc2d6c7f9e465891ae725195ed)
2020-08-01Conform with git format-patch for last tempest patchCédric Ollivier2-3/+3
The patch name must conform with the last commit update. Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e73bd90009e11f9aa5f92aefa435b85b7022db0f)
2020-08-01Revert ssh_timeout to 196 in FunctestCédric Ollivier3-3/+3
The race condition has been fixed [1] and we can try the timeout used in OpenStack gates. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606 Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b9dab9d9dcff803b71ce42ad26578f14ed448cb3)
2020-08-01Increase check_console_loop to 12Cédric Ollivier1-0/+2
It failed once when deeply testing in parallel [1]. https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 74ef88c1884bb0283236eeba82da834402928a40)
2020-07-29Apply new Create-new-server-test_reboot_server_hard.patchCédric Ollivier1-47/+63
test_reboot_server_hard sometimes fail in all gates [1]. This hack could highlight if they are side effects between test_create_backup and test_reboot_server_hard. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-26Print data to debug ServerActionsTestJSON.test_reboot_server_hardCédric Ollivier1-5/+7
Change-Id: Ib3142be2d6f04315c51831d06e35cc086223603e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3b7905fb1bba8b641bb3028154dc3d90e7b0d12d)
2020-07-25Create new server test_reboot_server_hardCédric Ollivier2-1/+70
It sometimes fail in all gates [1] This hack could highlight if it's a timeout issue or race conditions between all tempest tests. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I8d03aa10c3d822dacb983e5ca019f79e1c582c9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c29cdcb448cf0d61f4c48acb939d5a943c138a48)
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier3-3/+3
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7c999385a25e77fa0603a962b0fbc9824e5139ae)
2020-07-16Add tempest_cyborg in Functest ansible roleCédric Ollivier1-0/+1
Change-Id: I58ae820e10af29be757616fb5faf716453169e25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 216d8ff98081cb3e39c98f379dbe9a2dcc534ef6)
2020-07-16Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier4-2/+45
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 53c6cfb16b64298af498819ddbbe5d6a8bd7d3de)
2020-07-15Update microversions (Train) in CNTT testingCédric Ollivier1-3/+3
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Id9ee50133a3529e4c905b60f993762205178fe7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 60c2629983b21450cf430f47c538948472759ccb)