aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-11-23Remove snaps from rtd requirementsCédric Ollivier1-1/+0
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 47b5749a1356251f7808e558cd77cfca4d89f6e1)
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bbad4b86cfcbe87b4dc5a3c57cb9f0a747a92f1c)
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier1-1/+8
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5b96694ec402cede3e0ce3b57fa7e7cff281f179)
2020-11-15Fix branch when calling download_images.shCédric Ollivier1-1/+1
Change-Id: Idc5e7580194c63b50897d0b58d3a10df90eaede3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier6-9/+27
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d99e61f9eb1c4a582b71eb304259ddd3fdeb748f)
2020-11-03Update tempest_custom in userguideCédric Ollivier1-26/+14
It was mostly only used by OVP (Functest leverages regexes). It's now up-to-date about stevedore. Functest users are free to overwrite any refstack list (e.g. /home/opnfv/functest/data/refstack/platform.txt) if they want the same behavior [1]. [1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com> Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5d3e55c9eec208276121b0c4929de568244a7330)
2020-10-05Swith to active abot_charm repoCédric Ollivier1-1/+1
We keep syncing both repos but it helps quickly integrating patches. Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit caf48eebae6c3ffadf1589c5f34d4a272fb09b92)
2020-10-04Modify smoke and benchmarking in Docker FromCédric Ollivier1-0/+15
Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e59aaac6625fcc78de636c90d0738aaf899f2757)
2020-09-16Add helm_vims in release notes and console outputsCédric Ollivier3-5/+8
Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3c18972e21ddd4662d35f36c421ec771997a8442)
2020-09-13Update kube_bench split in docCédric Ollivier3-13/+16
Change-Id: Id4d934f0330bd3338498435a884e33df12850c64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2e291f74dab972b963ec6040521648c793dabdee)
2020-09-09Fi docker tags in site.cntt.yamlCédric Ollivier1-0/+3
Change-Id: Ie6a017e203d9a552c62987578cca41f96ed76843 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Functest Kubernetes outputsCédric Ollivier3-12/+18
Change-Id: I314e232838204f1fb1595cf884957cdf77969615 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b2c8d05d03d42e75407fa06472ddd29f2f649677)
2020-09-06Remove build date which fails spellcheckCédric Ollivier1-2/+0
https://travis-ci.org/github/collivier/functest/jobs/724612517 Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5ba58f6d5f3dc2ef370504e02252a4a2f4d30f17)
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier10-15/+3
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6d1302779501918acdbbd4047a67a010901814b1)
2020-08-23Update K8s test case results in docCédric Ollivier4-14/+102
Change-Id: I655629f539af63deccd6a9c6ad1fb7600f4bde60 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5b1a05cdea1d7e0a3c9e6bd8f81473f4be845b39)
2020-08-17Delete vgpu testcaseCédric Ollivier6-79/+0
It's not longer executed and offered in any Functest container. Change-Id: I9805eca1e0d7203fecc396398469bccc38458888 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3a15322d7398db08341943291e45aba611c59e87)
2020-08-17Boot a VM to run jujuCédric Ollivier8-218/+196
It allows running juju_epc vs arm32 and arm64. It stops offering juju in functest-vnf and rather installs it in a VM. It also adds a couple of missing output decode() Change-Id: I2218742b2824c8328823051bde32422e56784e90 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c4db06b2254e075af242965bec70a9b4c0c0ba38)
2020-08-05Update docs linksCédric Ollivier3-19/+2
It takes into account Bitergia EOL. Change-Id: Iaf1292a9b1af8a953ae731037be1954b6c8d5966 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 41d8a752c2c1d2dc2d6c7f9e465891ae725195ed)
2020-08-01Conform with git format-patch for last tempest patchCédric Ollivier2-3/+3
The patch name must conform with the last commit update. Change-Id: I493582d41080bd5d8b70d751b68af36ae61bcdc9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e73bd90009e11f9aa5f92aefa435b85b7022db0f)
2020-08-01Revert ssh_timeout to 196 in FunctestCédric Ollivier3-3/+3
The race condition has been fixed [1] and we can try the timeout used in OpenStack gates. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70606 Change-Id: Iaf8b260c743c1fd0088d31060a43b1788545743c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b9dab9d9dcff803b71ce42ad26578f14ed448cb3)
2020-08-01Increase check_console_loop to 12Cédric Ollivier1-0/+2
It failed once when deeply testing in parallel [1]. https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-jerma-vyos_vrouter-run/80/console Change-Id: Ia70c43d603302d1bed46d984541b0e71461be4c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 74ef88c1884bb0283236eeba82da834402928a40)
2020-07-29Apply new Create-new-server-test_reboot_server_hard.patchCédric Ollivier1-47/+63
test_reboot_server_hard sometimes fail in all gates [1]. This hack could highlight if they are side effects between test_create_backup and test_reboot_server_hard. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I230a6faa4b619e71646a312500ee38a3a8b1093c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-26Print data to debug ServerActionsTestJSON.test_reboot_server_hardCédric Ollivier1-5/+7
Change-Id: Ib3142be2d6f04315c51831d06e35cc086223603e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3b7905fb1bba8b641bb3028154dc3d90e7b0d12d)
2020-07-25Create new server test_reboot_server_hardCédric Ollivier2-1/+70
It sometimes fail in all gates [1] This hack could highlight if it's a timeout issue or race conditions between all tempest tests. [1] http://artifacts.opnfv.org/functest/E5AZMH89OOK6/functest-opnfv-functest-smoke-cntt-hunter-tempest_full_cntt-run-142/tempest_full_cntt/tempest-report.html Change-Id: I8d03aa10c3d822dacb983e5ca019f79e1c582c9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c29cdcb448cf0d61f4c48acb939d5a943c138a48)
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier3-3/+3
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7c999385a25e77fa0603a962b0fbc9824e5139ae)
2020-07-16Add tempest_cyborg in Functest ansible roleCédric Ollivier1-0/+1
Change-Id: I58ae820e10af29be757616fb5faf716453169e25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 216d8ff98081cb3e39c98f379dbe9a2dcc534ef6)
2020-07-16Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier4-2/+45
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 53c6cfb16b64298af498819ddbbe5d6a8bd7d3de)
2020-07-15Update microversions (Train) in CNTT testingCédric Ollivier1-3/+3
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Id9ee50133a3529e4c905b60f993762205178fe7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 60c2629983b21450cf430f47c538948472759ccb)
2020-07-15Enable back manage_snapshot testing in CNTTCédric Ollivier3-5/+3
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 31bf59e9ecefbf6c917638d2ab4c13f635f8f622)
2020-07-15Enable back RemoteStack testing from tempest_heat_cnttCédric Ollivier3-8/+4
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 33dd431d9c17708a13b3b26873d552a69bc81413)
2020-07-15Update functest/ci/testcases.yamlCédric Ollivier5-10/+335
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f36cc92bb628b53ed3a58fa84a24f94f006d6f30)
2020-07-03Fix tempest_scenarioCédric Ollivier3-3/+3
It completes "min_computes_nodes is also used as max values". Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b765cf825b1a0d0853420b4a4bb7a154063f117e)
2020-07-03min_computes_nodes is also used as max valuesCédric Ollivier2-16/+2
Its max value is now 10 according to the default quota. Change-Id: Ie7bfcb224e821c15d38d0cba1d9f080548613e79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f21f139f9d24d282310d0830a053169532e75596)
2020-07-01Apply "object storage: fix and cleanup header checks"Cédric Ollivier2-0/+180
It was highlighted as a fix needed by CNTT during the CNTT RC field trial [1]. [1] http://testresults.opnfv.org/functest/field_trial/ Change-Id: I7e85c952d2a5c9ce5006aa7034eaca6cd1f528ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-29Simplify hypervisor list logic in vmtpCédric Ollivier1-5/+4
It completes the previous change "Allow listing hypervisors in VMTP" [1]. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70359 Change-Id: I12a19fd473076cfc3262f096cac1615c183710b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 06f69562e0937535e665840336b951dbed7ebd1b)
2020-06-24Remove build data in CNTT playbookCédric Ollivier1-30/+0
It's useless from a CNTT point of view. It remains in the classical IaaS verification to ease creating Functest Jenkins Jobs. Change-Id: Icb13ab7d0e43b4cf968cab4041b6827c11c20cbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e468a2d44627f6cb92876971d0a30e65e6c2f236)
2020-06-19Allow listing hypervisors in VMTPCédric Ollivier2-2/+11
It allows listing the compute under tests via VMTP_HYPERVISORS. They are no additional log in Functest and the note in VMTP is still valid [1]. [1] https://opendev.org/x/vmtp/src/branch/master/vmtp/vmtp.py#L833 Change-Id: Ic9fbda3901d796c0ed94e42e2a14c468598f4311 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3668a839dd9b869a3162c8aa2d98a152d22b7244)
2020-06-15Increase timeout in shaker and vmtpCédric Ollivier2-0/+3
Running them in parallel of rally full and jobs asks for a increase. Change-Id: Ib2369d384ac839fb46031411e1985ac402da0c1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6a4195b2dbdfeecb6b75450d28039097fd71d8eb)
2020-06-15Stop leveraging on neutron plugins and extraCédric Ollivier2-22/+2
Neutron leverages on the upstream Rally task in Stein and newer. Leveraging on the upstream task may fix the side effects which sometimes occured on Vmtp and Shaker [1] and filled better the CNTT model. [1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/ Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4375f6b9cbf0916c8d82ab31cd30e45e40129ff6)
2020-06-15Compile lxml with optimization in smokeCédric Ollivier2-1/+5
Else cross compilation raises travis-ci.org's timeouts [1] [1] https://travis-ci.org/github/collivier/functest/jobs/698227192 Change-Id: I985321ac68a7a94cb8483d831f03222d44b3be57 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a8482af79b22326d336fe58de00bb425892d46c6)
2020-06-15Clone repositories instead of wgetting constraintsCédric Ollivier7-72/+48
It stops leveraging on wget to get constraints as it fails since opendev was created. Then functest and requirements are no longer removed for functest-core which simplifies all child Dockerfile. It also fix the current incompatibilities in OpenStack constraints ERROR: cliff 3.2.0 has requirement cmd2!=0.8.3,<0.9.0,>=0.8.0, but you'll have cmd2 1.1.0 which is incompatible. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L230 https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L416 Change-Id: I7c044208ef26ad047fb841710b422acb6c9f0320 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 961b940c796871e40146b90cf19b48390310dd59)
2020-06-12Skip EncryptionVolTypeTest in Iaas verification and CNTT ConformanceCédric Ollivier4-2/+5
Attaching an encryted volume is optional in CNTT [1]. This test fails if the volume type already exists and if it runs twice in parallel [2]. As this single test doesn't fullfil the Functest requirements, it's skiped in the classical verification as well. [1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md [2] https://storyboard.openstack.org/#!/story/2007804 Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f51decbef5fb243faad89f2adbb41d513a671b66)
2020-06-12Remove RemoteStack testing from tempest_heat_cnttCédric Ollivier2-2/+5
Trusts redelegation is supported by Train [1][2] which forces to skip RemoteStack as CNTT Baldy is designed for Pike (the support is incomplete in case of trust [3]). [1] https://docs.openstack.org/releasenotes/heat/train.html#relnotes-13-0-0-stable-train [2] https://github.com/openstack/heat/commit/e377658586c737150dad1bfd80b7b2267d46be51 [3] https://bugs.launchpad.net/heat/+bug/1701498 Change-Id: Ib4f66170b9b1f50b8224705edb4820e5a4cb0167 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 809b2eb2671bfc67d391eeb87b84a772eab04ade)
2020-06-08Add missing tempest_octavia in patchesCédric Ollivier1-0/+9
Change-Id: I0fae7487955895bf8f41046043425849f8fd0bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 905111ad76e80234bed2284b188b571322ec8e8f)
2020-06-08Update all patches proposed by FunctestCédric Ollivier2-73/+245
It mostly takes into account the last changes in test case names and new cntt-related test cases. Change-Id: I271fd02095b57f3b19b5ff95299fb4b257163c1f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dd92ba4d5b6d169dd52f5d43f35d84bdc6d6ab9b)
2020-06-08Update aarch64 configsCédric Ollivier2-18/+28
Change-Id: Ib53b9f97f30bf86d33857910ab9bffa1ce0d1e9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c336a44caf50c44221ca38620e7e2f894555c1e1)
2020-06-08Inherit from the right Docker parent imageCédric Ollivier1-1/+1
Change-Id: Ie5a382789a294b668095503a52d4e382336a935a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Stop increase thread stack sizeCédric Ollivier1-26/+2
It seems useless and then it limits the diff to Rally. Change-Id: Ib745c7aad20ab5ab7fd4f8a5c7deb9d4aff30881 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 38e63e588d3198de952a72b1fb8217df27511b95)
2020-06-05Switch back to concurrency = 4 in tempest testcasesCédric Ollivier4-23/+27
3 seems good enough and stable which allows trying 4 as before Change-Id: Id1f17ebf73f9faa13ed3ceb327ccb4ecf88c2bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c7296454e80cea8273700da13e720e7f357f008e)
2020-06-05Run VNF in parallel in Functest default playbookCédric Ollivier1-2/+0
They pass in parallel if the bandwidth is good enough. https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/679/ Change-Id: I2f466f7f25898d8af3004da1d3ef2208e4410f7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a5d8fadf7a0c68df662c8257947df82119bfe768)