aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-07-20Add Patrole compute testingCédric Ollivier3-22/+13
It stops leveraging on policy json files as it fails for Nova. Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Skip Patrole test_show_auto_allocated_topologyCédric Ollivier2-0/+6
test_show_auto_allocated_topology doesn't clean its resources: - network: auto_allocated_network - subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6 - router: auto_allocated_router This bug easily breaks testing in a quick run when allocating the subnet due to insufficient prefix space to allocate subnet size /26. https://build.opnfv.org/ci/job/functest-latest-daily/746/ Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use alpine edgeCédric Ollivier3-7/+7
Last upper-constraints updates force Alpine edge. https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/941/console Change-Id: If2c7d434cfa45e676e3d236a2f59f916b43b5cd1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier3-3/+3
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-16Add tempest_cyborg in Functest ansible roleCédric Ollivier1-0/+1
Change-Id: I58ae820e10af29be757616fb5faf716453169e25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier4-3/+45
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Update Cirros to O.5.1Cédric Ollivier9-127/+127
It conforms to the OpenStack gates which have just updated to Cirros 0.5.1 Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Update microversions (Train) in CNTT testingCédric Ollivier1-3/+3
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Id9ee50133a3529e4c905b60f993762205178fe7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back manage_snapshot testing in CNTTCédric Ollivier3-5/+3
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back RemoteStack testing from tempest_heat_cnttCédric Ollivier3-6/+5
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-07Update Patrole tempest list if OVNCédric Ollivier1-0/+4
Change-Id: I66811c31fac4a83ed9634e928b9af8fa6e633034 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-06Update tempest blacklist if OVNCédric Ollivier1-5/+0
It takes into account last Patrole changes. Change-Id: I552442864297b51a1cd7885b357b139b664e536a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-06Remove distlib from OpenStack constraintsCédric Ollivier1-0/+1
It raised side effects wih Alpine [1]. [1] https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/933/console Change-Id: Ic922c2b56afe67f2f3e436c562c045f4d0fdbef4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-05Reduce Patrole extra logicCédric Ollivier5-95/+49
It also reduces the skipped test list taking into account Patrole improvements. Change-Id: I23a8c0610a8a4258aa806451f52796f3e7bc46ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Avoid compiling numpy if armCédric Ollivier1-1/+2
It reaches Travis-ci timeouts Change-Id: I30405cc1cd603a9dee96674d350d04eeb39e6add Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Patrole user -> memberCédric Ollivier2-4/+4
Change-Id: I050caff2d255118edff48403a87305cfe336e20a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Create all /etc dirs per serviceCédric Ollivier1-1/+1
Change-Id: I6bb0e68b817a3776e0ca051eea93b199db0bac1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Fix tempest_scenarioCédric Ollivier3-3/+3
It completes "min_computes_nodes is also used as max values". Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Generate all policies for patroleCédric Ollivier1-0/+3
Change-Id: Ica6455e3467ef2695d489170bd8f94553a6fdf06 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03min_computes_nodes is also used as max valuesCédric Ollivier2-16/+2
Its max value is now 10 according to the default quota. Change-Id: Ie7bfcb224e821c15d38d0cba1d9f080548613e79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Prepare full patrole testingCédric Ollivier1-2/+9
It adds the remaining services which didn't work before. It may be needed for CNTT (see security discussion in vevent). Change-Id: I36b3ad8bbfc8ffdcc427c3d97b92c78da27915c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Add patrole user and reader testingCédric Ollivier5-5/+109
The regexes will be updated in a second change (chicken and egg between Functest and Releng) Change-Id: I4273a80799730fe30c941a7b2966cfee46f24d4a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-29Update tempest_neutron_cntt regex and test countCédric Ollivier1-0/+1
It takes latest updates into account [1][2]. [1] http://artifacts.opnfv.org/functest/4W4YF3954M7H/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-85/tempest_neutron_cntt/tempest-report.html [2] http://artifacts.opnfv.org/functest/K4DV91F2Y9V0/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-76/tempest_neutron_cntt/tempest-report.html Change-Id: Ia9b57e708522926fde9f8c44e6a0e936e97f304f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-29Simplify hypervisor list logic in vmtpCédric Ollivier1-5/+4
It completes the previous change "Allow listing hypervisors in VMTP" [1]. [1] https://gerrit.opnfv.org/gerrit/c/functest/+/70359 Change-Id: I12a19fd473076cfc3262f096cac1615c183710b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-24Remove build data in CNTT playbookCédric Ollivier1-27/+0
It's useless from a CNTT point of view. It remains in the classical IaaS verification to ease creating Functest Jenkins Jobs. Change-Id: Icb13ab7d0e43b4cf968cab4041b6827c11c20cbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-18Allow listing hypervisors in VMTPCédric Ollivier2-2/+11
It allows listing the compute under tests via VMTP_HYPERVISORS. They are no additional log in Functest and the note in VMTP is still valid [1]. [1] https://opendev.org/x/vmtp/src/branch/master/vmtp/vmtp.py#L833 Change-Id: Ic9fbda3901d796c0ed94e42e2a14c468598f4311 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Increase timeout in shaker and vmtpCédric Ollivier2-0/+3
Running them in parallel of rally full and jobs asks for a increase. Change-Id: Ib2369d384ac839fb46031411e1985ac402da0c1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Reuse OpenStack master upper-constaints.txtCédric Ollivier1-1/+1
https://github.com/openstack/requirements/commit/c2f72e26a42eceb4b64f80d04db8253a4fbdb793 Change-Id: I0318c8614b09dc7cff1ffba4b813e55483df7eb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Stop leveraging on neutron plugins and extraCédric Ollivier2-22/+2
Neutron leverages on the upstream Rally task in Stein and newer. Leveraging on the upstream task may fix the side effects which sometimes occured on Vmtp and Shaker [1] and filled better the CNTT model. [1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/ Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Install py3-wheel to avoid legacy installationCédric Ollivier1-1/+1
Change-Id: I5cfd3e370ef16785eeceaafefa18b45d2221c04b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Compile lxml with optimization in smokeCédric Ollivier2-1/+5
Else cross compilation raises travis-ci.org's timeouts [1] [1] https://travis-ci.org/github/collivier/functest/jobs/698227192 Change-Id: I985321ac68a7a94cb8483d831f03222d44b3be57 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-14Clone repositories instead of wgetting constraintsCédric Ollivier7-73/+49
It stops leveraging on wget to get constraints as it fails since opendev was created. Then functest and requirements are no longer removed for functest-core which simplifies all child Dockerfile. It also fix the current incompatibilities in OpenStack constraints ERROR: cliff 3.2.0 has requirement cmd2!=0.8.3,<0.9.0,>=0.8.0, but you'll have cmd2 1.1.0 which is incompatible. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L230 https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L416 Change-Id: I7c044208ef26ad047fb841710b422acb6c9f0320 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Skip EncryptionVolTypeTest in Iaas verification and CNTT ConformanceCédric Ollivier4-2/+5
Attaching an encryted volume is optional in CNTT [1]. This test fails if the volume type already exists and if it runs twice in parallel [2]. As this single test doesn't fullfil the Functest requirements, it's skiped in the classical verification as well. [1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md [2] https://storyboard.openstack.org/#!/story/2007804 Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Remove RemoteStack testing from tempest_heat_cnttCédric Ollivier2-2/+5
Trusts redelegation is supported by Train [1][2] which forces to skip RemoteStack as CNTT Baldy is designed for Pike (the support is incomplete in case of trust [3]). [1] https://docs.openstack.org/releasenotes/heat/train.html#relnotes-13-0-0-stable-train [2] https://github.com/openstack/heat/commit/e377658586c737150dad1bfd80b7b2267d46be51 [3] https://bugs.launchpad.net/heat/+bug/1701498 Change-Id: Ib4f66170b9b1f50b8224705edb4820e5a4cb0167 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Add missing tempest_octavia in patchesCédric Ollivier1-0/+9
Change-Id: I0fae7487955895bf8f41046043425849f8fd0bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Update all patches proposed by FunctestCédric Ollivier2-73/+245
It mostly takes into account the last changes in test case names and new cntt-related test cases. Change-Id: I271fd02095b57f3b19b5ff95299fb4b257163c1f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-08Update aarch64 configsCédric Ollivier2-18/+28
Change-Id: Ib53b9f97f30bf86d33857910ab9bffa1ce0d1e9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Merge "Update functest/ci/testcases.yaml"Cedric Ollivier5-8/+334
2020-06-07Merge "Stop increase thread stack size"Cedric Ollivier1-26/+2
2020-06-07Update functest/ci/testcases.yamlCédric Ollivier5-8/+334
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Stop increase thread stack sizeCédric Ollivier1-26/+2
It seems useless and then it limits the diff to Rally. Change-Id: Ib745c7aad20ab5ab7fd4f8a5c7deb9d4aff30881 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-06Update to alpine3.12Cédric Ollivier5-9/+9
https://alpinelinux.org/posts/Alpine-3.12.0-released.html Change-Id: Ie7c72abd10d70b90d65f260d595c0ca47b69a8c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-06Increase tempest_neutron's tests_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/Q3047D5AS3HJ/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-40/tempest_neutron_cntt/tempest-report.html http://artifacts.opnfv.org/functest/03PRDE6TZC14/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-49/tempest_neutron_cntt/tempest-report.html Change-Id: I4be6d2f58e50572a3e8b90ede0055f36bc1d6886 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-05Switch back to concurrency = 4 in tempest testcasesCédric Ollivier4-23/+27
3 seems good enough and stable which allows trying 4 as before Change-Id: Id1f17ebf73f9faa13ed3ceb327ccb4ecf88c2bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-05Run VNF in parallel in Functest default playbookCédric Ollivier1-2/+0
They pass in parallel if the bandwidth is good enough. https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/679/ Change-Id: I2f466f7f25898d8af3004da1d3ef2208e4410f7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-04Rename patch name and removes debug logsCédric Ollivier3-110/+76
The debug logs works only vs py3.8 and breaks backport to Iruya. Change-Id: Ie91a8a876e263a83b6ae3fbfb5bb05644b87b970 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Switching to Threading instead of multiprocessingCédric Ollivier1-343/+74
Change-Id: Id5059a06447357f4c9b058bad374ed6cbe4d742c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Increase tests_count into tempest_neutron_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/KJSOWXFF5CIQ/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-41/tempest_neutron_cntt/tempest-report.html Change-Id: I04f0c3ae695f17e2bd56add11410e24ee25967d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Switch to queue.Queue() in RallyCédric Ollivier1-21/+52
It's still failing. Change-Id: I20fdf5a8e05bccc30a760934f6c0e3cac16d763c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-01Switch to SimpleQueue()Cédric Ollivier1-14/+56
Change-Id: I1f3cb636813b9c3c10b5c829e35bbdeea02a318c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>