aboutsummaryrefslogtreecommitdiffstats
path: root/docker
AgeCommit message (Collapse)AuthorFilesLines
2020-07-20Add Patrole compute testingCédric Ollivier2-19/+10
It stops leveraging on policy json files as it fails for Nova. Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-20Skip Patrole test_show_auto_allocated_topologyCédric Ollivier1-0/+3
test_show_auto_allocated_topology doesn't clean its resources: - network: auto_allocated_network - subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6 - router: auto_allocated_router This bug easily breaks testing in a quick run when allocating the subnet due to insufficient prefix space to allocate subnet size /26. https://build.opnfv.org/ci/job/functest-latest-daily/746/ Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use alpine edgeCédric Ollivier1-1/+1
Last upper-constraints updates force Alpine edge. https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/941/console Change-Id: If2c7d434cfa45e676e3d236a2f59f916b43b5cd1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-19Use default ssh_timeout (300) in FunctestCédric Ollivier1-1/+1
196 is used in OpenStack gates but it doesn't fit the Functest model. Functest runs all test cases in parallel vs the same SUT. https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38 Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Add tempest_cyborg based on cyborg tempest pluginCédric Ollivier2-3/+27
Change-Id: I61e982011040ee8b0540910939983777280445ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Update microversions (Train) in CNTT testingCédric Ollivier1-3/+3
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Id9ee50133a3529e4c905b60f993762205178fe7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back manage_snapshot testing in CNTTCédric Ollivier2-3/+2
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-14Enable back RemoteStack testing from tempest_heat_cnttCédric Ollivier2-5/+3
Baraque selects Train: https://github.com/cntt-n/CNTT/pull/1782 https://github.com/cntt-n/CNTT/pull/1783 Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-06Remove distlib from OpenStack constraintsCédric Ollivier1-0/+1
It raised side effects wih Alpine [1]. [1] https://build.opnfv.org/ci/job/functest-core-docker-build-amd64-master/933/console Change-Id: Ic922c2b56afe67f2f3e436c562c045f4d0fdbef4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-05Reduce Patrole extra logicCédric Ollivier1-42/+21
It also reduces the skipped test list taking into account Patrole improvements. Change-Id: I23a8c0610a8a4258aa806451f52796f3e7bc46ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Avoid compiling numpy if armCédric Ollivier1-1/+2
It reaches Travis-ci timeouts Change-Id: I30405cc1cd603a9dee96674d350d04eeb39e6add Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Patrole user -> memberCédric Ollivier1-2/+2
Change-Id: I050caff2d255118edff48403a87305cfe336e20a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-04Create all /etc dirs per serviceCédric Ollivier1-1/+1
Change-Id: I6bb0e68b817a3776e0ca051eea93b199db0bac1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Fix tempest_scenarioCédric Ollivier2-2/+2
It completes "min_computes_nodes is also used as max values". Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Generate all policies for patroleCédric Ollivier1-0/+3
Change-Id: Ica6455e3467ef2695d489170bd8f94553a6fdf06 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Prepare full patrole testingCédric Ollivier1-2/+9
It adds the remaining services which didn't work before. It may be needed for CNTT (see security discussion in vevent). Change-Id: I36b3ad8bbfc8ffdcc427c3d97b92c78da27915c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-03Add patrole user and reader testingCédric Ollivier1-1/+51
The regexes will be updated in a second change (chicken and egg between Functest and Releng) Change-Id: I4273a80799730fe30c941a7b2966cfee46f24d4a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-29Update tempest_neutron_cntt regex and test countCédric Ollivier1-0/+1
It takes latest updates into account [1][2]. [1] http://artifacts.opnfv.org/functest/4W4YF3954M7H/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-85/tempest_neutron_cntt/tempest-report.html [2] http://artifacts.opnfv.org/functest/K4DV91F2Y9V0/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-76/tempest_neutron_cntt/tempest-report.html Change-Id: Ia9b57e708522926fde9f8c44e6a0e936e97f304f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Reuse OpenStack master upper-constaints.txtCédric Ollivier1-1/+1
https://github.com/openstack/requirements/commit/c2f72e26a42eceb4b64f80d04db8253a4fbdb793 Change-Id: I0318c8614b09dc7cff1ffba4b813e55483df7eb3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Stop leveraging on neutron plugins and extraCédric Ollivier1-2/+2
Neutron leverages on the upstream Rally task in Stein and newer. Leveraging on the upstream task may fix the side effects which sometimes occured on Vmtp and Shaker [1] and filled better the CNTT model. [1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/ Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Install py3-wheel to avoid legacy installationCédric Ollivier1-1/+1
Change-Id: I5cfd3e370ef16785eeceaafefa18b45d2221c04b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Compile lxml with optimization in smokeCédric Ollivier2-1/+5
Else cross compilation raises travis-ci.org's timeouts [1] [1] https://travis-ci.org/github/collivier/functest/jobs/698227192 Change-Id: I985321ac68a7a94cb8483d831f03222d44b3be57 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-14Clone repositories instead of wgetting constraintsCédric Ollivier7-73/+49
It stops leveraging on wget to get constraints as it fails since opendev was created. Then functest and requirements are no longer removed for functest-core which simplifies all child Dockerfile. It also fix the current incompatibilities in OpenStack constraints ERROR: cliff 3.2.0 has requirement cmd2!=0.8.3,<0.9.0,>=0.8.0, but you'll have cmd2 1.1.0 which is incompatible. https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L230 https://github.com/openstack/requirements/blob/master/upper-constraints.txt#L416 Change-Id: I7c044208ef26ad047fb841710b422acb6c9f0320 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Skip EncryptionVolTypeTest in Iaas verification and CNTT ConformanceCédric Ollivier2-2/+3
Attaching an encryted volume is optional in CNTT [1]. This test fails if the volume type already exists and if it runs twice in parallel [2]. As this single test doesn't fullfil the Functest requirements, it's skiped in the classical verification as well. [1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md [2] https://storyboard.openstack.org/#!/story/2007804 Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-12Remove RemoteStack testing from tempest_heat_cnttCédric Ollivier2-2/+5
Trusts redelegation is supported by Train [1][2] which forces to skip RemoteStack as CNTT Baldy is designed for Pike (the support is incomplete in case of trust [3]). [1] https://docs.openstack.org/releasenotes/heat/train.html#relnotes-13-0-0-stable-train [2] https://github.com/openstack/heat/commit/e377658586c737150dad1bfd80b7b2267d46be51 [3] https://bugs.launchpad.net/heat/+bug/1701498 Change-Id: Ib4f66170b9b1f50b8224705edb4820e5a4cb0167 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Merge "Update functest/ci/testcases.yaml"Cedric Ollivier4-6/+10
2020-06-07Merge "Stop increase thread stack size"Cedric Ollivier1-26/+2
2020-06-07Update functest/ci/testcases.yamlCédric Ollivier4-6/+10
It takes all CNTT changes into account. Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-07Stop increase thread stack sizeCédric Ollivier1-26/+2
It seems useless and then it limits the diff to Rally. Change-Id: Ib745c7aad20ab5ab7fd4f8a5c7deb9d4aff30881 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-06Update to alpine3.12Cédric Ollivier2-2/+2
https://alpinelinux.org/posts/Alpine-3.12.0-released.html Change-Id: Ie7c72abd10d70b90d65f260d595c0ca47b69a8c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-06Increase tempest_neutron's tests_countCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/Q3047D5AS3HJ/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-40/tempest_neutron_cntt/tempest-report.html http://artifacts.opnfv.org/functest/03PRDE6TZC14/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-49/tempest_neutron_cntt/tempest-report.html Change-Id: I4be6d2f58e50572a3e8b90ede0055f36bc1d6886 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-05Switch back to concurrency = 4 in tempest testcasesCédric Ollivier3-14/+16
3 seems good enough and stable which allows trying 4 as before Change-Id: Id1f17ebf73f9faa13ed3ceb327ccb4ecf88c2bf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-04Rename patch name and removes debug logsCédric Ollivier3-110/+76
The debug logs works only vs py3.8 and breaks backport to Iruya. Change-Id: Ie91a8a876e263a83b6ae3fbfb5bb05644b87b970 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Switching to Threading instead of multiprocessingCédric Ollivier1-343/+74
Change-Id: Id5059a06447357f4c9b058bad374ed6cbe4d742c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Increase tests_count into tempest_neutron_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/KJSOWXFF5CIQ/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-41/tempest_neutron_cntt/tempest-report.html Change-Id: I04f0c3ae695f17e2bd56add11410e24ee25967d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-03Switch to queue.Queue() in RallyCédric Ollivier1-21/+52
It's still failing. Change-Id: I20fdf5a8e05bccc30a760934f6c0e3cac16d763c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-01Switch to SimpleQueue()Cédric Ollivier1-14/+56
Change-Id: I1f3cb636813b9c3c10b5c829e35bbdeea02a318c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-01Switch to fork in Python multiprocessing (python2 default)Cédric Ollivier1-5/+8
Change-Id: Id93da8c0fc710e1491adeb2b42e6da99974a0580 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-28Take last upstream changes into account in the regexesCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/1NCC8YUFKE7X/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-64/tempest_slow_cntt/tempest-report.html Change-Id: I196421d96ada3ec1eb8fc718f72c3e796a0bd3b4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-28Retry increasing Stack sizeCédric Ollivier1-2/+17
Change-Id: I61cb70a74179dea6a02e81989695325fe6331e10 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-27Skip manage_snapshot in CNTTCédric Ollivier2-2/+3
As detected by Orange's RC Field trial, Ceph doesn't support this feature before Rocky [1]. "AttributeError: 'RBDDriver' object has no attribute 'unmanage_snapshot'" manage_snapshot testing is fully passing in Functest SUT because CNTT is verified vs OpenStack Rocky and newer. Ceph is selected by RI as backend and is widely reused by the ecosytem. It's similar to [2]. [1] https://bugs.launchpad.net/cinder/+bug/1645288 [2] https://gerrit.opnfv.org/gerrit/c/functest/+/69888 Change-Id: I3b7f88f5bed9a47a1e26e16bbbf74fea24ca76c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-26Remove test_gnocchi.GnocchiGabbiTest.test_liveCédric Ollivier1-1/+1
It sometimes fails in our gates and it seems unverified in OpenStack [1]. "Archive policy gabbilive is still in use" [1] http://artifacts.opnfv.org/functest/DET32CBF0L0F/functest-opnfv-functest-smoke-jerma-tempest_telemetry-run-29/tempest_telemetry/tempest-report.html Change-Id: Id5e5ad5ff0f7bade7932a085df28cc35b0ac7984 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-25Update tests_count in tempest_full_cnttCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/R1927JRCFJR5/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-62/tempest_full_cntt/tempest-report.html Change-Id: Ia4b5bbdb92e7877d81acdcf9c4f3a9745badfb36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-24Precise validation configs in NeutronCédric Ollivier1-0/+6
ServerActionsTestJSON.test_reboot_server_hard [1] sometimes fails in gates. We may increase timeouts if it stills fails. [1] http://artifacts.opnfv.org/functest/LIQH38CPR30X/functest-opnfv-functest-smoke-hunter-tempest_full-run-649/tempest_full/tempest-report.html Change-Id: Ia27c0faead1df5c2b33a3e1a272e5a1010a5a83e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7ccc1b0793e32cad3912e63bbca971d5c3ecd724)
2020-05-14Prevent microversion conflictsCédric Ollivier3-1/+98
CNTT selects Pike as baseline and Hunter matches Rocky. Change-Id: I8a1aa8385adce1ebb9d74bcb897effaf5b434e5a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 82ceefd8f1609508a476aa2e4573e59926653165)
2020-05-13Add other debug messages in RallyCédric Ollivier1-9/+141
It would allow debugging our Rally failures. Change-Id: I749a040fe76261e997d3a8dff4965867d54f7c42 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-10Increase tempest_neutron test_count to 512Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/V0A7B0J1PIRL/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-17/tempest_neutron_cntt/tempest-report.html Change-Id: I95dc0d8dec370dedb501878cbedfe5567ab86afd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-04Enable network_v6 testing in CNTTCédric Ollivier1-3/+2
req.inf.ntw.16 is a MUST requirement. Fixes cntt-n/CNTT#1556 Change-Id: Id48595f5f4710ea9cbf31edaa4ae0ed31f5278ba Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-03Update octavia regexesCédric Ollivier1-3/+6
It stops using noop drivers and adds all scenarios except: - .*api.v2.test_availability_zone - .*api.v2.test_availability_zone_profile - .*api.v2.test_member.MemberAPITest.test_member_ipv4_create - .*api.v2.test_member.MemberAPITest.test_member_ipv6_create It doesn't run ipv6 which asks for a deep dive (ipv6 from containers?) It increases threads to 3 as the other testcases. Change-Id: I36d9d764a5ab92efe89196181bffa3ad0a57227c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-05-03Stop overriding tempest_conf.yaml in CNTTCédric Ollivier2-92/+0
It's useless as they are skipped by regexes (vnc_console). Change-Id: If3cea451c95179e7e200708e1f3b5e9534be9e1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>