aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-06-25Fix link in docs (E2 Testing in Kubernetes)Cédric Ollivier1-1/+1
It conforms with "Cleanup tombstone files in community/devel" [1] and fixes the gates [2] [1] https://github.com/kubernetes/community/commit/4bb72158434b2d29094b06af4c9bda284e5417fd [2] https://build.opnfv.org/ci/job/functest-verify-iruya/111/ Change-Id: I052bdac9a43a346ce07f93d8183f53767c757930 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 655020449ba281dce52821cd36f5dd01bffebee9)
2019-06-21Merge "Remove quota about instances in shaker" into stable/hunterCedric Ollivier1-0/+4
2019-06-20Remove quota about instances in shakerCédric Ollivier1-0/+4
The default quota could be inadequate if lots of computes. Change-Id: I510d3ebd14c2a910b7be2bacc0b99d3059a7a881 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 234be6e5895a91ca3a83f3bef12a10631bbe6522)
2019-06-19Update tempest commit idCédric Ollivier6-6/+6
It includes "Fix region leaks after testing endpoints" [1]. [1] https://github.com/openstack/tempest/commit/e8088d1218eba0b8e4ed59fa5ca30ac9b664b7fb Change-Id: I063a9c4e2f09a27c79ea77ba0cf9307642950070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bf0b79d887851ebf36dca853328d388a727fd483)
2019-06-15Fix ShellCheck warningsCédric Ollivier1-4/+4
Change-Id: Idf571b39d38b9184b2e08c183d4afe44784fbfe6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit db7c7d3031c8f9a562c6e3db0922e1cfb92ea92b)
2019-06-15Turn all bashate warnings as errorsCédric Ollivier2-4/+10
Change-Id: Ic350ed8269347f5853a6d7b4e75cfccba6d85dcf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 12b1a3258219cd301866ea79924e08cfb2a7420e)
2019-06-09Add rally_jobs in config patchesCédric Ollivier2-0/+10
Change-Id: Iaf99ee1d6ea0b2c81874daf959f7430c564a1051 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e39bc8e266d451f2e0ade7b26aae6d6895d07234)
2019-06-09Add one missing output decode in rally.pyCédric Ollivier1-1/+1
It partially cherry-picks "Conform with latest Neutron rally job" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/68021/ Change-Id: I4943f737be29bcadfead427a7852964e6438a018 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0de102e46f3e8c3d7389a67a6f375fed69db4617)
2019-06-09Blacklist test_list_metadef_namespaces (Patrole)Cédric Ollivier2-0/+2
It seems dependent on test order (404 if no namespace) and sometimes fails in gates [1][2][3]. It will be enabled as soon it's fixed upstream or if SUT is wrong here. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-patrole-run/ [2] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-iruya-patrole-run/ [3] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-hunter-patrole-run/ Change-Id: I68e71e9b0753089e5620d6689ddff37fe66aeab7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 02b9592a129472ffd26206541f8efefe1f759957)
2019-06-08Update all patches about functest configsCédric Ollivier2-15/+6
It takes into account the last updates about snaps, cloudify and refstack. Change-Id: I959f8ed1c98cd1879b51b62252aeb38918af6a2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dbb00ca3ee3e3349b42c8133dee6b1abdbcb10c3)
2019-06-08Pin ruamel.yaml.jinja2Cédric Ollivier1-0/+1
It's out of openstack/requirements and last version breaks our stable containers [1]. It will be updated in master in a second step to ease cherry-picking. [1] https://build.opnfv.org/ci/job/functest-verify-unit-tests-and-docs-hunter/322/console Change-Id: I76e1965d49e6be6f185611bcfcd056d81bc599fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3472870b0e42c135d004e0006ad3e3607036e553)
2019-06-04Updated from global requirementsCédric Ollivier1-1/+2
Change-Id: Ibc60387cd43bd18d49631afb1050c0cec0e371e1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-03Publish rally logsCédric Ollivier3-25/+48
Both Rally and Tempest publish Rally debug logs. It also moves the logics from tempest to rally. Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bc88eff8f5850f8207431bb8d1958fe6b9cd09e8)
2019-06-02Merge "correct permanent redirects in documentation" into stable/hunterCedric Ollivier6-14/+14
2019-06-01correct permanent redirects in documentationVincentDanno6-14/+14
Change-Id: I5bcb402f51541483a2797629c44485e5d75913e3 Signed-off-by: VincentDanno <vincent.danno@orange.com>
2019-06-01Decode tempest exception output (py3)Cédric Ollivier2-2/+3
https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_compute-run/30/console Change-Id: I77264525917af5f67cdecae85ef7a50439499db8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier7-1/+7
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 7a628f087403089d282cda14bcba858d8b0bc6c3)
2019-05-28Stop downgrading pipCédric Ollivier1-3/+0
The pip package poposed by Alpine is fine. Change-Id: I415757b8f4028c76e9d8cec4895306d843d42ac2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5819ff6a14e7e89b6c7004336bfcabed9f16baa4)
2019-05-28Install PyNaCl via packageCédric Ollivier2-8/+7
Building functest-core container sometimes reaches travis-ci timeout [0]. It currently selects the right version in master and stable/hunter. [0] https://travis-ci.org/collivier/functest/jobs/531417730 Change-Id: Ie6c8e729f76c98c6f8c8e9ca01b2c998081f7ce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6aad708727e41eaa8f61a104323386568a163dd3)
2019-05-25Run bandit when verifying changesCédric Ollivier3-1/+8
It reports only MEDIUM issues or higher like nova [1]. It selects bandit 1.1.0 as defined in nova and neutron lower constraints [2]. [1] https://github.com/openstack/nova/blob/master/tox.ini#L221 [2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8 Change-Id: I6fc505f684701792d3e03659eb0feea8321452c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0440ffcac18991395799e5aafc9243e028917ab6)
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier10-56/+57
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5853dd1ef3c522a975f9685250b1b3e85588f738)
2019-05-24Decode Bytes in logging callsCédric Ollivier5-36/+39
It fixes a few incorrect types in log calls [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/ Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 7d58f89103a8c44fd166c3e06b492ade63e5c5b3)
2019-05-24Merge "Enable Vmtp if py3" into stable/hunterCedric Ollivier1-3/+4
2019-05-23Enable Vmtp if py3Cédric Ollivier1-3/+4
It leverages on last Vmtp review which adds py3 support [1]. [1] https://review.opendev.org/659970 Change-Id: I8319b9e7eb88b9015961188d47657a8c67e0f8da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f994b9180b621ae6bb6397acd23de8f1a625c4cd)
2019-05-23Update to Python3Cédric Ollivier11-86/+57
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework librairies to latest release and Vmtp to master ([1] is needed) It patches cloudify rest client to support python3. Vmtp is currently disabled because it currently supports python2 only. [1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2a0702ea914a574ffa7c6d6f83a5c606e24ebd0a)
2019-05-23Update Pylint score (10/10) in Release notesCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-verify-unit-tests-and-docs-master/2239/console Change-Id: I5f124250aba3aa9a5ca0bc01221c06843bba1b35 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit ab5dfff578e7c9686882c844ff2c0fed1f663e6f)
2019-05-21Avoid running local dnsmasq when testing IMSCédric Ollivier5-36/+25
It may be unsafe and it's useless for testing IMS if BONO_IP is set. Change-Id: I8b0f010956defbfa1fd22b5aa5cbea70bd2968a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a82827bd4f93c318f0bc2554928ab2213d1ee766)
2019-05-18Update tempest to avoid resource leaks in EndPointGroupsTestCédric Ollivier5-5/+5
It includes "Fix resource leaks in EndPointGroupsTest" [1] which removes the 2 remaining tempest services. It's worth mentioning they raised side effects when trying to connect to Horizon. Change-Id: Ic85fa38a4690c5532d10d21d2eec64d99ab1e8cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 084ce7dd3976d65409f54d8ff5010e709ec76cd6)
2019-05-13Update defcore.txt to the latest cached oneCédric Ollivier1-116/+3
Change-Id: Iea42b7ef8a76ff1c7bd56e88290c716776dd9291 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 90389efe0257f730418181291b82dda9c390b953)
2019-05-13Allow building containers when refstack.openstack.org is downCédric Ollivier2-2/+428
It has been down for days and break our gates again. Change-Id: I66e286f3624c776c7cec5164df53eb117550e78a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6b578b9068164eab33b2cc2d6002f59b9af88f8d)
2019-05-11Revert "Disable Patrole network.test_agents_rbac"Cédric Ollivier2-2/+0
This reverts commit 4fd59de2b5751437ca6faf71415129cf6f64cf8f. It should have been applied in master and iruya only. Change-Id: I8f467e5cbe2f230a0a3f119a3f4ad80da8a5a6bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-11Update neutron-tempest to 0.3.0Cédric Ollivier1-2/+2
It includes the fix "Cleanup Tempest tests legacy resources" [1] which cleans all remaining routers and security groups detected in Functest gates. [1] https://github.com/openstack/neutron-tempest-plugin/commit/2de722ef0af284b4f68e952df53ad4f0d9d452be#diff-44d072bece4c5873f0e78df8ad7cacf2 Change-Id: I4da824447ab67e4b0aba044c39467f8f105b5630 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-08Disable Patrole network.test_agents_rbacCédric Ollivier2-0/+2
They don't clean routers (tempest-L3AgentsExtRbacTest-Router) after testing. Change-Id: I78cfc783feb51d0f1b029c98e988c07e57e1e694 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d4178d425312497412e9832fb6cb1a074e5099f3)
2019-05-04Enable volume backup testingCédric Ollivier1-1/+1
It conforms with OpenStack gates by default. Change-Id: Icc1537b0f8342666d2a2a0de4655ba99f4f42470 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 305f9f41df7ecba640fc4552269bca8ee588b92c)
2019-05-03Update to tempest 20.0.0Cédric Ollivier5-5/+5
test_dualnet_multi_prefix_slaac which is uncovered (marked as slow) by OpenStack gates [1] is failing on lf-virtual6 [2]. Updating to 20.0.0 is closer to the current OpenStack Neutron Rocky gates (tempest==20.0.1.dev42) [3]. It's worth mentioning that we cannot downgrade to 19.0.0 because the next commit is needed [4]. [1] http://logs.openstack.org/28/656428/1/check/tempest-multinode-full-py3/74d9cd7/testr_results.html.gz [2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-tempest_scenario-run-113/results/tempest_scenario/tempest-report.html [3] http://logs.openstack.org/57/654957/2/check/neutron-tempest-multinode-full/e5eda83/job-output.txt.gz [4] https://github.com/openstack/tempest/commit/3588bb3f5ef546a0ef4d4ad621fd1be381b5fdaf Change-Id: I496df1272f26ad73daf388070b762b736e4e5fd8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Manage block_migration in RallyCédric Ollivier5-7/+16
It creates a new env var BLOCK_MIGRATION (True by default) to allow block migration for live migration in Rally. It updates scenarios and blacklisting to take that env vars into account. Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 940e49a6cdf7ae0f8286c953952a9757ba63a20b)
2019-05-01Use block devices for live migrationCédric Ollivier1-0/+2
The default values conform with OpenStack and Functest gates [1]. It could be set to false if shared storage-based live migration is supported [2]. It also currently disables cold migration. [1] http://logs.openstack.org/84/632984/24/check/tempest-multinode-full-py3/4216037/controller/logs/tempest_conf.txt.gz [2] https://docs.openstack.org/nova/pike/admin/configuring-migrations.html Change-Id: I0faa415eba610c20ba54353ac7ba7b0e83722c32 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f1695eceb3d18501a603dcc89da020c676d9b617)
2019-04-25Leverage on DEBUG env varCédric Ollivier5-9/+126
It allows muting debug logs. Change-Id: I291f3bb7e0a450724a34997c720bde01f72c8e50 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d777f2e588a321d5c01e2e50ffa5c8fc5a27c77c)
2019-04-25Enable stor4nfv in HunterCédric Ollivier2-2/+1
The branch is ready. Change-Id: I0b246cf3bb83eb7ef0151509d2e99c45032b7a7e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-25Merge "Refactor modules to avoid duplicated code" into stable/hunterCedric Ollivier9-178/+86
2019-04-24Refactor modules to avoid duplicated codeCédric Ollivier9-178/+86
It also increases number of lines to warm about duplicated codes. Change-Id: I3914da8a90cbfe8fd024e9944c3adc8a617330d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9dcc30874194382a25c66baf359b863c6e013caf)
2019-04-23Set max_microversion for placement and volumeCédric Ollivier1-0/+3
It sets max_microversion to latest because if both values are not specified, Tempest avoids tests which require a microversion [1]. It completes the previous change about nova [2]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html [2] https://gerrit.opnfv.org/gerrit/#/c/67318/ Change-Id: Ieab56a239077476dd9a0e1ee97ac4293c4075f5c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b9048a25355e1d6c29c84ca10a3d859841468f50)
2019-04-21Remove all sdnvpn loggersCédric Ollivier1-6/+1
OPNFV sdnvpn is over. Change-Id: I78b6c45c6e5216795252be38dbc54f80f6e65061 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2f80c3c0a89622a673ef7957d0d53d56e75c14ee)
2019-04-21Build arm* functest-vnf containers via travis-ciCédric Ollivier3-14/+35
It doesn't build juju deps if arm* as they can't be cross-compiled. Then that deps won't be built in releng on native arm64 hosts It's worth mentioning that containers have never been executed in OPNFV gates. That change allows running all other VNFs on Raspberry PI and building containers without arm build servers. Change-Id: I836a72f049e7f0e6ae704f5b829914692d5b2c09 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0c3ae6e09acd16fc50a516975631dd6bb76b8c53)
2019-04-21Update all OpenStack refs to opendev.orgCédric Ollivier9-34/+29
All gates are failing due wrong to redirections (see os-faults [1][2]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console [2] https://travis-ci.org/collivier/functest/builds/522071220 Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2ceebaa032f07c4162ed3701c6814dfe5cb683d4)
2019-04-19Updated from global requirementsCédric Ollivier1-1/+1
Change-Id: I5e2057c11920bba55d8bae34dc836aa86765ccf3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-15Update Hunter Release Notesopnfv-8.1.0Cédric Ollivier1-43/+19
Change-Id: Ie7826cf2ef8eb537f1b4f213c92c384e0b48c311 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-15Stop forcing admin_scope_domain = TrueCédric Ollivier1-1/+0
tempest fails vs devstack stable/stein and it passes successfully vs devstack stable/rocky (Functest gates) without that option. It may be added to tempest_conf.yaml if SUT requires it. Change-Id: I4730c25b25403fd130d71166a8778e06fd479935 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f038f387a8a0499d39b3fa5091c333b6b0ef5af7)
2019-04-14Speed up lxml buildCédric Ollivier2-1/+8
It allows cross-compiling it via travis-ci (benchmarking) [1][2] [1] https://lxml.de/installation.html [2] https://travis-ci.org/collivier/functest/jobs/519737041 Change-Id: I31609268d77405f036924a010cfb3dab520e9ea3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1d190eb4039194d049cfc97b456978853d0d77d1)
2019-04-14Verify py36 via travis-ciCédric Ollivier2-8/+5
Change-Id: I1180478c19d0f1c56e615a2af568cbbf4cc828d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8f1248484478813b7881e4642cf5ca6dbcf86f74)