aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-06-29Add Barbican scenario in RallyCédric Ollivier6-1/+107
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is currently failing [1]. Barbican testing is optional as Gnocchi. [1] https://bugs.launchpad.net/rally/+bug/1819285 Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 902b70b40e61a2afe4d92ba7759a33f1306d54ca)
2019-06-29Update Rally packagesCédric Ollivier1-2/+2
It now selects releases instead of a commit id. Change-Id: I45d438674baf1c7de00748b81e6dc9024ee28840 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-29Merge "Add swift scenario in rally" into stable/iruyaCedric Ollivier3-1/+76
2019-06-28Add swift scenario in rallyCédric Ollivier3-1/+76
As for refstack_object, it forces swift in SUT. Role is hardcoded to admin as for a few Neutron tests. Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 72a238d63d6e2e15eb74d02c3030663404c3872c)
2019-06-26Merge "Add warning messages in vyos_vrouter" into stable/iruyaCedric Ollivier2-1/+9
2019-06-26Merge "Set proxies in Cloudify container" into stable/iruyaJuha Kosonen1-17/+39
2019-06-26Merge "Fix link in docs (E2 Testing in Kubernetes)" into stable/iruyaJuha Kosonen1-1/+1
2019-06-25Add warning messages in vyos_vrouterCédric Ollivier2-1/+9
Both Cloudify based testcases print the same warning messages if NEW_USER_ROLE is admin. An additional whitespace is removed too. Change-Id: Idf2a2ea4373efdc579f0ac3e0a69ec08a7fbf105 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b95cdce13a8c51f285e285a3c4332cf1732abadb)
2019-06-25Set proxies in Cloudify containerCédric Ollivier1-17/+39
add_proxy.sh now modifies Cloudify containers to allow proxies. It follows "Update and enable Cloudify-based testcases" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/66909/ Co-Authored-By: Thierry ALLENO <thierry.alleno@orange.com> Change-Id: I54cfcd73685695c5f66f24acd32f126786acf48e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f246dd3889df5302756c9c73d70b346695aca146)
2019-06-25Fix link in docs (E2 Testing in Kubernetes)Cédric Ollivier1-1/+1
It conforms with "Cleanup tombstone files in community/devel" [1] and fixes the gates [2] [1] https://github.com/kubernetes/community/commit/4bb72158434b2d29094b06af4c9bda284e5417fd [2] https://build.opnfv.org/ci/job/functest-verify-iruya/111/ Change-Id: I052bdac9a43a346ce07f93d8183f53767c757930 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 655020449ba281dce52821cd36f5dd01bffebee9)
2019-06-20Remove quota about instances in shakerCédric Ollivier1-0/+4
The default quota could be inadequate if lots of computes. Change-Id: I510d3ebd14c2a910b7be2bacc0b99d3059a7a881 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 234be6e5895a91ca3a83f3bef12a10631bbe6522)
2019-06-19Update tempest commit idCédric Ollivier6-5/+6
It includes "Fix region leaks after testing endpoints" [1]. [1] https://github.com/openstack/tempest/commit/e8088d1218eba0b8e4ed59fa5ca30ac9b664b7fb Change-Id: I063a9c4e2f09a27c79ea77ba0cf9307642950070 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-15Fix ShellCheck warningsCédric Ollivier1-4/+4
Change-Id: Idf571b39d38b9184b2e08c183d4afe44784fbfe6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit db7c7d3031c8f9a562c6e3db0922e1cfb92ea92b)
2019-06-15Turn all bashate warnings as errorsCédric Ollivier2-4/+9
Change-Id: Ic350ed8269347f5853a6d7b4e75cfccba6d85dcf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 12b1a3258219cd301866ea79924e08cfb2a7420e)
2019-06-09Add rally_jobs in config patchesCédric Ollivier2-0/+10
Change-Id: Iaf99ee1d6ea0b2c81874daf959f7430c564a1051 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e39bc8e266d451f2e0ade7b26aae6d6895d07234)
2019-06-09Add one missing output decode in rally.pyCédric Ollivier1-1/+1
It partially cherry-picks "Conform with latest Neutron rally job" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/68021/ Change-Id: I4943f737be29bcadfead427a7852964e6438a018 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-09Blacklist test_list_metadef_namespaces (Patrole)Cédric Ollivier2-0/+2
It seems dependent on test order (404 if no namespace) and sometimes fails in gates [1][2][3]. It will be enabled as soon it's fixed upstream or if SUT is wrong here. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-patrole-run/ [2] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-iruya-patrole-run/ [3] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-hunter-patrole-run/ Change-Id: I68e71e9b0753089e5620d6689ddff37fe66aeab7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 02b9592a129472ffd26206541f8efefe1f759957)
2019-06-08Update all patches about functest configsCédric Ollivier2-19/+36
It takes into account the last updates about snaps, cloudify and refstack. Change-Id: I959f8ed1c98cd1879b51b62252aeb38918af6a2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dbb00ca3ee3e3349b42c8133dee6b1abdbcb10c3)
2019-06-08Pin ruamel.yaml.jinja2Cédric Ollivier1-0/+1
It's out of openstack/requirements and last version breaks our stable containers [1]. It will be updated in master in a second step to ease cherry-picking. [1] https://build.opnfv.org/ci/job/functest-verify-unit-tests-and-docs-hunter/322/console Change-Id: I76e1965d49e6be6f185611bcfcd056d81bc599fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3472870b0e42c135d004e0006ad3e3607036e553)
2019-06-04Updated from global requirementsCédric Ollivier1-1/+2
Change-Id: Icdca3cdc4abbe39e8e65f336b58cfb0bd4b61281 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-03Publish rally logsCédric Ollivier3-25/+48
Both Rally and Tempest publish Rally debug logs. It also moves the logics from tempest to rally. Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit bc88eff8f5850f8207431bb8d1958fe6b9cd09e8)
2019-06-01Merge "correct permanent redirects in documentation" into stable/iruyaCedric Ollivier6-14/+14
2019-06-01correct permanent redirects in documentationVincentDanno6-14/+14
Change-Id: I5bcb402f51541483a2797629c44485e5d75913e3 Signed-off-by: VincentDanno <vincent.danno@orange.com>
2019-06-01Decode tempest exception output (py3)Cédric Ollivier2-2/+3
https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_compute-run/30/console Change-Id: I77264525917af5f67cdecae85ef7a50439499db8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier7-1/+7
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 7a628f087403089d282cda14bcba858d8b0bc6c3)
2019-05-28Stop downgrading pipCédric Ollivier1-3/+0
The pip package poposed by Alpine is fine. Change-Id: I415757b8f4028c76e9d8cec4895306d843d42ac2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5819ff6a14e7e89b6c7004336bfcabed9f16baa4)
2019-05-28Install PyNaCl via packageCédric Ollivier2-8/+7
Building functest-core container sometimes reaches travis-ci timeout [0]. It currently selects the right version in master and stable/hunter. [0] https://travis-ci.org/collivier/functest/jobs/531417730 Change-Id: Ie6c8e729f76c98c6f8c8e9ca01b2c998081f7ce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6aad708727e41eaa8f61a104323386568a163dd3)
2019-05-25Run bandit when verifying changesCédric Ollivier3-1/+8
It reports only MEDIUM issues or higher like nova [1]. It selects bandit 1.1.0 as defined in nova and neutron lower constraints [2]. [1] https://github.com/openstack/nova/blob/master/tox.ini#L221 [2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8 Change-Id: I6fc505f684701792d3e03659eb0feea8321452c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0440ffcac18991395799e5aafc9243e028917ab6)
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier10-56/+57
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5853dd1ef3c522a975f9685250b1b3e85588f738)
2019-05-24Decode Bytes in logging callsCédric Ollivier5-36/+39
It fixes a few incorrect types in log calls [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/ Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 7d58f89103a8c44fd166c3e06b492ade63e5c5b3)
2019-05-23Enable Vmtp if py3Cédric Ollivier1-3/+4
It leverages on last Vmtp review which adds py3 support [1]. [1] https://review.opendev.org/659970 Change-Id: I8319b9e7eb88b9015961188d47657a8c67e0f8da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f994b9180b621ae6bb6397acd23de8f1a625c4cd)
2019-05-23Update to Python3Cédric Ollivier11-86/+57
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework librairies to latest release and Vmtp to master ([1] is needed) It patches cloudify rest client to support python3. Vmtp is currently disabled because it currently supports python2 only. [1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2a0702ea914a574ffa7c6d6f83a5c606e24ebd0a)
2019-05-23Update Pylint score (10/10) in Release notesCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-verify-unit-tests-and-docs-master/2239/console Change-Id: I5f124250aba3aa9a5ca0bc01221c06843bba1b35 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit ab5dfff578e7c9686882c844ff2c0fed1f663e6f)
2019-05-21Avoid running local dnsmasq when testing IMSCédric Ollivier5-36/+25
It may be unsafe and it's useless for testing IMS if BONO_IP is set. Change-Id: I8b0f010956defbfa1fd22b5aa5cbea70bd2968a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a82827bd4f93c318f0bc2554928ab2213d1ee766)
2019-05-18Update tempest to avoid resource leaks in EndPointGroupsTestCédric Ollivier5-5/+5
It includes "Fix resource leaks in EndPointGroupsTest" [1] which removes the 2 remaining tempest services. It's worth mentioning they raised side effects when trying to connect to Horizon. Change-Id: Ic85fa38a4690c5532d10d21d2eec64d99ab1e8cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-16Add all RefStack listsCédric Ollivier9-15/+518
It adds platform and object targets. refstack_defcore is renamed to refstack_compute. Change-Id: Iad5bfb27be614aada98eef5b3148965e65210725 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ce75381bdce754d40f632894f81a31ba6771a39f)
2019-05-13Update defcore.txt to the latest cached oneCédric Ollivier1-116/+3
Change-Id: Iea42b7ef8a76ff1c7bd56e88290c716776dd9291 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-13Merge "Stop leveraging on neutron-tempest-plugin package" into stable/iruyaCedric Ollivier1-2/+8
2019-05-13Allow building containers when refstack.openstack.org is downCédric Ollivier2-2/+428
It has been down for days and break our gates again. Change-Id: I66e286f3624c776c7cec5164df53eb117550e78a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6b578b9068164eab33b2cc2d6002f59b9af88f8d)
2019-05-11Stop leveraging on neutron-tempest-plugin packageCédric Ollivier1-2/+8
It reverts "Take new upper-constraints into account" [1] to follow the upstream revert [2]. [1] https://github.com/opnfv/functest/commit/14534c4ea68ee84645f8b1ddd836ed684a808385 [2] https://github.com/openstack/requirements/commit/ea2cfe661785c838991aa64b64e59aec245a0c0e Change-Id: I7085679ff6b04726842289133e526aaed87a416c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8bd9733158239ee3bf24f2f3d75ec108099d7994)
2019-05-08Disable Patrole network.test_agents_rbacCédric Ollivier2-0/+2
They don't clean routers (tempest-L3AgentsExtRbacTest-Router) after testing. Change-Id: I78cfc783feb51d0f1b029c98e988c07e57e1e694 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d4178d425312497412e9832fb6cb1a074e5099f3)
2019-05-04Enable volume backup testingCédric Ollivier1-1/+1
It conforms with OpenStack gates by default. Change-Id: Icc1537b0f8342666d2a2a0de4655ba99f4f42470 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 305f9f41df7ecba640fc4552269bca8ee588b92c)
2019-05-02Manage block_migration in RallyCédric Ollivier5-7/+16
It creates a new env var BLOCK_MIGRATION (True by default) to allow block migration for live migration in Rally. It updates scenarios and blacklisting to take that env vars into account. Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 940e49a6cdf7ae0f8286c953952a9757ba63a20b)
2019-05-01Use block devices for live migrationCédric Ollivier1-0/+2
The default values conform with OpenStack and Functest gates [1]. It could be set to false if shared storage-based live migration is supported [2]. It also currently disables cold migration. [1] http://logs.openstack.org/84/632984/24/check/tempest-multinode-full-py3/4216037/controller/logs/tempest_conf.txt.gz [2] https://docs.openstack.org/nova/pike/admin/configuring-migrations.html Change-Id: I0faa415eba610c20ba54353ac7ba7b0e83722c32 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f1695eceb3d18501a603dcc89da020c676d9b617)
2019-04-25Leverage on DEBUG env varCédric Ollivier5-9/+126
It allows muting debug logs. Change-Id: I291f3bb7e0a450724a34997c720bde01f72c8e50 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d777f2e588a321d5c01e2e50ffa5c8fc5a27c77c)
2019-04-25Merge "Refactor modules to avoid duplicated code" into stable/iruyaJuha Kosonen9-178/+86
2019-04-24Refactor modules to avoid duplicated codeCédric Ollivier9-178/+86
It also increases number of lines to warm about duplicated codes. Change-Id: I3914da8a90cbfe8fd024e9944c3adc8a617330d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9dcc30874194382a25c66baf359b863c6e013caf)
2019-04-23Set max_microversion for placement and volumeCédric Ollivier1-0/+3
It sets max_microversion to latest because if both values are not specified, Tempest avoids tests which require a microversion [1]. It completes the previous change about nova [2]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html [2] https://gerrit.opnfv.org/gerrit/#/c/67318/ Change-Id: Ieab56a239077476dd9a0e1ee97ac4293c4075f5c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b9048a25355e1d6c29c84ca10a3d859841468f50)
2019-04-22Install neutron package due to upper-constraintsCédric Ollivier1-3/+2
SFC requires constraints about neutron. We do switch to packages instead of cloning repos when generating policy files [1]. [1] https://build.opnfv.org/ci/view/functest%20(Installer%20gates)/job/functest-docker-iruya/25/ Change-Id: Ia2e8a1aa704372e543e9e967ba90e6d9e5db6c9a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-21Leverage on stein networking packagesCédric Ollivier1-2/+2
It updates refs for networking sfc and bgpvpn. Change-Id: I78f9815c688a3a4814f17f916e7429d2599af971 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>