aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-06-02Publish rally logsCédric Ollivier3-25/+48
Both Rally and Tempest publish Rally debug logs. It also moves the logics from tempest to rally. Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-01correct permanent redirects in documentationVincentDanno6-14/+14
Change-Id: I5bcb402f51541483a2797629c44485e5d75913e3 Signed-off-by: VincentDanno <vincent.danno@orange.com>
2019-06-01Decode tempest exception output (py3)Cédric Ollivier2-2/+3
https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_compute-run/30/console Change-Id: I77264525917af5f67cdecae85ef7a50439499db8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-01Stop installing sfc and bgpvpn tempest pluginsCédric Ollivier4-8/+5
They are being integrated into neutron tempest plugin [1][2]. It will fix our gates [3]. [1] https://github.com/openstack/neutron-tempest-plugin/commit/1a987ecb4d310328cc4c2c5628dc5018dc7afc48 [2] https://github.com/openstack/neutron-tempest-plugin/commit/8dd49aac9fa27166d76755c7d62ea9f0553d8d74 [3] https://build.opnfv.org/ci/job/functest-latest-gate/199/ Change-Id: Iafcfd0cb9b33a271cf37f269d9a3a2086eb67414 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier7-1/+7
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-28Stop downgrading pipCédric Ollivier1-3/+0
The pip package poposed by Alpine is fine. Change-Id: I415757b8f4028c76e9d8cec4895306d843d42ac2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Install PyNaCl via packageCédric Ollivier2-8/+7
Building functest-core container sometimes reaches travis-ci timeout [0]. It currently selects the right version in master and stable/hunter. [0] https://travis-ci.org/collivier/functest/jobs/531417730 Change-Id: Ie6c8e729f76c98c6f8c8e9ca01b2c998081f7ce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-25Run bandit when verifying changesCédric Ollivier3-1/+8
It reports only MEDIUM issues or higher like nova [1]. It selects bandit 1.1.0 as defined in nova and neutron lower constraints [2]. [1] https://github.com/openstack/nova/blob/master/tox.ini#L221 [2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8 Change-Id: I6fc505f684701792d3e03659eb0feea8321452c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier10-56/+57
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-24Decode Bytes in logging callsCédric Ollivier5-36/+39
It fixes a few incorrect types in log calls [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/ Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-23Merge "Update Pylint score (10/10) in Release notes"Cedric Ollivier1-1/+1
2019-05-23Enable Vmtp if py3Cédric Ollivier4-6/+5
It leverages on last Vmtp review which adds py3 support [1]. [1] https://review.opendev.org/659970 Change-Id: I8319b9e7eb88b9015961188d47657a8c67e0f8da Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-23Update Pylint score (10/10) in Release notesCédric Ollivier1-1/+1
https://build.opnfv.org/ci/job/functest-verify-unit-tests-and-docs-master/2239/console Change-Id: I5f124250aba3aa9a5ca0bc01221c06843bba1b35 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-21Avoid running local dnsmasq when testing IMSCédric Ollivier5-36/+25
It may be unsafe and it's useless for testing IMS if BONO_IP is set. Change-Id: I8b0f010956defbfa1fd22b5aa5cbea70bd2968a4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-16Fix python versionCédric Ollivier1-1/+1
It fixes an issue induced by an incomplete rebase [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/67833/ Change-Id: I9017becd06949afae0abd5f542a092570a163bc3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-16Add all RefStack listsCédric Ollivier9-132/+522
It adds platform and object targets. refstack_defcore is renamed to refstack_compute. Change-Id: Iad5bfb27be614aada98eef5b3148965e65210725 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-13Update to Python3Cédric Ollivier24-130/+338
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework librairies to latest release and Vmtp to master ([1] is needed) It patches cloudify rest client to support python3. Vmtp is currently disabled because it currently supports python2 only. [1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-13Merge "Stop leveraging on neutron-tempest-plugin package"Cedric Ollivier1-2/+8
2019-05-13Allow building containers when refstack.openstack.org is downCédric Ollivier2-2/+428
It has been down for days and break our gates again. Change-Id: I66e286f3624c776c7cec5164df53eb117550e78a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-11Stop leveraging on neutron-tempest-plugin packageCédric Ollivier1-2/+8
It reverts "Take new upper-constraints into account" [1] to follow the upstream revert [2]. [1] https://github.com/opnfv/functest/commit/14534c4ea68ee84645f8b1ddd836ed684a808385 [2] https://github.com/openstack/requirements/commit/ea2cfe661785c838991aa64b64e59aec245a0c0e Change-Id: I7085679ff6b04726842289133e526aaed87a416c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-08Disable Patrole network.test_agents_rbacCédric Ollivier2-0/+2
They don't clean routers (tempest-L3AgentsExtRbacTest-Router) after testing. Change-Id: I78cfc783feb51d0f1b029c98e988c07e57e1e694 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-04Enable volume backup testingCédric Ollivier1-1/+1
It conforms with OpenStack gates by default. Change-Id: Icc1537b0f8342666d2a2a0de4655ba99f4f42470 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Manage block_migration in RallyCédric Ollivier5-7/+16
It creates a new env var BLOCK_MIGRATION (True by default) to allow block migration for live migration in Rally. It updates scenarios and blacklisting to take that env vars into account. Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-30Use block devices for live migrationCédric Ollivier1-0/+2
The default values conform with OpenStack and Functest gates [1]. It could be set to false if shared storage-based live migration is supported [2]. It also currently disables cold migration. [1] http://logs.openstack.org/84/632984/24/check/tempest-multinode-full-py3/4216037/controller/logs/tempest_conf.txt.gz [2] https://docs.openstack.org/nova/pike/admin/configuring-migrations.html Change-Id: I0faa415eba610c20ba54353ac7ba7b0e83722c32 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-25Remove python warnings (yaml.load)Cédric Ollivier2-3/+3
It updates refstack_defcore and vmtp to conform with yaml [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_defcore-run/186/console Change-Id: I38e7a8d4c294c27f01c3e7385c4b716522a40334 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-25Leverage on DEBUG env varCédric Ollivier5-9/+126
It allows muting debug logs. Change-Id: I291f3bb7e0a450724a34997c720bde01f72c8e50 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-24Refactor modules to avoid duplicated codeCédric Ollivier9-178/+86
It also increases number of lines to warm about duplicated codes. Change-Id: I3914da8a90cbfe8fd024e9944c3adc8a617330d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-22Set max_microversion for placement and volumeCédric Ollivier1-0/+3
It sets max_microversion to latest because if both values are not specified, Tempest avoids tests which require a microversion [1]. It completes the previous change about nova [2]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html [2] https://gerrit.opnfv.org/gerrit/#/c/67318/ Change-Id: Ieab56a239077476dd9a0e1ee97ac4293c4075f5c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-20Add Stein in Nova API microversionsCédric Ollivier2-1/+11
Change-Id: I42e854122fde9495cb3472ccc78900eccb20670d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-20Increments version in setup.cfgCédric Ollivier1-1/+1
It prepares the file for the J-release. Change-Id: Ie637830c0397648a7efde8e061e2316145c97a41 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-20Remove all sdnvpn loggersCédric Ollivier1-6/+1
OPNFV sdnvpn is over. Change-Id: I78b6c45c6e5216795252be38dbc54f80f6e65061 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-20Build arm* functest-vnf containers via travis-ciCédric Ollivier3-14/+35
It doesn't build juju deps if arm* as they can't be cross-compiled. Then that deps won't be built in releng on native arm64 hosts It's worth mentioning that containers have never been executed in OPNFV gates. That change allows running all other VNFs on Raspberry PI and building containers without arm build servers. Change-Id: I836a72f049e7f0e6ae704f5b829914692d5b2c09 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-20Update all OpenStack refs to opendev.orgCédric Ollivier8-34/+28
All gates are failing due wrong to redirections (see os-faults [1][2]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console [2] https://travis-ci.org/collivier/functest/builds/522071220 Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-19Updated from global requirementsCédric Ollivier1-1/+1
Change-Id: I6ec8a42333c4b44928f5974bb67e445428b8c979 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-15Update Release NotesCédric Ollivier1-41/+5
Change-Id: Ie7826cf2ef8eb537f1b4f213c92c384e0b48c311 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-15Stop forcing admin_scope_domain = TrueCédric Ollivier1-1/+0
tempest fails vs devstack stable/stein and it passes successfully vs devstack stable/rocky (Functest gates) without that option. It may be added to tempest_conf.yaml if SUT requires it. Change-Id: I4730c25b25403fd130d71166a8778e06fd479935 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-14Disable falsy Patrole subtestsCédric Ollivier2-0/+4
It disables the two subtests which are failing in OpenStack Gates [1]. [1] http://logs.openstack.org/51/651851/1/check/patrole-admin/48dbeb0/testr_results.html.gz Change-Id: I6814d003d80593d2a89fefa439f0775187eb6f4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-14Speed up lxml buildCédric Ollivier2-1/+8
It allows cross-compiling it via travis-ci (benchmarking) [1][2] [1] https://lxml.de/installation.html [2] https://travis-ci.org/collivier/functest/jobs/519737041 Change-Id: I31609268d77405f036924a010cfb3dab520e9ea3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-13Verify py36 via travis-ciCédric Ollivier2-8/+5
Change-Id: I1180478c19d0f1c56e615a2af568cbbf4cc828d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-13Cross-compile arm and arm64 imagesCédric Ollivier2-5/+108
It allows building images for Raspberry PI via travis-ci. It builds all arm64 images except functest-benchmarking [1]. [1] https://travis-ci.org/collivier/functest/jobs/519673994 Change-Id: I695c3afe8aacda63b7eae0d2672cd836c19e8ceb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-13Stop generating policies for unexecuted servicesCédric Ollivier1-8/+2
It saves time when cross-compiling smoke. Then it allows building arm (Raspberry PI) smoke via travis-ci [1]. [1] https://travis-ci.org/collivier/functest/jobs/519630251 Change-Id: Ifbfcc0d726a8f74fd8a861bb52d6ea2543870e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-11Update .travis.ymlCédric Ollivier1-0/+5
It now selects Ubuntu Xenial and libssl1.0.0. It fixes all issues about SSL [1]. [1] https://travis-ci.org/collivier/functest/builds/518874638 Change-Id: Ib7217afc1cfbe3a7c675961b37ad9c097afca037 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-11Fix doc linksCédric Ollivier4-16/+5
It removes 1 link to ask.openstack.org which is being stopped. It also bypasses the issues due to LFN false certificates [1]. [1] https://travis-ci.org/collivier/functest/jobs/518170144 Change-Id: Iccfbc2d91aedb4617f2e29e9d03ba01e0fc58175 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-10Apply blacklist for OVN noha scenario as wellMichael Polenchuk1-0/+1
Change-Id: I1dd51a54f39967fcf6b3a522e2a548f81e5646a9 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2019-04-09Update tab resultsCédric Ollivier6-200/+58
It also removes all refs to components and to the former binaries. Change-Id: I4f7e3308673ba6ba4dd9c28a7a053e3d558c289d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-09Set cinder service type in rally testsJuha Kosonen8-1/+99
As a precondition for executing scenarios requiring volume, Rally expects the presence of service named as "cinder". In a case when there is only cinderv2 and cinderv3 configured in the system, Rally fails to validate a testcase even the volume service is working ok. Testcases in question changed to use v3. Change-Id: I42e7f846e80d3647df274b2e03add94c9f0a34d6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-04-02Remove 1 Patrole test with a hardcoded vxlan idCédric Ollivier2-0/+2
It may fail when testing OpenStack in production or when running testcases in parallel [1] because vxlan 200 is hardcoded [2] [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-patrole-run-75/results/patrole/tempest-report.html [2] https://github.com/openstack/patrole/blob/master/patrole_tempest_plugin/tests/api/network/test_networks_rbac.py#L208 Change-Id: Ibfaed6f3a95d016790baafebd203e49e152a889b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-01Update network context in selected rally testsJuha Kosonen2-18/+12
Network context not needed in following scenarios: NeutronNetworks.create_and_delete_routers NeutronNetworks.create_and_list_routers NeutronNetworks.create_and_list_subnets NeutronNetworks.create_and_update_routers NeutronNetworks.create_and_update_subnets NeutronNetworks.create_and_show_routers Router not needed in network context in following scenarios: NeutronNetworks.create_and_update_ports NeutronNetworks.create_and_delete_ports NeutronNetworks.create_and_delete_subnets NeutronNetworks.create_and_list_ports NeutronNetworks.create_and_show_ports NeutronNetworks.create_and_show_subnets This completes the patch skipping router creation [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/67429/ Change-Id: I80ea145a21168fd984cc9ef88d50af227f0d6ed4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-03-29Merge "Skip router creation in selected rally tests"Juha Kosonen1-6/+12
2019-03-29Use absolute dir when removing vmtp src dirCédric Ollivier1-1/+1
Change-Id: I7254201f97e9615d5d34ab9c199b33ef9de3680c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>