aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-08-16Allow rally_jobs without external networkCédric Ollivier1-0/+3
rally_jobs can verify network providers by skipping: - NeutronNetworks.create_and_delete_floating_ips - NeutronNetworks.create_and_list_floating_ips - NeutronNetworks.associate_and_dissociate_floating_ips Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: Ibda66e47f4d1101b53435ef4cd144dacbabff165 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-15Fix rally task file manipulationJuha Kosonen1-11/+11
Remove empty workload entries when applying blacklist in RallyJobs. Rally considers task file as invalid if it contains entries whose workload list empty. Change-Id: I34867c0aeea9c5ecf1294959d680e6de535be9cd Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-08-10Run Functest unit tests and linters via CircleCICédric Ollivier1-0/+26
It runs tox and publishes the artifacts. It's worth mentioning that all docker images are already built via Travis CI (amd64, arm and arm64) [1]. https://travis-ci.org/collivier/functest Change-Id: I48720f4f13dd1a93469b042000dd86a01854d8f0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-03Increase verify venv list in travis-ciCédric Ollivier1-1/+3
It cannot run perm due to the false umask in travis-ci [1]. [1] https://travis-ci.community/t/file-permissions-just-gone-up-to-664/1547/4 Change-Id: I788d846b1737cdff49959376e5bc92d8d1c4c970 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-03Run perm when checking all changesCédric Ollivier1-1/+1
It should be forbidden in releng jjbs if still needed. Change-Id: I7622f43603d41bb169d8a1341a38ed2d451459b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-28Pin ruamel.yaml to 0.15.100Cédric Ollivier1-0/+1
The last versions published between verification and build fails (0.16.0). Change-Id: I3ff72353ea29d8b5d946e3d15c21833c58211e0e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-28Remove former timeout -t argsCédric Ollivier1-7/+7
It completes the update to Alpine 3.10. Change-Id: I81793d4d17667b9bbab4b8659ebf90e1f79f3b5e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Fix remaining py36 testenvCédric Ollivier2-2/+2
Change-Id: Ifd5e65f597e2dcdb280fac6e3bc3ac999550a83f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Install python3.7 in travis-ciCédric Ollivier1-2/+2
https://travis-ci.org/collivier/functest/jobs/564349522 Change-Id: I8880256b226472157cdf2bfb5505d05160b3f1d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Add proxy in cloudify_imsThierry ALLENO1-2/+10
Add http-proxy configuration for pip in cloudify_ims testcase. Correct some errors. Change-Id: Ie09e1339536fd347ba0921e861474fecaf0876e4 Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com>
2019-07-27Updated from global requirementsCédric Ollivier2-2/+2
Change-Id: Icb22ff53d7aa123d42c06d60dff6f632ff78aa98 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Switch to Python 3.7 and Alpine 3.10Cédric Ollivier34-136/+131
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: If09d4796d48b7d0591e7926621d3bbf5ca1b6c24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-21Remove functest-tempest from travis-ciCédric Ollivier1-25/+0
It fails due to the former container builds [1] [1] https://travis-ci.org/collivier/functest/builds/557461053 Change-Id: I0d919ded13348e66852b79e2bdeba53add729d9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-21Conform with new ODL urlsCédric Ollivier1-1/+1
It now clones https://git.opendaylight.org/gerrit/integration/test Change-Id: Icff918305de1092cf6e985490188d409178273e1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-11Reuse same cidr in jujuCédric Ollivier1-1/+1
It seems fine with latest juju updates and eases setting no_proxy rules. Change-Id: I30e66568ec7339fc038b27e5ca47b26959842bf8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-10Allow scenarios without external networkCédric Ollivier3-2/+13
It allows creating testcases leveraging on Functest scenarios without external network. Then Rally can verify network providers by only skipping NovaServers.boot_server_associate_and_dissociate_floating_ip Change-Id: I07a9348214f7557195c7201466f7e37b2b980206 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-09set proxies in ubuntu for juju_epc use caseThierry ALLENO1-12/+66
Modification in add_proxy.sh in order to set proxy for juju_epc in various middleware(maven, subversion,...). And add some control for modification of cloudify container. Remove some trailing lines and define http_proxy using http_proxy_host and http_proxy_port. Change-Id: I9d85387f107b1b050ee96bf0ee6df9ba662b0df4 Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com>
2019-07-09Remove functest-tempestCédric Ollivier10-51/+22
Functest Kubernetes directly calls Rally API which force dependencies to rally and its plugins. Then it installs rally, rally-openstack and xrally-kubernetes as Functest dependencies. Change-Id: I18e0c2ba30588707beba1746aa4bfbc1ab7509c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-02Update python versions and testcase list in docsCédric Ollivier4-13/+17
Change-Id: I0ed395c39dd7e0ad1bf0f5d181fe6c2c397809e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add Barbican scenario in RallyCédric Ollivier6-1/+107
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is currently failing [1]. Barbican testing is optional as Gnocchi. [1] https://bugs.launchpad.net/rally/+bug/1819285 Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add swift scenario in rallyCédric Ollivier3-1/+76
As for refstack_object, it forces swift in SUT. Role is hardcoded to admin as for a few Neutron tests. Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-25Fix link in docs (E2 Testing in Kubernetes)Cédric Ollivier1-1/+1
It conforms with "Cleanup tombstone files in community/devel" [1] and fixes the gates [2] [1] https://github.com/kubernetes/community/commit/4bb72158434b2d29094b06af4c9bda284e5417fd [2] https://build.opnfv.org/ci/job/functest-verify-iruya/111/ Change-Id: I052bdac9a43a346ce07f93d8183f53767c757930 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-24Add warning messages in vyos_vrouterCédric Ollivier2-1/+9
Both Cloudify based testcases print the same warning messages if NEW_USER_ROLE is admin. An additional whitespace is removed too. Change-Id: Idf2a2ea4373efdc579f0ac3e0a69ec08a7fbf105 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-24Set proxies in Cloudify containerCédric Ollivier1-17/+39
add_proxy.sh now modifies Cloudify containers to allow proxies. It follows "Update and enable Cloudify-based testcases" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/66909/ Co-Authored-By: Thierry ALLENO <thierry.alleno@orange.com> Change-Id: I54cfcd73685695c5f66f24acd32f126786acf48e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-20Remove quota about instances in shakerCédric Ollivier1-0/+4
The default quota could be inadequate if lots of computes. Change-Id: I510d3ebd14c2a910b7be2bacc0b99d3059a7a881 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-15Fix ShellCheck warningsCédric Ollivier1-4/+4
Change-Id: Idf571b39d38b9184b2e08c183d4afe44784fbfe6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-14Turn all bashate warnings as errorsCédric Ollivier1-1/+1
Change-Id: Ic350ed8269347f5853a6d7b4e75cfccba6d85dcf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-14Update Xtesting to 0.70Cédric Ollivier4-16/+3
Change-Id: Ib2427112f1ec2e89aa349740c1bb82db1a3622f5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-13Merge "Publish "From Paris to Stockholm""Cedric Ollivier4-0/+216
2019-06-11Publish "From Paris to Stockholm"Cédric Ollivier4-0/+216
It highlights the changes done during the two Plugfests. Change-Id: Iff72fc259d13f0ce2b8e7c1b5f201196849d9bf6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-10Merge "Add rally_jobs in config patches"Juha Kosonen2-0/+14
2019-06-10Merge "Allow running Functest vs profiles defined by GSMA"Juha Kosonen1-0/+95
2019-06-09Add rally_jobs in config patchesCédric Ollivier2-0/+14
Change-Id: Iaf99ee1d6ea0b2c81874daf959f7430c564a1051 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-09Blacklist test_list_metadef_namespaces (Patrole)Cédric Ollivier2-0/+2
It seems dependent on test order (404 if no namespace) and sometimes fails in gates [1][2][3]. It will be enabled as soon it's fixed upstream or if SUT is wrong here. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-patrole-run/ [2] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-iruya-patrole-run/ [3] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-hunter-patrole-run/ Change-Id: I68e71e9b0753089e5620d6689ddff37fe66aeab7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-09Conform with latest Neutron rally jobCédric Ollivier1-1/+3
The last commit requires two additional task args [1][2]. [1] https://github.com/openstack/neutron/commit/ccef17605d1e28c418821c2235ba24c15893fff2#diff-720114afabbecd64333f4586a338f749 [2] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_jobs-run/145/console Change-Id: I4943f737be29bcadfead427a7852964e6438a018 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-08Allow running Functest vs profiles defined by GSMACédric Ollivier1-0/+95
It selects the close profils (here cpus, ram and disks) as being defined by GSMA if DEPLOY_SCENARIO contains GSMA. It allows a full OpenStack verification conformed with that profiles. Change-Id: I3830304a6cfcd651988063591f7ab0a7f57d124e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-08Update all patches about functest configsCédric Ollivier2-19/+36
It takes into account the last updates about snaps, cloudify and refstack. Change-Id: I959f8ed1c98cd1879b51b62252aeb38918af6a2c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-08Pin ruamel.yaml.jinja2Cédric Ollivier1-0/+1
It's out of openstack/requirements and last version breaks our stable containers [1]. It will be updated in master in a second step to ease cherry-picking. [1] https://build.opnfv.org/ci/job/functest-verify-unit-tests-and-docs-hunter/322/console Change-Id: I76e1965d49e6be6f185611bcfcd056d81bc599fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-04Updated from global requirementsCédric Ollivier1-1/+2
Change-Id: I3c2a69f63d38812656baf1f53a8b6a7ae1a0a242 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-02Publish rally logsCédric Ollivier3-25/+48
Both Rally and Tempest publish Rally debug logs. It also moves the logics from tempest to rally. Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-01correct permanent redirects in documentationVincentDanno6-14/+14
Change-Id: I5bcb402f51541483a2797629c44485e5d75913e3 Signed-off-by: VincentDanno <vincent.danno@orange.com>
2019-06-01Decode tempest exception output (py3)Cédric Ollivier2-2/+3
https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_compute-run/30/console Change-Id: I77264525917af5f67cdecae85ef7a50439499db8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-01Stop installing sfc and bgpvpn tempest pluginsCédric Ollivier4-8/+5
They are being integrated into neutron tempest plugin [1][2]. It will fix our gates [3]. [1] https://github.com/openstack/neutron-tempest-plugin/commit/1a987ecb4d310328cc4c2c5628dc5018dc7afc48 [2] https://github.com/openstack/neutron-tempest-plugin/commit/8dd49aac9fa27166d76755c7d62ea9f0553d8d74 [3] https://build.opnfv.org/ci/job/functest-latest-gate/199/ Change-Id: Iafcfd0cb9b33a271cf37f269d9a3a2086eb67414 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier7-1/+7
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-28Stop downgrading pipCédric Ollivier1-3/+0
The pip package poposed by Alpine is fine. Change-Id: I415757b8f4028c76e9d8cec4895306d843d42ac2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Install PyNaCl via packageCédric Ollivier2-8/+7
Building functest-core container sometimes reaches travis-ci timeout [0]. It currently selects the right version in master and stable/hunter. [0] https://travis-ci.org/collivier/functest/jobs/531417730 Change-Id: Ie6c8e729f76c98c6f8c8e9ca01b2c998081f7ce8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-25Run bandit when verifying changesCédric Ollivier3-1/+8
It reports only MEDIUM issues or higher like nova [1]. It selects bandit 1.1.0 as defined in nova and neutron lower constraints [2]. [1] https://github.com/openstack/nova/blob/master/tox.ini#L221 [2] https://github.com/openstack/nova/blob/master/lower-constraints.txt#L8 Change-Id: I6fc505f684701792d3e03659eb0feea8321452c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier10-56/+57
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-24Decode Bytes in logging callsCédric Ollivier5-36/+39
It fixes a few incorrect types in log calls [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/ Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-23Merge "Update Pylint score (10/10) in Release notes"Cedric Ollivier1-1/+1