aboutsummaryrefslogtreecommitdiffstats
path: root/docker/smoke
AgeCommit message (Collapse)AuthorFilesLines
2020-04-19Run sequentially tempest_heatCédric Ollivier1-1/+1
It's forced by design else it remains a few resources. It also sets fixed_subnet_name and network_for_ssh to avoid falsy discovery as it seems [1] [1] http://artifacts.opnfv.org/functest/X5GDYF3B0R2B/functest-opnfv-functest-smoke-jerma-tempest_heat-run-18/tempest_heat/tempest-report.html Change-Id: Ieb584ddc1c0b4ebb543e9d69277a20aaee0fbac0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heat (heat-tempest-plugin)Cédric Ollivier2-2/+23
It asks for the Fedora-Cloud-Base image and a second user account. It should be noted that heat-tempest-plugin duplicates all configs from tempest. Minimal image is still Cirros and the first account is the admin one. Then it conforms with the TempestCommon logic. AodhAlarmTest is skipped by default because pre conditions are missing. SoftwareConfigIntegrationTest is skipped as in gates because it requires a custom image [1] [1] https://github.com/openstack/heat/blob/master/devstack/lib/heat#L444 Change-Id: I8b39dc65ef3714411cd828e17b95e124f2e90f34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-04Reduce Tempest multi threadsCédric Ollivier1-8/+8
It decreases the threads from 4 to 3 to allow running the testcases in parallel. Else a few tests sometimes fail. Change-Id: I268eff5a72d5de5b26d7549ac74ee0e2a05cb61e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Revert "Keep the modified tempest"Cédric Ollivier1-1/+0
It's simply useless and may raise side effects later. Change-Id: Idaeab672480597ed39a5e29719580fee38aeb4ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Keep the modified tempestCédric Ollivier1-0/+1
http://artifacts.opnfv.org/functest/CRY58ZS3031L/functest-ovn-opnfv-functest-healthcheck-jerma-tempest_smoke-run-37/tempest_smoke/tempest-report.html Change-Id: I9598a45b09151fa267294716f70e65e3050f0239 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 21b512e55eb36e38160b697baae44c464fce9034)
2020-02-28Remove /src/glance after generating policy.confCédric Ollivier1-2/+2
It also cleans former dirs. Change-Id: I924436652e3fe0f19d0755024839ecb5290aa2f3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-17Select OpenStack requirements masterCédric Ollivier1-2/+2
https://github.com/openstack/requirements/commit/7a04f4e96205f16e74a9a08fe60b168c187516d6 Change-Id: I9ed510c45f63714b64dcb9fa90e4d7239f93ee3f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-17Bypass upstream requirement issuesCédric Ollivier1-4/+6
https://review.opendev.org/#/c/708041/ Change-Id: Iebbf0a720fe9d1c62083028d0bc0078bf7680753 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-16Remove refstack version tagCédric Ollivier1-1/+0
It has been unread since the files are cached. Change-Id: Iba74163ac486dddaee4e81a340fcbe2b9297071f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-24Update Alpine to 3.11Cédric Ollivier1-1/+1
It also updates Python to 3.8 (default version). It selects arm32v6 et arm64v8 repos and switches multiarch binfmt. https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: Ib41cf0ab805ce2137658f3ff656b0a88c7b4ebf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-24Generate /etc/glance/policy.jsonCédric Ollivier1-2/+3
It takes into account the following change in glance [1] [1] https://github.com/openstack/glance/commit/5c17e4c7ef533b57ba15ead931b0452e23f46b4b#diff-335462891f7178710c6ca7185f9f877c Change-Id: I61e37cd2383620fa6db665f1858830b9c5d13938 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-07Run tests sequentially in tempest_slowCédric Ollivier1-1/+1
concurrency is set to 2 in the upstream job [1] but it conflicts with serial also passed. As it fails once without any other test in parallel, the number of executors should be decreased [2]. [0] https://799189c1bf6a1aa9c8de-48970bda2a30ee836a70a12e61555969.ssl.cf1.rackcdn.com/694893/1/check/tempest-slow/1bf5851/job-output.txt [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-cntt-hunter-tempest_slow-run-7/tempest_slow/tempest-report.html Change-Id: I51bc9a584cf4b32a88b7a84d9387e7b8e90281c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-16Optimize lxml build if armCédric Ollivier1-0/+1
Else it raises timeouts on travis-ci.org: https://www.travis-ci.org/collivier/functest/builds/612068457 https://www.travis-ci.org/collivier/functest/builds/612116863 https://www.travis-ci.org/collivier/functest/jobs/612116916 Change-Id: Id34144ebcdf3f418d5a07068434eb7aa96b023d2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-26Add keystone-tempest-pluginCédric Ollivier2-2/+23
It adds tempest_keystone which runs the tests proposed by keystone-tempest-plugin [1]. [1] https://opendev.org/openstack/keystone-tempest-plugin Change-Id: I83db584c37fe63a549ccf396b03e034778254b3a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-26Add cinder-tempest-pluginCédric Ollivier2-1/+26
It adds tempest_cinder which runs the tests proposed by cinder-tempest-plugin [1]. test_incremental_backup is disabled because it currently fails vs Functest SUT (under analysis). [1] https://opendev.org/openstack/cinder-tempest-plugin Change-Id: I85b255eb05b9ab1c74c3829148da5230d6c7647e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-26Update RefStack lists to 2019.06Cédric Ollivier4-3/+12
Change-Id: I9d3abc3996857d8905007640250b94025735809c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-23Allow checking Tests countCédric Ollivier1-0/+3
It meets CNTT requirements (verifying conformance with a reference implementation) and may protect vs synchronization issues (see gambia refstack_defcore). Change-Id: I842bc4ed91eec6bc545c489e3686d0d41dae7b44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-14Remove any instance quota in tempest_scenarioCédric Ollivier1-1/+1
The next testcase can reach the default limit if lots of computes available [1]. tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-tempest_scenario-run-325/results/tempest_scenario/test_raw_list.txt Change-Id: Ibf68e2a367199afee3f6198ebf683be6cd938d94 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-28Merge "Add tempest slow"Cedric Ollivier1-0/+17
2019-08-27Add Octavia testingCédric Ollivier2-2/+27
It integrates Octavia Tempest Plugin. The new testcase octavia currently covers API only [1]. [1] https://logs.opendev.org/46/674846/2/check/octavia-v2-dsvm-noop-api/fe37c58/testr_results.html.gz Change-Id: I2a11a19aa0c43701499dc9e17bd69b9387b53b58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-26Add tempest slowCédric Ollivier1-0/+17
It conforms with tempest-slow-py3 executed in Neutron Gates [1]. [1] https://logs.opendev.org/68/672568/6/check/tempest-slow-py3/49fece6/testr_results.html.gz Change-Id: I0c1c6f7be38c9fcdd1a32e5cfa2bc4d8414885e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-27Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-1/+1
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: If09d4796d48b7d0591e7926621d3bbf5ca1b6c24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-09Remove functest-tempestCédric Ollivier1-2/+2
Functest Kubernetes directly calls Rally API which force dependencies to rally and its plugins. Then it installs rally, rally-openstack and xrally-kubernetes as Functest dependencies. Change-Id: I18e0c2ba30588707beba1746aa4bfbc1ab7509c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add Barbican scenario in RallyCédric Ollivier1-0/+1
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is currently failing [1]. Barbican testing is optional as Gnocchi. [1] https://bugs.launchpad.net/rally/+bug/1819285 Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-09Blacklist test_list_metadef_namespaces (Patrole)Cédric Ollivier1-0/+1
It seems dependent on test order (404 if no namespace) and sometimes fails in gates [1][2][3]. It will be enabled as soon it's fixed upstream or if SUT is wrong here. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-patrole-run/ [2] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-iruya-patrole-run/ [3] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-hunter-patrole-run/ Change-Id: I68e71e9b0753089e5620d6689ddff37fe66aeab7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-01Stop installing sfc and bgpvpn tempest pluginsCédric Ollivier2-4/+3
They are being integrated into neutron tempest plugin [1][2]. It will fix our gates [3]. [1] https://github.com/openstack/neutron-tempest-plugin/commit/1a987ecb4d310328cc4c2c5628dc5018dc7afc48 [2] https://github.com/openstack/neutron-tempest-plugin/commit/8dd49aac9fa27166d76755c7d62ea9f0553d8d74 [3] https://build.opnfv.org/ci/job/functest-latest-gate/199/ Change-Id: Iafcfd0cb9b33a271cf37f269d9a3a2086eb67414 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-28Remove PyNacl contraints in FeaturesCédric Ollivier1-0/+1
It conforms with "Install PyNaCl via package" [1]. functest-feature may raise timeouts when cross-compiling PyNacl [2]. [1] https://gerrit.opnfv.org/gerrit/#/c/67956/ [2] https://travis-ci.org/collivier/functest/jobs/538119733 Change-Id: I986677b869f62caee6be219ee1de622b7bc20ca4 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
2019-05-16Fix python versionCédric Ollivier1-1/+1
It fixes an issue induced by an incomplete rebase [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/67833/ Change-Id: I9017becd06949afae0abd5f542a092570a163bc3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-16Add all RefStack listsCédric Ollivier5-121/+476
It adds platform and object targets. refstack_defcore is renamed to refstack_compute. Change-Id: Iad5bfb27be614aada98eef5b3148965e65210725 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-13Update to Python3Cédric Ollivier1-4/+4
Functest containers leverage on Python3 instead of python2. https://mail.python.org/pipermail/python-dev/2018-March/152348.html It also updates robotframework librairies to latest release and Vmtp to master ([1] is needed) It patches cloudify rest client to support python3. Vmtp is currently disabled because it currently supports python2 only. [1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-13Merge "Stop leveraging on neutron-tempest-plugin package"Cedric Ollivier1-2/+8
2019-05-13Allow building containers when refstack.openstack.org is downCédric Ollivier2-2/+428
It has been down for days and break our gates again. Change-Id: I66e286f3624c776c7cec5164df53eb117550e78a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-11Stop leveraging on neutron-tempest-plugin packageCédric Ollivier1-2/+8
It reverts "Take new upper-constraints into account" [1] to follow the upstream revert [2]. [1] https://github.com/opnfv/functest/commit/14534c4ea68ee84645f8b1ddd836ed684a808385 [2] https://github.com/openstack/requirements/commit/ea2cfe661785c838991aa64b64e59aec245a0c0e Change-Id: I7085679ff6b04726842289133e526aaed87a416c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-08Disable Patrole network.test_agents_rbacCédric Ollivier1-0/+1
They don't clean routers (tempest-L3AgentsExtRbacTest-Router) after testing. Change-Id: I78cfc783feb51d0f1b029c98e988c07e57e1e694 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-20Update all OpenStack refs to opendev.orgCédric Ollivier1-6/+6
All gates are failing due wrong to redirections (see os-faults [1][2]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console [2] https://travis-ci.org/collivier/functest/builds/522071220 Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-14Disable falsy Patrole subtestsCédric Ollivier1-0/+2
It disables the two subtests which are failing in OpenStack Gates [1]. [1] http://logs.openstack.org/51/651851/1/check/patrole-admin/48dbeb0/testr_results.html.gz Change-Id: I6814d003d80593d2a89fefa439f0775187eb6f4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-13Stop generating policies for unexecuted servicesCédric Ollivier1-8/+2
It saves time when cross-compiling smoke. Then it allows building arm (Raspberry PI) smoke via travis-ci [1]. [1] https://travis-ci.org/collivier/functest/jobs/519630251 Change-Id: Ifbfcc0d726a8f74fd8a861bb52d6ea2543870e0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-02Remove 1 Patrole test with a hardcoded vxlan idCédric Ollivier1-0/+1
It may fail when testing OpenStack in production or when running testcases in parallel [1] because vxlan 200 is hardcoded [2] [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-patrole-run-75/results/patrole/tempest-report.html [2] https://github.com/openstack/patrole/blob/master/patrole_tempest_plugin/tests/api/network/test_networks_rbac.py#L208 Change-Id: Ibfaed6f3a95d016790baafebd203e49e152a889b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-25Clean OpenStack service tmp dirsCédric Ollivier1-1/+2
They can be safely removed once all policy.json are generated. Change-Id: I4eec21650fd661a616647502ee9e30589d67bb89 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-21Update RefStack list to 2018.11Cédric Ollivier2-428/+3
It sets max_microversion to latest because if both values are not specified, Tempest avoids tests which require a microversion [1]. Then test_keypairsv22_create_list_show_with_type is skipped and refstack_defcore fails [2]. It also partially reverts "Allow building containers when refstack.openstack.org is down" [3]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html [2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-refstack_defcore-run-147/results/refstack_defcore/tempest-report.html [3] https://gerrit.opnfv.org/gerrit/#/c/67232/ Change-Id: Ia87543bb476d3047684e71ddfd05c2aa3f10bbfe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-19Do not allow testcase skipping in refstackJuha Kosonen1-0/+1
Set the result of refstack_defcore as failed if there were skipped testcases in a run. Change-Id: Id782c2dee511cefbafd5b4440f386fd66f934a47 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-03-12Remove Snaps-based testcasesCédric Ollivier1-16/+0
Snaps hasn't been synchronized for a while regarding requirements. We do remove it due to the inactivity. All test result tabs will be updated in a second change. Change-Id: I834afd902829ed3883b0e88e92aa806ec43d6fcf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-03-11Allow building containers when refstack.openstack.org is downCédric Ollivier2-3/+428
It has been down for days and break our gates. Change-Id: I2e18a95abaced050f85f6efb8e849e0a5d497ea1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-27Take new upper-constraints into accountCédric Ollivier1-7/+2
neutron-tempest-plugin is now part of upper-constraints [1]. [1] https://github.com/openstack/requirements/commit/baa8b82c4ce14551c585ed1dcae0509eb81858c3 Change-Id: I80fb40530d7f2698ecedd7a6047d6395dc92f436 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-18Only run bgpvpn tempest api testsCédric Ollivier1-1/+1
It conforms with SFC regex and fits OPNFV criteria. Running scenarios may force the use of bagpipe [1]. The SUT (functest-virtual) is being updated to verify SFC and BGPVPN apis. [1] https://docs.openstack.org/networking-bgpvpn/latest/user/drivers/bagpipe/index.html Change-Id: I1442b9cac7eaba1aeef04e36a2f790bd29f90976 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-15Harden upper-constraints.txt operationsCédric Ollivier1-5/+4
It takes into account the wget exit values and avoids manipulating a falsy empty file. It won't help fixing the network outages in LF network which have been highlighted by false failures in api_check (the wrong snaps package is installed [1]) [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-api_check-run/100/console Change-Id: Ic9b75965b1ffb1f7bb342ff216bda9933ca75f0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-13Fix smoke testcase listCédric Ollivier1-14/+0
Rally_jobs were moved into benchmarking. It completes "Move testcases in the right tiers" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/66875/ Change-Id: I1c2da77eff6682f85ab8504750077c9ee542edb8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Remove tempest_smoke from smokeCédric Ollivier1-18/+0
It completes "Move testcases in the right tiers" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/66863/ Change-Id: Ic2e6ebf9371de87caafbfdb54029a24440e6fd5b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-06Move testcases in the right tiersCédric Ollivier2-4/+35
Here are the moves: - tempest_smoke in healthcheck - tempest_full and tempest_scenario in smoke - rally_jobs in benchmarking It avoids conflicts between benchmarking tools and few functional tests (short timeouts). Then it should allow running in parallel all testcases in one tiers. It also allows cleaning the additional steps defined in releng. rally_full could move in benchmarking in a second step. Change-Id: I0bc657557a61c7d9bf7679b4f2dbda08c36728ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-26Set Gnocchi scenario as optional in rally testsJuha Kosonen1-0/+6
The execution of an optional scenario is skipped if the corresponding openstack service does not exist. Change-Id: I8721f26ebc253ce02138b85d6c88e659c5afae80 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>