aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-04-16Update Neutron regexCédric Ollivier1-0/+1
It skips the latest tests added in neutron-tempest-plugin [1][2] [1] https://review.opendev.org/#/c/711656/ [2] http://artifacts.opnfv.org/functest/CQY2GVXZ1NTU/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-13/neutron-tempest-plugin-api-cntt/tempest-report.html Change-Id: Iae9cd7a45f908c310133bf354b205a623f4c7476 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-14Decrease volume size in boot_server_attach_created_volume_and_live_migrateCédric Ollivier2-2/+2
It now conforms with the other tasks which sets 1 Gb as default. Change-Id: Ibadb2bee2bea7a79db2eb27d0cc1867a823d7935 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-12Merge "Conform with the upstream create_and_delete_subnets"Cedric Ollivier1-2/+0
2020-04-11Disable VolumeBackupRestoreIntegrationTest if OVNCédric Ollivier1-1/+2
It completes "Skip VolumeBackupRestoreIntegrationTest in temptest_heat" Change-Id: I798cefa3a3648277cc321cc9e85be9b634aa9e20 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-10Set concurrency and containers_per_tenant to 1Cédric Ollivier1-6/+6
Most of the rally_full runs failed vs our new SUTs (radosgw) . This two params fail the testing when higher than 1 (verified independently). As the new test config works when hugely tested in //, it makes sens to merge the new config to fix the gates. This patch will be safely reverted if the issue is confirmed on SUT. Change-Id: I222652d484a5e06190c12d45d6c1882de5ab9eec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-10Update CNTT regexes and countsCédric Ollivier1-1/+2
It increases neutron-tempest-plugin-api test count to 502. It skips test_multiattach_rw_volume_update_failure which depends on volume multi-attach. http://artifacts.opnfv.org/functest/BVDINIZ8P8UC/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-6/neutron-tempest-plugin-api-cntt/tempest-report.html http://artifacts.opnfv.org/functest/BVDINIZ8P8UC/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-5/tempest_full_cntt/tempest-report.html Change-Id: Id4d4918ee24ef15f9610e706d6e90dfa3ae2cc43 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-09Conform with the upstream create_and_delete_subnetsCédric Ollivier1-2/+0
Ovn fails vs rally_full [1] but passes vs rally_jobs. It reverts the small diff between rally_full and rally_jobs added by "Update network context in selected rally tests". Then it may raise side effects in case of L2-only testing [2] [1] http://artifacts.opnfv.org/functest/JDD0PPKUOYO5/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run-9/rally_full_cntt/rally_full_cntt.html [2] https://github.com/opnfv/functest/commit/b4b2e7f9a5a3cb3379b45ac4ddd0ef949974a698 Change-Id: I5c7591a46de1b534b6b3dc511ca2caf20ac48e1f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-07Skip VolumeBackupRestoreIntegrationTest in temptest_heatCédric Ollivier1-1/+2
It's linked to vbd which is false in many cases [1]. e.g. IMAGE_PROPERTIES=hw_scsi_model:virtio-scsi,hw_disk_bus:scsi Enabling it requires upstream changes to configure the right device. [1] http://artifacts.opnfv.org/functest/FHHSBCPDUV6C/functest-opnfv-functest-smoke-latest-tempest_heat-run-7/tempest_heat/tempest-report.html Change-Id: I2632779e96b7b0850d1937a8ec3c7bf4607862a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Install libstdc++ in functest-coreCédric Ollivier1-1/+1
import ujson ImportError: Error loading shared library libstdc++.so.6 Change-Id: I0d479d9d4344d4a5c93174c7b0162b5c0234f2c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add tempest_heat (heat-tempest-plugin)Cédric Ollivier10-2/+118
It asks for the Fedora-Cloud-Base image and a second user account. It should be noted that heat-tempest-plugin duplicates all configs from tempest. Minimal image is still Cirros and the first account is the admin one. Then it conforms with the TempestCommon logic. AodhAlarmTest is skipped by default because pre conditions are missing. SoftwareConfigIntegrationTest is skipped as in gates because it requires a custom image [1] [1] https://github.com/openstack/heat/blob/master/devstack/lib/heat#L444 Change-Id: I8b39dc65ef3714411cd828e17b95e124f2e90f34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-06Add swift sections in OVN's tempest_conf.yamlCédric Ollivier1-0/+5
http://artifacts.opnfv.org/functest/4LM7FMUVFMML/functest-ovn-opnfv-functest-smoke-jerma-tempest_slow-run-41/tempest_slow/tempest-report.html Change-Id: I1a3f684a9059eac21695bd655df976bceebf26f0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Remove last skipped tests in neutron-tempest-plugin-api-cnttCédric Ollivier1-0/+2
It takes into account last results [1] [1] http://artifacts.opnfv.org/functest/LIF2Y3SVUWLD/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-2/neutron-tempest-plugin-api-cntt/tempest-report.html Change-Id: Idd03c5aa42309eb5f254d6a99ea7e7206ee705ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Swith to coreutils timeoutCédric Ollivier1-1/+1
juju is not correctly stopped when no internet. https://build.opnfv.org/ci/job/functest-ovn-opnfv-functest-vnf-jerma-juju_epc-run/21/console root 1 0 0 Apr04 ? 00:00:06 /usr/bin/python3.7 /usr/bin/run_tests -t juju_epc -r -p root 139 1 0 Apr04 ? 00:00:03 [juju] <defunct> root 141 1 0 Apr04 ? 00:00:00 [timeout] <defunct> Change-Id: Id06c6e829ab8a992107f655aac6ec4539e292d82 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cda22d7db0bcca380e1caef76e171cd7753b6221)
2020-04-05Fix the Glance tasksCédric Ollivier2-4/+6
http://artifacts.opnfv.org/functest/ONA0SEFCMPR5/functest-opnfv-functest-smoke-latest-rally_sanity-run-688/functest.log Change-Id: Ied7bd209aedd713fbd64b169247de7931098ca8b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Update server_kwargs to boot_server_kwargsCédric Ollivier2-2/+2
It takes into account "Remove deprecated stuff. Part 1" [1] and then fixes rally_sanity and rally_full (NovaKeypair.boot_and_delete_server_with_keypair [2]) [1] https://github.com/openstack/rally-openstack/commit/4436258d8fbb758a1771f908726e78c29e309c8a#diff-a80e66732701c545c7fc540d02ee1066 [2] http://artifacts.opnfv.org/functest/HG7XUW226S1T/functest-opnfv-functest-smoke-latest-rally_sanity-run-687/rally_sanity/rally_sanity.html#/NovaKeypair.boot_and_delete_server_with_keypair/failures Change-Id: Id39b3231153efcccd58ed6bd988e26e2a672825b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Enable TrunkTestInheritJSONBase.test_add_subport if ovnCédric Ollivier1-1/+0
It has been fixed upstream by "Protect vs unordered results in TrunkTestInheritJSONBase" [1]. [1] https://review.opendev.org/#/c/708305/5 Change-Id: Ibbc23a53d9d20d9b3a192e15779ca0f3334e2a38 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-04Reduce Tempest multi threadsCédric Ollivier4-22/+22
It decreases the threads from 4 to 3 to allow running the testcases in parallel. Else a few tests sometimes fail. Change-Id: I268eff5a72d5de5b26d7549ac74ee0e2a05cb61e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-04Skip test_container_synchronizationCédric Ollivier3-1/+12
It's not supported by radosgw which is now used in Functest SUTs [1][2]. It's removed from CNTT which seems leveraging on ceph (at least RI) [3] [1] https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/3.2/html/release_notes/bug-fixes [2] http://artifacts.opnfv.org/functest/E46RCZLBRYCC/functest-opnfv-functest-smoke-hunter-tempest_slow-run-127/tempest_slow/tempest-report.html [3] http://artifacts.opnfv.org/cntt/WKFRPQODPW34/cntt-opnfv-functest-smoke-latest-tempest_slow-run-37/tempest_slow/tempest-report.html Change-Id: I8127df786c41af0d0285ef0e5cd1b28901685f65 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Revert "Keep the modified tempest"Cédric Ollivier4-4/+0
It's simply useless and may raise side effects later. Change-Id: Idaeab672480597ed39a5e29719580fee38aeb4ad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-02Keep the modified tempestCédric Ollivier4-0/+4
http://artifacts.opnfv.org/functest/CRY58ZS3031L/functest-ovn-opnfv-functest-healthcheck-jerma-tempest_smoke-run-37/tempest_smoke/tempest-report.html Change-Id: I9598a45b09151fa267294716f70e65e3050f0239 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 21b512e55eb36e38160b697baae44c464fce9034)
2020-04-01Rename CNTT specific testcasesCédric Ollivier3-18/+18
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Vmtp and Shaker haven't been modified for CNTT. They will be renamed once CNTT asks for new post processing. http://testresults.opnfv.org:8080/ Change-Id: I64e06694620027faa06b6d9d339684f5e8d733d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-28Increase Shaker timeout before init message in consoleCédric Ollivier2-1/+6
It failed in parallel of rally_full [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-hunter-shaker-run/397/console [2] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-hunter-shaker-run/395/console Change-Id: I0eab7374c5962d45405c5f4147798067526f6e70 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-27Check the login prompt in console in SingleVm1Cédric Ollivier3-9/+28
It also checks the second vm2 console log in case of vping_ssh. Change-Id: I13a5edfb3e19449a38d2f0478d549bd8fcc5cfa7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-24Merge "Remove duplicated packages in VNF Dockerfile"Cedric Ollivier1-1/+1
2020-03-23Update xtesting to 0.87.0Cédric Ollivier1-1/+1
Change-Id: I0ee3499cf9c78687825714c00c1cf18ed2a70456 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-23Remove duplicated packages in VNF DockerfileCédric Ollivier1-1/+1
Change-Id: I7f9c5b5e2c59f23ada721e7209bec56bfa23ae9e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-23Doesn't redirect stderr when getting verifier idCédric Ollivier3-3/+3
The logic fails when rally produces warnings [1]. It also updates Rally OpenStack and checks if the previous error has been solved[2]. TypeError: _discover_or_create_flavor() missing 1 required positional argument: 'flv_disk' [3] [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-tempest_smoke-run/757/console [2] https://github.com/openstack/rally-openstack/commit/e62315115af20e53f6c7205494ba0008634047ed [3] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-tempest_smoke-run/629/console Change-Id: Ia1daaa76d7cef7f30904c1f3bd42e2f6a6ba10af Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-05Add oauth1 as optional Keystone featuresCédric Ollivier1-2/+3
It was not listed in Keystone which defacto sets it as optional. It may be considered as mandatory in a second step. It should be noted that it's not working in CNTT RI and there is no true plan to update CNTT RI from the time writing. Close cntt-n/CNTT#1253 Change-Id: If7ee4efeafc05638173a51ce997ecbdcaabfc79c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-03Blacklist tests which are not mandatory in CNTTCédric Ollivier2-0/+49
CNTT rally_jobs must conform with CNTT RC whatever the OpenStack version under tests. All tests added by neutron since Hunter must be skipped in conformance. Of course, the IaaS verification part is unchanged as this tests are relevant. Change-Id: I4cfb4ae725e5ce9125f4ed25489dd003e16695f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-03Add OVN Controller Gateway agent in neutron_bind_l2_agent_typesCédric Ollivier2-6/+2
It avoids blacklisting NeutronNetworks.create_and_bind_ports in case of OVN. It conforms with the upstream testing [1] and then reverts the previous change [2]. [1] https://github.com/openstack/networking-ovn/blob/master/zuul.d/networking-ovn-jobs.yaml#L299 [2] https://git.opnfv.org/functest/commit/?id=8e297c49c481961959b29c2080cc059fcc84e9ee This reverts commit 8e297c49c481961959b29c2080cc059fcc84e9ee. Change-Id: I95f1b7146e636ae3ebe9f995733e53ad1b276d26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Increate Neutron test count to 501Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/P5QXI9R2ULZQ/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run-29/neutron-tempest-plugin-api/tempest-report.html Change-Id: I0dee2ecea051e1caafd6437bc1766c920b3e1ff4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Remove /src/glance after generating policy.confCédric Ollivier1-2/+2
It also cleans former dirs. Change-Id: I924436652e3fe0f19d0755024839ecb5290aa2f3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-24Blacklist NeutronNetworks.create_and_bind_ports if ovnCédric Ollivier1-0/+5
It only works for Linux Bridge and Open vSwitch. Change-Id: I1a437145eb8140642d3c8297c3f154113e74505f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-22Blacklist tests asking for vxlanCédric Ollivier1-0/+5
http://artifacts.opnfv.org/functest/B4HOI3WWLNVK/functest-ovn-opnfv-functest-smoke-jerma-neutron-tempest-plugin-api-run-4/neutron-tempest-plugin-api/tempest-report.html Change-Id: I6ff82b92cb4c392ac1f453faf7e16ef587dc2060 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-22Publish tempest_conf.yaml for Functest OVN SUTCédric Ollivier1-0/+78
Change-Id: I96237e8bfe469f100dc72d022747ce0013b41284 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Update patrole regex (OVN)Cédric Ollivier1-2/+6
It takes into account last changes in Patrole. It was not covered since Apex stopped deploying OVN. Change-Id: I7ab8362f9998024ae65f49973b169b95bbfd4fb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Skip a few tests in tempest_full and tempest_slowCédric Ollivier1-2/+5
It completes the first patch updating neutron-tempest-plugin-api [1]. The same dvr regex is used in tempest_slow, a new one is defined for tempest_full which will be added in CNTT doc (test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling). Close cntt-n/CNTT#1106 Change-Id: I9fd79c9a82bb1f84a622ccb9ea316b8e43273e2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Merge "Update test case list in neutron-tempest-plugin-api"Cedric Ollivier1-2/+24
2020-02-18Blacklick test_add_subport if OVNCédric Ollivier1-0/+1
https://bugs.launchpad.net/neutron/+bug/1863707 Change-Id: Ieebe10ee2a9040887d84aca3e8fb5ee66294634b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Update test case list in neutron-tempest-plugin-apiCédric Ollivier1-2/+24
It takes into account latest changes in CNTT [1] [1] https://github.com/cntt-n/CNTT/pull/1107 Close cntt-n/CNTT#1106 Change-Id: I3212d1b765f7fd657ed603ed520d79fccae80bfa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-17Select OpenStack requirements masterCédric Ollivier4-8/+8
https://github.com/openstack/requirements/commit/7a04f4e96205f16e74a9a08fe60b168c187516d6 Change-Id: I9ed510c45f63714b64dcb9fa90e4d7239f93ee3f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-17Fix incorrect test numbersCédric Ollivier1-1/+1
[1] http://artifacts.opnfv.org/functest/16S4PBMRW5HP/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run-23/neutron-tempest-plugin-api/tempest-report.html Change-Id: I9cb04c3abdbb899d2f1d4188a9fb9743a8f4c6d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-17Bypass upstream requirement issuesCédric Ollivier4-11/+14
https://review.opendev.org/#/c/708041/ Change-Id: Iebbf0a720fe9d1c62083028d0bc0078bf7680753 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-16Remove refstack version tagCédric Ollivier1-1/+0
It has been unread since the files are cached. Change-Id: Iba74163ac486dddaee4e81a340fcbe2b9297071f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-16Exclude vxlan testing in CNTTCédric Ollivier1-1/+5
Close cntt-n/CNTT#1077 Change-Id: If9c0f52138e9f669f17933c42906936e2e196b2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Run test_agent_management vs OVNCédric Ollivier1-2/+0
They must not longer be blacklisted as opposed to test_dhcp_agent_scheduler [1]. https://bugs.launchpad.net/networking-ovn/+bug/1863432 Change-Id: Ib08bb87580a10e2124faa1b3853f3e27dcb3a0a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Set dhcp_agent_scheduler as optionalCédric Ollivier1-3/+5
dhcp_agent_scheduler [1] indirectly forces the Neutron backends as highlighted by OVN testing. [1] https://specs.openstack.org/openstack/neutron-specs/specs/api/agent_schedulers.html Close cntt-n/CNTT#1073 Change-Id: Iafa3ad7f15dc157c0362ffa59eed31b89bf368e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Order regex in neutron-tempest-plugin-api (CNTT)Cédric Ollivier1-4/+5
It mostly adds admin as prefix. Change-Id: Ic2e723b858ff1f3e26478f6037a19db1fd52e4aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Decrease test_count to 1290 in tempest_fullCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/2Y4502QRM7YM/functest-opnfv-functest-smoke-cntt-latest-tempest_full-run-16/tempest_full/tempest.log Change-Id: Ifa1ae117db7dff6471ab557d6f7f3bf03940de76 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Increase test_count to 547 in neutron-tempest-plugin-apiCédric Ollivier1-1/+1
It takes into account the new tests added in Neutron Tempest Plugin. Change-Id: I7994638c69ef6bd39bae3c6ded8409baabc27e9d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>