Age | Commit message (Collapse) | Author | Files | Lines |
|
It completes "Skip VolumeBackupRestoreIntegrationTest in temptest_heat"
Change-Id: I798cefa3a3648277cc321cc9e85be9b634aa9e20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's linked to vbd which is false in many cases [1].
e.g. IMAGE_PROPERTIES=hw_scsi_model:virtio-scsi,hw_disk_bus:scsi
Enabling it requires upstream changes to configure the right device.
[1] http://artifacts.opnfv.org/functest/FHHSBCPDUV6C/functest-opnfv-functest-smoke-latest-tempest_heat-run-7/tempest_heat/tempest-report.html
Change-Id: I2632779e96b7b0850d1937a8ec3c7bf4607862a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It asks for the Fedora-Cloud-Base image and a second user account.
It should be noted that heat-tempest-plugin duplicates all configs from
tempest.
Minimal image is still Cirros and the first account is the admin one.
Then it conforms with the TempestCommon logic.
AodhAlarmTest is skipped by default because pre conditions are missing.
SoftwareConfigIntegrationTest is skipped as in gates because it
requires a custom image [1]
[1] https://github.com/openstack/heat/blob/master/devstack/lib/heat#L444
Change-Id: I8b39dc65ef3714411cd828e17b95e124f2e90f34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/4LM7FMUVFMML/functest-ovn-opnfv-functest-smoke-jerma-tempest_slow-run-41/tempest_slow/tempest-report.html
Change-Id: I1a3f684a9059eac21695bd655df976bceebf26f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It has been fixed upstream by "Protect vs unordered results in
TrunkTestInheritJSONBase" [1].
[1] https://review.opendev.org/#/c/708305/5
Change-Id: Ibbc23a53d9d20d9b3a192e15779ca0f3334e2a38
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's not supported by radosgw which is now used in Functest SUTs [1][2].
It's removed from CNTT which seems leveraging on ceph (at least RI) [3]
[1] https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/3.2/html/release_notes/bug-fixes
[2] http://artifacts.opnfv.org/functest/E46RCZLBRYCC/functest-opnfv-functest-smoke-hunter-tempest_slow-run-127/tempest_slow/tempest-report.html
[3] http://artifacts.opnfv.org/cntt/WKFRPQODPW34/cntt-opnfv-functest-smoke-latest-tempest_slow-run-37/tempest_slow/tempest-report.html
Change-Id: I8127df786c41af0d0285ef0e5cd1b28901685f65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/B4HOI3WWLNVK/functest-ovn-opnfv-functest-smoke-jerma-neutron-tempest-plugin-api-run-4/neutron-tempest-plugin-api/tempest-report.html
Change-Id: I6ff82b92cb4c392ac1f453faf7e16ef587dc2060
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I96237e8bfe469f100dc72d022747ce0013b41284
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account last changes in Patrole.
It was not covered since Apex stopped deploying OVN.
Change-Id: I7ab8362f9998024ae65f49973b169b95bbfd4fb5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
https://bugs.launchpad.net/neutron/+bug/1863707
Change-Id: Ieebe10ee2a9040887d84aca3e8fb5ee66294634b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They must not longer be blacklisted as opposed to
test_dhcp_agent_scheduler [1].
https://bugs.launchpad.net/networking-ovn/+bug/1863432
Change-Id: Ib08bb87580a10e2124faa1b3853f3e27dcb3a0a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows running
test_boot_into_disabled_port_security_network_without_secgroup.
It also sets a few default values.
Change-Id: I851c5d13705e0419a7e664e05d32eec0efb417c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes last Neutron Tempest plugin change into account [1].
It also increases test count.
[1] https://review.opendev.org/#/c/692822/
Change-Id: I5e7218dd808069a0be6d481447576099aa9c63e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
DevStack seems incorrect when configuring serial console in case of
multinode deployment (missing proxyclient_address in master, missing
socket in Rocky, etc). Then the testing is disabled.
Change-Id: I9d1d43017b0935b23ea2a939748b5f709212c70d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It forbids skipping any test and counts the testcases executed.
It mosly avoids running tests accoring to the upstream skip tests
(known bugs), related to nova-network, glance v1, keystone v2 and
all features defined as optional by CNTT.
It fixes an issue highlighted by yallint.
Change-Id: Ib4678cb9e9fc37b16fcf21d8418931eae0f667d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Else few tests are skipped if DifferentHostFilter is not available.
Change-Id: Idfc524216dc8503e590d4fed569a43e99ea22123
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Our SUT allows verifying the next Nova features
- shelve
- vnc_console
- cold_migration
attach_encrypted_volume is now False because of ceph.
It writes the tempest default values to ease highlighting the overall
configuration.
Change-Id: Ib9ebc8e5b390ea99edf2c3aacbd873c5eb6e7abc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Ceph doesn't conform with the LVM driver and asks for modifying the
manage volume and snapshop refs [1].
It allows passing test_unmanage_manage_snapshot [2].
[1] https://opendev.org/openstack/tempest/commit/ebc752b59dd3e2164807930e31b313a92bce70d5
[2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-tempest_full-run-480/tempest_full/tempest-report.html
Change-Id: I8d3b2484ba5cbd203c32fa446fa27e17a80888d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Ceph is now used as backend which requires few adaptations for live
migration. It differs from the main OpenStack gates but suits CNTT and
most of the feedbacks received from enduser deployments.
Change-Id: If6b76a7d4ec09f90467f3e63618c15a9b413bfbd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Both are supported by OpenStack and Functest gates.
It also sets the default values to highlight the coverage.
Change-Id: Iae080a8bde0c411acc7811e7a0e70e3471db8c98
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The next features are supported by Functest SUT:
- backup
- snapshot
- clone
- manage_snapshot
- manage_volume
- volume_revert
Change-Id: I0e83bb616a56b9e8651115bebf2373f85c642260
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Few tests are skipped if this value is unset.
Then it's needed to fully cover Neutron Trunk (Compliance).
Change-Id: Ife4becb7ff8b47c2d90fc6c5eb4f585685205ed6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It avoids skipping the next 2 tests [1]:
neutron_tempest_plugin.api.admin.test_agent_availability_zone.AgentAvailabilityZoneTestCase.test_agents_availability_zone
neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan
[1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-neutron-tempest-plugin-api-run-498/results/neutron-tempest-plugin-api/tempest-report.html
Change-Id: I83f3f44302336045e47514e0aa0b67737161f0e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows reusing the blacklisting system if only public endpoints are
reachable (ONAP Openlab testing). It contains a first list of
tempest-based tests which force the use of admin endpoints.
Change-Id: Ic1ab07dec3ae1f2a0ca50b80e08cd0ac396f2e56
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It integrates Octavia Tempest Plugin.
The new testcase octavia currently covers API only [1].
[1] https://logs.opendev.org/46/674846/2/check/octavia-v2-dsvm-noop-api/fe37c58/testr_results.html.gz
Change-Id: I2a11a19aa0c43701499dc9e17bd69b9387b53b58
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms with OpenStack gates by default.
Change-Id: Icc1537b0f8342666d2a2a0de4655ba99f4f42470
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The default values conform with OpenStack and Functest gates [1].
It could be set to false if shared storage-based live migration is
supported [2].
It also currently disables cold migration.
[1] http://logs.openstack.org/84/632984/24/check/tempest-multinode-full-py3/4216037/controller/logs/tempest_conf.txt.gz
[2] https://docs.openstack.org/nova/pike/admin/configuring-migrations.html
Change-Id: I0faa415eba610c20ba54353ac7ba7b0e83722c32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sets max_microversion to latest because if both values are not
specified, Tempest avoids tests which require a microversion [1].
It completes the previous change about nova [2].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
[2] https://gerrit.opnfv.org/gerrit/#/c/67318/
Change-Id: Ieab56a239077476dd9a0e1ee97ac4293c4075f5c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I1dd51a54f39967fcf6b3a522e2a548f81e5646a9
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
It sets max_microversion to latest because if both values are not
specified, Tempest avoids tests which require a microversion [1].
Then test_keypairsv22_create_list_show_with_type is skipped and
refstack_defcore fails [2].
It also partially reverts "Allow building containers when
refstack.openstack.org is down" [3].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
[2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-refstack_defcore-run-147/results/refstack_defcore/tempest-report.html
[3] https://gerrit.opnfv.org/gerrit/#/c/67232/
Change-Id: Ia87543bb476d3047684e71ddfd05c2aa3f10bbfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows running test_user_update_own_password [1]
[1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-components-latest-tempest_full-run-8/results/tempest_full/tempest-report.html
Change-Id: I9f273ba58871f1e16886af623dcbb91f5c20c2f6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It blacklists agent testing and two tests asking for VXLAN as overlay
if OVN (OVN supports GENEVE) [1]
blacklist.txt is renamed blacklist.yaml and is verified by yamllint.
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/33/console
Change-Id: I73c1b8cbbd74973a7f15476feea6ee4532786660
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows removing OPNFV logics out of Functest (releng) and then
simplifies conf_utils.
tempest.conf is filled by the current default values.
functest-alpine.sh will be updated to allow modifying the default
values without breaking the OPNFV installers.
It deprecates the only tempest-related env var (STORAGE_PROTOCOL)
Change-Id: I14bcb715826ef2d85af87e7af600261a3c08e72c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also renames two testcases and updates all docs because tests
run in parallel in case of tempest smoke.
To force one thread as before:
run:
module: 'functest.opnfv_tests.openstack.tempest.tempest'
class: 'TempestCommon'
args:
mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$'
option:
- '--concurrency=1'
JIRA: FUNCTEST-989
Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Provides a convenient way to configure all params which users required.
JIRA: FUNCTEST-860
Change-Id: Iadfb704285f94530e1023ee780138f22dd672d33
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Tempest_custom will fail if only the test name is provided without id.
Change-Id: I170eff4215bcb09c6469072079091670aabaad5b
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
This list hasn't been updated in Danube. The idea is
to clean it up and allow all the test cases to be run.
If bugs are detected in Euphrates and there is an upstream
bug report, the affected tests can be added again here.
Change-Id: I44c8b4e8ae78dee7f13f761b6f7f6d8c09b2d0b0
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
tempest.api.compute.servers.test_server_actions\
.ServerActionsTestJSON.test_reboot_server_hard
is working in fuel so do test it.
The "-" was missing so
tempest.scenario.test_server_basic_ops
.TestServerBasicOps.test_server_basic_ops
was executed on fuel which is known to be
not working since metadata service is not
available. That was added already long
ago but through the not adding
of the "-" it got added again.
Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
|
|
|
|
This list has been generated in Colorado and there are
some scenarios that are deprecated and there is no
need to list them here.
Change-Id: I62a30b5026ed1df65ebdb7a68a6acf3364469865
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Bug report: https://bugs.opendaylight.org/show_bug.cgi?id=5586
As a result, floating IPs are not working in Apex at the moment.
Change-Id: I437c10b53dc01810ed757f040d3378c92320274b
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
|
|
Tempest ssh client is hanging on opendaylight enabled envs
(getting deadlock in paramiko recv_exit_status method) while
trying to execute a command on a vm.
Change-Id: I6660cebc6bc44a5f02e6a1e83ee9a61bae141746
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
Actually attach_detach_volume must be skipped because the device name
ain't reliable and that's using a hard-coded device name in config.
This test should just get the device info after the attach and use
that rather than the hard-coded config option in Tempest that ain't
likely to work - the test should have been written more dynamically.
However, set volume device name to "vdc" since "vdb" is used for config
drive when force_config_drive=True is in action.
Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
|
|
Change-Id: Ia468b9c9ab9f74a3255aa3647916d1018cef2902
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Some users need to run a specific list of
tempest test cases. This patch allows them
to do that by running the command:
functest testcase run tempest_custom
Change-Id: If8e7726b98c3a71398c7abdf80aea79f10653ebf
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Refstack is the OpenStack project that provides the tooling
to run the approved specific tempest test cases (Defcore guidelines)
by the Interop working group and by the OpenStack board
for OpenStack certification purposes.
For more info: https://refstack.openstack.org/
This adds the possibility for a Functest user to run this list
of tempest test cases by just issuing the command:
functest testcase run tempest_defcore
The test will be run on daily loops with the scenario nosdn-nofeature
on any installer.
Change-Id: I920b2a44cff418116008fdf514425e69dc959412
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
* newton release support is started from 13.0.0
* set swift operator role to existing one
* unblacklist server_basic_ops test
JIRA: FUNCTEST-712
Change-Id: Ieb3d9477db3dfa98f940c3732b64f6eb7515f6e6
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
JIRA: FUNCTEST-579
Change-Id: Iaa545db70bfb76770df0a3d17871e29ce518ff2d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|