Age | Commit message (Collapse) | Author | Files | Lines |
|
It now fails [1]:
Traceback (most recent call last):
File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run
floatingip = self.neutron.create_floatingip(**create_floating_ip_args)
File "/src/rally/rally/task/service.py", line 114, in wrapper
return func(instance, *args, **kwargs)
File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
TypeError: create_floatingip() got an unexpected keyword argument 'ext_network'
[1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures
Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops leveraging on policy json files as it fails for Nova.
Change-Id: Ic70997d0ff8151956dc189739b8468def048aad7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
test_show_auto_allocated_topology doesn't clean its resources:
- network: auto_allocated_network
- subnets: auto_allocated_subnet_v4 & auto_allocated_subnet_v6
- router: auto_allocated_router
This bug easily breaks testing in a quick run when allocating the
subnet due to insufficient prefix space to allocate subnet size /26.
https://build.opnfv.org/ci/job/functest-latest-daily/746/
Change-Id: I1a1bd22068bca0720016dab8a15ad7dd576ee152
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
196 is used in OpenStack gates but it doesn't fit the Functest model.
Functest runs all test cases in parallel vs the same SUT.
https://github.com/openstack/tempest/blob/master/tempest/lib/common/ssh.py#L38
Change-Id: I2db072a3cb691bc200cd4357852cdd8ceda91a1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I61e982011040ee8b0540910939983777280445ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms to the OpenStack gates which have just updated to Cirros
0.5.1
Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783
Change-Id: Ie715a86cf6129ab5b51bf9e0ec07f326c0f86ccb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Baraque selects Train:
https://github.com/cntt-n/CNTT/pull/1782
https://github.com/cntt-n/CNTT/pull/1783
Change-Id: I9650f5b9041a59b68af34c7410c64515e498a226
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I66811c31fac4a83ed9634e928b9af8fa6e633034
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account last Patrole changes.
Change-Id: I552442864297b51a1cd7885b357b139b664e536a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also reduces the skipped test list taking into account Patrole
improvements.
Change-Id: I23a8c0610a8a4258aa806451f52796f3e7bc46ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I050caff2d255118edff48403a87305cfe336e20a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It completes "min_computes_nodes is also used as max values".
Change-Id: I72c67e17015bc35ac5e14f20839cf74353695373
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Its max value is now 10 according to the default quota.
Change-Id: Ie7bfcb224e821c15d38d0cba1d9f080548613e79
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The regexes will be updated in a second change (chicken and egg
between Functest and Releng)
Change-Id: I4273a80799730fe30c941a7b2966cfee46f24d4a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It completes the previous change "Allow listing hypervisors in VMTP" [1].
[1] https://gerrit.opnfv.org/gerrit/c/functest/+/70359
Change-Id: I12a19fd473076cfc3262f096cac1615c183710b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows listing the compute under tests via VMTP_HYPERVISORS.
They are no additional log in Functest and the note in VMTP is still
valid [1].
[1] https://opendev.org/x/vmtp/src/branch/master/vmtp/vmtp.py#L833
Change-Id: Ic9fbda3901d796c0ed94e42e2a14c468598f4311
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Running them in parallel of rally full and jobs asks for a increase.
Change-Id: Ib2369d384ac839fb46031411e1985ac402da0c1e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Neutron leverages on the upstream Rally task in Stein and newer.
Leveraging on the upstream task may fix the side effects which
sometimes occured on Vmtp and Shaker [1] and filled better the CNTT
model.
[1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/
Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Attaching an encryted volume is optional in CNTT [1].
This test fails if the volume type already exists and if it runs
twice in parallel [2]. As this single test doesn't fullfil the Functest
requirements, it's skiped in the classical verification as well.
[1] https://github.com/cntt-n/CNTT/blob/master/doc/ref_arch/openstack/chapters/chapter05.md
[2] https://storyboard.openstack.org/#!/story/2007804
Change-Id: Ib6fc843d71704aab1bfc536133544eb3fa4f3e72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I0fae7487955895bf8f41046043425849f8fd0bf2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mostly takes into account the last changes in test case names and
new cntt-related test cases.
Change-Id: I271fd02095b57f3b19b5ff95299fb4b257163c1f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ib53b9f97f30bf86d33857910ab9bffa1ce0d1e9e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes all CNTT changes into account.
Change-Id: Ib6ddbd12695266fc78fd8ae4cce451bf8a4b95ad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
3 seems good enough and stable which allows trying 4 as before
Change-Id: Id1f17ebf73f9faa13ed3ceb327ccb4ecf88c2bf2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sometimes fails in our gates and it seems unverified in OpenStack [1].
"Archive policy gabbilive is still in use"
[1] http://artifacts.opnfv.org/functest/DET32CBF0L0F/functest-opnfv-functest-smoke-jerma-tempest_telemetry-run-29/tempest_telemetry/tempest-report.html
Change-Id: Id5e5ad5ff0f7bade7932a085df28cc35b0ac7984
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
ServerActionsTestJSON.test_reboot_server_hard [1] sometimes fails in
gates. We may increase timeouts if it stills fails.
[1] http://artifacts.opnfv.org/functest/LIQH38CPR30X/functest-opnfv-functest-smoke-hunter-tempest_full-run-649/tempest_full/tempest-report.html
Change-Id: Ia27c0faead1df5c2b33a3e1a272e5a1010a5a83e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7ccc1b0793e32cad3912e63bbca971d5c3ecd724)
|
|
It updates pyshaker to 1.3.4 and adds fio which should be useful for
the next disk benchmarking testcases.
Change-Id: I662599745590eae71922ea5ef3f3876ad1019387
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I362b70cdfe753f9c57f30d61662e9b08564ebfe9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops using noop drivers and adds all scenarios except:
- .*api.v2.test_availability_zone
- .*api.v2.test_availability_zone_profile
- .*api.v2.test_member.MemberAPITest.test_member_ipv4_create
- .*api.v2.test_member.MemberAPITest.test_member_ipv6_create
It doesn't run ipv6 which asks for a deep dive (ipv6 from containers?)
It increases threads to 3 as the other testcases.
Change-Id: I36d9d764a5ab92efe89196181bffa3ad0a57227c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
scp + ssh calls are replaced by the right scp call.
Change-Id: Iac2be63fb380486393af65dda8f7fd80bdd41d5f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It unifies all test case names.
Change-Id: I38576f2d6bae6ef0236b6acfbd30c0446d3a2eca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They were all merged in neutron-tempest-plugin.
Change-Id: Iefe3bf98fc41d0dab5a7cec640337c672a7b1a69
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It seems failing due to octavia noop driver as in-used.
Change-Id: I53e1fe1cfe4930f92c1a4460e89ed6e21eb3f922
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Icad13836d88583ee676525d4743f12a5b888ebe2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It runs all telemetry-tempest-plugin tests except test_autoscaling
which is currently failing in our gates.
Change-Id: I2c712eda71799e96735419e1c547a775be659156
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms with the other test case names
Change-Id: Ia8836375c26ea4f1bff3637f7078e5f70f83c5fb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I99f33f2e5f27c22c597f7c4f2f864710ceb1350e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sometimes fails due to other test resources [1].
[1] http://artifacts.opnfv.org/functest/83IV2XRCU05K/functest-opnfv-functest-smoke-latest-tempest_heat-run-53/tempest_heat/tempest-report.html
Change-Id: Ied91781c784370b424653e37c090a909f16b6585
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sometimes fails according to the special chars selected [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-hunter-juju_epc-run/333/console
Change-Id: Ie0af3f2fe8d28225296788a8fce73e6d2ec2a304
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's forced by design else it remains a few resources.
It also sets fixed_subnet_name and network_for_ssh to avoid falsy
discovery as it seems [1]
[1] http://artifacts.opnfv.org/functest/X5GDYF3B0R2B/functest-opnfv-functest-smoke-jerma-tempest_heat-run-18/tempest_heat/tempest-report.html
Change-Id: Ieb584ddc1c0b4ebb543e9d69277a20aaee0fbac0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now conforms with the other tasks which sets 1 Gb as default.
Change-Id: Ibadb2bee2bea7a79db2eb27d0cc1867a823d7935
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It completes "Skip VolumeBackupRestoreIntegrationTest in temptest_heat"
Change-Id: I798cefa3a3648277cc321cc9e85be9b634aa9e20
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Most of the rally_full runs failed vs our new SUTs (radosgw) .
This two params fail the testing when higher than 1 (verified
independently).
As the new test config works when hugely tested in //, it makes sens to
merge the new config to fix the gates.
This patch will be safely reverted if the issue is confirmed on SUT.
Change-Id: I222652d484a5e06190c12d45d6c1882de5ab9eec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Ovn fails vs rally_full [1] but passes vs rally_jobs.
It reverts the small diff between rally_full and rally_jobs added by
"Update network context in selected rally tests". Then it may raise
side effects in case of L2-only testing [2]
[1] http://artifacts.opnfv.org/functest/JDD0PPKUOYO5/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run-9/rally_full_cntt/rally_full_cntt.html
[2] https://github.com/opnfv/functest/commit/b4b2e7f9a5a3cb3379b45ac4ddd0ef949974a698
Change-Id: I5c7591a46de1b534b6b3dc511ca2caf20ac48e1f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's linked to vbd which is false in many cases [1].
e.g. IMAGE_PROPERTIES=hw_scsi_model:virtio-scsi,hw_disk_bus:scsi
Enabling it requires upstream changes to configure the right device.
[1] http://artifacts.opnfv.org/functest/FHHSBCPDUV6C/functest-opnfv-functest-smoke-latest-tempest_heat-run-7/tempest_heat/tempest-report.html
Change-Id: I2632779e96b7b0850d1937a8ec3c7bf4607862a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It asks for the Fedora-Cloud-Base image and a second user account.
It should be noted that heat-tempest-plugin duplicates all configs from
tempest.
Minimal image is still Cirros and the first account is the admin one.
Then it conforms with the TempestCommon logic.
AodhAlarmTest is skipped by default because pre conditions are missing.
SoftwareConfigIntegrationTest is skipped as in gates because it
requires a custom image [1]
[1] https://github.com/openstack/heat/blob/master/devstack/lib/heat#L444
Change-Id: I8b39dc65ef3714411cd828e17b95e124f2e90f34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/4LM7FMUVFMML/functest-ovn-opnfv-functest-smoke-jerma-tempest_slow-run-41/tempest_slow/tempest-report.html
Change-Id: I1a3f684a9059eac21695bd655df976bceebf26f0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/ONA0SEFCMPR5/functest-opnfv-functest-smoke-latest-rally_sanity-run-688/functest.log
Change-Id: Ied7bd209aedd713fbd64b169247de7931098ca8b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|