Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I2fed5dc5798a3d217be032d754da9f7dbbbd30d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
CinderVolumeTypes.create_volume_type_add_and_list_type_access
Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
A few tests are linked to Cinder v2 which was dropped in Xena
Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mostly add encoding in open calls and leverage f-strings.
Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also fixes lots of new pylint warnings.
Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This issues were hidden by Airship limitation (live-migration fails)
Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers
Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms with "Fix nova scenarios for assiciating fips" [1]
http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html
[1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460
Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It pleases airship which doesn't support neither routers and floating
ips.
Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops leveraging auto_assign_nic which fails in case of Airship.
Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It pleases the networking configuration proposed by Airship.
Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures
Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip
Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows running dd in VM (simple disk benchmarking).
https://github.com/cntt-n/CNTT/issues/1477
Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now fails [1]:
Traceback (most recent call last):
File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run
floatingip = self.neutron.create_floatingip(**create_floating_ip_args)
File "/src/rally/rally/task/service.py", line 114, in wrapper
return func(instance, *args, **kwargs)
File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
TypeError: create_floatingip() got an unexpected keyword argument 'ext_network'
[1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures
Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms to the OpenStack gates which have just updated to Cirros
0.5.1
Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Neutron leverages on the upstream Rally task in Stein and newer.
Leveraging on the upstream task may fix the side effects which
sometimes occured on Vmtp and Shaker [1] and filled better the CNTT
model.
[1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/
Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now conforms with the other tasks which sets 1 Gb as default.
Change-Id: Ibadb2bee2bea7a79db2eb27d0cc1867a823d7935
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Most of the rally_full runs failed vs our new SUTs (radosgw) .
This two params fail the testing when higher than 1 (verified
independently).
As the new test config works when hugely tested in //, it makes sens to
merge the new config to fix the gates.
This patch will be safely reverted if the issue is confirmed on SUT.
Change-Id: I222652d484a5e06190c12d45d6c1882de5ab9eec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Ovn fails vs rally_full [1] but passes vs rally_jobs.
It reverts the small diff between rally_full and rally_jobs added by
"Update network context in selected rally tests". Then it may raise
side effects in case of L2-only testing [2]
[1] http://artifacts.opnfv.org/functest/JDD0PPKUOYO5/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run-9/rally_full_cntt/rally_full_cntt.html
[2] https://github.com/opnfv/functest/commit/b4b2e7f9a5a3cb3379b45ac4ddd0ef949974a698
Change-Id: I5c7591a46de1b534b6b3dc511ca2caf20ac48e1f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/ONA0SEFCMPR5/functest-opnfv-functest-smoke-latest-rally_sanity-run-688/functest.log
Change-Id: Ied7bd209aedd713fbd64b169247de7931098ca8b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account "Remove deprecated stuff. Part 1" [1] and then fixes
rally_sanity and rally_full
(NovaKeypair.boot_and_delete_server_with_keypair [2])
[1] https://github.com/openstack/rally-openstack/commit/4436258d8fbb758a1771f908726e78c29e309c8a#diff-a80e66732701c545c7fc540d02ee1066
[2] http://artifacts.opnfv.org/functest/HG7XUW226S1T/functest-opnfv-functest-smoke-latest-rally_sanity-run-687/rally_sanity/rally_sanity.html#/NovaKeypair.boot_and_delete_server_with_keypair/failures
Change-Id: Id39b3231153efcccd58ed6bd988e26e2a672825b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It avoids blacklisting NeutronNetworks.create_and_bind_ports in case of
OVN. It conforms with the upstream testing [1] and then reverts the
previous change [2].
[1] https://github.com/openstack/networking-ovn/blob/master/zuul.d/networking-ovn-jobs.yaml#L299
[2] https://git.opnfv.org/functest/commit/?id=8e297c49c481961959b29c2080cc059fcc84e9ee
This reverts commit 8e297c49c481961959b29c2080cc059fcc84e9ee.
Change-Id: I95f1b7146e636ae3ebe9f995733e53ad1b276d26
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It only works for Linux Bridge and Open vSwitch.
Change-Id: I1a437145eb8140642d3c8297c3f154113e74505f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It was blacklisted for a while and it's still failing [1][2].
It has to be removed from scenarios (blacklisting is useless and could
mislead endusers).
[1] http://artifacts.opnfv.org/functest/BYERCT6UZDWT/functest-opnfv-functest-benchmarking-iruya-rally_full-run-227/rally_full/rally_full.html
[2] http://artifacts.opnfv.org/functest/LYQLHFQB7CTI/functest-opnfv-functest-benchmarking-hunter-rally_full-run-329/rally_full/rally_full.html
Change-Id: I9ccea90a70024b6e54d873024cf550db5beea990
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ibc9aa210846ad2163f7ef943d224374dfff6f1ec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
self.details is now a dict and summary is located under root [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-hunter-rally_sanity-run/422/console
Change-Id: Ic89e674b2f6660704b9dafe6070a224753e2af46
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It avoids parsing rally task outputs which may hang (subprocess
communicate) as seen in rally_full and rally_jobs.
It simply selects test names as tags.
Change-Id: I88b54a8f155e557f8a606fdbd7d86c1f4d5dae3b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
If one hypervisor is down, few tempest test fails.
User is free to set SKIP_DOWN_HYPERVISORS if it's down on purpose.
Change-Id: I7b6a4d0d8f67755d8c1550fd1bc6fd707634f68b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Else tempest_slow fails if one hypervisor is down (detected in ONAP
Openlab). It also improves Shaker, Rally and Vmtp which count them.
Change-Id: Iee7c20e0357d9237501c5c451580d8f6409ac86b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Rally now leverages on list_services as proposed in utils [1]
[1] https://git.opnfv.org/functest/commit/?id=0837a745c81ed2a6e7df097f60d227d5997c805e
Change-Id: Ib17f9b530c2933d4a49eb5b744c2ae80b24ad560
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It overrides the default implementation provided by Shade.
Change-Id: I3ad2f8ba543be4483f108c4bd7765018dddc5b19
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Id907abff44490a57e8ec2cdb00396d9e4b422815
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
One HeatStacks.create_and_delete_stack call asks for floating_network.
Change-Id: I75d01b4ecb1f484eac3af6efc53cf4a94206b158
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Set timeout on subprocess invocation instead of spawned child process.
Increase the timeout value for rally_full to 2h since the execution
typically takes ~90min [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_full-run/22/
Change-Id: I0ca90bc2d85b4625336eb0396d8b2816a486b746
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It calls timeout (1 hour) to stop any hanging task [1].
It will be backported to Hunter and Iruya if similar failures are
detected.
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_full-run/9/console
Change-Id: I8fe89f9fa1c6c39cd8810096c1d586bdef7865a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
rally_jobs can verify network providers by skipping:
- NeutronNetworks.create_and_delete_floating_ips
- NeutronNetworks.create_and_list_floating_ips
- NeutronNetworks.associate_and_dissociate_floating_ips
Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com>
Change-Id: Ibda66e47f4d1101b53435ef4cd144dacbabff165
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Remove empty workload entries when applying blacklist in RallyJobs.
Rally considers task file as invalid if it contains entries whose
workload list empty.
Change-Id: I34867c0aeea9c5ecf1294959d680e6de535be9cd
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It also allows building docs as doc8 is broken due to latest
OpenStack's upper-constraints.
pylint is updated to 2.3.1 (lastest py3.7 version)
It disables perm as umask is currently false on lf-virtual1.
Change-Id: If09d4796d48b7d0591e7926621d3bbf5ca1b6c24
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows creating testcases leveraging on Functest scenarios without
external network. Then Rally can verify network providers by only
skipping NovaServers.boot_server_associate_and_dissociate_floating_ip
Change-Id: I07a9348214f7557195c7201466f7e37b2b980206
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is
currently failing [1].
Barbican testing is optional as Gnocchi.
[1] https://bugs.launchpad.net/rally/+bug/1819285
Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As for refstack_object, it forces swift in SUT.
Role is hardcoded to admin as for a few Neutron tests.
Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The last commit requires two additional task args [1][2].
[1] https://github.com/openstack/neutron/commit/ccef17605d1e28c418821c2235ba24c15893fff2#diff-720114afabbecd64333f4586a338f749
[2] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_jobs-run/145/console
Change-Id: I4943f737be29bcadfead427a7852964e6438a018
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Both Rally and Tempest publish Rally debug logs.
It also moves the logics from tempest to rally.
Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console
Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It fixes a few incorrect types in log calls [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/
Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
|