aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack/rally
AgeCommit message (Collapse)AuthorFilesLines
2023-05-13Complete migration to Cirros 0.6.1Cédric Ollivier1-1/+1
Change-Id: I2fed5dc5798a3d217be032d754da9f7dbbbd30d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-04Temporarily blacklist ↵Cédric Ollivier1-13/+0
CinderVolumeTypes.create_volume_type_add_and_list_type_access Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-03Temporarily remove CinderVolumeTypes.create_and_update_volume_typeCédric Ollivier1-14/+0
A few tests are linked to Cinder v2 which was dropped in Xena Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-11-15Update linters and fix all new issuesCédric Ollivier1-30/+34
It mostly add encoding in open calls and leverage f-strings. Change-Id: Ifead18fc724a452c1067dcf91dc577032edc9c59 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-08-18Update to Alpine 3.14Cédric Ollivier1-37/+32
It also fixes lots of new pylint warnings. Change-Id: I3376aee5649596c53bc2941ad4d8e0674a2967fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Remove all network data in Rally full tasksCédric Ollivier1-24/+0
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Update Rally sanity tasks and blacklists for L2 onlyCédric Ollivier2-9/+2
This issues were hidden by Airship limitation (live-migration fails) Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip create_and_update_routers if NO_TENANT_NETWORKCédric Ollivier1-0/+1
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Update NovaServers.boot_server_associate_and_dissociate_floating_ipCédric Ollivier2-6/+3
It conforms with "Fix nova scenarios for assiciating fips" [1] http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html [1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460 Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Remove former allow_no_fip logicCédric Ollivier1-1/+0
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier2-1/+9
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-27Add nics net-id when booting dd load testCédric Ollivier1-0/+2
http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-24Rename ext_network to floating_network in Rally tasksCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Add VMTasks.dd_load_test in Rally test casesCédric Ollivier3-1/+25
It allows running dd in VM (simple disk benchmarking). https://github.com/cntt-n/CNTT/issues/1477 Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Rename ext_network to floating_network in Rally tasksCédric Ollivier2-2/+2
It now fails [1]: Traceback (most recent call last): File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run floatingip = self.neutron.create_floatingip(**create_floating_ip_args) File "/src/rally/rally/task/service.py", line 114, in wrapper return func(instance, *args, **kwargs) File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) TypeError: create_floatingip() got an unexpected keyword argument 'ext_network' [1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Update Cirros to O.5.1Cédric Ollivier2-2/+2
It conforms to the OpenStack gates which have just updated to Cirros 0.5.1 Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-06-15Stop leveraging on neutron plugins and extraCédric Ollivier1-20/+0
Neutron leverages on the upstream Rally task in Stein and newer. Leveraging on the upstream task may fix the side effects which sometimes occured on Vmtp and Shaker [1] and filled better the CNTT model. [1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/ Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-14Decrease volume size in boot_server_attach_created_volume_and_live_migrateCédric Ollivier2-2/+2
It now conforms with the other tasks which sets 1 Gb as default. Change-Id: Ibadb2bee2bea7a79db2eb27d0cc1867a823d7935 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-12Merge "Conform with the upstream create_and_delete_subnets"Cedric Ollivier1-2/+0
2020-04-10Set concurrency and containers_per_tenant to 1Cédric Ollivier1-6/+6
Most of the rally_full runs failed vs our new SUTs (radosgw) . This two params fail the testing when higher than 1 (verified independently). As the new test config works when hugely tested in //, it makes sens to merge the new config to fix the gates. This patch will be safely reverted if the issue is confirmed on SUT. Change-Id: I222652d484a5e06190c12d45d6c1882de5ab9eec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-09Conform with the upstream create_and_delete_subnetsCédric Ollivier1-2/+0
Ovn fails vs rally_full [1] but passes vs rally_jobs. It reverts the small diff between rally_full and rally_jobs added by "Update network context in selected rally tests". Then it may raise side effects in case of L2-only testing [2] [1] http://artifacts.opnfv.org/functest/JDD0PPKUOYO5/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run-9/rally_full_cntt/rally_full_cntt.html [2] https://github.com/opnfv/functest/commit/b4b2e7f9a5a3cb3379b45ac4ddd0ef949974a698 Change-Id: I5c7591a46de1b534b6b3dc511ca2caf20ac48e1f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Fix the Glance tasksCédric Ollivier2-4/+6
http://artifacts.opnfv.org/functest/ONA0SEFCMPR5/functest-opnfv-functest-smoke-latest-rally_sanity-run-688/functest.log Change-Id: Ied7bd209aedd713fbd64b169247de7931098ca8b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Update server_kwargs to boot_server_kwargsCédric Ollivier2-2/+2
It takes into account "Remove deprecated stuff. Part 1" [1] and then fixes rally_sanity and rally_full (NovaKeypair.boot_and_delete_server_with_keypair [2]) [1] https://github.com/openstack/rally-openstack/commit/4436258d8fbb758a1771f908726e78c29e309c8a#diff-a80e66732701c545c7fc540d02ee1066 [2] http://artifacts.opnfv.org/functest/HG7XUW226S1T/functest-opnfv-functest-smoke-latest-rally_sanity-run-687/rally_sanity/rally_sanity.html#/NovaKeypair.boot_and_delete_server_with_keypair/failures Change-Id: Id39b3231153efcccd58ed6bd988e26e2a672825b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-03Add OVN Controller Gateway agent in neutron_bind_l2_agent_typesCédric Ollivier1-5/+0
It avoids blacklisting NeutronNetworks.create_and_bind_ports in case of OVN. It conforms with the upstream testing [1] and then reverts the previous change [2]. [1] https://github.com/openstack/networking-ovn/blob/master/zuul.d/networking-ovn-jobs.yaml#L299 [2] https://git.opnfv.org/functest/commit/?id=8e297c49c481961959b29c2080cc059fcc84e9ee This reverts commit 8e297c49c481961959b29c2080cc059fcc84e9ee. Change-Id: I95f1b7146e636ae3ebe9f995733e53ad1b276d26 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-24Blacklist NeutronNetworks.create_and_bind_ports if ovnCédric Ollivier1-0/+5
It only works for Linux Bridge and Open vSwitch. Change-Id: I1a437145eb8140642d3c8297c3f154113e74505f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-27Fully remove Quotas.nova_update_and_deleteCédric Ollivier1-11/+0
It was blacklisted for a while and it's still failing [1][2]. It has to be removed from scenarios (blacklisting is useless and could mislead endusers). [1] http://artifacts.opnfv.org/functest/BYERCT6UZDWT/functest-opnfv-functest-benchmarking-iruya-rally_full-run-227/rally_full/rally_full.html [2] http://artifacts.opnfv.org/functest/LYQLHFQB7CTI/functest-opnfv-functest-benchmarking-hunter-rally_full-run-329/rally_full/rally_full.html Change-Id: I9ccea90a70024b6e54d873024cf550db5beea990 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-24Remove former Rally blacklistCédric Ollivier1-8/+0
Change-Id: Ibc9aa210846ad2163f7ef943d224374dfff6f1ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-17Fix details in RallyCédric Ollivier1-5/+4
self.details is now a dict and summary is located under root [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-hunter-rally_sanity-run/422/console Change-Id: Ic89e674b2f6660704b9dafe6070a224753e2af46 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-11Leverage on Rally task tagsCédric Ollivier1-23/+20
It avoids parsing rally task outputs which may hang (subprocess communicate) as seen in rally_full and rally_jobs. It simply selects test names as tags. Change-Id: I88b54a8f155e557f8a606fdbd7d86c1f4d5dae3b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-08Count all hypervisors by defaultCédric Ollivier1-1/+1
If one hypervisor is down, few tempest test fails. User is free to set SKIP_DOWN_HYPERVISORS if it's down on purpose. Change-Id: I7b6a4d0d8f67755d8c1550fd1bc6fd707634f68b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-01Merge "Count all active hypervisors"Cedric Ollivier1-1/+1
2019-09-30Count all active hypervisorsCédric Ollivier1-1/+1
Else tempest_slow fails if one hypervisor is down (detected in ONAP Openlab). It also improves Shaker, Rally and Vmtp which count them. Change-Id: Iee7c20e0357d9237501c5c451580d8f6409ac86b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-29List services via OS_INTERFACE in RallyCédric Ollivier1-1/+2
Rally now leverages on list_services as proposed in utils [1] [1] https://git.opnfv.org/functest/commit/?id=0837a745c81ed2a6e7df097f60d227d5997c805e Change-Id: Ib17f9b530c2933d4a49eb5b744c2ae80b24ad560 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-28Allow getting service via any endpointCédric Ollivier1-0/+1
It overrides the default implementation provided by Shade. Change-Id: I3ad2f8ba543be4483f108c4bd7765018dddc5b19 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-07Blacklist boot_and_associate_floating_ip if no floating ipCédric Ollivier1-0/+1
Change-Id: Id907abff44490a57e8ec2cdb00396d9e4b422815 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-07Blacklist create_and_delete_stack if no floating ipCédric Ollivier1-0/+1
One HeatStacks.create_and_delete_stack call asks for floating_network. Change-Id: I75d01b4ecb1f484eac3af6efc53cf4a94206b158 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-09-04Prevent occasional rally hangsJuha Kosonen1-8/+13
Set timeout on subprocess invocation instead of spawned child process. Increase the timeout value for rally_full to 2h since the execution typically takes ~90min [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_full-run/22/ Change-Id: I0ca90bc2d85b4625336eb0396d8b2816a486b746 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-08-26Protect vs rally infine loopCédric Ollivier1-2/+6
It calls timeout (1 hour) to stop any hanging task [1]. It will be backported to Hunter and Iruya if similar failures are detected. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_full-run/9/console Change-Id: I8fe89f9fa1c6c39cd8810096c1d586bdef7865a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-16Allow rally_jobs without external networkCédric Ollivier1-0/+3
rally_jobs can verify network providers by skipping: - NeutronNetworks.create_and_delete_floating_ips - NeutronNetworks.create_and_list_floating_ips - NeutronNetworks.associate_and_dissociate_floating_ips Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: Ibda66e47f4d1101b53435ef4cd144dacbabff165 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-08-15Fix rally task file manipulationJuha Kosonen1-11/+11
Remove empty workload entries when applying blacklist in RallyJobs. Rally considers task file as invalid if it contains entries whose workload list empty. Change-Id: I34867c0aeea9c5ecf1294959d680e6de535be9cd Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-07-27Switch to Python 3.7 and Alpine 3.10Cédric Ollivier1-49/+50
It also allows building docs as doc8 is broken due to latest OpenStack's upper-constraints. pylint is updated to 2.3.1 (lastest py3.7 version) It disables perm as umask is currently false on lf-virtual1. Change-Id: If09d4796d48b7d0591e7926621d3bbf5ca1b6c24 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-10Allow scenarios without external networkCédric Ollivier2-0/+8
It allows creating testcases leveraging on Functest scenarios without external network. Then Rally can verify network providers by only skipping NovaServers.boot_server_associate_and_dissociate_floating_ip Change-Id: I07a9348214f7557195c7201466f7e37b2b980206 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add Barbican scenario in RallyCédric Ollivier3-1/+103
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is currently failing [1]. Barbican testing is optional as Gnocchi. [1] https://bugs.launchpad.net/rally/+bug/1819285 Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add swift scenario in rallyCédric Ollivier3-1/+76
As for refstack_object, it forces swift in SUT. Role is hardcoded to admin as for a few Neutron tests. Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-09Conform with latest Neutron rally jobCédric Ollivier1-1/+3
The last commit requires two additional task args [1][2]. [1] https://github.com/openstack/neutron/commit/ccef17605d1e28c418821c2235ba24c15893fff2#diff-720114afabbecd64333f4586a338f749 [2] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_jobs-run/145/console Change-Id: I4943f737be29bcadfead427a7852964e6438a018 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-02Publish rally logsCédric Ollivier1-0/+32
Both Rally and Tempest publish Rally debug logs. It also moves the logics from tempest to rally. Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-25Set utf-8 in decode and encode callsCédric Ollivier1-9/+9
It eases backporting in iruya and hunter as a few logs can't be decoded as ascii [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-24Decode Bytes in logging callsCédric Ollivier1-7/+7
It fixes a few incorrect types in log calls [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/ Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>