aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack/rally/scenario
AgeCommit message (Collapse)AuthorFilesLines
2023-05-13Complete migration to Cirros 0.6.1Cédric Ollivier1-1/+1
Change-Id: I2fed5dc5798a3d217be032d754da9f7dbbbd30d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-04Temporarily blacklist ↵Cédric Ollivier1-13/+0
CinderVolumeTypes.create_volume_type_add_and_list_type_access Change-Id: Ibe2437970d962af8262e885e44a2caafb4c08828 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-12-03Temporarily remove CinderVolumeTypes.create_and_update_volume_typeCédric Ollivier1-14/+0
A few tests are linked to Cinder v2 which was dropped in Xena Change-Id: I1d7e4ff4cdca61e553738ae79d21eb34033198a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Remove all network data in Rally full tasksCédric Ollivier1-24/+0
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Update Rally sanity tasks and blacklists for L2 onlyCédric Ollivier1-9/+0
This issues were hidden by Airship limitation (live-migration fails) Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Update NovaServers.boot_server_associate_and_dissociate_floating_ipCédric Ollivier2-6/+3
It conforms with "Fix nova scenarios for assiciating fips" [1] http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html [1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460 Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-27Add nics net-id when booting dd load testCédric Ollivier1-0/+2
http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-24Rename ext_network to floating_network in Rally tasksCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Add VMTasks.dd_load_test in Rally test casesCédric Ollivier1-0/+17
It allows running dd in VM (simple disk benchmarking). https://github.com/cntt-n/CNTT/issues/1477 Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-23Rename ext_network to floating_network in Rally tasksCédric Ollivier2-2/+2
It now fails [1]: Traceback (most recent call last): File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run floatingip = self.neutron.create_floatingip(**create_floating_ip_args) File "/src/rally/rally/task/service.py", line 114, in wrapper return func(instance, *args, **kwargs) File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) TypeError: create_floatingip() got an unexpected keyword argument 'ext_network' [1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-07-15Update Cirros to O.5.1Cédric Ollivier2-2/+2
It conforms to the OpenStack gates which have just updated to Cirros 0.5.1 Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-14Decrease volume size in boot_server_attach_created_volume_and_live_migrateCédric Ollivier2-2/+2
It now conforms with the other tasks which sets 1 Gb as default. Change-Id: Ibadb2bee2bea7a79db2eb27d0cc1867a823d7935 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-12Merge "Conform with the upstream create_and_delete_subnets"Cedric Ollivier1-2/+0
2020-04-10Set concurrency and containers_per_tenant to 1Cédric Ollivier1-6/+6
Most of the rally_full runs failed vs our new SUTs (radosgw) . This two params fail the testing when higher than 1 (verified independently). As the new test config works when hugely tested in //, it makes sens to merge the new config to fix the gates. This patch will be safely reverted if the issue is confirmed on SUT. Change-Id: I222652d484a5e06190c12d45d6c1882de5ab9eec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-09Conform with the upstream create_and_delete_subnetsCédric Ollivier1-2/+0
Ovn fails vs rally_full [1] but passes vs rally_jobs. It reverts the small diff between rally_full and rally_jobs added by "Update network context in selected rally tests". Then it may raise side effects in case of L2-only testing [2] [1] http://artifacts.opnfv.org/functest/JDD0PPKUOYO5/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run-9/rally_full_cntt/rally_full_cntt.html [2] https://github.com/opnfv/functest/commit/b4b2e7f9a5a3cb3379b45ac4ddd0ef949974a698 Change-Id: I5c7591a46de1b534b6b3dc511ca2caf20ac48e1f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Fix the Glance tasksCédric Ollivier2-4/+6
http://artifacts.opnfv.org/functest/ONA0SEFCMPR5/functest-opnfv-functest-smoke-latest-rally_sanity-run-688/functest.log Change-Id: Ied7bd209aedd713fbd64b169247de7931098ca8b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-04-05Update server_kwargs to boot_server_kwargsCédric Ollivier2-2/+2
It takes into account "Remove deprecated stuff. Part 1" [1] and then fixes rally_sanity and rally_full (NovaKeypair.boot_and_delete_server_with_keypair [2]) [1] https://github.com/openstack/rally-openstack/commit/4436258d8fbb758a1771f908726e78c29e309c8a#diff-a80e66732701c545c7fc540d02ee1066 [2] http://artifacts.opnfv.org/functest/HG7XUW226S1T/functest-opnfv-functest-smoke-latest-rally_sanity-run-687/rally_sanity/rally_sanity.html#/NovaKeypair.boot_and_delete_server_with_keypair/failures Change-Id: Id39b3231153efcccd58ed6bd988e26e2a672825b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-27Fully remove Quotas.nova_update_and_deleteCédric Ollivier1-11/+0
It was blacklisted for a while and it's still failing [1][2]. It has to be removed from scenarios (blacklisting is useless and could mislead endusers). [1] http://artifacts.opnfv.org/functest/BYERCT6UZDWT/functest-opnfv-functest-benchmarking-iruya-rally_full-run-227/rally_full/rally_full.html [2] http://artifacts.opnfv.org/functest/LYQLHFQB7CTI/functest-opnfv-functest-benchmarking-hunter-rally_full-run-329/rally_full/rally_full.html Change-Id: I9ccea90a70024b6e54d873024cf550db5beea990 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add Barbican scenario in RallyCédric Ollivier1-0/+98
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is currently failing [1]. Barbican testing is optional as Gnocchi. [1] https://bugs.launchpad.net/rally/+bug/1819285 Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-06-28Add swift scenario in rallyCédric Ollivier1-0/+71
As for refstack_object, it forces swift in SUT. Role is hardcoded to admin as for a few Neutron tests. Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-02Manage block_migration in RallyCédric Ollivier2-6/+6
It creates a new env var BLOCK_MIGRATION (True by default) to allow block migration for live migration in Rally. It updates scenarios and blacklisting to take that env vars into account. Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-04-09Set cinder service type in rally testsJuha Kosonen5-0/+88
As a precondition for executing scenarios requiring volume, Rally expects the presence of service named as "cinder". In a case when there is only cinderv2 and cinderv3 configured in the system, Rally fails to validate a testcase even the volume service is working ok. Testcases in question changed to use v3. Change-Id: I42e7f846e80d3647df274b2e03add94c9f0a34d6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-04-01Update network context in selected rally testsJuha Kosonen2-18/+12
Network context not needed in following scenarios: NeutronNetworks.create_and_delete_routers NeutronNetworks.create_and_list_routers NeutronNetworks.create_and_list_subnets NeutronNetworks.create_and_update_routers NeutronNetworks.create_and_update_subnets NeutronNetworks.create_and_show_routers Router not needed in network context in following scenarios: NeutronNetworks.create_and_update_ports NeutronNetworks.create_and_delete_ports NeutronNetworks.create_and_delete_subnets NeutronNetworks.create_and_list_ports NeutronNetworks.create_and_show_ports NeutronNetworks.create_and_show_subnets This completes the patch skipping router creation [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/67429/ Change-Id: I80ea145a21168fd984cc9ef88d50af227f0d6ed4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-03-28Skip router creation in selected rally testsJuha Kosonen1-6/+12
Do not create routers in those rally_sanity tests where the test does not require it. Change-Id: I6dd8a2b7579e11ca6ecc3b7383fa4d09a1e56ec3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-01-28Decrease volume_size in all Rally testsCédric Ollivier3-7/+7
Devstack allocates a 24G disk image by default [1]. It can be easily reached by setting volume size to 5G or 10G. [1] https://github.com/openstack-dev/devstack/blob/master/stackrc#L779 Change-Id: I7c35d8f333718d6c192a9f12a714e626d60b1895 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-02Add Rally scenarios for testing floating IPJuha Kosonen2-0/+51
rally_sanity: NovaServers.boot_server_associate_and_dissociate_floating_ip rally_full: NovaServers.boot_server_associate_and_dissociate_floating_ip NovaServers.boot_and_associate_floating_ip Change-Id: I31b7693828920bae92ff4ac8e7b0fde86e958cb5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-03Refactor RallyBaseJuha Kosonen2-55/+0
This provides a more generic way to integrate test case lists which are not hosted in Functest. Also removes vm scenarios since they have never been a part of actual rally runs. Change-Id: Ib0a020fe72800915bbf2d10ecc690a248d33c246 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-24Add Rally GnocchiResource scenariosJuha Kosonen2-0/+27
New scenarios: GnocchiResource.create_resource (rally_full) GnocchiResource.create_delete_resource (rally_sanity, rally_full) Change-Id: Ica03bdd60224d97ef0ec0d45c2cd25c295723ffc Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-19Introduce Rally scenarios for GnocchiJuha Kosonen2-0/+273
Added scenarios for testing: - capabilities - status - archive policy - archive policy rule - resource - resource type - metric Change-Id: I79f4f0b2bd4d206588ea3edbce8037d1cb993646 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-09Remove Ceilometer test scenariosJuha Kosonen2-705/+0
The API utilized by Rally in Ceilometer scenarios was deprecated in OpenStack Pike and scenarios were blacklisted. Remove these scenarios from respository. JIRA: FUNCTEST-949 Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-02-06Fix rally cinder volume attach scenariosJuha Kosonen1-0/+6
Add network id to following scenarios: CinderVolumes.create_snapshot_and_attach_volume CinderVolumes.create_nested_snapshots_and_attach_volume JIRA: FUNCTEST-929 Change-Id: If95babebf9ea6205684494395bdfd72d5203f4bf Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-12-21Update cirros image to 0.4.0Michael Polenchuk2-2/+2
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-12-06Assign heat_stack_owner role to the new userLinda Wang2-0/+34
For heat scenario in rally, assign heat_stack_owner role to the new created users. Change-Id: I86a74ca88993ed3782d21b22eb5933d639d86c94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-05Merge "Add new cinder scenarios for rally sanity/full"Cedric Ollivier2-0/+157
2017-11-04Fix rally cinder scenariosJuha Kosonen1-10/+2
Remove network and servers context and set image and flavor as a scenario parameters. Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-03Add new cinder scenarios for rally sanity/fullJuha Kosonen2-0/+157
Included several CinderQos and CinderVolumeTypes scenarios introduced by the recent Rally version. Change-Id: Ibd2affa2e0d24ec79d3b4518456ca0f0457ace9f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-02Add new neutron scenarios for rally sanity/fullJuha Kosonen2-0/+168
Included several new NeutronNetworks and NeutronSecurityGroup scenarios introduced by the recent Rally version. Change-Id: I87ad0947ab6b4e1faf8fcad9006dbe34251c313b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Add new nova scenarios for rally sanity/fullJuha Kosonen2-0/+123
Several new NovaServers and NovaServerGroups scenarios available along with the recent Rally update. Change-Id: Iee27174923da5a1a25991d8ab5e18f1d404b09ef Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-11-01Merge "Add new glance scenarios for rally 0.10"Linda Wang2-1/+92
2017-10-31Add new glance scenarios for rally 0.10Linda Wang2-1/+92
Some new glance scenarios have been added in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I91ffe31b8cc5c94991c9bdd6e33b756c447d82ce Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-10-31Remove some obsolete scenarios for rally 0.10Linda Wang2-72/+0
Nova-Network are not alive any more and have been removed in Rally stable/0.10 [1]. [1]: https://github.com/openstack/rally/releases/tag/0.10.0 JIRA: FUNCTEST-883 Change-Id: I45a20504589003a39ff27770709de6881e69aee3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-20Dedicated flavors for rally testsJuha Kosonen1-1/+1
Create flavors and use them in rally scenarios instead of expecting certain flavors to pre-exist. Change-Id: I77c94ab80fcabd7b80ffb36f9856a48121858009 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-09-11Remove volume type handlingJuha Kosonen1-21/+0
Rally scenarios don't require volume type to exist as a precondition. Change-Id: Id735346e062af084635fd8f76f3686005b9b8add Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-24Add Rally scenarios for telemetryMartin Kulhavy2-0/+705
Ceilometer scenarios were added. Reasons for testcase blacklisting: - Deprecated ceilometer client used by Rally. This depends on the confuguration of the system, currently it seems to affect all installers. - A bug in ceilometer client (already fixed and merged in OpenStack repository). JIRA: FUNCTEST-849 Change-Id: I0bd7e1e9817538165b7b9705bcec213d7d275359 Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
2017-06-30Define download_images.sh and check_os.sh as scriptsCédric Ollivier1-0/+0
It also updates all python scripts which call check_os.sh. The former healthcheck.sh is removed. No shell script must be executable in git. Change-Id: If4e8deb50ebd635a9091e3bb79ef61c07b9660dc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-27Remove Rally requests scenarioJuha Kosonen1-11/+0
HttpRequests scenario is not directly related to OpenStack and not supported by Rally in https environment. Change-Id: I2e91d129d82dfaba62eca25e3e4890ff54f52ac6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-28Update cirros image to latest versionMichael Polenchuk2-2/+2
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-11-25file/dir renaming for consistencyMorgan Richomme27-0/+2011
JIRA: FUNCTEST-579 Change-Id: Iaa545db70bfb76770df0a3d17871e29ce518ff2d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>