Age | Commit message (Collapse) | Author | Files | Lines |
|
http://artifacts.opnfv.org/functest/EP1852KPIZEE/functest-opnfv-functest-smoke-latest-rally_sanity-run-920/rally_sanity/rally_sanity.html#/VMTasks.dd_load_test/failures
Change-Id: I959d414692dd52e76175a7341f7d16ef28ab8472
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/TCEP6YYTDWIG/functest-opnfv-functest-benchmarking-latest-rally_full-run-181/rally_full/rally_full.html#/NovaServers.boot_and_associate_floating_ip
Change-Id: I45d666e80a55802ab6c672dfb5f3cf93dc5381bb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows running dd in VM (simple disk benchmarking).
https://github.com/cntt-n/CNTT/issues/1477
Change-Id: I4f1150637460f6e0b661fc80fec2cc292efcc511
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now fails [1]:
Traceback (most recent call last):
File "/src/rally/rally/task/runner.py", line 70, in _run_scenario_once
getattr(scenario_inst, method_name)(**scenario_kwargs)
File "/usr/lib/python3.8/site-packages/rally_openstack/task/scenarios/nova/servers.py", line 1115, in run
floatingip = self.neutron.create_floatingip(**create_floating_ip_args)
File "/src/rally/rally/task/service.py", line 114, in wrapper
return func(instance, *args, **kwargs)
File "/src/rally/rally/task/atomic.py", line 91, in func_atomic_actions
f = func(self, *args, **kwargs)
TypeError: create_floatingip() got an unexpected keyword argument 'ext_network'
[1] http://artifacts.opnfv.org/functest/JOGVTC31O1IL/functest-opnfv-functest-smoke-latest-rally_sanity-run-905/rally_sanity/rally_sanity.html#/NovaServers.boot_server_associate_and_dissociate_floating_ip/failures
Change-Id: I7157847980b417b814d15e4bf3bbac3c4f114690
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms to the OpenStack gates which have just updated to Cirros
0.5.1
Change-Id: If2ec4b2da2152c244af7ea86a57054fea195c4ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now conforms with the other tasks which sets 1 Gb as default.
Change-Id: Ibadb2bee2bea7a79db2eb27d0cc1867a823d7935
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Most of the rally_full runs failed vs our new SUTs (radosgw) .
This two params fail the testing when higher than 1 (verified
independently).
As the new test config works when hugely tested in //, it makes sens to
merge the new config to fix the gates.
This patch will be safely reverted if the issue is confirmed on SUT.
Change-Id: I222652d484a5e06190c12d45d6c1882de5ab9eec
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Ovn fails vs rally_full [1] but passes vs rally_jobs.
It reverts the small diff between rally_full and rally_jobs added by
"Update network context in selected rally tests". Then it may raise
side effects in case of L2-only testing [2]
[1] http://artifacts.opnfv.org/functest/JDD0PPKUOYO5/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_full_cntt-run-9/rally_full_cntt/rally_full_cntt.html
[2] https://github.com/opnfv/functest/commit/b4b2e7f9a5a3cb3379b45ac4ddd0ef949974a698
Change-Id: I5c7591a46de1b534b6b3dc511ca2caf20ac48e1f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/ONA0SEFCMPR5/functest-opnfv-functest-smoke-latest-rally_sanity-run-688/functest.log
Change-Id: Ied7bd209aedd713fbd64b169247de7931098ca8b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account "Remove deprecated stuff. Part 1" [1] and then fixes
rally_sanity and rally_full
(NovaKeypair.boot_and_delete_server_with_keypair [2])
[1] https://github.com/openstack/rally-openstack/commit/4436258d8fbb758a1771f908726e78c29e309c8a#diff-a80e66732701c545c7fc540d02ee1066
[2] http://artifacts.opnfv.org/functest/HG7XUW226S1T/functest-opnfv-functest-smoke-latest-rally_sanity-run-687/rally_sanity/rally_sanity.html#/NovaKeypair.boot_and_delete_server_with_keypair/failures
Change-Id: Id39b3231153efcccd58ed6bd988e26e2a672825b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It was blacklisted for a while and it's still failing [1][2].
It has to be removed from scenarios (blacklisting is useless and could
mislead endusers).
[1] http://artifacts.opnfv.org/functest/BYERCT6UZDWT/functest-opnfv-functest-benchmarking-iruya-rally_full-run-227/rally_full/rally_full.html
[2] http://artifacts.opnfv.org/functest/LYQLHFQB7CTI/functest-opnfv-functest-benchmarking-hunter-rally_full-run-329/rally_full/rally_full.html
Change-Id: I9ccea90a70024b6e54d873024cf550db5beea990
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is
currently failing [1].
Barbican testing is optional as Gnocchi.
[1] https://bugs.launchpad.net/rally/+bug/1819285
Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As for refstack_object, it forces swift in SUT.
Role is hardcoded to admin as for a few Neutron tests.
Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It creates a new env var BLOCK_MIGRATION (True by default) to allow
block migration for live migration in Rally.
It updates scenarios and blacklisting to take that env vars into account.
Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As a precondition for executing scenarios requiring volume, Rally
expects the presence of service named as "cinder". In a case when
there is only cinderv2 and cinderv3 configured in the system, Rally
fails to validate a testcase even the volume service is working ok.
Testcases in question changed to use v3.
Change-Id: I42e7f846e80d3647df274b2e03add94c9f0a34d6
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Network context not needed in following scenarios:
NeutronNetworks.create_and_delete_routers
NeutronNetworks.create_and_list_routers
NeutronNetworks.create_and_list_subnets
NeutronNetworks.create_and_update_routers
NeutronNetworks.create_and_update_subnets
NeutronNetworks.create_and_show_routers
Router not needed in network context in following scenarios:
NeutronNetworks.create_and_update_ports
NeutronNetworks.create_and_delete_ports
NeutronNetworks.create_and_delete_subnets
NeutronNetworks.create_and_list_ports
NeutronNetworks.create_and_show_ports
NeutronNetworks.create_and_show_subnets
This completes the patch skipping router creation [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/67429/
Change-Id: I80ea145a21168fd984cc9ef88d50af227f0d6ed4
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Do not create routers in those rally_sanity tests where the test does
not require it.
Change-Id: I6dd8a2b7579e11ca6ecc3b7383fa4d09a1e56ec3
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Devstack allocates a 24G disk image by default [1].
It can be easily reached by setting volume size to 5G or 10G.
[1] https://github.com/openstack-dev/devstack/blob/master/stackrc#L779
Change-Id: I7c35d8f333718d6c192a9f12a714e626d60b1895
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
rally_sanity:
NovaServers.boot_server_associate_and_dissociate_floating_ip
rally_full:
NovaServers.boot_server_associate_and_dissociate_floating_ip
NovaServers.boot_and_associate_floating_ip
Change-Id: I31b7693828920bae92ff4ac8e7b0fde86e958cb5
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
This provides a more generic way to integrate test case lists which are
not hosted in Functest.
Also removes vm scenarios since they have never been a part of actual
rally runs.
Change-Id: Ib0a020fe72800915bbf2d10ecc690a248d33c246
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
New scenarios:
GnocchiResource.create_resource (rally_full)
GnocchiResource.create_delete_resource (rally_sanity, rally_full)
Change-Id: Ica03bdd60224d97ef0ec0d45c2cd25c295723ffc
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Added scenarios for testing:
- capabilities
- status
- archive policy
- archive policy rule
- resource
- resource type
- metric
Change-Id: I79f4f0b2bd4d206588ea3edbce8037d1cb993646
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
The API utilized by Rally in Ceilometer scenarios was deprecated in
OpenStack Pike and scenarios were blacklisted. Remove these scenarios
from respository.
JIRA: FUNCTEST-949
Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Add network id to following scenarios:
CinderVolumes.create_snapshot_and_attach_volume
CinderVolumes.create_nested_snapshots_and_attach_volume
JIRA: FUNCTEST-929
Change-Id: If95babebf9ea6205684494395bdfd72d5203f4bf
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
ChangeLog: https://git.launchpad.net/cirros/plain/ChangeLog
Change-Id: Ic41bec08b9dbfa7f1a501d5ba18602ba455fb5d0
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
For heat scenario in rally, assign heat_stack_owner role to
the new created users.
Change-Id: I86a74ca88993ed3782d21b22eb5933d639d86c94
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
Remove network and servers context and set image and flavor as a
scenario parameters.
Change-Id: I5181ccce61c4f58af3737619d1b7d259cf539937
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Included several CinderQos and CinderVolumeTypes scenarios introduced
by the recent Rally version.
Change-Id: Ibd2affa2e0d24ec79d3b4518456ca0f0457ace9f
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Included several new NeutronNetworks and NeutronSecurityGroup
scenarios introduced by the recent Rally version.
Change-Id: I87ad0947ab6b4e1faf8fcad9006dbe34251c313b
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Several new NovaServers and NovaServerGroups scenarios available along
with the recent Rally update.
Change-Id: Iee27174923da5a1a25991d8ab5e18f1d404b09ef
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
|
|
Some new glance scenarios have been added in Rally stable/0.10 [1].
[1]: https://github.com/openstack/rally/releases/tag/0.10.0
Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com>
Change-Id: I91ffe31b8cc5c94991c9bdd6e33b756c447d82ce
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Nova-Network are not alive any more and have been removed
in Rally stable/0.10 [1].
[1]: https://github.com/openstack/rally/releases/tag/0.10.0
JIRA: FUNCTEST-883
Change-Id: I45a20504589003a39ff27770709de6881e69aee3
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Create flavors and use them in rally scenarios instead of expecting
certain flavors to pre-exist.
Change-Id: I77c94ab80fcabd7b80ffb36f9856a48121858009
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Rally scenarios don't require volume type to exist as a precondition.
Change-Id: Id735346e062af084635fd8f76f3686005b9b8add
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Ceilometer scenarios were added.
Reasons for testcase blacklisting:
- Deprecated ceilometer client used by Rally. This depends on the
confuguration of the system, currently it seems to affect all
installers.
- A bug in ceilometer client (already fixed and merged in OpenStack
repository).
JIRA: FUNCTEST-849
Change-Id: I0bd7e1e9817538165b7b9705bcec213d7d275359
Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
|
|
It also updates all python scripts which call check_os.sh.
The former healthcheck.sh is removed.
No shell script must be executable in git.
Change-Id: If4e8deb50ebd635a9091e3bb79ef61c07b9660dc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
HttpRequests scenario is not directly related to OpenStack and not
supported by Rally in https environment.
Change-Id: I2e91d129d82dfaba62eca25e3e4890ff54f52ac6
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
JIRA: FUNCTEST-579
Change-Id: Iaa545db70bfb76770df0a3d17871e29ce518ff2d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|