Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e28706a10c20bcb359f7d2283802ea9b4ef4bc66)
|
|
It pleases the networking configuration proposed by Airship.
Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5b96694ec402cede3e0ce3b57fa7e7cff281f179)
|
|
Neutron leverages on the upstream Rally task in Stein and newer.
Leveraging on the upstream task may fix the side effects which
sometimes occured on Vmtp and Shaker [1] and filled better the CNTT
model.
[1] https://build.opnfv.org/ci/view/functest/job/functest-hunter-daily/574/
Change-Id: I5ee2e3a3ca956cf57365bf4579534177e87dc08b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As for refstack_object, it forces swift in SUT.
Role is hardcoded to admin as for a few Neutron tests.
Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 72a238d63d6e2e15eb74d02c3030663404c3872c)
|
|
self.details is now a dict and summary is located under root [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-hunter-rally_sanity-run/422/console
Change-Id: Ic89e674b2f6660704b9dafe6070a224753e2af46
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 07b6f59f209d4bdf7b9a722ac348f87f3bfce320)
|
|
It avoids parsing rally task outputs which may hang (subprocess
communicate) as seen in rally_full and rally_jobs.
It simply selects test names as tags.
Change-Id: I88b54a8f155e557f8a606fdbd7d86c1f4d5dae3b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 74df72ec294998787a8f0af5e2084db91ba0778b)
|
|
If one hypervisor is down, few tempest test fails.
User is free to set SKIP_DOWN_HYPERVISORS if it's down on purpose.
Change-Id: I7b6a4d0d8f67755d8c1550fd1bc6fd707634f68b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7332716dc835cd72b0beefc38afda2697bd99e02)
|
|
|
|
Else tempest_slow fails if one hypervisor is down (detected in ONAP
Openlab). It also improves Shaker, Rally and Vmtp which count them.
Change-Id: Iee7c20e0357d9237501c5c451580d8f6409ac86b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 22b37f0482f84fc935ae9ece3c9722098c0573bc)
|
|
Rally now leverages on list_services as proposed in utils [1]
[1] https://git.opnfv.org/functest/commit/?id=0837a745c81ed2a6e7df097f60d227d5997c805e
Change-Id: Ib17f9b530c2933d4a49eb5b744c2ae80b24ad560
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9d839eb3a0109609513c23f9362573ae3aed0904)
|
|
Set timeout on subprocess invocation instead of spawned child process.
Increase the timeout value for rally_full to 2h since the execution
typically takes ~90min [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_full-run/22/
Change-Id: I0ca90bc2d85b4625336eb0396d8b2816a486b746
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 9f07e41cc85f3dbe6e5eb151a0c59743521a6c00)
|
|
Remove empty workload entries when applying blacklist in RallyJobs.
Rally considers task file as invalid if it contains entries whose
workload list empty.
Change-Id: I34867c0aeea9c5ecf1294959d680e6de535be9cd
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It benefits from the swith to lf-virtual1.
Change-Id: Ib38bf0adb09df62173894d048fb06c48b3a4b462
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 4138ba00dd8db7fcf043a071f4c44b52e33265bc)
|
|
It allows creating testcases leveraging on Functest scenarios without
external network. Then Rally can verify network providers by only
skipping NovaServers.boot_server_associate_and_dissociate_floating_ip
Change-Id: I07a9348214f7557195c7201466f7e37b2b980206
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a30e0c35f248cc9225e628e3a64723b2184d6087)
|
|
It partially cherry-picks "Conform with latest Neutron rally job" [1]
[1] https://gerrit.opnfv.org/gerrit/#/c/68021/
Change-Id: I4943f737be29bcadfead427a7852964e6438a018
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0de102e46f3e8c3d7389a67a6f375fed69db4617)
|
|
Both Rally and Tempest publish Rally debug logs.
It also moves the logics from tempest to rally.
Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit bc88eff8f5850f8207431bb8d1958fe6b9cd09e8)
|
|
It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console
Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 5853dd1ef3c522a975f9685250b1b3e85588f738)
|
|
It fixes a few incorrect types in log calls [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/
Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
(cherry picked from commit 7d58f89103a8c44fd166c3e06b492ade63e5c5b3)
|
|
Functest containers leverage on Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html
It also updates robotframework librairies to latest release and Vmtp
to master ([1] is needed)
It patches cloudify rest client to support python3.
Vmtp is currently disabled because it currently supports python2 only.
[1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a
Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2a0702ea914a574ffa7c6d6f83a5c606e24ebd0a)
|
|
It creates a new env var BLOCK_MIGRATION (True by default) to allow
block migration for live migration in Rally.
It updates scenarios and blacklisting to take that env vars into account.
Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 940e49a6cdf7ae0f8286c953952a9757ba63a20b)
|
|
It also increases number of lines to warm about duplicated codes.
Change-Id: I3914da8a90cbfe8fd024e9944c3adc8a617330d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9dcc30874194382a25c66baf359b863c6e013caf)
|
|
As a precondition for executing scenarios requiring volume, Rally
expects the presence of service named as "cinder". In a case when
there is only cinderv2 and cinderv3 configured in the system, Rally
fails to validate a testcase even the volume service is working ok.
Testcases in question changed to use v3.
Change-Id: I42e7f846e80d3647df274b2e03add94c9f0a34d6
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit ebc2b41505299846faeb2163d34d820a8ef2bdb2)
|
|
This patch adds success/failure information of rally test cases to
summary output.
Change-Id: Ie4f9b4972a26e187bb7afdddfd5ce51b16f3db12
Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
(cherry picked from commit 13777d607dd219ace0157e560ff11c3cd6f1aad0)
|
|
It adds xunit reports for rally-based and tempest-based testcases.
It completes the reports provided by snaps (thanks to Xtesting).
All rally related operations are moved to rally.
It allows removing the rally dependency to tempest which was false.
Change-Id: Ia7d2476f58f4f68b7c88442e50cad844037a36e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 3393f2016483555c27d612c69ec11274cc8aa72a)
|
|
This patch adds the ability to specify which rally test to run by
setting the appropriate configuration value.
Change-Id: I6cbc9d12aada4f8eab68d2219d94ae1391a79021
Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
(cherry picked from commit d0cb38d7ad5046700564f2700df9b8c92706b32c)
|
|
It eases sharing one single report including all task results.
For the time being, rally_jobs only generates neutron.html.
Then it only adds one report for rally_full and rally_sanity.
We may consider generating only one json file but it asks for
a refactoring (result parsing) which can be done in a second
change.
Change-Id: I8fa75ae80750336950f355c2aedc3dd4dc621cc5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2df7a0728d687de9a24d8432ef30bbd2ecd771c8)
|
|
The execution of an optional scenario is skipped if the corresponding
openstack service does not exist.
Change-Id: I8721f26ebc253ce02138b85d6c88e659c5afae80
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 3b7b393ca643bcf7db0361bcc4414b74fff953be)
|
|
It eases editing it or verifyfing it via yamllint.
Change-Id: I380830eff5f404745e284067b5a10f58dc60b80e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit f600874cef933a2077a51bb334365a861e6fbb48)
|
|
Use /home/opnfv/functest/data/rally/task directory for storing
temporary files when running rally tasks.
Also removes unused vm scenario from task service list.
Change-Id: Icfd4f99ebe6194360bda8bd88e497e018a9541a0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 520331a06750dd02228f840c346402f52fb864e8)
|
|
rally_jobs is failing vs APEX which still sets OS_TENANT [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console
Change-Id: I672bfa93b37b1b773ea7d20fdd91bea0ff14b79f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 83e0e6836d7f5e18eb4eb8c9d28b4e6980b790c2)
|
|
Change-Id: I15393b870d648432c900d429d17129c630ed4f58
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit aff6640b5aed37221a05067e93ee164273c16910)
|
|
Include Neutron rally-jobs.
Change-Id: Ic1122962bd7d876d179729640a8a321bc36442d8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 5d54a533d25a989dc64a2789788ff2f2fd6ad5c6)
|
|
It sets [openstack] keystone_default_role if NEW_USER_ROLE differs
from member.
Change-Id: Ib6be5cf22654e882ea110298cba421c1e87c78fd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This provides a more generic way to integrate test case lists which are
not hosted in Functest.
Also removes vm scenarios since they have never been a part of actual
rally runs.
Change-Id: Ib0a020fe72800915bbf2d10ecc690a248d33c246
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Enables utilization of blacklist also on non-OPNFV environments since
there is no link to installer type.
JIRA: FUNCTEST-1008
Change-Id: I3eb4377af153480794c1a71c5d7ef3e78dacacb9
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
FUNCTEST-1002
Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Utilize the output of Rally task execution since it internally
validates the task.
Use Popen.communicate to get the output from the running Rally task.
Change-Id: I9b1299bc26129ff4f89adccec611c78195a3ab02
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Else it could raise unauthorized exceptions [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Rally may print additional data to console which results in an
invalid json files. The json files are generated via rally instead of
dumping stdout.
It's mandatory to backport the next bugfix [1] in stable/fraser.
[1] https://gerrit.opnfv.org/gerrit/#/c/60265/
Change-Id: Ifbd90e685a7b52c70b3110a46e3c7991eddc05f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It checks all openstack resources before cleaning.
It allows removing images even if the test fail quickly.
Change-Id: I1763b8a70fa7ffeb03c435e8e775c7afd1a7adac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: If63c228f2844194279b560515f4ab24a4ee88be0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
self.result can be positive due to intermediary steps (scenarios).
Else it can return false positives [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-virtual-suite-master/113/console
Change-Id: Iecadee7f7380fda5273a0668aff1b441647c45aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also fixes clean().
Change-Id: I42d1305d5cdb5a717cfa7fce26798ac7102310f7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They are highlighted by the last pylint version.
Change-Id: I473212a413013492716993fb536903b13bff66ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It applied the same operations as [1].
Only one config is used between rally, tempest and vping.
[1] https://gerrit.opnfv.org/gerrit/#/c/57613/
Change-Id: I4d5fd2117d404b7eaa79326e21a35272232d0b92
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Use data provided by report generation since the output of task
results is not available as valid JSON if task didn't finish
gracefully.
JIRA: FUNCTEST-966
Change-Id: Ieb906bc209cc26055babd5f4e6b2bb556724f9a8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Use Shade for managing OpenStack resources in rally.
Change-Id: Ic8b7aaef6886f6ca4930b2ea463317b75ed8d3c9
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It converts private subnet name to str as it's mandary till [1].
It could be reverted as soon as [2] is merged in snaps.
[1] https://gerrit.opnfv.org/gerrit/#/c/56091/
[2] https://gerrit.opnfv.org/gerrit/#/c/56171/
Change-Id: Ia728415207f8ecb5b5ac55982f82337c45671c4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Added scenarios for testing:
- capabilities
- status
- archive policy
- archive policy rule
- resource
- resource type
- metric
Change-Id: I79f4f0b2bd4d206588ea3edbce8037d1cb993646
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
The API utilized by Rally in Ceilometer scenarios was deprecated in
OpenStack Pike and scenarios were blacklisted. Remove these scenarios
from respository.
JIRA: FUNCTEST-949
Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|