Age | Commit message (Collapse) | Author | Files | Lines |
|
This provides a more generic way to integrate test case lists which are
not hosted in Functest.
Also removes vm scenarios since they have never been a part of actual
rally runs.
Change-Id: Ib0a020fe72800915bbf2d10ecc690a248d33c246
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Rally warns from these deprecated conf sections.
Change-Id: I15933c4f2cda14384e53202ec22f438a586d7b05
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
JIRA: FUNCTEST-1009
Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
|
|
If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for
/home/opnfv/functest/data/accounts.yaml which contains the set of
pre-existing credentials to use for testing [1].
It also sets admin_domain_scope and default_credentials_domain_name.
[1] https://docs.openstack.org/tempest/latest/configuration.html
Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
It may allow bypassing RBAC policies if required.
Change-Id: I3b7ad44d7b80f8ea757846afdcd787b686c52856
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Enables utilization of blacklist also on non-OPNFV environments since
there is no link to installer type.
JIRA: FUNCTEST-1008
Change-Id: I3a012b8b7e7dbd049f8794dff3c9d56dcc1cadad
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Enables utilization of blacklist also on non-OPNFV environments since
there is no link to installer type.
JIRA: FUNCTEST-1008
Change-Id: I3eb4377af153480794c1a71c5d7ef3e78dacacb9
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It's linked to a specific configuration on purpose which doesn't meet
all OpenStack deployments [1].
JIRA: SNAPS-322
Change-Id: I372f8ed56600e1846383d1da76720a0d3783e901
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
JIRA: FUNCTEST-1003
Change-Id: Ic55998977386f95f619a355d22bd285782fe81f0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
The rally.conf gets copied before the target directory has been created.
JIRA: FUNCTEST-1007
JIRA: DOVETAIL-730
Change-Id: Ie774fce994ada644c1163600e6c62e1231fde443
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
They are blocking in Orange Openlab as the support is missing.
A dynamic check has to be implemented before activating it.
Change-Id: I8d87251fa4589f96d3515e411aeec5e79b7e7960
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also copies rally.conf and tempest.log in res_dir.
Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Else rally_sanity may print logs in tempest_smoke res dir.
Change-Id: Iae97d533e9b99dcf8da70229b0675228472bfe52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It stops depending on refstack_client which cannot work till
OpenStack Queens.
JIRA: FUNCTEST-977
Change-Id: I2340643de82ab10d8fb83fb3a7fbfd1f412b2d7b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
FUNCTEST-1002
Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
All Joid runs are stopped, then these scenarios can't be maintained.
Change-Id: Ida7c8c86cbd377024047d4abbbc1806ad65afc8a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/387/console
Change-Id: I3ef130bf5ad4b46f26776feeaa434ca528965f36
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
XCI will be able to deploy this feature
on top of pharos lab with GPU so we have test it
This test can be improved in the future with OpenCL tests etc
| DEPLOY_SCENARIO | os-nosdn-vgpu-ha |
+-------------------+-------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+-------------------+------------------+----------------+
| vgpu | functest | 01:00 | PASS |
+-------------------+-------------------+------------------+----------------+
Change-Id: I50618f47097a0257b1834b3966054d20458715df
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
|
|
|
|
It also redirect stderr to stdout as tempest mainly prints in stderr.
JIRA: FUNCTEST-999
Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Utilize the output of Rally task execution since it internally
validates the task.
Use Popen.communicate to get the output from the running Rally task.
Change-Id: I9b1299bc26129ff4f89adccec611c78195a3ab02
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Change-Id: Ie23628f39979e3497c81e23d99f30e0dc7564055
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Else shaker may run until job timeout if deployment misconfigurations [1]
[1] https://jira.opnfv.org/browse/FUNCTEST-998
JIRA: FUNCTEST-998
Change-Id: I948ff8ffeeccdab637927614193d2c2ef03fe5c8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console
Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It makes difficult to find the issues (floating ip, boot, ssh
connection, etc...) for a small benefit regarding the current
testcase implementations.
It increases the default floating ip timeout because it has been
reached when running Functest multiple times in parallel. It may
be the root cause when running singlevm vs XCI (in that case,
neutron api and agents are hosted in a nested vm).
Change-Id: Ia97e04902321644c207c59987283754318aee5e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It now runs vtmp via a new admin member. Else it fails due to cidr
already used.
It only creates a router and both tenant networks are still created
by VMTP.
Change-Id: I05ed41a3b7a01ee97c720176c404929bf8ea97a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It completes "Switch create_server timeout to default value" [1]
which forbids waiting more that 180s (create_server was asynchronous).
[1] https://gerrit.opnfv.org/gerrit/#/c/60423/2
Change-Id: Icbf9ee48024fe9e10571c2bb7ca895d5828fb561
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Test failes to parse /etc/rally/rally.conf
(RALLY_CONF_FILE) whith inplace=1 keyword argument
for fileinput
One new space is added in second line
JIRA: ARMBAND-395
Change-Id: I8adb333047f9962f4105a6a74e2f8ef83d5745e0
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
|
|
It ends after a little bit more than 3 minutes in Apex [1].
It increases to 5 minutes like Cloudify.
[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-30_11-30-01/functest.log
Change-Id: I8362034107e694ddd5a1e4a1f9e11362100d7cb0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
private_v4 and public_v4 are incorrectly set when vlan is used as
overlay.
JIRA: FUNCTEST-996
Change-Id: I120a247e92e0fd295769b2a0eeb15ce82a0eabc8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I152ac898661a0e99a6232df86689c70c468ceaa5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
60s was successfully reached when running all containers (3
containers * 3 branches) in parallel.
It also removes the wait attribute (the current impl will meet
a possible next asynchronous design) which is useless here.
For the time being, only cloudify needs an extra timeout.
Change-Id: Ic7741b4c1a3223be076fb69ef70a3cb6c05456c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Else it could raise unauthorized exceptions [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Rally may print additional data to console which results in an
invalid json files. The json files are generated via rally instead of
dumping stdout.
It's mandatory to backport the next bugfix [1] in stable/fraser.
[1] https://gerrit.opnfv.org/gerrit/#/c/60265/
Change-Id: Ifbd90e685a7b52c70b3110a46e3c7991eddc05f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It fixes the possible mismatch if both OS_TENANT and OS_PROJECT are
set [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console
Change-Id: I66b6e3cf30a34aff1234da00cdd6b40da92089e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As Keystone roles are case insensitive, Admin is checked as well.
Change-Id: I28a611add7890c3188a289d1e24c043d88c34ea1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows testing OpenStack Queens and older [1].
It will be improved in a second change for latest OpenStack releases
(if deprecated).
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/174/console
Change-Id: I6e91e8c45d335aa606370c35b0a03b990e22c165
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This reverts commit 74c4e99c18d00d80ce7a2c2f0c36e656a842b966.
Change-Id: I6fdfd080e0e3b46e1d65b992e680daefe260add9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This reverts commit 59ba5abb31018282bca796ee0c0652d61192c6bf.
Change-Id: I87a01b828668123dc9d96f5ac7823686ff0fb10e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Snaps is testing vs OpenStack Queens following the traditional
release track. Then Snaps testcases must be skipped vs OpenStack
master as deployed by Apex.
Snaps isn't compatible yet with the last Cinder changes (API
microversions) which is out of its current scope [1].
[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-19_05-29-02/functest.log
Change-Id: I1e93527d9c87eb11bf7fd0cc9d04597614d32370
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ie0fdfd2bbd93952bcd35a30c96b7980ffeb0d87c
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
|