Age | Commit message (Collapse) | Author | Files | Lines |
|
Both Cloudify based testcases print the same warning messages if
NEW_USER_ROLE is admin. An additional whitespace is removed too.
Change-Id: Idf2a2ea4373efdc579f0ac3e0a69ec08a7fbf105
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The default quota could be inadequate if lots of computes.
Change-Id: I510d3ebd14c2a910b7be2bacc0b99d3059a7a881
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The last commit requires two additional task args [1][2].
[1] https://github.com/openstack/neutron/commit/ccef17605d1e28c418821c2235ba24c15893fff2#diff-720114afabbecd64333f4586a338f749
[2] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_jobs-run/145/console
Change-Id: I4943f737be29bcadfead427a7852964e6438a018
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Both Rally and Tempest publish Rally debug logs.
It also moves the logics from tempest to rally.
Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_compute-run/30/console
Change-Id: I77264525917af5f67cdecae85ef7a50439499db8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console
Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It fixes a few incorrect types in log calls [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/
Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
|
|
It leverages on last Vmtp review which adds py3 support [1].
[1] https://review.opendev.org/659970
Change-Id: I8319b9e7eb88b9015961188d47657a8c67e0f8da
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It may be unsafe and it's useless for testing IMS if BONO_IP is set.
Change-Id: I8b0f010956defbfa1fd22b5aa5cbea70bd2968a4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It adds platform and object targets.
refstack_defcore is renamed to refstack_compute.
Change-Id: Iad5bfb27be614aada98eef5b3148965e65210725
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Functest containers leverage on Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html
It also updates robotframework librairies to latest release and Vmtp
to master ([1] is needed)
It patches cloudify rest client to support python3.
Vmtp is currently disabled because it currently supports python2 only.
[1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a
Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms with OpenStack gates by default.
Change-Id: Icc1537b0f8342666d2a2a0de4655ba99f4f42470
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It creates a new env var BLOCK_MIGRATION (True by default) to allow
block migration for live migration in Rally.
It updates scenarios and blacklisting to take that env vars into account.
Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The default values conform with OpenStack and Functest gates [1].
It could be set to false if shared storage-based live migration is
supported [2].
It also currently disables cold migration.
[1] http://logs.openstack.org/84/632984/24/check/tempest-multinode-full-py3/4216037/controller/logs/tempest_conf.txt.gz
[2] https://docs.openstack.org/nova/pike/admin/configuring-migrations.html
Change-Id: I0faa415eba610c20ba54353ac7ba7b0e83722c32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It updates refstack_defcore and vmtp to conform with yaml [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_defcore-run/186/console
Change-Id: I38e7a8d4c294c27f01c3e7385c4b716522a40334
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also increases number of lines to warm about duplicated codes.
Change-Id: I3914da8a90cbfe8fd024e9944c3adc8a617330d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sets max_microversion to latest because if both values are not
specified, Tempest avoids tests which require a microversion [1].
It completes the previous change about nova [2].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
[2] https://gerrit.opnfv.org/gerrit/#/c/67318/
Change-Id: Ieab56a239077476dd9a0e1ee97ac4293c4075f5c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It doesn't build juju deps if arm* as they can't be cross-compiled.
Then that deps won't be built in releng on native arm64 hosts
It's worth mentioning that containers have never been executed in
OPNFV gates.
That change allows running all other VNFs on Raspberry PI and
building containers without arm build servers.
Change-Id: I836a72f049e7f0e6ae704f5b829914692d5b2c09
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
tempest fails vs devstack stable/stein and it passes successfully vs
devstack stable/rocky (Functest gates) without that option.
It may be added to tempest_conf.yaml if SUT requires it.
Change-Id: I4730c25b25403fd130d71166a8778e06fd479935
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I1dd51a54f39967fcf6b3a522e2a548f81e5646a9
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
As a precondition for executing scenarios requiring volume, Rally
expects the presence of service named as "cinder". In a case when
there is only cinderv2 and cinderv3 configured in the system, Rally
fails to validate a testcase even the volume service is working ok.
Testcases in question changed to use v3.
Change-Id: I42e7f846e80d3647df274b2e03add94c9f0a34d6
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Network context not needed in following scenarios:
NeutronNetworks.create_and_delete_routers
NeutronNetworks.create_and_list_routers
NeutronNetworks.create_and_list_subnets
NeutronNetworks.create_and_update_routers
NeutronNetworks.create_and_update_subnets
NeutronNetworks.create_and_show_routers
Router not needed in network context in following scenarios:
NeutronNetworks.create_and_update_ports
NeutronNetworks.create_and_delete_ports
NeutronNetworks.create_and_delete_subnets
NeutronNetworks.create_and_list_ports
NeutronNetworks.create_and_show_ports
NeutronNetworks.create_and_show_subnets
This completes the patch skipping router creation [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/67429/
Change-Id: I80ea145a21168fd984cc9ef88d50af227f0d6ed4
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Do not create routers in those rally_sanity tests where the test does
not require it.
Change-Id: I6dd8a2b7579e11ca6ecc3b7383fa4d09a1e56ec3
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It adds loops to wait for services.
It sets dns forwarders to allow sending Heat signal at last
instructions.
Change-Id: I3ae29ddbaee5f8b2086078bd5245e140348f0dcf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It sets the shaker args to override ext net and name servers [1].
[1] https://pyshaker.readthedocs.io/en/latest/tools.html
Change-Id: I1cc6d52837e3c370db5ff59f024e96d7423be63a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sets max_microversion to latest because if both values are not
specified, Tempest avoids tests which require a microversion [1].
Then test_keypairsv22_create_list_show_with_type is skipped and
refstack_defcore fails [2].
It also partially reverts "Allow building containers when
refstack.openstack.org is down" [3].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
[2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-refstack_defcore-run-147/results/refstack_defcore/tempest-report.html
[3] https://gerrit.opnfv.org/gerrit/#/c/67232/
Change-Id: Ia87543bb476d3047684e71ddfd05c2aa3f10bbfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Set the result of refstack_defcore as failed if there were skipped testcases
in a run.
Change-Id: Id782c2dee511cefbafd5b4440f386fd66f934a47
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
create_numbers.py has been killed by other services as described in [1].
It's now called when ellis is up and running.
It adds few sleeps to ensure the right boot orders (signals must be send
before switching DNS).
[1] http://www.projectclearwater.org/using-start-stop-daemon-with-the-python-interpreter/
Change-Id: I87ad3828c10d3ccbc707ed8f4ab99987c6968f09
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I94310aa609d2c56609e0a5f0e46932af4aee02eb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Snaps hasn't been synchronized for a while regarding requirements.
We do remove it due to the inactivity.
All test result tabs will be updated in a second change.
Change-Id: I834afd902829ed3883b0e88e92aa806ec43d6fcf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It avoids useless loops for cloud init messages.
It now conforms with clearwater-docker (disable ipv6 in cassandra).
Change-Id: I6f469cf48224296b2eaa079d342642c5caca65f5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I597abdbb5bd3de023aa7b66fa27764ca2ec27f0d
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It forces a single network for both management and signaling traffic.
It meets the OPNFV deployment requirements and the Functest SUT ones.
The security group will be improved in a second step to first quickly
fix the testcase in gambia. Private IPs may be registered in DNS to
avoid network address translations.
Change-Id: Ic19cf336ac5c2d07c52c6dd37b06271790145cf9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It should be modified by tempest custom yaml file instead.
It's safe as the default timeout is bigger than the previous one.
It also cleans the obsolete tempest/rally data in config_functest.yaml.
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
Change-Id: Ibad02d8aaf90f154c82f3b60a6d3f04fc37bd7de
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Member is the default value [1] and SwiftOperator is not created by
default in OpenStack gates (devstack)
This role should be modified by tempest custom yaml file instead.
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
Change-Id: Ie77b91e36a7011e5730cbf5998e029c07ec7fe2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It will be enhanced in a second step to calculate options from configs.
Change-Id: I91738e1aaad9a7049df44f734c4190def62fff91
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It eases testing with less resources.
It conforms with the new values in the Cloudify part [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/67092/
Change-Id: I1f6158a42fd8ed390c07e7c773bb246f81adef3b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This patch applies a change to the regex responsible for
identifying Tempest test cases. With the current regex some
skipped test cases are erroneously ignored.
The condition has been updated in order to match both format of
skipped testcases ('skip:' and 'skip [xxx]:')
Change-Id: Ie7144b01e07cae92918eede0324f3f1f2582c4aa
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
It doesn't store any file.
Change-Id: I94801508a11edb8f0bbff7e4319c4d50411ec715
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's worth mentionning that the filesystem is hugely reduced.
Change-Id: Ic3e8a5d601a62f1762cbd491c228b7f053905e35
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I8f1ccdb709dbb3e7a22a404c036714dd848dd87d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It eases testing with less resources.
Change-Id: I301cdff0c8dfb2cf70ef53fc446749e1a70b0919
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This patch adds success/failure information of rally test cases to
summary output.
Change-Id: Ie4f9b4972a26e187bb7afdddfd5ce51b16f3db12
Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
|
|
It adds xunit reports for rally-based and tempest-based testcases.
It completes the reports provided by snaps (thanks to Xtesting).
All rally related operations are moved to rally.
It allows removing the rally dependency to tempest which was false.
Change-Id: Ia7d2476f58f4f68b7c88442e50cad844037a36e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It switches from tempest.log to rally.log to conform with rally/stestr.
Change-Id: I00c2a268a2bc312a22a8d70278fad618c1c25235
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This patch adds the ability to specify which rally test to run by
setting the appropriate configuration value.
Change-Id: I6cbc9d12aada4f8eab68d2219d94ae1391a79021
Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
|