Age | Commit message (Collapse) | Author | Files | Lines |
|
It also allows building docs as doc8 is broken due to latest
OpenStack's upper-constraints.
pylint is updated to 2.3.1 (lastest py3.7 version)
It disables perm as umask is currently false on lf-virtual1.
Change-Id: If09d4796d48b7d0591e7926621d3bbf5ca1b6c24
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows creating testcases leveraging on Functest scenarios without
external network. Then Rally can verify network providers by only
skipping NovaServers.boot_server_associate_and_dissociate_floating_ip
Change-Id: I07a9348214f7557195c7201466f7e37b2b980206
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It doesn't run BarbicanSecrets.create_symmetric_and_delete which is
currently failing [1].
Barbican testing is optional as Gnocchi.
[1] https://bugs.launchpad.net/rally/+bug/1819285
Change-Id: I9121ce3c9f29ba05069c905325327d4c4d0b9e71
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As for refstack_object, it forces swift in SUT.
Role is hardcoded to admin as for a few Neutron tests.
Change-Id: I0ae823fc8f31016d37831a82f7a50e92b2ed5f58
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The default quota could be inadequate if lots of computes.
Change-Id: I510d3ebd14c2a910b7be2bacc0b99d3059a7a881
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The last commit requires two additional task args [1][2].
[1] https://github.com/openstack/neutron/commit/ccef17605d1e28c418821c2235ba24c15893fff2#diff-720114afabbecd64333f4586a338f749
[2] https://build.opnfv.org/ci/job/functest-opnfv-functest-benchmarking-latest-rally_jobs-run/145/console
Change-Id: I4943f737be29bcadfead427a7852964e6438a018
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Both Rally and Tempest publish Rally debug logs.
It also moves the logics from tempest to rally.
Change-Id: I5c057d830202baddd73577ade1b09ce304e3c5a5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_compute-run/30/console
Change-Id: I77264525917af5f67cdecae85ef7a50439499db8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It eases backporting in iruya and hunter as a few logs can't be
decoded as ascii [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-iruya-juju_epc-run/56/console
Change-Id: I52a6f9a25130cbf62e8ce3b9972064ab73177665
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It fixes a few incorrect types in log calls [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-latest-daily/163/
Change-Id: I01790f6454694f434d31366f9c1cf9d98ff5a9cf
Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com>
|
|
It leverages on last Vmtp review which adds py3 support [1].
[1] https://review.opendev.org/659970
Change-Id: I8319b9e7eb88b9015961188d47657a8c67e0f8da
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It adds platform and object targets.
refstack_defcore is renamed to refstack_compute.
Change-Id: Iad5bfb27be614aada98eef5b3148965e65210725
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Functest containers leverage on Python3 instead of python2.
https://mail.python.org/pipermail/python-dev/2018-March/152348.html
It also updates robotframework librairies to latest release and Vmtp
to master ([1] is needed)
It patches cloudify rest client to support python3.
Vmtp is currently disabled because it currently supports python2 only.
[1] https://github.com/openstack/vmtp/commit/a5d062881d91bf4f547d92c6e289bea30feb5d6e#diff-b4ef698db8ca845e5845c4618278f29a
Change-Id: I39964a212ec2d4dbf53c9ea7c63f02e0b6a05b48
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms with OpenStack gates by default.
Change-Id: Icc1537b0f8342666d2a2a0de4655ba99f4f42470
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It creates a new env var BLOCK_MIGRATION (True by default) to allow
block migration for live migration in Rally.
It updates scenarios and blacklisting to take that env vars into account.
Change-Id: I41129432798ae9e40fe23bbe2c2162df4c0dff80
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The default values conform with OpenStack and Functest gates [1].
It could be set to false if shared storage-based live migration is
supported [2].
It also currently disables cold migration.
[1] http://logs.openstack.org/84/632984/24/check/tempest-multinode-full-py3/4216037/controller/logs/tempest_conf.txt.gz
[2] https://docs.openstack.org/nova/pike/admin/configuring-migrations.html
Change-Id: I0faa415eba610c20ba54353ac7ba7b0e83722c32
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It updates refstack_defcore and vmtp to conform with yaml [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-latest-refstack_defcore-run/186/console
Change-Id: I38e7a8d4c294c27f01c3e7385c4b716522a40334
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also increases number of lines to warm about duplicated codes.
Change-Id: I3914da8a90cbfe8fd024e9944c3adc8a617330d3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sets max_microversion to latest because if both values are not
specified, Tempest avoids tests which require a microversion [1].
It completes the previous change about nova [2].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
[2] https://gerrit.opnfv.org/gerrit/#/c/67318/
Change-Id: Ieab56a239077476dd9a0e1ee97ac4293c4075f5c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
tempest fails vs devstack stable/stein and it passes successfully vs
devstack stable/rocky (Functest gates) without that option.
It may be added to tempest_conf.yaml if SUT requires it.
Change-Id: I4730c25b25403fd130d71166a8778e06fd479935
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I1dd51a54f39967fcf6b3a522e2a548f81e5646a9
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
As a precondition for executing scenarios requiring volume, Rally
expects the presence of service named as "cinder". In a case when
there is only cinderv2 and cinderv3 configured in the system, Rally
fails to validate a testcase even the volume service is working ok.
Testcases in question changed to use v3.
Change-Id: I42e7f846e80d3647df274b2e03add94c9f0a34d6
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Network context not needed in following scenarios:
NeutronNetworks.create_and_delete_routers
NeutronNetworks.create_and_list_routers
NeutronNetworks.create_and_list_subnets
NeutronNetworks.create_and_update_routers
NeutronNetworks.create_and_update_subnets
NeutronNetworks.create_and_show_routers
Router not needed in network context in following scenarios:
NeutronNetworks.create_and_update_ports
NeutronNetworks.create_and_delete_ports
NeutronNetworks.create_and_delete_subnets
NeutronNetworks.create_and_list_ports
NeutronNetworks.create_and_show_ports
NeutronNetworks.create_and_show_subnets
This completes the patch skipping router creation [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/67429/
Change-Id: I80ea145a21168fd984cc9ef88d50af227f0d6ed4
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Do not create routers in those rally_sanity tests where the test does
not require it.
Change-Id: I6dd8a2b7579e11ca6ecc3b7383fa4d09a1e56ec3
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
|
|
It sets the shaker args to override ext net and name servers [1].
[1] https://pyshaker.readthedocs.io/en/latest/tools.html
Change-Id: I1cc6d52837e3c370db5ff59f024e96d7423be63a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It sets max_microversion to latest because if both values are not
specified, Tempest avoids tests which require a microversion [1].
Then test_keypairsv22_create_list_show_with_type is skipped and
refstack_defcore fails [2].
It also partially reverts "Allow building containers when
refstack.openstack.org is down" [3].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
[2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-refstack_defcore-run-147/results/refstack_defcore/tempest-report.html
[3] https://gerrit.opnfv.org/gerrit/#/c/67232/
Change-Id: Ia87543bb476d3047684e71ddfd05c2aa3f10bbfe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Set the result of refstack_defcore as failed if there were skipped testcases
in a run.
Change-Id: Id782c2dee511cefbafd5b4440f386fd66f934a47
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Snaps hasn't been synchronized for a while regarding requirements.
We do remove it due to the inactivity.
All test result tabs will be updated in a second change.
Change-Id: I834afd902829ed3883b0e88e92aa806ec43d6fcf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I597abdbb5bd3de023aa7b66fa27764ca2ec27f0d
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
It should be modified by tempest custom yaml file instead.
It's safe as the default timeout is bigger than the previous one.
It also cleans the obsolete tempest/rally data in config_functest.yaml.
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
Change-Id: Ibad02d8aaf90f154c82f3b60a6d3f04fc37bd7de
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Member is the default value [1] and SwiftOperator is not created by
default in OpenStack gates (devstack)
This role should be modified by tempest custom yaml file instead.
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
Change-Id: Ie77b91e36a7011e5730cbf5998e029c07ec7fe2f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This patch applies a change to the regex responsible for
identifying Tempest test cases. With the current regex some
skipped test cases are erroneously ignored.
The condition has been updated in order to match both format of
skipped testcases ('skip:' and 'skip [xxx]:')
Change-Id: Ie7144b01e07cae92918eede0324f3f1f2582c4aa
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
This patch adds success/failure information of rally test cases to
summary output.
Change-Id: Ie4f9b4972a26e187bb7afdddfd5ce51b16f3db12
Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
|
|
It adds xunit reports for rally-based and tempest-based testcases.
It completes the reports provided by snaps (thanks to Xtesting).
All rally related operations are moved to rally.
It allows removing the rally dependency to tempest which was false.
Change-Id: Ia7d2476f58f4f68b7c88442e50cad844037a36e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It switches from tempest.log to rally.log to conform with rally/stestr.
Change-Id: I00c2a268a2bc312a22a8d70278fad618c1c25235
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This patch adds the ability to specify which rally test to run by
setting the appropriate configuration value.
Change-Id: I6cbc9d12aada4f8eab68d2219d94ae1391a79021
Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
|
|
It eases sharing one single report including all task results.
For the time being, rally_jobs only generates neutron.html.
Then it only adds one report for rally_full and rally_sanity.
We may consider generating only one json file but it asks for
a refactoring (result parsing) which can be done in a second
change.
Change-Id: I8fa75ae80750336950f355c2aedc3dd4dc621cc5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The volume and the virtual machine created are not deleted.
Change-Id: I238fcb0839a2f609333080bc8c88b84327d51475
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Devstack allocates a 24G disk image by default [1].
It can be easily reached by setting volume size to 5G or 10G.
[1] https://github.com/openstack-dev/devstack/blob/master/stackrc#L779
Change-Id: I7c35d8f333718d6c192a9f12a714e626d60b1895
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It allows running test_user_update_own_password [1]
[1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-components-latest-tempest_full-run-8/results/tempest_full/tempest-report.html
Change-Id: I9f273ba58871f1e16886af623dcbb91f5c20c2f6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I88a58516a3620cc6b19013313672ad1a80791e70
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
It has been fixed in Snaps [1] but we can't sync its requiremets [2].
Then we have to remove the test.
[1] https://gerrit.opnfv.org/gerrit/#/c/66625/
[2] https://gerrit.opnfv.org/gerrit/#/c/66627/1
Change-Id: Ied405092cb4992bc04ca13c1536d1e8cee056ace
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 17b788c5340e7d76f6c37397cd8aa35c8db3f4c2)
|
|
|
|
urljoin works here only if url ends by /.
It replaces identity by v3 when running vs devstack.
Change-Id: Id896f2b54dfcabadaad1137deef91b1cb07c697d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It checks all 3 endpoints for image but nothing forces to define them.
Here is the only endpoint created by devstack.
glance | image | RegionOne
| | public: http://192.168.1.10/image
[1] keystoneauth1.exceptions.catalog.EndpointNotFound: internal endpoint for image service in RegionOne region not found
Change-Id: If501b849fbbed6df98742db21e924094c1df9c7f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|