Age | Commit message (Collapse) | Author | Files | Lines |
|
It includes "Fix resource leaks in EndPointGroupsTest" [1] which
removes the 2 remaining tempest services.
It's worth mentioning they raised side effects when trying to connect
to Horizon.
Change-Id: Ic85fa38a4690c5532d10d21d2eec64d99ab1e8cd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 084ce7dd3976d65409f54d8ff5010e709ec76cd6)
|
|
Change-Id: Iea42b7ef8a76ff1c7bd56e88290c716776dd9291
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 90389efe0257f730418181291b82dda9c390b953)
|
|
It has been down for days and break our gates again.
Change-Id: I66e286f3624c776c7cec5164df53eb117550e78a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 6b578b9068164eab33b2cc2d6002f59b9af88f8d)
|
|
This reverts commit 4fd59de2b5751437ca6faf71415129cf6f64cf8f.
It should have been applied in master and iruya only.
Change-Id: I8f467e5cbe2f230a0a3f119a3f4ad80da8a5a6bf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It includes the fix "Cleanup Tempest tests legacy resources" [1]
which cleans all remaining routers and security groups detected
in Functest gates.
[1] https://github.com/openstack/neutron-tempest-plugin/commit/2de722ef0af284b4f68e952df53ad4f0d9d452be#diff-44d072bece4c5873f0e78df8ad7cacf2
Change-Id: I4da824447ab67e4b0aba044c39467f8f105b5630
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They don't clean routers (tempest-L3AgentsExtRbacTest-Router) after
testing.
Change-Id: I78cfc783feb51d0f1b029c98e988c07e57e1e694
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d4178d425312497412e9832fb6cb1a074e5099f3)
|
|
test_dualnet_multi_prefix_slaac which is uncovered (marked as slow) by
OpenStack gates [1] is failing on lf-virtual6 [2]. Updating to 20.0.0
is closer to the current OpenStack Neutron Rocky gates
(tempest==20.0.1.dev42) [3].
It's worth mentioning that we cannot downgrade to 19.0.0 because the
next commit is needed [4].
[1] http://logs.openstack.org/28/656428/1/check/tempest-multinode-full-py3/74d9cd7/testr_results.html.gz
[2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-tempest_scenario-run-113/results/tempest_scenario/tempest-report.html
[3] http://logs.openstack.org/57/654957/2/check/neutron-tempest-multinode-full/e5eda83/job-output.txt.gz
[4] https://github.com/openstack/tempest/commit/3588bb3f5ef546a0ef4d4ad621fd1be381b5fdaf
Change-Id: I496df1272f26ad73daf388070b762b736e4e5fd8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
All gates are failing due wrong to redirections (see os-faults [1][2]).
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-tempest-latest-gate/96/console
[2] https://travis-ci.org/collivier/functest/builds/522071220
Change-Id: I5a8ca67f0d95df24daa9bdca2f23eb13d896f9d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2ceebaa032f07c4162ed3701c6814dfe5cb683d4)
|
|
It may fail when testing OpenStack in production or when running
testcases in parallel [1] because vxlan 200 is hardcoded [2]
[1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-hunter-patrole-run-75/results/patrole/tempest-report.html
[2] https://github.com/openstack/patrole/blob/master/patrole_tempest_plugin/tests/api/network/test_networks_rbac.py#L208
Change-Id: Ibfaed6f3a95d016790baafebd203e49e152a889b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8ee279600186f2713b4c181965d8d290d2644cfb)
|
|
It sets max_microversion to 2.65 because if both values are not
specified, Tempest avoids tests which require a microversion [1].
Then test_keypairsv22_create_list_show_with_type is skipped and
refstack_defcore fails [2].
It also partially reverts "Allow building containers when
refstack.openstack.org is down" [3].
[1] https://docs.openstack.org/tempest/latest/sampleconf.html
[2] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-latest-refstack_defcore-run-147/results/refstack_defcore/tempest-report.html
[3] https://gerrit.opnfv.org/gerrit/#/c/67232/
Change-Id: I609ad1586ad5d03a00196c28ff5c6c23228037ce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Set the result of refstack_defcore as failed if there were skipped testcases
in a run.
Change-Id: Id782c2dee511cefbafd5b4440f386fd66f934a47
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit cfd79ec4c39e215a25fc3d99fc5368e7d874f7bf)
|
|
Snaps hasn't been synchronized for a while regarding requirements.
We do remove it due to the inactivity.
All test result tabs will be updated in a second change.
Change-Id: I834afd902829ed3883b0e88e92aa806ec43d6fcf
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit e44841210c53290207db9b958c66cb8019910cb7)
|
|
It has been down for days and break our gates.
Change-Id: I2e18a95abaced050f85f6efb8e849e0a5d497ea1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a52900d8c926dc4370dea3b3ebe94d20d05e1357)
|
|
It conforms with SFC regex and fits OPNFV criteria.
Running scenarios may force the use of bagpipe [1].
The SUT (functest-virtual) is being updated to verify SFC and BGPVPN
apis.
[1] https://docs.openstack.org/networking-bgpvpn/latest/user/drivers/bagpipe/index.html
Change-Id: I1442b9cac7eaba1aeef04e36a2f790bd29f90976
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2b4e7955815ce27284043c03730fff6ace029a0d)
|
|
It takes into account the wget exit values and avoids manipulating a
falsy empty file.
It won't help fixing the network outages in LF network which have been
highlighted by false failures in api_check (the wrong snaps package
is installed [1])
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-healthcheck-latest-api_check-run/100/console
Change-Id: Ic9b75965b1ffb1f7bb342ff216bda9933ca75f0b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit fa8c50f4fd19576a2fde5b04077810d4ca91b330)
|
|
Rally_jobs were moved into benchmarking.
It completes "Move testcases in the right tiers" [1]
[1] https://gerrit.opnfv.org/gerrit/#/c/66875/
Change-Id: I1c2da77eff6682f85ab8504750077c9ee542edb8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit dd217735edd2e596d396a2b8815b418548f78111)
|
|
It completes "Move testcases in the right tiers" [1]
[1] https://gerrit.opnfv.org/gerrit/#/c/66863/
Change-Id: Ic2e6ebf9371de87caafbfdb54029a24440e6fd5b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Here are the moves:
- tempest_smoke in healthcheck
- tempest_full and tempest_scenario in smoke
- rally_jobs in benchmarking
It avoids conflicts between benchmarking tools and few functional
tests (short timeouts).
Then it should allow running in parallel all testcases in one tiers.
It also allows cleaning the additional steps defined in releng.
rally_full could move in benchmarking in a second step.
Change-Id: I0bc657557a61c7d9bf7679b4f2dbda08c36728ca
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 1d0f0bbf773aaaf7139b76442a9e59d13bd32830)
|
|
Change-Id: Ieadf7ec3d1b05eefa6634db5f3d0ea264e9994af
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The execution of an optional scenario is skipped if the corresponding
openstack service does not exist.
Change-Id: I8721f26ebc253ce02138b85d6c88e659c5afae80
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 3b7b393ca643bcf7db0361bcc4414b74fff953be)
|
|
It updates smoke/Dockerfile to allow pulling Neutron reviews/tags
(rally_jobs).
Change-Id: Ifc10eebb444bfe2c3e1fb47a9bd52d8a4f8a7007
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 2d0c8cb6eaf10b7c712335beb79fae726ea3a965)
|
|
Change-Id: I4f6fbbef814a5b45aeb3b6152878421fc6e998bc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Include Neutron rally-jobs.
Change-Id: Ic1122962bd7d876d179729640a8a321bc36442d8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 5d54a533d25a989dc64a2789788ff2f2fd6ad5c6)
|
|
It fails at least vs OpenStack Queens.
OPNFV Gambia Installers are still falsy running latest then we do
disable it.
It has to be double checked as soon as Functest can be verified vs
Rocky or newer.
Change-Id: I7126c61d0c26b16f9058ed813af3344ca2930a86
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 9b941ea58c60827d563d266f7dedd0d95de3ca93)
|
|
Change-Id: I6e4634b4633075c0146bef064deb28f2ae34472b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0592fdff11d3f6e28101b7af11bf71a7d21f5842)
|
|
It completes the previous change.
Change-Id: I3d65e15eba6a4ba812466a01cefe938002a9b177
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I409975acd1493e2f5a6bdcb3a4bd6ff6e383e02e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
tempest.conf conforms with Devstack post-actions [1].
One test is still disabled as it may force to sign all images.
A deeper analysis has to be done before enabling it.
[1] https://github.com/openstack/barbican-tempest-plugin/blob/master/tools/pre_test_hook.sh
Change-Id: I163c0e7c4671ca67f0b6c127c29fdcb12a8e426b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ic5754821542e873bb7d33a8864a852993947b762
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It inits the repos and fetch the required tags/ids/branches.
All tags are fetched to meet pbr requirements.
Change-Id: I0accd8ad04b93d63857e301dea11af69e0edf957
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Neutron and Barbican tempest plugins have just been released.
Change-Id: Ib9c523e9a75dae31249fd84ba454d0ef8537ca1d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also updates all jobs and fixes Dockerhub hooks.
Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Xtesting leverages on stevedore [1] which will bring much more
flexibility (discovery, module or class renaming, etc).
OPNFV Features have to be updated as well:
- https://gerrit.opnfv.org/gerrit/61713
- https://gerrit.opnfv.org/gerrit/61715
- https://gerrit.opnfv.org/gerrit/61717
- https://gerrit.opnfv.org/gerrit/61719
[1] https://docs.openstack.org/stevedore/latest/
Change-Id: I0ce45eb6c9af66546c2c020eb962fa457f6c7e1a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* changes:
Allow refs as vnf requirement versions
Avoid downloading git history
|
|
It decreases container build duration.
depth 1 is set only when TAG is not a commit id because
github.com doesn't advertise commit ids.
It switches to git.openstack.org as much as possible.
Change-Id: I3ad7a38eda0f7023302d71bb55de23828120f599
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
In fraser release we observed that refstack tests are executed in parallel
and that might causes problems in CI because without concurrency
parameter it will try to use as many cpus as possible and that might
lead to race condition issues.
This patch is created for backporting purposes to fraser branch
where the problem occurs.
JIRA: DOVETAIL-662
Change-Id: I6cf0ad3a32e88f04abd00d69523aa8ac47c39470
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
|
|
They are mandatory before releasing.
Change-Id: I2980536e28d183343ff0a9520ca9ee663e437fee
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
To conform with Openstack Queens
Change-Id: I7d65a1d7fe7c9a30e2c00a8a0eac2ab3fe1b9428
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It stops depending on refstack_client which cannot work till
OpenStack Queens.
JIRA: FUNCTEST-977
Change-Id: I2340643de82ab10d8fb83fb3a7fbfd1f412b2d7b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
All Joid runs are stopped, then these scenarios can't be maintained.
Change-Id: Ida7c8c86cbd377024047d4abbbc1806ad65afc8a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Vmtp package delivers amd64 binaries in both architectures.
JIRA: ARMBAND-396
Change-Id: I4c6e010e47c8aa9adfafb373c261262d23ef382a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The patch "Reuse the router passed as config if available" [1] was
merged.
[1] https://review.openstack.org/#/c/588459/
Change-Id: Iad8a1ff694f0bff3e13922a6c248dbe49b313a11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I6f1452469cb5ffaf9b538ba87edaa174977b91c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: If3191d8e8c16854aa059e6483b3c0ea704777c05
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It adds testcases and updates regexes to conform with OpenStack gates:
- tempest-full
- neutron-tempest-plugin-api
It should be noted that tempest-smoke is no longer run in gates and
two testcases are available for tempest-full as we can't manage
Tempest combine.
Criteria is set to 100% for tempest_full (it works in OpenStack
gates).
JIRA: FUNCTEST-1000
Change-Id: I77a0f533255483bdf61f0a5f60c9c437ce843591
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now runs vtmp via a new admin member. Else it fails due to cidr
already used.
It only creates a router and both tenant networks are still created
by VMTP.
Change-Id: I05ed41a3b7a01ee97c720176c404929bf8ea97a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They don't pass in two different Queens deployments.
The topic will continue upstream.
Change-Id: I43d6b8306aee6934fa1545ec3ed8130bb9b23ee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The related review has been merged [1].
[1] https://review.openstack.org/#/c/580914/
Change-Id: I64dc2a38b08d02ea653582159d2af83fc7e16e31
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Else neutron_trunk is skipped [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/184/console
Change-Id: I5d63e84414d8fc3af3ef2ac5b4d023fc5e59ef81
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Else it conflicts with the new tempest config fields [1].
It makes sense to switch to includes here.
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/566/console
Change-Id: If7b3025b4003ea5704c6a3cdeae8cd00f1c5509e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|