Age | Commit message (Collapse) | Author | Files | Lines |
|
http://artifacts.opnfv.org/functest/SXA8X2BBP3L4/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-1/tempest_heat_cntt/tempest-report.html
Change-Id: Ie26d561fbb490bcaafe7c8ffddebc28bd72ff51c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/3L7CL8K6CU2N/functest-ovn-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-29/neutron-tempest-plugin-api-cntt/tempest-report.html
Change-Id: I077464ed0fc734b97de089f549fb66ab137fccdb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It increases Heat coverage [1].
[1] http://artifacts.opnfv.org/functest/24ELW4C5RKD4/functest-ovn-opnfv-functest-smoke-latest-tempest_heat-run-34/tempest_heat/tempest-report.html
Change-Id: I6630e4827a59b2ded34e5c271b9155df3b25f588
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/C5BKAKPJIZVJ/functest-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-26/tempest_cinder_cntt/tempest-report.html
Change-Id: I5c0a7db033024259180610b83b07c055f0393e4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/53FYHR0Q9VVJ/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-20/tempest_full_cntt/tempest-report.html
Change-Id: Ia4bba0b14ed1d1058f0461e90207aa7530f2e0f3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/U0Y127OQNBF4/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-17/neutron-tempest-plugin-api-cntt/tempest-report.html
Change-Id: Ib19c63e1a7f6e4c050c19b520fe149ff7c81b156
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It skips the latest tests added in neutron-tempest-plugin [1][2]
[1] https://review.opendev.org/#/c/711656/
[2] http://artifacts.opnfv.org/functest/CQY2GVXZ1NTU/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-13/neutron-tempest-plugin-api-cntt/tempest-report.html
Change-Id: Iae9cd7a45f908c310133bf354b205a623f4c7476
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It increases neutron-tempest-plugin-api test count to 502.
It skips test_multiattach_rw_volume_update_failure which depends on volume multi-attach.
http://artifacts.opnfv.org/functest/BVDINIZ8P8UC/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-6/neutron-tempest-plugin-api-cntt/tempest-report.html
http://artifacts.opnfv.org/functest/BVDINIZ8P8UC/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-5/tempest_full_cntt/tempest-report.html
Change-Id: Id4d4918ee24ef15f9610e706d6e90dfa3ae2cc43
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account last results [1]
[1] http://artifacts.opnfv.org/functest/LIF2Y3SVUWLD/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-2/neutron-tempest-plugin-api-cntt/tempest-report.html
Change-Id: Idd03c5aa42309eb5f254d6a99ea7e7206ee705ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It decreases the threads from 4 to 3 to allow running the testcases in
parallel. Else a few tests sometimes fail.
Change-Id: I268eff5a72d5de5b26d7549ac74ee0e2a05cb61e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's not supported by radosgw which is now used in Functest SUTs [1][2].
It's removed from CNTT which seems leveraging on ceph (at least RI) [3]
[1] https://access.redhat.com/documentation/en-us/red_hat_ceph_storage/3.2/html/release_notes/bug-fixes
[2] http://artifacts.opnfv.org/functest/E46RCZLBRYCC/functest-opnfv-functest-smoke-hunter-tempest_slow-run-127/tempest_slow/tempest-report.html
[3] http://artifacts.opnfv.org/cntt/WKFRPQODPW34/cntt-opnfv-functest-smoke-latest-tempest_slow-run-37/tempest_slow/tempest-report.html
Change-Id: I8127df786c41af0d0285ef0e5cd1b28901685f65
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Test DB and API don't support suites which raise side effects in Cachet
if both IaaS verification and CNTT conformance are executed.
Vmtp and Shaker haven't been modified for CNTT. They will be renamed
once CNTT asks for new post processing.
http://testresults.opnfv.org:8080/
Change-Id: I64e06694620027faa06b6d9d339684f5e8d733d7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It was not listed in Keystone which defacto sets it as optional.
It may be considered as mandatory in a second step.
It should be noted that it's not working in CNTT RI and there is no
true plan to update CNTT RI from the time writing.
Close cntt-n/CNTT#1253
Change-Id: If7ee4efeafc05638173a51ce997ecbdcaabfc79c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/P5QXI9R2ULZQ/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run-29/neutron-tempest-plugin-api/tempest-report.html
Change-Id: I0dee2ecea051e1caafd6437bc1766c920b3e1ff4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It completes the first patch updating neutron-tempest-plugin-api [1].
The same dvr regex is used in tempest_slow, a new one is defined for
tempest_full which will be added in CNTT doc
(test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling).
Close cntt-n/CNTT#1106
Change-Id: I9fd79c9a82bb1f84a622ccb9ea316b8e43273e2a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account latest changes in CNTT [1]
[1] https://github.com/cntt-n/CNTT/pull/1107
Close cntt-n/CNTT#1106
Change-Id: I3212d1b765f7fd657ed603ed520d79fccae80bfa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
[1] http://artifacts.opnfv.org/functest/16S4PBMRW5HP/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run-23/neutron-tempest-plugin-api/tempest-report.html
Change-Id: I9cb04c3abdbb899d2f1d4188a9fb9743a8f4c6d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Close cntt-n/CNTT#1077
Change-Id: If9c0f52138e9f669f17933c42906936e2e196b2a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
dhcp_agent_scheduler [1] indirectly forces the Neutron backends
as highlighted by OVN testing.
[1] https://specs.openstack.org/openstack/neutron-specs/specs/api/agent_schedulers.html
Close cntt-n/CNTT#1073
Change-Id: Iafa3ad7f15dc157c0362ffa59eed31b89bf368e7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mostly adds admin as prefix.
Change-Id: Ic2e723b858ff1f3e26478f6037a19db1fd52e4aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
http://artifacts.opnfv.org/functest/2Y4502QRM7YM/functest-opnfv-functest-smoke-cntt-latest-tempest_full-run-16/tempest_full/tempest.log
Change-Id: Ifa1ae117db7dff6471ab557d6f7f3bf03940de76
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account the new tests added in Neutron Tempest Plugin.
Change-Id: I7994638c69ef6bd39bae3c6ded8409baabc27e9d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's skipped due to an upstream bug [1] highlighted by Jerma runs [2].
[1] https://launchpad.net/bugs/1836595
[2] http://artifacts.opnfv.org/functest/UXR96KDNMPTP/functest-opnfv-functest-smoke-cntt-jerma-tempest_slow-run-4/tempest_slow/tempest-report.html
Change-Id: Ib4cbf0e6e8e010febd39dec8dd8ecd773ad28c3e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It has to be part of the Compliance testing
Co-Authored-By: Deepanshu Bhatia <deepanshu@voereir.com>
Change-Id: I16d35e3c3a14b6b18901b6b27e50fc709ce0559f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows running
test_boot_into_disabled_port_security_network_without_secgroup.
It also sets a few default values.
Change-Id: I851c5d13705e0419a7e664e05d32eec0efb417c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes last Neutron Tempest plugin change into account [1].
It also increases test count.
[1] https://review.opendev.org/#/c/692822/
Change-Id: I5e7218dd808069a0be6d481447576099aa9c63e9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
concurrency is set to 2 in the upstream job [1] but it conflicts with
serial also passed.
As it fails once without any other test in parallel, the number of
executors should be decreased [2].
[0] https://799189c1bf6a1aa9c8de-48970bda2a30ee836a70a12e61555969.ssl.cf1.rackcdn.com/694893/1/check/tempest-slow/1bf5851/job-output.txt
[1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-cntt-hunter-tempest_slow-run-7/tempest_slow/tempest-report.html
Change-Id: I51bc9a584cf4b32a88b7a84d9387e7b8e90281c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
New tests have been published in the upstream project [1].
[1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run/4/console
Change-Id: I46603ed78f865f89fe2a7ebcf6a72da38a02bb14
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also deactivates ipv6 tests as for tempest_scenario.
Change-Id: Ie383e9c5b96fa4b7c989979a8c0bc8d9875d95ef
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The testcases related to ipv6 are currenty not executed because they
cannot be covered by our SUTs.
Close cntt-n/CNTT#696
Change-Id: Ic0ca3818011bede965702e778f37752059c86173
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It forbids skipping any test and counts the testcases executed.
It mosly avoids running tests accoring to the upstream skip tests
(known bugs), related to nova-network, glance v1, keystone v2 and
all features defined as optional by CNTT.
It fixes an issue highlighted by yallint.
Change-Id: Ib4678cb9e9fc37b16fcf21d8418931eae0f667d0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ib2898d48d21704a06cf1f4574df81f4f0dae3f52
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Gnocchi and Barbican are not currently selected by CNTT.
Then they are removed from the optional list.
Change-Id: I46d16b2cabd832b2655606b0708a6f43721cb3c5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It excludes test_federated_authentication as federation is currently
optional [1].
Close cntt-n/CNTT#624
[1] https://github.com/collivier/CNTT/commit/2e4ae5d0f4ebf4ef4bbc2504ed6cd46388361c09
Change-Id: Ie322e7912c429543c5da92f8afb33de3e8e75c8a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms with Cinder Microversions and Feature [1].
It cleans the testcases which require CNTT updates (Keystone, Glance,
Nova, etc.)
[1] https://github.com/cntt-n/CNTT/pull/577
Change-Id: I8e719e9f48d70a860c0f879117144bb3ce6f4875
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms with the last updates in API [1] adding Neutron QoS and
Trunk as mandatory.
QosMinimumBandwidthRuleTestJSON is skipped as it's not covered by
OpenStack (and Functest) gates.
[1] https://github.com/cntt-n/CNTT/pull/463
Change-Id: I54ff5e1fdb9b1e7265c63e3f66dfcf2f10db07d5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It tunes neutron-tempest-plugin-api to avoid skipping any test
(conformance as expected by CNTT). Until CNTT clearly defines the
optional and mandatory neutron extensions, it selects the
OpenStack and Functest gate values as default.
The next Neutron extensions are considered as optional (still verified
by functest-smoke):
- logging
- network-segment-range
- port-resource-request
- qos
- trunk
- l3-conntrack-helper
- metering
- floating-ip-port-forwarding
- uplink-status-propagation
- dns-domain-ports
- dns-integration
- router-interface-fip
The next tests (tempest_full, tempest_slow, tempest_scenario, etc.)
will be updated in next changes.
Change-Id: I003d1e509cd6dc7bd58261f27676fb53cb79e68c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|