aboutsummaryrefslogtreecommitdiffstats
path: root/docker/smoke-cntt
AgeCommit message (Collapse)AuthorFilesLines
2020-04-01Rename CNTT specific testcasesCédric Ollivier1-7/+7
Test DB and API don't support suites which raise side effects in Cachet if both IaaS verification and CNTT conformance are executed. Vmtp and Shaker haven't been modified for CNTT. They will be renamed once CNTT asks for new post processing. http://testresults.opnfv.org:8080/ Change-Id: I64e06694620027faa06b6d9d339684f5e8d733d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-03-05Add oauth1 as optional Keystone featuresCédric Ollivier1-2/+3
It was not listed in Keystone which defacto sets it as optional. It may be considered as mandatory in a second step. It should be noted that it's not working in CNTT RI and there is no true plan to update CNTT RI from the time writing. Close cntt-n/CNTT#1253 Change-Id: If7ee4efeafc05638173a51ce997ecbdcaabfc79c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-28Increate Neutron test count to 501Cédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/P5QXI9R2ULZQ/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run-29/neutron-tempest-plugin-api/tempest-report.html Change-Id: I0dee2ecea051e1caafd6437bc1766c920b3e1ff4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-21Skip a few tests in tempest_full and tempest_slowCédric Ollivier1-2/+5
It completes the first patch updating neutron-tempest-plugin-api [1]. The same dvr regex is used in tempest_slow, a new one is defined for tempest_full which will be added in CNTT doc (test_network_basic_ops.TestNetworkBasicOps.test_router_rescheduling). Close cntt-n/CNTT#1106 Change-Id: I9fd79c9a82bb1f84a622ccb9ea316b8e43273e2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-18Update test case list in neutron-tempest-plugin-apiCédric Ollivier1-2/+24
It takes into account latest changes in CNTT [1] [1] https://github.com/cntt-n/CNTT/pull/1107 Close cntt-n/CNTT#1106 Change-Id: I3212d1b765f7fd657ed603ed520d79fccae80bfa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-17Fix incorrect test numbersCédric Ollivier1-1/+1
[1] http://artifacts.opnfv.org/functest/16S4PBMRW5HP/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run-23/neutron-tempest-plugin-api/tempest-report.html Change-Id: I9cb04c3abdbb899d2f1d4188a9fb9743a8f4c6d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-16Exclude vxlan testing in CNTTCédric Ollivier1-1/+5
Close cntt-n/CNTT#1077 Change-Id: If9c0f52138e9f669f17933c42906936e2e196b2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Set dhcp_agent_scheduler as optionalCédric Ollivier1-3/+5
dhcp_agent_scheduler [1] indirectly forces the Neutron backends as highlighted by OVN testing. [1] https://specs.openstack.org/openstack/neutron-specs/specs/api/agent_schedulers.html Close cntt-n/CNTT#1073 Change-Id: Iafa3ad7f15dc157c0362ffa59eed31b89bf368e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Order regex in neutron-tempest-plugin-api (CNTT)Cédric Ollivier1-4/+5
It mostly adds admin as prefix. Change-Id: Ic2e723b858ff1f3e26478f6037a19db1fd52e4aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Decrease test_count to 1290 in tempest_fullCédric Ollivier1-1/+1
http://artifacts.opnfv.org/functest/2Y4502QRM7YM/functest-opnfv-functest-smoke-cntt-latest-tempest_full-run-16/tempest_full/tempest.log Change-Id: Ifa1ae117db7dff6471ab557d6f7f3bf03940de76 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-02-15Increase test_count to 547 in neutron-tempest-plugin-apiCédric Ollivier1-1/+1
It takes into account the new tests added in Neutron Tempest Plugin. Change-Id: I7994638c69ef6bd39bae3c6ded8409baabc27e9d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-24Update Alpine to 3.11Cédric Ollivier1-2/+2
It also updates Python to 3.8 (default version). It selects arm32v6 et arm64v8 repos and switches multiarch binfmt. https://alpinelinux.org/posts/Alpine-3.11.0-released.html Change-Id: Ib41cf0ab805ce2137658f3ff656b0a88c7b4ebf5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-01-09Remove test_server_connectivity_cold_migration_revert from ComplianceCédric Ollivier1-1/+2
It's skipped due to an upstream bug [1] highlighted by Jerma runs [2]. [1] https://launchpad.net/bugs/1836595 [2] http://artifacts.opnfv.org/functest/UXR96KDNMPTP/functest-opnfv-functest-smoke-cntt-jerma-tempest_slow-run-4/tempest_slow/tempest-report.html Change-Id: Ib4cbf0e6e8e010febd39dec8dd8ecd773ad28c3e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-30Remove test_server_connectivity_cold_migration_revert from exclusion listCédric Ollivier1-2/+1
It has to be part of the Compliance testing Co-Authored-By: Deepanshu Bhatia <deepanshu@voereir.com> Change-Id: I16d35e3c3a14b6b18901b6b27e50fc709ce0559f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-27Set port_security: true in tempest_conf.yamlCédric Ollivier2-2/+5
It allows running test_boot_into_disabled_port_security_network_without_secgroup. It also sets a few default values. Change-Id: I851c5d13705e0419a7e664e05d32eec0efb417c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-27Set create_shared_resources to trueCédric Ollivier2-1/+2
It takes last Neutron Tempest plugin change into account [1]. It also increases test count. [1] https://review.opendev.org/#/c/692822/ Change-Id: I5e7218dd808069a0be6d481447576099aa9c63e9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-07Run tests sequentially in tempest_slowCédric Ollivier1-1/+1
concurrency is set to 2 in the upstream job [1] but it conflicts with serial also passed. As it fails once without any other test in parallel, the number of executors should be decreased [2]. [0] https://799189c1bf6a1aa9c8de-48970bda2a30ee836a70a12e61555969.ssl.cf1.rackcdn.com/694893/1/check/tempest-slow/1bf5851/job-output.txt [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-smoke-cntt-hunter-tempest_slow-run-7/tempest_slow/tempest-report.html Change-Id: I51bc9a584cf4b32a88b7a84d9387e7b8e90281c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-12-07Increase tests_count (538) in CNTT neutron-tempest-plugin-api-runCédric Ollivier1-1/+1
New tests have been published in the upstream project [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-run/4/console Change-Id: I46603ed78f865f89fe2a7ebcf6a72da38a02bb14 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Fix CNTT tempest_slow regexCédric Ollivier1-7/+8
It also deactivates ipv6 tests as for tempest_scenario. Change-Id: Ie383e9c5b96fa4b7c989979a8c0bc8d9875d95ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add tempest_scenario and tempest_slow in smoke-cnttCédric Ollivier1-0/+48
The testcases related to ipv6 are currenty not executed because they cannot be covered by our SUTs. Close cntt-n/CNTT#696 Change-Id: Ic0ca3818011bede965702e778f37752059c86173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Complete tempest_full for CNTT ComplianceCédric Ollivier2-1/+25
It forbids skipping any test and counts the testcases executed. It mosly avoids running tests accoring to the upstream skip tests (known bugs), related to nova-network, glance v1, keystone v2 and all features defined as optional by CNTT. It fixes an issue highlighted by yallint. Change-Id: Ib4678cb9e9fc37b16fcf21d8418931eae0f667d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-26Add tempest_full in ComplianceCédric Ollivier3-0/+108
Change-Id: Ib2898d48d21704a06cf1f4574df81f4f0dae3f52 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-15Add rally_sanityCédric Ollivier1-1/+23
Gnocchi and Barbican are not currently selected by CNTT. Then they are removed from the optional list. Change-Id: I46d16b2cabd832b2655606b0708a6f43721cb3c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-15Add tempest_keystone in CNTT API ComplianceCédric Ollivier1-0/+18
It excludes test_federated_authentication as federation is currently optional [1]. Close cntt-n/CNTT#624 [1] https://github.com/collivier/CNTT/commit/2e4ae5d0f4ebf4ef4bbc2504ed6cd46388361c09 Change-Id: Ie322e7912c429543c5da92f8afb33de3e8e75c8a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-10Add tempest_cinder in complianceCédric Ollivier1-219/+7
It conforms with Cinder Microversions and Feature [1]. It cleans the testcases which require CNTT updates (Keystone, Glance, Nova, etc.) [1] https://github.com/cntt-n/CNTT/pull/577 Change-Id: I8e719e9f48d70a860c0f879117144bb3ce6f4875 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-11-10Update neutron-tempest-plugin-api regex (CNTT)Cédric Ollivier1-9/+2
It conforms with the last updates in API [1] adding Neutron QoS and Trunk as mandatory. QosMinimumBandwidthRuleTestJSON is skipped as it's not covered by OpenStack (and Functest) gates. [1] https://github.com/cntt-n/CNTT/pull/463 Change-Id: I54ff5e1fdb9b1e7265c63e3f66dfcf2f10db07d5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-10-26Publish functest-cntt-smokeCédric Ollivier2-0/+285
It tunes neutron-tempest-plugin-api to avoid skipping any test (conformance as expected by CNTT). Until CNTT clearly defines the optional and mandatory neutron extensions, it selects the OpenStack and Functest gate values as default. The next Neutron extensions are considered as optional (still verified by functest-smoke): - logging - network-segment-range - port-resource-request - qos - trunk - l3-conntrack-helper - metering - floating-ip-port-forwarding - uplink-status-propagation - dns-domain-ports - dns-integration - router-interface-fip The next tests (tempest_full, tempest_slow, tempest_scenario, etc.) will be updated in next changes. Change-Id: I003d1e509cd6dc7bd58261f27676fb53cb79e68c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>