AgeCommit message (Collapse)AuthorFilesLines
3 daysMerge "Update test case list in neutron-tempest-plugin-api"HEADmasterCedric Ollivier1-2/+24
3 daysBlacklick test_add_subport if OVNCédric Ollivier1-0/+1 Change-Id: Ieebe10ee2a9040887d84aca3e8fb5ee66294634b Signed-off-by: Cédric Ollivier <>
3 daysUpdate test case list in neutron-tempest-plugin-apiCédric Ollivier1-2/+24
It takes into account latest changes in CNTT [1] [1] Close cntt-n/CNTT#1106 Change-Id: I3212d1b765f7fd657ed603ed520d79fccae80bfa Signed-off-by: Cédric Ollivier <>
4 daysSelect OpenStack requirements masterCédric Ollivier4-8/+8 Change-Id: I9ed510c45f63714b64dcb9fa90e4d7239f93ee3f Signed-off-by: Cédric Ollivier <>
4 daysFix incorrect test numbersCédric Ollivier1-1/+1
[1] Change-Id: I9cb04c3abdbb899d2f1d4188a9fb9743a8f4c6d0 Signed-off-by: Cédric Ollivier <>
4 daysBypass upstream requirement issuesCédric Ollivier4-11/+14 Change-Id: Iebbf0a720fe9d1c62083028d0bc0078bf7680753 Signed-off-by: Cédric Ollivier <>
5 daysRemove refstack version tagCédric Ollivier1-1/+0
It has been unread since the files are cached. Change-Id: Iba74163ac486dddaee4e81a340fcbe2b9297071f Signed-off-by: Cédric Ollivier <>
5 daysExclude vxlan testing in CNTTCédric Ollivier1-1/+5
Close cntt-n/CNTT#1077 Change-Id: If9c0f52138e9f669f17933c42906936e2e196b2a Signed-off-by: Cédric Ollivier <>
6 daysRun test_agent_management vs OVNCédric Ollivier1-2/+0
They must not longer be blacklisted as opposed to test_dhcp_agent_scheduler [1]. Change-Id: Ib08bb87580a10e2124faa1b3853f3e27dcb3a0a0 Signed-off-by: Cédric Ollivier <>
6 daysSet dhcp_agent_scheduler as optionalCédric Ollivier1-3/+5
dhcp_agent_scheduler [1] indirectly forces the Neutron backends as highlighted by OVN testing. [1] Close cntt-n/CNTT#1073 Change-Id: Iafa3ad7f15dc157c0362ffa59eed31b89bf368e7 Signed-off-by: Cédric Ollivier <>
6 daysOrder regex in neutron-tempest-plugin-api (CNTT)Cédric Ollivier1-4/+5
It mostly adds admin as prefix. Change-Id: Ic2e723b858ff1f3e26478f6037a19db1fd52e4aa Signed-off-by: Cédric Ollivier <>
6 daysDecrease test_count to 1290 in tempest_fullCédric Ollivier1-1/+1 Change-Id: Ifa1ae117db7dff6471ab557d6f7f3bf03940de76 Signed-off-by: Cédric Ollivier <>
6 daysIncrease test_count to 547 in neutron-tempest-plugin-apiCédric Ollivier1-1/+1
It takes into account the new tests added in Neutron Tempest Plugin. Change-Id: I7994638c69ef6bd39bae3c6ded8409baabc27e9d Signed-off-by: Cédric Ollivier <>
2020-02-04Add Functest CNTT-specific containers in release notesCédric Ollivier1-0/+2
Change-Id: I979a5e26caee893d772de484e7a61f2e82762ace Signed-off-by: Cédric Ollivier <>
2020-01-24Update Alpine to 3.11Cédric Ollivier19-48/+51
It also updates Python to 3.8 (default version). It selects arm32v6 et arm64v8 repos and switches multiarch binfmt. Change-Id: Ib41cf0ab805ce2137658f3ff656b0a88c7b4ebf5 Signed-off-by: Cédric Ollivier <>
2020-01-24Generate /etc/glance/policy.jsonCédric Ollivier1-2/+3
It takes into account the following change in glance [1] [1] Change-Id: I61e37cd2383620fa6db665f1858830b9c5d13938 Signed-off-by: Cédric Ollivier <>
2020-01-14Slightly change Functest2020Cédric Ollivier1-2/+6
Change-Id: I7f82f5905536da593193d586a1b0655fcd44d6ad Signed-off-by: Cédric Ollivier <>
2020-01-14Update ODL git commit id (python3 migration)Cédric Ollivier1-1/+1 Co-Authored-By: Alexandru Avadanii <> Change-Id: I40c9df7c7d80fc8d9709f0b75dda333d9ed9da12 Signed-off-by: Cédric Ollivier <>
2020-01-13Publish Functest 2020Cédric Ollivier2-0/+109 Change-Id: I4116b08bd2210231d78e2761a1089fbfc0d56a46 Signed-off-by: Cédric Ollivier <>
2020-01-09Revert "Ease overriding tempest_conf.yaml"Cédric Ollivier1-1/+0
It raises side effects if the file is missing (trying to mount a directory onto a file) which is the default case. This reverts commit fe4c595edbaa31a43b94c5065fb14cab932ddffd. Change-Id: Ic24bbbbadfe0cd8901ed66357e95f466cee8da80 Signed-off-by: Cédric Ollivier <>
2020-01-09Remove test_server_connectivity_cold_migration_revert from ComplianceCédric Ollivier1-1/+2
It's skipped due to an upstream bug [1] highlighted by Jerma runs [2]. [1] [2] Change-Id: Ib4cbf0e6e8e010febd39dec8dd8ecd773ad28c3e Signed-off-by: Cédric Ollivier <>
2020-01-02Ease overriding tempest_conf.yamlCédric Ollivier1-0/+1
It works asis in Functest gates but its values mays be modified by users at their convenience. Change-Id: Id83c01693818802d11eb3822b59a508ac09990c3 Signed-off-by: Cédric Ollivier <>
2019-12-30Remove test_server_connectivity_cold_migration_revert from exclusion listCédric Ollivier1-2/+1
It has to be part of the Compliance testing Co-Authored-By: Deepanshu Bhatia <> Change-Id: I16d35e3c3a14b6b18901b6b27e50fc709ce0559f Signed-off-by: Cédric Ollivier <>
2019-12-27Set port_security: true in tempest_conf.yamlCédric Ollivier3-2/+9
It allows running test_boot_into_disabled_port_security_network_without_secgroup. It also sets a few default values. Change-Id: I851c5d13705e0419a7e664e05d32eec0efb417c6 Signed-off-by: Cédric Ollivier <>
2019-12-27Fully remove Quotas.nova_update_and_deleteCédric Ollivier1-11/+0
It was blacklisted for a while and it's still failing [1][2]. It has to be removed from scenarios (blacklisting is useless and could mislead endusers). [1] [2] Change-Id: I9ccea90a70024b6e54d873024cf550db5beea990 Signed-off-by: Cédric Ollivier <>
2019-12-27Set create_shared_resources to trueCédric Ollivier3-1/+3
It takes last Neutron Tempest plugin change into account [1]. It also increases test count. [1] Change-Id: I5e7218dd808069a0be6d481447576099aa9c63e9 Signed-off-by: Cédric Ollivier <>
2019-12-26Pin rally-openstack in masterCédric Ollivier1-1/+1
The last patch seems buggy [1] TypeError: _discover_or_create_flavor() missing 1 required positional argument: 'flv_disk' [2] [1] [2] Change-Id: Id0402afdf79d7a1081e817ea513d90c93b077ce4 Signed-off-by: Cédric Ollivier <>
2019-12-24Remove former Rally blacklistCédric Ollivier1-8/+0
Change-Id: Ibc9aa210846ad2163f7ef943d224374dfff6f1ec Signed-off-by: Cédric Ollivier <>
2019-12-22Update Xtesting to 0.86Cédric Ollivier1-1/+1
It eases dumping all logs for third-parties. Change-Id: I6055e85902eb41cce01f1502cd31d7ec489708d8 Signed-off-by: Cédric Ollivier <>
2019-12-07Merge "Run tests sequentially in tempest_slow"Cedric Ollivier3-3/+3
2019-12-07Merge "Introduce CNTT Compliance by Functest"Cedric Ollivier2-0/+149
2019-12-07Merge "Disable false ansiblelint warnings"Cedric Ollivier2-2/+2
2019-12-07Run tests sequentially in tempest_slowCédric Ollivier3-3/+3
concurrency is set to 2 in the upstream job [1] but it conflicts with serial also passed. As it fails once without any other test in parallel, the number of executors should be decreased [2]. [0] [1] Change-Id: I51bc9a584cf4b32a88b7a84d9387e7b8e90281c2 Signed-off-by: Cédric Ollivier <>
2019-12-07Introduce CNTT Compliance by FunctestCédric Ollivier2-0/+149
Change-Id: I77dd7d3e0d21573e76ec8d43a0b6ca5b64be2ad2 Signed-off-by: Cédric Ollivier <>
2019-12-07Disable false ansiblelint warningsCédric Ollivier2-2/+2
git commit has to be executed via shell module [1]. It also update ansible to conform with the latest changes in XtestingCI. [1] Change-Id: I3cc7a675eddabb0cbd9834a9e64fe7389a11865f Signed-off-by: Cédric Ollivier <>
2019-12-07Increase tests_count (538) in CNTT neutron-tempest-plugin-api-runCédric Ollivier1-1/+1
New tests have been published in the upstream project [1]. [1] Change-Id: I46603ed78f865f89fe2a7ebcf6a72da38a02bb14 Signed-off-by: Cédric Ollivier <>
2019-12-03Disable tempest serial_console testingCédric Ollivier1-1/+1
DevStack seems incorrect when configuring serial console in case of multinode deployment (missing proxyclient_address in master, missing socket in Rocky, etc). Then the testing is disabled. Change-Id: I9d1d43017b0935b23ea2a939748b5f709212c70d Signed-off-by: Cédric Ollivier <>
2019-12-02Verify Shaker results via json reportCédric Ollivier1-0/+8
As shaker always returns 0, it verifies the records and returns false after the first failure. Change-Id: I9393be0c65d315c1ca055de9f7f994f9db22eadb Signed-off-by: Cédric Ollivier <>
2019-12-02Return result = 0 if failure in juju_epcCédric Ollivier1-0/+1
Else it's falsy successfull [1] [1] Change-Id: Ic9f7c37db998904833c90ae3ee912e9908617abd Signed-off-by: Cédric Ollivier <>
2019-11-30Update Xtesting to 0.85.0Cédric Ollivier1-1/+1
It fixes falsy hrefs returned by OPNFV Test API. Change-Id: Ib6e7e7e35cf6ad581fb67692dcba561769686007 Signed-off-by: Cédric Ollivier <>
2019-11-29Switch xrally_kubernetes back to masterJuha Kosonen1-1/+1
The pull request [1] is now merged. [1] Change-Id: Ida258c279314cdbbacf255c50b3a4d1224ea803b Signed-off-by: Juha Kosonen <>
2019-11-27Propose CNTT Compliance playbookCédric Ollivier3-7/+73
It eases building CI/CD toolchains everywhere veryfing the compliance between CNTT Chapter 5 API and local platforms. Change-Id: Ia5375031d5e8cafca808d52c71dde70f80e841e9 Signed-off-by: Cédric Ollivier <>
2019-11-27Update package list before installing in CircleCICédric Ollivier1-1/+1
It currently fails: Change-Id: I8d3e2f468c6c44fa2b680f0370100d2bcf786601 Signed-off-by: Cédric Ollivier <>
2019-11-26Fix CNTT tempest_slow regexCédric Ollivier1-7/+8
It also deactivates ipv6 tests as for tempest_scenario. Change-Id: Ie383e9c5b96fa4b7c989979a8c0bc8d9875d95ef Signed-off-by: Cédric Ollivier <>
2019-11-26Add tempest_scenario and tempest_slow in smoke-cnttCédric Ollivier1-0/+48
The testcases related to ipv6 are currenty not executed because they cannot be covered by our SUTs. Close cntt-n/CNTT#696 Change-Id: Ic0ca3818011bede965702e778f37752059c86173 Signed-off-by: Cédric Ollivier <>
2019-11-26Add functest-benchmarking-cnttCédric Ollivier4-2/+102
It configures Rally to verify the mandatory services asked by CNTT. It also prepares the next benchmarking (API and dataplane) KPIs. Change-Id: Ie8701ddfa1a497f8b1a6f839e6ff7a77849b618c Signed-off-by: Cédric Ollivier <>
2019-11-26Complete tempest_full for CNTT ComplianceCédric Ollivier3-2/+28
It forbids skipping any test and counts the testcases executed. It mosly avoids running tests accoring to the upstream skip tests (known bugs), related to nova-network, glance v1, keystone v2 and all features defined as optional by CNTT. It fixes an issue highlighted by yallint. Change-Id: Ib4678cb9e9fc37b16fcf21d8418931eae0f667d0 Signed-off-by: Cédric Ollivier <>
2019-11-26Add tempest_full in ComplianceCédric Ollivier3-0/+108
Change-Id: Ib2898d48d21704a06cf1f4574df81f4f0dae3f52 Signed-off-by: Cédric Ollivier <>
2019-11-26Update scheduler_available_filtersCédric Ollivier2-7/+1
Else few tests are skipped if DifferentHostFilter is not available. Change-Id: Idfc524216dc8503e590d4fed569a43e99ea22123 Signed-off-by: Cédric Ollivier <>
2019-11-25Merge "Add rally_sanity"Cedric Ollivier1-1/+23