aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2021-05-16Add defaultbranch=stable/wallaby in .gitreviewCédric Ollivier1-1/+1
Change-Id: I2b39fcda468fe280eb5b4a6f489af968f5494669 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-20Refactor test_run_verifier_tests_defaultCédric Ollivier1-13/+10
https://app.circleci.com/pipelines/github/collivier/functest/801/workflows/4e3262ab-3adf-4539-839c-eddd49bcc2c1/jobs/809 Change-Id: Id2f95a4d8db253449723bf48d190eac7928f038e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-04-19Pin setuptools_scm===6.0.1Cédric Ollivier1-0/+1
https://build.opnfv.org/ci/job/functest-kubernetes-opnfv-functest-kubernetes-core-hunter-build/4/console Change-Id: I1c8bf76c7e69a65e4193a158c80b17a48a8a3ec2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 21f5124676edb73f76cc819554f074d40d791eda) (cherry picked from commit ff8546b16057e6a053ea54de0eac1a2229a7ec75)
2021-02-17Move Functest on Raspberry PI to mdCédric Ollivier1-0/+32
https://wiki.opnfv.org/display/functest/Run+Functest+containers+on+Raspberry+PI Change-Id: I7239d89237e7a06ff702ee140f8851e136eb6d87 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-17TyposCédric Ollivier1-4/+4
Change-Id: Ib6972a88644913621dc376367821148286123e9b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-17Update INFO.ymlCédric Ollivier2-38/+1
Functest has been promoted as Mature. Badly lots of contributors dropped. Change-Id: I1cc6542a83df0fabbf67eef9aad535fb27d3bd84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-17Fix typoCédric Ollivier1-1/+1
Change-Id: I1c232d201915e7fe199b5c9cb19cdca878d3e28d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-17Publish former wiki page as README.mdCédric Ollivier1-0/+212
https://wiki.opnfv.org/pages/viewpage.action?pageId=13211751 Change-Id: I3c564bdca64b50b04f353137814ed089ad1b193b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-13Upgrade system firstCédric Ollivier1-1/+2
Change-Id: I2d1b7816505370aa326e48c5aba3177a3fa844d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-11tempest_horizon has been merged into openstack/tempestCédric Ollivier3-12/+3
https://github.com/openstack/tempest-horizon/commit/6883d8ff5a1cc2c20b4fea7b58ba8fcda12ec035 Change-Id: Ib978fdb5f208e0767091eda32bd2103cc88cf47c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-10Force ansible-lint===4.2.0Cédric Ollivier1-0/+1
Change-Id: Ic5a08a76d7008d861adf0a83f117e549fb4c12ee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-02-10Follow new pip name resolverCédric Ollivier4-10/+10
Change-Id: Ib185c90b4403a25db55ab0948c2d6bb2b2bc8dfd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2021-01-21Update to alpine:3.13Cédric Ollivier2-6/+6
Change-Id: I4acdb1f619883bd1e25bb5aef6a9d1722e7bfde5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Update tempest_neutron test_count to 529Cédric Ollivier2-2/+2
artifacts.opnfv.org/functest/RT4JR0LWTYQhttp://artifacts.opnfv.org/functest/RT4JR0LWTYQE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.htmlE/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-152/tempest_neutron_cntt/tempest-report.html Change-Id: Ifcb8e5ffb8a8c9244b6736affa48f0615368640c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Use pip==20.2.4 in tox venvCédric Ollivier3-3/+4
pip 20.3 is disruptive and would lead to big changes in stable branches. Change-Id: I33079e7d667e42240fcc497d595509e88da3c4f7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-10Set NEW_USER ROLE in tempest_heat classic userCédric Ollivier1-0/+3
Else it fails when member is not the default role. Change-Id: I1c830705b94a116ef56d83ebcd59145cd40e59a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Remove all network data in Rally full tasksCédric Ollivier1-24/+0
Change-Id: I97fcd7831cfcf6aa5abef007fca214e4042702e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Update Rally sanity tasks and blacklists for L2 onlyCédric Ollivier2-9/+2
This issues were hidden by Airship limitation (live-migration fails) Change-Id: I19006af2a70377cc87cf88d7c50747deec55993b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Rally_jobs asks for Router in several tasksCédric Ollivier2-0/+4
NeutronNetworks.create_and_list_ports can be executed when no L3 if the appropriate params are passed (see rally_sanity and rally_full). As rally_jobs is an official task which shouldn't be changed, it simply skips rally_jobs rather than NeutronNetworks.create_and_list_ports [1] [1] http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_list_ports Change-Id: I9bccb7417bbd514bd213a6b103f62165de497c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Don't filter vs NO_TENANT_NETWORK in CNTT testcasesCédric Ollivier1-4/+0
This param is incorrect from a CNTT point of view. It only filters test cases in classical IaaS verification containers. Change-Id: I8551cb1af28ecb2bea5c29d7c0b692fee41bd119 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-09Skip test_minbw_allocation_placement added to tempest_scenario_cnttCédric Ollivier2-0/+2
http://artifacts.opnfv.org/functest/NA19LNZY1R9P/functest-opnfv-functest-smoke-cntt-latest-tempest_scenario_cntt-run-183/tempest_scenario_cntt/tempest-report.html Change-Id: Ibe70e8f5f1510d60cc53c89d9f1e30655d496fdf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Rather use rconfig.has_option() insteadCédric Ollivier1-1/+1
It slightly increases py2 and py3 to ease next backports. Change-Id: I168044d85469e92f970e983f4bdfe627d3763e61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip create_and_update_routers if NO_TENANT_NETWORKCédric Ollivier1-0/+1
http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-184/rally_jobs/rally_jobs.html#/NeutronNetworks.create_and_update_routers Change-Id: Iac2330aff915ce5de55fc03d2c8466fbf6d40f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Skip Restack compute and platform if NO_TENANT_NETWORKCédric Ollivier2-0/+8
Change-Id: Icdfd3ed23b6a5a47d95ae50aea88a46cd77be2ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-08Concat both dynamic and static roles in tempest.confCédric Ollivier1-13/+28
It also moves all auth logic in a specific method. Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Remove test_reset_network from Patrole test casesCédric Ollivier2-0/+6
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Update NovaServers.boot_server_associate_and_dissociate_floating_ipCédric Ollivier2-6/+3
It conforms with "Fix nova scenarios for assiciating fips" [1] http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html [1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460 Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Stop setting floating_ips in tempest_conf.yamlCédric Ollivier4-3/+1
It's now handled by tempest.py Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Remove list_routers call if no tenant networkCédric Ollivier1-0/+1
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Update Shaker image as proposed in download.shCédric Ollivier1-1/+1
Change-Id: I408a462274245e927b382e008ba146603d82b2e2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier2-0/+2
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-30Publish CNTT/OPNFV CI assetsCédric Ollivier3-0/+90
It will be introduced to ORAN. It's also available in [1] [1] http://testresults.opnfv.org/functest/oran Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-29Skip the tests now marked as buggyCédric Ollivier1-0/+1
tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding Skipped until bug: https://launchpad.net/bugs/1905432 is resolved. http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-29Clean obsolete OPNFV contraints.Cédric Ollivier1-10/+0
Most of the projects are closed or at best no longer integrated in Functest features. Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-28Stop duplicating connect_methodCédric Ollivier3-3/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Replace git.openstack.org by opendev.orgCédric Ollivier1-7/+7
https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Re-enable xrally_kubernetes masterCédric Ollivier1-1/+1
It mostly reverts the following changes as xrally_kubernetes supports 12.0.0 - xrally_kubernetes fails vs kubernetes 12.0 - patch xrally_kubernetes for kubernetes 12" https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090 Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier3-6/+6
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier3-2/+17
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-24Remove rtd-requirements.txtCédric Ollivier1-2/+0
It's now useless (snaps was removed). Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Slightly update tempest_confCédric Ollivier3-3/+14
It completes "Update CNTT regex according to latest tempest changes" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464 Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Remove snaps from rtd requirementsCédric Ollivier1-1/+0
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier2-4/+34
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Disable refstack platform and computeCédric Ollivier2-0/+4
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1] "Metadata is read-only on non-Xen-based deployments." [1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>