aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-12-08Concat both dynamic and static roles in tempest.confCédric Ollivier1-13/+28
It also moves all auth logic in a specific method. Change-Id: I95ecce84ef202c8fe72719c2263d96a76070c571 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Remove test_reset_network from Patrole test casesCédric Ollivier2-0/+6
Details: Policy action "os_compute_api:os-admin-actions:reset_network" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/6I7CUHIE1P9P/functest-opnfv-functest-smoke-latest-patrole_member-run-140/patrole_member/tempest-report.html Change-Id: I0ec24bab4fa3c692a4096b093d81b11dc5d1367c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-07Update NovaServers.boot_server_associate_and_dissociate_floating_ipCédric Ollivier2-6/+3
It conforms with "Fix nova scenarios for assiciating fips" [1] http://artifacts.opnfv.org/functest/2B3GHZXZMEIC/functest-opnfv-functest-smoke-leguer-rally_sanity-run-16/rally_sanity/rally_sanity.html [1] https://github.com/openstack/rally-openstack/commit/ab03bfeafda0a29def4c792a174ec1af836b68be#diff-e40d163061529de4f93597cc2597505325ededfaa93855d59b2f3c717f6fa460 Change-Id: Iaed6d2f8527f62629fb7a761860f789fa1e8df72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-06Update test_count in tempest_full_cnttCédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/22NZHI7FCIPV/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-184/tempest_full_cntt/tempest-report.html Change-Id: I99c68dc7ba3c040b8dcc2061ea594ca66e41bcb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Remove Rally Router testing if no tenant resourcesCédric Ollivier1-0/+4
It pleases airship which doesn't support neither routers and floating ips. Change-Id: I8b9f44c0bccd66d7808e100203f4bfea000ead2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-04Stop setting floating_ips in tempest_conf.yamlCédric Ollivier4-3/+1
It's now handled by tempest.py Change-Id: Iaeefd70f95a3c64c7ca41b984e934c4aeadea8ab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Remove list_routers call if no tenant networkCédric Ollivier1-0/+1
Change-Id: I49ea5cc9207048f5dda49fcd0463ef333970ecb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-02Update Shaker image as proposed in download.shCédric Ollivier1-1/+1
Change-Id: I408a462274245e927b382e008ba146603d82b2e2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-12-01Skip a new upstream test in CNTT tempest_slowCédric Ollivier2-0/+2
tempest.scenario.test_shelve_instance.TestShelveInstance.test_cold_migrate_unshelved_instance http://artifacts.opnfv.org/functest/PFALJC46DYJ2/functest-opnfv-functest-smoke-cntt-latest-tempest_slow_cntt-run-179/tempest_slow_cntt/tempest-report.html Change-Id: I7cedc72bc1e05da61109b64375e32a675588b52d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-30Publish CNTT/OPNFV CI assetsCédric Ollivier3-0/+90
It will be introduced to ORAN. It's also available in [1] [1] http://testresults.opnfv.org/functest/oran Change-Id: I00c187a642ca0d03bffcdceed4592632f04d6a8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-29Skip the tests now marked as buggyCédric Ollivier1-0/+1
tempest.api.object_storage.test_object_services.ObjectTest.test_create_object_with_transfer_encoding Skipped until bug: https://launchpad.net/bugs/1905432 is resolved. http://artifacts.opnfv.org/functest/DOI2EPYN3STY/functest-opnfv-functest-smoke-cntt-latest-tempest_full_cntt-run-178/tempest_full_cntt/tempest-report.html Change-Id: I0dce32b30d4fa839083975919284c7c4d64850e8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-29Clean obsolete OPNFV contraints.Cédric Ollivier1-10/+0
Most of the projects are closed or at best no longer integrated in Functest features. Change-Id: I30e5da6eef0222fde263d56c041a57e3d44cecb7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-28Stop duplicating connect_methodCédric Ollivier3-3/+0
This config is now managed dynamically by tempest.py Change-Id: I99a30930fa1a7da8202b1da7d4eb05bca5412943 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Replace git.openstack.org by opendev.orgCédric Ollivier1-7/+7
https://build.opnfv.org/ci/job/functest-smoke-docker-build-amd64-master/910/console Change-Id: I855e683b4efd4b805b6e14eef787f95b9a9bca3c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Protect vs false detected external networks if l2-onlyCédric Ollivier2-8/+10
Change-Id: I0e58c9df0e9971fcdae5fa7b209940569ae51a78 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-27Re-enable xrally_kubernetes masterCédric Ollivier1-1/+1
It mostly reverts the following changes as xrally_kubernetes supports 12.0.0 - xrally_kubernetes fails vs kubernetes 12.0 - patch xrally_kubernetes for kubernetes 12" https://github.com/xrally/xrally-kubernetes/commit/2ffa85af2bff3438b6b23034b6ec6ee1de481090 Change-Id: I38a6e3fba35ec2afabd7c849a0cde74d83eece1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Skip dataplane benchmarkign if no tenant resourcesCédric Ollivier3-6/+6
It asks for routers for instance. Change-Id: I7c7468b21ecf0578895735b5bc83b90a752813d0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Remove former allow_no_fip logicCédric Ollivier2-3/+1
Change-Id: Ie6e45572e98108fca114a1d798f2d2a99ad41299 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running cloudify without tenant network resources.Cédric Ollivier3-2/+17
It fits the Airship deployment where there is neither tenant networks nor floating ips. It skips all VNF test cases as they ask for tenant resources. Change-Id: Ib5f2074314ff940595ce1387912055fa916a1f79 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-26Allow running tempest without tenant network resources.Cédric Ollivier1-8/+32
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: I8077400536628ed2349b548efee3c3e165a0a5c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-24Remove rtd-requirements.txtCédric Ollivier1-2/+0
It's now useless (snaps was removed). Change-Id: Ide72eb9b4db799fc74161399b469c5f4f68013fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Slightly update tempest_confCédric Ollivier3-3/+14
It completes "Update CNTT regex according to latest tempest changes" [1] [1] https://gerrit.opnfv.org/gerrit/c/functest/+/71464 Change-Id: Iaf2bcef723f423bff1753e27732edf0fc2242677 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Remove snaps from rtd requirementsCédric Ollivier1-1/+0
Change-Id: I1c2631faee91980bff4043ecb429722603e2ba13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-23Update CNTT regex according to latest tempest changesCédric Ollivier2-4/+34
It skips all the new feature testing untill they are mandatory in CNTT - [compute_feature_enabled] xenapi_apis [1] - [identity_feature_enabled] access_rules [2] - [image_feature_enabled] import_image [3] - [volume_feature_enabled] extend_attached_encrypted_volume [4] [1] https://review.opendev.org/c/openstack/tempest/+/749527 [2] https://review.opendev.org/c/openstack/tempest/+/699519 [3] https://review.opendev.org/c/openstack/tempest/+/742546 [4] https://review.opendev.org/c/openstack/tempest/+/706904 Change-Id: I161360f882138b46da56b78084a70b244cd1c53d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Update test count in tempest_heat_cnttCédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/OYN5BXIR5ANR/functest-opnfv-functest-smoke-cntt-latest-tempest_heat_cntt-run-143/tempest_heat_cntt/tempest-report.html Change-Id: I1073988106dac42ecb0e4c6496e9a2957207e274 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Disable refstack platform and computeCédric Ollivier2-0/+4
RefStack 2020.06 is obsolete regarding latest OpenStack changes [1] "Metadata is read-only on non-Xen-based deployments." [1] http://artifacts.opnfv.org/functest/CX0VIHZZXPK9/functest-opnfv-functest-smoke-latest-refstack_compute-run-737/refstack_compute/tempest-report.html Change-Id: I6c86ae097d99f1af2cb6a58f3c14fd9b22afe3ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-22Patch xrally_kubernetes for kubernetes 12Cédric Ollivier2-3/+1
Then it reverts "xrally_kubernetes fails vs kubernetes 12.0". https://github.com/collivier/xrally-kubernetes/commit/10cd8fc1611d8b954532617f75cc90a0277b717e Change-Id: I3a0beef0b0e6322d3a871a2a90a1c0570ed70a4d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-20xrally_kubernetes fails vs kubernetes 12.0Cédric Ollivier2-0/+2
It selects Kubernetes 11.0 as opposed to the new OpenStack upper-constraints.txt [1]. Once xrally_kubernetes is updated, this patch will be removed. [1] https://github.com/openstack/requirements/commit/d8d2e848ec057c47963d33dbd44479fc28e6f38b Change-Id: I486284a2e67a732048755551a54234852ae3e45f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-19Force nics in NovaServers.boot_server_and_list_interfacesCédric Ollivier1-1/+2
It stops leveraging auto_assign_nic which fails in case of Airship. Change-Id: I707bbde08c00f9d70efd6207b627fd3fb228873f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-18Use EXTERNAL_NETWORK as a fallback if no tenant networkCédric Ollivier2-1/+9
It pleases the networking configuration proposed by Airship. Change-Id: I24bc4613557c61db93d543cde730cd872e0176e0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-14Allow connecting vm to the external networkCédric Ollivier6-9/+27
It fits the Airship deployment where there is neither tenant networks nor floating ips. It only updates the scenarios and must be completed by other changes for all the advanced testcases (Rally, Tempest, etc) Change-Id: Ia19f24d484b7b384c4aeeb3be35aac7aee31baab Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-12Add timeout as needed by Gitlab CI/CDCédric Ollivier3-0/+9
Gitlab CI/CD sets 1h as default timeout. The timeout is valid for all test cases in tiers (current XtestingCI design). Change-Id: I1ffae060ee8fd26426a9ee9a2ad2cd131ff9abe9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-09Run vnfs in parallelCédric Ollivier1-2/+0
Jenkins slaves must be limited to 2 (default setup) if needed. Change-Id: Ic05552085988efda0ff4a283ff84942e263750ca Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-09Split Gates in a dedicated site.ymlCédric Ollivier2-27/+82
Change-Id: If470f70359442fabba6c5064f65aff972597131e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-11-03Update tempest_custom in userguideCédric Ollivier1-26/+14
It was mostly only used by OVP (Functest leverages regexes). It's now up-to-date about stevedore. Functest users are free to overwrite any refstack list (e.g. /home/opnfv/functest/data/refstack/platform.txt) if they want the same behavior [1]. [1] https://git.opnfv.org/functest/tree/docker/smoke/platform.txt Co-Authored-By: Roman Kuzmin <rkuzmin@mirantis.com> Change-Id: I2b6c3ceda102319bfea810ab2a7bf2d911e20f6b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-14Publish "Orange CNTT RC1 Field Trial"Cédric Ollivier2-0/+114
It will be introduced during LFN Dev event. Change-Id: I9e0a048464a8fd99131cccf2741135aacf7e839d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-14Publish presentation "OPNFV/CNTT in Orange RFP"Cédric Ollivier2-0/+149
It was introduced during ONES NA 2020 [1][2]. [1] http://testresults.opnfv.org/functest/rfp/ [2] http://testresults.opnfv.org/functest/ONES2020NA_OPNFV-CNTT_RFP.1080p.mp4 Change-Id: I7accf164907d04c56470fbf83fe28363b84ac1bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-10Update results in docsCédric Ollivier2-2/+8
It takes into account cybort and new patrole testing. Change-Id: I96ef84c32f792d162bf05399229ba1c4ca7600a8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-05Swith to active abot_charm repoCédric Ollivier1-1/+1
We keep syncing both repos but it helps quickly integrating patches. Change-Id: Ia6f05994d209e60d1278b7a033317bf7e17e22c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-10-04Modify smoke and benchmarking in Docker FromCédric Ollivier1-3/+12
Change-Id: I0d7acd82f3a4305e862e924d1199c5d28d3ccf56 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Enable back Patrole volume testingCédric Ollivier2-6/+18
It skips test_create_network_provider_segmentation_id as it can run in parallel (200 is hardcoded) and test_create_image_from_volume_backed_server which doesn't clean its resources. Change-Id: I8918ecc0a215a491bff9f4d507dacdd4a9d0b92c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-16Add helm_vims in release notes and console outputsCédric Ollivier3-5/+8
Change-Id: Iaf8d09046471e4508660ebd34f34278683a449c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-13Update kube_bench split in docCédric Ollivier3-13/+16
Change-Id: Id4d934f0330bd3338498435a884e33df12850c64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-08Update tempest_neutron test_count to 523Cédric Ollivier2-2/+2
http://artifacts.opnfv.org/functest/DIGECU2S2NDT/functest-opnfv-functest-smoke-cntt-latest-tempest_neutron_cntt-run-137/tempest_neutron_cntt/tempest-report.html Change-Id: I27bebfef7a77198e8550a3597e3309a6f8a27740 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip patrole volume testingCédric Ollivier2-6/+6
They don't clean volume and snapshot which raises side effects after lots of iterations. They may be obsolete too [1] [1] http://artifacts.opnfv.org/functest/4VZKU3ZR64DP/functest-ovn-opnfv-functest-smoke-latest-patrole_admin-run-9/patrole_admin/tempest-report.html Change-Id: I5562931a403dfdc5e3d75a1fcce52316d359482a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-07Skip test_backup_crossproject_*_negativeCédric Ollivier3-6/+14
They are currently failing and they don't seem executed in gates [1]. [1] http://artifacts.opnfv.org/functest/Y0L6XUXULRRL/functest-ovn-opnfv-functest-smoke-cntt-latest-tempest_cinder_cntt-run-108/tempest_cinder_cntt/tempest-report.html Change-Id: I397bad9feb79ecaea8477f2e931ab0b57237be0b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Update Functest Kubernetes outputsCédric Ollivier3-12/+18
Change-Id: I314e232838204f1fb1595cf884957cdf77969615 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-06Remove build date which fails spellcheckCédric Ollivier1-2/+0
https://travis-ci.org/github/collivier/functest/jobs/724612517 Change-Id: Iee849b624870a8106de0167f30bc1e31d47f1f13 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-09-05Update Xtesting to 0.91.0Cédric Ollivier10-15/+3
Change-Id: Icd467525f4b1b1f97d14a5ec3d5d78b94fd1d4a9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2020-08-30Skip obsolete Patrole testsCédric Ollivier2-0/+6
Details: Policy action "os_compute_api:os-floating-ips" not found in policy files: [] or among registered policy in code defaults for nova service. http://artifacts.opnfv.org/functest/OTNURZ1MTVG3/functest-opnfv-functest-smoke-latest-patrole_reader-run-86/patrole_reader/tempest-report.html Change-Id: I678b3c10d19006d9ed978c8fa1d9eed933012b84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>