aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-11-23Stop cleaning roleCédric Ollivier1-6/+3
Functest may create default role if member doesn't exist. It cannot be removed at the end of the testcase as it raises side effects when testing in parallel. Change-Id: Ief552f450a34b4aeda045b0c5d5f237ed77f3643 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-17Rename Rally blacklist.txt to blacklist.yamlCédric Ollivier2-1/+2
It eases editing it or verifyfing it via yamllint. Change-Id: I380830eff5f404745e284067b5a10f58dc60b80e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-15Switch to Clearwater Zamin (heat_ims)Cédric Ollivier1-2/+2
Zamin is declared as the first "stable" release. Cloudify descriptor is not ready for the update. Change-Id: Ibfd2e3a226e1a547dd8c4e32ff998bac007f10a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3ac3d8d6f725b76ccb22a730cd802f36f75c8b90)
2018-11-11Check if at least 2 hypervisors (Shaker)Cédric Ollivier1-0/+6
Shaker is now skipped if only one hypervisor. Change-Id: Ib3f803ab61e66e0daba0622ead0c1bf0905d0cce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-10Check if at least 1 hypervisorsCédric Ollivier2-1/+7
Vmtp is skipped if only one hypervisor. As Vtmp returns 0 when all is skipped, it protects vs issues when generating charts. Change-Id: I5ea7c31c0688ae773425d2192a4f30a22360185f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-07Merge "Disable agent testing in tempest-based testcases"Cedric Ollivier3-3/+13
2018-11-07Remove snaps ansible test casesCédric Ollivier1-7/+0
They can't work vs all OPFV scenarios (MTU doesn't conform with Geneve) and are deprecated. Updating snaps commit id [1] breaks all gates closed to Gambia release. [1] https://gerrit.opnfv.org/gerrit/#/c/64515/ Change-Id: Ie4a7a694703642a74b731a4142a5c8c029f7e661 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-06Disable agent testing in tempest-based testcasesCédric Ollivier3-3/+13
It blacklists agent testing and two tests asking for VXLAN as overlay if OVN (OVN supports GENEVE) [1] blacklist.txt is renamed blacklist.yaml and is verified by yamllint. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/33/console Change-Id: I73c1b8cbbd74973a7f15476feea6ee4532786660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-06Increase Vmtp timeoutsCédric Ollivier1-0/+1
It now conforms with other testcases booting ubuntu images. Change-Id: If9b610646ee5dcb2eb002d74dff8e1a797a4f232 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-06Run vnfs in all scenariosCédric Ollivier1-8/+0
It allows fair comparisons between scenarios (e.g. ovs dpdk). os-nosdn-calipso-noha could be verified VNFs as well [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/32/console Change-Id: I0490eade81c531e38ce7156a61446a9fccaffb17 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-26Move tempest logics in tempest_conf.yamlCédric Ollivier3-31/+15
It allows removing OPNFV logics out of Functest (releng) and then simplifies conf_utils. tempest.conf is filled by the current default values. functest-alpine.sh will be updated to allow modifying the default values without breaking the OPNFV installers. It deprecates the only tempest-related env var (STORAGE_PROTOCOL) Change-Id: I14bcb715826ef2d85af87e7af600261a3c08e72c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-26Temporarily disable Cinder volumes backup testsCédric Ollivier1-0/+3
From the time being, all OPNFV installers [1][2][3] don't support Cinder volumes backup. We will find a better way to handle the lack of OPNFV requiremements (these tests pass succesfully in Orange Openlab). At least, it will allow verifying tempest_full in OPNFV gates. [1] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [2] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [3] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I319536070aa77a5dbab6a692a1d76049f75e758b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-26Temporarily disable VNC testsCédric Ollivier1-0/+3
At least Compass and Fuel configure Spice as console [1][2]. It disables vnc testing as it could fail for endusers as well. [1] https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I2a1ecf345cb81170c1b1a3e49f8f3a58602fc3f0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Disable Glance API v1Cédric Ollivier1-0/+4
It has been deprecated since Newton [1]. Even if the related tests are skipped in latest tempest [2], API v1 has to be disabled in Gambia's tempest.conf [3]. [1] https://docs.openstack.org/glance/latest/user/glanceapi.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-22_02-34-24/tempest_full/tempest-report.html [3] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I3b6bb632412c0fecaa659da262760af64d79fa71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Merge "Overprotect vmtp vs unversioned OS_AUTH_URL"Cedric Ollivier1-0/+4
2018-10-23Overprotect vmtp vs unversioned OS_AUTH_URLCédric Ollivier1-0/+4
It simply adds v3 to OS_AUTH_URL if required. Vtmp should be updated to manage unversioned url [1]. https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/371/console Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I4806e811c0714b061b77f940934830cfb1835d74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Revert "Temporarily disable test_address_scope_rbac"Cédric Ollivier1-1/+0
This reverts commit 6939526b9802539a62f71ca7759f7bd49c16aef4. Change-Id: Ieb6644b47cc1567d5312f27e66ce250193db1f62 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Harden Rally generate reportCédric Ollivier2-7/+4
It converts html_file to str and raises all possible exceptions. It sometimes fails when locally generating reports. Change-Id: Idf6a12aaac4561800cd5e364f8bcc495aabbee1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Temporarily disable test_address_scope_rbacCédric Ollivier1-0/+1
It will be safely reverted when it'is fixed in patrole [1]. [1] https://review.openstack.org/#/c/612167/ Change-Id: Ib072f833523456004b7f211ef951c4b053d82577 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21List neutron exts and service providers in connection_checkCédric Ollivier1-1/+7
It eases debugging as well [1]. [1] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-20_12-23-41/patrole/tempest-report.html Change-Id: Ie9ddc280fc239c5e0887347d434839940e7a3240 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-15Merge "Ease configuring extra specs via env vars"Cedric Ollivier5-177/+13
2018-10-15Ease configuring extra specs via env varsDelia Popescu5-177/+13
Ease configuring flavor extra specs, as well as image extra specs. Set environment variables for image_properties and flavor extra_specs for ovs|fdio scenario from the start. Image extra_properties and flavor extra_specs will continue to get updates from functest config file but so will from IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS env variables. Change-Id: Ie1c69e66d2e2e158915d214402fe44d9991c56d3 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-15Do not create files in site-package directoryJuha Kosonen3-9/+25
Use /home/opnfv/functest/data/rally/task directory for storing temporary files when running rally tasks. Also removes unused vm scenario from task service list. Change-Id: Icfd4f99ebe6194360bda8bd88e497e018a9541a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-10-14Fix image properties parsingCédric Ollivier6-46/+85
It removes useless spaces and now conforms with oslo.conf dict. New helpers and unit tests are available. Change-Id: I20335c5e5c3840cc872e158c6072d97a3f2cb98c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-06Merge "Rename IMG_PROP to IMAGE_PROPERTIES"Cedric Ollivier3-13/+16
2018-10-06Rename IMG_PROP to IMAGE_PROPERTIESCédric Ollivier3-13/+16
Any other env vars are reduced. Change-Id: Ic2c37d6efd543603a2495f9d2621b66d61710a54 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-06Merge "Use environment variable for image properties"Cedric Ollivier4-124/+14
2018-10-05Use environment variable for image propertiesDelia Popescu4-124/+14
Use IMG_PROP environment variable to read extra image properties. Set image_extra_properties for scsi volume types without file patch, but using IMG_PROP env variable IMG_PROP is defined through releng. Image extra_properties will continue to get updates from functest config file With this change, remove unnecessary parameters from arm patch Related to:https://gerrit.opnfv.org/gerrit/#/c/63203/ JIRA:ARMBAND-402 Change-Id: I64139240751b1e109bbe24ba32f487ccd98b9a92 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-02Add Rally scenarios for testing floating IPJuha Kosonen2-0/+51
rally_sanity: NovaServers.boot_server_associate_and_dissociate_floating_ip rally_full: NovaServers.boot_server_associate_and_dissociate_floating_ip NovaServers.boot_and_associate_floating_ip Change-Id: I31b7693828920bae92ff4ac8e7b0fde86e958cb5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-24Update juju agentsCédric Ollivier1-1/+1
It conforms with last juju update. Change-Id: I4941aac66e5ac96045090f10f197f6ee2712caac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-24Protect if default secgroup not createdCédric Ollivier1-3/+5
https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/lastFailedBuild/console Change-Id: I2b5f1dc577f98773ad40ed3bcfff609d8d6c4b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23Protect vs former OS env varsCédric Ollivier2-0/+10
rally_jobs is failing vs APEX which still sets OS_TENANT [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I672bfa93b37b1b773ea7d20fdd91bea0ff14b79f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23List default secgroup via orig userCédric Ollivier1-1/+1
Else the generated account can be already removed [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I93d88763cdc67cd38286c24ad830244e0c12e019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23Fix typos in tempest.confCédric Ollivier1-4/+5
It completes the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/62793/2 Change-Id: Ie4c4c5cb374f2bfac6397841f8ddc2cd3b2f524b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23Set default_domain_id in tempest.confCédric Ollivier2-3/+6
It allows verifying via non-default domain. Change-Id: I95ae26fd3bfd1c10421c02d2b4f6e8a9b6aa49e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22Set admin_domain_scope to True (tempest)Cédric Ollivier2-15/+15
It completes the previous commit [1]. It also sets cidr and fully forces Keystone v3. [1] https://gerrit.opnfv.org/gerrit/#/c/62777/ Change-Id: Ida948a4ff051dc1d1325d29a815c201366a1e33e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22List all sheduler filters instead of allCédric Ollivier1-1/+5
It doesn't work as expected as highlighted in [1]. [1] https://review.openstack.org/#/c/570207/ Change-Id: Iaf64345c40e8d62349cd50a6861c1191d25c40b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22Clean the default security groupCédric Ollivier1-0/+4
It's not removed when deleting the users and the projects. Change-Id: Ib5de0885dcbfb558a48cdd20ae3ccc47b7f23748 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22Grant new tempest user as admin in domain tooCédric Ollivier1-0/+3
It seems mandatory for test_list_projects_returns_only_authorized_projects Change-Id: Id994e66b088d751c4f6d7f260f8e482c2ee83307 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-22Stop creating network resources in tempestCédric Ollivier2-4/+5
fixed_network_name is not used in neutron or nova gates [1]. It may bypass juju bug (subnet discovery). [1] http://logs.openstack.org/46/603046/1/check/tempest-full/a8468a1/controller/logs/tempest_conf.txt Change-Id: I820e8c723918ed683ed1f8016363eb70bad0d14a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-21Remove rally plugins and extra when cleaningCédric Ollivier1-2/+11
Change-Id: I15393b870d648432c900d429d17129c630ed4f58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-20Allow overriding default storage protocolCédric Ollivier2-2/+5
It adds a new env var STORAGE_PROTOCOL to override storage_protocol in tempest. The default value is unchanged [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I19e4e25212b6f6176e3b967e01eb634c15e4d474 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-20Set scheduler_available_filters to allCédric Ollivier1-0/+2
It indicates all filters that are included with nova are enabled [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I0d1943941d62d2eee418200c69e8198cd858383e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-19Merge "Modify creation of SecGroup Rule for SSH"Cedric Ollivier1-1/+11
2018-09-19Modify creation of SecGroup Rule for SSHThierry ALLENO1-1/+11
There is multiple "default" security groups, when user is created with admin role. Change-Id: I7555dc9461816dfdaaee36d82d712e25b4b65da7 Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com>
2018-09-19Merge "Correct proxy configuration for VNF VM"valentin boucher1-0/+12
2018-09-19Correct proxy configuration for VNF VMThierry ALLENO1-0/+12
The configuration of proxy for apt is missing in ubuntu images. Line Feed is missing in cloudify conf files. Change-Id: I3237b914e993c57f4fe3ed568690d2d9a41c0bdf Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com>
2018-09-18Add support for Rally OpenStack CI test casesJuha Kosonen6-17/+147
Include Neutron rally-jobs. Change-Id: Ic1122962bd7d876d179729640a8a321bc36442d8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-15Disable test_auto_allocated_topology_rbac in patroleCédric Ollivier1-0/+1
It fails at least vs OpenStack Queens. OPNFV Gambia Installers are still falsy running latest then we do disable it. It has to be double checked as soon as Functest can be verified vs Rocky or newer. Change-Id: I7126c61d0c26b16f9058ed813af3344ca2930a86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-14Change dir when calling stestrCédric Ollivier1-2/+5
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/467/console Change-Id: Icaa773cf61397650e73a01b182a759dd64b11b95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>