aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2018-12-01Remove Snaps NovaUtilsInstanceVolumeTestsCédric Ollivier1-5/+1
It doesn't clean its resources and then breaks the gate after multiple runs. It's the only way as Snaps is inactive and pinned in Functest. Change-Id: I5bb8707edaf998b91b8d5642b48465d4247cf8e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2e278acd3797f71d04500b3e9892a1769044b682)
2018-11-25Fix an invalid class name (vGPU)Cédric Ollivier1-2/+2
Change-Id: Ifff9eff1984846937920124ad0a7790e20593b25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d263576bd9961b4177080ff75844d0ed47dc886a)
2018-11-17Rename Rally blacklist.txt to blacklist.yamlCédric Ollivier2-1/+2
It eases editing it or verifyfing it via yamllint. Change-Id: I380830eff5f404745e284067b5a10f58dc60b80e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f600874cef933a2077a51bb334365a861e6fbb48)
2018-11-11Check if at least 2 hypervisors (Shaker)Cédric Ollivier1-0/+6
Shaker is now skipped if only one hypervisor. Change-Id: Ib3f803ab61e66e0daba0622ead0c1bf0905d0cce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 07a5762fd3e929a50c49785f2e583dba20a0ba4a)
2018-11-10Check if at least 1 hypervisorsCédric Ollivier2-1/+7
Vmtp is skipped if only one hypervisor. As Vtmp returns 0 when all is skipped, it protects vs issues when generating charts. Change-Id: I5ea7c31c0688ae773425d2192a4f30a22360185f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 396b3d8a7a9036ae3a8a8443b489654d3a2dd3cb)
2018-11-07Merge "Disable agent testing in tempest-based testcases" into stable/gambiaCedric Ollivier3-3/+13
2018-11-07Remove snaps ansible test casesCédric Ollivier1-7/+0
They can't work vs all OPFV scenarios (MTU doesn't conform with Geneve) and are deprecated. Updating snaps commit id [1] breaks all gates closed to Gambia release. [1] https://gerrit.opnfv.org/gerrit/#/c/64515/ Change-Id: Ie4a7a694703642a74b731a4142a5c8c029f7e661 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 24a7b14c20ad96f10db0d8bfa6187c1b7c9737b9)
2018-11-06Disable agent testing in tempest-based testcasesCédric Ollivier3-3/+13
It blacklists agent testing and two tests asking for VXLAN as overlay if OVN (OVN supports GENEVE) [1] blacklist.txt is renamed blacklist.yaml and is verified by yamllint. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/33/console Change-Id: I73c1b8cbbd74973a7f15476feea6ee4532786660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3b07c3e741e0e64603d01afc651176aa2fc52391)
2018-11-06Increase Vmtp timeoutsCédric Ollivier1-0/+1
It now conforms with other testcases booting ubuntu images. Change-Id: If9b610646ee5dcb2eb002d74dff8e1a797a4f232 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 023a4c7d0cb85d3b624ee946097e721880169371)
2018-10-27Move tempest logics in tempest_conf.yamlopnfv-7.0.0Cédric Ollivier2-29/+14
It allows removing OPNFV logics out of Functest (releng) and then simplifies conf_utils. tempest.conf is filled by the current default values. functest-alpine.sh will be updated to allow modifying the default values without breaking the OPNFV installers. It deprecates the only tempest-related env var (STORAGE_PROTOCOL) Change-Id: I14bcb715826ef2d85af87e7af600261a3c08e72c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3872290bb673513459588bbe83e65efc631615f7)
2018-10-26Temporarily disable Cinder volumes backup testsCédric Ollivier1-0/+3
From the time being, all OPNFV installers [1][2][3] don't support Cinder volumes backup. We will find a better way to handle the lack of OPNFV requiremements (these tests pass succesfully in Orange Openlab). At least, it will allow verifying tempest_full in OPNFV gates. [1] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [2] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [3] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I319536070aa77a5dbab6a692a1d76049f75e758b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7cf46992c7f3e854b038f6f17a279d65108aa764)
2018-10-26Temporarily disable VNC testsCédric Ollivier1-0/+3
At least Compass and Fuel configure Spice as console [1][2]. It disables vnc testing as it could fail for endusers as well. [1] https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I2a1ecf345cb81170c1b1a3e49f8f3a58602fc3f0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit df9d5c5d3b80b613130de59a1810f7fce9cbbc0d)
2018-10-23Disable Glance API v1Cédric Ollivier1-0/+4
It has been deprecated since Newton [1]. Even if the related tests are skipped in latest tempest [2], API v1 has to be disabled in Gambia's tempest.conf [3]. [1] https://docs.openstack.org/glance/latest/user/glanceapi.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-22_02-34-24/tempest_full/tempest-report.html [3] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I3b6bb632412c0fecaa659da262760af64d79fa71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dddd8073c97ca09937504cb10c1a7be2a0986380)
2018-10-23Overprotect vmtp vs unversioned OS_AUTH_URLCédric Ollivier1-0/+4
It simply adds v3 to OS_AUTH_URL if required. Vtmp should be updated to manage unversioned url [1]. https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/371/console Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I4806e811c0714b061b77f940934830cfb1835d74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5ac878fe7cccbfe5cb829488d0aedc307dd42885)
2018-10-22Change dir when calling stestrCédric Ollivier1-2/+5
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/467/console Change-Id: Icaa773cf61397650e73a01b182a759dd64b11b95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d1eed120e18ec456841a8df2f29e1711da0aa833)
2018-10-21Harden Rally generate reportCédric Ollivier1-3/+2
It converts html_file to str and raises all possible exceptions. It sometimes fails when locally generating reports. Change-Id: Idf6a12aaac4561800cd5e364f8bcc495aabbee1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4d3627e56d333e313b67bbf1e7880b11883b5652)
2018-10-21List neutron exts and service providers in connection_checkCédric Ollivier1-1/+7
It eases debugging as well [1]. [1] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-20_12-23-41/patrole/tempest-report.html Change-Id: Ie9ddc280fc239c5e0887347d434839940e7a3240 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 87f5db13d594075903face649f877478edb3b285)
2018-10-16Do not create files in site-package directoryJuha Kosonen2-9/+22
Use /home/opnfv/functest/data/rally/task directory for storing temporary files when running rally tasks. Also removes unused vm scenario from task service list. Change-Id: Icfd4f99ebe6194360bda8bd88e497e018a9541a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 520331a06750dd02228f840c346402f52fb864e8)
2018-10-14Fix image properties parsingCédric Ollivier2-20/+7
It removes useless spaces and now conforms with oslo.conf dict. New helpers and unit tests are available. Change-Id: I20335c5e5c3840cc872e158c6072d97a3f2cb98c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 904377462f58464937d4cafeb8c432f024a85bd4)
2018-10-09Add Rally scenarios for testing floating IPJuha Kosonen2-0/+51
rally_sanity: NovaServers.boot_server_associate_and_dissociate_floating_ip rally_full: NovaServers.boot_server_associate_and_dissociate_floating_ip NovaServers.boot_and_associate_floating_ip Change-Id: I31b7693828920bae92ff4ac8e7b0fde86e958cb5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 6efcc4fe7456663445e9fbda54bba3239288ad73)
2018-10-08Use environment variable for image propertiesDelia Popescu1-0/+5
Use IMAGE_PROPERTIES environment variable to read extra image properties. Set image_extra_properties for scsi volume types without file patch, but using IMAGE_PROPERTIES env variable IMAGE_PROPERTIES is defined through releng. Image extra_properties will continue to get updates from functest config file With this change, remove unnecessary parameters from arm patch Related to:https://gerrit.opnfv.org/gerrit/#/c/63203/ JIRA:ARMBAND-402 Change-Id: I64139240751b1e109bbe24ba32f487ccd98b9a92 Signed-off-by: Delia Popescu <delia.popescu@enea.com> (cherry picked from commit d7c5419ed8d3dcdb59f4f5f254de0c7bb7a0aec6)
2018-09-23Protect vs former OS env varsCédric Ollivier2-0/+10
rally_jobs is failing vs APEX which still sets OS_TENANT [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I672bfa93b37b1b773ea7d20fdd91bea0ff14b79f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 83e0e6836d7f5e18eb4eb8c9d28b4e6980b790c2)
2018-09-23Fix typos in tempest.confCédric Ollivier1-4/+5
It completes the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/62793/2 Change-Id: Ie4c4c5cb374f2bfac6397841f8ddc2cd3b2f524b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 98a4a863935be38f63e78550ddbcf4c1299bfdf1)
2018-09-23Set default_domain_id in tempest.confCédric Ollivier2-3/+6
It allows verifying via non-default domain. Change-Id: I95ae26fd3bfd1c10421c02d2b4f6e8a9b6aa49e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 11d28aaf2e726859b59b7511d64dc4dd4b422e1e)
2018-09-22Set admin_domain_scope to True (tempest)Cédric Ollivier2-15/+15
It completes the previous commit [1]. It also sets cidr and fully forces Keystone v3. [1] https://gerrit.opnfv.org/gerrit/#/c/62777/ Change-Id: Ida948a4ff051dc1d1325d29a815c201366a1e33e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f4b545efe2339bdb5f6117d484e127adda5c8021)
2018-09-22List all sheduler filters instead of allCédric Ollivier1-1/+5
It doesn't work as expected as highlighted in [1]. [1] https://review.openstack.org/#/c/570207/ Change-Id: Iaf64345c40e8d62349cd50a6861c1191d25c40b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ecc7bc215cdf47104d61ba7e23e5f8ec65ca03c4)
2018-09-22Grant new tempest user as admin in domain tooCédric Ollivier1-0/+3
It seems mandatory for test_list_projects_returns_only_authorized_projects Change-Id: Id994e66b088d751c4f6d7f260f8e482c2ee83307 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 17e87d5af713bb07759c4b2af0c2b40077343a32)
2018-09-22Stop creating network resources in tempestCédric Ollivier2-4/+5
fixed_network_name is not used in neutron or nova gates [1]. It may bypass juju bug (subnet discovery). [1] http://logs.openstack.org/46/603046/1/check/tempest-full/a8468a1/controller/logs/tempest_conf.txt Change-Id: I820e8c723918ed683ed1f8016363eb70bad0d14a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ac31a32320122ea1683fe9884e5bf1f969678b03)
2018-09-21Remove rally plugins and extra when cleaningCédric Ollivier1-2/+11
Change-Id: I15393b870d648432c900d429d17129c630ed4f58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit aff6640b5aed37221a05067e93ee164273c16910)
2018-09-20Allow overriding default storage protocolCédric Ollivier1-1/+3
It adds a new env var STORAGE_PROTOCOL to override storage_protocol in tempest. The default value is unchanged [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I19e4e25212b6f6176e3b967e01eb634c15e4d474 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a561c6ca316feb1a203327aa729ac0317f70df48)
2018-09-20Merge "Set scheduler_available_filters to all" into stable/gambiaJuha Kosonen1-0/+2
2018-09-20Set scheduler_available_filters to allCédric Ollivier1-0/+2
It indicates all filters that are included with nova are enabled [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I0d1943941d62d2eee418200c69e8198cd858383e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ff2ba1fd18b05bf1b031e78d2589028968bbe906)
2018-09-20Add support for Rally OpenStack CI test casesJuha Kosonen3-13/+129
Include Neutron rally-jobs. Change-Id: Ic1122962bd7d876d179729640a8a321bc36442d8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5d54a533d25a989dc64a2789788ff2f2fd6ad5c6)
2018-09-09Clean user/project after skipping testcasesCédric Ollivier1-0/+2
It avoids remaining resources after skipping a tempest-based testcase. Change-Id: I0a993486c6e9265d15166d5eed5a612875d29b08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-08Merge "Fix dict conversion in tempest.conf"Cedric Ollivier1-1/+1
2018-09-08Fix dict conversion in tempest.confCédric Ollivier1-1/+1
https://github.com/openstack/oslo.config/blob/master/oslo_config/types.py#L600 https://build.opnfv.org/ci/view/fuel/job/functest-fuel-virtual-daily-master/817/consoleFull Change-Id: Icde9938bb9f6c0c37d2504317f31b0af4ef9ee8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-07Do not raise exceptions in conf_utilsJuha Kosonen2-14/+13
Return a reasonable value for caller to process. Change-Id: I5a83544aaebb4e53db37ddaa13033d77848722b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-06Add role to users created by rally if requiredCédric Ollivier1-0/+27
It sets [openstack] keystone_default_role if NEW_USER_ROLE differs from member. Change-Id: Ib6be5cf22654e882ea110298cba421c1e87c78fd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-05Conform with Barbican gatesCédric Ollivier2-0/+41
tempest.conf conforms with Devstack post-actions [1]. One test is still disabled as it may force to sign all images. A deeper analysis has to be done before enabling it. [1] https://github.com/openstack/barbican-tempest-plugin/blob/master/tools/pre_test_hook.sh Change-Id: I163c0e7c4671ca67f0b6c127c29fdcb12a8e426b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-05Update scenario section in tempest.confCédric Ollivier2-1/+41
It's required at least by Barbican tempest plugin. Change-Id: I46a65ee5fee044917c5375adaa8ebb529efe86ec Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-04Protect vs OS_ENDPOINT_TYPE in shakerCédric Ollivier1-0/+1
Else a conflict can occur between OS_INTERFACE and OS_ENDPOINT_TYPE. Change-Id: I3e0237857f95e506706fb852889308ea82e41e84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Merge "Refactor RallyBase"Cedric Ollivier3-90/+37
2018-09-03Refactor RallyBaseJuha Kosonen3-90/+37
This provides a more generic way to integrate test case lists which are not hosted in Functest. Also removes vm scenarios since they have never been a part of actual rally runs. Change-Id: Ib0a020fe72800915bbf2d10ecc690a248d33c246 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-03Switch from tempest section to openstackCédric Ollivier1-10/+10
Rally warns from these deprecated conf sections. Change-Id: I15933c4f2cda14384e53202ec22f438a586d7b05 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Merge "Create new project/user for tempest tests"Cedric Ollivier2-15/+25
2018-08-29Create new project/user for tempest testsJuha Kosonen2-15/+25
JIRA: FUNCTEST-1009 Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-29Merge "Support pre-Provisioned credentials"Cedric Ollivier2-2/+14
2018-08-28Support pre-Provisioned credentialsCédric Ollivier2-2/+14
If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for /home/opnfv/functest/data/accounts.yaml which contains the set of pre-existing credentials to use for testing [1]. It also sets admin_domain_scope and default_credentials_domain_name. [1] https://docs.openstack.org/tempest/latest/configuration.html Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Merge "Remove installer type from rally blacklist"Cedric Ollivier2-7/+2
2018-08-28Merge "Remove installer type from tempest blacklist"Cedric Ollivier1-7/+3