summaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-12-07Remove duplicated code in vnfsopnfv-7.1.0Cédric Ollivier7-243/+130
It mainly leverages on functest_utils instead of duplicating. Change-Id: I97dc9215a835d3e7f1527b565132f667f09f2b7e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 555956f1d19800114a6f422de78816859aaa7bdc)
2018-12-01Remove Snaps NovaUtilsInstanceVolumeTestsCédric Ollivier1-5/+1
It doesn't clean its resources and then breaks the gate after multiple runs. It's the only way as Snaps is inactive and pinned in Functest. Change-Id: I5bb8707edaf998b91b8d5642b48465d4247cf8e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 2e278acd3797f71d04500b3e9892a1769044b682)
2018-11-25Fix an invalid class name (vGPU)Cédric Ollivier1-2/+2
Change-Id: Ifff9eff1984846937920124ad0a7790e20593b25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d263576bd9961b4177080ff75844d0ed47dc886a)
2018-11-25Stop cleaning roleCédric Ollivier1-6/+3
Functest may create default role if member doesn't exist. It cannot be removed at the end of the testcase as it raises side effects when testing in parallel. Change-Id: Ief552f450a34b4aeda045b0c5d5f237ed77f3643 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 79771aaf65fd6eb93e318c472d72d5fad6561bf1)
2018-11-17Rename Rally blacklist.txt to blacklist.yamlCédric Ollivier2-1/+2
It eases editing it or verifyfing it via yamllint. Change-Id: I380830eff5f404745e284067b5a10f58dc60b80e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f600874cef933a2077a51bb334365a861e6fbb48)
2018-11-15Switch to Clearwater Zamin (heat_ims)Cédric Ollivier1-2/+2
Zamin is declared as the first "stable" release. Cloudify descriptor is not ready for the update. Change-Id: Ibfd2e3a226e1a547dd8c4e32ff998bac007f10a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3ac3d8d6f725b76ccb22a730cd802f36f75c8b90)
2018-11-11Check if at least 2 hypervisors (Shaker)Cédric Ollivier1-0/+6
Shaker is now skipped if only one hypervisor. Change-Id: Ib3f803ab61e66e0daba0622ead0c1bf0905d0cce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 07a5762fd3e929a50c49785f2e583dba20a0ba4a)
2018-11-10Check if at least 1 hypervisorsCédric Ollivier2-1/+7
Vmtp is skipped if only one hypervisor. As Vtmp returns 0 when all is skipped, it protects vs issues when generating charts. Change-Id: I5ea7c31c0688ae773425d2192a4f30a22360185f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 396b3d8a7a9036ae3a8a8443b489654d3a2dd3cb)
2018-11-07Merge "Disable agent testing in tempest-based testcases" into stable/gambiaCedric Ollivier3-3/+13
2018-11-07Remove snaps ansible test casesCédric Ollivier1-7/+0
They can't work vs all OPFV scenarios (MTU doesn't conform with Geneve) and are deprecated. Updating snaps commit id [1] breaks all gates closed to Gambia release. [1] https://gerrit.opnfv.org/gerrit/#/c/64515/ Change-Id: Ie4a7a694703642a74b731a4142a5c8c029f7e661 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 24a7b14c20ad96f10db0d8bfa6187c1b7c9737b9)
2018-11-06Disable agent testing in tempest-based testcasesCédric Ollivier3-3/+13
It blacklists agent testing and two tests asking for VXLAN as overlay if OVN (OVN supports GENEVE) [1] blacklist.txt is renamed blacklist.yaml and is verified by yamllint. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/33/console Change-Id: I73c1b8cbbd74973a7f15476feea6ee4532786660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3b07c3e741e0e64603d01afc651176aa2fc52391)
2018-11-06Increase Vmtp timeoutsCédric Ollivier1-0/+1
It now conforms with other testcases booting ubuntu images. Change-Id: If9b610646ee5dcb2eb002d74dff8e1a797a4f232 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 023a4c7d0cb85d3b624ee946097e721880169371)
2018-11-06Run vnfs in all scenariosCédric Ollivier1-8/+0
It allows fair comparisons between scenarios (e.g. ovs dpdk). os-nosdn-calipso-noha could be verified VNFs as well [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/32/console Change-Id: I0490eade81c531e38ce7156a61446a9fccaffb17 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 61b708cc0987bf48d07df9d46ed25e4b42c15efc)
2018-10-27Move tempest logics in tempest_conf.yamlopnfv-7.0.0Cédric Ollivier3-31/+15
It allows removing OPNFV logics out of Functest (releng) and then simplifies conf_utils. tempest.conf is filled by the current default values. functest-alpine.sh will be updated to allow modifying the default values without breaking the OPNFV installers. It deprecates the only tempest-related env var (STORAGE_PROTOCOL) Change-Id: I14bcb715826ef2d85af87e7af600261a3c08e72c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3872290bb673513459588bbe83e65efc631615f7)
2018-10-26Temporarily disable Cinder volumes backup testsCédric Ollivier1-0/+3
From the time being, all OPNFV installers [1][2][3] don't support Cinder volumes backup. We will find a better way to handle the lack of OPNFV requiremements (these tests pass succesfully in Orange Openlab). At least, it will allow verifying tempest_full in OPNFV gates. [1] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [2] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [3] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I319536070aa77a5dbab6a692a1d76049f75e758b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7cf46992c7f3e854b038f6f17a279d65108aa764)
2018-10-26Temporarily disable VNC testsCédric Ollivier1-0/+3
At least Compass and Fuel configure Spice as console [1][2]. It disables vnc testing as it could fail for endusers as well. [1] https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I2a1ecf345cb81170c1b1a3e49f8f3a58602fc3f0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit df9d5c5d3b80b613130de59a1810f7fce9cbbc0d)
2018-10-23Disable Glance API v1Cédric Ollivier1-0/+4
It has been deprecated since Newton [1]. Even if the related tests are skipped in latest tempest [2], API v1 has to be disabled in Gambia's tempest.conf [3]. [1] https://docs.openstack.org/glance/latest/user/glanceapi.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-22_02-34-24/tempest_full/tempest-report.html [3] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I3b6bb632412c0fecaa659da262760af64d79fa71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit dddd8073c97ca09937504cb10c1a7be2a0986380)
2018-10-23Overprotect vmtp vs unversioned OS_AUTH_URLCédric Ollivier1-0/+4
It simply adds v3 to OS_AUTH_URL if required. Vtmp should be updated to manage unversioned url [1]. https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/371/console Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I4806e811c0714b061b77f940934830cfb1835d74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5ac878fe7cccbfe5cb829488d0aedc307dd42885)
2018-10-22Change dir when calling stestrCédric Ollivier1-2/+5
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/467/console Change-Id: Icaa773cf61397650e73a01b182a759dd64b11b95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d1eed120e18ec456841a8df2f29e1711da0aa833)
2018-10-21Harden Rally generate reportCédric Ollivier2-7/+4
It converts html_file to str and raises all possible exceptions. It sometimes fails when locally generating reports. Change-Id: Idf6a12aaac4561800cd5e364f8bcc495aabbee1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4d3627e56d333e313b67bbf1e7880b11883b5652)
2018-10-21List neutron exts and service providers in connection_checkCédric Ollivier1-1/+7
It eases debugging as well [1]. [1] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-20_12-23-41/patrole/tempest-report.html Change-Id: Ie9ddc280fc239c5e0887347d434839940e7a3240 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 87f5db13d594075903face649f877478edb3b285)
2018-10-16Merge "Do not create files in site-package directory" into stable/gambiaCedric Ollivier3-9/+25
2018-10-16Ease configuring extra specs via env varsDelia Popescu5-177/+13
Ease configuring flavor extra specs, as well as image extra specs. Set environment variables for image_properties and flavor extra_specs for ovs|fdio scenario from the start. Image extra_properties and flavor extra_specs will continue to get updates from functest config file but so will from IMAGE_PROPERTIES and FLAVOR_EXTRA_SPECS env variables. Change-Id: Ie1c69e66d2e2e158915d214402fe44d9991c56d3 Signed-off-by: Delia Popescu <delia.popescu@enea.com> (cherry picked from commit 1a00b9de56ef65eef2a0b269a514cb25491ac54b)
2018-10-16Do not create files in site-package directoryJuha Kosonen3-9/+25
Use /home/opnfv/functest/data/rally/task directory for storing temporary files when running rally tasks. Also removes unused vm scenario from task service list. Change-Id: Icfd4f99ebe6194360bda8bd88e497e018a9541a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 520331a06750dd02228f840c346402f52fb864e8)
2018-10-14Fix image properties parsingCédric Ollivier6-46/+85
It removes useless spaces and now conforms with oslo.conf dict. New helpers and unit tests are available. Change-Id: I20335c5e5c3840cc872e158c6072d97a3f2cb98c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 904377462f58464937d4cafeb8c432f024a85bd4)
2018-10-09Merge "Add Rally scenarios for testing floating IP" into stable/gambiaCedric Ollivier2-0/+51
2018-10-09Add Rally scenarios for testing floating IPJuha Kosonen2-0/+51
rally_sanity: NovaServers.boot_server_associate_and_dissociate_floating_ip rally_full: NovaServers.boot_server_associate_and_dissociate_floating_ip NovaServers.boot_and_associate_floating_ip Change-Id: I31b7693828920bae92ff4ac8e7b0fde86e958cb5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 6efcc4fe7456663445e9fbda54bba3239288ad73)
2018-10-09Remove fds from stable/gambiaCédric Ollivier1-16/+0
FDS doesn't participate to Gambia. Change-Id: I9fb293b2972e0deb318ac9d3d08377039ea247e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-08Use environment variable for image propertiesDelia Popescu4-124/+17
Use IMAGE_PROPERTIES environment variable to read extra image properties. Set image_extra_properties for scsi volume types without file patch, but using IMAGE_PROPERTIES env variable IMAGE_PROPERTIES is defined through releng. Image extra_properties will continue to get updates from functest config file With this change, remove unnecessary parameters from arm patch Related to:https://gerrit.opnfv.org/gerrit/#/c/63203/ JIRA:ARMBAND-402 Change-Id: I64139240751b1e109bbe24ba32f487ccd98b9a92 Signed-off-by: Delia Popescu <delia.popescu@enea.com> (cherry picked from commit d7c5419ed8d3dcdb59f4f5f254de0c7bb7a0aec6)
2018-09-25Update juju agentsCédric Ollivier1-1/+1
It conforms with last juju update. Change-Id: I4941aac66e5ac96045090f10f197f6ee2712caac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1ab7a53dab08a6f67ff2cf54f33b70dea0e82bfb)
2018-09-24Protect if default secgroup not createdCédric Ollivier1-3/+5
https://build.opnfv.org/ci/view/functest/job/functest-compass-virtual-daily-master/lastFailedBuild/console Change-Id: I2b5f1dc577f98773ad40ed3bcfff609d8d6c4b93 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5bb60b33a8fad4859b7391576fdfed7cec4c14a8)
2018-09-23Protect vs former OS env varsCédric Ollivier2-0/+10
rally_jobs is failing vs APEX which still sets OS_TENANT [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I672bfa93b37b1b773ea7d20fdd91bea0ff14b79f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 83e0e6836d7f5e18eb4eb8c9d28b4e6980b790c2)
2018-09-23List default secgroup via orig userCédric Ollivier1-1/+1
Else the generated account can be already removed [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/324/console Change-Id: I93d88763cdc67cd38286c24ad830244e0c12e019 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-23Fix typos in tempest.confCédric Ollivier1-4/+5
It completes the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/62793/2 Change-Id: Ie4c4c5cb374f2bfac6397841f8ddc2cd3b2f524b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 98a4a863935be38f63e78550ddbcf4c1299bfdf1)
2018-09-23Set default_domain_id in tempest.confCédric Ollivier2-3/+6
It allows verifying via non-default domain. Change-Id: I95ae26fd3bfd1c10421c02d2b4f6e8a9b6aa49e6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 11d28aaf2e726859b59b7511d64dc4dd4b422e1e)
2018-09-22Set admin_domain_scope to True (tempest)Cédric Ollivier2-15/+15
It completes the previous commit [1]. It also sets cidr and fully forces Keystone v3. [1] https://gerrit.opnfv.org/gerrit/#/c/62777/ Change-Id: Ida948a4ff051dc1d1325d29a815c201366a1e33e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f4b545efe2339bdb5f6117d484e127adda5c8021)
2018-09-22List all sheduler filters instead of allCédric Ollivier1-1/+5
It doesn't work as expected as highlighted in [1]. [1] https://review.openstack.org/#/c/570207/ Change-Id: Iaf64345c40e8d62349cd50a6861c1191d25c40b9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ecc7bc215cdf47104d61ba7e23e5f8ec65ca03c4)
2018-09-22Clean the default security groupCédric Ollivier1-0/+4
It's not removed when deleting the users and the projects. Change-Id: Ib5de0885dcbfb558a48cdd20ae3ccc47b7f23748 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d4e60af2b8f544d774223b16c193dc40bd5dce38)
2018-09-22Grant new tempest user as admin in domain tooCédric Ollivier1-0/+3
It seems mandatory for test_list_projects_returns_only_authorized_projects Change-Id: Id994e66b088d751c4f6d7f260f8e482c2ee83307 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 17e87d5af713bb07759c4b2af0c2b40077343a32)
2018-09-22Stop creating network resources in tempestCédric Ollivier2-4/+5
fixed_network_name is not used in neutron or nova gates [1]. It may bypass juju bug (subnet discovery). [1] http://logs.openstack.org/46/603046/1/check/tempest-full/a8468a1/controller/logs/tempest_conf.txt Change-Id: I820e8c723918ed683ed1f8016363eb70bad0d14a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ac31a32320122ea1683fe9884e5bf1f969678b03)
2018-09-21Remove rally plugins and extra when cleaningCédric Ollivier1-2/+11
Change-Id: I15393b870d648432c900d429d17129c630ed4f58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit aff6640b5aed37221a05067e93ee164273c16910)
2018-09-20Allow overriding default storage protocolCédric Ollivier2-2/+5
It adds a new env var STORAGE_PROTOCOL to override storage_protocol in tempest. The default value is unchanged [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I19e4e25212b6f6176e3b967e01eb634c15e4d474 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a561c6ca316feb1a203327aa729ac0317f70df48)
2018-09-20Merge "Set scheduler_available_filters to all" into stable/gambiaJuha Kosonen1-0/+2
2018-09-20Set scheduler_available_filters to allCédric Ollivier1-0/+2
It indicates all filters that are included with nova are enabled [1]. [1] https://docs.openstack.org/tempest/latest/sampleconf.html Co-Authored-By: Viktor Tikkanen <viktor.tikkanen@nokia.com> Change-Id: I0d1943941d62d2eee418200c69e8198cd858383e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ff2ba1fd18b05bf1b031e78d2589028968bbe906)
2018-09-20Add support for Rally OpenStack CI test casesJuha Kosonen6-17/+147
Include Neutron rally-jobs. Change-Id: Ic1122962bd7d876d179729640a8a321bc36442d8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5d54a533d25a989dc64a2789788ff2f2fd6ad5c6)
2018-09-19Modify creation of SecGroup Rule for SSHThierry ALLENO1-1/+11
There is multiple "default" security groups, when user is created with admin role. Change-Id: I7555dc9461816dfdaaee36d82d712e25b4b65da7 Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com> (cherry picked from commit 7488f119f9d9c61c61ef55d53f87de0e671fed23)
2018-09-19Correct proxy configuration for VNF VMThierry ALLENO1-0/+12
The configuration of proxy for apt is missing in ubuntu images. Line Feed is missing in cloudify conf files. Change-Id: I3237b914e993c57f4fe3ed568690d2d9a41c0bdf Signed-off-by: Thierry ALLENO <thierry.alleno@orange.com> (cherry picked from commit be864b0de9f0f990984ad9e3c2d20b694e1b2c26)
2018-09-12Ease adding proxies in vmsCédric Ollivier1-0/+41
It eases running VNFs behind proxies as they download packages. Change-Id: I187078dab744c51188b9835417d1a29fad1b4bd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-09Clean user/project after skipping testcasesCédric Ollivier1-0/+2
It avoids remaining resources after skipping a tempest-based testcase. Change-Id: I0a993486c6e9265d15166d5eed5a612875d29b08 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-08Merge "Stop cloning when running vyos_vrouter"Cedric Ollivier5-39/+7