aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests
AgeCommit message (Collapse)AuthorFilesLines
2019-02-12Generate one single report for Rally testcasesCédric Ollivier1-9/+17
It eases sharing one single report including all task results. For the time being, rally_jobs only generates neutron.html. Then it only adds one report for rally_full and rally_sanity. We may consider generating only one json file but it asks for a refactoring (result parsing) which can be done in a second change. Change-Id: I8fa75ae80750336950f355c2aedc3dd4dc621cc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-12Increase timeout to reach vnf APICédric Ollivier1-2/+2
It increases the timeout in cloudify-based and clearwater-based testcases to allow running them in parallel (functest-virtual) [1]. [1] https://build.opnfv.org/ci/job/functest-latest-gate/54/ Change-Id: Ic637cb46a1380a683cb1e2b633cb97ac3be6affa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-11Update and enable Cloudify-based testcasesCédric Ollivier2-8/+30
It switches from the Cloudify virtual machine to the community container which allows deploying vyos_vrouter and cloudify_ims. Last stable Cloudify OpenStack plugin (2.4.17) is now deployed. It also updates the Cloudify python package to latest release. It adds a delay before deleting the blueprint which may be improved in a second change (it allows enabling the testcase in the stable release). Change-Id: Ie48a2c9d2badab0d7ba0b9e7845f453fad335ef7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-02-09Increase juju_epc timeoutCédric Ollivier1-1/+1
It fails 4 times in functest-virtual (out of 34) due to a possible slow bandwidth (e.g. [1]). [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-latest-juju_epc-run/24/console Change-Id: Ie1aa69464f8dd0fa1a15900e7d49576368187a44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Remove CreateInstanceVolumeTests (snaps_smoke)Cédric Ollivier1-7/+1
The volume and the virtual machine created are not deleted. Change-Id: I238fcb0839a2f609333080bc8c88b84327d51475 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Decrease volume_size in all Rally testsCédric Ollivier3-7/+7
Devstack allocates a 24G disk image by default [1]. It can be easily reached by setting volume size to 5G or 10G. [1] https://github.com/openstack-dev/devstack/blob/master/stackrc#L779 Change-Id: I7c35d8f333718d6c192a9f12a714e626d60b1895 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Merge "Wait for apps being active (juju_epc)"Cedric Ollivier1-8/+14
2019-01-28Merge "Allow running latest tempest_full"Cedric Ollivier1-0/+5
2019-01-28Wait for apps being active (juju_epc)Cédric Ollivier1-8/+14
It seems that juju-wait doesn't wait for all apps. Juju_epc passes in functest-virtual thanks to that additional tries. Change-Id: I161902c6308cfa6323c21e09140d16e036768ece Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Allow running latest tempest_fullCédric Ollivier1-0/+5
It allows running test_user_update_own_password [1] [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-components-latest-tempest_full-run-8/results/tempest_full/tempest-report.html Change-Id: I9f273ba58871f1e16886af623dcbb91f5c20c2f6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-28Clean project/user if snaps tests are skippedCédric Ollivier1-0/+1
Change-Id: I88a58516a3620cc6b19013313672ad1a80791e70 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-27Merge "Remove Snaps NeutronUtilsFloatingIpTests"Cedric Ollivier1-5/+1
2019-01-27Merge "Stop using urljoin when adding v3"Cedric Ollivier2-6/+2
2019-01-27Remove Snaps NeutronUtilsFloatingIpTestsCédric Ollivier1-5/+1
It has been fixed in Snaps [1] but we can't sync its requiremets [2]. Then we have to remove the test. [1] https://gerrit.opnfv.org/gerrit/#/c/66625/ [2] https://gerrit.opnfv.org/gerrit/#/c/66627/1 Change-Id: Ied405092cb4992bc04ca13c1536d1e8cee056ace Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 17b788c5340e7d76f6c37397cd8aa35c8db3f4c2)
2019-01-27Merge "Remove test_get_endpoint_with_each_interface"Cedric Ollivier1-5/+1
2019-01-27Stop using urljoin when adding v3Cédric Ollivier2-6/+2
urljoin works here only if url ends by /. It replaces identity by v3 when running vs devstack. Change-Id: Id896f2b54dfcabadaad1137deef91b1cb07c697d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-26Remove test_get_endpoint_with_each_interfaceCédric Ollivier1-5/+1
It checks all 3 endpoints for image but nothing forces to define them. Here is the only endpoint created by devstack. glance | image | RegionOne | | public: http://192.168.1.10/image [1] keystoneauth1.exceptions.catalog.EndpointNotFound: internal endpoint for image service in RegionOne region not found Change-Id: If501b849fbbed6df98742db21e924094c1df9c7f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-26Set Gnocchi scenario as optional in rally testsJuha Kosonen1-6/+10
The execution of an optional scenario is skipped if the corresponding openstack service does not exist. Change-Id: I8721f26ebc253ce02138b85d6c88e659c5afae80 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2019-01-20Slightly improve heat_imsCédric Ollivier1-2/+2
It increases timeouts which could be reached if shared bandwidth (functest-virtual [1]). [1] http://artifacts.opnfv.org/functest/functest-opnfv-functest-vnf-latest-heat_ims-run-4/results/functest.log Change-Id: I29adcd9ea88bbccbaef9ba7f8e155d37a3217433 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-20Force the right external network if jujuCédric Ollivier1-0/+1
It may select a falsy external network [1]. [1] https://build.opnfv.org/ci/job/functest-opnfv-functest-vnf-latest-juju_epc-run/4/console Change-Id: Ic403d0cfb4bc829275617d6b1338311e8e7ea894 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-20Fix one typo in docstring (tempest.py)Cédric Ollivier1-1/+1
Change-Id: I46053c92660139f4004d9cec8d1cfb6817cc0e07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-19Take control over Rally logicsCédric Ollivier1-4/+25
Rally selects the first external network [1] which could raise side effects if: - another testcase is creating a dummy external network in // - all external subnets are not reachable from jumphost It's now overriden by EXTERNAL_NETWORK as defined in Functest Rally creates a new shared network if one already exists [2]. As juju now allows other shared networks, it can be safely created by Functest to allow only one logic and to handle provider networks, different name servers, etc... [1] https://github.com/openstack/rally-openstack/blob/master/rally_openstack/verification/tempest/config.py#L146 [2] https://github.com/openstack/rally-openstack/blob/master/rally_openstack/verification/tempest/context.py#L85 Change-Id: Icf8c08077d4b0a9eb1c2e1b7309c62957b0a3b63 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-01-19Move logics out of TempestCommon.__init__()Cédric Ollivier1-22/+33
It conforms with best programming practices. It allows muting console and increasing log level (debug). Change-Id: I0e0cfef6abe3b354a43817fcb242c71da701e237 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-19Add task arguments to rally_jobsJuha Kosonen1-4/+14
Define floating network as a Rally task argument. Enable rally_jobs subtest. Change-Id: I37d7c4718cfb3de3ad1980878e0529d652013ccb Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-12-06Remove duplicated code in vnfsCédric Ollivier6-243/+65
It mainly leverages on functest_utils instead of duplicating. Change-Id: I97dc9215a835d3e7f1527b565132f667f09f2b7e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-12-01Remove Snaps NovaUtilsInstanceVolumeTestsCédric Ollivier1-5/+1
It doesn't clean its resources and then breaks the gate after multiple runs. It's the only way as Snaps is inactive and pinned in Functest. Change-Id: I5bb8707edaf998b91b8d5642b48465d4247cf8e7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-23Fix an invalid class name (vGPU)Cédric Ollivier1-2/+2
Change-Id: Ifff9eff1984846937920124ad0a7790e20593b25 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-17Rename Rally blacklist.txt to blacklist.yamlCédric Ollivier2-1/+2
It eases editing it or verifyfing it via yamllint. Change-Id: I380830eff5f404745e284067b5a10f58dc60b80e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-15Switch to Clearwater Zamin (heat_ims)Cédric Ollivier1-2/+2
Zamin is declared as the first "stable" release. Cloudify descriptor is not ready for the update. Change-Id: Ibfd2e3a226e1a547dd8c4e32ff998bac007f10a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3ac3d8d6f725b76ccb22a730cd802f36f75c8b90)
2018-11-11Check if at least 2 hypervisors (Shaker)Cédric Ollivier1-0/+6
Shaker is now skipped if only one hypervisor. Change-Id: Ib3f803ab61e66e0daba0622ead0c1bf0905d0cce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-10Check if at least 1 hypervisorsCédric Ollivier2-1/+7
Vmtp is skipped if only one hypervisor. As Vtmp returns 0 when all is skipped, it protects vs issues when generating charts. Change-Id: I5ea7c31c0688ae773425d2192a4f30a22360185f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-07Merge "Disable agent testing in tempest-based testcases"Cedric Ollivier3-3/+13
2018-11-07Remove snaps ansible test casesCédric Ollivier1-7/+0
They can't work vs all OPFV scenarios (MTU doesn't conform with Geneve) and are deprecated. Updating snaps commit id [1] breaks all gates closed to Gambia release. [1] https://gerrit.opnfv.org/gerrit/#/c/64515/ Change-Id: Ie4a7a694703642a74b731a4142a5c8c029f7e661 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-06Disable agent testing in tempest-based testcasesCédric Ollivier3-3/+13
It blacklists agent testing and two tests asking for VXLAN as overlay if OVN (OVN supports GENEVE) [1] blacklist.txt is renamed blacklist.yaml and is verified by yamllint. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-gambia/33/console Change-Id: I73c1b8cbbd74973a7f15476feea6ee4532786660 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-11-06Increase Vmtp timeoutsCédric Ollivier1-0/+1
It now conforms with other testcases booting ubuntu images. Change-Id: If9b610646ee5dcb2eb002d74dff8e1a797a4f232 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-26Move tempest logics in tempest_conf.yamlCédric Ollivier2-29/+14
It allows removing OPNFV logics out of Functest (releng) and then simplifies conf_utils. tempest.conf is filled by the current default values. functest-alpine.sh will be updated to allow modifying the default values without breaking the OPNFV installers. It deprecates the only tempest-related env var (STORAGE_PROTOCOL) Change-Id: I14bcb715826ef2d85af87e7af600261a3c08e72c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-26Temporarily disable Cinder volumes backup testsCédric Ollivier1-0/+3
From the time being, all OPNFV installers [1][2][3] don't support Cinder volumes backup. We will find a better way to handle the lack of OPNFV requiremements (these tests pass succesfully in Orange Openlab). At least, it will allow verifying tempest_full in OPNFV gates. [1] Apex: https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-25_02-17-25/tempest_full/tempest-report.html [2] Compass: https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [3] Fuel: https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I319536070aa77a5dbab6a692a1d76049f75e758b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-26Temporarily disable VNC testsCédric Ollivier1-0/+3
At least Compass and Fuel configure Spice as console [1][2]. It disables vnc testing as it could fail for endusers as well. [1] https://artifacts.opnfv.org/logs/functest/huawei-virtual9/2018-10-24_04-54-25/tempest_full/tempest-report.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod2/gambia/2018-10-25_05-57-54/tempest_full/tempest-report.html Change-Id: I2a1ecf345cb81170c1b1a3e49f8f3a58602fc3f0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Disable Glance API v1Cédric Ollivier1-0/+4
It has been deprecated since Newton [1]. Even if the related tests are skipped in latest tempest [2], API v1 has to be disabled in Gambia's tempest.conf [3]. [1] https://docs.openstack.org/glance/latest/user/glanceapi.html [2] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-22_02-34-24/tempest_full/tempest-report.html [3] https://artifacts.opnfv.org/logs/functest/lf-pod1/gambia/2018-10-23_10-34-07/tempest_full/tempest-report.html Change-Id: I3b6bb632412c0fecaa659da262760af64d79fa71 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-23Overprotect vmtp vs unversioned OS_AUTH_URLCédric Ollivier1-0/+4
It simply adds v3 to OS_AUTH_URL if required. Vtmp should be updated to manage unversioned url [1]. https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/371/console Co-Authored-By: Juha Kosonen <juha.kosonen@nokia.com> Change-Id: I4806e811c0714b061b77f940934830cfb1835d74 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21Harden Rally generate reportCédric Ollivier1-3/+2
It converts html_file to str and raises all possible exceptions. It sometimes fails when locally generating reports. Change-Id: Idf6a12aaac4561800cd5e364f8bcc495aabbee1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-21List neutron exts and service providers in connection_checkCédric Ollivier1-1/+7
It eases debugging as well [1]. [1] https://artifacts.opnfv.org/logs/functest/lf-pod1/2018-10-20_12-23-41/patrole/tempest-report.html Change-Id: Ie9ddc280fc239c5e0887347d434839940e7a3240 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-15Do not create files in site-package directoryJuha Kosonen2-9/+22
Use /home/opnfv/functest/data/rally/task directory for storing temporary files when running rally tasks. Also removes unused vm scenario from task service list. Change-Id: Icfd4f99ebe6194360bda8bd88e497e018a9541a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-10-14Fix image properties parsingCédric Ollivier2-20/+7
It removes useless spaces and now conforms with oslo.conf dict. New helpers and unit tests are available. Change-Id: I20335c5e5c3840cc872e158c6072d97a3f2cb98c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-06Merge "Rename IMG_PROP to IMAGE_PROPERTIES"Cedric Ollivier1-4/+5
2018-10-06Rename IMG_PROP to IMAGE_PROPERTIESCédric Ollivier1-4/+5
Any other env vars are reduced. Change-Id: Ic2c37d6efd543603a2495f9d2621b66d61710a54 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-10-06Merge "Use environment variable for image properties"Cedric Ollivier1-0/+4
2018-10-05Use environment variable for image propertiesDelia Popescu1-0/+4
Use IMG_PROP environment variable to read extra image properties. Set image_extra_properties for scsi volume types without file patch, but using IMG_PROP env variable IMG_PROP is defined through releng. Image extra_properties will continue to get updates from functest config file With this change, remove unnecessary parameters from arm patch Related to:https://gerrit.opnfv.org/gerrit/#/c/63203/ JIRA:ARMBAND-402 Change-Id: I64139240751b1e109bbe24ba32f487ccd98b9a92 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-10-02Add Rally scenarios for testing floating IPJuha Kosonen2-0/+51
rally_sanity: NovaServers.boot_server_associate_and_dissociate_floating_ip rally_full: NovaServers.boot_server_associate_and_dissociate_floating_ip NovaServers.boot_and_associate_floating_ip Change-Id: I31b7693828920bae92ff4ac8e7b0fde86e958cb5 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-24Update juju agentsCédric Ollivier1-1/+1
It conforms with last juju update. Change-Id: I4941aac66e5ac96045090f10f197f6ee2712caac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>