summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-06-13Fix result parsing in cloudify_imsCédric Ollivier1-2/+2
The previous regex failed when errors are listed [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/194/console Change-Id: I57c8bfb8968555c3d43267a06f2bb9a2b95a3268 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit da3c805f8829f67d4d4154cd24f322ccf516b450)
2018-06-10Update cloudify-rest-client to 4.3.2Cédric Ollivier3-3/+5
Change-Id: I8ac0becb57897233c2a12781dc022d9fdfd32f85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 776eccccedbd560e8be332504bfa3cdfcbdc66e3)
2018-06-09Select the right quaff repoCédric Ollivier1-2/+2
Change-Id: I0aa090bf1f8c6220918ebc1b041bab4a43d444b5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 759cd4bb92e171b16af5c6c1206352b92096d596)
2018-06-09Force unf_ext 0.0.7.4Cédric Ollivier1-0/+1
Else it cannot compile vs arm [1][2] [1] https://build.opnfv.org/ci/job/functest-vnf-docker-build-arm64-master/231/console [2] https://github.com/sile/unf/pull/2/commits/74ed3e3b1ec31474cf9b8d8a90aee535607fdfe8 Change-Id: I8b0890c3b7a2a148975635c0f4eafbcc5568fc00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e9b5f08ddbdfefd6cbdf226a10b79b2349c4c86b)
2018-06-09Stop using a forked obsolete repoCédric Ollivier3-43/+29
It leverages on the official clearwater live test instead. It now parses the output directly. Conflicts: docker/vnf/Dockerfile Change-Id: Ia7746c13362323daf72b3536d294401f0b7ae42f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0c55898253147b8fb6e5ef1afbf6f462a5b343b5)
2018-06-06Switch to Python3 divide in cloudify_imsCédric Ollivier1-0/+2
The code simply asks for python3 divide else only live_test = 100% is considered as successful [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/169/console Change-Id: I84690d20791cd3d6a68823eec40f0e4b0f876b72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f7b6a9a8d69313bbb8203eaf25b2d78d86ae799c)
2018-06-05Switch from OS_ENDPOINT_TYPE to OS_INTERFACECédric Ollivier4-19/+16
It also set endpoint_type to public in tempest.conf if unset. JIRA: FUNCTEST-975 Change-Id: I91bd1d7171b4bcf58dbe818696d5b864d5036619 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4f9789cfab845d7209f5a2fc2209cad8941d02d6)
2018-06-05Return true if at least one passed testCédric Ollivier1-1/+1
JIRA: FUNCTEST-974 Change-Id: I9915dbb91516baf5307a577c41ede5dca51a2f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d77a8c4158562dea02500a7b6240b4934ab4fc7c)
2018-06-01Update clearwater to 129Cédric Ollivier1-1/+1
It switches to Sprint Ulmo [1] which fixes deployment issues in Orange ONAP Openlab. [1] http://www.projectclearwater.org/sprint-ulmo-release-note/ Change-Id: I3c32faf4e26e64bb12438238cf1ba66b9771da0d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a66e3b24e4dccd9e58fa5947d9850df48e74f07e)
2018-05-30Bypass Cloudify's upper-constraints issuesCédric Ollivier2-2/+4
It installs cmd2 via yum instead as last cmd2 release only supports python3. Change-Id: I495d71f11ed48ba47e1aa27965675d4bef7c141e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8b81b33530a9e46e7e6e7f8b81e752892bf9f2b9)
2018-05-30Fix _do_execute() return code in vping_sshCédric Ollivier1-1/+1
Change-Id: I781e51bb56f6cdac8b347e7fd85e70c07eb69e23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 30e4106b56608595885e1b46ad4b668866ab9426)
2018-05-30Simplify loggingPanagiotis Karalis2-50/+4
In order to collect logs from features running through functest framework (mainly for troubleshooting purposes), the logging mechanism has been updated accordingly. It should be noted that feature logs are printed in functest.log. All logs are now printed in functest.log whatever the namespace. JIRA: SFC-125 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I6cb32e5553749023d490d553ae4653750c52e844 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ceaea7f0cb95bce7f71d29dff71d58654cf0e700)
2018-05-28Print vping output instead of Paramiko objectCédric Ollivier1-1/+1
Change-Id: Iddc1abdf443e482e8748434a4ba7d85709d8cd0e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 72b17bc82ac5c6a388adbfc8a564f118d0ccd247)
2018-05-27Add debug logs in cloudify_imsCédric Ollivier2-15/+21
Change-Id: I47c6d598ce52f292bf2abdd2e9ecbadff6250712 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e5abdcc0d867f293dd89c9ba1a398071ef2cedd0)
2018-05-27Bypass Cloudify tenancy issuesCédric Ollivier2-75/+91
It creates a second user to bypass possible bugs and correctly exits on failure if it cannot connect to manager via ssh. It leverages on the _member_ user as much as possible. It also switches all flavor names to avoid conflicts. It also increases debug logs. Change-Id: I59cb071248b5ae50952b9f16eb29f7be3f3644ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a3542307b369ab91ee24d1fed534b565cd4030d7)
2018-05-27Leverage on _member_ userCédric Ollivier2-88/+85
It leverages on the _member_ user as much as possible. It also switches all flavor names to avoid conflicts. It also increases debug logs. Change-Id: Ica595b0aba81e845ddb1c858fd5d0deb69872319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8238ec092d2823fbb77537169580721ed0c4d03e)
2018-05-27Stop rolling snaps (bypass bugfixes)Cédric Ollivier1-1/+1
Snaps now requires admin role for creating routers [1]. [1] https://git.opnfv.org/snaps/commit/?h=stable/fraser&id=b351d8cf4d882c7ec3acbd0111b4d0bf1747c9d3 Change-Id: If3148ffac3e572f7971dbd56dad889e0028a763a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-24Set image metadata in tempestCédric Ollivier2-2/+3
It applied the same operations as [1]. Only one config is used between rally, tempest and vping. [1] https://gerrit.opnfv.org/gerrit/#/c/57613/ Change-Id: I4d5fd2117d404b7eaa79326e21a35272232d0b92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 46d61dac3e306249e729f45d25e33c3b4d7986e9)
2018-05-22Update Release Notes (Fraser.1)opnfv-6.1.0Cédric Ollivier7-165/+251
Change-Id: I574d1477e59c4261e385b5457bf351b0a4085899 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-21Switch to Shade in rallyJuha Kosonen2-167/+231
Use Shade for managing OpenStack resources in rally. Conflicts: functest/opnfv_tests/openstack/rally/rally.py functest/tests/unit/openstack/rally/test_rally.py Change-Id: Ic8b7aaef6886f6ca4930b2ea463317b75ed8d3c9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit e32353a740a3aaa76031fe9c2372b11f88add1bb)
2018-05-21Update ODL testcase to OpenStack ShadeCédric Ollivier2-35/+155
Conflicts: functest/opnfv_tests/sdn/odl/odl.py functest/tests/unit/odl/test_odl.py Change-Id: I7832b5ed274e181449f9db9fb03a2d27038520ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c9b0a0a1bf5b30f241dee566c815d4e527ec9628)
2018-05-21Switch to project domain nameCédric Ollivier1-3/+5
At least Fuel, Apex and Joid don't export OS_PROJECT_DOMAIN_ID. https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/353/console Change-Id: I8441d2de1841d5a9ce78c6929fd78da01c45548c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 084dd47cdeb68f150165e009877ed995cb9db6dc)
2018-05-21Rewrite TempestResourcesManagerCédric Ollivier5-255/+141
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Conflicts: functest/opnfv_tests/openstack/tempest/tempest.py functest/tests/unit/openstack/tempest/test_conf_utils.py functest/tests/unit/openstack/tempest/test_tempest.py Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9fb702111ae63824a2e293d327437d0486a565d2)
2018-05-20Add image extra properties back in vping_baseDelia Popescu2-1/+6
Image extra properties are missing for ARM Set image_url for ARM JIRA: ARMBAND-383 Change-Id: I0e2730c3f22214ad61d72424ea76173f1783d0ca Signed-off-by: Delia Popescu <delia.popescu@enea.com> (cherry picked from commit 1aaeab75130345ae9198de23d013f9840044c8b5)
2018-05-20Improve ssh timeout in vping_sshCédric Ollivier1-6/+18
It seems that 10s is not enough for Fuel. Change-Id: I46d3d2c9091946befb0e056a8c8cc56c59087471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e1e1317226b4022b6e77ae7ddcc9a1ef9d8ccbd2)
2018-05-20Simplify vping_sshCédric Ollivier8-98/+32
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 213ca8e4e4d155ed6d5626020e56c3a241d1dace)
2018-05-20Implement get_external_network via shadeCédric Ollivier3-1/+87
It fixes the current issues as EXTERNAL_NETWORK is mainly unset by all Installers [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-arm-daily-fraser/31/console Change-Id: I8ee62623701c15b9ff962d0a0e07a77934ff03ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8cf94642d8e41af5b23892323528aaab0e087a83)
2018-05-20Rewrite vping_ssh and vping_userdataCédric Ollivier5-482/+204
They now leverage on shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (openstacksdk) requires to change only one line. It deletes the related unit tests as they have to be fully rewritten. They will be added in another change. Conflict: functest/opnfv_tests/openstack/vping/vping_base.py Change-Id: I0c60681d6e1c0944960770429ef972947dd85321 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f1fbaabcc46dafe4b9937af600294f042cab31e0)
2018-05-20Set image_url as filenameCédric Ollivier1-2/+1
It will be reused as soon as vping switches to openstacksdk. Change-Id: Ib84f4b35b22ead1741579ec9140d3626f9102469 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 67d0f2c89b22a18580c6a3acdcdff1648af36e95)
2018-05-20Switch from deploy utils to the right objectsCédric Ollivier4-35/+49
It also prints the full exceptions and removes useless casts. Change-Id: I19ff1ae90670833f998c0d17592da82207235229 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fd18d52e94cc293c32bb7f69a00ec4604bdace0e)
2018-05-16Merge "Fix UserConfig objects" into stable/fraserCedric Ollivier2-2/+2
2018-05-16Fix UserConfig objectsCédric Ollivier2-2/+2
UserConfig is expecting domain_name as arg instead of domain. Else all vnfs cannot work against non Default domains. Change-Id: I4bb53df9d9c03524b19ec32f8d346d94ba78d188 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4bdb6e5de13eb5dc7f175dcc45d0dfedd0582fe4)
2018-05-16Fine-tuning the juju-epc codebase for better error-handlingsoumaya1-33/+68
The changes are mostly basic/cosmetic in nature. - Add some additional info in loggers. - Remove timeout from few commands(such as juju deploy) - Add exception logging for few commands(such as juju bootstrap). - Change rsync to cp for feature file transfer within ABot. Change-Id: Ibeaae17f1c25d04b7830ed42719b70e6c99228cf Signed-off-by: soumaya <soumaya.nayek@rebaca.com> (cherry picked from commit a69c4be1d1b4c6cc5021a14e63c9f73d28490942)
2018-05-16Updated documentation for juju_epc testssoumaya2-4/+40
Change-Id: If9399b7b385cb2660e76fcd42776c0dfcb4f7677 Signed-off-by: soumaya <soumaya.nayek@rebaca.com> (cherry picked from commit bd029d8b6b6801461904a257d566cd46a8c8d130)
2018-05-14Update cirros image version for ARM architectureDelia Popescu3-7/+5
Change-Id: Ia7a65a4f83798cb80ca7470d475c2c2d8c9fb6ea Signed-off-by: Delia Popescu <delia.popescu@enea.com> (cherry picked from commit c967e4702b215b3899c822c60529651335220cfa)
2018-05-11Leverage on local descriptorCédric Ollivier1-3/+1
It simply seems dummy. Change-Id: Ifb83dd0310f523f211911a35e7b481f9da6f9704 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7668df132aa661973a37aa5842be502765ba4922)
2018-05-11Install Cloudify descritors in functest-vnfCédric Ollivier5-23/+18
It completes [1] to fix gates [2] and stops getting thirdparty vnf master (dependencies). It also prints data to ease debugging. [1] https://github.com/Orange-OpenSource/opnfv-cloudify-clearwater/commit/abd39d772c77317a25745feaaf312165e7588346 [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/110/console Conflicts: docker/vnf/Dockerfile functest/opnfv_tests/vnf/ims/cloudify_ims.yaml Change-Id: Ib317a491e54820f4edb01fcecfca9d2a08b40c0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 19807ef8967c21da41fe5f5566751be8de250434)
2018-05-09Merge "Functest fail to parse tempest-based results" into stable/fraserLinda Wang1-3/+6
2018-05-07Make volumes appear as SCSI devices in aarch64Charalampos Kominos1-0/+8
Adding volumes in openstack by default uses virtio_blk and the devices appear as /dev/vdX. In aarch64 however a qemu pci slot is already in use so the tests cannot assign more than one volume to a VM. Forcing the drives to use virtio-scsi solves the issue and allows more volumes to be attached as /dev/sdX. The variable defining the drive is VOLUME_DEVICE_NAME and is passed as environmental variable when the container is created. JIRA: ARMBAND-376 Change-Id: Ia688cff338ff319e22a3b26796fa197297c23ce0 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com> (cherry picked from commit a663c33645681f66ebe6b6af79c4e9f5910fb26b)
2018-05-07Functest fail to parse tempest-based resultsxudan1-3/+6
1. The regular expression can't work well for all tempest-based results 2. Refer to http://testresults.opnfv.org/test/api/v1/results?project=functest&case_name=refstack_defcore&last=1 3. There are 88 success test cases but the list of success is empty 4. tempest test case name is not always begin with {0}, it maybe any number 5. The test case whose name has the keyword 'fail' will also be list in 'failures' Change-Id: I5187aaaabdca762256be9162cc85ba42263169bc Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit 9286e052afe194c400479275edaa2aaf8ed52de8)
2018-04-27Control vping cleanup step via --nocleanLinda Wang3-46/+40
Change-Id: Ic43b100348e77fd96aab9abc5a9ec4a0b47a2f87 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 1ca85485f74d09dfd6787b75fb40cb70dce64e4b)
2018-04-24Check shell scripts via bashateCédric Ollivier5-19/+33
It also removes functest/cli/functest-complete.sh. Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 00b78ca96bef67166e0118a0dbdb5152f401a608)
2018-04-23Update graphs in userguideLinda Wang4-2/+2
1. Functest structural concept 2. Clearwater architecture Change-Id: I88e39d6d08f1eb28a389d2b8a7a1669295f6aa49 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit ccaa9c9d495575bd16da001a984597456bf152e4)
2018-04-22Bypass NoneType errors when creating router in rallyCédric Ollivier1-1/+1
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: Ia728415207f8ecb5b5ac55982f82337c45671c4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0870e3735324941f5bd77243f36f9214cd531ac)
2018-04-21Bypass NoneType errors when creating routerCédric Ollivier1-2/+2
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: I849944fa9d4d2be21fe1a37b76c4cfd231b6d56f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Add timeouts in juju_epcCédric Ollivier1-11/+19
juju_epc still hangs if OpenStack isn't well deployed [1]. As releng doesn't publish logs if the job is aborted, timeout has to be added mostly everywhere. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/31/console Change-Id: I0296cd811bda0234aab98f184b3ab247a5b32017 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6279d9372d0a1827bb14e365cd02e9888941315d)
2018-04-20Merge "Update configguide" into stable/fraseropnfv-6.0.0Cedric Ollivier1-202/+94
2018-04-20Merge "Update version in setup.cfg (Fraser)" into stable/fraserCedric Ollivier1-1/+1
2018-04-20Merge "Last Release updates before tag (Fraser)" into stable/fraserCedric Ollivier6-131/+131
2018-04-20Update configguideLinda Wang1-202/+94
JIRA: FUNCTEST-959 Change-Id: Id75689154a63b7258d753f26bb5ff01c0b06012e Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit e37cf21781d60f498e08683df4ca7b1993c52052)