summaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-05-21Switch to Shade in rallyJuha Kosonen2-167/+231
Use Shade for managing OpenStack resources in rally. Conflicts: functest/opnfv_tests/openstack/rally/rally.py functest/tests/unit/openstack/rally/test_rally.py Change-Id: Ic8b7aaef6886f6ca4930b2ea463317b75ed8d3c9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit e32353a740a3aaa76031fe9c2372b11f88add1bb)
2018-05-21Update ODL testcase to OpenStack ShadeCédric Ollivier2-35/+155
Conflicts: functest/opnfv_tests/sdn/odl/odl.py functest/tests/unit/odl/test_odl.py Change-Id: I7832b5ed274e181449f9db9fb03a2d27038520ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c9b0a0a1bf5b30f241dee566c815d4e527ec9628)
2018-05-21Switch to project domain nameCédric Ollivier1-3/+5
At least Fuel, Apex and Joid don't export OS_PROJECT_DOMAIN_ID. https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/353/console Change-Id: I8441d2de1841d5a9ce78c6929fd78da01c45548c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 084dd47cdeb68f150165e009877ed995cb9db6dc)
2018-05-21Rewrite TempestResourcesManagerCédric Ollivier5-255/+141
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Conflicts: functest/opnfv_tests/openstack/tempest/tempest.py functest/tests/unit/openstack/tempest/test_conf_utils.py functest/tests/unit/openstack/tempest/test_tempest.py Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9fb702111ae63824a2e293d327437d0486a565d2)
2018-05-20Add image extra properties back in vping_baseDelia Popescu2-1/+6
Image extra properties are missing for ARM Set image_url for ARM JIRA: ARMBAND-383 Change-Id: I0e2730c3f22214ad61d72424ea76173f1783d0ca Signed-off-by: Delia Popescu <delia.popescu@enea.com> (cherry picked from commit 1aaeab75130345ae9198de23d013f9840044c8b5)
2018-05-20Improve ssh timeout in vping_sshCédric Ollivier1-6/+18
It seems that 10s is not enough for Fuel. Change-Id: I46d3d2c9091946befb0e056a8c8cc56c59087471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e1e1317226b4022b6e77ae7ddcc9a1ef9d8ccbd2)
2018-05-20Simplify vping_sshCédric Ollivier6-95/+30
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 213ca8e4e4d155ed6d5626020e56c3a241d1dace)
2018-05-20Implement get_external_network via shadeCédric Ollivier3-1/+87
It fixes the current issues as EXTERNAL_NETWORK is mainly unset by all Installers [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-arm-daily-fraser/31/console Change-Id: I8ee62623701c15b9ff962d0a0e07a77934ff03ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8cf94642d8e41af5b23892323528aaab0e087a83)
2018-05-20Rewrite vping_ssh and vping_userdataCédric Ollivier4-482/+202
They now leverage on shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (openstacksdk) requires to change only one line. It deletes the related unit tests as they have to be fully rewritten. They will be added in another change. Conflict: functest/opnfv_tests/openstack/vping/vping_base.py Change-Id: I0c60681d6e1c0944960770429ef972947dd85321 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f1fbaabcc46dafe4b9937af600294f042cab31e0)
2018-05-20Set image_url as filenameCédric Ollivier1-2/+1
It will be reused as soon as vping switches to openstacksdk. Change-Id: Ib84f4b35b22ead1741579ec9140d3626f9102469 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 67d0f2c89b22a18580c6a3acdcdff1648af36e95)
2018-05-20Switch from deploy utils to the right objectsCédric Ollivier4-35/+49
It also prints the full exceptions and removes useless casts. Change-Id: I19ff1ae90670833f998c0d17592da82207235229 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fd18d52e94cc293c32bb7f69a00ec4604bdace0e)
2018-05-16Merge "Fix UserConfig objects" into stable/fraserCedric Ollivier2-2/+2
2018-05-16Fix UserConfig objectsCédric Ollivier2-2/+2
UserConfig is expecting domain_name as arg instead of domain. Else all vnfs cannot work against non Default domains. Change-Id: I4bb53df9d9c03524b19ec32f8d346d94ba78d188 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4bdb6e5de13eb5dc7f175dcc45d0dfedd0582fe4)
2018-05-16Fine-tuning the juju-epc codebase for better error-handlingsoumaya1-33/+68
The changes are mostly basic/cosmetic in nature. - Add some additional info in loggers. - Remove timeout from few commands(such as juju deploy) - Add exception logging for few commands(such as juju bootstrap). - Change rsync to cp for feature file transfer within ABot. Change-Id: Ibeaae17f1c25d04b7830ed42719b70e6c99228cf Signed-off-by: soumaya <soumaya.nayek@rebaca.com> (cherry picked from commit a69c4be1d1b4c6cc5021a14e63c9f73d28490942)
2018-05-14Update cirros image version for ARM architectureDelia Popescu3-7/+5
Change-Id: Ia7a65a4f83798cb80ca7470d475c2c2d8c9fb6ea Signed-off-by: Delia Popescu <delia.popescu@enea.com> (cherry picked from commit c967e4702b215b3899c822c60529651335220cfa)
2018-05-11Leverage on local descriptorCédric Ollivier1-3/+1
It simply seems dummy. Change-Id: Ifb83dd0310f523f211911a35e7b481f9da6f9704 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7668df132aa661973a37aa5842be502765ba4922)
2018-05-11Install Cloudify descritors in functest-vnfCédric Ollivier4-20/+10
It completes [1] to fix gates [2] and stops getting thirdparty vnf master (dependencies). It also prints data to ease debugging. [1] https://github.com/Orange-OpenSource/opnfv-cloudify-clearwater/commit/abd39d772c77317a25745feaaf312165e7588346 [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/110/console Conflicts: docker/vnf/Dockerfile functest/opnfv_tests/vnf/ims/cloudify_ims.yaml Change-Id: Ib317a491e54820f4edb01fcecfca9d2a08b40c0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 19807ef8967c21da41fe5f5566751be8de250434)
2018-05-09Merge "Functest fail to parse tempest-based results" into stable/fraserLinda Wang1-3/+6
2018-05-07Make volumes appear as SCSI devices in aarch64Charalampos Kominos1-0/+8
Adding volumes in openstack by default uses virtio_blk and the devices appear as /dev/vdX. In aarch64 however a qemu pci slot is already in use so the tests cannot assign more than one volume to a VM. Forcing the drives to use virtio-scsi solves the issue and allows more volumes to be attached as /dev/sdX. The variable defining the drive is VOLUME_DEVICE_NAME and is passed as environmental variable when the container is created. JIRA: ARMBAND-376 Change-Id: Ia688cff338ff319e22a3b26796fa197297c23ce0 Signed-off-by: Charalampos Kominos <Charalampos.Kominos@enea.com> (cherry picked from commit a663c33645681f66ebe6b6af79c4e9f5910fb26b)
2018-05-07Functest fail to parse tempest-based resultsxudan1-3/+6
1. The regular expression can't work well for all tempest-based results 2. Refer to http://testresults.opnfv.org/test/api/v1/results?project=functest&case_name=refstack_defcore&last=1 3. There are 88 success test cases but the list of success is empty 4. tempest test case name is not always begin with {0}, it maybe any number 5. The test case whose name has the keyword 'fail' will also be list in 'failures' Change-Id: I5187aaaabdca762256be9162cc85ba42263169bc Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit 9286e052afe194c400479275edaa2aaf8ed52de8)
2018-04-27Control vping cleanup step via --nocleanLinda Wang3-46/+40
Change-Id: Ic43b100348e77fd96aab9abc5a9ec4a0b47a2f87 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 1ca85485f74d09dfd6787b75fb40cb70dce64e4b)
2018-04-24Check shell scripts via bashateCédric Ollivier2-9/+2
It also removes functest/cli/functest-complete.sh. Change-Id: I5d9313be6a155b4adf1b82ce2b111ec06823cd8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 00b78ca96bef67166e0118a0dbdb5152f401a608)
2018-04-22Bypass NoneType errors when creating router in rallyCédric Ollivier1-1/+1
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: Ia728415207f8ecb5b5ac55982f82337c45671c4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f0870e3735324941f5bd77243f36f9214cd531ac)
2018-04-21Bypass NoneType errors when creating routerCédric Ollivier1-2/+2
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: I849944fa9d4d2be21fe1a37b76c4cfd231b6d56f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Add timeouts in juju_epcCédric Ollivier1-11/+19
juju_epc still hangs if OpenStack isn't well deployed [1]. As releng doesn't publish logs if the job is aborted, timeout has to be added mostly everywhere. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/31/console Change-Id: I0296cd811bda0234aab98f184b3ab247a5b32017 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6279d9372d0a1827bb14e365cd02e9888941315d)
2018-04-20Fix image paths in cloudify_ims_perf.yamlCédric Ollivier1-2/+2
Change-Id: If58b5f2021df8a0de672a30459b5b0b12f3fcef2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 4c140b0cc3f484ce441e0f24a6a3a8c906d4cc59)
2018-04-20Set fraser as branch in cloudify_vrouter reposCédric Ollivier1-2/+2
Change-Id: I1338c07f7eab398723b5e7599cf94b032d014cdd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Download fraser.zip instead of master.zip (cloudify_ims)Cédric Ollivier2-2/+2
Change-Id: I6a5ebb27f445b816cf449f8b9db60e70278b338f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Use timeout to wrap juju-waitCédric Ollivier1-2/+4
It allows getting logs as releng doesn't push them if global timeout. Change-Id: I4bbb3818feff37d29b4ccd586f3e940380feef2e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 251024b29199ecee86661b8850751d982b7c5797)
2018-04-17Check app workload in juju_epcCédric Ollivier1-16/+16
It avoids interpreting rsync errors in case of deployment failures. Mysql is still unchecked. Change-Id: I01b4470b86637d0fc322c422f05240a928305158 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Merge "Get debug data before cleaning juju_epc" into stable/fraserCedric Ollivier1-0/+6
2018-04-17Get debug data before cleaning juju_epcCédric Ollivier1-0/+6
It could help us to detect the issue when testing Apex (nosdn). It should be only printed on exceptions instead but this proposal is safer and straightforward. Change-Id: I2cccc737e3b3572af72c2653bf32bc02f9ab9077 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c789cca4a6e9afefba0c1622d49a181dd35437f7)
2018-04-17Set scp debug flag in juju_epcCédric Ollivier1-3/+3
Change-Id: Ic57d05416ac7c8bc459363ea479237101c22f27e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit ed3a825ec90796fe72387b4bd74033a991b2351b)
2018-04-15Remove odl_netvirt testcaseCédric Ollivier1-22/+0
Its dendencies have not been met since Danube [1]. [1] https://build.opnfv.org/ci/job/apex-os-odl_l3-nofeature-noha-baremetal-danube/ Change-Id: I1a5bb4acd9e7e14dbf519132847521b5138f4cd6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 13e4c5838b732bf9fd246cd4f97cb9b4e2b8e0b9)
2018-04-15Filter only on scenarios if possibleCédric Ollivier1-3/+3
If a scenario is defined, setting installers as dependencies makes the maintenance more difficult. Change-Id: I3d0dc51ec3b9ccf3270ad1ec8253d6ee7e4a99a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 38c67396839738cb319c797aa35fb50ec892b053)
2018-04-15Set same dependencies for all vping test casesCédric Ollivier1-1/+1
It allows a fair comparison between odl and nosdn scenarios. Gluon could also be safely removed as scenario filter. https://build.opnfv.org/ci/job/functest-compass-baremetal-daily-master/88/console Change-Id: I0a9268d2038c79320e372d1d35d276560555aa7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7c8d58fbe548f94c6cecfef7afc66270b395d6e9)
2018-04-14Print the stack traceback when cleaning juju_epcCédric Ollivier1-2/+1
Change-Id: If32557a4384cafd67b7c294f8c0592ee2769b1a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b2b1be21af5de2dd88092be268ae5f817608ecd1)
2018-04-13Merge "Fix role processing in Patrole" into stable/fraserCedric Ollivier5-41/+36
2018-04-13Merge "Pass kwargs in TempestCommon:configure()" into stable/fraserCedric Ollivier1-1/+1
2018-04-13Print the stack traceback when cleaningCédric Ollivier2-4/+3
Change-Id: I8279844f0e42378b4fe550696608054cd7418a12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 38b69d908ccf5550b1de5b9ecf170a4169fa82f1)
2018-04-12Fix role processing in PatroleCédric Ollivier5-41/+36
Role has to be listed in tempest.conf before calling testr. It also saves the right config file. Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 71c4b3b719289929c226cae60eb1b23ada16eeb2)
2018-04-12Pass kwargs in TempestCommon:configure()Cédric Ollivier1-1/+1
It's required by Patrole. Change-Id: I07eb6f05b4776c3f9929b6f08c5cbfa131e09d8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 51acd93bfe71e2cbd897f071e58b641ccd5ca1ac)
2018-04-11Precise vyos_vrouter logsCédric Ollivier2-4/+6
Aborting was written even if it worked after rebooting the vm [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/41/console Change-Id: Idb29624b8793df5d77d401b375aa3b3176778ddf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 99b72c34e92c567a47ebc3b977c7aaa290fef6de)
2018-04-11Take all cmd status into account in juju_epcCédric Ollivier1-67/+88
It also puts output in functest.log instead of /dev/stdout. Change-Id: I3a4b5f81edd20a529821c5a684b3ab269b7c6796 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 35d2dbdeeadece1b8dbac5210f05dee7028bfbb6)
2018-04-11Leverage on SDN_CONTROLLER_IP if fuelCédric Ollivier2-8/+7
It conforms with [1]. [1] https://jira.opnfv.org/browse/FUEL-352 Change-Id: Idae142de8de09203509c73c35c2e7fea5a5d880b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 492b5543103a25b51740b82a291b087f68d932eb)
2018-04-11Remove obsolete apex processing in juju_epcCédric Ollivier1-18/+5
It has been useless since [1] was merged [1] https://jira.opnfv.org/browse/APEX-570 Change-Id: Id89b75d8cad9e180a02189450e13fa1e61b1239c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 941838f1b7e574e738b359ee3bb542d04eb97176)
2018-04-09Run all VNFs vs SDN scenariosCédric Ollivier1-3/+3
It allows a fair comparison between Neutron standalone and SDN controllers. They should run successfully at least vs Daisy [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/lastSuccessfulBuild/ Change-Id: Iac34cd4d6eb070be0abe081fbc815e971675faef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit abfdf1d28292198ef94059b5812a5987887404e0)
2018-04-09Merge "[fuel] Unite OpenDaylight ports" into stable/fraserCedric Ollivier2-2/+2
2018-04-09[fuel] Unite OpenDaylight portsMichael Polenchuk2-2/+2
ODL Oxygen has only 1 connector by default, so unite web and rest ports together. Change-Id: Idd5bdd5da3dcc85fa25b82ab2d19107b2d005974 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit bc65c4a9424a7f9b37a81b13b67ea3d86b52d9d3)
2018-04-09Remove Ceilometer test scenariosJuha Kosonen5-763/+1
The API utilized by Rally in Ceilometer scenarios was deprecated in OpenStack Pike and scenarios were blacklisted. Remove these scenarios from respository. JIRA: FUNCTEST-949 Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 2e0dad6e9a49ad9fdd349387b72f145e53bc4da0)