aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests
AgeCommit message (Collapse)AuthorFilesLines
2018-05-05Merge "Functest fail to parse refstack results"Cedric Ollivier1-3/+6
2018-05-05Switch to Shade in rallyJuha Kosonen1-76/+79
Use Shade for managing OpenStack resources in rally. Change-Id: Ic8b7aaef6886f6ca4930b2ea463317b75ed8d3c9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-05-05Implement get_external_network via shadeCédric Ollivier1-1/+2
It fixes the current issues as EXTERNAL_NETWORK is mainly unset by all Installers [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-arm-daily-fraser/31/console Change-Id: I8ee62623701c15b9ff962d0a0e07a77934ff03ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-04Functest fail to parse refstack resultsxudan1-3/+6
1. The regular expression can't work well for refstack results 2. Refer to http://testresults.opnfv.org/test/api/v1/results?project=functest&case_name=refstack_defcore&last=1 3. There are 88 success test cases but the list of success is empty 4. Refstack test case name is not always begin with {0}, it maybe any number 5. The test case whose name has the keyword 'fail' will also be list in 'failures' Change-Id: I5187aaaabdca762256be9162cc85ba42263169bc Signed-off-by: xudan <xudan16@huawei.com>
2018-04-30Rewrite TempestResourcesManagerCédric Ollivier2-147/+104
It now leverages on OpenStack Shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (OpenStack SDK Rocky) requires to change only one line. It stops dedicating the network to the user possibly created because the support is incomplete (the users have to be registed in tempest.conf and the multiprocessing has to be enforced). It also writes the second image and the second flavor in tempest.conf. Change-Id: I9fe2c90a6073ebc240e9aa8fdf2ef93d5dd5f15f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-29Rewrite vping_ssh and vping_userdataCédric Ollivier3-303/+200
They now leverage on shade to allow gating OpenStack master as asked by TSC. Switching to OpenStack master (openstacksdk) requires to change only one line. It deletes the related unit tests as they have to be fully rewritten. They will be added in another change. Change-Id: I0c60681d6e1c0944960770429ef972947dd85321 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-24Merge "Add debug logs in cloudify_ims"valentin boucher2-15/+21
2018-04-24Merge "Switch from deploy utils to the right objects"Cedric Ollivier3-18/+28
2018-04-24Add Rally GnocchiResource scenariosJuha Kosonen2-0/+27
New scenarios: GnocchiResource.create_resource (rally_full) GnocchiResource.create_delete_resource (rally_sanity, rally_full) Change-Id: Ica03bdd60224d97ef0ec0d45c2cd25c295723ffc Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-23Switch from deploy utils to the right objectsCédric Ollivier3-18/+28
It also prints the full exceptions and removes useless casts. Change-Id: I19ff1ae90670833f998c0d17592da82207235229 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-23Add debug logs in cloudify_imsCédric Ollivier2-15/+21
Change-Id: I47c6d598ce52f292bf2abdd2e9ecbadff6250712 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-22Bypass NoneType errors when creating router in rallyCédric Ollivier1-1/+1
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: Ia728415207f8ecb5b5ac55982f82337c45671c4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Bypass NoneType errors when creating routerCédric Ollivier1-2/+2
It converts private subnet name to str as it's mandary till [1]. It could be reverted as soon as [2] is merged in snaps. [1] https://gerrit.opnfv.org/gerrit/#/c/56091/ [2] https://gerrit.opnfv.org/gerrit/#/c/56171/ Change-Id: I849944fa9d4d2be21fe1a37b76c4cfd231b6d56f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-21Add timeouts in juju_epcCédric Ollivier1-11/+19
juju_epc still hangs if OpenStack isn't well deployed [1]. As releng doesn't publish logs if the job is aborted, timeout has to be added mostly everywhere. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/31/console Change-Id: I0296cd811bda0234aab98f184b3ab247a5b32017 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-20Fix image paths in cloudify_ims_perf.yamlCédric Ollivier1-2/+2
Change-Id: If58b5f2021df8a0de672a30459b5b0b12f3fcef2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Merge "Introduce Rally scenarios for Gnocchi"Cedric Ollivier4-1/+278
2018-04-19Use timeout to wrap juju-waitCédric Ollivier1-2/+4
It allows getting logs as releng doesn't push them if global timeout. Change-Id: I4bbb3818feff37d29b4ccd586f3e940380feef2e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-19Introduce Rally scenarios for GnocchiJuha Kosonen4-1/+278
Added scenarios for testing: - capabilities - status - archive policy - archive policy rule - resource - resource type - metric Change-Id: I79f4f0b2bd4d206588ea3edbce8037d1cb993646 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-18Check app workload in juju_epcCédric Ollivier1-16/+16
It avoids interpreting rsync errors in case of deployment failures. Mysql is still unchecked. Change-Id: I01b4470b86637d0fc322c422f05240a928305158 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Get debug data before cleaning juju_epcCédric Ollivier1-0/+6
It could help us to detect the issue when testing Apex (nosdn). It should be only printed on exceptions instead but this proposal is safer and straightforward. Change-Id: I2cccc737e3b3572af72c2653bf32bc02f9ab9077 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-17Set scp debug flag in juju_epcCédric Ollivier1-3/+3
Change-Id: Ic57d05416ac7c8bc459363ea479237101c22f27e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-14Print the stack traceback when cleaning juju_epcCédric Ollivier1-2/+1
Change-Id: If32557a4384cafd67b7c294f8c0592ee2769b1a5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Install new neutron-tempest-pluginCédric Ollivier1-1/+1
Change-Id: Id43e7cd5efa4a78397238bf27ef7e6b476704557 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Merge "Fix role processing in Patrole"Cedric Ollivier3-16/+19
2018-04-13Merge "Pass kwargs in TempestCommon:configure()"Cedric Ollivier1-1/+1
2018-04-13Update regex to get verification_idCédric Ollivier1-6/+4
Rally changes the sentence which our testcase was unable to parse. Change-Id: I9bab3109adc37d349c6fbec73cea9052d09cedb1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-13Switch to stestrCédric Ollivier1-1/+1
It also updates rally and installs rally-openstack. It completes the update to OpenStack Queens. Change-Id: Iabf436ac6e7facfa21a3d7c8a3dfaffa9142da98 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Print the stack traceback when cleaningCédric Ollivier2-4/+3
Change-Id: I8279844f0e42378b4fe550696608054cd7418a12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Fix role processing in PatroleCédric Ollivier3-16/+19
Role has to be listed in tempest.conf before calling testr. It also saves the right config file. Change-Id: Ifd122f31d0bfe3e9b3f93c6d62526acce96953d3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-12Pass kwargs in TempestCommon:configure()Cédric Ollivier1-1/+1
It's required by Patrole. Change-Id: I07eb6f05b4776c3f9929b6f08c5cbfa131e09d8e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-11Precise vyos_vrouter logsCédric Ollivier2-4/+6
Aborting was written even if it worked after rebooting the vm [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/41/console Change-Id: Idb29624b8793df5d77d401b375aa3b3176778ddf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-11Take all cmd status into account in juju_epcCédric Ollivier1-67/+88
It also puts output in functest.log instead of /dev/stdout. Change-Id: I3a4b5f81edd20a529821c5a684b3ab269b7c6796 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-11Leverage on SDN_CONTROLLER_IP if fuelCédric Ollivier1-7/+1
It conforms with [1]. [1] https://jira.opnfv.org/browse/FUEL-352 Change-Id: Idae142de8de09203509c73c35c2e7fea5a5d880b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-11Remove obsolete apex processing in juju_epcCédric Ollivier1-18/+5
It has been useless since [1] was merged [1] https://jira.opnfv.org/browse/APEX-570 Change-Id: Id89b75d8cad9e180a02189450e13fa1e61b1239c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-04-09Merge "[fuel] Unite OpenDaylight ports"Cedric Ollivier1-1/+1
2018-04-09[fuel] Unite OpenDaylight portsMichael Polenchuk1-1/+1
ODL Oxygen has only 1 connector by default, so unite web and rest ports together. Change-Id: Idd5bdd5da3dcc85fa25b82ab2d19107b2d005974 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2018-04-09Remove Ceilometer test scenariosJuha Kosonen5-763/+1
The API utilized by Rally in Ceilometer scenarios was deprecated in OpenStack Pike and scenarios were blacklisted. Remove these scenarios from respository. JIRA: FUNCTEST-949 Change-Id: I6f100cdb18853d177fd88ea7bd539f9837914f25 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-04-02Control vping cleanup step via --nocleanLinda Wang3-46/+40
Change-Id: Ic43b100348e77fd96aab9abc5a9ec4a0b47a2f87 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-20Stop redirecting dnsmasq messagesCédric Ollivier1-1/+1
Else dnsmasq is defunct: "dnsmasq: junk found in command line". It partially reverts "Mute log in vnfs" [1] from the time being to allow gating. [1] https://gerrit.opnfv.org/gerrit/#/c/54043/ Change-Id: I660904b9e542f776f554562df2808db751cb9d2e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-20Merge "Put TestResults.json in the right dir"Linda Wang1-7/+3
2018-03-20Merge "Remove unused code in vyos_vrouter"Linda Wang1-6/+1
2018-03-20Merge "Update the details of tempest results"Cedric Ollivier1-4/+6
2018-03-20Update the details of tempest resultsLinda Wang1-4/+6
Change-Id: Idb18c7784e44030a48208ea64c21cde2536a3387 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-03-19Put TestResults.json in the right dirCédric Ollivier1-7/+3
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/26/console Change-Id: Icfdc0030d517b1885a94c2815aeb35257fdfd590 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Remove unused code in vyos_vrouterCédric Ollivier1-6/+1
Change-Id: I0fcfa886bfb5133d5e4b3face1e649e4cf8b9fc0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-19Conform with vyos descritor updatesCédric Ollivier1-0/+4
The new inputs [1] must be set else the testcase simply fails [2]. JIRA: FUNCTEST-936 [1] https://github.com/oolorg/opnfv-vnf-vyos-blueprint/commit/794f8a0594ed4c461c7d1d08d6b0ef9fb12004e2 [2] https://build.opnfv.org/ci/view/functest/job/functest-daisy-baremetal-daily-master/12/console Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I1113581feac7d4dc901ba197caed4fddd5994929
2018-03-18Allow exceptions when deleting a missing verifierCédric Ollivier1-2/+5
Change-Id: I2e48bdcf9bce872a4a7855f9f6cd05d2b4897244 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute log in vnfsCédric Ollivier2-19/+23
It also configures the nameserver when creating the subnet in juju_epc. Change-Id: I163ba99cd56f44ca3c3464398e182152b3ab74dd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Refactor refstack to limit instructionsCédric Ollivier1-24/+8
Change-Id: I3cd490d18898d0ee6f48e4c19d7ed65c0cf0c275 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-03-17Mute all rally messagesCédric Ollivier2-39/+36
The are now printed in functest.log only. JIRA: FUNCTEST-950 Change-Id: I1fdd0e0f1be19fc5e7536326acb6a66645610696 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>