aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2018-06-19Fix pylint errorsCédric Ollivier9-35/+32
They are highlighted by the last pylint version. Change-Id: I473212a413013492716993fb536903b13bff66ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-18Add minimal docstings in clearwater_ims_base.pyCédric Ollivier1-1/+14
It will allow forcing 10/10 in any new patchset. Change-Id: I4cc52a9fb66fdd2c0dcbf9915be262acedac8672 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-17Fix invalid method names in vnfsCédric Ollivier2-9/+8
Change-Id: Icff1a53ffd7b59d46543b79571b45872a9f243c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-17Mock os.makedirs() in test_odl.pyCédric Ollivier2-3/+7
os.makedirs() is called before calling robot.run. Change-Id: Id651428343510683cd616d8101d22a73ccbf3dad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-15Fix pylint warnings in clearwater_ims_baseCédric Ollivier1-7/+9
Change-Id: I663bd2826e43ce888990b012df27ca94e2d49a8d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-15Remove cloudify_ims_perfCédric Ollivier10-18063/+0
All that modules are uncovered, unverified and deprecated. They will be safely reverted as soon as they are updated, verified by gates and unit tests are added. Change-Id: Iac0893f9f0ccb485d91cd17305e744aff9bf9414 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-15Remove cli and apiCédric Ollivier45-2245/+0
cli has been deprecated for a while and restapi is uncovered and unverified. This patch will be partially reverted as soon as next unit tests cover functest/api. It partially updates troubleshooting docs which has to be completed in a second change [1]. [1] https://jira.opnfv.org/browse/FUNCTEST-982 Change-Id: I08e0bd212fcf5f5c5c220eb2500a6b0a6ff46df7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-14Support py3 in uncovered packagesCédric Ollivier9-31/+39
It has to be noted that cloudify_rest_client doesn't support py3 then next unit tests vs cloudify-based testcases would be excluded. Change-Id: I0b0e64929d1238665c778ce51fd6abd5ccf06b6c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-14Add py3 support in tempest and rallyCédric Ollivier6-27/+31
Change-Id: I009d38a0db409ab4ec641cba9173ab2386d0ce2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-13Merge "Abort vping_userdata test if IP address is missing"Cedric Ollivier1-0/+4
2018-06-13Abort vping_userdata test if IP address is missingJuha Kosonen1-0/+4
Do not start checking the result of ping test if the first instance has no IP address. JIRA: FUNCTEST-976 Change-Id: I2da3154e63a6a97f86efe8274be84abc437aa133 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-06-13Fix result parsing in cloudify_imsCédric Ollivier1-2/+2
The previous regex failed when errors are listed [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/194/console Change-Id: I57c8bfb8968555c3d43267a06f2bb9a2b95a3268 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-12SNAPS via functest with flavor metadata configurablePanagiotis Karalis3-13/+18
The required data for the SNAPS flavors are sent through the config_functest yaml file in order for the SNAPS scenarios to be configured accordingly. If the config_functest yaml file includes empty flavor_extra_specs or there is not included this parameter, the SNAPS scenarios will be executed using the hardcoded value. Change-Id: I4ef46d1fe93497d658414170a72c4520d8f37808 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-06-10Update cloudify-rest-client to 4.3.2Cédric Ollivier2-2/+4
Change-Id: I8ac0becb57897233c2a12781dc022d9fdfd32f85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-09Stop using a forked obsolete repoCédric Ollivier2-39/+20
It leverages on the official clearwater live test instead. It now parses the output directly. Change-Id: Ia7746c13362323daf72b3536d294401f0b7ae42f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-06Switch to Python3 divide in cloudify_imsCédric Ollivier1-0/+2
The code simply asks for python3 divide else only live_test = 100% is considered as successful [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/169/console Change-Id: I84690d20791cd3d6a68823eec40f0e4b0f876b72 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-05Switch from OS_ENDPOINT_TYPE to OS_INTERFACECédric Ollivier4-19/+16
It also set endpoint_type to public in tempest.conf if unset. JIRA: FUNCTEST-975 Change-Id: I91bd1d7171b4bcf58dbe818696d5b864d5036619 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-05Return true if at least one passed testCédric Ollivier1-1/+1
JIRA: FUNCTEST-974 Change-Id: I9915dbb91516baf5307a577c41ede5dca51a2f07 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-01Update clearwater to 129Cédric Ollivier1-1/+1
It switches to Sprint Ulmo [1] which fixes deployment issues in Orange ONAP Openlab. [1] http://www.projectclearwater.org/sprint-ulmo-release-note/ Change-Id: I3c32faf4e26e64bb12438238cf1ba66b9771da0d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-06-01Merge "Update read and write data path in cinder test"Cedric Ollivier2-13/+20
2018-05-31Update read and write data path in cinder testDelia Popescu2-13/+20
Update the path for read/write data Fix a false possitive result on read_data Fix read device name Unmount volume after writing data JIRA: FUNCTEST-908 Change-Id: I555b5a3daaeff3aa58891e65c0b70094372c04c9 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-30Fix tempest result parsingJuha Kosonen1-1/+1
Detailed results of verifier are in tempest-error.log. Change-Id: Id5dbdfd3389d1b79dba2bebc5f5ffa7811ef06c8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-05-30Bypass Cloudify's upper-constraints issuesCédric Ollivier2-2/+4
It installs cmd2 via yum instead as last cmd2 release only supports python3. Change-Id: I495d71f11ed48ba47e1aa27965675d4bef7c141e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-30Fix _do_execute() return code in vping_sshCédric Ollivier1-1/+1
Change-Id: I781e51bb56f6cdac8b347e7fd85e70c07eb69e23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-29Simplify loggingPanagiotis Karalis1-49/+3
In order to collect logs from features running through functest framework (mainly for troubleshooting purposes), the logging mechanism has been updated accordingly. It should be noted that feature logs are printed in functest.log. All logs are now printed in functest.log whatever the namespace. JIRA: SFC-125 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I6cb32e5553749023d490d553ae4653750c52e844 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-28Print vping output instead of Paramiko objectCédric Ollivier1-1/+1
Change-Id: Iddc1abdf443e482e8748434a4ba7d85709d8cd0e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-26Merge "Add cinder_test testcase"Cedric Ollivier7-0/+476
2018-05-25Add cinder_test testcaseDelia Popescu7-0/+476
Create 2 instances with Floating IPs Attach data volume to instance 1 Write data on the volume Detach volume from instance 1 Attach volume to instance 2 Read data from volume JIRA: FUNCTEST-908 Change-Id: I10efdfb3b7f9d7e6ab5c6a538052437585d52fb0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-24Set image metadata in tempestCédric Ollivier2-2/+3
It applied the same operations as [1]. Only one config is used between rally, tempest and vping. [1] https://gerrit.opnfv.org/gerrit/#/c/57613/ Change-Id: I4d5fd2117d404b7eaa79326e21a35272232d0b92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-24Bypass Cloudify tenancy issuesCédric Ollivier2-75/+91
It creates a second user to bypass possible bugs and correctly exits on failure if it cannot connect to manager via ssh. It leverages on the _member_ user as much as possible. It also switches all flavor names to avoid conflicts. It also increases debug logs. Change-Id: I59cb071248b5ae50952b9f16eb29f7be3f3644ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-23Leverage on _member_ userCédric Ollivier2-89/+86
It leverages on the _member_ user as much as possible. It also switches all flavor names to avoid conflicts. It also increases debug logs. Change-Id: Ica595b0aba81e845ddb1c858fd5d0deb69872319 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-20Merge "Refactor task results manipulation in rally"Cedric Ollivier2-75/+130
2018-05-18Refactor task results manipulation in rallyJuha Kosonen2-75/+130
Use data provided by report generation since the output of task results is not available as valid JSON if task didn't finish gracefully. JIRA: FUNCTEST-966 Change-Id: Ieb906bc209cc26055babd5f4e6b2bb556724f9a8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-05-16Merge "Fix UserConfig objects"Cedric Ollivier2-2/+2
2018-05-16Fix UserConfig objectsCédric Ollivier2-2/+2
UserConfig is expecting domain_name as arg instead of domain. Else all vnfs cannot work against non Default domains. Change-Id: I4bb53df9d9c03524b19ec32f8d346d94ba78d188 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-16Fine-tuning the juju-epc codebase for better error-handlingsoumaya1-33/+68
The changes are mostly basic/cosmetic in nature. - Add some additional info in loggers. - Remove timeout from few commands(such as juju deploy) - Add exception logging for few commands(such as juju bootstrap). - Change rsync to cp for feature file transfer within ABot. Change-Id: Ibeaae17f1c25d04b7830ed42719b70e6c99228cf Signed-off-by: soumaya <soumaya.nayek@rebaca.com>
2018-05-14Merge "Update ODL testcase to OpenStack Shade"Cedric Ollivier2-28/+132
2018-05-14Update cirros image version for ARM architectureDelia Popescu3-8/+6
Change-Id: Ia7a65a4f83798cb80ca7470d475c2c2d8c9fb6ea Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-12Update ODL testcase to OpenStack ShadeCédric Ollivier2-28/+132
Change-Id: I7832b5ed274e181449f9db9fb03a2d27038520ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-11Leverage on local descriptorCédric Ollivier1-3/+1
It simply seems dummy. Change-Id: Ifb83dd0310f523f211911a35e7b481f9da6f9704 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-11Install Cloudify descritors in functest-vnfCédric Ollivier4-20/+10
It completes [1] to fix gates [2] and stops getting thirdparty vnf master (dependencies). It also prints data to ease debugging. [1] https://github.com/Orange-OpenSource/opnfv-cloudify-clearwater/commit/abd39d772c77317a25745feaaf312165e7588346 [2] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/110/console Change-Id: Ib317a491e54820f4edb01fcecfca9d2a08b40c0f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-10Add image extra properties back in vping_baseDelia Popescu2-1/+6
Image extra properties are missing for ARM Set image_url for ARM JIRA: ARMBAND-383 Change-Id: I0e2730c3f22214ad61d72424ea76173f1783d0ca Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-05-07Merge "Switch to project domain name"Cedric Ollivier1-3/+5
2018-05-07Merge "Improve ssh timeout in vping_ssh"Cedric Ollivier1-6/+18
2018-05-07Switch to project domain nameCédric Ollivier1-3/+5
At least Fuel, Apex and Joid don't export OS_PROJECT_DOMAIN_ID. https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/353/console Change-Id: I8441d2de1841d5a9ce78c6929fd78da01c45548c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-07Merge "Make volumes appear as SCSI devices in aarch64"Cedric Ollivier1-0/+8
2018-05-07Improve ssh timeout in vping_sshCédric Ollivier1-6/+18
It seems that 10s is not enough for Fuel. Change-Id: I46d3d2c9091946befb0e056a8c8cc56c59087471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-07Simplify vping_sshCédric Ollivier6-95/+30
It directly calls ping from the ssh socket. It fixes a possible missing security rule. It stops blocking if vpings are in failure. Change-Id: I64092a155bb134fa8b7d31d0d13f695e019540d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-05-05Merge "Functest fail to parse refstack results"Cedric Ollivier1-3/+6
2018-05-05Switch to Shade in rallyJuha Kosonen2-167/+228
Use Shade for managing OpenStack resources in rally. Change-Id: Ic8b7aaef6886f6ca4930b2ea463317b75ed8d3c9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>