summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-07-28Add configure options for healthcheckCiprian Barbu2-4/+43
The healthcheck tier used hard-coded x86 image for testing glance and nova. This breaks functest for ARM based pods, because x86 instances cannot run on ARM and even more, if healthcheck fails no other testcases are executed. Change-Id: I8a4cc754569a26d98bff57470574ed28eebbf2da Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-07-28Add region name to OpenStack credentialsDimitri Mazmanov1-0/+4
Currently functest doesn't account for regions when it tries to instantieate OpenStack clients. As a result, the code fails when functest is used in a multi-region environment. The fix forces functest account for region name. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: Iebbd20042548c02da9d5ed7e58a454347a555778
2016-07-28Functional testing for tosca2heat translationSerenaFeng5-0/+121
in Dockerfile, add parser related work in config_functest.yaml/testcase.yaml, add parser related configuration in exec_test.sh to run parser test add vnf/RNC/parser.py script JIRA: FUNCTEST-187 Change-Id: I8b53774da00f13b630ec5d9f750817db892a82bb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Merge "Bugfix: dont stop execution when a test case is not blocking"jose.lausuch3-8/+19
2016-07-28Bugfix: dont stop execution when a test case is not blockingjose.lausuch3-8/+19
Change-Id: I3564b6f2d8f8057ec2c9753837e3a5fe16a4a866 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Add endpoint type support on functestboucherv6-32/+66
By default public endpoint was used but now you can use internal or admin JIRA: FUNCTEST-387 Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-28logger the push result of rally testSerenaFeng1-1/+1
JIRA: FUNCTEST-393 Change-Id: I94158531739e1e05c694a785a8bbca7f80684af5 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Merge "[bugfix] issures in multisite testcase"meimei1-5/+2
2016-07-27Disable security scan testsjose.lausuch1-1/+1
Change-Id: Ic6800f4b1401c44dbded160f45fdd17c706f14f8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Make openstack_clean be aware of the names and not only the IDsjose.lausuch1-8/+16
Sometimes, when using the same container for a different deployment, the IDs of the openstack resources are different but the names are the same. This will avoid cleaning for example the user 'admin' regardless of the ID it has. JIRA: FUNCTEST-383 Change-Id: If27603f8f6d0cb7ad0aeba6e3c89ca19e2b8aed2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Fix the proper version output for kingbird.Dimitri Mazmanov1-1/+1
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2016-07-27Return -1 in Tempest if the success criteria is not passed.jose.lausuch1-17/+40
JIRA: FUNCTEST-381 Change-Id: I533bb50e26a3b97da9fd3bfa007f8ac7ce752a5b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Return -1 if copper test failsjose.lausuch2-5/+9
Change-Id: Ib66d1b69c73603bab33950ca2c0fca3f07eb3d22 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27[bugfix] issures in multisite testcasemeimei1-5/+2
Change-Id: I351311688742c04c2c2b7278015e221178267fda Signed-off-by: meimei <meimei@huawei.com>
2016-07-27Enable odl-sfc in CIManuel Buil2-0/+12
JIRA:FUNCTEST-392 Change-Id: If1c931df26062501695061e1155eb26ad007c8de Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-27Bump rally to 0.5.0 and add shyamlCiprian Barbu2-2/+3
A newer version of rally brings in this change that is required by armband: https://bugs.launchpad.net/rally/+bug/1580695 The shyaml cli parser can be used to make the healthcheck testcase configurable, for instance to pass a different cirros image other than the one for x86_64. Also required by armband to make functest execute all tests. Change-Id: Ic4976bb6d4a4753e56deade35b641f1127af3162 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-07-27Merge "[bugfix] miss a argument"meimei1-1/+1
2016-07-27[bugfix] miss a argumentmeimei1-1/+1
Change-Id: Id8cdf6a5dadee6a2e0ba10772db88c84e5ce13a3 Signed-off-by: meimei <meimei@huawei.com>
2016-07-27substitue misused variable 'total_success' with 'success_rate'SerenaFeng1-5/+5
JIRA: FUNCTEST-390 Change-Id: I35a2f72016573fc9e0a8403e436d5568937c5b14 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26Generate Functest report at the end of the executionjose.lausuch2-11/+175
JIRA: FUNCTEST-89 Change-Id: I10c41efdd6a7f737f57ab15158c8c8d49f392271 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-26delete useless stop_time initialization in run_rally-cert.pySerenaFeng1-2/+0
stop_time is assigned twice, delete the first one JIRA:FUNCTEST-384 Change-Id: I380113474e66a73c516f4411d8d7c5832e33921a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26Bug fix for ODL-SFC testcaseManuel Buil1-0/+19
The vxlan_tool was sometimes not started properly in the SFs. Now we check that the process is started Change-Id: I8b88b76ba30755a1ed339f9e4c374d43e5e0b422 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-26Bad status on rally_sanitySerenaFeng1-1/+1
format total_success to float when compared with numeric 90 JIRA: FUNCTEST-365 Change-Id: I473582053c107bb026bf0e8d76dab46b2e5e3eb6 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26add .idea directory to gitignoreSerenaFeng1-0/+1
ignore .idea created by using pycharm JIRA: FUNCTEST-386 Change-Id: I425b4525ea16cafc2883f165efd2293a8adb13fb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-25Turn off vPing_ssh for odl_l3 scenarios due to odl bugjose.lausuch1-1/+1
https://bugs.opendaylight.org/show_bug.cgi?id=5586 JIRA: FUNCTEST-363 Change-Id: I4d195ae7ebbe10cfc4fe2947eecf5f0c051fd4e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-25Merge "Create a flag in the tests to indicate if they should be blocking or not"jose.lausuch4-11/+46
2016-07-25Create a flag in the tests to indicate if they should be blocking or notjose.lausuch4-11/+46
JIRA: FUNCTEST-380 Change-Id: I737d71a47ddac80bf0222a1f004af05f509c5971 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-25Bug fix for SFC test caseManuel Buil2-8/+7
The path is fixed in the sfc_tacker script, some minor bug fixes in sfc.py are made and the "FAILED" messages are not handled by log.error instead of debug Change-Id: I2facbd985c1c0c0cac3865504b1bf65940b7ce50 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-22Add duration message after test executionjose.lausuch2-2/+8
Change-Id: Ida68009ba02b2a5135dc4f3ae958fc77088389d7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-22bugfix: Don't try to run a tier if it doesn't contain any enabled testjose.lausuch1-7/+14
- Add separation (blank lines) between the test cases output JIRA: FUNCTEST-349 Change-Id: I54a5d4f33d5776b4754641168c3775d19ca50e4a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-22Fix execute_command function to show all the outputjose.lausuch1-8/+6
This function wasn't showing anything for some commands, like 'rally show images' and 'rally show flavors' JIRA: FUNCTEST-348 Change-Id: I75bf5f3504ea8ffea42c2fb237d6863c655259e1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-21Add cd to test directoryblsaws1-1/+2
JIRA: COPPER-4 Fix pendantic formatting issue Change-Id: Iaab44a990fc04addd4c66dc8432bc9428bb5a52f Signed-off-by: blsaws <bryan.sullivan@att.com>
2016-07-20Bugfix: ODL report to DB failsjose.lausuch2-15/+19
JIRA: FUNCTEST-370 Change-Id: I48c8927f3490b86fcf1c95656324429b70201653 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-20Merge "Add kingbird endpoint information to functest."Jose Lausuch2-8/+60
2016-07-20Remove logger as input parameter of functions in openstack_utilsjose.lausuch9-100/+98
JIRA: FUNCTEST-376 Also some fixes to get rid of flake8 violations in onos-sfc Change-Id: I52c2fd30a6b81af20ea779db2d73b9386524f7ce Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-20Add kingbird endpoint information to functest.Dimitri Mazmanov2-8/+60
The patch multihops to the fuel node and dynamically retrieves kingbird endpoint information. It also resolves the controller ip instead of using the hardcoded value from the config ONLY if the installer type is Fuel. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: I5161df5df3da7283f6374efa6bd1108246c1095a
2016-07-19Add logger to openstack_utils to output error messagesjose.lausuch1-92/+109
This will help to see the exception error when something fails JIRA: FUNCTEST-376 Change-Id: Ibaa6954fc63af00d552ac32b3cf903b9218200d1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-19Merge "Show real time tempest test execution"jose.lausuch2-5/+23
2016-07-19Show real time tempest test executionjose.lausuch2-5/+23
JIRA: FUNCTEST-375 Change-Id: I4f0cb68639b927f2980389d9331ec260605c8caf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-19Catch timeout exception in vIMSboucherv1-4/+12
JIRA: FUNCTEST-368 Change-Id: Ifeec4b89e9a05ee02d5a0829ee787dbd6ef528b2 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-19Exit with -1 return code if something fails in vping testsjose.lausuch2-15/+15
Also, turn off debug info from paramiko python module in vping_ssh JIRA: FUNCTEST-373 JIRA: FUNCTEST-374 Change-Id: I6168cae85db91b2dd6ceac591f12dd9295786b59 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-19Extend timeout to check vm in onos-sfc testcasewuwenbin21-2/+2
Change-Id: I68ae154391d8098cab3d3cb05cebe6f1922ca701 Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-18Don't take openstack snapshot when "-n" option is setjose.lausuch2-11/+12
JIRA: FUNCTEST-236 Change-Id: I37bfa4ebe88a8cf02f2cddc8fc4cce70ad87b775 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-18[multisite] run on the env of fuel and compassmeimei1-1/+1
Change-Id: Ie590a99e8b571af66cc2164c291dd8e9eed47e4a Signed-off-by: meimei <meimei@huawei.com>
2016-07-15Use blacklist of Tempest test cases for SDNVPN scenariojose.lausuch2-2/+15
This patch disables tempest smoke from being executed in bgpvpn scenarios. Since there is a known upstream issue which won't be resolved before Colorado, it doesn't make sense to run the test cases in Tempest that will fail due to that issue. The Tempest suite will be triggered along with the "features" tier, with a given blacklist of the known test that will fail. JIRA: FUNCTEST-369 Change-Id: Ifc533077207e9d62d49bcedcc3cd0936df312891 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Fixed typo in config.ini for reports.htmlLuke Hinds1-2/+2
JIRA: FUNCTEST-359 Change-Id: Ide565cea987592446a44b168bd4cff0285864192 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-07-15Add functest logger in ODL scriptjose.lausuch1-9/+20
JIRA: FUNCTEST-367 Change-Id: I3a752ca78d274ca8c16f6179534d36f12facc202 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Push sfc result into DBwuwenbin22-4/+51
Change-Id: I8ab9b5b9322fa3a6905c629e559aa78d9817958f Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-15Revert "Disable ODL test."Jose Lausuch1-1/+1
This reverts commit adf9811e8c0f2fa92ca1c45658a3360e1de8be7e. JIRA: FUNCTEST-371 Change-Id: I677ed08e017e2b147eec9433b050d3fa480565a2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Disable ODL test.jose.lausuch4-4/+4
It triggers a lot of errors. See log in the JIRA ticket: JIRA: FUNCTEST-371 Change-Id: Ia039d36773158850f7746ae6d3a2a65fb350e382 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>