aboutsummaryrefslogtreecommitdiffstats
path: root/testcases
AgeCommit message (Collapse)AuthorFilesLines
2016-08-02use configured success_rate to check tempest test statusSerenaFeng1-21/+7
when checking tempest test results using success_rate configured in testcases.yaml rather than written it in the code JIRA: FUNCTEST-400 Change-Id: I2a34e3e032a0d94c6a4605fcf09a66c8f8f9b78c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-01Fix missing directory when calling bgpvpn testsjose.lausuch1-2/+2
Change-Id: Ic9f6b9592202c3bed9d6835eeea7c14971e1c01f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-08-01Merge "Several bug fixes in ODL-SFC functest testcase"Jose Lausuch2-19/+23
2016-08-01Several bug fixes in ODL-SFC functest testcaseManuel Buil2-19/+23
JIRA: SFC-42 - SSH options added so that the ssh key is not needed - IPTABLES change done before contacting nova, neutron... - Fix a problem in the CI test (we need to CD the BASEDIR) Change-Id: Id63c02a614bf31e5a33637c2bf95270bd1399ff8 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-31modfied to mute object storage test on joid.Narinder Gupta1-0/+23
In case of joid we implement ceph-radosgw for object storage which creates swift api for object storage. Manually i can verify we can upload the object. But functest is failing other installer removed the API but we need in JOID for juju based deployment on Openstack. So this patch will mute the object storage test cases for functest. Change-Id: I21d2bdc665a9589630cfcacb278cfb65a1c15f11 Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com>
2016-07-30Add onos_sfc scenariowuwenbin22-7/+22
JIRA:ONOSFW-172 Change-Id: I019edf79f8d343f794aa7af151d8e30c18e2c5f6 Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-29Return with exit code in Doctor testcaseCarlos Goncalves1-0/+4
JIRA: DOCTOR-63 Change-Id: Ib142a6102a705ee571081651c650ced05f7d5d4f Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-07-29Return with exit code in Promise testcaseCarlos Goncalves1-0/+4
JIRA: PROMISE-77 Change-Id: Ie856d7b58f72a253abf4b446e33f3c98d06c50c1 Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-07-29Return -1 in Rally if the success criteria is not metMarkus Kullberg1-1/+7
JIRA: FUNCTEST-382 Change-Id: Iaf475ecd3dbfcf6fb639ff146fe96e54c5393a1e Signed-off-by: Markus Kullberg <markus.kullberg@nokia.com>
2016-07-29Merge "Select test cases in tempest to be blacklisted per each scenario"jose.lausuch2-4/+39
2016-07-29correct rally criteria checkSerenaFeng1-12/+3
add method check_success_rate() to unify criteria check by success_rate JIRA: FUNCTEST-398 Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-29unify test results logger and apply to parserSerenaFeng1-17/+10
refine a unified method to log the test results and use it to parser. JIRA: FUNCTEST-397 Change-Id: I5ed6b04107be5590b1d9d5683c8f1846fef5a4d4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch2-4/+39
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Bug fix of the CI script in the ODL-SFC test caseManuel Buil2-4/+4
Change-Id: Id3db14d1f26a7dd75cdaaf4d7ca0f54268a89faf Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-28Scripts added to enable the SFC-ODL test in CIManuel Buil2-0/+41
We need to install Tacker in the server before running the test cases Change-Id: Id7daee80627bc71c335fcb3efa5d389594641b65 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-28Add configure options for healthcheckCiprian Barbu1-3/+39
The healthcheck tier used hard-coded x86 image for testing glance and nova. This breaks functest for ARM based pods, because x86 instances cannot run on ARM and even more, if healthcheck fails no other testcases are executed. Change-Id: I8a4cc754569a26d98bff57470574ed28eebbf2da Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-07-28Functional testing for tosca2heat translationSerenaFeng1-0/+86
in Dockerfile, add parser related work in config_functest.yaml/testcase.yaml, add parser related configuration in exec_test.sh to run parser test add vnf/RNC/parser.py script JIRA: FUNCTEST-187 Change-Id: I8b53774da00f13b630ec5d9f750817db892a82bb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Add endpoint type support on functestboucherv4-24/+29
By default public endpoint was used but now you can use internal or admin JIRA: FUNCTEST-387 Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-28logger the push result of rally testSerenaFeng1-1/+1
JIRA: FUNCTEST-393 Change-Id: I94158531739e1e05c694a785a8bbca7f80684af5 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Merge "[bugfix] issures in multisite testcase"meimei1-5/+2
2016-07-27Fix the proper version output for kingbird.Dimitri Mazmanov1-1/+1
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2016-07-27Return -1 in Tempest if the success criteria is not passed.jose.lausuch1-17/+40
JIRA: FUNCTEST-381 Change-Id: I533bb50e26a3b97da9fd3bfa007f8ac7ce752a5b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Return -1 if copper test failsjose.lausuch1-4/+9
Change-Id: Ib66d1b69c73603bab33950ca2c0fca3f07eb3d22 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27[bugfix] issures in multisite testcasemeimei1-5/+2
Change-Id: I351311688742c04c2c2b7278015e221178267fda Signed-off-by: meimei <meimei@huawei.com>
2016-07-27substitue misused variable 'total_success' with 'success_rate'SerenaFeng1-5/+5
JIRA: FUNCTEST-390 Change-Id: I35a2f72016573fc9e0a8403e436d5568937c5b14 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26delete useless stop_time initialization in run_rally-cert.pySerenaFeng1-2/+0
stop_time is assigned twice, delete the first one JIRA:FUNCTEST-384 Change-Id: I380113474e66a73c516f4411d8d7c5832e33921a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26Bug fix for ODL-SFC testcaseManuel Buil1-0/+19
The vxlan_tool was sometimes not started properly in the SFs. Now we check that the process is started Change-Id: I8b88b76ba30755a1ed339f9e4c374d43e5e0b422 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-26Bad status on rally_sanitySerenaFeng1-1/+1
format total_success to float when compared with numeric 90 JIRA: FUNCTEST-365 Change-Id: I473582053c107bb026bf0e8d76dab46b2e5e3eb6 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-25Bug fix for SFC test caseManuel Buil2-8/+7
The path is fixed in the sfc_tacker script, some minor bug fixes in sfc.py are made and the "FAILED" messages are not handled by log.error instead of debug Change-Id: I2facbd985c1c0c0cac3865504b1bf65940b7ce50 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-21Add cd to test directoryblsaws1-1/+2
JIRA: COPPER-4 Fix pendantic formatting issue Change-Id: Iaab44a990fc04addd4c66dc8432bc9428bb5a52f Signed-off-by: blsaws <bryan.sullivan@att.com>
2016-07-20Bugfix: ODL report to DB failsjose.lausuch1-6/+10
JIRA: FUNCTEST-370 Change-Id: I48c8927f3490b86fcf1c95656324429b70201653 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-20Merge "Add kingbird endpoint information to functest."Jose Lausuch1-7/+52
2016-07-20Remove logger as input parameter of functions in openstack_utilsjose.lausuch8-93/+93
JIRA: FUNCTEST-376 Also some fixes to get rid of flake8 violations in onos-sfc Change-Id: I52c2fd30a6b81af20ea779db2d73b9386524f7ce Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-20Add kingbird endpoint information to functest.Dimitri Mazmanov1-7/+52
The patch multihops to the fuel node and dynamically retrieves kingbird endpoint information. It also resolves the controller ip instead of using the hardcoded value from the config ONLY if the installer type is Fuel. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: I5161df5df3da7283f6374efa6bd1108246c1095a
2016-07-19Merge "Show real time tempest test execution"jose.lausuch1-4/+21
2016-07-19Show real time tempest test executionjose.lausuch1-4/+21
JIRA: FUNCTEST-375 Change-Id: I4f0cb68639b927f2980389d9331ec260605c8caf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-19Catch timeout exception in vIMSboucherv1-4/+12
JIRA: FUNCTEST-368 Change-Id: Ifeec4b89e9a05ee02d5a0829ee787dbd6ef528b2 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-19Exit with -1 return code if something fails in vping testsjose.lausuch2-15/+15
Also, turn off debug info from paramiko python module in vping_ssh JIRA: FUNCTEST-373 JIRA: FUNCTEST-374 Change-Id: I6168cae85db91b2dd6ceac591f12dd9295786b59 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-19Extend timeout to check vm in onos-sfc testcasewuwenbin21-2/+2
Change-Id: I68ae154391d8098cab3d3cb05cebe6f1922ca701 Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-15Fixed typo in config.ini for reports.htmlLuke Hinds1-2/+2
JIRA: FUNCTEST-359 Change-Id: Ide565cea987592446a44b168bd4cff0285864192 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-07-15Add functest logger in ODL scriptjose.lausuch1-9/+20
JIRA: FUNCTEST-367 Change-Id: I3a752ca78d274ca8c16f6179534d36f12facc202 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Push sfc result into DBwuwenbin22-4/+51
Change-Id: I8ab9b5b9322fa3a6905c629e559aa78d9817958f Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-15Disable ODL test.jose.lausuch3-3/+3
It triggers a lot of errors. See log in the JIRA ticket: JIRA: FUNCTEST-371 Change-Id: Ia039d36773158850f7746ae6d3a2a65fb350e382 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Enable domino multi-node test case in FunctestUlas Kozat1-0/+83
This includes: - Add domino.py script - Add call to domino.py - Add the Domino repo in the Dockerfile - Add the test case definition in testcases.yaml JIRA: FUNCTEST-246 Change-Id: I5a8c3345a14c43fa80e6e86678ae5fb1417b3147 Signed-off-by: Ulas Kozat <ulas.kozat@gmail.com>
2016-07-14Enable new SDNVPN test cases in Functestjose.lausuch1-123/+0
JIRA:FUNCTEST-99 The tempest execution has been moved to the sdnvpn to leverage the logic of execution and collecting the results from the executor wrapper: sdnvpn/test/functest/run_tests.py Change-Id: Ic4763f4ab45dde81f91b241ae91073b9ea47e333 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Use common way to get the openstack clientsjose.lausuch4-166/+119
Instead of repeating the code in all the scripts and importing the openstack libraries, the clients shall be given by openstack utils, which is its purpose JIRA: FUNCTEST-163 Change-Id: I1ccc05a3af44ee1ab5938ea9e4e01dbe55f4816d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14[multisite] integrate kingbird tempest testcasesmeimei1-1/+43
JIRA: FUNCTEST-179 Change-Id: I4a8ae43e2814b3d859c32a6278671f87155aa855 Signed-off-by: meimei <meimei@huawei.com>
2016-07-13Improve timeout management with pythonboucherv1-4/+5
JIRA: FUNCTEST-368 Change-Id: I9f7a6adc807c63694fc5d9fb8a81ad1d2d9d3225 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-13Propose a new python file to launch ODL testingCédric Ollivier3-103/+116
OpenDaylightTesting.py safely replaces start_tests.sh. It also adds the report of the basic test of RESTConf which was previously ignored. JIRA: FUNCTEST-367 Change-Id: I8ba288271455fd9f31cf87aa65bf45cfb53cd8d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-13Enhance ips, ports and creds managementCédric Ollivier1-8/+19
It follows the next ODL patch [1] which splits Keystone and Neutron IPs in Robotframework files. It also adds ODL creds, ODL ports and tenant name as inputs. Classical default values are also used now. [1] https://git.opendaylight.org/gerrit/#/c/41554/ Change-Id: I867f1d4c003c4b96a5d4c3e2f982b5a0e3139217 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>