aboutsummaryrefslogtreecommitdiffstats
path: root/testcases
AgeCommit message (Collapse)AuthorFilesLines
2016-04-22Fix regex to exclude vPing_ssh and vIMS for scenario dealing with bgpvpnMorgan Richomme1-2/+2
previous regex was excluding most of the scenario Change-Id: I7dd9e2b3a844eab232a2b44af382202fca2253ca Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-22Affect version field in results for all the testcasesMorgan Richomme10-13/+24
Previously version was scenario JIRA: FUNCTEST-225 Change-Id: Ia86f83dbe98ad5f9dbced60c46e57f58eccba7e9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-22Enable PYTHONPATH env variable inside the containerjose.lausuch12-62/+53
JIRA: FUNCTEST-224 Change-Id: Ib10dc312a761b06fe36174c5c19a0165f746593e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-21Remove cleanup from vPing scripts, and use the existing cleanup scriptjose.lausuch2-185/+0
JIRA: FUNCTEST-215 Change-Id: I1ec494097a9b70de142da9f90136256535af5100 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-21Fix Flake8 Violations in the Functest scriptsjose.lausuch24-662/+828
JIRA: FUNCTEST-213 Change-Id: I66c02dd6ff12ffb9798ebe44a4cfe7bfc73e76c3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-20Print openstack info only if CI_DEBUG==truejose.lausuch1-17/+18
JIRA: FUNCTEST-205 Change-Id: I550d26ba1fddcedf5697dadd38a85148ecef2d44 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-20Remove RALLY_REPO in config_functest since it is not usedjose.lausuch1-1/+0
Change-Id: Ifb3b338543b4ce3b961564a6e9cb1e943634af3d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-18Merge "Author: Luke Hinds <lhinds@redhat.com> Date: Mon 18 Apr 11:48:27 ↵Morgan Richomme3-0/+349
2016 +0100"
2016-04-18Merge "Generating test lists for tempest"Morgan Richomme4-251/+160
2016-04-18Remove all the repo handling in prepare_envjose.lausuch1-19/+0
JIRA: FUNCTEST-203 Since almost all the repos always pull from master and latest, this is about saving some time and to avoid needing internet to pull or checkout the repos. The needed repos content has to be present in the docker image. Change-Id: Ia6e1ed2b5d5b2aff8661a38eb64a081cc8016019 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-18Allow rally to use existing glance imageCiprian Barbu1-4/+7
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: Ia79f519d10fc9155ab2fb44a3e427ae3bb1ce399 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-18Author: Luke Hinds <lhinds@redhat.com>lukehinds3-0/+349
Date: Mon 18 Apr 11:48:27 2016 +0100 JIRA: FUNCTEST-169 Inital commit of security test code The following code peforms NFVi based SCAP security scans. This code is still pending integration with functest scripts, for when flashtest development is complete. Amend: Removed pyc file, requirements.txt and fixed flake8 Change-Id: Ie182ae5c21d36218f5c9b389c4b6e63ecbf1d151 Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-04-18Generating test lists for tempestvitikkan4-251/+160
'testr list-tests' command is now used for generating smoke and full test case lists for tempest. test_list.txt file is replaced by defcore_req.txt file which contains latest (2016.01) DefCore test case for possible references. Partly implements JIRA: FUNCTEST-196 Change-Id: I993aa8a3919b97d50f081725ced686dbe6ffc4b7 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-18Add healthcheck test case to test_exec_priorityjose.lausuch1-10/+11
JIRA: FUNCTEST-199 Change-Id: I7ced0a78a93387d94709501fbbaba1c67c93c1cb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-15[BGPVPN] Exclude vims and vping_ssh from testlistNikolas Hermanns1-1/+2
Since vims and vping_ssh are meant to fail for bgpvpn scenario we will exclude them from testlist. Change-Id: Id9da6fdd3d9a1d7c1fb5c7fb1379c13720af34af
2016-04-15Revert "[BGPVPN] Rally create the v-env which is needed"Nikolas Hermanns1-1/+2
This reverts commit 07beceb07f8cf8d6e86d2c188b3ad81688a9827f. Change-Id: I22c9e3726abee28db3fa311aae8e273e8b353402
2016-04-15[BGPVPN] Rally create the v-env which is neededNikolas Hermanns1-2/+1
Since we rely on the v-env which is created by rally we run bgpvpn testcases after rally. Change-Id: Ie54e3332c9130dc337303855a4b5c36df4e3d1fb
2016-04-15Adding Apex able to run BGPVPN testsNikolas Hermanns1-1/+1
Change-Id: Ia346f5843fc4a1242c9a60f4dbe07e54c4920f46
2016-04-14Add healthcheck test case to config_functest.yamljose.lausuch1-0/+1
JIRA: FUNCTEST-199 Change-Id: I82fa45eafd078490162e275877673e263479bb8f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-14Create health check test casejose.lausuch2-117/+170
JIRA: FUNCTEST-199 Change-Id: Iee40f182cdbe848d0f87619b7dd06fbce34d0440 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-13Lack of Internet connectivity is not treated as fatalvitikkan1-2/+1
Implements partly JIRA: FUNCTEST-195 Change-Id: Iacf9216bb549109e07a6cbc9b68c863f17736df4 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-12Remove unused Rally scenarios and run scriptJuha Kosonen16-2851/+3
run_rally.py is longer in use, it has been replaced with run_rally-cert.py already earlier. JIRA: FUNCTEST-191 Change-Id: I81b5060ed9a30e758afe75321052f120e9cf7389 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-11Merge "Split functest_utils.py into 2 scripts"jose.lausuch12-938/+958
2016-04-11[BGPVPN] Remove odl-vpnservice test casesNikolas Hermanns1-5/+0
The odl-vpnservice test cases are meant to be tested in the mini-net setup. We would need to change our enviroment under test to include mini-net to be able to run this tests. Since this is not wanted we remove the test cases. Change-Id: Ic916e1e89d54fea78371bc566d8428141949e412
2016-04-11Split functest_utils.py into 2 scriptsjose.lausuch12-938/+958
JIRA: FUNCTEST-186 All the openstack related functions are in openstack_utils.py and the remaining functions in functest_utils.py All the scripts are adapted to this structure. Change-Id: I7f3805779741f0b085985d0d053feb429250b1ea Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-05Allow vping to use existing glance imageCiprian Barbu3-12/+17
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: I3bc16eab592b9ad629693c402466755b6fa6db8a Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-01bugfix single quoteboucherv1-3/+2
Change-Id: I3391b9a3d0dd84402b7d2b588b9611a8035966d7
2016-04-01Bugfix result criteriaboucherv1-2/+2
Change-Id: I5f5f7b88f1b42d2cecd0444339ee117da61ac2a1 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-03-22Add status when pushing Tempest resultsMorgan Richomme1-34/+49
Change-Id: Ie4ad96d9c580370ae9f451ea440a71cf7a6fb841 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-22ONOS can now support vPing_userdata testcase, remove the exception in the ↵Morgan Richomme1-1/+0
config for CI Change-Id: I80828e431ad879bff0d44d476d6a076520ee8132 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-22Try configdrive in vping userdata test casecarey.xu1-0/+2
JIRA: FUNCTEST-158 Change-Id: Ic4205a4a7d125bc2b160403daf5e577d6d29c34f Signed-off-by: carey.xu <carey.xuhan@huawei.com>
2016-03-21improve status criteriaboucherv1-4/+5
Change-Id: Icfab7ead860d96cef119cc63e9fccfd9d62c009d Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-03-18Fix support for CACERT and set OS_INSECURE=truejose.lausuch1-5/+8
JIRA: FUNCTEST-145 Change-Id: If8fce037117d7c7d16d08a558d0675cbfe5f9836 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-18Add criteria and version when pushing the results into test DBMorgan Richomme9-165/+258
JIRA: FUNCTEST-151 Change-Id: Iac36f28db5f2203d7b2977a2bb973534fe167bac Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-15Add exception handling for output processingJuha Kosonen1-2/+9
Handle the exception if parsed result in report cannot be converted to a numeric value. JIRA: FUNCTEST-149 Change-Id: Ibb259abdaa800761ee8dd2270c6bc2529081242d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-03-12Test numbers creation before starting the signal testboucherv1-8/+43
Change-Id: Ife6a21e0dc3b12d1efd7aeb398b1ca0b85458a42 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-03-11A non default argument cannot be placed before a default one.jose.lausuch1-1/+1
This is blocking the execution of functest from jenkins Change-Id: I880b455016ae716db234fd118c8456829fec9861 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-10Have vIMS and Promise packages pre installed in the docker image.jose.lausuch1-39/+0
Also, change to master in Functest repo. JIRA: FUNCTEST-148 Change-Id: Ie4f3991adde9296fe86d4bedd4a9ca5e8aea33b3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-04Merge "Add support for SSL endpoints in Functest"Morgan Richomme1-0/+6
2016-03-04Add support for SSL endpoints in Functestjose.lausuch1-0/+6
JIRA: FUNCTEST-145 Change-Id: I051f1b71fda251e57d70f147433b9f038d30e7f9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-04Rally and Tempest pre-installed in the Docker image.jose.lausuch3-12/+6
Also, upgrade Rally to version 0.3.1 JIRA: FUNCTEST-147 Change-Id: I6aa15a7c282462058b7786c7dc7174d48c905d3a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-24Add jenkins build tag for result apiboucherv9-21/+42
Ex: jenkins-functest-compass-intel-pod8-daily-master-19 this will bring together all tests passed on the same functest run JIRA: FUNCTEST-140 Change-Id: I3c1cd8137184509ee5fdeeb2df5399d4c71e3f67 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-02-23remove "print" in tempest to avoid having a message "None" in the outputjose.lausuch1-1/+1
Change-Id: If2008fa7ed1bce1b5acc40cad82c21afa55ec4e5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-22Add git support for Doctor repo in config_functest.yamljose.lausuch1-0/+2
Change-Id: I10ad0dc6cd6697a2a93f5e11edcdd69f70f86c5f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-19Fix message outputs taken from the console log in vPing_sshjose.lausuch1-4/+18
Change-Id: Id169167d90d60b8266913a8451699969abb4ef7c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-18Remove network failed message check form vping_sshjose.lausuch1-2/+1
Change-Id: I72d97af3ddd76f698ce54918cf92f98c8f5a7fd4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-17Release floating ip after vPing_ssh testjose.lausuch2-37/+37
Also, check the console to see if the instance fails when sending the discover to the dhcp agent Change-Id: I314051886b9580a42bb88f2d88a9bdbf2a9e198a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-16Create vPing_userdata instances with dynamic ports created by nova/neutronjose.lausuch3-110/+115
Change-Id: I1808763f6ccf1ac90b8a696c48ecdfba03d782fb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-16Create vPing instances with dynamic ports created by nova/neutronjose.lausuch2-147/+146
Also, - check if the used network is already created to not create it again - check if the image already exists to not create it again - check if the sec group already exists to not create it again Change-Id: I243619a1538444d836fdda84a86b834668aaf456 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-12Rally live migration case selectionJuha Kosonen3-44/+61
Execute live migration cases only if the feature is enabled in Tempest configuration file. Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>