aboutsummaryrefslogtreecommitdiffstats
path: root/testcases
AgeCommit message (Collapse)AuthorFilesLines
2016-05-26Use flavor name instead of flavor idCédric Ollivier1-4/+4
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Added 60 sec delay before launching instances in healthcheckvitikkan1-0/+5
This delay should be removed after resolving Jira case APEX-149. The purpose is to give some time to populate openflow rules by SDN controller in case of odl_l2 scenario. Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-20Push bgpvpn_api results into Test DBMorgan Richomme1-5/+60
JIRA: FUNCTEST-234 Change-Id: I0494043bff6a37dc94724dfee1a718a1ab9fbcf3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Fix path for vping.sh and exit if SCP failsjose.lausuch1-1/+3
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-17Change 'testcases' directory structurejose.lausuch57-8/+8
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-16BGPVPN test case refactoredvitikkan2-16/+59
BGPVPN test case is refactored and moved into bgpvpn.py module. JIRA: FUNCTEST-234 Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-13Added handling of blacklist for tempestvitikkan1-39/+72
It is now possible to exclude some specific test cases ("black list") from the test case suites. JIRA: FUNCTEST-197 Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Removed obsolete modulesvitikkan2-122/+0
testcases/VIM/OpenStack/CI/libraries/check_os.sh testcases/VIM/OpenStack/CI/libraries/os_defaults.yaml Change-Id: I835bfbdc9aa43903ca2ad6041a38216fd68263a5 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Split tempest into smoke and full modesvitikkan1-1/+1
"tempest_smoke_serial" and "tempest_full_parallel" test cases replace the original "tempest" case. Corrected fetching tempest results from "rally verify list" output (last result is taken instead of the first one). This correction is needed when "rally verify start" is run multiple times. JIRA: FUNCTEST-242 Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-10Create a private shared network for RallyJuha Kosonen1-4/+27
Since functest-net will be obsolete, own private network, subnet and router is created for Rally tests. JIRA: FUNCTEST-240 Change-Id: I8a30e2b4fe12238dba526c21188c85f75bacc0b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Creating private network for Tempestvitikkan1-34/+25
Since functest-net will be obsolete, own private network, subnet and router is taken into use for Tempest test. JIRA: FUNCTEST-239 Change-Id: I2b9f6aae74dc36decf305a4531fe0a071031aca3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-09Generic Function to create a private networkjose.lausuch3-131/+39
This is to be used by all the tests which need a private network to work, for example Tempest, Rally, vPing, ssh.. Added example for vPing and promise scripts. Change-Id: I5d79e7b60b81b0f34230ea3ef2f3076697a1958c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-05Fix bug config_functest.yaml locationjose.lausuch2-2/+3
Change-Id: I3b28eb7015f6f1418ef04ca91103e313f71f74e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor, add logger handler to collect all the logs to a file as welljose.lausuch2-121/+25
JIRA: FUNCTEST-190 Also: - remove old code that are not used any more - improve execute_command function - fix logger output for run_tempest Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch12-612/+77
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-29Execute successive scenarios after task failureJuha Kosonen1-2/+20
Log the result of task validation and proceed executing next rally scenario when the current task start-up fails. JIRA: FUNCTEST-230 Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-27Replace all the loggers by the functest logger modulejose.lausuch8-147/+47
JIRA: FUNCTEST-228 Change-Id: If7a3c8cb08e9fbdf155fc5eff5330f79e5f8d234 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-27Create prepare_env.py from prepare_env.sh and config_functest.pyjose.lausuch3-672/+2
JIRA: FUNCTEST-227 Change-Id: I1aa890b9f91ec524c766ba3c460666ed227f2126 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Move functest_utils and openstack_utils to directory /utilsjose.lausuch12-1102/+22
JIRA: FUNCTEST-226 Change-Id: I74d09f6322844b25ab45a02156317ae76ab40d8a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Corrected logging.Formatter parametersvitikkan1-2/+2
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-25Remove backslashs for line continuationCédric Ollivier17-334/+313
JIRA: FUNCTEST-213 Change-Id: Ia50521cf8fcf60a847aa44fe0ea59b6e64830e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-04-25ConfigParser is used for tempest.conf updatingvitikkan1-19/+10
Bash commands are replaced with python's ConfigParser routines for configuration file reading/updating. Removed updating of ssh_user_regex parameter since it is now into upstream Rally code. JIRA: FUNCTEST-198 Change-Id: I95f926948a395993e28e993bf7ea2872d6b5c969 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-22Merge "Introduce a sanity test mode for Rally test"Morgan Richomme5-206/+251
2016-04-22Introduce a sanity test mode for Rally testJuha Kosonen5-206/+251
In a sanity test mode the number of iterations is reduced and only a subset of tests is executed. JIRA: FUNCTEST-220 Change-Id: I722f12b8cc6df29bfcb81b8798d8d0802b207d94 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-22Fix regex to exclude vPing_ssh and vIMS for scenario dealing with bgpvpnMorgan Richomme1-2/+2
previous regex was excluding most of the scenario Change-Id: I7dd9e2b3a844eab232a2b44af382202fca2253ca Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-22Affect version field in results for all the testcasesMorgan Richomme10-13/+24
Previously version was scenario JIRA: FUNCTEST-225 Change-Id: Ia86f83dbe98ad5f9dbced60c46e57f58eccba7e9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-22Enable PYTHONPATH env variable inside the containerjose.lausuch12-62/+53
JIRA: FUNCTEST-224 Change-Id: Ib10dc312a761b06fe36174c5c19a0165f746593e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-21Remove cleanup from vPing scripts, and use the existing cleanup scriptjose.lausuch2-185/+0
JIRA: FUNCTEST-215 Change-Id: I1ec494097a9b70de142da9f90136256535af5100 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-21Fix Flake8 Violations in the Functest scriptsjose.lausuch24-662/+828
JIRA: FUNCTEST-213 Change-Id: I66c02dd6ff12ffb9798ebe44a4cfe7bfc73e76c3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-20Print openstack info only if CI_DEBUG==truejose.lausuch1-17/+18
JIRA: FUNCTEST-205 Change-Id: I550d26ba1fddcedf5697dadd38a85148ecef2d44 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-20Remove RALLY_REPO in config_functest since it is not usedjose.lausuch1-1/+0
Change-Id: Ifb3b338543b4ce3b961564a6e9cb1e943634af3d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-18Merge "Author: Luke Hinds <lhinds@redhat.com> Date: Mon 18 Apr 11:48:27 ↵Morgan Richomme3-0/+349
2016 +0100"
2016-04-18Merge "Generating test lists for tempest"Morgan Richomme4-251/+160
2016-04-18Remove all the repo handling in prepare_envjose.lausuch1-19/+0
JIRA: FUNCTEST-203 Since almost all the repos always pull from master and latest, this is about saving some time and to avoid needing internet to pull or checkout the repos. The needed repos content has to be present in the docker image. Change-Id: Ia6e1ed2b5d5b2aff8661a38eb64a081cc8016019 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-18Allow rally to use existing glance imageCiprian Barbu1-4/+7
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: Ia79f519d10fc9155ab2fb44a3e427ae3bb1ce399 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-18Author: Luke Hinds <lhinds@redhat.com>lukehinds3-0/+349
Date: Mon 18 Apr 11:48:27 2016 +0100 JIRA: FUNCTEST-169 Inital commit of security test code The following code peforms NFVi based SCAP security scans. This code is still pending integration with functest scripts, for when flashtest development is complete. Amend: Removed pyc file, requirements.txt and fixed flake8 Change-Id: Ie182ae5c21d36218f5c9b389c4b6e63ecbf1d151 Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-04-18Generating test lists for tempestvitikkan4-251/+160
'testr list-tests' command is now used for generating smoke and full test case lists for tempest. test_list.txt file is replaced by defcore_req.txt file which contains latest (2016.01) DefCore test case for possible references. Partly implements JIRA: FUNCTEST-196 Change-Id: I993aa8a3919b97d50f081725ced686dbe6ffc4b7 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-18Add healthcheck test case to test_exec_priorityjose.lausuch1-10/+11
JIRA: FUNCTEST-199 Change-Id: I7ced0a78a93387d94709501fbbaba1c67c93c1cb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-15[BGPVPN] Exclude vims and vping_ssh from testlistNikolas Hermanns1-1/+2
Since vims and vping_ssh are meant to fail for bgpvpn scenario we will exclude them from testlist. Change-Id: Id9da6fdd3d9a1d7c1fb5c7fb1379c13720af34af
2016-04-15Revert "[BGPVPN] Rally create the v-env which is needed"Nikolas Hermanns1-1/+2
This reverts commit 07beceb07f8cf8d6e86d2c188b3ad81688a9827f. Change-Id: I22c9e3726abee28db3fa311aae8e273e8b353402
2016-04-15[BGPVPN] Rally create the v-env which is neededNikolas Hermanns1-2/+1
Since we rely on the v-env which is created by rally we run bgpvpn testcases after rally. Change-Id: Ie54e3332c9130dc337303855a4b5c36df4e3d1fb
2016-04-15Adding Apex able to run BGPVPN testsNikolas Hermanns1-1/+1
Change-Id: Ia346f5843fc4a1242c9a60f4dbe07e54c4920f46
2016-04-14Add healthcheck test case to config_functest.yamljose.lausuch1-0/+1
JIRA: FUNCTEST-199 Change-Id: I82fa45eafd078490162e275877673e263479bb8f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-14Create health check test casejose.lausuch2-117/+170
JIRA: FUNCTEST-199 Change-Id: Iee40f182cdbe848d0f87619b7dd06fbce34d0440 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-13Lack of Internet connectivity is not treated as fatalvitikkan1-2/+1
Implements partly JIRA: FUNCTEST-195 Change-Id: Iacf9216bb549109e07a6cbc9b68c863f17736df4 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-12Remove unused Rally scenarios and run scriptJuha Kosonen16-2851/+3
run_rally.py is longer in use, it has been replaced with run_rally-cert.py already earlier. JIRA: FUNCTEST-191 Change-Id: I81b5060ed9a30e758afe75321052f120e9cf7389 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-11Merge "Split functest_utils.py into 2 scripts"jose.lausuch12-938/+958
2016-04-11[BGPVPN] Remove odl-vpnservice test casesNikolas Hermanns1-5/+0
The odl-vpnservice test cases are meant to be tested in the mini-net setup. We would need to change our enviroment under test to include mini-net to be able to run this tests. Since this is not wanted we remove the test cases. Change-Id: Ic916e1e89d54fea78371bc566d8428141949e412
2016-04-11Split functest_utils.py into 2 scriptsjose.lausuch12-938/+958
JIRA: FUNCTEST-186 All the openstack related functions are in openstack_utils.py and the remaining functions in functest_utils.py All the scripts are adapted to this structure. Change-Id: I7f3805779741f0b085985d0d053feb429250b1ea Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-05Allow vping to use existing glance imageCiprian Barbu3-12/+17
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: I3bc16eab592b9ad629693c402466755b6fa6db8a Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>