summaryrefslogtreecommitdiffstats
path: root/testcases/VIM/OpenStack/CI
AgeCommit message (Collapse)AuthorFilesLines
2016-05-13Added handling of blacklist for tempestvitikkan1-39/+72
It is now possible to exclude some specific test cases ("black list") from the test case suites. JIRA: FUNCTEST-197 Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Removed obsolete modulesvitikkan2-122/+0
testcases/VIM/OpenStack/CI/libraries/check_os.sh testcases/VIM/OpenStack/CI/libraries/os_defaults.yaml Change-Id: I835bfbdc9aa43903ca2ad6041a38216fd68263a5 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Split tempest into smoke and full modesvitikkan1-1/+1
"tempest_smoke_serial" and "tempest_full_parallel" test cases replace the original "tempest" case. Corrected fetching tempest results from "rally verify list" output (last result is taken instead of the first one). This correction is needed when "rally verify start" is run multiple times. JIRA: FUNCTEST-242 Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-10Create a private shared network for RallyJuha Kosonen1-4/+27
Since functest-net will be obsolete, own private network, subnet and router is created for Rally tests. JIRA: FUNCTEST-240 Change-Id: I8a30e2b4fe12238dba526c21188c85f75bacc0b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Creating private network for Tempestvitikkan1-34/+25
Since functest-net will be obsolete, own private network, subnet and router is taken into use for Tempest test. JIRA: FUNCTEST-239 Change-Id: I2b9f6aae74dc36decf305a4531fe0a071031aca3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-05Fix bug config_functest.yaml locationjose.lausuch1-0/+2
Change-Id: I3b28eb7015f6f1418ef04ca91103e313f71f74e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor, add logger handler to collect all the logs to a file as welljose.lausuch1-24/+25
JIRA: FUNCTEST-190 Also: - remove old code that are not used any more - improve execute_command function - fix logger output for run_tempest Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch3-30/+68
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-29Execute successive scenarios after task failureJuha Kosonen1-2/+20
Log the result of task validation and proceed executing next rally scenario when the current task start-up fails. JIRA: FUNCTEST-230 Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-27Replace all the loggers by the functest logger modulejose.lausuch2-28/+4
JIRA: FUNCTEST-228 Change-Id: If7a3c8cb08e9fbdf155fc5eff5330f79e5f8d234 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-27Create prepare_env.py from prepare_env.sh and config_functest.pyjose.lausuch3-672/+2
JIRA: FUNCTEST-227 Change-Id: I1aa890b9f91ec524c766ba3c460666ed227f2126 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Move functest_utils and openstack_utils to directory /utilsjose.lausuch2-4/+4
JIRA: FUNCTEST-226 Change-Id: I74d09f6322844b25ab45a02156317ae76ab40d8a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Corrected logging.Formatter parametersvitikkan1-2/+2
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-25Remove backslashs for line continuationCédric Ollivier3-88/+83
JIRA: FUNCTEST-213 Change-Id: Ia50521cf8fcf60a847aa44fe0ea59b6e64830e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-04-25ConfigParser is used for tempest.conf updatingvitikkan1-19/+10
Bash commands are replaced with python's ConfigParser routines for configuration file reading/updating. Removed updating of ssh_user_regex parameter since it is now into upstream Rally code. JIRA: FUNCTEST-198 Change-Id: I95f926948a395993e28e993bf7ea2872d6b5c969 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-22Introduce a sanity test mode for Rally testJuha Kosonen5-206/+251
In a sanity test mode the number of iterations is reduced and only a subset of tests is executed. JIRA: FUNCTEST-220 Change-Id: I722f12b8cc6df29bfcb81b8798d8d0802b207d94 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-22Affect version field in results for all the testcasesMorgan Richomme2-3/+3
Previously version was scenario JIRA: FUNCTEST-225 Change-Id: Ia86f83dbe98ad5f9dbced60c46e57f58eccba7e9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-22Enable PYTHONPATH env variable inside the containerjose.lausuch4-14/+14
JIRA: FUNCTEST-224 Change-Id: Ib10dc312a761b06fe36174c5c19a0165f746593e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-21Fix Flake8 Violations in the Functest scriptsjose.lausuch4-160/+203
JIRA: FUNCTEST-213 Change-Id: I66c02dd6ff12ffb9798ebe44a4cfe7bfc73e76c3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-20Print openstack info only if CI_DEBUG==truejose.lausuch1-17/+18
JIRA: FUNCTEST-205 Change-Id: I550d26ba1fddcedf5697dadd38a85148ecef2d44 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-18Merge "Generating test lists for tempest"Morgan Richomme3-245/+153
2016-04-18Allow rally to use existing glance imageCiprian Barbu1-4/+7
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: Ia79f519d10fc9155ab2fb44a3e427ae3bb1ce399 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-18Generating test lists for tempestvitikkan3-245/+153
'testr list-tests' command is now used for generating smoke and full test case lists for tempest. test_list.txt file is replaced by defcore_req.txt file which contains latest (2016.01) DefCore test case for possible references. Partly implements JIRA: FUNCTEST-196 Change-Id: I993aa8a3919b97d50f081725ced686dbe6ffc4b7 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-14Create health check test casejose.lausuch2-117/+170
JIRA: FUNCTEST-199 Change-Id: Iee40f182cdbe848d0f87619b7dd06fbce34d0440 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-12Remove unused Rally scenarios and run scriptJuha Kosonen15-2850/+2
run_rally.py is longer in use, it has been replaced with run_rally-cert.py already earlier. JIRA: FUNCTEST-191 Change-Id: I81b5060ed9a30e758afe75321052f120e9cf7389 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-11Split functest_utils.py into 2 scriptsjose.lausuch5-75/+78
JIRA: FUNCTEST-186 All the openstack related functions are in openstack_utils.py and the remaining functions in functest_utils.py All the scripts are adapted to this structure. Change-Id: I7f3805779741f0b085985d0d053feb429250b1ea Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-22Add status when pushing Tempest resultsMorgan Richomme1-34/+49
Change-Id: Ie4ad96d9c580370ae9f451ea440a71cf7a6fb841 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-18Add criteria and version when pushing the results into test DBMorgan Richomme1-12/+25
JIRA: FUNCTEST-151 Change-Id: Iac36f28db5f2203d7b2977a2bb973534fe167bac Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-15Add exception handling for output processingJuha Kosonen1-2/+9
Handle the exception if parsed result in report cannot be converted to a numeric value. JIRA: FUNCTEST-149 Change-Id: Ibb259abdaa800761ee8dd2270c6bc2529081242d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-03-04Rally and Tempest pre-installed in the Docker image.jose.lausuch1-1/+1
Also, upgrade Rally to version 0.3.1 JIRA: FUNCTEST-147 Change-Id: I6aa15a7c282462058b7786c7dc7174d48c905d3a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-24Add jenkins build tag for result apiboucherv1-1/+3
Ex: jenkins-functest-compass-intel-pod8-daily-master-19 this will bring together all tests passed on the same functest run JIRA: FUNCTEST-140 Change-Id: I3c1cd8137184509ee5fdeeb2df5399d4c71e3f67 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-02-23remove "print" in tempest to avoid having a message "None" in the outputjose.lausuch1-1/+1
Change-Id: If2008fa7ed1bce1b5acc40cad82c21afa55ec4e5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-12Rally live migration case selectionJuha Kosonen3-44/+61
Execute live migration cases only if the feature is enabled in Tempest configuration file. Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-11Merge "Push results without extra formating"Morgan Richomme1-5/+7
2016-02-11Push results without extra formatingMorgan Richomme1-5/+7
Change-Id: I70713a30cec556ca7cd32122b9c10cf4c1732c3f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-11Enadled --serial option for run_tests.shViktor Tikkanen1-2/+11
It could be useful to execute e.g. Tempest test cases in a single thread in order to troubleshoot possible concurrency problems. Change-Id: I5e5fc190fb4483ff075a8f837a8d4116ece90c80 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-10Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scriptsjose.lausuch3-0/+19
Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup or not the resources Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Create Rally summary report also for verbose modejose.lausuch1-24/+36
Also: - Fix percentage format of summary - Get the percentage from the row 'total' JIRA: FUNCTEST-134 Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Push rally summary results into DBMorgan Richomme2-49/+53
json produced by Rally are pushed to rally_details Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-09Merge "Remove obsolete public network definitions"Morgan Richomme1-5/+10
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-09Remove obsolete public network definitionsJuha Kosonen1-5/+10
Use functest_utils.py routines in run_rally-cert.py to retrive external network name instead of static definition in config_functest.yaml. Also change the network name and id setting in task arguments. Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-08Used sed instead of crudini for updating regexViktor Tikkanen1-2/+1
It seems that crudini has limitations regarding quotation marks so sed tool is used instead in order to replace ssh_user_regex parameter into tempest.conf file. Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-08Merge "Added configuration of ssh_user_regex parameter"Morgan Richomme1-0/+5
2016-02-08Added configuration of ssh_user_regex parameterViktor Tikkanen1-0/+5
Some Rally versions don't set correctly SSH user name into tempest.conf file so that e.g. test_server_basicops test case of Tempest suite fails with "Please login as 'cirros' user, not as root" error. This change ensures that correct SSH user info will be used for Cirros images created by Rally. Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen11-95/+98
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-04Merge "Fix success status parsing of rally results"Morgan Richomme1-8/+6
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-02Consider volumes and floatingips as defaults in clean_openstackjose.lausuch2-18/+56
Change-Id: I3ffc864768a7c474ee1063eecee1e2085de807b5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02bug fix to run tempest and minor display error in run_test.shMorgan Richomme1-0/+1
Change-Id: Ic30bdd1c514aa8dcab37ba91de2f8879729a80a2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>