aboutsummaryrefslogtreecommitdiffstats
path: root/testcases/VIM/OpenStack/CI/libraries/run_tempest.py
AgeCommit message (Collapse)AuthorFilesLines
2016-05-17Change 'testcases' directory structurejose.lausuch1-347/+0
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-16BGPVPN test case refactoredvitikkan1-16/+1
BGPVPN test case is refactored and moved into bgpvpn.py module. JIRA: FUNCTEST-234 Change-Id: Ib0dd6e11f3c568470d9c3837ca192da767c64843 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-13Added handling of blacklist for tempestvitikkan1-39/+72
It is now possible to exclude some specific test cases ("black list") from the test case suites. JIRA: FUNCTEST-197 Change-Id: I2946a010793da0a3d3ef1d96aa0ca0840e8a761d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-11Split tempest into smoke and full modesvitikkan1-1/+1
"tempest_smoke_serial" and "tempest_full_parallel" test cases replace the original "tempest" case. Corrected fetching tempest results from "rally verify list" output (last result is taken instead of the first one). This correction is needed when "rally verify start" is run multiple times. JIRA: FUNCTEST-242 Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-10Creating private network for Tempestvitikkan1-34/+25
Since functest-net will be obsolete, own private network, subnet and router is taken into use for Tempest test. JIRA: FUNCTEST-239 Change-Id: I2b9f6aae74dc36decf305a4531fe0a071031aca3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-05Fix bug config_functest.yaml locationjose.lausuch1-0/+2
Change-Id: I3b28eb7015f6f1418ef04ca91103e313f71f74e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor, add logger handler to collect all the logs to a file as welljose.lausuch1-24/+25
JIRA: FUNCTEST-190 Also: - remove old code that are not used any more - improve execute_command function - fix logger output for run_tempest Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch1-1/+1
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-27Replace all the loggers by the functest logger modulejose.lausuch1-14/+2
JIRA: FUNCTEST-228 Change-Id: If7a3c8cb08e9fbdf155fc5eff5330f79e5f8d234 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Move functest_utils and openstack_utils to directory /utilsjose.lausuch1-2/+2
JIRA: FUNCTEST-226 Change-Id: I74d09f6322844b25ab45a02156317ae76ab40d8a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-25Remove backslashs for line continuationCédric Ollivier1-26/+23
JIRA: FUNCTEST-213 Change-Id: Ia50521cf8fcf60a847aa44fe0ea59b6e64830e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-04-25ConfigParser is used for tempest.conf updatingvitikkan1-19/+10
Bash commands are replaced with python's ConfigParser routines for configuration file reading/updating. Removed updating of ssh_user_regex parameter since it is now into upstream Rally code. JIRA: FUNCTEST-198 Change-Id: I95f926948a395993e28e993bf7ea2872d6b5c969 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-22Affect version field in results for all the testcasesMorgan Richomme1-1/+2
Previously version was scenario JIRA: FUNCTEST-225 Change-Id: Ia86f83dbe98ad5f9dbced60c46e57f58eccba7e9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-22Enable PYTHONPATH env variable inside the containerjose.lausuch1-4/+5
JIRA: FUNCTEST-224 Change-Id: Ib10dc312a761b06fe36174c5c19a0165f746593e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-21Fix Flake8 Violations in the Functest scriptsjose.lausuch1-30/+40
JIRA: FUNCTEST-213 Change-Id: I66c02dd6ff12ffb9798ebe44a4cfe7bfc73e76c3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-18Generating test lists for tempestvitikkan1-18/+31
'testr list-tests' command is now used for generating smoke and full test case lists for tempest. test_list.txt file is replaced by defcore_req.txt file which contains latest (2016.01) DefCore test case for possible references. Partly implements JIRA: FUNCTEST-196 Change-Id: I993aa8a3919b97d50f081725ced686dbe6ffc4b7 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-04-11Split functest_utils.py into 2 scriptsjose.lausuch1-10/+11
JIRA: FUNCTEST-186 All the openstack related functions are in openstack_utils.py and the remaining functions in functest_utils.py All the scripts are adapted to this structure. Change-Id: I7f3805779741f0b085985d0d053feb429250b1ea Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-22Add status when pushing Tempest resultsMorgan Richomme1-34/+49
Change-Id: Ie4ad96d9c580370ae9f451ea440a71cf7a6fb841 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-04Rally and Tempest pre-installed in the Docker image.jose.lausuch1-1/+1
Also, upgrade Rally to version 0.3.1 JIRA: FUNCTEST-147 Change-Id: I6aa15a7c282462058b7786c7dc7174d48c905d3a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-23remove "print" in tempest to avoid having a message "None" in the outputjose.lausuch1-1/+1
Change-Id: If2008fa7ed1bce1b5acc40cad82c21afa55ec4e5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-11Enadled --serial option for run_tests.shViktor Tikkanen1-2/+11
It could be useful to execute e.g. Tempest test cases in a single thread in order to troubleshoot possible concurrency problems. Change-Id: I5e5fc190fb4483ff075a8f837a8d4116ece90c80 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-10Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scriptsjose.lausuch1-0/+7
Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup or not the resources Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-08Used sed instead of crudini for updating regexViktor Tikkanen1-2/+1
It seems that crudini has limitations regarding quotation marks so sed tool is used instead in order to replace ssh_user_regex parameter into tempest.conf file. Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-08Added configuration of ssh_user_regex parameterViktor Tikkanen1-0/+5
Some Rally versions don't set correctly SSH user name into tempest.conf file so that e.g. test_server_basicops test case of Tempest suite fails with "Please login as 'cirros' user, not as root" error. This change ensures that correct SSH user info will be used for Cirros images created by Rally. Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-02bug fix to run tempest and minor display error in run_test.shMorgan Richomme1-0/+1
Change-Id: Ic30bdd1c514aa8dcab37ba91de2f8879729a80a2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-01-30Copy tempest.conf to results dir to be uploaded to artifactsjose.lausuch1-4/+7
Change-Id: I9cfe566c085dc45410a03650a9cf2a84de004d19 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-29Create stdout and stderr files for Tempest resultsjose.lausuch1-7/+18
Change-Id: Ibd45dd628dc64db16af28102276f5523f55fcaf4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-27Option to redirect stderr output to a file for Tempest testjose.lausuch1-1/+19
The output when we run Tempest from CI is too long if there are many tests failing. This patch intends to show only the test cases that passed/failed within a table. If troubleshooting is needed, it will be a log file with all the stderr in it. Change-Id: If5b0f35463a3dae06a0c177de4dc473bfc4687c5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-22Put scenario in version field on the Test DB (rather that git indication)Morgan Richomme1-2/+2
Change-Id: I22f7ff3841d7fca637e400d92926d2e1b1755371 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-01-19Add mention to apache 2 license in Functest files and remove unused filesMorgan Richomme1-1/+6
Change-Id: Iaf67792ad61351d0573c8d92e5d78f5f7a6e86ff Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-01-13Place config_functest.yaml outside the functest repojose.lausuch1-1/+1
If config_functest.yaml is given it will be placed in: /home/opnfv/functest/conf/config_functest.yaml If not given: copy default from repo to that location Change-Id: I816bf5ccf8e0a5b8ebde2a0ab924657533f49127 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-07Searching for shared private networksViktor Tikkanen1-3/+10
Tempest suite assumes that there is at least one shared private network in the system. get_private_net() returns now first found shared private network (instead of first found private network). Change-Id: I892abcacff2c0349dd42444a632f71c6a14a0861 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-01-04Configuring non-admin credentials for tempestViktor Tikkanen1-0/+90
Since some test cases from tempest suite require non-admin credentials, a new project and a new user with non-admin role were added to the configuration. JIRA: FUNCTEST-72 Change-Id: I573bc18292b5885bd354f4af16f7f70a7178540d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2015-12-30Support for customized tempest case listViktor Tikkanen1-2/+4
Newer release (0.1.2) of Rally has introduced some syntax changes (e.g. "--set" option for test set selection), so run_tempest.py is updated according to them. Custom test case list is taken into use instead of smoke test set. The list itself is updated (rally didn't recognize test cases with 'gate' definition). JIRA: FUNCTEST-72 Change-Id: I5e178f90f66fda7cb8099ddb4f82b93af3148c79 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2015-12-22Use repos_dir env variable in all Functest scriptsjose.lausuch1-6/+8
JIRA: FUNCTEST-90 This way, we remove the 'functest repo' input parameter on the python scripts call and we make it simpler using the available repos_dir env variable which points to /home/opnfv/repos Change-Id: I7d74bf1bc8d89f8f14397fcb9dafc22ee1482f84 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2015-12-14Add a flag to push the results to the DB optionalyjose.lausuch1-1/+8
By default, it will NOT push, only if specified by -r The parameter must be taken from a Jenkins job set to TRUE JIRA: FUNCTEST-84 Change-Id: Iee3b293e90b052b88de2d4f1d337f5ec5e3b3941 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2015-11-30Add functions to retrieve POD name in FunctestMorgan Richomme1-1/+2
JIRA: FUNCTEST-108 Change-Id: I3453933e12cd7af9b06f50b327873f7516609566 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2015-10-20Change duration to integer seconds in tempest resultsjose.lausuch1-1/+6
JIRA: FUNCTEST-37 Change-Id: I4de4f8564598bbb8e47ff5e8062c696cf06ac55e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2015-10-19set nb test run and failure tests as intMorgan Richomme1-31/+33
JIRA: FUNCTEST-37 Change-Id: Ic540eab88c86422af1b68b4ead74f9456d18fa25 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2015-10-19Create run_tempest out of run_rallyjose.lausuch1-0/+144
JIRA: FUNCTEST-37 Change-Id: If87c66f0905b8577b6ebccff7a61d6d6eced6da9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>