summaryrefslogtreecommitdiffstats
path: root/ci/run_tests.py
AgeCommit message (Collapse)AuthorFilesLines
2016-10-18Use importlib to load testcasesCédric Ollivier1-7/+33
It modifies run_tests.py to dynamically execute testcases and then removes the test condition about odl. It also induces that the modules and the related classes must be defined in ci/testcases.yaml. JIRA: FUNCTEST-353 Change-Id: I6ad67b70624aac6bf805c9bde4dfef7c9fbd5c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-10-17Conform ODL to TestCasesBaseCédric Ollivier1-5/+7
Now ODLTestCases inherits from TestCasesBase what induces several modifications of function definitions. It also renames functest_run to run and run to main and they now return the code status defined in TestCasesBase instead of True and False (run_tests.py has been adapted as well). It checks if errno is equal to EEXIST when makedir raises an OSError exception. JIRA: FUNCTEST-353 Change-Id: I88240a9ce8e491dab4c7e6c604f3ecc62cf9edce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-10-12Remove exit() in ft_utils.execute_commandCédric Ollivier1-1/+1
It simply removes the exit call in ft_utils.execute_command which is quite safe as every testcase sets exit_on_error to False JIRA: FUNCTEST-438 Change-Id: Ia273de0955cc3ea65a150c626638400ce614da00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-09-07remove imported FUNCTEST_REPO objectSerenaFeng1-2/+2
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/ **** Do not import objects, only modules (*) **** so direct FUNCTEST_REPO import should be avoided from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO JIRA: FUNCTEST-459 Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-01stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng1-6/+4
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-31unify testcases.yaml obtain processSerenaFeng1-1/+1
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever testcases.yaml is needed, abstract a method to provide unified interface JIRA: FUNCTEST-449 Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-30Allow realtime Jenkins' console outputCédric Ollivier1-1/+1
Change-Id: I6005000762eb6e7bb7e40ccaea35004a07b47aa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-24Stop calling exec_test.sh in the middle of python scriptsCédric Ollivier1-3/+11
Now run_tests.py calls directly OpenDaylightTesting.functest_run(). It mainly reads env vars as exec_test.sh does. Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-23Avoid duplicating logs in run_tests.pyCédric Ollivier1-1/+1
When run_tests.py sets logger as execute_command arg, logs are duplicated in functest.log and not shown in console (as every DEBUG message). As logger is mainly managed by the python scripts in charge of testing, it can be safely removed here. stderr is also redirected to stdout in execute_command to print possible relevant data. JIRA: FUNCTEST-431 Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-28Prevent exiting the overall execution when there is a failed test casejose.lausuch1-12/+3
Unless it is a test with the flag blocking=true Change-Id: Iada54319db1c81c73781f1b135eb496bc9f2af1b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Bugfix: dont stop execution when a test case is not blockingjose.lausuch1-6/+17
Change-Id: I3564b6f2d8f8057ec2c9753837e3a5fe16a4a866 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Return -1 if copper test failsjose.lausuch1-1/+0
Change-Id: Ib66d1b69c73603bab33950ca2c0fca3f07eb3d22 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27[bugfix] miss a argumentmeimei1-1/+1
Change-Id: Id8cdf6a5dadee6a2e0ba10772db88c84e5ce13a3 Signed-off-by: meimei <meimei@huawei.com>
2016-07-26Generate Functest report at the end of the executionjose.lausuch1-11/+29
JIRA: FUNCTEST-89 Change-Id: I10c41efdd6a7f737f57ab15158c8c8d49f392271 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-25Create a flag in the tests to indicate if they should be blocking or notjose.lausuch1-8/+17
JIRA: FUNCTEST-380 Change-Id: I737d71a47ddac80bf0222a1f004af05f509c5971 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-22Add duration message after test executionjose.lausuch1-0/+6
Change-Id: Ida68009ba02b2a5135dc4f3ae958fc77088389d7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-22bugfix: Don't try to run a tier if it doesn't contain any enabled testjose.lausuch1-7/+14
- Add separation (blank lines) between the test cases output JIRA: FUNCTEST-349 Change-Id: I54a5d4f33d5776b4754641168c3775d19ca50e4a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-18Don't take openstack snapshot when "-n" option is setjose.lausuch1-1/+2
JIRA: FUNCTEST-236 Change-Id: I37bfa4ebe88a8cf02f2cddc8fc4cce70ad87b775 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Use common way to get the openstack clientsjose.lausuch1-1/+0
Instead of repeating the code in all the scripts and importing the openstack libraries, the clients shall be given by openstack utils, which is its purpose JIRA: FUNCTEST-163 Change-Id: I1ccc05a3af44ee1ab5938ea9e4e01dbe55f4816d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-12Chmod 755 all py files which can be executedCédric Ollivier1-0/+0
All files where __main__ is checked can now be executed by everyone. It results from [1]. [1] find . -name "*.py" |xargs grep __main__ |cut -d\: -f 1 |xargs chmod 755 Change-Id: I9ad153cfdde0447213e35dac102e668d9e754cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-04Change OpenStack clean behaviourjose.lausuch1-3/+11
JIRA: FUNCTEST-236 The openstack snapshot generation is now triggered before running a test case and removed from prepare_env Change-Id: I4d1bc95dedd7f59d4b1d5866f288e1c1a70ec69e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-10Adapt tiers to run depending on WEEKLY/DAILYjose.lausuch1-5/+16
JIRA: FUNCTEST-244 Change-Id: I11bf28baff52b75b0f6c58845edc22f266dfcbe8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-09Fix shebang of python scriptsJuha Kosonen1-1/+1
Change-Id: I8a05fd6fbb0d392a27f354a6b8cacf33073bf17f Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-04Refactor, add logger handler to collect all the logs to a file as welljose.lausuch1-7/+3
JIRA: FUNCTEST-190 Also: - remove old code that are not used any more - improve execute_command function - fix logger output for run_tempest Change-Id: Ib268738ada1b9de2a418ef01e684a90e6f4e02ed Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch1-14/+11
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-02Add command to execute the actual testsjose.lausuch1-3/+20
JIRA: FUNCTEST-190 Run_tests was generating the tests cases to be executed, but not actually running them. This patch also includes a small enhancement to avoid too much output when showing which tiers to be tested. Change-Id: Id70cfe44a8263ce7f598386668a33c67a8961b42 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-02Source the credentials in run_tests.pyjose.lausuch1-1/+12
JIRA: FUNCTEST-227 JIRA: FUNCTEST-190 OpenStack clean was failing due to this. Change-Id: Ia4dcf084becb532f157c0924baf44bb2441f6379 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-28Create run_test.py using the tier mechanism to run the testsjose.lausuch1-0/+134
JIRA: FUNCTEST-227 JIRA: FUNCTEST-190 Change-Id: I5445ad36ec65e62d48c8f5b16352caea2e51e3c9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>