summaryrefslogtreecommitdiffstats
path: root/ci
AgeCommit message (Collapse)AuthorFilesLines
2018-08-26Avoid duplicating jjb namesCédric Ollivier4-54/+58
It allows loading functest and functest-kubernetes jjbs in one Jenkins. Change-Id: Ia52e84583bc25aad0d1508096b536cbd5585d261 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Merge "Integrate Stor4NFV feature openstack test case"Cedric Ollivier1-0/+2
2018-08-25Integrate Stor4NFV feature openstack test caseQiaowei Ren1-0/+2
Change-Id: I245d0fbe8f026a24138ede4041caae4dccc15cc0 Signed-off-by: Qiaowei Ren <qiaowei.ren@intel.com>
2018-08-22Execute refstack_defcore in ci/run.yamlCédric Ollivier1-0/+1
Change-Id: Ib65203e74244d87f7ac6b24f6e6abf723c57a786 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20Publish Functest daily and gate jobsCédric Ollivier4-0/+365
As opposed to the Releng ones, they are designed to be easily executed by endusers as well. They can be considered as a first step towards a full Functest CI/CD toolchain deployed via docker-compose. All components testcases are enabled here. They hugely leverage on templates to load the right yamls per branch and multijobs to run testcases in parallel. Many steps are proposed allowing running part of the chain. Executors have to be increased to allow running them (it was tested vs 10 and more). At first, all docker images are downloaded to avoid different versions between testcases. They will be improved in a second change to ensure that only one node is selected and to take all Functest env vars into account. Change-Id: I99c7b8ee5d0ddbb00102b3147739b5e8b5c65c23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-11-10change path for python ci filesMorgan Richomme11-1770/+0
JIRA: FUNCTEST-525 Change-Id: I6b09eaec55e42a3ee1474b21bc7ed87a71118e60 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-09Repo structure modificationMorgan Richomme3-28/+29
- create functest subdirectory - rename unit tests - adapt path in exec and config files JIRA: FUNCTEST-525 Change-Id: Ifd5c6edfb5bda1b09f82848e2269ad5fbeb84d0a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18Use importlib to load testcasesCédric Ollivier2-7/+36
It modifies run_tests.py to dynamically execute testcases and then removes the test condition about odl. It also induces that the modules and the related classes must be defined in ci/testcases.yaml. JIRA: FUNCTEST-353 Change-Id: I6ad67b70624aac6bf805c9bde4dfef7c9fbd5c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-10-18Merge "Conform ODL to TestCasesBase"Jose Lausuch1-5/+7
2016-10-17Multi-compute support and python refactoringManuel Buil1-1/+1
We added support for multi-compute and changed one file from bash to python Change-Id: Ife3d5a8e41936c044cfe88664187d81c18d96b93 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-10-17Conform ODL to TestCasesBaseCédric Ollivier1-5/+7
Now ODLTestCases inherits from TestCasesBase what induces several modifications of function definitions. It also renames functest_run to run and run to main and they now return the code status defined in TestCasesBase instead of True and False (run_tests.py has been adapted as well). It checks if errno is equal to EEXIST when makedir raises an OSError exception. JIRA: FUNCTEST-353 Change-Id: I88240a9ce8e491dab4c7e6c604f3ecc62cf9edce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-10-12Remove exit() in ft_utils.execute_commandCédric Ollivier2-2/+2
It simply removes the exit call in ft_utils.execute_command which is quite safe as every testcase sets exit_on_error to False JIRA: FUNCTEST-438 Change-Id: Ia273de0955cc3ea65a150c626638400ce614da00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-10-10Use huge page for dpdk (ovs) scenarioMorgan Richomme1-1/+8
JIRA: FUNCTEST-487 Change-Id: I41d0180b622623699bccc3f7413ffbbb468f7656 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-21Add odl_sfc test in apex as the scenario is runMorgan Richomme1-1/+1
Change-Id: I81a74a9f7c6ae54ba1b2be7ec27a11ae3a2392b9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-20Bug fix for the SFC-CI test caseManuel Buil1-1/+1
A iteration is added so that the test is run several times. We are experiencing that ODL requires one deployment for things to work Change-Id: Ic70e8f2dabbf03827dd6d7396d2ab8177140cc97 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-09-20[ODL-SFC] Bugfix: replace string "22" by "22/tcp"jose.lausuch1-1/+1
This fixes a small bug in https://gerrit.opnfv.org/gerrit/#/c/21833/ JIRA: JIRA: SFC-48 Change-Id: I92ad973369109a107700443c074dfae6f6c21516 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-20[ODL-SFC] Open port 22 in default secgroup for sfc scenariojose.lausuch1-0/+16
JIRA: SFC-48 After some troublehsooting done in Boron RC3.5, vPing doesn't work because the instances are created on 2 security groups. One (vping-sg) opens port 22 but the default secgroup doesn't. This patch allows port 22 also on the default and therefore vPing passes. This patch is to workaround a bug in ODL. The bug will be reported to the corresponding community. Change-Id: I807249d42cebe7c8dccd78a3496c1d34996d73ee Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-19Remove parser test case from bgpvpn scenariosjose.lausuch1-1/+2
Due to the same performance issue encountered in bgpvpn scenarios, Jenkins still times out and can't have a summary of all the tests and upload logs to artifacts. The removal of this test case will affect only Colorado 1.0, and will be reactivated in Colorado 2.0 with ODL Boron. Change-Id: Ic2d8cc43a1a732daa063aa7c01a309a3dfa2050d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-15Added support for custom images and flavors in tempestjuraj.linkes2-1/+11
Change-Id: I9335ed1517097e83175a265b603a6707adf476b6 Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2016-09-15Exclude Doctor from Functest for fuel scenariosMorgan Richomme1-1/+1
Doctor, as part of the feature project, is FAIL on fuel scenarios JIRA: FUNCTEST-192 Change-Id: Ic5b9b4afe80fbb2d5887bdf46410a0fc72e7be37 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-14Exclude copper, doctor and security_scan from apex/fdio scenariosMorgan Richomme1-3/+3
JIRA: FUNCTEST-475 Change-Id: I720b9d88db94d66f067601608ab2d1435fc93d47 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-14Added missing parameter into logger warning messagevitikkan1-3/+4
Missing parameter prevented using of customer defined installer type when executing "functest env prepare" command. JIRA: FUNCTEST-467 Change-Id: I69b69fa43584ec7ae4e4d8925f99624711131ef9 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-09-13Merge "Refactored support for flavor and image hugepages based on Morgan's ↵Morgan Richomme1-1/+5
suggestins"
2016-09-13Refactored support for flavor and image hugepages based on Morgan's suggestinsjuraj.linkes1-1/+5
Change-Id: I414338616aecda161a51a780abb24c9e3a8f5c54 Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2016-09-13[SDNVPN] Disable Rally Sanity test case for bgpvpn scenariosjose.lausuch1-1/+1
Due to a known issue with API performance when bgpvpn extension is activated which causes some delays and the tests take longer time than normal, we get a lot of Jenkins Job timeouts and the scenario cannot be validated. Since it is a performance issue, we black list rally sanity, which takes 1 hour to complete and will re-enable it in Colorado.2.0 where ODL Boron release will be available and SDNVPN team thinks this will be fixed. Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-08make use of functest_utils.get_parameter_from_yamlSerenaFeng1-12/+12
JIRA: FUNCTEST-463 Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-07Merge "remove imported FUNCTEST_REPO object"Morgan Richomme2-5/+5
2016-09-07remove imported FUNCTEST_REPO objectSerenaFeng2-5/+5
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/ **** Do not import objects, only modules (*) **** so direct FUNCTEST_REPO import should be avoided from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO JIRA: FUNCTEST-459 Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-06Reduce logging in the SFC test caseGeorge Paraskevopoulos1-12/+5
JIRA: FUNCTEST-446 Reduce the logs that appear in the Jenkins CI console to make the output of the SFC test case more readable - Redirect tacker installation logs to results folder /home/opnfv/functest/results/odl-sfc.log - Split odl-sfc preparation into a new script - Pipe STDERR in the sfc.py script so that "Added to known hosts" messages do not show in the output Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-09-05[Promise test case] Use proper way to get parameters from yamljose.lausuch1-14/+13
Since there is a function in functest_utils to get a value from the config_functest.yaml directly, there is no need to load again that file. Better to use common functions that are designed for that. Also, Replace location of the results json file to the results directory. It will be also pushed to artifacts repository. Change-Id: Ic6422ed78ccd0f8b40b519342a7dcf38c502924e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-01Change default memory for Promise flavorjose.lausuch1-1/+1
In some scenarios (bgpvpn) the timeout defined in promise to boot/delete vms is too tight. Having less memory might fix the problem as it will take less time and it doesn't impact the promise test case. Change-Id: Ib3165ea5d6518d88384f76c8edd10dddb0b529a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-01stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng2-11/+7
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-01Merge "unify functest_yaml obtain process"Jose Lausuch1-2/+1
2016-08-31Remove copper from lxd scenarioMorgan Richomme1-1/+1
JIRA: FUNCTEST-452 Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-31unify functest_yaml obtain processSerenaFeng1-2/+1
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-31Remove all logers as utils method args.Cédric Ollivier1-6/+6
As it modifies method params, it could break the testcases. JIRA: FUNCTEST-428 Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-31Merge "unify testcases.yaml obtain process"Morgan Richomme1-1/+1
2016-08-31parser fails on virtual environementSerenaFeng1-1/+1
Parser tests needs lots of resources, such as vcpu/memory/disk, virtuals pod may not meet the requirements, so exclude Parser running on virtual pods by exclude 'noha' scenario JIRA: FUNCTEST-444 Change-Id: I6f2832fa0f727f762987c41d7a3485dede041151 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-31unify testcases.yaml obtain processSerenaFeng1-1/+1
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever testcases.yaml is needed, abstract a method to provide unified interface JIRA: FUNCTEST-449 Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-30Exclude healthcheck from lxd scenariosMorgan Richomme1-1/+1
JIRA: FUNCTEST-442 Change-Id: I1f6888dbddebf28af4b565ca87d9791a21cd4d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-30Allow realtime Jenkins' console outputCédric Ollivier1-1/+1
Change-Id: I6005000762eb6e7bb7e40ccaea35004a07b47aa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-30Force stdin, stdout and stderr to be totally unbufferedCédric Ollivier1-0/+1
It protects against mixed logs as lots of python scripts directly call print which doesn't flush stdout as opposed to log.info(). This requirement is induced by subprocess.Popen() initiated by run_tests.py. The following programs could switch to logging instead of print [1] [1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \ |grep \ print\ |cut -d: -f 1 |sort -u ./testcases/Controllers/ODL/OpenDaylightTesting.py ./testcases/Controllers/ONOS/Sfc/Sfc_fun.py ./testcases/Controllers/ONOS/Sfc/Sfc.py ./testcases/Controllers/ONOS/Teston/adapters/client.py ./testcases/Controllers/ONOS/Teston/adapters/connection.py ./testcases/Controllers/ONOS/Teston/adapters/environment.py ./testcases/Controllers/ONOS/Teston/adapters/foundation.py ./testcases/OpenStack/vPing/vping_util.py ./testcases/security_scan/connect.py ./utils/functest_utils.py ./utils/functest_vacation.py ./utils/openstack_clean.py JIRA: FUNCTEST-441 Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-30Stop hard-coding db urlCédric Ollivier1-3/+3
Change-Id: I587ac6d210135e7124ba006a977a675a4d38b518 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-26Set env vars as mandatory to push to DBCédric Ollivier1-6/+1
Now env vars are mandatory in push_results_to_db. It avoids testing programs to check them even if they are useless from their points of view. The related getters aren't removed to help debugging via logger_test_results which could be run without report. Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-26Merge "Stop calling exec_test.sh in the middle of python scripts"Morgan Richomme1-3/+11
2016-08-24Stop calling exec_test.sh in the middle of python scriptsCédric Ollivier1-3/+11
Now run_tests.py calls directly OpenDaylightTesting.functest_run(). It mainly reads env vars as exec_test.sh does. Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-24Use by default the default ODL web portCédric Ollivier1-5/+3
Change-Id: I7580f02dd5b2db6cf06690ef0163768ea59079fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-23Avoid duplicating logs in run_tests.pyCédric Ollivier1-1/+1
When run_tests.py sets logger as execute_command arg, logs are duplicated in functest.log and not shown in console (as every DEBUG message). As logger is mainly managed by the python scripts in charge of testing, it can be safely removed here. stderr is also redirected to stdout in execute_command to print possible relevant data. JIRA: FUNCTEST-431 Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-23Enable security scan for apex scenariosvitikkan1-1/+1
Change-Id: I6c2925237d7ae437f49d60d37ef906ed8029eb03 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-23doctor test support fuel installerdongwenjuan1-1/+1
Change-Id: I9229d4de823568bfefd4f2c1ab5c5c1a1ded6d2c Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>