summaryrefslogtreecommitdiffstats
path: root/ci
AgeCommit message (Collapse)AuthorFilesLines
2016-09-02stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng2-11/+7
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 470f573a3ac2eb1783efec6da01a3bee33360c65)
2016-09-02unify functest_yaml obtain processSerenaFeng1-2/+1
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit f4d0a05011e961a363c6d99522684ecdeb959716)
2016-08-31Remove copper from lxd scenarioMorgan Richomme1-1/+1
JIRA: FUNCTEST-452 Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit bb699b3cfc146566ba54aa96111cf5a05839322a)
2016-08-31unify testcases.yaml obtain processSerenaFeng1-1/+1
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever testcases.yaml is needed, abstract a method to provide unified interface JIRA: FUNCTEST-449 Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit f5afb93a4a2ed9547757655c1405ef27fabed11b)
2016-08-31parser fails on virtual environementSerenaFeng1-1/+1
Parser tests needs lots of resources, such as vcpu/memory/disk, virtuals pod may not meet the requirements, so exclude Parser running on virtual pods by exclude 'noha' scenario JIRA: FUNCTEST-444 Change-Id: I6f2832fa0f727f762987c41d7a3485dede041151 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 35cf15a87126b6947b59899cd726f4b92599fe79)
2016-08-30Exclude healthcheck from lxd scenariosMorgan Richomme1-1/+1
JIRA: FUNCTEST-442 Change-Id: I1f6888dbddebf28af4b565ca87d9791a21cd4d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 9b77f96822457e20bd5c5249c41bf498a3351b2b)
2016-08-30Allow realtime Jenkins' console outputCédric Ollivier1-1/+1
Change-Id: I6005000762eb6e7bb7e40ccaea35004a07b47aa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8afd88fdf4574136d44cfaa8b01a4fa89e6a7a81)
2016-08-30Force stdin, stdout and stderr to be totally unbufferedCédric Ollivier1-0/+1
It protects against mixed logs as lots of python scripts directly call print which doesn't flush stdout as opposed to log.info(). This requirement is induced by subprocess.Popen() initiated by run_tests.py. The following programs could switch to logging instead of print [1] [1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \ |grep \ print\ |cut -d: -f 1 |sort -u ./testcases/Controllers/ODL/OpenDaylightTesting.py ./testcases/Controllers/ONOS/Sfc/Sfc_fun.py ./testcases/Controllers/ONOS/Sfc/Sfc.py ./testcases/Controllers/ONOS/Teston/adapters/client.py ./testcases/Controllers/ONOS/Teston/adapters/connection.py ./testcases/Controllers/ONOS/Teston/adapters/environment.py ./testcases/Controllers/ONOS/Teston/adapters/foundation.py ./testcases/OpenStack/vPing/vping_util.py ./testcases/security_scan/connect.py ./utils/functest_utils.py ./utils/functest_vacation.py ./utils/openstack_clean.py JIRA: FUNCTEST-441 Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d32ff56af10bcc15163d573a64970013242c689c)
2016-08-30Stop hard-coding db urlCédric Ollivier1-3/+3
Change-Id: I587ac6d210135e7124ba006a977a675a4d38b518 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fee070fcc4a31735abb88b303742bb05f12b53e7)
2016-08-30Set env vars as mandatory to push to DBCédric Ollivier1-6/+1
Now env vars are mandatory in push_results_to_db. It avoids testing programs to check them even if they are useless from their points of view. The related getters aren't removed to help debugging via logger_test_results which could be run without report. Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 66334bc798c25d5769f92f2a6292daaf6220da79)
2016-08-26Stop calling exec_test.sh in the middle of python scriptsCédric Ollivier1-3/+11
Now run_tests.py calls directly OpenDaylightTesting.functest_run(). It mainly reads env vars as exec_test.sh does. Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d6484df9b602f0888450ef1e29ccc0a5f6c94675)
2016-08-25Use by default the default ODL web portCédric Ollivier1-5/+3
Change-Id: I7580f02dd5b2db6cf06690ef0163768ea59079fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 683db3a5d67aeead1090008bce7701ffb208a15c)
2016-08-23Avoid duplicating logs in run_tests.pyCédric Ollivier1-1/+1
When run_tests.py sets logger as execute_command arg, logs are duplicated in functest.log and not shown in console (as every DEBUG message). As logger is mainly managed by the python scripts in charge of testing, it can be safely removed here. stderr is also redirected to stdout in execute_command to print possible relevant data. JIRA: FUNCTEST-431 Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 53fd052b7fce64294c50ca170d42367d711ccc3f)
2016-08-23Enable security scan for apex scenariosvitikkan1-1/+1
Change-Id: I6c2925237d7ae437f49d60d37ef906ed8029eb03 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit da6398642446f98240d9d1bf924e959e64a73d63)
2016-08-23doctor test support fuel installerdongwenjuan1-1/+1
Change-Id: I9229d4de823568bfefd4f2c1ab5c5c1a1ded6d2c Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn> (cherry picked from commit e0a17212d21ae7d76c55791ab8bcde1c66df3158)
2016-08-22Merge "Add reporting to DB in OpenDaylightTesting"Morgan Richomme1-10/+6
2016-08-22Merge "refactor vping"Morgan Richomme1-2/+2
2016-08-22refactor vpingSerenaFeng1-2/+2
There are lots of common processes in vPing_userdata.py and vPing_ssh.py, abstract and refactor them. JIRA: FUNCTEST-414 Change-Id: I4cd2c635318c063319d2a3c31f9a1e512eeea6c8 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-21Chmod 755 all py files which can be executedCédric Ollivier1-0/+0
All files where __main__ is checked can now be executed by everyone. It results from [1] like the next commit [2]. [1] find . -name "*.py" |xargs grep __main__ |cut -d\: -f 1 |xargs chmod 755 [2] https://gerrit.opnfv.org/gerrit/#/c/16737/ Change-Id: I75395892e9e6afbf8ac9c995258496be557aad5f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-19Add reporting to DB in OpenDaylightTestingCédric Ollivier1-10/+6
It now relies on Robotframework API instead of parsing output.xml. The type of critical and elapsedime fields are now bool and int respectively. start_date and stop_date has been fixed too. JIRA: FUNCTEST-367 Change-Id: I59f3ad2109345395ccf01a714301a14f9323f088 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-19Add exec rightCédric Ollivier1-0/+0
Change-Id: I9c3fd786574622977870b12d38b92f8bed8a929c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-19Pull down default instance flavorMichael Polenchuk1-1/+1
Set default instance flavor to m1.tiny in order to keep hardware resources requirements at the minimum. Change-Id: If070e25389e1d7978c34dec8621414c8938a262f Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-08-18Remove useless odlreport2db argsCédric Ollivier1-2/+1
It removes useless odlreport2db args as functest_utils parses env vars too and erases this previous values. All mandatory env vars are still checked in exec_test.sh. Change-Id: I3dd299dcad1758b994cf9d53ef65a5b83dc46b97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-18Merge "Add report flag for moon"Morgan Richomme1-1/+1
2016-08-18Merge "resume Parser test run on fuel onos"Morgan Richomme1-1/+1
2016-08-18Add report flag for moonMorgan Richomme1-1/+1
JIRA: FUNCTEST-210 Change-Id: I97be5542ae4ae87f1b8d62394ff66068e77f4082 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-18delete extra slash while execute cases test in exec_test.shSerenaFeng1-2/+2
There are two slashes appeared in the path when we execute case test: /home/opnfv/functest/conf//openstack.creds /home/opnfv/repos/functest//testcases/OpenStack/vPing/vPing_userdata.py JIRA: FUNCTEST-421 Change-Id: I4fa8a11499e301dd84d1e1de7c72189b8d84459b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-18resume Parser test run on fuel onosSerenaFeng1-1/+1
Parser tests was removed by onos people in change https://gerrit.opnfv.org/gerrit/#/c/18821/. After we talk about this, we found it was a mis-removal. JIRA: FUNCTEST-422 Change-Id: I76da8786cac0fc5c874aa69e937d6ae19b20c6b1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-17Merge "Add reporting flag to push reuslts only from CI"Morgan Richomme1-4/+4
2016-08-17Remove parser tests from fuel onoswuwb19891-1/+1
Change-Id: I72467575ca3eb79cbd0094882d3a5be73c2cf308 Signed-off-by: wuwb1989 <wuwenbin2@huawei.com>
2016-08-17Add reporting flag to push reuslts only from CIMorgan Richomme1-4/+4
JIRA: FUNCTEST-416 Change-Id: I1a5800be0dcf75573f44e6214b23917aadc1cbf7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-17[multisite] set the criteria as 100%meimei1-1/+1
Change-Id: I8e6a274c0f250b63c3e6f698b527fc476e1162b8 Signed-off-by: meimei <meimei@huawei.com>
2016-08-16Repoint security_scanning to its own repositoryLuke Hinds1-1/+1
JIRA: FUNCTEST-415 Change-Id: I5ac2bd9b417ae045f4a1c0fa3f4fd2e7c545dbf3 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-08-16Call moon python script to run the moon testsMorgan Richomme1-2/+1
JIRA: FUNCTEST-210 Change-Id: Ic0a5f5620f9ceb42cb443b2509a2376e48d0cc42 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-15Merge "add parser to feature tier to make it run daily"Morgan Richomme1-10/+9
2016-08-14add parser to feature tier to make it run dailySerenaFeng1-10/+9
For now parser belongs to vnf tier, but this tier is defined to run weekly, which is not parser wanted, so I move it to feature tier to make it run daily. JIRA: FUNCTEST-413 Change-Id: I5b1fe3e7b140d26fe2e71f0a625e0ffad7937a13 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-12Fixing a typoDimitri Mazmanov1-1/+1
Multisite jobs kept failing because of a typo. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: I6e484e6457c7b8bae7c0343e9307bd15222e4fe3
2016-08-12Merge "Improve LXD scenario support"Morgan Richomme3-1/+3
2016-08-12Improve LXD scenario supportboucherv3-1/+3
JIRA: FUNCTEST-268 Change-Id: I8c8a3eff4a7e94b963c0307010a60723dc13a537 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-11Merge "Create config_functest patch to update the conf with scenario"boucherv2-1/+32
2016-08-11add report flag to parserSerenaFeng1-1/+1
parser has no report flag, every time we run the test the results will be reported to db JIRA: FUNCTEST-410 Change-Id: I6336b4c367fd8edc70e076b81d01d9356580bc22 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-11Merge "[multisite] refactor the scripts of multiste"meimei1-1/+2
2016-08-11[multisite] refactor the scripts of multistemeimei1-1/+2
Change-Id: I07f0f5e253b04c9ac70e6dc4ea210e7cecf22c6a Signed-off-by: meimei <meimei@huawei.com>
2016-08-11change parser path from RNC to vRNCSerenaFeng1-1/+1
JIRA: FUNCTEST-409 Change-Id: I83887160a328c6f022efaa1547ca214571a9a01c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-10Create config_functest patch to update the conf with scenarioboucherv2-1/+32
Adding support of LXD scenario JIRA: FUNCTEST-268 Change-Id: I5891ff9de674d99d32d8db747be501ee8a2e6609 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-10parser integration bugfixSerenaFeng1-16/+0
JIRA: FUNCTEST-407 Change-Id: I9f202cb09935d9b77c5a977234bec6b505e296fd Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-08Merge "Enable Copper functest under JOID"Morgan Richomme1-1/+1
2016-08-07Merge "Bug fixes odl-sfc + new features"valentin boucher1-0/+5
2016-08-05Bug fixes odl-sfc + new featuresManuel Buil1-0/+5
* Doing the test with private IPs as floating are currently not working in ODL * New SF takes more time to start the service. A while loop is added. * Configuration of the compute set-up due to ODL limitations added Change-Id: I5449af940caee456262dac66bc47b66fd05c2a70 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-08-05Reduced timeout for SSH connection attempt in tempest.confvitikkan1-0/+2
Some tempest test cases try to establish SSH connection to Cirros VMs using default 300s timeout. Since Cirros VMs send only three DHCP requests with 1 minute interval, future SSH connection attempts will most probably fail if DHCP response will not be received right after third request. For that reason the optimal timeout is slightly above 2 minutes. JIRA: FUNCTEST-378 Change-Id: I57415ad37a85cd84887d3cac4f7a44f7e145d820 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>