summaryrefslogtreecommitdiffstats
path: root/ci/exec_test.sh
AgeCommit message (Collapse)AuthorFilesLines
2016-09-06Reduce logging in the SFC test caseGeorge Paraskevopoulos1-12/+5
JIRA: FUNCTEST-446 Reduce the logs that appear in the Jenkins CI console to make the output of the SFC test case more readable - Redirect tacker installation logs to results folder /home/opnfv/functest/results/odl-sfc.log - Split odl-sfc preparation into a new script - Pipe STDERR in the sfc.py script so that "Added to known hosts" messages do not show in the output Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-08-30Force stdin, stdout and stderr to be totally unbufferedCédric Ollivier1-0/+1
It protects against mixed logs as lots of python scripts directly call print which doesn't flush stdout as opposed to log.info(). This requirement is induced by subprocess.Popen() initiated by run_tests.py. The following programs could switch to logging instead of print [1] [1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \ |grep \ print\ |cut -d: -f 1 |sort -u ./testcases/Controllers/ODL/OpenDaylightTesting.py ./testcases/Controllers/ONOS/Sfc/Sfc_fun.py ./testcases/Controllers/ONOS/Sfc/Sfc.py ./testcases/Controllers/ONOS/Teston/adapters/client.py ./testcases/Controllers/ONOS/Teston/adapters/connection.py ./testcases/Controllers/ONOS/Teston/adapters/environment.py ./testcases/Controllers/ONOS/Teston/adapters/foundation.py ./testcases/OpenStack/vPing/vping_util.py ./testcases/security_scan/connect.py ./utils/functest_utils.py ./utils/functest_vacation.py ./utils/openstack_clean.py JIRA: FUNCTEST-441 Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d32ff56af10bcc15163d573a64970013242c689c)
2016-08-30Set env vars as mandatory to push to DBCédric Ollivier1-6/+1
Now env vars are mandatory in push_results_to_db. It avoids testing programs to check them even if they are useless from their points of view. The related getters aren't removed to help debugging via logger_test_results which could be run without report. Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 66334bc798c25d5769f92f2a6292daaf6220da79)
2016-08-25Use by default the default ODL web portCédric Ollivier1-5/+3
Change-Id: I7580f02dd5b2db6cf06690ef0163768ea59079fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 683db3a5d67aeead1090008bce7701ffb208a15c)
2016-08-22Merge "Add reporting to DB in OpenDaylightTesting"Morgan Richomme1-10/+6
2016-08-22refactor vpingSerenaFeng1-2/+2
There are lots of common processes in vPing_userdata.py and vPing_ssh.py, abstract and refactor them. JIRA: FUNCTEST-414 Change-Id: I4cd2c635318c063319d2a3c31f9a1e512eeea6c8 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-19Add reporting to DB in OpenDaylightTestingCédric Ollivier1-10/+6
It now relies on Robotframework API instead of parsing output.xml. The type of critical and elapsedime fields are now bool and int respectively. start_date and stop_date has been fixed too. JIRA: FUNCTEST-367 Change-Id: I59f3ad2109345395ccf01a714301a14f9323f088 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-19Add exec rightCédric Ollivier1-0/+0
Change-Id: I9c3fd786574622977870b12d38b92f8bed8a929c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-18Remove useless odlreport2db argsCédric Ollivier1-2/+1
It removes useless odlreport2db args as functest_utils parses env vars too and erases this previous values. All mandatory env vars are still checked in exec_test.sh. Change-Id: I3dd299dcad1758b994cf9d53ef65a5b83dc46b97 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-18Add report flag for moonMorgan Richomme1-1/+1
JIRA: FUNCTEST-210 Change-Id: I97be5542ae4ae87f1b8d62394ff66068e77f4082 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-18delete extra slash while execute cases test in exec_test.shSerenaFeng1-2/+2
There are two slashes appeared in the path when we execute case test: /home/opnfv/functest/conf//openstack.creds /home/opnfv/repos/functest//testcases/OpenStack/vPing/vPing_userdata.py JIRA: FUNCTEST-421 Change-Id: I4fa8a11499e301dd84d1e1de7c72189b8d84459b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-17Add reporting flag to push reuslts only from CIMorgan Richomme1-4/+4
JIRA: FUNCTEST-416 Change-Id: I1a5800be0dcf75573f44e6214b23917aadc1cbf7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-16Repoint security_scanning to its own repositoryLuke Hinds1-1/+1
JIRA: FUNCTEST-415 Change-Id: I5ac2bd9b417ae045f4a1c0fa3f4fd2e7c545dbf3 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-08-16Call moon python script to run the moon testsMorgan Richomme1-2/+1
JIRA: FUNCTEST-210 Change-Id: Ic0a5f5620f9ceb42cb443b2509a2376e48d0cc42 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-12Fixing a typoDimitri Mazmanov1-1/+1
Multisite jobs kept failing because of a typo. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: I6e484e6457c7b8bae7c0343e9307bd15222e4fe3
2016-08-11add report flag to parserSerenaFeng1-1/+1
parser has no report flag, every time we run the test the results will be reported to db JIRA: FUNCTEST-410 Change-Id: I6336b4c367fd8edc70e076b81d01d9356580bc22 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-11Merge "[multisite] refactor the scripts of multiste"meimei1-1/+2
2016-08-11[multisite] refactor the scripts of multistemeimei1-1/+2
Change-Id: I07f0f5e253b04c9ac70e6dc4ea210e7cecf22c6a Signed-off-by: meimei <meimei@huawei.com>
2016-08-11change parser path from RNC to vRNCSerenaFeng1-1/+1
JIRA: FUNCTEST-409 Change-Id: I83887160a328c6f022efaa1547ca214571a9a01c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-05Bug fixes odl-sfc + new featuresManuel Buil1-0/+5
* Doing the test with private IPs as floating are currently not working in ODL * New SF takes more time to start the service. A while loop is added. * Configuration of the compute set-up due to ODL limitations added Change-Id: I5449af940caee456262dac66bc47b66fd05c2a70 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-08-01Fix missing directory when calling bgpvpn testsjose.lausuch1-0/+1
Change-Id: Ic9f6b9592202c3bed9d6835eeea7c14971e1c01f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-30Add onos_sfc scenariowuwenbin21-0/+3
JIRA:ONOSFW-172 Change-Id: I019edf79f8d343f794aa7af151d8e30c18e2c5f6 Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch1-14/+1
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Scripts added to enable the SFC-ODL test in CIManuel Buil1-0/+6
We need to install Tacker in the server before running the test cases Change-Id: Id7daee80627bc71c335fcb3efa5d389594641b65 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-28Functional testing for tosca2heat translationSerenaFeng1-0/+3
in Dockerfile, add parser related work in config_functest.yaml/testcase.yaml, add parser related configuration in exec_test.sh to run parser test add vnf/RNC/parser.py script JIRA: FUNCTEST-187 Change-Id: I8b53774da00f13b630ec5d9f750817db892a82bb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-27Enable odl-sfc in CIManuel Buil1-0/+3
JIRA:FUNCTEST-392 Change-Id: If1c931df26062501695061e1155eb26ad007c8de Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-20Bugfix: ODL report to DB failsjose.lausuch1-9/+9
JIRA: FUNCTEST-370 Change-Id: I48c8927f3490b86fcf1c95656324429b70201653 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Use blacklist of Tempest test cases for SDNVPN scenariojose.lausuch1-1/+14
This patch disables tempest smoke from being executed in bgpvpn scenarios. Since there is a known upstream issue which won't be resolved before Colorado, it doesn't make sense to run the test cases in Tempest that will fail due to that issue. The Tempest suite will be triggered along with the "features" tier, with a given blacklist of the known test that will fail. JIRA: FUNCTEST-369 Change-Id: Ifc533077207e9d62d49bcedcc3cd0936df312891 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Disable ODL reporting to DBjose.lausuch1-9/+9
The script odlreport2db.py fails and it needs more investigation and troubleshooting. For now, we disable it to not block CI JIRA:FUNCTEST-370 Change-Id: I9952fd7c5238212d6ed1437f1595fdadde9208f2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15[bug] miss a ; in case statementmeimei1-0/+1
Change-Id: I2e3d99203450d2abc93e5f472c6be701a385a3c6 Signed-off-by: meimei <meimei@huawei.com>
2016-07-14Enable domino multi-node test case in FunctestUlas Kozat1-0/+2
This includes: - Add domino.py script - Add call to domino.py - Add the Domino repo in the Dockerfile - Add the test case definition in testcases.yaml JIRA: FUNCTEST-246 Change-Id: I5a8c3345a14c43fa80e6e86678ae5fb1417b3147 Signed-off-by: Ulas Kozat <ulas.kozat@gmail.com>
2016-07-14Enable new SDNVPN test cases in Functestjose.lausuch1-1/+1
JIRA:FUNCTEST-99 The tempest execution has been moved to the sdnvpn to leverage the logic of execution and collecting the results from the executor wrapper: sdnvpn/test/functest/run_tests.py Change-Id: Ic4763f4ab45dde81f91b241ae91073b9ea47e333 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Switch to $SDN_CONTROLLER_IP instead of $neutron_ipCédric Ollivier1-2/+2
ODL IP is now set to $SDN_CONTROLLER_IP in case of Apex and default. It follows the next patch [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/16779/ Change-Id: I60238705e45ed31a67da1518ec586e3f2970c13f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-14[multisite] integrate kingbird tempest testcasesmeimei1-0/+2
JIRA: FUNCTEST-179 Change-Id: I4a8ae43e2814b3d859c32a6278671f87155aa855 Signed-off-by: meimei <meimei@huawei.com>
2016-07-13Propose a new python file to launch ODL testingCédric Ollivier1-3/+5
OpenDaylightTesting.py safely replaces start_tests.sh. It also adds the report of the basic test of RESTConf which was previously ignored. JIRA: FUNCTEST-367 Change-Id: I8ba288271455fd9f31cf87aa65bf45cfb53cd8d6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-13Enhance ips, ports and creds managementCédric Ollivier1-1/+3
It follows the next ODL patch [1] which splits Keystone and Neutron IPs in Robotframework files. It also adds ODL creds, ODL ports and tenant name as inputs. Classical default values are also used now. [1] https://git.opendaylight.org/gerrit/#/c/41554/ Change-Id: I867f1d4c003c4b96a5d4c3e2f982b5a0e3139217 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-13[multisite] add interface of multisite test suitemeimei1-0/+3
JIRA: FUNCTEST-179 Change-Id: I23ae0f73a6efb410e54fedd75537bb2e219344e0 Signed-off-by: meimei <meimei@huawei.com>
2016-07-08Create vnf directory in testcasesMorgan Richomme1-1/+1
JIRA: FUNCTEST-358 Change-Id: I00dacef2a07e3980cc33cdbfad7ea238c1153599 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-06Add Moon in FunctestMorgan Richomme1-0/+4
JIRA: FUNCTEST-210 Change-Id: Ibc8792f74c4c62122856cff355e55cda88fc691e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-06Add copper for CI integrationMorgan Richomme1-0/+3
JIRA: FUNCTEST-67 Change-Id: Idffa4ccae4eb51ad335a5c49876bb18731990e84 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-05Enable doctor test scenario in masterRyota MIBU1-2/+1
The doctor testing script has fixed and improved by adding timeout function, now it can be back to enable. Change-Id: I5b5602dc3453cdbca14fc78aa567b69b27896a5d Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-07-04Add interface to run sfc functests.wuwb19891-5/+1
Varified only in fuel. Prerequisite: no floating ip exists. Change-Id: If6ef4c395992ba1544559b47c5c97f7cd5ce004c Signed-off-by: wuwb1989 <wuwenbin2@huawei.com>
2016-06-29Suspend Doctor execution on Master for apex scenarioMorgan Richomme1-1/+2
Change-Id: I6a0e8969484ced97a08b87e1fc48a4e53e57bb9d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-16Fixed auth url in v2.PasswordLuke Hinds1-1/+1
Completes "Added use of OS_AUTH_URL to security_scan and exec_test.sh" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/15633/ Change-Id: I756c10091c3e7fe9e7c8978e2747582bb0f4d281 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-15Added use of OS_AUTH_URL to security_scan and exec_test.shLuke Hinds1-1/+3
JIRA: FUNCTEST-315 Change-Id: I1f8ac20cd93ce25548dbf47d62fc6a076d347d62 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-14Enable security scanningLuke Hinds1-2/+1
Change-Id: Ib179ee6b2fcc7cf6c9ac522fdb83755ecbb99f52 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-06-02Stop the job and quit with error if a test case failsjose.lausuch1-0/+4
JIRA: FUNCTEST-282 Change-Id: I9fd638c19333772040481140f9e2324b7d80772f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-31Add Apex based security scan codelukehinds1-2/+2
JIRA: FUNCTEST-169 Performs a SCAP based security scan of all overcloud nodes, followed by report download to functest dashboard Change-Id: I9058227e19c0877e5f8913931febdd667a908cdd Signed-off-by: lukehinds <lukehinds@gmail.com>
2016-05-26Take report arg into accountCédric Ollivier1-1/+2
$report is now tested before calling odlreport2db.py Change-Id: I92be1488f710065dbc0a0c00e8023c6201028c2f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Add security_scan in Functest CI pipelineMorgan Richomme1-1/+7
JIRA: FUNCTEST-258 Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>