summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-08-30Force stdin, stdout and stderr to be totally unbufferedCédric Ollivier1-0/+1
It protects against mixed logs as lots of python scripts directly call print which doesn't flush stdout as opposed to log.info(). This requirement is induced by subprocess.Popen() initiated by run_tests.py. The following programs could switch to logging instead of print [1] [1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \ |grep \ print\ |cut -d: -f 1 |sort -u ./testcases/Controllers/ODL/OpenDaylightTesting.py ./testcases/Controllers/ONOS/Sfc/Sfc_fun.py ./testcases/Controllers/ONOS/Sfc/Sfc.py ./testcases/Controllers/ONOS/Teston/adapters/client.py ./testcases/Controllers/ONOS/Teston/adapters/connection.py ./testcases/Controllers/ONOS/Teston/adapters/environment.py ./testcases/Controllers/ONOS/Teston/adapters/foundation.py ./testcases/OpenStack/vPing/vping_util.py ./testcases/security_scan/connect.py ./utils/functest_utils.py ./utils/functest_vacation.py ./utils/openstack_clean.py JIRA: FUNCTEST-441 Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-30Merge "Stop hard-coding db url"Morgan Richomme1-3/+3
2016-08-30Merge "Flush stdout as it can be redirected to log"Morgan Richomme1-0/+1
2016-08-30Exclude floating-ip related tempest tests to blacklist for bgpvpn scenariojose.lausuch1-0/+2
Change-Id: I7115018e64a2413209313b9a432d3d1b59e841d1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-08-30Stop hard-coding db urlCédric Ollivier1-3/+3
Change-Id: I587ac6d210135e7124ba006a977a675a4d38b518 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-30Flush stdout as it can be redirected to logCédric Ollivier1-0/+1
It avoids mixed logs in Jenkins' console by flushing every message printed by the forked programs as logger.info() does. It must be complete by refactoring logger management in util functions [1] and by preventing output buffering in forked programs. [1] https://jira.opnfv.org/browse/FUNCTEST-428 JIRA: FUNCTEST-441 Change-Id: Id8da814d79ea6b1e6b91b49e23a85c3802e11515 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-30Merge "Set env vars as mandatory to push to DB"Morgan Richomme2-11/+25
2016-08-30Merge "Update Release note"Morgan Richomme1-21/+40
2016-08-29Update Release noteMorgan Richomme1-21/+40
JIRA: FUNCTEST-436 Change-Id: I3cbf6b276494c77afb10802af6735647ea6e62d5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-29Merge "Review dev guide"Morgan Richomme1-98/+147
2016-08-29Review dev guideMorgan Richomme1-98/+147
JIRA: FUNCTEST-433 Change-Id: Ic141a5b74d9b3afc165e1f1f65f3dc1b05d77f4e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-26Set env vars as mandatory to push to DBCédric Ollivier2-11/+25
Now env vars are mandatory in push_results_to_db. It avoids testing programs to check them even if they are useless from their points of view. The related getters aren't removed to help debugging via logger_test_results which could be run without report. Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-26Merge "configuration guide review"Morgan Richomme2-42/+48
2016-08-26configuration guide reviewMorgan Richomme2-42/+48
JIRA: FUNCTEST-435 Change-Id: I5b18f1223a5892d084c761f174ac5f713ceed476 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-26refactor create shared network process to eliminate reduplicateSerenaFeng3-32/+33
Some places shared network is created through create_network_full first, then update it to shared, abstract a uniformed method to eliminate reduplicate JIRA: FUNCTEST-437 Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-26Merge "refactor create or get image process to eliminate reduplicate"Morgan Richomme4-56/+35
2016-08-26Merge "Stop calling exec_test.sh in the middle of python scripts"Morgan Richomme4-6/+53
2016-08-26Merge "[Fuel] Skip test_server_basic_ops tempest test"Morgan Richomme1-0/+14
2016-08-26refactor create or get image process to eliminate reduplicateSerenaFeng4-56/+35
Some places when create image is referred, they check if image exist, if exist use it directly, else create a new one. Abstract a method to integrate the process JIRA: FUNCTEST-432 Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-24Stop calling exec_test.sh in the middle of python scriptsCédric Ollivier4-6/+53
Now run_tests.py calls directly OpenDaylightTesting.functest_run(). It mainly reads env vars as exec_test.sh does. Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-24Use by default the default ODL web portCédric Ollivier1-5/+3
Change-Id: I7580f02dd5b2db6cf06690ef0163768ea59079fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-24Fixing commit f1054f8fFerenc Cserepkei1-1/+1
fix missed the apt-get action Change-Id: Iac94576a2f712133eee92e4b5460f85d59e90e94 Signed-off-by: Ferenc Cserepkei <ferenc.cserepkei@ericsson.com>
2016-08-24Merge "Included correct links (Colorado) to Doctor/Promise user guides"Morgan Richomme2-4/+4
2016-08-24Included correct links (Colorado) to Doctor/Promise user guidesBertrand Souville2-4/+4
Change-Id: I9f6a3d806407f088bd97826c978417d23b18613a Signed-off-by: Bertrand Souville <souville@docomolab-euro.com>
2016-08-24[SFC] Fixing CINikolas Hermanns1-0/+1
The fix https://gerrit.opnfv.org/gerrit/#/c/19351 will need more time for dicussion. In the meanwhile we can use this one so that CI does not break anymore. Change-Id: Icbd54200bd62e5019c2a556699ceb41afdb229ca Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2016-08-23Merge "Avoid duplicating logs in run_tests.py"valentin boucher2-2/+3
2016-08-23Merge "when create/get/update failed return None rather than False"Morgan Richomme4-28/+28
2016-08-23Merge "delete useless image_exists in vping"Morgan Richomme2-7/+2
2016-08-23Avoid duplicating logs in run_tests.pyCédric Ollivier2-2/+3
When run_tests.py sets logger as execute_command arg, logs are duplicated in functest.log and not shown in console (as every DEBUG message). As logger is mainly managed by the python scripts in charge of testing, it can be safely removed here. stderr is also redirected to stdout in execute_command to print possible relevant data. JIRA: FUNCTEST-431 Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-23when create/get/update failed return None rather than FalseSerenaFeng4-28/+28
In openstack_util.py, when create/get/update network or other resources failed, False is returned, which is incompatible with success return value such as id, network_nic. JIRA: FUNCTEST-427 Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23Enable security scan for apex scenariosvitikkan1-1/+1
Change-Id: I6c2925237d7ae437f49d60d37ef906ed8029eb03 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-23[Fuel] Skip test_server_basic_ops tempest testMichael Polenchuk1-0/+14
Skip TestServerBasicOps which fails when deleting server and floating ip almost at the same time. JIRA: FUEL-173 JIRA: FUEL-176 Change-Id: I24f3397096757028bed9d32d6353aa689e8eaa9a Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-08-23Merge "refactor push_result_to_db print thing"Morgan Richomme1-11/+38
2016-08-23refactor push_result_to_db print thingSerenaFeng1-11/+38
when Exceptions happen, the print code is too difficult to understand and maintain, modify to make it clear jira: FUNCTEST-425 Change-Id: Ie12af989e711df3791167955642f2edf1164b146 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23Create tempest resources before generating tempest.confvitikkan1-1/+1
During generating tempest.conf file rally tries to download cirros image from the internet if no suitable images exist in the configuration. This change ensures that cirros image is created before generating tempest.conf file. JIRA: FUNCTEST-195 Change-Id: I9e2df8af40bd02db9b78b8b6b730b4f4168a8b2d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-23Merge "doctor test support fuel installer"Morgan Richomme1-1/+1
2016-08-23Merge "Add logger to push_results_to_db args"Morgan Richomme1-1/+1
2016-08-23Merge "Point tempest to stable 12.1.0"Morgan Richomme1-1/+1
2016-08-23Add logger to push_results_to_db argsCédric Ollivier1-1/+1
It conforms to the current implementation of functest_utils Change-Id: I50fa05fbf81a7c76cf4a6e3ef906fffe8aec15bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-23delete useless image_exists in vpingSerenaFeng2-7/+2
In rally, image_exists is used to decide whether the image resource should be cleaned or not. But unlike rally, image_exists in vping is only assigned but not never be actually used. JIRA: FUNCTEST-426 Change-Id: Id2089dd2a9734ba957cc1c80d4dc31bc27907b0a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23doctor test support fuel installerdongwenjuan1-1/+1
Change-Id: I9229d4de823568bfefd4f2c1ab5c5c1a1ded6d2c Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>
2016-08-22Fix typos in OpenDaylightTestingCédric Ollivier1-2/+2
Change-Id: Ia70c1db358b727a910a38b679de0e3c6febdb0cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-22Mend create_image() functionMichael Polenchuk1-0/+2
Change-Id: I91681736817f881ca53e5124328bd4399aa54740 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-08-22Merge changes from topics 'dont_open_twice', 'add_logs', 'manage_return_codes'Morgan Richomme1-15/+21
* changes: Avoid opening tmp files twice Add logs (info) Improve errors and status codes management
2016-08-22Merge "bugfix: push_result_to_db exception show"Morgan Richomme1-0/+5
2016-08-22Avoid opening tmp files twiceCédric Ollivier1-2/+6
It avoids opening stdout.txt twice and removes it at the end. Change-Id: I7e006b52f49dd32543676259e0a1be2473670487 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-22Merge "Bug fix - Better way to grab file from gerrit"valentin boucher1-3/+5
2016-08-22Add logs (info)Cédric Ollivier1-2/+3
It adds logs (info) when status is ok and fixes an exception printing too. It removes one useless log (debug). Change-Id: Ia59c3985ae749b80d0e0c07f331220bd33cd8007 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-22bugfix: push_result_to_db exception showSerenaFeng1-0/+5
When pod is not exist in DB, exception will be shown as 'Error pushing results into Database '<type 'exceptions.TypeError'>'', very unclear, make it very difficult to fix the problem. Modify it to show as the testapi returned 'HTTPError: HTTP 404: Not Found (Could not find pod [zte-no])' JIRA: FUNCTEST-424 Change-Id: I55fc4639d745b84f6d32a148bd13793d236e2a09 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-22Improve errors and status codes managementCédric Ollivier1-11/+12
Run returns the number of errors which is irrelevant to catch as they are published to DB. Useless generated files are desactivated too. Change-Id: I2baf6d5242c5f4095302a47ff90272fb95103457 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>