summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-09-05Switch print to logging.infoCédric Ollivier5-32/+44
It follows the recommendations described in the next review [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/19795/ Change-Id: Ie7ce28451122c554f135caad068844c0303deaeb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0ae5f5fc64868e8c68eb330fa5aa219abdbdfee0)
2016-09-05Revert excluding floating IP cases from odl_l3vitikkan2-21/+4
Only restrictions table in release notes is updated. Change-Id: I8f27a876058eabe1c490fc5980de5626aed665a3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit beb0b0c8fddbdfd45fef0a7e9548b52e48f94c45)
2016-09-05Exclude test cases that use floating IP from odl_l3 scenariosvitikkan2-0/+24
All the tempest_smoke_serial test cases that use floating IP addresses for accessing instances are excluded because of ODL bug https://bugs.opendaylight.org/show_bug.cgi?id=5586 JIRA: FUNCTEST-445 Change-Id: I19468be108a25e989c0cfef031bbe5f2b9db0964 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit 0e29b1b97d1b996706aca692872fca5488a3acf7)
2016-09-02stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng17-72/+54
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 470f573a3ac2eb1783efec6da01a3bee33360c65)
2016-09-02Merge "Refactor SFC testcase" into stable/coloradoJose Lausuch1-49/+54
2016-09-02unify functest_yaml obtain processSerenaFeng14-71/+38
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit f4d0a05011e961a363c6d99522684ecdeb959716)
2016-09-02Fixes cleaning up HA Neutron objectsTim Rozet1-0/+11
This fixes a race condition where the cleanup method is trying to remove HA networks, while Neutron is also trying to remove the network - after the HA router is removed. This only applies to installations where Neutron L3 HA is enabled (nosdn cases only). JIRA: FUNCTEST-454 Change-Id: If06b6f6297e99dcce4b0f2aff8ec80b47488ee90 Signed-off-by: Tim Rozet <trozet@redhat.com> (cherry picked from commit c7effe57d86f77e1d824b9c927d9e8ab70a59695)
2016-09-01Add router association utility functionGeorge Paraskevopoulos1-0/+5
Add function to create an association between a router and a bgpvpn Change-Id: I23449a0363f9d8f3c77ea3be1e104586d3c111d1 Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit 1d01ece307a130bdd0c85ea811b3b72cc6d53156)
2016-09-01Fix some bugsboucherv2-2/+2
Change-Id: Iaf0859775933ba09cbbe170af3ce4ed1e6d3e9a1 Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit 26f493bf3bb06a0ceb959294397ff653b92da202)
2016-09-01Add a specific logger for orchestrator classboucherv2-60/+45
JIRA: FUNCTEST-428 Change-Id: I1aab08f8f92df3b5527e6f8121cdf45aec2f5c17 Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit dbbf8da5725f18eede541c82f6adac90a955f43d)
2016-08-31Remove copper from lxd scenarioMorgan Richomme1-1/+1
JIRA: FUNCTEST-452 Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit bb699b3cfc146566ba54aa96111cf5a05839322a)
2016-08-31Refactor SFC testcaseGeorge Paraskevopoulos1-49/+54
- Change the way the test checks if the vxlan_tool has started. Now the vxlan_tool is detected even if another python process is up. - Log the exceptions in the vxlan_tool check block. The exceptions that occur are not destructive for the testcase but it's better to be visible. - Add a 60 seconds sleep before the testcase starts to give plenty of time to ODL to add the correct flows. - Move the testcase success/fail check blocks inside the try blocks. The checks are performed on the stdout variable which is in scope only inside the try blocks. Change-Id: I49dec176fb83117e9896ac1d19e8a5bd95e3d7cf Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit 563a540585768d900d70ce79f2a871a9d1fab03e)
2016-08-31Use a global logger instead of method argsCédric Ollivier1-74/+44
It's the first step to safely remove all logers as method args. Outputs printed by bash scripts called by execute_command are no longer written in functest.log. Else logs printed by python scripts will be duplicated in it. JIRA: FUNCTEST-428 Change-Id: I60702f3b62121f731cd6845c335e227f97df37c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fe5d0f8628b8e0defdfc6e3b0e4556b46311a2f9)
2016-08-31unify testcases.yaml obtain processSerenaFeng4-8/+8
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever testcases.yaml is needed, abstract a method to provide unified interface JIRA: FUNCTEST-449 Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit f5afb93a4a2ed9547757655c1405ef27fabed11b)
2016-08-31delete useless FUNCTEST_REPO variableSerenaFeng5-5/+0
FUNCTEST_REPO appears in lots of feature testcases, but never be used, delete it clean the code JIRA: FUNCTEST-448 Change-Id: I4a9a10eac29e09b481563ed2c33f4122dd9ee3de Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 834f81f0ad708b930f66aec1fd8b36e2cfb8b32b)
2016-08-31Release note: add restriction for joid/dominoMorgan Richomme2-12/+20
JIRA: FUNCTEST-436 Change-Id: I44fb50a2ef58095aff54f03b837bf456850f3057 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit e1cf8564b1f06a64863ee463b817935ec58f834c)
2016-08-31Update Release noteMorgan Richomme1-21/+40
JIRA: FUNCTEST-436 Change-Id: I3cbf6b276494c77afb10802af6735647ea6e62d5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 2d3b3b01e9c53930ff4bfa9d1142a3a25bba42a0)
2016-08-31parser fails on virtual environementSerenaFeng1-1/+1
Parser tests needs lots of resources, such as vcpu/memory/disk, virtuals pod may not meet the requirements, so exclude Parser running on virtual pods by exclude 'noha' scenario JIRA: FUNCTEST-444 Change-Id: I6f2832fa0f727f762987c41d7a3485dede041151 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 35cf15a87126b6947b59899cd726f4b92599fe79)
2016-08-31Fix problem with SFC testBrady Johnson1-0/+5
- If its not possible to get the IPs, then exit - Patch Set 2: addressed code review comments Change-Id: I16e22513b32e2b0da311ebcc280f3611570634a3 Signed-off-by: Brady Johnson <brady.allen.johnson@ericsson.com> (cherry picked from commit 429ea989e665ebc3dac381c2629662f327dd9a46)
2016-08-31Committer promotion: Cedric OllivierMorgan Richomme1-0/+1
Cedric joind Functest for Colorado He fully refactored the ODL section including work upstream within ODL community In addition of ODL skills, Cedric is a great benevolent reviewer. Even if he is famous in the project for his gerrit -1, his reviews are always usefull and clearly consolidate the code baseline for functest. He is very relevant on all the technical aspects and we always need a Debianist among commiters Change-Id: I4bd0f778edfaa0d8969bdda3387d5a5ebc8b0f93 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit bb88bedfd4410ca6057fe9a2512537b25ba7c326)
2016-08-31Committer promotion: Serena FengMorgan Richomme1-0/+1
Serena has joined the project for Colorado She managed 22% of the open JIRAs (Ast rank in Functest) She fully managed the refactoring of the testapi used by most of the projects She also was key for the integration of several feature projects She replaced the PTL during Summer Change-Id: Id2a1ca253f80a425d7db4cb64591a44b4bcc5898 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 648a32fcf32390a301c75dd21aa7bae2ff5580d0)
2016-08-30disable test case does not make sense for LXD.Narinder Gupta1-0/+11
This patch will disable the test cases which does not make sense to run on LXD deployments. Change-Id: I683b3714aa5af3c750ca57fab9fceff907b7d646 Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com> (cherry picked from commit 029a659b4198611dc93b6b41f42c3939a98de5bd)
2016-08-30update fuel ref in tacker setup scriptFerenc Cserepkei1-1/+1
Since the poc script is fixed it's fuel commit hash in the setup script have to be updated to select the fixed poc script. Change-Id: I1fd22e4dc216fd2889adea0c9889df1d4a1bf476 Signed-off-by: Ferenc Cserepkei <ferenc.cserepkei@ericsson.com> (cherry picked from commit 0d1faa954ec5a5e2911a2ec6df2f0a5f8782a623)
2016-08-30Exclude healthcheck from lxd scenariosMorgan Richomme1-1/+1
JIRA: FUNCTEST-442 Change-Id: I1f6888dbddebf28af4b565ca87d9791a21cd4d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 9b77f96822457e20bd5c5249c41bf498a3351b2b)
2016-08-30Allow realtime Jenkins' console outputCédric Ollivier1-1/+1
Change-Id: I6005000762eb6e7bb7e40ccaea35004a07b47aa1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8afd88fdf4574136d44cfaa8b01a4fa89e6a7a81)
2016-08-30Force stdin, stdout and stderr to be totally unbufferedCédric Ollivier1-0/+1
It protects against mixed logs as lots of python scripts directly call print which doesn't flush stdout as opposed to log.info(). This requirement is induced by subprocess.Popen() initiated by run_tests.py. The following programs could switch to logging instead of print [1] [1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \ |grep \ print\ |cut -d: -f 1 |sort -u ./testcases/Controllers/ODL/OpenDaylightTesting.py ./testcases/Controllers/ONOS/Sfc/Sfc_fun.py ./testcases/Controllers/ONOS/Sfc/Sfc.py ./testcases/Controllers/ONOS/Teston/adapters/client.py ./testcases/Controllers/ONOS/Teston/adapters/connection.py ./testcases/Controllers/ONOS/Teston/adapters/environment.py ./testcases/Controllers/ONOS/Teston/adapters/foundation.py ./testcases/OpenStack/vPing/vping_util.py ./testcases/security_scan/connect.py ./utils/functest_utils.py ./utils/functest_vacation.py ./utils/openstack_clean.py JIRA: FUNCTEST-441 Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d32ff56af10bcc15163d573a64970013242c689c)
2016-08-30Stop hard-coding db urlCédric Ollivier1-3/+3
Change-Id: I587ac6d210135e7124ba006a977a675a4d38b518 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fee070fcc4a31735abb88b303742bb05f12b53e7)
2016-08-30Flush stdout as it can be redirected to logCédric Ollivier1-0/+1
It avoids mixed logs in Jenkins' console by flushing every message printed by the forked programs as logger.info() does. It must be complete by refactoring logger management in util functions [1] and by preventing output buffering in forked programs. [1] https://jira.opnfv.org/browse/FUNCTEST-428 JIRA: FUNCTEST-441 Change-Id: Id8da814d79ea6b1e6b91b49e23a85c3802e11515 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c7edada4ccf84851b76b9ef738c270a7a6819a06)
2016-08-30Exclude floating-ip related tempest tests to blacklist for bgpvpn scenariojose.lausuch1-0/+2
Change-Id: I7115018e64a2413209313b9a432d3d1b59e841d1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit fbe4b77d39e0520e2f34a81dae7010b0f01d2aa2)
2016-08-30Set env vars as mandatory to push to DBCédric Ollivier2-11/+25
Now env vars are mandatory in push_results_to_db. It avoids testing programs to check them even if they are useless from their points of view. The related getters aren't removed to help debugging via logger_test_results which could be run without report. Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 66334bc798c25d5769f92f2a6292daaf6220da79)
2016-08-29Review dev guideMorgan Richomme1-98/+147
JIRA: FUNCTEST-433 Change-Id: Ic141a5b74d9b3afc165e1f1f65f3dc1b05d77f4e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 94c22c662fa057a181f76ef28bddc0c5ac949e7e)
2016-08-26configuration guide reviewMorgan Richomme2-42/+48
JIRA: FUNCTEST-435 Change-Id: I5b18f1223a5892d084c761f174ac5f713ceed476 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit e9876bd337af54883fe46e49343abc22cfd0404f)
2016-08-26refactor create shared network process to eliminate reduplicateSerenaFeng3-32/+33
Some places shared network is created through create_network_full first, then update it to shared, abstract a uniformed method to eliminate reduplicate JIRA: FUNCTEST-437 Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 007868e4810aaf9a2664b030281fe7c818fc3494)
2016-08-26refactor create or get image process to eliminate reduplicateSerenaFeng4-56/+35
Some places when create image is referred, they check if image exist, if exist use it directly, else create a new one. Abstract a method to integrate the process JIRA: FUNCTEST-432 Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 5f5af6b1d8d0af19db143e67f04f67a643af863c)
2016-08-26Stop calling exec_test.sh in the middle of python scriptsCédric Ollivier4-6/+53
Now run_tests.py calls directly OpenDaylightTesting.functest_run(). It mainly reads env vars as exec_test.sh does. Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d6484df9b602f0888450ef1e29ccc0a5f6c94675)
2016-08-26[Fuel] Skip test_server_basic_ops tempest testMichael Polenchuk1-0/+14
Skip TestServerBasicOps which fails when deleting server and floating ip almost at the same time. JIRA: FUEL-173 JIRA: FUEL-176 Change-Id: I24f3397096757028bed9d32d6353aa689e8eaa9a Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 44819aec4a70a75abc9fbcff23edd9d904170bf7)
2016-08-25Use by default the default ODL web portCédric Ollivier1-5/+3
Change-Id: I7580f02dd5b2db6cf06690ef0163768ea59079fe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 683db3a5d67aeead1090008bce7701ffb208a15c)
2016-08-24Fixing commit f1054f8fFerenc Cserepkei1-1/+1
fix missed the apt-get action Change-Id: Iac94576a2f712133eee92e4b5460f85d59e90e94 Signed-off-by: Ferenc Cserepkei <ferenc.cserepkei@ericsson.com> (cherry picked from commit 2002f166154ca5a9380f9d2da2843477669af8f5)
2016-08-24Included correct links (Colorado) to Doctor/Promise user guidesBertrand Souville2-4/+4
Change-Id: I9f6a3d806407f088bd97826c978417d23b18613a Signed-off-by: Bertrand Souville <souville@docomolab-euro.com> (cherry picked from commit 218e49c9729f3ecfe3661a6efce0a46a6ba4e278)
2016-08-24[SFC] Fixing CINikolas Hermanns1-0/+1
The fix https://gerrit.opnfv.org/gerrit/#/c/19351 will need more time for dicussion. In the meanwhile we can use this one so that CI does not break anymore. Change-Id: Icbd54200bd62e5019c2a556699ceb41afdb229ca Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com> (cherry picked from commit f1054f8f7c787e50df0c0e27ecb10752393071e2)
2016-08-23Avoid duplicating logs in run_tests.pyCédric Ollivier2-2/+3
When run_tests.py sets logger as execute_command arg, logs are duplicated in functest.log and not shown in console (as every DEBUG message). As logger is mainly managed by the python scripts in charge of testing, it can be safely removed here. stderr is also redirected to stdout in execute_command to print possible relevant data. JIRA: FUNCTEST-431 Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 53fd052b7fce64294c50ca170d42367d711ccc3f)
2016-08-23when create/get/update failed return None rather than FalseSerenaFeng4-28/+28
In openstack_util.py, when create/get/update network or other resources failed, False is returned, which is incompatible with success return value such as id, network_nic. JIRA: FUNCTEST-427 Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 3e95a1cd0721924e89e2cfd2960d4736bc6c5588)
2016-08-23delete useless image_exists in vpingSerenaFeng2-7/+2
In rally, image_exists is used to decide whether the image resource should be cleaned or not. But unlike rally, image_exists in vping is only assigned but not never be actually used. JIRA: FUNCTEST-426 Change-Id: Id2089dd2a9734ba957cc1c80d4dc31bc27907b0a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 73053cd38fed875e3e5d64cabfb7fbfeb2839a80)
2016-08-23Enable security scan for apex scenariosvitikkan1-1/+1
Change-Id: I6c2925237d7ae437f49d60d37ef906ed8029eb03 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit da6398642446f98240d9d1bf924e959e64a73d63)
2016-08-23refactor push_result_to_db print thingSerenaFeng1-11/+38
when Exceptions happen, the print code is too difficult to understand and maintain, modify to make it clear jira: FUNCTEST-425 Change-Id: Ie12af989e711df3791167955642f2edf1164b146 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 2588e2af6c2b609ab08957268f8163954cd8eae1)
2016-08-23Create tempest resources before generating tempest.confvitikkan1-1/+1
During generating tempest.conf file rally tries to download cirros image from the internet if no suitable images exist in the configuration. This change ensures that cirros image is created before generating tempest.conf file. JIRA: FUNCTEST-195 Change-Id: I9e2df8af40bd02db9b78b8b6b730b4f4168a8b2d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit 93f4a6576d58522dfbb458f184399767ef8764aa)
2016-08-23doctor test support fuel installerdongwenjuan1-1/+1
Change-Id: I9229d4de823568bfefd4f2c1ab5c5c1a1ded6d2c Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn> (cherry picked from commit e0a17212d21ae7d76c55791ab8bcde1c66df3158)
2016-08-23Add logger to push_results_to_db argsCédric Ollivier1-1/+1
It conforms to the current implementation of functest_utils Change-Id: I50fa05fbf81a7c76cf4a6e3ef906fffe8aec15bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8541642abd6504d5df021654a7481fc90315da8c)
2016-08-23Point tempest to stable 12.1.0Michael Polenchuk1-1/+1
Checkout tempest to the latest stable tag instead of master development branch. Change-Id: I20c7e83bf6441e84b9441f4cb193681753f81300 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 132774cfdca1f8c4cb6f62baed15314f657e0e0b)
2016-08-22Fix typos in OpenDaylightTestingCédric Ollivier1-2/+2
Change-Id: Ia70c1db358b727a910a38b679de0e3c6febdb0cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 43a98904445a7151b586f996ae5d0e858fa24b98)