summaryrefslogtreecommitdiffstats
path: root/testcases
AgeCommit message (Collapse)AuthorFilesLines
2016-09-08make use of functest_utils.get_parameter_from_yamlSerenaFeng13-270/+274
JIRA: FUNCTEST-463 Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 55d301a2622ff5b63d431b9272caa68224d53843)
2016-09-08Exclude some Rally/Nova tests from lxd noha scenarioMorgan Richomme1-0/+1
JIRA: FUNCTEST-464 Change-Id: I0b5014eabccd60c9efaacc4ee529e7b44fd070b2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 1d0e2d8bfb0a0cd070551d57c7669c02e86196ea)
2016-09-08remove imported FUNCTEST_REPO objectSerenaFeng8-29/+33
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/ **** Do not import objects, only modules (*) **** so direct FUNCTEST_REPO import should be avoided from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO JIRA: FUNCTEST-459 Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-07Add blacklist handling for rally test casesJuha Kosonen3-18/+73
Test cases can be excluded from execution based on installer/scenario via blacklist file. JIRA: FUNCTEST-451 Change-Id: I17bbd5f1364a890b88bc196cbc5f49c492df1cb1 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-09-07Exclude Rally/Nova tests for lxd scenarioMorgan Richomme1-0/+7
JIRA: FUNCTEST-464 Change-Id: I521f1ccd88579ba411d3691e4c222a2e8b41e1f8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-07Fix image format set for rally test casesJuha Kosonen2-3/+4
Always use image format defined in config_functest.yaml when creating glance images. JIRA: FUNCTEST-460 Change-Id: Ica6b35605301bc14290daa23a1480114cf6294c0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit b49d6129e2f6a15be9de7b7f04fbec0bd15ee8e6)
2016-09-06Merge "Reduce logging in the SFC test case" into stable/coloradoJose Lausuch2-4/+47
2016-09-06[Promise] Fix bug opening the json result filejose.lausuch1-2/+2
Change-Id: I8882ffc8139095a79b6542c508a6293ae231f232 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 56fa7f26dae9c41235ea1251e1b7d2ea1b389b7c)
2016-09-06[Promise test case] Use proper way to get parameters from yamljose.lausuch1-37/+38
Since there is a function in functest_utils to get a value from the config_functest.yaml directly, there is no need to load again that file. Better to use common functions that are designed for that. Also, Replace location of the results json file to the results directory. It will be also pushed to artifacts repository. Change-Id: Ic6422ed78ccd0f8b40b519342a7dcf38c502924e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 861ad3fe18c6ee672c8c82d5d8ad39c6131fdf85)
2016-09-06Reduce logging in the SFC test caseGeorge Paraskevopoulos2-4/+47
JIRA: FUNCTEST-446 Reduce the logs that appear in the Jenkins CI console to make the output of the SFC test case more readable - Redirect tacker installation logs to results folder /home/opnfv/functest/results/odl-sfc.log - Split odl-sfc preparation into a new script - Pipe STDERR in the sfc.py script so that "Added to known hosts" messages do not show in the output Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-09-06Merge "Remove all logers as utils method args." into stable/coloradoJose Lausuch14-28/+12
2016-09-06Merge "Print all the Parser test output to a log file" into stable/coloradojose.lausuch1-6/+9
2016-09-06Remove all logers as utils method args.Carlos Goncalves14-28/+12
As it modifies method params, it could break the testcases. JIRA: FUNCTEST-428 Conflicts: testcases/features/copper.py testcases/features/doctor.py testcases/features/domino.py Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8bfe49ee5a6d7b93b3ce7fb6aae0072acb1171d9)
2016-09-06Add support of arm for doctorcristinapauna1-2/+9
This is half of the fix to make the doctor suite run on arm. The other half is at https://gerrit.opnfv.org/gerrit/#/c/20369/ In this fix I set an enviroment variable, to be used by the doctor suite when ran with functest. The variable is set only when present in config_functest.yaml, which we use as a custom file when running functest on arm. Change-Id: If34d3e7734a194bf9fe8b525a362e029767caa4f Signed-off-by: cristinapauna <cristina.pauna@enea.com> (cherry picked from commit 53b8060cd60c163315d706a6035e30eb66fe8d15)
2016-09-05Redirect dominio's output to a log fileCarlos Goncalves1-2/+7
Change-Id: Ic4daa57ddbf6587660f982acd915cd4363d3ccbc Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu> (cherry picked from commit e0e414259aded62e66b2795ae789ae81d632902b)
2016-09-05Print all the Copper test output to a log fileCarlos Goncalves1-6/+10
To keep the jenkins console clean and readable, dump all the output that the Copper test case generates to a log file and push it to artifact repository at the end. Change-Id: If4812c7e92b4d050757ca07333f7c353a0220056 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu> (cherry picked from commit 7442f6fb3ec962481d45a8ee0d12ad96242d9c0e)
2016-09-05[Doctor test case] Redirect output to a log fileCarlos Goncalves1-5/+12
The output shown in the Jenkins console will now be redirected to a file which will be available and linked to the artifacts repository. Change-Id: I2e9b5c2ab681a787aa0fc249844cc13feb581764 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu> (cherry picked from commit de6ca443b6ea60111f57bfe1cc6153463847c209)
2016-09-05Switch print to logging.infoCédric Ollivier4-31/+43
It follows the recommendations described in the next review [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/19795/ Change-Id: Ie7ce28451122c554f135caad068844c0303deaeb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0ae5f5fc64868e8c68eb330fa5aa219abdbdfee0)
2016-09-05Revert excluding floating IP cases from odl_l3vitikkan1-19/+0
Only restrictions table in release notes is updated. Change-Id: I8f27a876058eabe1c490fc5980de5626aed665a3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit beb0b0c8fddbdfd45fef0a7e9548b52e48f94c45)
2016-09-05Exclude test cases that use floating IP from odl_l3 scenariosvitikkan1-0/+19
All the tempest_smoke_serial test cases that use floating IP addresses for accessing instances are excluded because of ODL bug https://bugs.opendaylight.org/show_bug.cgi?id=5586 JIRA: FUNCTEST-445 Change-Id: I19468be108a25e989c0cfef031bbe5f2b9db0964 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit 0e29b1b97d1b996706aca692872fca5488a3acf7)
2016-09-02Print all the Parser test output to a log filejose.lausuch1-6/+9
To keep the jenkins console clean and readable, dump all the output that the Parser test case generates to a log file and push it to artifact repository at the end. Change-Id: I04c8507fda535c7bcb0919fc3bc5877336664942 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit fde68435a66f999a0121b20c64e671ac06086cb3)
2016-09-02stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng9-41/+32
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 470f573a3ac2eb1783efec6da01a3bee33360c65)
2016-09-02Merge "Refactor SFC testcase" into stable/coloradoJose Lausuch1-49/+54
2016-09-02unify functest_yaml obtain processSerenaFeng9-51/+24
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit f4d0a05011e961a363c6d99522684ecdeb959716)
2016-09-01Fix some bugsboucherv1-1/+1
Change-Id: Iaf0859775933ba09cbbe170af3ce4ed1e6d3e9a1 Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit 26f493bf3bb06a0ceb959294397ff653b92da202)
2016-09-01Add a specific logger for orchestrator classboucherv2-60/+45
JIRA: FUNCTEST-428 Change-Id: I1aab08f8f92df3b5527e6f8121cdf45aec2f5c17 Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit dbbf8da5725f18eede541c82f6adac90a955f43d)
2016-08-31Refactor SFC testcaseGeorge Paraskevopoulos1-49/+54
- Change the way the test checks if the vxlan_tool has started. Now the vxlan_tool is detected even if another python process is up. - Log the exceptions in the vxlan_tool check block. The exceptions that occur are not destructive for the testcase but it's better to be visible. - Add a 60 seconds sleep before the testcase starts to give plenty of time to ODL to add the correct flows. - Move the testcase success/fail check blocks inside the try blocks. The checks are performed on the stdout variable which is in scope only inside the try blocks. Change-Id: I49dec176fb83117e9896ac1d19e8a5bd95e3d7cf Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit 563a540585768d900d70ce79f2a871a9d1fab03e)
2016-08-31delete useless FUNCTEST_REPO variableSerenaFeng5-5/+0
FUNCTEST_REPO appears in lots of feature testcases, but never be used, delete it clean the code JIRA: FUNCTEST-448 Change-Id: I4a9a10eac29e09b481563ed2c33f4122dd9ee3de Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 834f81f0ad708b930f66aec1fd8b36e2cfb8b32b)
2016-08-31Fix problem with SFC testBrady Johnson1-0/+5
- If its not possible to get the IPs, then exit - Patch Set 2: addressed code review comments Change-Id: I16e22513b32e2b0da311ebcc280f3611570634a3 Signed-off-by: Brady Johnson <brady.allen.johnson@ericsson.com> (cherry picked from commit 429ea989e665ebc3dac381c2629662f327dd9a46)
2016-08-30disable test case does not make sense for LXD.Narinder Gupta1-0/+11
This patch will disable the test cases which does not make sense to run on LXD deployments. Change-Id: I683b3714aa5af3c750ca57fab9fceff907b7d646 Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com> (cherry picked from commit 029a659b4198611dc93b6b41f42c3939a98de5bd)
2016-08-30update fuel ref in tacker setup scriptFerenc Cserepkei1-1/+1
Since the poc script is fixed it's fuel commit hash in the setup script have to be updated to select the fixed poc script. Change-Id: I1fd22e4dc216fd2889adea0c9889df1d4a1bf476 Signed-off-by: Ferenc Cserepkei <ferenc.cserepkei@ericsson.com> (cherry picked from commit 0d1faa954ec5a5e2911a2ec6df2f0a5f8782a623)
2016-08-30Exclude floating-ip related tempest tests to blacklist for bgpvpn scenariojose.lausuch1-0/+2
Change-Id: I7115018e64a2413209313b9a432d3d1b59e841d1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit fbe4b77d39e0520e2f34a81dae7010b0f01d2aa2)
2016-08-26refactor create shared network process to eliminate reduplicateSerenaFeng2-32/+11
Some places shared network is created through create_network_full first, then update it to shared, abstract a uniformed method to eliminate reduplicate JIRA: FUNCTEST-437 Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 007868e4810aaf9a2664b030281fe7c818fc3494)
2016-08-26refactor create or get image process to eliminate reduplicateSerenaFeng3-56/+15
Some places when create image is referred, they check if image exist, if exist use it directly, else create a new one. Abstract a method to integrate the process JIRA: FUNCTEST-432 Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 5f5af6b1d8d0af19db143e67f04f67a643af863c)
2016-08-26Stop calling exec_test.sh in the middle of python scriptsCédric Ollivier3-3/+42
Now run_tests.py calls directly OpenDaylightTesting.functest_run(). It mainly reads env vars as exec_test.sh does. Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d6484df9b602f0888450ef1e29ccc0a5f6c94675)
2016-08-26[Fuel] Skip test_server_basic_ops tempest testMichael Polenchuk1-0/+14
Skip TestServerBasicOps which fails when deleting server and floating ip almost at the same time. JIRA: FUEL-173 JIRA: FUEL-176 Change-Id: I24f3397096757028bed9d32d6353aa689e8eaa9a Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 44819aec4a70a75abc9fbcff23edd9d904170bf7)
2016-08-24Fixing commit f1054f8fFerenc Cserepkei1-1/+1
fix missed the apt-get action Change-Id: Iac94576a2f712133eee92e4b5460f85d59e90e94 Signed-off-by: Ferenc Cserepkei <ferenc.cserepkei@ericsson.com> (cherry picked from commit 2002f166154ca5a9380f9d2da2843477669af8f5)
2016-08-24[SFC] Fixing CINikolas Hermanns1-0/+1
The fix https://gerrit.opnfv.org/gerrit/#/c/19351 will need more time for dicussion. In the meanwhile we can use this one so that CI does not break anymore. Change-Id: Icbd54200bd62e5019c2a556699ceb41afdb229ca Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com> (cherry picked from commit f1054f8f7c787e50df0c0e27ecb10752393071e2)
2016-08-23when create/get/update failed return None rather than FalseSerenaFeng3-7/+7
In openstack_util.py, when create/get/update network or other resources failed, False is returned, which is incompatible with success return value such as id, network_nic. JIRA: FUNCTEST-427 Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 3e95a1cd0721924e89e2cfd2960d4736bc6c5588)
2016-08-23delete useless image_exists in vpingSerenaFeng2-7/+2
In rally, image_exists is used to decide whether the image resource should be cleaned or not. But unlike rally, image_exists in vping is only assigned but not never be actually used. JIRA: FUNCTEST-426 Change-Id: Id2089dd2a9734ba957cc1c80d4dc31bc27907b0a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 73053cd38fed875e3e5d64cabfb7fbfeb2839a80)
2016-08-23Create tempest resources before generating tempest.confvitikkan1-1/+1
During generating tempest.conf file rally tries to download cirros image from the internet if no suitable images exist in the configuration. This change ensures that cirros image is created before generating tempest.conf file. JIRA: FUNCTEST-195 Change-Id: I9e2df8af40bd02db9b78b8b6b730b4f4168a8b2d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit 93f4a6576d58522dfbb458f184399767ef8764aa)
2016-08-23Add logger to push_results_to_db argsCédric Ollivier1-1/+1
It conforms to the current implementation of functest_utils Change-Id: I50fa05fbf81a7c76cf4a6e3ef906fffe8aec15bf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8541642abd6504d5df021654a7481fc90315da8c)
2016-08-22Fix typos in OpenDaylightTestingCédric Ollivier1-2/+2
Change-Id: Ia70c1db358b727a910a38b679de0e3c6febdb0cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 43a98904445a7151b586f996ae5d0e858fa24b98)
2016-08-22Mend create_image() functionMichael Polenchuk1-0/+2
Change-Id: I91681736817f881ca53e5124328bd4399aa54740 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-08-22Merge changes from topics 'dont_open_twice', 'add_logs', 'manage_return_codes'Morgan Richomme1-15/+21
* changes: Avoid opening tmp files twice Add logs (info) Improve errors and status codes management
2016-08-22Avoid opening tmp files twiceCédric Ollivier1-2/+6
It avoids opening stdout.txt twice and removes it at the end. Change-Id: I7e006b52f49dd32543676259e0a1be2473670487 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-22Merge "Bug fix - Better way to grab file from gerrit"valentin boucher1-3/+5
2016-08-22Add logs (info)Cédric Ollivier1-2/+3
It adds logs (info) when status is ok and fixes an exception printing too. It removes one useless log (debug). Change-Id: Ia59c3985ae749b80d0e0c07f331220bd33cd8007 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-22Improve errors and status codes managementCédric Ollivier1-11/+12
Run returns the number of errors which is irrelevant to catch as they are published to DB. Useless generated files are desactivated too. Change-Id: I2baf6d5242c5f4095302a47ff90272fb95103457 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-22Catch exception if output.xml failedCédric Ollivier1-15/+19
It protects against a direct call to push_to_db without a previous run even if it can not happen in the current implementation. Change-Id: Ifa00aed60912fa8b96b80d581067548ac6727fb5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>