summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-09-13[SDNVPN] Disable Rally Sanity test case for bgpvpn scenariosjose.lausuch2-2/+10
Due to a known issue with API performance when bgpvpn extension is activated which causes some delays and the tests take longer time than normal, we get a lot of Jenkins Job timeouts and the scenario cannot be validated. Since it is a performance issue, we black list rally sanity, which takes 1 hour to complete and will re-enable it in Colorado.2.0 where ODL Boron release will be available and SDNVPN team thinks this will be fixed. Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 642661f2de6afa12268e2d2cb854652f3db10ab8)
2016-09-12Exclude Tempest basicops case also in noha scenariosMorgan Richomme1-0/+6
FUNCTEST-470 Change-Id: I7bfd52b5e18e22d78437821906244a8e32ce38a3 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 8cfb05465b9069960e45ffdf50e5cf987f0e8693)
2016-09-09Optimize onos-sfcwuwenbin22-244/+245
1.Delete print and format in onos-sfc 2.Split class into serveral methods in Sfc.py 3.Update Fail process 4.Use vars of HTTP status code Change-Id: Ifb2fc5c570e2c2aa2cfb173eadb32c688a84969e Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com> (cherry picked from commit ccb598c098c813cab4e3e4a3e0f3b2bf0d994489)
2016-09-08make use of functest_utils.get_parameter_from_yamlSerenaFeng20-310/+310
JIRA: FUNCTEST-463 Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 55d301a2622ff5b63d431b9272caa68224d53843)
2016-09-08[Promise] Use the repository from githubjose.lausuch1-1/+1
The patch https://gerrit.opnfv.org/gerrit/#/c/20433/ modified the source of the repository from github to gerrit. Since gerrit repo causes the failures, we change back to the original one where the latest changes are performed. Change-Id: Ibbe944a457ce0ec3f184a33696c302448e25e506 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 4bd8e5f735562c38ad90c411f74f642c6e3ec73f)
2016-09-08Merge "Tempest release verion updated 12.1.0 -> 12.2.0" into stable/coloradoJose Lausuch1-1/+1
2016-09-08Exclude some Rally/Nova tests from lxd noha scenarioMorgan Richomme1-0/+1
JIRA: FUNCTEST-464 Change-Id: I0b5014eabccd60c9efaacc4ee529e7b44fd070b2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 1d0e2d8bfb0a0cd070551d57c7669c02e86196ea)
2016-09-08remove imported FUNCTEST_REPO objectSerenaFeng14-40/+47
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/ **** Do not import objects, only modules (*) **** so direct FUNCTEST_REPO import should be avoided from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO JIRA: FUNCTEST-459 Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-08Tempest release verion updated 12.1.0 -> 12.2.0vitikkan1-1/+1
A bug (https://bugs.launchpad.net/tempest/+bug/1597164) in the older version caused three tearDownClass failures in smoke suite. JIRA: FUNCTEST-466 Change-Id: Iaa5cb7082b05aa938f2088dc635a47d1319f340c Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit d41aae6a119387bc00e22be8c4e6cf91753baa22)
2016-09-07Clone the proper branches in the dockerfilejose.lausuch1-16/+30
JIRA: FUNCTEST-458 Related: https://gerrit.opnfv.org/gerrit/#/c/20431/ Change-Id: I234b1ed9c61411d7f328340612c28dffe12bb605 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 81c83cae960b19366a6acd8d127b562abcfb601f)
2016-09-07Add blacklist handling for rally test casesJuha Kosonen3-18/+73
Test cases can be excluded from execution based on installer/scenario via blacklist file. JIRA: FUNCTEST-451 Change-Id: I17bbd5f1364a890b88bc196cbc5f49c492df1cb1 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-09-07Exclude Rally/Nova tests for lxd scenarioMorgan Richomme1-0/+7
JIRA: FUNCTEST-464 Change-Id: I521f1ccd88579ba411d3691e4c222a2e8b41e1f8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-07Fix image format set for rally test casesJuha Kosonen2-3/+4
Always use image format defined in config_functest.yaml when creating glance images. JIRA: FUNCTEST-460 Change-Id: Ica6b35605301bc14290daa23a1480114cf6294c0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit b49d6129e2f6a15be9de7b7f04fbec0bd15ee8e6)
2016-09-06Merge "Reduce logging in the SFC test case" into stable/coloradoJose Lausuch3-16/+52
2016-09-06Merge "[Promise] Fix bug opening the json result file" into stable/coloradojose.lausuch1-2/+2
2016-09-06Add print-to-a-file option when executing a command in functest_utilsjose.lausuch1-4/+11
Change-Id: I8b91979380d0f4794d5ceaf8edb2a9d80cd7170f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 75479a40514ef2cea93d2ef032e5bfe00f987714)
2016-09-06Merge "Add stable/colorado as defaultbranch" into stable/coloradoMorgan Richomme1-1/+1
2016-09-06Remove source-sans-pro directory, fonts not used and license conflictMorgan Richomme14-84/+0
Change-Id: I0ecdc71fe6cd58923c6fa9ad1bc01a0cc13bf72b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit e848f2851a7d1d23915793e4e99e74bc4f3c4b02)
2016-09-06[Promise] Fix bug opening the json result filejose.lausuch1-2/+2
Change-Id: I8882ffc8139095a79b6542c508a6293ae231f232 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 56fa7f26dae9c41235ea1251e1b7d2ea1b389b7c)
2016-09-06[Promise test case] Use proper way to get parameters from yamljose.lausuch2-51/+51
Since there is a function in functest_utils to get a value from the config_functest.yaml directly, there is no need to load again that file. Better to use common functions that are designed for that. Also, Replace location of the results json file to the results directory. It will be also pushed to artifacts repository. Change-Id: Ic6422ed78ccd0f8b40b519342a7dcf38c502924e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 861ad3fe18c6ee672c8c82d5d8ad39c6131fdf85)
2016-09-06Add stable/colorado as defaultbranchCédric Ollivier1-1/+1
Change-Id: I91278556f56c5c2024a7befd59049912558f5b5a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-09-06Reduce logging in the SFC test caseGeorge Paraskevopoulos3-16/+52
JIRA: FUNCTEST-446 Reduce the logs that appear in the Jenkins CI console to make the output of the SFC test case more readable - Redirect tacker installation logs to results folder /home/opnfv/functest/results/odl-sfc.log - Split odl-sfc preparation into a new script - Pipe STDERR in the sfc.py script so that "Added to known hosts" messages do not show in the output Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-09-06Merge "Remove all logers as utils method args." into stable/coloradoJose Lausuch16-66/+47
2016-09-06Merge "Print all the Parser test output to a log file" into stable/coloradojose.lausuch1-6/+9
2016-09-06Merge "Force python-keystoneclient to version 2.3.1 for tacker to work" into ↵jose.lausuch1-0/+1
stable/colorado
2016-09-06Remove all logers as utils method args.Carlos Goncalves16-66/+47
As it modifies method params, it could break the testcases. JIRA: FUNCTEST-428 Conflicts: testcases/features/copper.py testcases/features/doctor.py testcases/features/domino.py Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8bfe49ee5a6d7b93b3ce7fb6aae0072acb1171d9)
2016-09-06Merge "Change default memory for Promise flavor" into stable/coloradojose.lausuch1-1/+1
2016-09-06Add support of arm for doctorcristinapauna1-2/+9
This is half of the fix to make the doctor suite run on arm. The other half is at https://gerrit.opnfv.org/gerrit/#/c/20369/ In this fix I set an enviroment variable, to be used by the doctor suite when ran with functest. The variable is set only when present in config_functest.yaml, which we use as a custom file when running functest on arm. Change-Id: If34d3e7734a194bf9fe8b525a362e029767caa4f Signed-off-by: cristinapauna <cristina.pauna@enea.com> (cherry picked from commit 53b8060cd60c163315d706a6035e30eb66fe8d15)
2016-09-05Redirect dominio's output to a log fileCarlos Goncalves1-2/+7
Change-Id: Ic4daa57ddbf6587660f982acd915cd4363d3ccbc Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu> (cherry picked from commit e0e414259aded62e66b2795ae789ae81d632902b)
2016-09-05Print all the Copper test output to a log fileCarlos Goncalves1-6/+10
To keep the jenkins console clean and readable, dump all the output that the Copper test case generates to a log file and push it to artifact repository at the end. Change-Id: If4812c7e92b4d050757ca07333f7c353a0220056 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu> (cherry picked from commit 7442f6fb3ec962481d45a8ee0d12ad96242d9c0e)
2016-09-05[Doctor test case] Redirect output to a log fileCarlos Goncalves1-5/+12
The output shown in the Jenkins console will now be redirected to a file which will be available and linked to the artifacts repository. Change-Id: I2e9b5c2ab681a787aa0fc249844cc13feb581764 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu> (cherry picked from commit de6ca443b6ea60111f57bfe1cc6153463847c209)
2016-09-05Switch print to logging.infoCédric Ollivier5-32/+44
It follows the recommendations described in the next review [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/19795/ Change-Id: Ie7ce28451122c554f135caad068844c0303deaeb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 0ae5f5fc64868e8c68eb330fa5aa219abdbdfee0)
2016-09-05Revert excluding floating IP cases from odl_l3vitikkan2-21/+4
Only restrictions table in release notes is updated. Change-Id: I8f27a876058eabe1c490fc5980de5626aed665a3 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit beb0b0c8fddbdfd45fef0a7e9548b52e48f94c45)
2016-09-05Exclude test cases that use floating IP from odl_l3 scenariosvitikkan2-0/+24
All the tempest_smoke_serial test cases that use floating IP addresses for accessing instances are excluded because of ODL bug https://bugs.opendaylight.org/show_bug.cgi?id=5586 JIRA: FUNCTEST-445 Change-Id: I19468be108a25e989c0cfef031bbe5f2b9db0964 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit 0e29b1b97d1b996706aca692872fca5488a3acf7)
2016-09-02Print all the Parser test output to a log filejose.lausuch1-6/+9
To keep the jenkins console clean and readable, dump all the output that the Parser test case generates to a log file and push it to artifact repository at the end. Change-Id: I04c8507fda535c7bcb0919fc3bc5877336664942 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit fde68435a66f999a0121b20c64e671ac06086cb3)
2016-09-02stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng17-72/+54
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 470f573a3ac2eb1783efec6da01a3bee33360c65)
2016-09-02Merge "Refactor SFC testcase" into stable/coloradoJose Lausuch1-49/+54
2016-09-02Change default memory for Promise flavorjose.lausuch1-1/+1
In some scenarios (bgpvpn) the timeout defined in promise to boot/delete vms is too tight. Having less memory might fix the problem as it will take less time and it doesn't impact the promise test case. Change-Id: Ib3165ea5d6518d88384f76c8edd10dddb0b529a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit abc3abc3981ba33d32b446fba8b2d40ceb59ec17)
2016-09-02unify functest_yaml obtain processSerenaFeng14-71/+38
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit f4d0a05011e961a363c6d99522684ecdeb959716)
2016-09-02Fixes cleaning up HA Neutron objectsTim Rozet1-0/+11
This fixes a race condition where the cleanup method is trying to remove HA networks, while Neutron is also trying to remove the network - after the HA router is removed. This only applies to installations where Neutron L3 HA is enabled (nosdn cases only). JIRA: FUNCTEST-454 Change-Id: If06b6f6297e99dcce4b0f2aff8ec80b47488ee90 Signed-off-by: Tim Rozet <trozet@redhat.com> (cherry picked from commit c7effe57d86f77e1d824b9c927d9e8ab70a59695)
2016-09-02Force python-keystoneclient to version 2.3.1 for tacker to workjose.lausuch1-0/+1
Tacker client is installed from Tim Rozet repository, it doesn't support version 3 of the keystone client. Change-Id: Ie2005b1590dfccf93442995e96e0c02b4629edea Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 8167b3f6643c5fb35abcbdd3d6ba56f87541c32b)
2016-09-01Add router association utility functionGeorge Paraskevopoulos1-0/+5
Add function to create an association between a router and a bgpvpn Change-Id: I23449a0363f9d8f3c77ea3be1e104586d3c111d1 Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit 1d01ece307a130bdd0c85ea811b3b72cc6d53156)
2016-09-01Fix some bugsboucherv2-2/+2
Change-Id: Iaf0859775933ba09cbbe170af3ce4ed1e6d3e9a1 Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit 26f493bf3bb06a0ceb959294397ff653b92da202)
2016-09-01Add a specific logger for orchestrator classboucherv2-60/+45
JIRA: FUNCTEST-428 Change-Id: I1aab08f8f92df3b5527e6f8121cdf45aec2f5c17 Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit dbbf8da5725f18eede541c82f6adac90a955f43d)
2016-08-31Remove copper from lxd scenarioMorgan Richomme1-1/+1
JIRA: FUNCTEST-452 Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit bb699b3cfc146566ba54aa96111cf5a05839322a)
2016-08-31Refactor SFC testcaseGeorge Paraskevopoulos1-49/+54
- Change the way the test checks if the vxlan_tool has started. Now the vxlan_tool is detected even if another python process is up. - Log the exceptions in the vxlan_tool check block. The exceptions that occur are not destructive for the testcase but it's better to be visible. - Add a 60 seconds sleep before the testcase starts to give plenty of time to ODL to add the correct flows. - Move the testcase success/fail check blocks inside the try blocks. The checks are performed on the stdout variable which is in scope only inside the try blocks. Change-Id: I49dec176fb83117e9896ac1d19e8a5bd95e3d7cf Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit 563a540585768d900d70ce79f2a871a9d1fab03e)
2016-08-31Use a global logger instead of method argsCédric Ollivier1-74/+44
It's the first step to safely remove all logers as method args. Outputs printed by bash scripts called by execute_command are no longer written in functest.log. Else logs printed by python scripts will be duplicated in it. JIRA: FUNCTEST-428 Change-Id: I60702f3b62121f731cd6845c335e227f97df37c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit fe5d0f8628b8e0defdfc6e3b0e4556b46311a2f9)
2016-08-31unify testcases.yaml obtain processSerenaFeng4-8/+8
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever testcases.yaml is needed, abstract a method to provide unified interface JIRA: FUNCTEST-449 Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit f5afb93a4a2ed9547757655c1405ef27fabed11b)
2016-08-31delete useless FUNCTEST_REPO variableSerenaFeng5-5/+0
FUNCTEST_REPO appears in lots of feature testcases, but never be used, delete it clean the code JIRA: FUNCTEST-448 Change-Id: I4a9a10eac29e09b481563ed2c33f4122dd9ee3de Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 834f81f0ad708b930f66aec1fd8b36e2cfb8b32b)
2016-08-31Release note: add restriction for joid/dominoMorgan Richomme2-12/+20
JIRA: FUNCTEST-436 Change-Id: I44fb50a2ef58095aff54f03b837bf456850f3057 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit e1cf8564b1f06a64863ee463b817935ec58f834c)