aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-08-11Bug fix to eliminate undeterministic behaviourManuel Buil1-0/+3
When changing the classifier, ODL needs some seconds to update the switches and sometimes they are not changed when the script executes the second part of the test ==> test fails Change-Id: I1fa3306eb7b283d708dbd736d2365456559db9b9 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-08-11Merge "Create config_functest patch to update the conf with scenario"boucherv8-9/+58
2016-08-11add report flag to parserSerenaFeng2-8/+17
parser has no report flag, every time we run the test the results will be reported to db JIRA: FUNCTEST-410 Change-Id: I6336b4c367fd8edc70e076b81d01d9356580bc22 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-11Merge "[multisite] refactor the scripts of multiste"meimei3-87/+132
2016-08-11Merge "update pip version of functest docker image"valentin boucher1-0/+1
2016-08-11Merge "Bug fix in functest ODL-SFC"valentin boucher2-5/+13
2016-08-11[multisite] refactor the scripts of multistemeimei3-87/+132
Change-Id: I07f0f5e253b04c9ac70e6dc4ea210e7cecf22c6a Signed-off-by: meimei <meimei@huawei.com>
2016-08-11change parser path from RNC to vRNCSerenaFeng1-1/+1
JIRA: FUNCTEST-409 Change-Id: I83887160a328c6f022efaa1547ca214571a9a01c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-11update pip version of functest docker imageSerenaFeng1-0/+1
JIRA: FUNCTEST-408 Change-Id: Ie14bbd0e2fa6f76957217d27cb8b0c76d4d28a03 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-10Create config_functest patch to update the conf with scenarioboucherv8-9/+58
Adding support of LXD scenario JIRA: FUNCTEST-268 Change-Id: I5891ff9de674d99d32d8db747be501ee8a2e6609 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-10Merge "parser integration bugfix"Morgan Richomme3-22/+2
2016-08-10Add SKIP status if Domino Test Case is skippedUlas Kozat1-8/+15
Change-Id: I099010496dadabc18952de88fd6b3740592fc583 Signed-off-by: Ulas Kozat <ulas.kozat@gmail.com>
2016-08-10parser integration bugfixSerenaFeng3-22/+2
JIRA: FUNCTEST-407 Change-Id: I9f202cb09935d9b77c5a977234bec6b505e296fd Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-10Bug fix in functest ODL-SFCManuel Buil2-5/+13
Change-Id: I496ade3ea5888967e933231f515a340369bffe8f Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-08-09Merge "Use Kingbird Bind host URL for Tempest"mei mei1-5/+49
2016-08-08Update test with the new SF and new tacker scriptManuel Buil4-6/+6
- A new SF image was created with a new name. Several files must be updated - There is a new tacker branch for OPNFV Colorado, an update was made Change-Id: Ib5ed364467baca32fa204155655318cb1ec189f5 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-08-08Use Kingbird Bind host URL for TempestAshish Singh1-5/+49
Earlier, there was external URL for accessing KB services in tempest.conf which is not accessible from functest docker. Use bind host URL for KB service to access from the docker. Change-Id: I147ffc2cd9883a6913080f9e1ab245807e0ca707 Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
2016-08-08Merge "Enable Copper functest under JOID"Morgan Richomme1-1/+1
2016-08-07Merge "Bug fixes odl-sfc + new features"valentin boucher4-18/+104
2016-08-05Bug fixes odl-sfc + new featuresManuel Buil4-18/+104
* Doing the test with private IPs as floating are currently not working in ODL * New SF takes more time to start the service. A while loop is added. * Configuration of the compute set-up due to ODL limitations added Change-Id: I5449af940caee456262dac66bc47b66fd05c2a70 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-08-05Reduced timeout for SSH connection attempt in tempest.confvitikkan2-0/+5
Some tempest test cases try to establish SSH connection to Cirros VMs using default 300s timeout. Since Cirros VMs send only three DHCP requests with 1 minute interval, future SSH connection attempts will most probably fail if DHCP response will not be received right after third request. For that reason the optimal timeout is slightly above 2 minutes. JIRA: FUNCTEST-378 Change-Id: I57415ad37a85cd84887d3cac4f7a44f7e145d820 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-04Merge "Re-generating tempest.conf file before starting tests"valentin boucher1-2/+6
2016-08-04Merge "unify test result check for feature project and apply to parser"valentin boucher3-24/+26
2016-08-04Merge "support "" equals to None check in Testcase.is_compatible"valentin boucher1-3/+7
2016-08-04Re-generating tempest.conf file before starting testsvitikkan1-2/+6
"rally verify genconfig" command doesn't generate tempest.conf file if it already exists in the used deployment. This can cause troubles if some resources (images, flavors etc.) change between consecutive runs of tempest. The change ensures that tempest.conf is deleted before executing "rally verify genconfig". JIRA: FUNCTEST-403 Change-Id: Icf5e380da3cb8757f4177b49028937355e2cf1d7 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-04unify test result check for feature project and apply to parserSerenaFeng3-24/+26
add check_test_result() method to unify test result process JIRA: FUNCTEST-405 Change-Id: Iee4d2876cbbf372f8c3e3bf94448036669bc7f7e Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-04support "" equals to None check in Testcase.is_compatibleSerenaFeng1-3/+7
when check ci_installer/ci_scenario is None, we also check if ci_installer/ci_scenario is "" JIRA: FUNCTEST-404 Change-Id: Ib8b7b9a98f6eb064d2b3648e5d1334990c69cb2f Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-03Set lnfo logging level for Doctor testsCarlos Goncalves1-1/+2
JIRA: DOCTOR-63 Change-Id: Iaa8fb5989f69a8853c0e3e03ce87d58fb2d4309b Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-08-03Enable Copper functest under JOIDblsaws1-1/+1
JIRA: COPPER-4 Change-Id: Ief49cea34ed15ba9c877bf4acd512f4d77cb5016 Signed-off-by: blsaws <bryan.sullivan@att.com>
2016-08-03Merge "Shorter test case names are accepted for tempest blacklist file"vitikkan2-20/+16
2016-08-03Shorter test case names are accepted for tempest blacklist filevitikkan2-20/+16
Blacklist file handling is changed so that also partial test case names are accepted. For example, "tempest.api.object_storage" entry will exclude all the test cases containing this string. JIRA: FUNCTEST-401 Change-Id: I620be7dfd5d980a343d2f7cc7c0dbe40598bf65c Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-03functest utils - get_resolvconf_ns() Ensure that dns works with dns name ↵boucherv4-9/+12
resolution JIRA: FUNCTEST-402 Change-Id: I5fa9204aafb13330eb810950aa7bc728f1a69162 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-03Merge "Fix for the endpoint URL for kingbird"mei mei1-52/+7
2016-08-02Merge "modfied to mute object storage test on joid."valentin boucher1-0/+23
2016-08-02Fix for the endpoint URL for kingbirdAshish Singh1-52/+7
Currently, there is internal IP address which is getting populated in tempest.conf. Since the tempest are run inside functest docker container we need to use public IP address for accessing Kingbird services. Now, there will not be any installer specific endpoints as we had earlier. All should communicate with public endpoints. Change-Id: Id22e7e4d9ece9a0000a1186113627b82d6ba400a Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
2016-08-02use configured success_rate to check tempest test statusSerenaFeng1-21/+7
when checking tempest test results using success_rate configured in testcases.yaml rather than written it in the code JIRA: FUNCTEST-400 Change-Id: I2a34e3e032a0d94c6a4605fcf09a66c8f8f9b78c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-01Fix missing directory when calling bgpvpn testsjose.lausuch2-2/+3
Change-Id: Ic9f6b9592202c3bed9d6835eeea7c14971e1c01f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-08-01Merge "Several bug fixes in ODL-SFC functest testcase"Jose Lausuch2-19/+23
2016-08-01Several bug fixes in ODL-SFC functest testcaseManuel Buil2-19/+23
JIRA: SFC-42 - SSH options added so that the ssh key is not needed - IPTABLES change done before contacting nova, neutron... - Fix a problem in the CI test (we need to CD the BASEDIR) Change-Id: Id63c02a614bf31e5a33637c2bf95270bd1399ff8 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-31modfied to mute object storage test on joid.Narinder Gupta1-0/+23
In case of joid we implement ceph-radosgw for object storage which creates swift api for object storage. Manually i can verify we can upload the object. But functest is failing other installer removed the API but we need in JOID for juju based deployment on Openstack. So this patch will mute the object storage test cases for functest. Change-Id: I21d2bdc665a9589630cfcacb278cfb65a1c15f11 Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com>
2016-07-31Wrap call to the rest api with try-except while generating reportjose.lausuch1-6/+11
When the Rest api is not available for some reason (see associated JIRA), the script fails and it gives also a false output to Jenkins. JIRA: FUNCTEST-399 Change-Id: I81622a2e22661889afcf49526c2421af257920a4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-30Add onos_sfc scenariowuwenbin24-7/+35
JIRA:ONOSFW-172 Change-Id: I019edf79f8d343f794aa7af151d8e30c18e2c5f6 Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-29Add dir_repo_domino to fix bugUlas Kozat1-0/+1
JIRA: DOMINO-19 Change-Id: Ib054b859569ef69e32cec650c7dd223199762763 Signed-off-by: Ulas Kozat <ulas.kozat@gmail.com>
2016-07-29Return with exit code in Doctor testcaseCarlos Goncalves1-0/+4
JIRA: DOCTOR-63 Change-Id: Ib142a6102a705ee571081651c650ced05f7d5d4f Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-07-29Return with exit code in Promise testcaseCarlos Goncalves1-0/+4
JIRA: PROMISE-77 Change-Id: Ie856d7b58f72a253abf4b446e33f3c98d06c50c1 Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-07-29Return -1 in Rally if the success criteria is not metMarkus Kullberg1-1/+7
JIRA: FUNCTEST-382 Change-Id: Iaf475ecd3dbfcf6fb639ff146fe96e54c5393a1e Signed-off-by: Markus Kullberg <markus.kullberg@nokia.com>
2016-07-29Merge "Select test cases in tempest to be blacklisted per each scenario"jose.lausuch4-19/+41
2016-07-29correct rally criteria checkSerenaFeng2-12/+22
add method check_success_rate() to unify criteria check by success_rate JIRA: FUNCTEST-398 Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-29unify test results logger and apply to parserSerenaFeng2-17/+31
refine a unified method to log the test results and use it to parser. JIRA: FUNCTEST-397 Change-Id: I5ed6b04107be5590b1d9d5683c8f1846fef5a4d4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch4-19/+41
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>