summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-08-03Set lnfo logging level for Doctor testsCarlos Goncalves1-1/+2
JIRA: DOCTOR-63 Change-Id: Iaa8fb5989f69a8853c0e3e03ce87d58fb2d4309b Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-08-03Merge "Shorter test case names are accepted for tempest blacklist file"vitikkan2-20/+16
2016-08-03Shorter test case names are accepted for tempest blacklist filevitikkan2-20/+16
Blacklist file handling is changed so that also partial test case names are accepted. For example, "tempest.api.object_storage" entry will exclude all the test cases containing this string. JIRA: FUNCTEST-401 Change-Id: I620be7dfd5d980a343d2f7cc7c0dbe40598bf65c Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-03functest utils - get_resolvconf_ns() Ensure that dns works with dns name ↵boucherv4-9/+12
resolution JIRA: FUNCTEST-402 Change-Id: I5fa9204aafb13330eb810950aa7bc728f1a69162 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-03Merge "Fix for the endpoint URL for kingbird"mei mei1-52/+7
2016-08-02Merge "modfied to mute object storage test on joid."valentin boucher1-0/+23
2016-08-02Fix for the endpoint URL for kingbirdAshish Singh1-52/+7
Currently, there is internal IP address which is getting populated in tempest.conf. Since the tempest are run inside functest docker container we need to use public IP address for accessing Kingbird services. Now, there will not be any installer specific endpoints as we had earlier. All should communicate with public endpoints. Change-Id: Id22e7e4d9ece9a0000a1186113627b82d6ba400a Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
2016-08-02use configured success_rate to check tempest test statusSerenaFeng1-21/+7
when checking tempest test results using success_rate configured in testcases.yaml rather than written it in the code JIRA: FUNCTEST-400 Change-Id: I2a34e3e032a0d94c6a4605fcf09a66c8f8f9b78c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-01Fix missing directory when calling bgpvpn testsjose.lausuch2-2/+3
Change-Id: Ic9f6b9592202c3bed9d6835eeea7c14971e1c01f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-08-01Merge "Several bug fixes in ODL-SFC functest testcase"Jose Lausuch2-19/+23
2016-08-01Several bug fixes in ODL-SFC functest testcaseManuel Buil2-19/+23
JIRA: SFC-42 - SSH options added so that the ssh key is not needed - IPTABLES change done before contacting nova, neutron... - Fix a problem in the CI test (we need to CD the BASEDIR) Change-Id: Id63c02a614bf31e5a33637c2bf95270bd1399ff8 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-31modfied to mute object storage test on joid.Narinder Gupta1-0/+23
In case of joid we implement ceph-radosgw for object storage which creates swift api for object storage. Manually i can verify we can upload the object. But functest is failing other installer removed the API but we need in JOID for juju based deployment on Openstack. So this patch will mute the object storage test cases for functest. Change-Id: I21d2bdc665a9589630cfcacb278cfb65a1c15f11 Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com>
2016-07-31Wrap call to the rest api with try-except while generating reportjose.lausuch1-6/+11
When the Rest api is not available for some reason (see associated JIRA), the script fails and it gives also a false output to Jenkins. JIRA: FUNCTEST-399 Change-Id: I81622a2e22661889afcf49526c2421af257920a4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-30Add onos_sfc scenariowuwenbin24-7/+35
JIRA:ONOSFW-172 Change-Id: I019edf79f8d343f794aa7af151d8e30c18e2c5f6 Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-29Add dir_repo_domino to fix bugUlas Kozat1-0/+1
JIRA: DOMINO-19 Change-Id: Ib054b859569ef69e32cec650c7dd223199762763 Signed-off-by: Ulas Kozat <ulas.kozat@gmail.com>
2016-07-29Return with exit code in Doctor testcaseCarlos Goncalves1-0/+4
JIRA: DOCTOR-63 Change-Id: Ib142a6102a705ee571081651c650ced05f7d5d4f Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-07-29Return with exit code in Promise testcaseCarlos Goncalves1-0/+4
JIRA: PROMISE-77 Change-Id: Ie856d7b58f72a253abf4b446e33f3c98d06c50c1 Signed-off-by: Carlos Goncalves <carlos.goncalves@neclab.eu>
2016-07-29Return -1 in Rally if the success criteria is not metMarkus Kullberg1-1/+7
JIRA: FUNCTEST-382 Change-Id: Iaf475ecd3dbfcf6fb639ff146fe96e54c5393a1e Signed-off-by: Markus Kullberg <markus.kullberg@nokia.com>
2016-07-29Merge "Select test cases in tempest to be blacklisted per each scenario"jose.lausuch4-19/+41
2016-07-29correct rally criteria checkSerenaFeng2-12/+22
add method check_success_rate() to unify criteria check by success_rate JIRA: FUNCTEST-398 Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-29unify test results logger and apply to parserSerenaFeng2-17/+31
refine a unified method to log the test results and use it to parser. JIRA: FUNCTEST-397 Change-Id: I5ed6b04107be5590b1d9d5683c8f1846fef5a4d4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch4-19/+41
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Merge "Bug fix of the CI script in the ODL-SFC test case"Jose Lausuch2-4/+4
2016-07-28Bug fix of the CI script in the ODL-SFC test caseManuel Buil2-4/+4
Change-Id: Id3db14d1f26a7dd75cdaaf4d7ca0f54268a89faf Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-28Prevent exiting the overall execution when there is a failed test casejose.lausuch1-12/+3
Unless it is a test with the flag blocking=true Change-Id: Iada54319db1c81c73781f1b135eb496bc9f2af1b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Scripts added to enable the SFC-ODL test in CIManuel Buil3-0/+47
We need to install Tacker in the server before running the test cases Change-Id: Id7daee80627bc71c335fcb3efa5d389594641b65 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-28Add configure options for healthcheckCiprian Barbu2-4/+43
The healthcheck tier used hard-coded x86 image for testing glance and nova. This breaks functest for ARM based pods, because x86 instances cannot run on ARM and even more, if healthcheck fails no other testcases are executed. Change-Id: I8a4cc754569a26d98bff57470574ed28eebbf2da Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-07-28Add region name to OpenStack credentialsDimitri Mazmanov1-0/+4
Currently functest doesn't account for regions when it tries to instantieate OpenStack clients. As a result, the code fails when functest is used in a multi-region environment. The fix forces functest account for region name. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: Iebbd20042548c02da9d5ed7e58a454347a555778
2016-07-28Functional testing for tosca2heat translationSerenaFeng5-0/+121
in Dockerfile, add parser related work in config_functest.yaml/testcase.yaml, add parser related configuration in exec_test.sh to run parser test add vnf/RNC/parser.py script JIRA: FUNCTEST-187 Change-Id: I8b53774da00f13b630ec5d9f750817db892a82bb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Merge "Bugfix: dont stop execution when a test case is not blocking"jose.lausuch3-8/+19
2016-07-28Bugfix: dont stop execution when a test case is not blockingjose.lausuch3-8/+19
Change-Id: I3564b6f2d8f8057ec2c9753837e3a5fe16a4a866 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Add endpoint type support on functestboucherv6-32/+66
By default public endpoint was used but now you can use internal or admin JIRA: FUNCTEST-387 Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-28logger the push result of rally testSerenaFeng1-1/+1
JIRA: FUNCTEST-393 Change-Id: I94158531739e1e05c694a785a8bbca7f80684af5 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Merge "[bugfix] issures in multisite testcase"meimei1-5/+2
2016-07-27Disable security scan testsjose.lausuch1-1/+1
Change-Id: Ic6800f4b1401c44dbded160f45fdd17c706f14f8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Make openstack_clean be aware of the names and not only the IDsjose.lausuch1-8/+16
Sometimes, when using the same container for a different deployment, the IDs of the openstack resources are different but the names are the same. This will avoid cleaning for example the user 'admin' regardless of the ID it has. JIRA: FUNCTEST-383 Change-Id: If27603f8f6d0cb7ad0aeba6e3c89ca19e2b8aed2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Fix the proper version output for kingbird.Dimitri Mazmanov1-1/+1
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2016-07-27Return -1 in Tempest if the success criteria is not passed.jose.lausuch1-17/+40
JIRA: FUNCTEST-381 Change-Id: I533bb50e26a3b97da9fd3bfa007f8ac7ce752a5b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Return -1 if copper test failsjose.lausuch2-5/+9
Change-Id: Ib66d1b69c73603bab33950ca2c0fca3f07eb3d22 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27[bugfix] issures in multisite testcasemeimei1-5/+2
Change-Id: I351311688742c04c2c2b7278015e221178267fda Signed-off-by: meimei <meimei@huawei.com>
2016-07-27Enable odl-sfc in CIManuel Buil2-0/+12
JIRA:FUNCTEST-392 Change-Id: If1c931df26062501695061e1155eb26ad007c8de Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-27Bump rally to 0.5.0 and add shyamlCiprian Barbu2-2/+3
A newer version of rally brings in this change that is required by armband: https://bugs.launchpad.net/rally/+bug/1580695 The shyaml cli parser can be used to make the healthcheck testcase configurable, for instance to pass a different cirros image other than the one for x86_64. Also required by armband to make functest execute all tests. Change-Id: Ic4976bb6d4a4753e56deade35b641f1127af3162 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-07-27Merge "[bugfix] miss a argument"meimei1-1/+1
2016-07-27[bugfix] miss a argumentmeimei1-1/+1
Change-Id: Id8cdf6a5dadee6a2e0ba10772db88c84e5ce13a3 Signed-off-by: meimei <meimei@huawei.com>
2016-07-27substitue misused variable 'total_success' with 'success_rate'SerenaFeng1-5/+5
JIRA: FUNCTEST-390 Change-Id: I35a2f72016573fc9e0a8403e436d5568937c5b14 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26Generate Functest report at the end of the executionjose.lausuch2-11/+175
JIRA: FUNCTEST-89 Change-Id: I10c41efdd6a7f737f57ab15158c8c8d49f392271 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-26delete useless stop_time initialization in run_rally-cert.pySerenaFeng1-2/+0
stop_time is assigned twice, delete the first one JIRA:FUNCTEST-384 Change-Id: I380113474e66a73c516f4411d8d7c5832e33921a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26Bug fix for ODL-SFC testcaseManuel Buil1-0/+19
The vxlan_tool was sometimes not started properly in the SFs. Now we check that the process is started Change-Id: I8b88b76ba30755a1ed339f9e4c374d43e5e0b422 Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-26Bad status on rally_sanitySerenaFeng1-1/+1
format total_success to float when compared with numeric 90 JIRA: FUNCTEST-365 Change-Id: I473582053c107bb026bf0e8d76dab46b2e5e3eb6 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26add .idea directory to gitignoreSerenaFeng1-0/+1
ignore .idea created by using pycharm JIRA: FUNCTEST-386 Change-Id: I425b4525ea16cafc2883f165efd2293a8adb13fb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>