summaryrefslogtreecommitdiffstats
path: root/testcases/OpenStack
AgeCommit message (Collapse)AuthorFilesLines
2016-07-29Merge "Select test cases in tempest to be blacklisted per each scenario"jose.lausuch2-4/+39
2016-07-29correct rally criteria checkSerenaFeng1-12/+3
add method check_success_rate() to unify criteria check by success_rate JIRA: FUNCTEST-398 Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch2-4/+39
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Add configure options for healthcheckCiprian Barbu1-3/+39
The healthcheck tier used hard-coded x86 image for testing glance and nova. This breaks functest for ARM based pods, because x86 instances cannot run on ARM and even more, if healthcheck fails no other testcases are executed. Change-Id: I8a4cc754569a26d98bff57470574ed28eebbf2da Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-07-28Add endpoint type support on functestboucherv1-0/+11
By default public endpoint was used but now you can use internal or admin JIRA: FUNCTEST-387 Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-28logger the push result of rally testSerenaFeng1-1/+1
JIRA: FUNCTEST-393 Change-Id: I94158531739e1e05c694a785a8bbca7f80684af5 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Merge "[bugfix] issures in multisite testcase"meimei1-5/+2
2016-07-27Fix the proper version output for kingbird.Dimitri Mazmanov1-1/+1
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2016-07-27Return -1 in Tempest if the success criteria is not passed.jose.lausuch1-17/+40
JIRA: FUNCTEST-381 Change-Id: I533bb50e26a3b97da9fd3bfa007f8ac7ce752a5b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27[bugfix] issures in multisite testcasemeimei1-5/+2
Change-Id: I351311688742c04c2c2b7278015e221178267fda Signed-off-by: meimei <meimei@huawei.com>
2016-07-27substitue misused variable 'total_success' with 'success_rate'SerenaFeng1-5/+5
JIRA: FUNCTEST-390 Change-Id: I35a2f72016573fc9e0a8403e436d5568937c5b14 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26delete useless stop_time initialization in run_rally-cert.pySerenaFeng1-2/+0
stop_time is assigned twice, delete the first one JIRA:FUNCTEST-384 Change-Id: I380113474e66a73c516f4411d8d7c5832e33921a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26Bad status on rally_sanitySerenaFeng1-1/+1
format total_success to float when compared with numeric 90 JIRA: FUNCTEST-365 Change-Id: I473582053c107bb026bf0e8d76dab46b2e5e3eb6 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-20Merge "Add kingbird endpoint information to functest."Jose Lausuch1-7/+52
2016-07-20Remove logger as input parameter of functions in openstack_utilsjose.lausuch5-13/+7
JIRA: FUNCTEST-376 Also some fixes to get rid of flake8 violations in onos-sfc Change-Id: I52c2fd30a6b81af20ea779db2d73b9386524f7ce Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-20Add kingbird endpoint information to functest.Dimitri Mazmanov1-7/+52
The patch multihops to the fuel node and dynamically retrieves kingbird endpoint information. It also resolves the controller ip instead of using the hardcoded value from the config ONLY if the installer type is Fuel. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: I5161df5df3da7283f6374efa6bd1108246c1095a
2016-07-19Show real time tempest test executionjose.lausuch1-4/+21
JIRA: FUNCTEST-375 Change-Id: I4f0cb68639b927f2980389d9331ec260605c8caf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-19Exit with -1 return code if something fails in vping testsjose.lausuch2-15/+15
Also, turn off debug info from paramiko python module in vping_ssh JIRA: FUNCTEST-373 JIRA: FUNCTEST-374 Change-Id: I6168cae85db91b2dd6ceac591f12dd9295786b59 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Use common way to get the openstack clientsjose.lausuch4-166/+119
Instead of repeating the code in all the scripts and importing the openstack libraries, the clients shall be given by openstack utils, which is its purpose JIRA: FUNCTEST-163 Change-Id: I1ccc05a3af44ee1ab5938ea9e4e01dbe55f4816d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14[multisite] integrate kingbird tempest testcasesmeimei1-1/+43
JIRA: FUNCTEST-179 Change-Id: I4a8ae43e2814b3d859c32a6278671f87155aa855 Signed-off-by: meimei <meimei@huawei.com>
2016-07-12Use flavor m1.tiny in healthcheckjose.lausuch1-4/+15
In some small virtual environments, booting 4 VMs using the flavor m1.small can fail because of insufficient disk space or available hosts. Check if the flavor exists, if it doesnt, create it. Change-Id: Ib7a3f337ea5e0686bcb9af442be175db436e4e8a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-12Merge changes from topics 'fix_unix_rights_py', 'stop_creating_ODL_dir'Morgan Richomme4-0/+0
* changes: Chmod 755 all py files which can be executed Stop creating the useless ODL results dir
2016-07-12Chmod 755 all sh files which can be executedCédric Ollivier2-0/+0
All files where shebang is defined can now be executed by everyone. It results from [1]. [1] find . -name "*.sh" |xargs grep \#\! |cut -d\: -f 1 |xargs chmod 755 Change-Id: I8bf1f52e55532d5e82f8188121028e9dd5074294 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-12Chmod 755 all py files which can be executedCédric Ollivier4-0/+0
All files where __main__ is checked can now be executed by everyone. It results from [1]. [1] find . -name "*.py" |xargs grep __main__ |cut -d\: -f 1 |xargs chmod 755 Change-Id: I9ad153cfdde0447213e35dac102e668d9e754cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-06bug fix: use PASS/FAIL for rallyMorgan Richomme1-2/+2
Change-Id: I1f870aad5b648f24f8097028ba97d6c118402586 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-04Add example script creating an instancejose.lausuch1-0/+136
This is to be used by feature projects or newcomers to functest. SFC or BGPVPN test cases can be based on this one. The script creates an instance and assigns a floating IP to it. Change-Id: If35495631031187bfb5382ba8c0a8884dfaa3d7f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> Depends-On: Ie10d55872bc8c5a404b0d0156ee49a9d94482008
2016-06-29bug fix: use FAIL/PASS as criteria for vping_userdata and rally_sanityMorgan Richomme2-4/+4
Change-Id: Iadccae118bb2dc557bb590175c65022c1ed70605 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-28Change step 4 to step 3 in healtcheckjose.lausuch1-1/+1
Change-Id: I4b506f942d7435b8d67e710f3e00a0886cdf6cd5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-16Align test names in DB and config fileMorgan Richomme4-7/+17
JIRA: FUNCTEST-304 Change-Id: I98d3155beb1c5e49eda84b443df603c2630b4823 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-14Reduce rally run script log outputJuha Kosonen1-1/+1
Log scenario specific tables only in debug mode. JIRA: FUNCTEST-312 Change-Id: Iacfdfb8156b1d5e9bc0a85abc1d6a10d6cac032e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Remove unnecessary defaults from rally task fileJuha Kosonen2-12/+1
Parameters used in test scenarios are defined and correctly set by run script. No need to hardcode defaults in task file. JIRA: FUNCTEST-311 Change-Id: Ic7decfc5144c40a50cd32862eb4aed263930a78e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Remove external server references on Rally scenariosJuha Kosonen2-19/+8
Use url derived from OS_AUTH_URL on a scenario making http request and checking the response. This way successful test execution does not require internet connection nor rely on external servers functionality. JIRA: FUNCTEST-201 Change-Id: Ic11f8f5c32d015624bdec1db07d8bb49f7b77bc8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Creating Glance image for Tempest suitevitikkan1-0/+30
If not yet existing, Cirros-0.3.4 image is created before running Tempest test suite. Source file for the image is included into opnfv/functest Docker container. JIRA: FUNCTEST-195 Change-Id: I980193c4207c1301ca4e3b6e850b4056e6aa0130 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-06-09Fix vPing success criteria evaluation bugfixjose.lausuch1-8/+5
Switching back to the odl approach. Need more discussions to see how to evaluate the result from testcases.yaml Change-Id: Iaa866db3010d35bd2cc427190dfe64db6b732a93 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-06-08Adapt functest testcase to APi refactoringMorgan Richomme4-115/+89
JIRA: FUNCTEST-303 Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-01Add criteria in testcases.yaml and Test classjose.lausuch1-5/+6
JIRA: FUNCTEST-257 Added example of usage in vping_ssh Change-Id: Iac143b811db163f0f86682b0688948c20843ede5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-31Remove unused CI_DEBUGCédric Ollivier1-1/+0
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-30Bugfix: can not find tempest.logSerenaFeng1-24/+21
JIRA: FUNCTEST-269 Remove dependency on CI_DEBUG and use subprocess.call to redirect stdout to tempest.log in any case. Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-05-27Merge "Use flavor name instead of flavor id"Morgan Richomme1-4/+4
2016-05-27Merge "Add simple error logs in result DB"Morgan Richomme1-16/+28
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-26Use flavor name instead of flavor idCédric Ollivier1-4/+4
Default flavor id changes if its attributes have been modified. Flavor name is used instead of flavor id. Change-Id: I7a076eed4ebef13a83594bf9017895bd6fb36bd2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-25Added 60 sec delay before launching instances in healthcheckvitikkan1-0/+5
This delay should be removed after resolving Jira case APEX-149. The purpose is to give some time to populate openflow rules by SDN controller in case of odl_l2 scenario. Change-Id: I05c0b82a7544e934d82f1fa37e2f146aab03f7b9 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-19Fix path for vping.sh and exit if SCP failsjose.lausuch1-1/+3
Change-Id: I28b394071ae739af60f7e7007cc54e96f13d39db Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-17Change 'testcases' directory structurejose.lausuch33-0/+4166
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>