aboutsummaryrefslogtreecommitdiffstats
path: root/testcases/OpenStack/rally
AgeCommit message (Collapse)AuthorFilesLines
2016-11-09Repo structure modificationMorgan Richomme31-2799/+0
- create functest subdirectory - rename unit tests - adapt path in exec and config files JIRA: FUNCTEST-525 Change-Id: Ifd5c6edfb5bda1b09f82848e2269ad5fbeb84d0a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18Extend rally test case exclusion featureJuha Kosonen1-4/+23
Regular expression matching support for test cases on blacklist. JIRA: FUNCTEST-491 Change-Id: I4dc61ab0d93d699dd5e77ee3198a62d1bddd020a Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-10-14Unify rally test case exclusion mechanismsJuha Kosonen4-34/+65
In all cases exclusion is now controlled via blacklist file. JIRA: FUNCTEST-511 Change-Id: I482c33b6da4c9b711ebeddc13855b1337ab217eb Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-09-30Refactor rally task scenario filesJuha Kosonen10-309/+434
Use a dedicated scenario file for each scenario (full, sanity) instead of a shared one. JIRA: FUNCTEST-501 Change-Id: Icd45d6bf11b605f073c2667e9948589ee0a3b75c Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-09-08Merge "make use of functest_utils.get_parameter_from_yaml"Morgan Richomme1-37/+37
2016-09-08Merge "Exclude some Rally/Nova tests from lxd noha scenario"Morgan Richomme1-0/+1
2016-09-08Exclude some Rally/Nova tests from lxd noha scenarioMorgan Richomme1-0/+1
JIRA: FUNCTEST-464 Change-Id: I0b5014eabccd60c9efaacc4ee529e7b44fd070b2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-08make use of functest_utils.get_parameter_from_yamlSerenaFeng1-37/+37
JIRA: FUNCTEST-463 Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-07Merge "remove imported FUNCTEST_REPO object"Morgan Richomme1-5/+5
2016-09-07Exclude Rally/Nova tests for lxd scenarioMorgan Richomme1-3/+3
JIRA: FUNCTEST-464 Change-Id: I521f1ccd88579ba411d3691e4c222a2e8b41e1f8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-07remove imported FUNCTEST_REPO objectSerenaFeng1-5/+5
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/ **** Do not import objects, only modules (*) **** so direct FUNCTEST_REPO import should be avoided from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO JIRA: FUNCTEST-459 Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-06Fix image format set for rally test casesJuha Kosonen2-3/+4
Always use image format defined in config_functest.yaml when creating glance images. JIRA: FUNCTEST-460 Change-Id: Ica6b35605301bc14290daa23a1480114cf6294c0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-09-05Add blacklist handling for rally test casesJuha Kosonen3-17/+79
Test cases can be excluded from execution based on installer/scenario via blacklist file. JIRA: FUNCTEST-451 Change-Id: I17bbd5f1364a890b88bc196cbc5f49c492df1cb1 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-09-01stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng1-6/+2
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-01Merge "unify functest_yaml obtain process"Jose Lausuch1-6/+3
2016-08-31unify functest_yaml obtain processSerenaFeng1-6/+3
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-31Remove all logers as utils method args.Cédric Ollivier1-2/+0
As it modifies method params, it could break the testcases. JIRA: FUNCTEST-428 Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-26refactor create shared network process to eliminate reduplicateSerenaFeng1-15/+5
Some places shared network is created through create_network_full first, then update it to shared, abstract a uniformed method to eliminate reduplicate JIRA: FUNCTEST-437 Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-26refactor create or get image process to eliminate reduplicateSerenaFeng1-21/+5
Some places when create image is referred, they check if image exist, if exist use it directly, else create a new one. Abstract a method to integrate the process JIRA: FUNCTEST-432 Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-10Create config_functest patch to update the conf with scenarioboucherv1-1/+2
Adding support of LXD scenario JIRA: FUNCTEST-268 Change-Id: I5891ff9de674d99d32d8db747be501ee8a2e6609 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-29Return -1 in Rally if the success criteria is not metMarkus Kullberg1-1/+7
JIRA: FUNCTEST-382 Change-Id: Iaf475ecd3dbfcf6fb639ff146fe96e54c5393a1e Signed-off-by: Markus Kullberg <markus.kullberg@nokia.com>
2016-07-29correct rally criteria checkSerenaFeng1-12/+3
add method check_success_rate() to unify criteria check by success_rate JIRA: FUNCTEST-398 Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28logger the push result of rally testSerenaFeng1-1/+1
JIRA: FUNCTEST-393 Change-Id: I94158531739e1e05c694a785a8bbca7f80684af5 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-27substitue misused variable 'total_success' with 'success_rate'SerenaFeng1-5/+5
JIRA: FUNCTEST-390 Change-Id: I35a2f72016573fc9e0a8403e436d5568937c5b14 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26delete useless stop_time initialization in run_rally-cert.pySerenaFeng1-2/+0
stop_time is assigned twice, delete the first one JIRA:FUNCTEST-384 Change-Id: I380113474e66a73c516f4411d8d7c5832e33921a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-26Bad status on rally_sanitySerenaFeng1-1/+1
format total_success to float when compared with numeric 90 JIRA: FUNCTEST-365 Change-Id: I473582053c107bb026bf0e8d76dab46b2e5e3eb6 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-20Remove logger as input parameter of functions in openstack_utilsjose.lausuch1-2/+1
JIRA: FUNCTEST-376 Also some fixes to get rid of flake8 violations in onos-sfc Change-Id: I52c2fd30a6b81af20ea779db2d73b9386524f7ce Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Use common way to get the openstack clientsjose.lausuch1-50/+34
Instead of repeating the code in all the scripts and importing the openstack libraries, the clients shall be given by openstack utils, which is its purpose JIRA: FUNCTEST-163 Change-Id: I1ccc05a3af44ee1ab5938ea9e4e01dbe55f4816d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-12Chmod 755 all sh files which can be executedCédric Ollivier1-0/+0
All files where shebang is defined can now be executed by everyone. It results from [1]. [1] find . -name "*.sh" |xargs grep \#\! |cut -d\: -f 1 |xargs chmod 755 Change-Id: I8bf1f52e55532d5e82f8188121028e9dd5074294 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-07-06bug fix: use PASS/FAIL for rallyMorgan Richomme1-2/+2
Change-Id: I1f870aad5b648f24f8097028ba97d6c118402586 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-29bug fix: use FAIL/PASS as criteria for vping_userdata and rally_sanityMorgan Richomme1-2/+2
Change-Id: Iadccae118bb2dc557bb590175c65022c1ed70605 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-16Align test names in DB and config fileMorgan Richomme1-2/+7
JIRA: FUNCTEST-304 Change-Id: I98d3155beb1c5e49eda84b443df603c2630b4823 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-14Reduce rally run script log outputJuha Kosonen1-1/+1
Log scenario specific tables only in debug mode. JIRA: FUNCTEST-312 Change-Id: Iacfdfb8156b1d5e9bc0a85abc1d6a10d6cac032e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Remove unnecessary defaults from rally task fileJuha Kosonen2-12/+1
Parameters used in test scenarios are defined and correctly set by run script. No need to hardcode defaults in task file. JIRA: FUNCTEST-311 Change-Id: Ic7decfc5144c40a50cd32862eb4aed263930a78e Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-13Remove external server references on Rally scenariosJuha Kosonen2-19/+8
Use url derived from OS_AUTH_URL on a scenario making http request and checking the response. This way successful test execution does not require internet connection nor rely on external servers functionality. JIRA: FUNCTEST-201 Change-Id: Ic11f8f5c32d015624bdec1db07d8bb49f7b77bc8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-06-08Adapt functest testcase to APi refactoringMorgan Richomme1-25/+22
JIRA: FUNCTEST-303 Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-17Change 'testcases' directory structurejose.lausuch27-0/+2636
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>