summaryrefslogtreecommitdiffstats
path: root/testcases/VIM/OpenStack/CI/libraries/run_rally-cert.py
AgeCommit message (Collapse)AuthorFilesLines
2016-05-17Change 'testcases' directory structurejose.lausuch1-560/+0
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-10Create a private shared network for RallyJuha Kosonen1-4/+27
Since functest-net will be obsolete, own private network, subnet and router is created for Rally tests. JIRA: FUNCTEST-240 Change-Id: I8a30e2b4fe12238dba526c21188c85f75bacc0b8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-04Refactor improvementsjose.lausuch1-1/+1
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-29Execute successive scenarios after task failureJuha Kosonen1-2/+20
Log the result of task validation and proceed executing next rally scenario when the current task start-up fails. JIRA: FUNCTEST-230 Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-27Replace all the loggers by the functest logger modulejose.lausuch1-14/+2
JIRA: FUNCTEST-228 Change-Id: If7a3c8cb08e9fbdf155fc5eff5330f79e5f8d234 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-26Move functest_utils and openstack_utils to directory /utilsjose.lausuch1-2/+2
JIRA: FUNCTEST-226 Change-Id: I74d09f6322844b25ab45a02156317ae76ab40d8a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-25Remove backslashs for line continuationCédric Ollivier1-58/+58
JIRA: FUNCTEST-213 Change-Id: Ia50521cf8fcf60a847aa44fe0ea59b6e64830e92 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-04-22Introduce a sanity test mode for Rally testJuha Kosonen1-2/+10
In a sanity test mode the number of iterations is reduced and only a subset of tests is executed. JIRA: FUNCTEST-220 Change-Id: I722f12b8cc6df29bfcb81b8798d8d0802b207d94 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-22Affect version field in results for all the testcasesMorgan Richomme1-2/+1
Previously version was scenario JIRA: FUNCTEST-225 Change-Id: Ia86f83dbe98ad5f9dbced60c46e57f58eccba7e9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-22Enable PYTHONPATH env variable inside the containerjose.lausuch1-4/+4
JIRA: FUNCTEST-224 Change-Id: Ib10dc312a761b06fe36174c5c19a0165f746593e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-21Fix Flake8 Violations in the Functest scriptsjose.lausuch1-37/+47
JIRA: FUNCTEST-213 Change-Id: I66c02dd6ff12ffb9798ebe44a4cfe7bfc73e76c3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-18Allow rally to use existing glance imageCiprian Barbu1-4/+7
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: Ia79f519d10fc9155ab2fb44a3e427ae3bb1ce399 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-12Remove unused Rally scenarios and run scriptJuha Kosonen1-5/+2
run_rally.py is longer in use, it has been replaced with run_rally-cert.py already earlier. JIRA: FUNCTEST-191 Change-Id: I81b5060ed9a30e758afe75321052f120e9cf7389 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-04-11Split functest_utils.py into 2 scriptsjose.lausuch1-12/+13
JIRA: FUNCTEST-186 All the openstack related functions are in openstack_utils.py and the remaining functions in functest_utils.py All the scripts are adapted to this structure. Change-Id: I7f3805779741f0b085985d0d053feb429250b1ea Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-03-18Add criteria and version when pushing the results into test DBMorgan Richomme1-12/+25
JIRA: FUNCTEST-151 Change-Id: Iac36f28db5f2203d7b2977a2bb973534fe167bac Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-15Add exception handling for output processingJuha Kosonen1-2/+9
Handle the exception if parsed result in report cannot be converted to a numeric value. JIRA: FUNCTEST-149 Change-Id: Ibb259abdaa800761ee8dd2270c6bc2529081242d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-12Rally live migration case selectionJuha Kosonen1-0/+14
Execute live migration cases only if the feature is enabled in Tempest configuration file. Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-11Merge "Push results without extra formating"Morgan Richomme1-5/+7
2016-02-11Push results without extra formatingMorgan Richomme1-5/+7
Change-Id: I70713a30cec556ca7cd32122b9c10cf4c1732c3f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-10Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scriptsjose.lausuch1-0/+6
Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup or not the resources Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Create Rally summary report also for verbose modejose.lausuch1-24/+36
Also: - Fix percentage format of summary - Get the percentage from the row 'total' JIRA: FUNCTEST-134 Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Push rally summary results into DBMorgan Richomme1-37/+42
json produced by Rally are pushed to rally_details Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-09Merge "Remove obsolete public network definitions"Morgan Richomme1-5/+10
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-09Remove obsolete public network definitionsJuha Kosonen1-5/+10
Use functest_utils.py routines in run_rally-cert.py to retrive external network name instead of static definition in config_functest.yaml. Also change the network name and id setting in task arguments. Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen1-2/+5
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-01Enable all rally outputs in verbose modeJuha Kosonen1-19/+28
In verbose mode the complete output of rally tests is shown. Change-Id: I315c89b270312b13b3630b97cc24e5f529952645 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-01-29Change scenario start/result messages in run_rally-cert.pyJuha Kosonen1-3/+3
Change-Id: I2f5d4f327ab88b6855569d920a275ec801eb0311 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-01-28Add scenario name to Rally result messageJuha Kosonen1-2/+2
Change-Id: I1eb6604c9ad658b65cc47c8d7d0f47717078a9fe Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-01-28Merge "Reduce Rally output"Morgan Richomme1-7/+18
2016-01-28Reduce Rally outputjose.lausuch1-7/+18
This patch intends to reduce the output of Rally test, showing only the important information of the tests, which is the scenario name and the table with results. Showing the scenario json/yaml is unnecessary since it is already in the repo. Change-Id: Iff0ba3fed17212bb4a695c4155747c8aaf683da3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-27Volume type management moved from run_tests.sh to run_rally-cert.pyJuha Kosonen1-0/+29
Change-Id: I80c8b27e041ec5089b816b8515cbc8fa1e8b9eea Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-01-22Removed unnecessary references to public subnet cidrJuha Kosonen1-3/+0
Change-Id: I9961fcdd9fca6ae98f4c1b38c7eae119447132e4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-01-22Put scenario in version field on the Test DB (rather that git indication)Morgan Richomme1-2/+2
Change-Id: I22f7ff3841d7fca637e400d92926d2e1b1755371 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-01-21Add control to redirect rally stderrJuha Kosonen1-2/+9
By default rally stderr output is suppressed. Option --verbose enables the output by redirecting it to stdout. Change-Id: I2fd372b2a5cd70095969ef926bc9675dde4f98f6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-01-20Check if rally image already exist and don't create it again if sojose.lausuch1-15/+18
Change-Id: Ib872b7c21449fe4dc9c4331401fbfbff86140f68 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-19Remove rally stderr output from rally-certjose.lausuch1-2/+11
Change-Id: I2a5bb72989639059f082eedfb4abe8d582bef35c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-15Change novaclient usagejose.lausuch1-2/+2
Avoid having this warning: UserWarning: 'novaclient.v2.client.Client' is not designed to be initialized directly. Change-Id: I1a9154d97be14007bcb988a5ccd630eadf2e8a5f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-13Remove arg.repo_path in run_rally_cert.pyjose.lausuch1-6/+8
It is not needed as we have an env variable which points to the repositories directories Change-Id: I4c07e6a28a9e31a2794d74182436545fe6561a92 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-13Place config_functest.yaml outside the functest repojose.lausuch1-1/+1
If config_functest.yaml is given it will be placed in: /home/opnfv/functest/conf/config_functest.yaml If not given: copy default from repo to that location Change-Id: I816bf5ccf8e0a5b8ebde2a0ab924657533f49127 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-01-12Rally test case troubleshootingJuha Kosonen1-8/+23
Minor changes to some of the failed scenarios in rally_cert. JIRA: FUNCTEST-110 Change-Id: I25d1a80d295bea0004a3bf5f42161080c44091e9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2015-12-28Refactor run_rally-cert.pyJuha Kosonen1-29/+17
Changed run_rally-cert.py to utilize image creation/deletion functions of functest_utils. Removed cleanup function too as this is done in general cleanup. JIRA: FUNCTEST-109 Change-Id: I20cde1b664e0c25bd4ce0b25dc86dff817fba7f3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2015-12-18Parameterize Rally scenariosJuha Kosonen1-0/+301
Applied argument manipulation approach from rally/certification. JIRA: FUNCTEST-109 Change-Id: Ia6f08f1a7e7566c883cf7c616d32b7e0ca26b1f9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>