summaryrefslogtreecommitdiffstats
path: root/testcases/VIM/OpenStack/CI/libraries/run_rally-cert.py
AgeCommit message (Collapse)AuthorFilesLines
2016-05-12Allow rally to use existing glance imageCiprian Barbu1-4/+7
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: Ia79f519d10fc9155ab2fb44a3e427ae3bb1ce399 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-29Execute successive scenarios after task failureJuha Kosonen1-2/+20
Log the result of task validation and proceed executing next rally scenario when the current task start-up fails. JIRA: FUNCTEST-230 Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 4bdb6ed6d41aed8763f22aa84155ac810569deb1)
2016-03-15Add exception handling for output processingJuha Kosonen1-2/+9
Handle the exception if parsed result in report cannot be converted to a numeric value. JIRA: FUNCTEST-149 Change-Id: Ibb259abdaa800761ee8dd2270c6bc2529081242d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit d9d32a3f3f45b4f9008201e82235b33910e0f7f6)
2016-02-12Rally live migration case selectionJuha Kosonen1-0/+14
Execute live migration cases only if the feature is enabled in Tempest configuration file. Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 1d62586d396d948c523fb0b0e351ae162e7fdc6b)
2016-02-11Push results without extra formatingMorgan Richomme1-5/+7
Change-Id: I70713a30cec556ca7cd32122b9c10cf4c1732c3f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 4c2674593f1bf6f093bbdc5de41241e46bfcbe14)
2016-02-10Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scriptsjose.lausuch1-0/+6
Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup or not the resources Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit abc81e24d33b9bf8d2f8fb05dc5f5f57443abe93)
2016-02-10Create Rally summary report also for verbose modejose.lausuch1-24/+36
Also: - Fix percentage format of summary - Get the percentage from the row 'total' JIRA: FUNCTEST-134 Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 945aff5ef35837170fc09953b83cfb6081a1edad)
2016-02-10Push rally summary results into DBMorgan Richomme1-37/+42
json produced by Rally are pushed to rally_details Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 96f4bbb9aef2b4d3a8bda16b82a06157c110d2e9)
2016-02-09Remove obsolete public network definitionsJuha Kosonen1-5/+10
Use functest_utils.py routines in run_rally-cert.py to retrive external network name instead of static definition in config_functest.yaml. Also change the network name and id setting in task arguments. Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 41eaec87fe939a8511dc6c0ec63976b53cbf5578)
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 76ee625343b28868ca7c6c6108ee974bb57dbea8)
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen1-2/+5
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 01608c214878c19c9f01c60e1b08e106a5d684cf)
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5cf9b7fe8f380f6315e656527b90778c2d91a95c)
2016-02-01Enable all rally outputs in verbose modeJuha Kosonen1-19/+28
In verbose mode the complete output of rally tests is shown. Change-Id: I315c89b270312b13b3630b97cc24e5f529952645 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit e75f34706a8d72ee440d7f94363d4909a02f5293)
2016-01-29Change scenario start/result messages in run_rally-cert.pyJuha Kosonen1-3/+3
Change-Id: I2f5d4f327ab88b6855569d920a275ec801eb0311 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 358ea20ea921db3d2f4ed0d0d22c92a2b534ce3a)
2016-01-29Add scenario name to Rally result messageJuha Kosonen1-2/+2
Change-Id: I1eb6604c9ad658b65cc47c8d7d0f47717078a9fe Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit c269353e4027a2f8d690fc4a03315ebc93301ba7)
2016-01-28Reduce Rally outputjose.lausuch1-7/+18
This patch intends to reduce the output of Rally test, showing only the important information of the tests, which is the scenario name and the table with results. Showing the scenario json/yaml is unnecessary since it is already in the repo. Change-Id: Iff0ba3fed17212bb4a695c4155747c8aaf683da3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit b0365d10fda5018721d012602077dddda948a6d9)
2016-01-28Volume type management moved from run_tests.sh to run_rally-cert.pyJuha Kosonen1-0/+29
Change-Id: I80c8b27e041ec5089b816b8515cbc8fa1e8b9eea Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 9922669c3dd92d43c6e387c8077255153c35b71e)
2016-01-22Removed unnecessary references to public subnet cidrJuha Kosonen1-3/+0
Change-Id: I9961fcdd9fca6ae98f4c1b38c7eae119447132e4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit b8a2d3f517a2c599b603da491229527278b0e87d)
2016-01-22Put scenario in version field on the Test DB (rather that git indication)Morgan Richomme1-2/+2
Change-Id: I22f7ff3841d7fca637e400d92926d2e1b1755371 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 59063638116508f7ce4f7612def938bb9eb0e938)
2016-01-21Add control to redirect rally stderrJuha Kosonen1-2/+9
By default rally stderr output is suppressed. Option --verbose enables the output by redirecting it to stdout. Change-Id: I2fd372b2a5cd70095969ef926bc9675dde4f98f6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit c2fcca7373e4b65d4eec221e020bc49c9e443a70)
2016-01-20Check if rally image already exist and don't create it again if sojose.lausuch1-15/+18
Change-Id: Ib872b7c21449fe4dc9c4331401fbfbff86140f68 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 2a9268e11cbac21a0952dee6831d28cd06dc70d7)
2016-01-19Remove rally stderr output from rally-certjose.lausuch1-2/+11
Change-Id: I2a5bb72989639059f082eedfb4abe8d582bef35c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 79a23744af12da7163e3a142dd44f60d46cbfd41)
2016-01-15Change novaclient usagejose.lausuch1-2/+2
Avoid having this warning: UserWarning: 'novaclient.v2.client.Client' is not designed to be initialized directly. Change-Id: I1a9154d97be14007bcb988a5ccd630eadf2e8a5f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit eb12e95f822c70566cb417e5b5d85a65df14b79c)
2016-01-13Remove arg.repo_path in run_rally_cert.pyjose.lausuch1-6/+8
It is not needed as we have an env variable which points to the repositories directories Change-Id: I4c07e6a28a9e31a2794d74182436545fe6561a92 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit ce427331a1d220a061abcd1dbd6caac9dff9afee)
2016-01-13Place config_functest.yaml outside the functest repojose.lausuch1-1/+1
If config_functest.yaml is given it will be placed in: /home/opnfv/functest/conf/config_functest.yaml If not given: copy default from repo to that location Change-Id: I816bf5ccf8e0a5b8ebde2a0ab924657533f49127 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 00b51ffe114702ce207aa7ba2e40f01984c0c57c)
2016-01-12Rally test case troubleshootingJuha Kosonen1-8/+23
Minor changes to some of the failed scenarios in rally_cert. JIRA: FUNCTEST-110 Change-Id: I25d1a80d295bea0004a3bf5f42161080c44091e9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 236f391ce99bc5e1d4a56ec5ea65705895bf39d9)
2015-12-28Refactor run_rally-cert.pyJuha Kosonen1-29/+17
Changed run_rally-cert.py to utilize image creation/deletion functions of functest_utils. Removed cleanup function too as this is done in general cleanup. JIRA: FUNCTEST-109 Change-Id: I20cde1b664e0c25bd4ce0b25dc86dff817fba7f3 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2015-12-18Parameterize Rally scenariosJuha Kosonen1-0/+301
Applied argument manipulation approach from rally/certification. JIRA: FUNCTEST-109 Change-Id: Ia6f08f1a7e7566c883cf7c616d32b7e0ca26b1f9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>