summaryrefslogtreecommitdiffstats
path: root/testcases/VIM
AgeCommit message (Collapse)AuthorFilesLines
2016-05-12Allow rally to use existing glance imageCiprian Barbu1-4/+7
This allows to use a prebuilt glance image without deleting it after the test. For ARM platforms this is especially helpful because the test image is three-part and can be created before running any tests. Change-Id: Ia79f519d10fc9155ab2fb44a3e427ae3bb1ce399 Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-04-29Execute successive scenarios after task failureJuha Kosonen1-2/+20
Log the result of task validation and proceed executing next rally scenario when the current task start-up fails. JIRA: FUNCTEST-230 Change-Id: I5544a9559636f671035578f9cc5cf6f934bcbcd8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 4bdb6ed6d41aed8763f22aa84155ac810569deb1)
2016-03-15Add exception handling for output processingJuha Kosonen1-2/+9
Handle the exception if parsed result in report cannot be converted to a numeric value. JIRA: FUNCTEST-149 Change-Id: Ibb259abdaa800761ee8dd2270c6bc2529081242d Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit d9d32a3f3f45b4f9008201e82235b33910e0f7f6)
2016-03-04Rally and Tempest pre-installed in the Docker image.jose.lausuch1-1/+1
Also, upgrade Rally to version 0.3.1 JIRA: FUNCTEST-147 Change-Id: I6aa15a7c282462058b7786c7dc7174d48c905d3a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit def1634a5b8a2c8ca794fa878394234a8ebb3468)
2016-02-23remove "print" in tempest to avoid having a message "None" in the outputjose.lausuch1-1/+1
Change-Id: If2008fa7ed1bce1b5acc40cad82c21afa55ec4e5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit f937af8864c6fe6d392c9b9766df98d164c64459)
2016-02-12Rally live migration case selectionJuha Kosonen3-44/+61
Execute live migration cases only if the feature is enabled in Tempest configuration file. Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 1d62586d396d948c523fb0b0e351ae162e7fdc6b)
2016-02-11Push results without extra formatingMorgan Richomme1-5/+7
Change-Id: I70713a30cec556ca7cd32122b9c10cf4c1732c3f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 4c2674593f1bf6f093bbdc5de41241e46bfcbe14)
2016-02-11Enadled --serial option for run_tests.shViktor Tikkanen1-2/+11
It could be useful to execute e.g. Tempest test cases in a single thread in order to troubleshoot possible concurrency problems. Change-Id: I5e5fc190fb4483ff075a8f837a8d4116ece90c80 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 66df82a76334015e3e2d25ddcc22b343b110320c)
2016-02-10Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scriptsjose.lausuch3-0/+19
Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup or not the resources Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit abc81e24d33b9bf8d2f8fb05dc5f5f57443abe93)
2016-02-10Create Rally summary report also for verbose modejose.lausuch1-24/+36
Also: - Fix percentage format of summary - Get the percentage from the row 'total' JIRA: FUNCTEST-134 Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 945aff5ef35837170fc09953b83cfb6081a1edad)
2016-02-10Push rally summary results into DBMorgan Richomme2-49/+53
json produced by Rally are pushed to rally_details Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 96f4bbb9aef2b4d3a8bda16b82a06157c110d2e9)
2016-02-09Remove obsolete public network definitionsJuha Kosonen1-5/+10
Use functest_utils.py routines in run_rally-cert.py to retrive external network name instead of static definition in config_functest.yaml. Also change the network name and id setting in task arguments. Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 41eaec87fe939a8511dc6c0ec63976b53cbf5578)
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 76ee625343b28868ca7c6c6108ee974bb57dbea8)
2016-02-09Used sed instead of crudini for updating regexViktor Tikkanen1-2/+1
It seems that crudini has limitations regarding quotation marks so sed tool is used instead in order to replace ssh_user_regex parameter into tempest.conf file. Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 8d7f1158885ca2d880811747b07f34ab50d2031d)
2016-02-08Added configuration of ssh_user_regex parameterViktor Tikkanen1-0/+5
Some Rally versions don't set correctly SSH user name into tempest.conf file so that e.g. test_server_basicops test case of Tempest suite fails with "Please login as 'cirros' user, not as root" error. This change ensures that correct SSH user info will be used for Cirros images created by Rally. Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 04cf934e24b0f7e0c53125711b4e98c14d54f049)
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen11-95/+98
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 01608c214878c19c9f01c60e1b08e106a5d684cf)
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5cf9b7fe8f380f6315e656527b90778c2d91a95c)
2016-02-03Consider volumes and floatingips as defaults in clean_openstackjose.lausuch2-18/+56
Change-Id: I3ffc864768a7c474ee1063eecee1e2085de807b5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 16038f444c1e80006e13b72cb0597976a0b2f92e)
2016-02-02bug fix to run tempest and minor display error in run_test.shMorgan Richomme1-0/+1
Change-Id: Ic30bdd1c514aa8dcab37ba91de2f8879729a80a2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 86c95df05ef125218f392748a177d2f9aa79848f)
2016-02-02Use openstack client to avoid keystone deprecation warningsjose.lausuch1-6/+6
Change-Id: Ib82b3f20d0c23fc67201c7159e3b3a6de5c201cf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 906b3b2f7e85f1269d009684b1a557a6c19e96bc)
2016-02-02Use generate_defaults instead of os_defaults fixed parametersjose.lausuch2-22/+29
JIRA: FUNCTEST-131 Running generate_defaults.py in prepare_env.sh (before running any test) will create a file with the CURRENT OpenStack objects in the deployment. After each test, the cleanup script will take into consideration those parameters instead of the specified in os_defaults.yaml Keep os_defaults.yaml for the moment Change-Id: I5f38fef47f0a6d79407d1d582b1e7d3713503e07 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 47635924e6def36be3c44a047d91018e47a439eb)
2016-02-01Add script to generate the OpenStack defaultsjose.lausuch1-0/+176
JIRA: FUNCTEST-131 It checks the existing Openstack objects in the current deployment (i.e. when the script is executed) and it will create a yaml file to be used afterwards by clean_openstack. This way, a user can generate the defaults when needed if there are things that are not meant to be deleted without fear of using clean_openstack. Change-Id: Iacf204bdd14f591df21b3f243d27199ead2404b0 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 954907ac2995cfc158d5e363829af7c776be5f90)
2016-02-01Enable all rally outputs in verbose modeJuha Kosonen1-19/+28
In verbose mode the complete output of rally tests is shown. Change-Id: I315c89b270312b13b3630b97cc24e5f529952645 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit e75f34706a8d72ee440d7f94363d4909a02f5293)
2016-02-01Add aodh default user for apexjose.lausuch1-2/+2
Noticed here: https://build.opnfv.org/ci/view/functest/job/functest-apex-opnfv-jump-1-daily-master/lastBuild/consoleFull Change-Id: I508f8c2d6e19ba2ee5e633a3ed323693b06a6692 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 2eeb7cb050bf1a52358eb526eaad48870efcb46c)
2016-01-30Copy tempest.conf to results dir to be uploaded to artifactsjose.lausuch1-4/+7
Change-Id: I9cfe566c085dc45410a03650a9cf2a84de004d19 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit aa02e0de645a6af39baed4abed3667a112b09c42)
2016-01-29Create stdout and stderr files for Tempest resultsjose.lausuch1-7/+18
Change-Id: Ibd45dd628dc64db16af28102276f5523f55fcaf4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit c04286e7e407ebfc383f1e69ae1b7c3e015b9971)
2016-01-29Change scenario start/result messages in run_rally-cert.pyJuha Kosonen1-3/+3
Change-Id: I2f5d4f327ab88b6855569d920a275ec801eb0311 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 358ea20ea921db3d2f4ed0d0d22c92a2b534ce3a)
2016-01-29Add scenario name to Rally result messageJuha Kosonen1-2/+2
Change-Id: I1eb6604c9ad658b65cc47c8d7d0f47717078a9fe Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit c269353e4027a2f8d690fc4a03315ebc93301ba7)
2016-01-28Change to logger.error when there is an error in clean_openstackjose.lausuch1-13/+14
Change-Id: I753ded0cbbd9982dfa81ff734ae1f1fdeea6f268 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 899f54d9123f6cdc349807dc7fc17fdbc58d2394)
2016-01-28Reduce Rally outputjose.lausuch1-7/+18
This patch intends to reduce the output of Rally test, showing only the important information of the tests, which is the scenario name and the table with results. Showing the scenario json/yaml is unnecessary since it is already in the repo. Change-Id: Iff0ba3fed17212bb4a695c4155747c8aaf683da3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit b0365d10fda5018721d012602077dddda948a6d9)
2016-01-28Volume type management moved from run_tests.sh to run_rally-cert.pyJuha Kosonen1-0/+29
Change-Id: I80c8b27e041ec5089b816b8515cbc8fa1e8b9eea Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 9922669c3dd92d43c6e387c8077255153c35b71e)
2016-01-27Option to redirect stderr output to a file for Tempest testjose.lausuch1-1/+19
The output when we run Tempest from CI is too long if there are many tests failing. This patch intends to show only the test cases that passed/failed within a table. If troubleshooting is needed, it will be a log file with all the stderr in it. Change-Id: If5b0f35463a3dae06a0c177de4dc473bfc4687c5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 9be6519eca39111295b89e9b3b0d853f95126a72)
2016-01-26Add more OS defaults for Fuel 8.0jose.lausuch1-2/+2
Change-Id: I6f569a4fd66020a699702733303ec55c6aeab15d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 683f459c4e6be7d984b857f6c5c2df7e6c2eae8d)
2016-01-22Removed unnecessary references to public subnet cidrJuha Kosonen2-4/+0
Change-Id: I9961fcdd9fca6ae98f4c1b38c7eae119447132e4 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit b8a2d3f517a2c599b603da491229527278b0e87d)
2016-01-22Put scenario in version field on the Test DB (rather that git indication)Morgan Richomme3-6/+6
Change-Id: I22f7ff3841d7fca637e400d92926d2e1b1755371 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 59063638116508f7ce4f7612def938bb9eb0e938)
2016-01-21Add control to redirect rally stderrJuha Kosonen2-4/+17
By default rally stderr output is suppressed. Option --verbose enables the output by redirecting it to stdout. Change-Id: I2fd372b2a5cd70095969ef926bc9675dde4f98f6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit c2fcca7373e4b65d4eec221e020bc49c9e443a70)
2016-01-21Add default admin_floating for Fuel 8.0jose.lausuch1-2/+2
Change-Id: I43640cde64ccf5975195f2d5c71c8fc5634b4503 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit c8cb5e92172f78aa75bd36362f3644322165436d)
2016-01-20Check if rally image already exist and don't create it again if sojose.lausuch2-39/+38
Change-Id: Ib872b7c21449fe4dc9c4331401fbfbff86140f68 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 2a9268e11cbac21a0952dee6831d28cd06dc70d7)
2016-01-19Add mention to apache 2 license in Functest files and remove unused filesMorgan Richomme3-1/+18
Change-Id: Iaf67792ad61351d0573c8d92e5d78f5f7a6e86ff Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit cc27777f84ea018cc2c0487a4fc3ff0c3b6d358f)
2016-01-19Remove rally stderr output from rally-certjose.lausuch1-2/+11
Change-Id: I2a5bb72989639059f082eedfb4abe8d582bef35c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 79a23744af12da7163e3a142dd44f60d46cbfd41)
2016-01-19Remove all the unnecessary Rally outputjose.lausuch1-3/+10
Change-Id: Ic6c719afadae56723ba515eaf9ad5e29be57c129 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 29d9df125f30f0fbfd20da687be89603de2b84e1)
2016-01-19Bugfix Missing "$" in front of some variablesjose.lausuch1-3/+3
Change-Id: I1192ee4cf692861509777c9c13f917ff58dc8660 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 36a3d6d9de841ec459a4edc7890d5aeb2fe46024)
2016-01-18Add 'neutron' default user for joidjose.lausuch1-1/+1
Change-Id: I60bf62f1df40acdfeea6ed72cf1823725c763b38 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 322dd6a16cc1b77d8ccd49f0d19781e455ef6bfb)
2016-01-18Print openstack defaults before running clean_openstack.pyjose.lausuch1-0/+22
Change-Id: Ifc3ce69074d5c264ab252aaadb2877c823901b76 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit dc566ec04b7af4c35be6c8a41271367cb1dd621b)
2016-01-15Change novaclient usagejose.lausuch3-6/+6
Avoid having this warning: UserWarning: 'novaclient.v2.client.Client' is not designed to be initialized directly. Change-Id: I1a9154d97be14007bcb988a5ccd630eadf2e8a5f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit eb12e95f822c70566cb417e5b5d85a65df14b79c)
2016-01-15Remove extra output if CI_DEBUG is falsejose.lausuch1-2/+1
This way we have a nicer view in Jenkins when preparing Functest Change-Id: Ie0df3aa8b07ac2fd726d11b1ab01a7291d4c2c5e Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 973c722f929eb3652d19a15911404f31a9f66216)
2016-01-13Remove arg.repo_path in run_rally_cert.pyjose.lausuch1-6/+8
It is not needed as we have an env variable which points to the repositories directories Change-Id: I4c07e6a28a9e31a2794d74182436545fe6561a92 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit ce427331a1d220a061abcd1dbd6caac9dff9afee)
2016-01-13Place config_functest.yaml outside the functest repojose.lausuch3-3/+3
If config_functest.yaml is given it will be placed in: /home/opnfv/functest/conf/config_functest.yaml If not given: copy default from repo to that location Change-Id: I816bf5ccf8e0a5b8ebde2a0ab924657533f49127 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 00b51ffe114702ce207aa7ba2e40f01984c0c57c)
2016-01-12Add cinderv2 and ceilometer to default users for Apexjose.lausuch1-1/+1
Change-Id: I923a2f2dfc8b9e6c68cf2c03edde4f4e38ba23b4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit ef47efad50bb9c194d553c12c87ef93bf66f30c8)
2016-01-12Fixes netcat for multiple platformsTim Rozet1-1/+1
netcat package on LF POD1 missing -z arg. This update allows for netcat to be used when platforms are missing it. Change-Id: I09fb9986520018a92a1c9147a2948ae5029bb3e3 Signed-off-by: Tim Rozet <trozet@redhat.com> (cherry picked from commit 83cb89a2cd3b95acab7f616533653493354138c1)