summaryrefslogtreecommitdiffstats
path: root/testcases
AgeCommit message (Collapse)AuthorFilesLines
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 76ee625343b28868ca7c6c6108ee974bb57dbea8)
2016-02-09doctor: adds loggerRyota MIBU1-7/+23
Change-Id: Idc9c0f17049b9e6d2d7a0b8dc2bf35778d3c29dd Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com> (cherry picked from commit fc19da3f029594b4e0a72bfe11b66d0ed76f0ff4)
2016-02-09Used sed instead of crudini for updating regexViktor Tikkanen2-3/+2
It seems that crudini has limitations regarding quotation marks so sed tool is used instead in order to replace ssh_user_regex parameter into tempest.conf file. Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 8d7f1158885ca2d880811747b07f34ab50d2031d)
2016-02-08Merge "enable doctor test scenario" into stable/brahmaputraMorgan Richomme1-2/+2
2016-02-08enable doctor test scenarioRyota MIBU1-2/+2
Change-Id: If0e050e979d886fff436daa384a97a651a56aaa5 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com> (cherry picked from commit f91f448317ea36ce5c790bcac345dfdcefbe1fb7)
2016-02-08Added configuration of ssh_user_regex parameterViktor Tikkanen2-0/+7
Some Rally versions don't set correctly SSH user name into tempest.conf file so that e.g. test_server_basicops test case of Tempest suite fails with "Please login as 'cirros' user, not as root" error. This change ensures that correct SSH user info will be used for Cirros images created by Rally. Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 04cf934e24b0f7e0c53125711b4e98c14d54f049)
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen11-95/+98
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 01608c214878c19c9f01c60e1b08e106a5d684cf)
2016-02-04Import request python module for promise test casejose.lausuch1-0/+1
Change-Id: I437766fe1c595a60a82af3c49a5eb29974e0da33 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit b0e19118c80d694820dd75c53001e0b9563061a9)
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5cf9b7fe8f380f6315e656527b90778c2d91a95c)
2016-02-04Use python json parser to get the results form the Promise json reportjose.lausuch1-29/+32
JIRA: FUNCTEST-68 Also, add sleep to let the promise instances terminate, otherwise, clean_openstack will detect them while they are still being removed and will fail. Change-Id: I7a5543143758483eb1d7e06dbe4922e9f1e05cfb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 75149a9d278b5a969606ad182fff580c08e37d6c)
2016-02-03bug fix: get installer using functest_utilsMorgan Richomme1-1/+1
JIRA: FUNCTEST-68 Change-Id: I0b4847f28ca77e171ca525b301b7bfa6cf366e94 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit a6a3af39986e61f5f7c9094befec41fd753610d5)
2016-02-03FIX: sleep 3 second to release create_venv.sh from chmod commandgrakiss1-0/+1
sometimes vIMS failed to create venv for "Text file busy",it should be a side effect of last command "chmod +x ..." Change-Id: I6a94b644e89988efa92afc46e9fbdeb8564db89e Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2016-02-03Show Promise results output and push results to DBjose.lausuch1-18/+45
JIRA: FUNCTEST-68 Change-Id: Iecb1becee1fc788a7c854227a8c3ea2252898eba Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 17baf4a83e8b9962281ed230e75c362047c34487)
2016-02-03Consider volumes and floatingips as defaults in clean_openstackjose.lausuch2-18/+56
Change-Id: I3ffc864768a7c474ee1063eecee1e2085de807b5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 16038f444c1e80006e13b72cb0597976a0b2f92e)
2016-02-02Create security groups with ICMP and SSH rules for vPing testsjose.lausuch2-17/+112
JIRA: FUNCTEST-133 Some installers don't allow icmp and TCP port 22 (SSH) in the default security group. To avoid any dependency with the installer, vPing will create its own security group with those rules and delete it afterwards. Change-Id: I6f31f21c240d80eed8bead638af51aa7e1e92aad Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit ab3413a15aeb3b3669da94fa383ec07212eeb915)
2016-02-02bug fix to run tempest and minor display error in run_test.shMorgan Richomme2-1/+2
Change-Id: Ic30bdd1c514aa8dcab37ba91de2f8879729a80a2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 86c95df05ef125218f392748a177d2f9aa79848f)
2016-02-02Report vPing timeouts to the DB with duration = 0 and test status=NOKjose.lausuch2-37/+38
JIRA: FUNCTEST-132 Change-Id: Ida0c485504fd07db29b0c33ac59da6944da303a9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 5bb53025a593bbda834ef6ad325faba5aa073f7f)
2016-02-02Remove error message if instance is not foundjose.lausuch1-2/+2
Reason: vping calls this function until the VMs are deleted, when that happens, it throws an exception and returns None, which is fine, but the message error on the output is a bit confusing if you don't know the context. Change-Id: I8a4c408197d3c83151fb15a12387575d9fe1d553 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 7dd58acc208727aaed83807f065dedcc899b0137)
2016-02-02Small improvements with output messagesjose.lausuch1-24/+11
Change-Id: I4c274df30bc3123bef23d5423a1762a07dd93e68 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit ac0d556e54a09b5a3470b20384ac58f7ed383202)
2016-02-02Use openstack client to avoid keystone deprecation warningsjose.lausuch2-7/+7
Change-Id: Ib82b3f20d0c23fc67201c7159e3b3a6de5c201cf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 906b3b2f7e85f1269d009684b1a557a6c19e96bc)
2016-02-02Use generate_defaults instead of os_defaults fixed parametersjose.lausuch3-26/+29
JIRA: FUNCTEST-131 Running generate_defaults.py in prepare_env.sh (before running any test) will create a file with the CURRENT OpenStack objects in the deployment. After each test, the cleanup script will take into consideration those parameters instead of the specified in os_defaults.yaml Keep os_defaults.yaml for the moment Change-Id: I5f38fef47f0a6d79407d1d582b1e7d3713503e07 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 47635924e6def36be3c44a047d91018e47a439eb)
2016-02-01Use promise-flavor if exists and don't try to create it againjose.lausuch1-10/+17
Change-Id: I02ba76acb02f9785d13ca9bcd61ebe1290fa1cd7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 81d7877b7f124f393c929e3a862e64125218e945)
2016-02-01Add script to generate the OpenStack defaultsjose.lausuch1-0/+176
JIRA: FUNCTEST-131 It checks the existing Openstack objects in the current deployment (i.e. when the script is executed) and it will create a yaml file to be used afterwards by clean_openstack. This way, a user can generate the defaults when needed if there are things that are not meant to be deleted without fear of using clean_openstack. Change-Id: Iacf204bdd14f591df21b3f243d27199ead2404b0 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 954907ac2995cfc158d5e363829af7c776be5f90)
2016-02-01Enable all rally outputs in verbose modeJuha Kosonen1-19/+28
In verbose mode the complete output of rally tests is shown. Change-Id: I315c89b270312b13b3630b97cc24e5f529952645 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit e75f34706a8d72ee440d7f94363d4909a02f5293)
2016-02-01use scenario instead of git info in version field of the test resultsMorgan Richomme1-3/+3
Change-Id: Ie80cc39e64d0fe70981623229560aa145df95c50 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 86728ad2ccfbea4a733b664aaafff0fcc22c4b0e)
2016-02-01Merge "Add aodh default user for apex" into stable/brahmaputraMorgan Richomme1-2/+2
2016-02-01Add testcases results to DBlanqinglong1-6/+29
Change-Id: Iada89aa690f6b3f1d041328b641620ceb0279912 (cherry picked from commit 817f19d6c668176d9e62ab4a3523585fcdd92b01)
2016-02-01Export private net OS_TEST_NETWORK for Promise testsjose.lausuch1-0/+10
Change-Id: Ie2e83a049a98f8e63245c3b992ff379fd353a0be Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit cc8dd9e8092cc68484d8ad3422c97762658271e8)
2016-02-01Add aodh default user for apexjose.lausuch1-2/+2
Noticed here: https://build.opnfv.org/ci/view/functest/job/functest-apex-opnfv-jump-1-daily-master/lastBuild/consoleFull Change-Id: I508f8c2d6e19ba2ee5e633a3ed323693b06a6692 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 2eeb7cb050bf1a52358eb526eaad48870efcb46c)
2016-01-30fix the bug of onos test reportlanqinglong1-3/+23
Change-Id: I34a068f991b89af6c65c895c7e9e604eac5dadf6 (cherry picked from commit 38cb5f334a2acc034b9757eba68561d134da79fa)
2016-01-30Copy tempest.conf to results dir to be uploaded to artifactsjose.lausuch1-4/+7
Change-Id: I9cfe566c085dc45410a03650a9cf2a84de004d19 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit aa02e0de645a6af39baed4abed3667a112b09c42)
2016-01-29Create stdout and stderr files for Tempest resultsjose.lausuch1-7/+18
Change-Id: Ibd45dd628dc64db16af28102276f5523f55fcaf4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit c04286e7e407ebfc383f1e69ae1b7c3e015b9971)
2016-01-29bugfix: self.loggerboucherv1-2/+2
Change-Id: I6e9b3a833f590831cddac83e00a6b8809410d2cb Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit feecd6ccf9231ffdb82ac6bb2b1dcbb8389e457c)
2016-01-29Merge "Add some error result in result db api" into stable/brahmaputraboucherv3-59/+82
2016-01-29Change scenario start/result messages in run_rally-cert.pyJuha Kosonen1-3/+3
Change-Id: I2f5d4f327ab88b6855569d920a275ec801eb0311 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 358ea20ea921db3d2f4ed0d0d22c92a2b534ce3a)
2016-01-29Add some error result in result db apiboucherv3-59/+82
Change-Id: I1c5f9bc51c04e321ace8c0ee0312be28d321910f Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit 9ec86196a8e96fea966beef08c01b9c9822a9bc4)
2016-01-29Add scenario name to Rally result messageJuha Kosonen1-2/+2
Change-Id: I1eb6604c9ad658b65cc47c8d7d0f47717078a9fe Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit c269353e4027a2f8d690fc4a03315ebc93301ba7)
2016-01-28Small typos fixes in functest_utils.pyjose.lausuch1-6/+7
Change-Id: I9fdb1efe11ce62c460f380ba1087ed9fc83611ef Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 87880013c9030fdacf477c0b977a8e06f9afbbdf)
2016-01-28Change to logger.error when there is an error in clean_openstackjose.lausuch1-13/+14
Change-Id: I753ded0cbbd9982dfa81ff734ae1f1fdeea6f268 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 899f54d9123f6cdc349807dc7fc17fdbc58d2394)
2016-01-28Refactor functest_utils.pyJuha Kosonen1-23/+24
The order of volume type related functions and the error handling changed to conform general approach used in functest_utils.py. Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 09f1b2201aaee2c3deee5936c819089bcc86692b) Change-Id: I1461380ae0c579e5557bf4bfec4ec68f2766ee40
2016-01-28change for get joid onos iplanqinglong1-2/+17
(cherry picked from commit 03ec0a88e72ed6c2fdc2995d0c93d2c61f847ae3) Change-Id: Ic6d420d855615ddf53de707c19771fffaba47bbf
2016-01-28Merge "Fix promise test output" into stable/brahmaputrajose.lausuch1-2/+3
2016-01-28Reduce Rally outputjose.lausuch1-7/+18
This patch intends to reduce the output of Rally test, showing only the important information of the tests, which is the scenario name and the table with results. Showing the scenario json/yaml is unnecessary since it is already in the repo. Change-Id: Iff0ba3fed17212bb4a695c4155747c8aaf683da3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit b0365d10fda5018721d012602077dddda948a6d9)
2016-01-28Volume type management moved from run_tests.sh to run_rally-cert.pyJuha Kosonen2-0/+59
Change-Id: I80c8b27e041ec5089b816b8515cbc8fa1e8b9eea Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 9922669c3dd92d43c6e387c8077255153c35b71e)
2016-01-27Fix promise test outputjose.lausuch1-2/+3
Change-Id: I12bda2e9953228bd0db1810a8a06bfe2e1644ac8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 9c6eeae44d8e82fb7af2111784474628ec839a46)
2016-01-27Bugfix print arguments in functest_utils.pyjose.lausuch1-3/+4
Change-Id: I54c94ad43a88732840c0cf915bae42a0cf476e90 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit fd0e23740a75ef749a75431defba50520d79215a)
2016-01-27Print json result file of Promise testcasejose.lausuch1-6/+18
JIRA: FUNCTEST-68 Change-Id: Ib89e84b7f4d6f3cfe990655c941705af1da24bfb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 5c705a0c56af8d622edafa1e99e9806ba627754e)
2016-01-27Remove possible message "No handlers could be found for logger paramiko"jose.lausuch1-0/+1
Change-Id: Ib6324b96489551cd88eb1639cb61d38bff898638 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 438a29faf556a9dcc2a304180ce77a32cc748e35)
2016-01-27Option to redirect stderr output to a file for Tempest testjose.lausuch1-1/+19
The output when we run Tempest from CI is too long if there are many tests failing. This patch intends to show only the test cases that passed/failed within a table. If troubleshooting is needed, it will be a log file with all the stderr in it. Change-Id: If5b0f35463a3dae06a0c177de4dc473bfc4687c5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 9be6519eca39111295b89e9b3b0d853f95126a72)
2016-01-27Refactor functest_utils.py scriptjose.lausuch1-287/+380
JIRA: FUNCTEST-129 Change-Id: Id5202b1830f7efa77fdb8023d4eeb93775168d29 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit b3b50bef3d0ee76decca7810fbccdbac13ab892c)