summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-02-23Fix differences in stable/brahmaputrajose.lausuch2-79/+77
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-23Moving testusage.rst to introduction.rst to avoid being pulled into the ↵ChristopherPrice4-194/+194
userguide. Change-Id: I96bc3bd578ccb19b0aac2af2f2134619e476605f Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-23Add compass onos and odl_l2 scenariomrichomme2-638/+4215
Signed-off-by: mrichomme <morgan.richomme@orange.com> (cherry picked from commit 2515014f340542d0f39e1ea516314ddb5fb86c0a) Change-Id: I9331aec4fb2548e15a37f63da6190ad490d5b8e6
2016-02-23remove "print" in tempest to avoid having a message "None" in the outputjose.lausuch1-1/+1
Change-Id: If2008fa7ed1bce1b5acc40cad82c21afa55ec4e5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit f937af8864c6fe6d392c9b9766df98d164c64459)
2016-02-23Create troubleshooting guide as a separate .rstjose.lausuch2-120/+123
Change-Id: I2d5a1544e7c07dbc164b5d7403318ccafe75e5c1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit a931c6fe03313fac0cb1374acad2d753670328bf)
2016-02-22Add git support for Doctor repo in config_functest.yamljose.lausuch3-3/+20
Change-Id: I10ad0dc6cd6697a2a93f5e11edcdd69f70f86c5f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit e0e52cec1e43491714f0ce078a7722e2cc3d9fca)
2016-02-19Fix message outputs taken from the console log in vPing_sshjose.lausuch1-4/+18
Change-Id: Id169167d90d60b8266913a8451699969abb4ef7c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 8960264f843abd8c261b0effe9014d1be5cd4dae)
2016-02-19Corrected using of echo commandViktor Tikkanen1-2/+2
Full path of echo is needed when using -e option in Docker file. Otherwise -e will be output as part of the string. Change-Id: Ic226209a3ef5dac991ccae996f6e7afa0061fccf Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 78fd590723f24a723fe8ab32bf992b80f0956f25)
2016-02-18Remove network failed message check form vping_sshjose.lausuch1-2/+1
Change-Id: I72d97af3ddd76f698ce54918cf92f98c8f5a7fd4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 4789710123718723adbc84ab6445ac141e074a9b)
2016-02-18Add VI and alias support in the docker containerjose.lausuch1-0/+6
When editing a file with VI in the container, the keyboard is not properly setup. This options will help to do things more smoothly.. Change-Id: I4c9004a4df067d7bbb558461dd98d76e32e64591 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 80ddf6005f1e1afbcbc3183f2a0ced1a66fdfe8b)
2016-02-17Release floating ip after vPing_ssh testjose.lausuch2-37/+37
Also, check the console to see if the instance fails when sending the discover to the dhcp agent Change-Id: I314051886b9580a42bb88f2d88a9bdbf2a9e198a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 62131c3f53e66b6305bdd163037d452483821cfd)
2016-02-16Create vPing_userdata instances with dynamic ports created by nova/neutronjose.lausuch3-110/+115
Change-Id: I1808763f6ccf1ac90b8a696c48ecdfba03d782fb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 81892929f7fc0949b08eb79c93583658a2b87c50)
2016-02-16Create vPing instances with dynamic ports created by nova/neutronjose.lausuch2-147/+146
Also, - check if the used network is already created to not create it again - check if the image already exists to not create it again - check if the sec group already exists to not create it again Change-Id: I243619a1538444d836fdda84a86b834668aaf456 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 12c1b110e91b2c062b378561f3fb271fe0626aec)
2016-02-12Rally live migration case selectionJuha Kosonen3-44/+61
Execute live migration cases only if the feature is enabled in Tempest configuration file. Change-Id: Ie88da2a8f6a4e22cbc96d6aa1f749d555ac58d84 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 1d62586d396d948c523fb0b0e351ae162e7fdc6b)
2016-02-12Add result overview and onos-nosdn-ha scenario reultsMorgan Richomme4-283/+1659
Change-Id: I5978d06dc2f991630a6fd3ebfb8c20c5f8978b1b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 6e424590b9e3129ffc2801df9b23b7313126389e)
2016-02-12docs: add userguide file for the central docRyota MIBU1-0/+6
See https://wiki.opnfv.org/documentation/userguide . Change-Id: Id3786ca6d69b517e9dc8ddc96c9cf3a8cf3438ea Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com> (cherry picked from commit 3bdc2171d87e61da1589fe238c6fa6ed5981ffe5)
2016-02-11Adding a structure for the reporting of test cases for functestChristopherPrice24-343/+1653
The structure builds on an index.rst in the results folder. The results are seperated inot specific files for each scenario. All scenarios are commented out at this time and we can add them when ready. Not all scenario files have template text at this time. (have to run, wanted to push this) Change-Id: Iaff140a5e8106f19d15d23f937f6dd27453a5680 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> (cherry picked from commit 75bfd472302483a201a48eb18c69447343f83b75)
2016-02-11bug fiw syntax when calling push to db from vIMSMorgan Richomme1-1/+2
Change-Id: I79ce10993c5a21fcb840681efd364ad2dc366e50 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit b577ceda844c7fae4b2991b12a335f34fcf9cd73)
2016-02-11Add project in push_to_db function of functests utils to allow external ↵Morgan Richomme7-53/+50
project onboarded in Functest to push their results Change-Id: I3a065e6ce82b1a87bbd07810f13df7d146655933 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 9812bf270c6ef1a5f0582bd8be3c5a3776e73960)
2016-02-11Push results without extra formatingMorgan Richomme1-5/+7
Change-Id: I70713a30cec556ca7cd32122b9c10cf4c1732c3f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 4c2674593f1bf6f093bbdc5de41241e46bfcbe14)
2016-02-11Enadled --serial option for run_tests.shViktor Tikkanen3-3/+27
It could be useful to execute e.g. Tempest test cases in a single thread in order to troubleshoot possible concurrency problems. Change-Id: I5e5fc190fb4483ff075a8f837a8d4116ece90c80 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 66df82a76334015e3e2d25ddcc22b343b110320c)
2016-02-10Bugfix add "fi" at the end of the if-else statement in run_tests.shjose.lausuch1-0/+1
Change-Id: I14945cf335803936043ab71dff93250577bc6601 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 188aef4912beee7a8eb87272de1500a1bded99f0)
2016-02-10Add -n|--no-clean flag to vPing,Tempest,Rally,vIMS scriptsjose.lausuch7-5/+45
Use --no-clean flag in run_tests.sh to tell the test scripts to cleanup or not the resources Change-Id: I597eca5199e1eaf16b1f03a223222d33e4adf170 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit abc81e24d33b9bf8d2f8fb05dc5f5f57443abe93)
2016-02-10Rename the vPing scripts proplery and adapt documentationjose.lausuch8-25/+32
Change-Id: Idb498eb7cefd938006661f42f1bf1772395d9d47 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Doc updatesjose.lausuch3-166/+211
- Some clarifications, rephrasing - Remove more statements related to the DB - Add more info for vPing - Add more info about clean defaults Change-Id: I12e97443852dc38a23bda589945ca0333a37e410 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit e637e75435587014cb99edbc57e79970095d0464)
2016-02-10Create Rally summary report also for verbose modejose.lausuch1-24/+36
Also: - Fix percentage format of summary - Get the percentage from the row 'total' JIRA: FUNCTEST-134 Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 945aff5ef35837170fc09953b83cfb6081a1edad)
2016-02-10Push rally summary results into DBMorgan Richomme2-49/+53
json produced by Rally are pushed to rally_details Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 96f4bbb9aef2b4d3a8bda16b82a06157c110d2e9)
2016-02-09Remove obsolete public network definitionsJuha Kosonen2-11/+10
Use functest_utils.py routines in run_rally-cert.py to retrive external network name instead of static definition in config_functest.yaml. Also change the network name and id setting in task arguments. Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 41eaec87fe939a8511dc6c0ec63976b53cbf5578)
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 76ee625343b28868ca7c6c6108ee974bb57dbea8)
2016-02-09doctor: adds loggerRyota MIBU1-7/+23
Change-Id: Idc9c0f17049b9e6d2d7a0b8dc2bf35778d3c29dd Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com> (cherry picked from commit fc19da3f029594b4e0a72bfe11b66d0ed76f0ff4)
2016-02-09update docMorgan Richomme2-332/+405
- update external test cases - add chapter on push to DB Change-Id: I10cd5c9583233604c8b8595f173c690f45124789 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 6ab2ccb7071f1d4925f25344d4b4a29d0525d935)
2016-02-09Used sed instead of crudini for updating regexViktor Tikkanen2-3/+2
It seems that crudini has limitations regarding quotation marks so sed tool is used instead in order to replace ssh_user_regex parameter into tempest.conf file. Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 8d7f1158885ca2d880811747b07f34ab50d2031d)
2016-02-08Merge "enable doctor test scenario" into stable/brahmaputraMorgan Richomme1-2/+2
2016-02-08enable doctor test scenarioRyota MIBU1-2/+2
Change-Id: If0e050e979d886fff436daa384a97a651a56aaa5 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com> (cherry picked from commit f91f448317ea36ce5c790bcac345dfdcefbe1fb7)
2016-02-08Added configuration of ssh_user_regex parameterViktor Tikkanen2-0/+7
Some Rally versions don't set correctly SSH user name into tempest.conf file so that e.g. test_server_basicops test case of Tempest suite fails with "Please login as 'cirros' user, not as root" error. This change ensures that correct SSH user info will be used for Cirros images created by Rally. Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com> (cherry picked from commit 04cf934e24b0f7e0c53125711b4e98c14d54f049)
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen11-95/+98
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 01608c214878c19c9f01c60e1b08e106a5d684cf)
2016-02-05update user guideMorgan Richomme3-224/+249
- change vIMS logs - add Promise logs - modify section on OpenStack audit (now dynamic) - minor reformating of tables - typos - add troubleshooting section on vPing and vPing_userdata JIRA: FUNCTEST-113 Change-Id: Ib29c4d5e2c4f10f64de764491fc536495b39ea3d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit c348fa9a9dcd8fd4fb4d83b36d441e3c949af390)
2016-02-04Import request python module for promise test casejose.lausuch1-0/+1
Change-Id: I437766fe1c595a60a82af3c49a5eb29974e0da33 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit b0e19118c80d694820dd75c53001e0b9563061a9)
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 5cf9b7fe8f380f6315e656527b90778c2d91a95c)
2016-02-04Use python json parser to get the results form the Promise json reportjose.lausuch2-29/+33
JIRA: FUNCTEST-68 Also, add sleep to let the promise instances terminate, otherwise, clean_openstack will detect them while they are still being removed and will fail. Change-Id: I7a5543143758483eb1d7e06dbe4922e9f1e05cfb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 75149a9d278b5a969606ad182fff580c08e37d6c)
2016-02-03bug fix: get installer using functest_utilsMorgan Richomme1-1/+1
JIRA: FUNCTEST-68 Change-Id: I0b4847f28ca77e171ca525b301b7bfa6cf366e94 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit a6a3af39986e61f5f7c9094befec41fd753610d5)
2016-02-03FIX:use 'info' after sourcing the common.shgrakiss1-1/+1
Change-Id: I0572375d79983791970ece0d31ed2e3d7df8cfc3 Signed-off-by: grakiss <grakiss.wanglei@huawei.com> (cherry picked from commit 778325ba0b725ab524ffb1944140e3e555dcfd5d)
2016-02-03FIX: sleep 3 second to release create_venv.sh from chmod commandgrakiss1-0/+1
sometimes vIMS failed to create venv for "Text file busy",it should be a side effect of last command "chmod +x ..." Change-Id: I6a94b644e89988efa92afc46e9fbdeb8564db89e Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2016-02-03Show Promise results output and push results to DBjose.lausuch1-18/+45
JIRA: FUNCTEST-68 Change-Id: Iecb1becee1fc788a7c854227a8c3ea2252898eba Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 17baf4a83e8b9962281ed230e75c362047c34487)
2016-02-03Consider volumes and floatingips as defaults in clean_openstackjose.lausuch2-18/+56
Change-Id: I3ffc864768a7c474ee1063eecee1e2085de807b5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 16038f444c1e80006e13b72cb0597976a0b2f92e)
2016-02-02Create security groups with ICMP and SSH rules for vPing testsjose.lausuch2-17/+112
JIRA: FUNCTEST-133 Some installers don't allow icmp and TCP port 22 (SSH) in the default security group. To avoid any dependency with the installer, vPing will create its own security group with those rules and delete it afterwards. Change-Id: I6f31f21c240d80eed8bead638af51aa7e1e92aad Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit ab3413a15aeb3b3669da94fa383ec07212eeb915)
2016-02-02bug fix to run tempest and minor display error in run_test.shMorgan Richomme3-2/+3
Change-Id: Ic30bdd1c514aa8dcab37ba91de2f8879729a80a2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 86c95df05ef125218f392748a177d2f9aa79848f)
2016-02-02Report vPing timeouts to the DB with duration = 0 and test status=NOKjose.lausuch2-37/+38
JIRA: FUNCTEST-132 Change-Id: Ida0c485504fd07db29b0c33ac59da6944da303a9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 5bb53025a593bbda834ef6ad325faba5aa073f7f)
2016-02-02Remove error message if instance is not foundjose.lausuch1-2/+2
Reason: vping calls this function until the VMs are deleted, when that happens, it throws an exception and returns None, which is fine, but the message error on the output is a bit confusing if you don't know the context. Change-Id: I8a4c408197d3c83151fb15a12387575d9fe1d553 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 7dd58acc208727aaed83807f065dedcc899b0137)
2016-02-02Small improvements with output messagesjose.lausuch2-33/+14
Change-Id: I4c274df30bc3123bef23d5423a1762a07dd93e68 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit ac0d556e54a09b5a3470b20384ac58f7ed383202)