aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-02-11Adding a structure for the reporting of test cases for functestChristopherPrice24-343/+1653
The structure builds on an index.rst in the results folder. The results are seperated inot specific files for each scenario. All scenarios are commented out at this time and we can add them when ready. Not all scenario files have template text at this time. (have to run, wanted to push this) Change-Id: Iaff140a5e8106f19d15d23f937f6dd27453a5680 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2016-02-10Rename the vPing scripts proplery and adapt documentationjose.lausuch8-25/+32
Change-Id: Idb498eb7cefd938006661f42f1bf1772395d9d47 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Merge "Doc updates"Morgan Richomme3-166/+211
2016-02-10Doc updatesjose.lausuch3-166/+211
- Some clarifications, rephrasing - Remove more statements related to the DB - Add more info for vPing - Add more info about clean defaults Change-Id: I12e97443852dc38a23bda589945ca0333a37e410 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Create Rally summary report also for verbose modejose.lausuch1-24/+36
Also: - Fix percentage format of summary - Get the percentage from the row 'total' JIRA: FUNCTEST-134 Change-Id: Ifb45523921b4096c3242578cf4ddc6b084e8bbb2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-10Push rally summary results into DBMorgan Richomme2-49/+53
json produced by Rally are pushed to rally_details Change-Id: I2f057093307cb395f5c5ffd42c3d228b05133a09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-09Merge "Remove obsolete public network definitions"Morgan Richomme2-11/+10
2016-02-09Create Rally output summary at the end of the testsjose.lausuch1-8/+85
Added template to start pushing results to DB JIRA: FUNCTEST-134 Change-Id: Ibc04eae8478827146947df2bcf3460b8c7ef0bc7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-09Remove obsolete public network definitionsJuha Kosonen2-11/+10
Use functest_utils.py routines in run_rally-cert.py to retrive external network name instead of static definition in config_functest.yaml. Also change the network name and id setting in task arguments. Change-Id: Iced9e9a28e79d6ac6ddd2f9f593481949f5fc8a0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-09Merge "doctor: adds logger"Morgan Richomme1-7/+23
2016-02-09Merge "update doc - update external test cases - add chapter on push to DB"Morgan Richomme2-332/+405
2016-02-09doctor: adds loggerRyota MIBU1-7/+23
Change-Id: Idc9c0f17049b9e6d2d7a0b8dc2bf35778d3c29dd Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-02-09update docMorgan Richomme2-332/+405
- update external test cases - add chapter on push to DB Change-Id: I10cd5c9583233604c8b8595f173c690f45124789 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-08Used sed instead of crudini for updating regexViktor Tikkanen2-3/+2
It seems that crudini has limitations regarding quotation marks so sed tool is used instead in order to replace ssh_user_regex parameter into tempest.conf file. Change-Id: I8587b3e6b0c15930407ab90bf05f00086348edf6 Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-08Merge "enable doctor test scenario"Morgan Richomme1-2/+2
2016-02-08Merge "Added configuration of ssh_user_regex parameter"Morgan Richomme2-0/+7
2016-02-08Added configuration of ssh_user_regex parameterViktor Tikkanen2-0/+7
Some Rally versions don't set correctly SSH user name into tempest.conf file so that e.g. test_server_basicops test case of Tempest suite fails with "Please login as 'cirros' user, not as root" error. This change ensures that correct SSH user info will be used for Cirros images created by Rally. Change-Id: I90dcad0024f2034ef3ed20d2c6981e675213558d Signed-off-by: Viktor Tikkanen <viktor.tikkanen@nokia.com>
2016-02-08enable doctor test scenarioRyota MIBU1-2/+2
Change-Id: If0e050e979d886fff436daa384a97a651a56aaa5 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-02-05Merge "Reduce the number of iterations to ten in rally scenarios"Morgan Richomme11-95/+98
2016-02-05Reduce the number of iterations to ten in rally scenariosJuha Kosonen11-95/+98
Change-Id: Ibefc3f5eeb57ff6a1daa0be26f482ed0376a0d40 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-05update user guideMorgan Richomme3-224/+249
- change vIMS logs - add Promise logs - modify section on OpenStack audit (now dynamic) - minor reformating of tables - typos - add troubleshooting section on vPing and vPing_userdata JIRA: FUNCTEST-113 Change-Id: Ib29c4d5e2c4f10f64de764491fc536495b39ea3d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-04Import request python module for promise test casejose.lausuch1-0/+1
Change-Id: I437766fe1c595a60a82af3c49a5eb29974e0da33 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-04Merge "Fix success status parsing of rally results"Morgan Richomme1-8/+6
2016-02-04Fix success status parsing of rally resultsJuha Kosonen1-8/+6
Change-Id: I6053bce6cc919af7ac34a16843b2583e45f01ac2 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-03Use python json parser to get the results form the Promise json reportjose.lausuch2-30/+34
JIRA: FUNCTEST-68 Also, add sleep to let the promise instances terminate, otherwise, clean_openstack will detect them while they are still being removed and will fail. Change-Id: I7a5543143758483eb1d7e06dbe4922e9f1e05cfb Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-03Revert "bug fix: get installer using functest_utils"Morgan Richomme1-1/+1
This reverts commit a6a3af39986e61f5f7c9094befec41fd753610d5. Change-Id: I33d5d77ce166a324582a8f5ca11d75c5d9628c14
2016-02-03bug fix: get installer using functest_utilsMorgan Richomme1-1/+1
JIRA: FUNCTEST-68 Change-Id: I0b4847f28ca77e171ca525b301b7bfa6cf366e94 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-03Merge "FIX:use 'info' after sourcing the common.sh"Morgan Richomme1-1/+1
2016-02-03FIX: sleep 3 second to release create_venv.sh from chmod commandgrakiss1-0/+1
sometimes vIMS failed to create venv for "Text file busy",it should be a side effect of last command "chmod +x ..." Change-Id: I6a94b644e89988efa92afc46e9fbdeb8564db89e Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2016-02-03Merge "Show Promise results output and push results to DB"Morgan Richomme1-18/+45
2016-02-02FIX:use 'info' after sourcing the common.shgrakiss1-1/+1
Change-Id: I0572375d79983791970ece0d31ed2e3d7df8cfc3 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2016-02-02Show Promise results output and push results to DBjose.lausuch1-18/+45
JIRA: FUNCTEST-68 Change-Id: Iecb1becee1fc788a7c854227a8c3ea2252898eba Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02Consider volumes and floatingips as defaults in clean_openstackjose.lausuch2-18/+56
Change-Id: I3ffc864768a7c474ee1063eecee1e2085de807b5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02Merge "Create security groups with ICMP and SSH rules for vPing tests"jose.lausuch2-17/+112
2016-02-02bug fix to run tempest and minor display error in run_test.shMorgan Richomme3-2/+3
Change-Id: Ic30bdd1c514aa8dcab37ba91de2f8879729a80a2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-02-02Create security groups with ICMP and SSH rules for vPing testsjose.lausuch2-17/+112
JIRA: FUNCTEST-133 Some installers don't allow icmp and TCP port 22 (SSH) in the default security group. To avoid any dependency with the installer, vPing will create its own security group with those rules and delete it afterwards. Change-Id: I6f31f21c240d80eed8bead638af51aa7e1e92aad Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02Report vPing timeouts to the DB with duration = 0 and test status=NOKjose.lausuch2-37/+38
JIRA: FUNCTEST-132 Change-Id: Ida0c485504fd07db29b0c33ac59da6944da303a9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02Merge "Remove error message if instance is not found"Morgan Richomme1-2/+2
2016-02-02Remove error message if instance is not foundjose.lausuch1-2/+2
Reason: vping calls this function until the VMs are deleted, when that happens, it throws an exception and returns None, which is fine, but the message error on the output is a bit confusing if you don't know the context. Change-Id: I8a4c408197d3c83151fb15a12387575d9fe1d553 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02Small improvements with output messagesjose.lausuch2-33/+14
Change-Id: I4c274df30bc3123bef23d5423a1762a07dd93e68 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02Use openstack client to avoid keystone deprecation warningsjose.lausuch3-10/+10
Change-Id: Ib82b3f20d0c23fc67201c7159e3b3a6de5c201cf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-02Merge "Use generate_defaults instead of os_defaults fixed parameters"jose.lausuch4-27/+36
2016-02-01Use promise-flavor if exists and don't try to create it againjose.lausuch1-10/+17
Change-Id: I02ba76acb02f9785d13ca9bcd61ebe1290fa1cd7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-01Use generate_defaults instead of os_defaults fixed parametersjose.lausuch4-27/+36
JIRA: FUNCTEST-131 Running generate_defaults.py in prepare_env.sh (before running any test) will create a file with the CURRENT OpenStack objects in the deployment. After each test, the cleanup script will take into consideration those parameters instead of the specified in os_defaults.yaml Keep os_defaults.yaml for the moment Change-Id: I5f38fef47f0a6d79407d1d582b1e7d3713503e07 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-01Merge "Add script to generate the OpenStack defaults"Morgan Richomme1-0/+176
2016-02-01Add script to generate the OpenStack defaultsjose.lausuch1-0/+176
JIRA: FUNCTEST-131 It checks the existing Openstack objects in the current deployment (i.e. when the script is executed) and it will create a yaml file to be used afterwards by clean_openstack. This way, a user can generate the defaults when needed if there are things that are not meant to be deleted without fear of using clean_openstack. Change-Id: Iacf204bdd14f591df21b3f243d27199ead2404b0 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-02-01Enable all rally outputs in verbose modeJuha Kosonen1-19/+28
In verbose mode the complete output of rally tests is shown. Change-Id: I315c89b270312b13b3630b97cc24e5f529952645 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-02-01Adding structure to pull content into central docs.ChristopherPrice5-349/+352
Including minor fixes and corrections. Change-Id: I7c4bd9ca4f5fb35aeb2350096520c66b11aecbe8 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2016-02-01Merge "use scenario instead of git info in version field of the test results"Morgan Richomme1-3/+3
2016-02-01Merge "Add testcases results to DB"Morgan Richomme1-6/+29