summaryrefslogtreecommitdiffstats
path: root/dovetail
AgeCommit message (Collapse)AuthorFilesLines
2017-03-29dovetail tool: offline supportMatthewLi4-2/+26
JIRA: DOVETAIL-164 usage: dovetail run --testsuite <testsuite> --offline 1,if --offline given, can run offline by using local docker images (if there is no images, will get an error in log, images can be pulled from dockerhub or downloaded from artifacts.opnfv.org ) 2,if --offline not given, will run online, which means pull docker image from dockerhub Change-Id: I87ab35c82e59fb13a7a88c38d233e89285efc4d3 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-25dovetail tool: Add an option cmd for pushing results into DBxudan7-37/+92
JIRA: DOVETAIL-373 1. add an option --report/-r to choose the report type. 2. "-r file" will store results with files. 3. "-r http://192.168.135.2:8000/api/v1" will push results into DB. The DB url can replaced by user's local DB or official DB. 4. Default report type is defined as "report_dest" in dovetail_config.yml. 5. Yardstick can't push results of one testcase into DB now, so both "-r file" and "-r http://..." will be regarded as "file". Change-Id: Ieaa017ab59c5b15235bf306ef57cdc56beb22af8 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-22Merge "dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵hongbo tian2-9/+12
yardstick.log"
2017-03-21dovetail tool: remove installer and CI related variablesxudan8-99/+56
JIRA: DOVETAIL-371 1. remove all the envs in functest_config.yml and yardstick_config.yml 2. remove all relative cmds in cmd_config.yml 3. remove all the envs when running a new functest/yardstick container 4. add some variables just for functest pushing results to db 5. get the external network name for yardstick 6. make --debug/-d just control the log level shown on the screen 7. set requests=2.10.0 since python-openstackclient needs 'requests!=2.12.2,!=2.13.0,>=2.10.0' Change-Id: I9f941e09d067fc95a14c3c9be1374f41df4a9a16 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-21dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵xudan2-9/+12
yardstick.log 1. For Fuel, yardstick prepare_env.sh will fail when pwd != /home/opnfv/repos/yardstick 2. Modify yardstick_config.yml in Dovetail to change pwd to that path. 3. Use log file /tmp/yardstick/yardstick.log created by cmd "yardstick task start" rather than redirecting the console output to yardstick.log. JIRA: DOVETAIL-363 Change-Id: Ie0475cfabc66e342be868f0924a5fccd6fa74b58 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-20dovetail tool: change name of credentials from creds to openrcxudan6-14/+17
1. change file name from openstack.creds to openrc.sh 2. change the cmd --creds to --openrc/-o 3. now the path of --openrc can be relative path no restrict to abspath 4. remove the useless "work_dir" in dovetail_config.yml JIRA: DOVETAIL-369 JIRA: DOVETAIL-367 Change-Id: I2592438eef060f84132ff7fa226aea93ea947362 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-24Merge "dovetail tool: bugfix for dovetail report and docker build"hongbo tian1-2/+2
2017-02-21dovetail tool: Bugfix about the creds path in yardstick conf filexudan1-1/+1
JIRA: DOVETAIL-355 Change-Id: I04a74caa080e0fd2ea11648f8085947ef8d556b1 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-20dovetail tool: bugfix for dovetail report and docker buildMatthewLi1-2/+2
JIRA: DOVETAIL-353 JIRA: DOVETAIL-354 related patch: https://gerrit.opnfv.org/gerrit/#/c/29049/ Change-Id: Ic871abbda62dead7cf5e23e6117c9885d637c7fb Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-18Merge "dovetail tool: skip testcase status added"hongbo tian3-51/+69
2017-02-17dovetail tool: change the way to get the functest result filexudan2-6/+12
Functest has changed it's way to generate the local result file. see Gerrit: https://gerrit.opnfv.org/gerrit/#/c/28513/ Dovetail needs to do some adaptions to fit this change. JIRA: DOVETAIL-350 Change-Id: I681f74832f582f26c8874f7d2726c8588f430612 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-17dovetail tool: skip testcase status addedMatthewLi3-51/+69
JIRA: DOVETAIL-344 1) testcase status, True/False --> PASS/SKIP/FAIL, so skipped testcase in tempest can be figured out details can be seen in https://etherpad.opnfv.org/p/dovetail_report 2) some variable name changed more readable, such as passed-->testcase_passed failed--> prepare_failed 3) "dovetail report" minor amend according to 1) Change-Id: Ibe8e50693fc474d78e7d0fb89257f34703248579 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-08Merge "dovetail tool: use python new-style classes which inherit from object"hongbo tian7-16/+16
2017-02-07Merge "dovetail tool: report.py bugfix and tempest skipped testcase added"hongbo tian2-11/+8
2017-02-07dovetail tool: report.py bugfix and tempest skipped testcase addedMatthewLi2-11/+8
JIRA: DOVETAIL-343 1, bugfix https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-debug-master/lastSuccessfulBuild/artifact/results/dovetail_report.txt test result error 2, skipped testcase in tempest added 3, two testcase in tempest full testsuite added in debug.yml to debug Change-Id: I6bf371d3384e3755d6a41d951cfc9d1a55e00ab3 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-03dovetail tool: bugfix: cannot load pre/post condition from config filexudan1-10/+20
JIRA: DOVETAIL-342 Change-Id: If98905b6724c0a990d789a7ce914aeecac72d7c4 Signed-off-by: xudan <xudan16@huawei.com>
2017-01-25dovetail tool: functest different testsuite support and yardstick testcase addedMatthewLi8-26/+91
JIRA: DOVETAIL-186 Change-Id: Id0eec6652c9595c660436dec89a309a77b16bc03 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-20dovetail tool: use python new-style classes which inherit from objectxudan7-16/+16
JIRA: DOVETAIL-187 Change-Id: Id6fa50a3a3cec7a18d27ca8feb383b53836a339b Signed-off-by: xudan <xudan16@huawei.com>
2017-01-19dovetail tool: modify function exec_cmd to force it to flush the bufferxudan1-16/+11
1. force to flush the buffer line by line 2. remove the progress bar since it will stay in the screen if using the cli command JIRA: DOVETAIL-173, which will be ugly. JIRA: DOVETAIL-172 Change-Id: I47b823c7e0bce955a50086613a656c83ab7707e3 Signed-off-by: xudan <xudan16@huawei.com>
2017-01-16dovetail tool: format improvementMatthewLi45-4/+45
Change-Id: Ibf0bb781c0f0b6be73526bf45231040e68510f76 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-15dovetail tool: delete unnecessary prepare_env.pyMatthewLi1-65/+0
JIRA: DOVETAIL-181 Change-Id: I6e79467b829b4ae1d815bdb9ead0b930f0338cd2 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-14Merge "dovetail tool: switch logging to proper usage"hongbo tian4-26/+26
2017-01-13dovetail tool: command lineMatthewLi8-4/+173
JIRA: DOVETAIL-173 details please see https://wiki.opnfv.org/display/dovetail/Dovetail+Command+Line Change-Id: Iff04b0df8c4e6310d35a45b9c8ba3c7b3b5e1105 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-11dovetail tool: switch logging to proper usageMatthewLi4-26/+26
JIRA: DOVETAIL-178 Change-Id: Ica814d4ff634c9159e4ecca888b8cc0f6c16e624 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-10Merge "dovetail tool: remove old image when pulling new one successfully"hongbo tian1-10/+54
2017-01-06dovetail tool: remove old image when pulling new one successfullyxudan1-10/+54
1. split function pull_image into four functions, get_image_id, pull_image_only, remove_image and pull_image. 2. after pulling new version of the image, remove the old one with tag <none>. JIRA: DOVETAIL-171 Change-Id: I2d2a9d6a8bc2308d434d0a3c76aa24bf5b39bfd7 Signed-off-by: xudan <xudan16@huawei.com>
2017-01-05release tag supportMatthewLi2-10/+13
JIRA: DOVETAIL-170 Change-Id: Id56e30fdb3fb5b652e2145dd406b71986997f200 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-28Merge "dovetail tool: reorganize function prepare_cmd in testcase.py"hongbo tian2-28/+26
2016-12-26dovetail tool: reorganize function prepare_cmd in testcase.pyxudan2-28/+26
1. move the common statements in prepare_cmd of class FunctestTestcase and Testcase into parse_cmd. JIRA: DOVETAIL-163 Change-Id: I61a0a24b47cfc9e8d49ca9c62fafbac7cce21111 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-26Merge "dovetail tool: bugfix CI job dovetail-merge-master fail"hongbo tian1-3/+4
2016-12-26Merge "dovetail tool: bugfix functest prepare_env fail"hongbo tian1-2/+8
2016-12-23dovetail tool: bugfix CI job dovetail-merge-master failxudan1-3/+4
JIRA: DOVETAIL-156 Change-Id: I3453571568494850049eb7956387ee7e275934af Signed-off-by: xudan <xudan16@huawei.com>
2016-12-23Merge "dovetail tool: use command 'debug' to control both 'debug' and ↵hongbo tian2-10/+5
'CON_DEBUG'"
2016-12-22dovetail tool: bugfix functest prepare_env failxudan1-2/+8
JIRA: DOVETAIL-169 Change-Id: I7ede8713c16b084255f691505a39db122fdbe8ea Signed-off-by: xudan <xudan16@huawei.com>
2016-12-22[dovetail tool]check and get results for each cmdLeo Wang10-53/+179
JIRA: DOVETAIL-166 Check the results of each cmds executed in test case 1. the results of pre_condition, post_condition, cmds need to be checked, so it can get a quick fail, dont need to go through the next step 2. it's more accurate to show where error occurred as early as possible 3. get results from shell scripts Change-Id: I5c1e59839c55b92de0e83e7e1eb552aa364b3f80 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-21dovetail tool: fully tox supportedMatthewLi1-5/+5
JIRA: DOVETAIL-165 1, fully tox supported 2, previous easy setup abandoned 3, CI verify job changed accordingly 4, unittest bug fix this should merge after https://gerrit.opnfv.org/gerrit/#/c/26297/ results see https://etherpad.opnfv.org/p/dovetail_report Change-Id: I52ce3999fcde7e817854e4a39f4111eef081bc78 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-21Merge "updated the process flow of function exec_cmd"hongbo tian2-36/+35
2016-12-21dovetail tool: use command 'debug' to control both 'debug' and 'CON_DEBUG'xudan2-10/+5
JIRA: DOVETAIL-167 Change-Id: Ieb35f6aa2a6868af7d6dad5727bb3b345709275a Signed-off-by: xudan <xudan16@huawei.com>
2016-12-20Merge "bugfix for duration missed"hongbo tian2-1/+5
2016-12-20bugfix for duration missedMatthewLi2-1/+5
JIRA: DOVETAIL-162 Change-Id: Idc78790e49ab3e3552d45b902cfdf8cc37fd2847 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-19Merge "dovetail tool: bugfix about setup dovetail"hongbo tian3-7/+11
2016-12-19Merge "dovetail tool: move conf/dovetail_config.py into utils/"hongbo tian8-10/+11
2016-12-18[dovetail tool] fetch openstack rc files without installer infoLeo Wang5-2/+16
JIRA: DOVETAIL-157 dovetail tool must not depend on any installers or any SUT, so openstack rc files need to be provided to eliminate this dependency. 1. input parameters "SUT_IP"/"SUT_TYPE" must be optional, may be finally will be removed 2. new parameter "creds" to specify the file used to get access to openstack of SUT Change-Id: I877efb2a6abc198c32ed6d52b9418a35597d5867 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-16updated the process flow of function exec_cmdRyan.RCS2-36/+35
separate the log expressions to other functions removed statements that not necessary output error detail info in exception Change-Id: I721611d61dee83eb5f40ee954d433073114e231a JIRA: DOVETAIL-161 Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-12-16dovetail tool: show progress during executing test casesxudan1-0/+19
1. the utils exec_cmd() will take a long time for some cmds such as executing test cases and pull images. 2. if the time is longer than 3 seconds, progress bar will be shown on the screen. JIRA: DOVETAIL-159 Change-Id: I4ae04d6e884853d843baf8f547394247f4165377 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-15dovetail tool: bugfix about setup dovetailxudan3-7/+11
1. change the entry_points of setup.cfg into dovetail.run:main 2. after setup the command 'dovetail -d true --testsuite debug' can just be successfully executed under folder dovetail/dovetail. That is mainly because of the load functions of testcase.py using relative paths. 3. using absolute path instead of relative path can support the command successfully executed under any path. JIRA: DOVETAIL-154 Change-Id: I4a2ad39a1a60e7e63efc55515781d27b823aa894 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-14add example test areaLeo Wang2-8/+1
1. use this config to support example test case Change-Id: I3fda73c408ed4b2bfb75aac52e0292fa4de9161b Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-15dovetail tool: move conf/dovetail_config.py into utils/xudan8-10/+11
1. move conf/dovetail_config.py into utils/ 2. change the open file path in dovetail_config.py 3. do some modification about all 'from conf.dovetail_config import ***' JIRA: DOVETAIL-158 Change-Id: I7670e6de993899e4e2a604cbc501dc3339896ef1 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-14[dovetail tool] support shell scripts for testcase validationLeo Wang8-75/+170
JIRA: DOVETAIL-46 1. for now a testcase has two kinds of validation types(functest, yardstick), and it is not enough to check the complete funcionality 2. add new validation type(shell) for extra validation of the test case to make result more accurate and more convincing. Change-Id: I5c049a71f11cca71a7914f8af704c1983aba3dca Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-14[dovetail tool] support shell scripts for testcase validationLeo Wang1-4/+5
JIRA: DOVETAIL-46 1. for now a testcase has two kinds of validation types(functest, yardstick), and it is not enough to check the complete funcionality 2. add new validation type(shell) for extra validation of the test case to make result more accurate and more convincing. Change-Id: I60c1b54335b94e0cb150232432adb958b8f5a143 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>