summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-04-13Merge "dovetail tool: bugfix: test cases are erroneously judged"hongbo tian6-75/+97
2017-04-12dovetail tool: bugfix: test cases are erroneously judgedxudan6-75/+97
JIRA: DOVETAIL-375 JIRA: DOVETAIL-390 1. defcore test cases are erroneously judged because of: a) defcore results json data lack some keys b) some sub-testcases' names are the same as the prefix of another sub-testcases. 2. this patch removes the extra keys and judge sub-testcases accurately. 3. remove "store_type" in functest_config.yml and yardstick_config.yml. 4. change some log levels from info to debug. Change-Id: I5f126e70309409cac66ef9a0909f1573d325098b Signed-off-by: xudan <xudan16@huawei.com>
2017-04-12Merge "refstack: add manually method to let user can set its tempest.conf ↵hongbo tian5-2/+38
and defcore.txt"
2017-04-10refstack: add manually method to let user can set its tempest.conf and ↵MatthewLi5-2/+38
defcore.txt JIRA: DOVETAIL-394 for refstack, userguide is listed in https://gerrit.opnfv.org/gerrit/#/c/33049/ in CI, use the automate way to generate tempest.conf to let refstack run against SUT, i.e., defcore.tc001.yml will provide a way to let user can let refstack run against SUT manually, i.e. defcore.tc002.yml since the tempest.conf autometely generated may not satisfied with SUT, users can adjust its tempest.conf to let the defcore testcases pass. Change-Id: I5ed212c9c6d864d352d1c497ea039cc553461158 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-10dovetail tool: show progress during executing test casesxudan1-1/+6
JIRA: DOVETAIL-159 1. It takes long time to execute test cases that most of users think it hangs there, so a progress is needed to show the test is running. 2. add dynamic progress during execution 3. it' s a fake progress only showing the test is alive, not to show the percentage of completion. Change-Id: I0294659f79e8e09d1bcdd36d8f391d933e35b635 Signed-off-by: xudan <xudan16@huawei.com>
2017-04-05Merge "fix yardstick openrc location"hongbo tian1-1/+1
2017-04-05Merge "bugfix of pbr after updating"hongbo tian1-0/+8
2017-04-01fix yardstick openrc locationMatthewLi1-1/+1
since yardstick changes its openrc location see https://gerrit.opnfv.org/gerrit/#/c/32861/ Change-Id: Ib85910fe5521fb398c47e389e2baf127342b1c0b Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-01Merge "refstack result parse"hongbo tian8-48/+52
2017-04-01refstack result parseMatthewLi8-48/+52
JIRA: DOVETAIL-375 1, together with other testsuite from functest, such as tempest etc. this should merge after https://gerrit.opnfv.org/gerrit/#/c/31313/ 2, delete some unnecessary definition 3, bugfix of docker cp inside container, see https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-debug-master/361/console 4, disable tempest testcaes since changed to refstack_defcore Change-Id: I67503e348af4a3f697f1b4106bfe81c05add8aa0 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-01Merge "dovetail tool: check push_to_db success or fail"hongbo tian2-9/+38
2017-03-31dovetail tool: change results dir into $DOVETAIL_HOME/resultsxudan2-1/+7
JIRA: DOVETAIL-381 Now DoveTail's results dir is defined in $DOVETAIL_HOME/dovetail/conf/dovetail_config.yml, and its default value is /home/opnfv/dovetail/results. Since customer's jumphost may not have this dir and they don't want to create it, Dovetail needs to change this dir into $DOVETAIL_HOME/results. Change-Id: I616fb2da87bcfaabfd78d8762897e378168f694d Signed-off-by: xudan <xudan16@huawei.com>
2017-03-31dovetail tool: check push_to_db success or failxudan2-9/+38
JIRA: DOVETAIL-380 If Functest fails to push results to db, there is just an error log in functest.log Dovetail needs to know the failure. Dovetail will get the results from db with keys, build_tag and testcase. If it can get the results data, it means push_to_db success. Fix the duration time wrong. Change-Id: If03bdf0ceb2f1a9d422381cdf06e1fd207358bd5 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-30bugfix of pbr after updatingMatthewLi1-0/+8
JIRA: DOVETAIL-388 Change-Id: I3611624c955fa735aabfd00b456bd7f8455080e5 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-30Merge "dovetail tool: change function pull_image"hongbo tian2-21/+31
2017-03-30Merge "dovetail tool: set a unique build_tag for each DoveTail test"hongbo tian3-6/+10
2017-03-30Merge "dovetail tool: support centos 7"hongbo tian1-3/+14
2017-03-30dovetail tool: refstack testcase integrationMatthewLi6-7/+314
JIRA: DOVETAIL-370 Change-Id: I60c9f431358f848e24abcb865c4b2ca8c3b2d843 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-30dovetail tool: support centos 7xudan1-3/+14
JIRA: DOVETAIL-383 The script launch_db.sh can just support ubuntu now. Make it support centos 7. Change-Id: Ic6123ac82cb81bacb2d0c2d394619b8d8d7b3296 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-30dovetail tool: set a unique build_tag for each DoveTail testxudan3-6/+10
JIRA: DOVETAIL-379 1. create a uuid for each test, and set build_tag=daily-master-<uuid> 2. the reason it starts with "daily_master" is that it's the requirement of functest when push data to DB. Change-Id: I9a59d5695a9f0d83bf4330379f1949a2a04f876c Signed-off-by: xudan <xudan16@huawei.com>
2017-03-30dovetail tool: change function pull_imagexudan2-21/+31
JIRA: DOVETAIL-378 1. test_runner checks the result of cmd "pull image". If fail to pull, then break the running. 2. pull_image will return None when there are errors, otherwise return image name. 3. if there is an old image named the same as the new one, the old one's tag will be changed into <none>. In this case, the old image needs to be removed. 4. if there are some containers using this old image, the remove will be skipped rather than logging error. Change-Id: I940cb18911112d5e13f3c14f87ddbdbaced3538a Signed-off-by: xudan <xudan16@huawei.com>
2017-03-29Draft one of the test specification.ChristopherPrice2-0/+367
JIRA: DOVETAIL-352 Needs a lot more work, but the directory tree and layout are according to our needs in order to have this published as a CVP document. Will push patches to restructure the repo according to the new requirements later. Change-Id: I9d4316407c94bc3096d322f6206eccf236d349da Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-03-29dovetail tool: offline supportMatthewLi6-4/+29
JIRA: DOVETAIL-164 usage: dovetail run --testsuite <testsuite> --offline 1,if --offline given, can run offline by using local docker images (if there is no images, will get an error in log, images can be pulled from dockerhub or downloaded from artifacts.opnfv.org ) 2,if --offline not given, will run online, which means pull docker image from dockerhub Change-Id: I87ab35c82e59fb13a7a88c38d233e89285efc4d3 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-25dovetail tool: Add an option cmd for pushing results into DBxudan7-37/+92
JIRA: DOVETAIL-373 1. add an option --report/-r to choose the report type. 2. "-r file" will store results with files. 3. "-r http://192.168.135.2:8000/api/v1" will push results into DB. The DB url can replaced by user's local DB or official DB. 4. Default report type is defined as "report_dest" in dovetail_config.yml. 5. Yardstick can't push results of one testcase into DB now, so both "-r file" and "-r http://..." will be regarded as "file". Change-Id: Ieaa017ab59c5b15235bf306ef57cdc56beb22af8 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-24Launch a local TESTAPI DB instanceLeo Wang3-0/+205
JIRA: DOVETAIL-374 User may want to dry run the test, and does not intend to upload test results to OPNFV DB. So dovetail provide a way to launch a local TESTAPI DB instance, then user can upload test results to this local db, and browse test results locally. Change-Id: I17b6153c9a308bd3cd59a2450c415200496cb855 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2017-03-23bugfix of package errorMatthewLi3-6/+11
JIRA: DOVETAIL-376 Change-Id: I91e0efff01d445e3f74718d730c8ff48c6413b26 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-22Merge "dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵hongbo tian2-9/+12
yardstick.log"
2017-03-21dovetail tool: remove installer and CI related variablesxudan9-101/+60
JIRA: DOVETAIL-371 1. remove all the envs in functest_config.yml and yardstick_config.yml 2. remove all relative cmds in cmd_config.yml 3. remove all the envs when running a new functest/yardstick container 4. add some variables just for functest pushing results to db 5. get the external network name for yardstick 6. make --debug/-d just control the log level shown on the screen 7. set requests=2.10.0 since python-openstackclient needs 'requests!=2.12.2,!=2.13.0,>=2.10.0' Change-Id: I9f941e09d067fc95a14c3c9be1374f41df4a9a16 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-21dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵xudan2-9/+12
yardstick.log 1. For Fuel, yardstick prepare_env.sh will fail when pwd != /home/opnfv/repos/yardstick 2. Modify yardstick_config.yml in Dovetail to change pwd to that path. 3. Use log file /tmp/yardstick/yardstick.log created by cmd "yardstick task start" rather than redirecting the console output to yardstick.log. JIRA: DOVETAIL-363 Change-Id: Ie0475cfabc66e342be868f0924a5fccd6fa74b58 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-20dovetail tool: change name of credentials from creds to openrcxudan6-14/+17
1. change file name from openstack.creds to openrc.sh 2. change the cmd --creds to --openrc/-o 3. now the path of --openrc can be relative path no restrict to abspath 4. remove the useless "work_dir" in dovetail_config.yml JIRA: DOVETAIL-369 JIRA: DOVETAIL-367 Change-Id: I2592438eef060f84132ff7fa226aea93ea947362 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-24Merge "dovetail tool: bugfix for dovetail report and docker build"hongbo tian2-5/+3
2017-02-21dovetail tool: Bugfix about the creds path in yardstick conf filexudan1-1/+1
JIRA: DOVETAIL-355 Change-Id: I04a74caa080e0fd2ea11648f8085947ef8d556b1 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-20dovetail tool: bugfix for dovetail report and docker buildMatthewLi2-5/+3
JIRA: DOVETAIL-353 JIRA: DOVETAIL-354 related patch: https://gerrit.opnfv.org/gerrit/#/c/29049/ Change-Id: Ic871abbda62dead7cf5e23e6117c9885d637c7fb Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-18Merge "dovetail tool: skip testcase status added"hongbo tian3-51/+69
2017-02-17dovetail tool: change the way to get the functest result filexudan2-6/+12
Functest has changed it's way to generate the local result file. see Gerrit: https://gerrit.opnfv.org/gerrit/#/c/28513/ Dovetail needs to do some adaptions to fit this change. JIRA: DOVETAIL-350 Change-Id: I681f74832f582f26c8874f7d2726c8588f430612 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-17dovetail tool: skip testcase status addedMatthewLi3-51/+69
JIRA: DOVETAIL-344 1) testcase status, True/False --> PASS/SKIP/FAIL, so skipped testcase in tempest can be figured out details can be seen in https://etherpad.opnfv.org/p/dovetail_report 2) some variable name changed more readable, such as passed-->testcase_passed failed--> prepare_failed 3) "dovetail report" minor amend according to 1) Change-Id: Ibe8e50693fc474d78e7d0fb89257f34703248579 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-08Merge "dovetail tool: use python new-style classes which inherit from object"hongbo tian7-16/+16
2017-02-07Merge "bugfix of dovetail tool userguide document"hongbo tian1-0/+1
2017-02-07Merge "dovetail tool: report.py bugfix and tempest skipped testcase added"hongbo tian2-11/+8
2017-02-07dovetail tool: report.py bugfix and tempest skipped testcase addedMatthewLi2-11/+8
JIRA: DOVETAIL-343 1, bugfix https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-debug-master/lastSuccessfulBuild/artifact/results/dovetail_report.txt test result error 2, skipped testcase in tempest added 3, two testcase in tempest full testsuite added in debug.yml to debug Change-Id: I6bf371d3384e3755d6a41d951cfc9d1a55e00ab3 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-07bugfix of dovetail tool userguide documentMatthewLi1-0/+1
Change-Id: I33eea93ca0db018a5f79041152516fa48b94ba46 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-03dovetail tool: bugfix: cannot load pre/post condition from config filexudan1-10/+20
JIRA: DOVETAIL-342 Change-Id: If98905b6724c0a990d789a7ce914aeecac72d7c4 Signed-off-by: xudan <xudan16@huawei.com>
2017-01-26Merge "Change to use "pip install -r requirements.txt" to install deps."hongbo tian1-2/+4
2017-01-25dovetail tool: functest different testsuite support and yardstick testcase addedMatthewLi8-26/+91
JIRA: DOVETAIL-186 Change-Id: Id0eec6652c9595c660436dec89a309a77b16bc03 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-24Change to use "pip install -r requirements.txt" to install deps.Tomofumi Hayashi1-2/+4
At the change of DOVETAIL-183, dovetail uses requirements.txt to install python dependency file so this change is following it. Change-Id: I6cb2420274f385224b517950ddfdf1cf0e764350 Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2017-01-23Merge "dovetail tool userguide document"hongbo tian5-156/+192
2017-01-20dovetail tool: use python new-style classes which inherit from objectxudan7-16/+16
JIRA: DOVETAIL-187 Change-Id: Id6fa50a3a3cec7a18d27ca8feb383b53836a339b Signed-off-by: xudan <xudan16@huawei.com>
2017-01-19dovetail tool: modify function exec_cmd to force it to flush the bufferxudan1-16/+11
1. force to flush the buffer line by line 2. remove the progress bar since it will stay in the screen if using the cli command JIRA: DOVETAIL-173, which will be ugly. JIRA: DOVETAIL-172 Change-Id: I47b823c7e0bce955a50086613a656c83ab7707e3 Signed-off-by: xudan <xudan16@huawei.com>
2017-01-19dovetail tool userguide documentMatthewLi5-156/+192
JIRA: DOVETAIL-182 Change-Id: Icbfa347dda3840520484d10b9d539da9c8f1d31c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-17bugfix for delete unnecessary fileMatthewLi2-64/+0
Change-Id: I14b1556eb117d2111ebe85e73b8c33820db39a3e Signed-off-by: MatthewLi <matthew.lijun@huawei.com>