summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-12-23Merge "dovetail tool: flake8 support in tox"hongbo tian2-2/+3
2016-12-23Merge "dovetail tool: use command 'debug' to control both 'debug' and ↵hongbo tian2-10/+5
'CON_DEBUG'"
2016-12-22[dovetail tool]check and get results for each cmdLeo Wang10-53/+179
JIRA: DOVETAIL-166 Check the results of each cmds executed in test case 1. the results of pre_condition, post_condition, cmds need to be checked, so it can get a quick fail, dont need to go through the next step 2. it's more accurate to show where error occurred as early as possible 3. get results from shell scripts Change-Id: I5c1e59839c55b92de0e83e7e1eb552aa364b3f80 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-21dovetail tool: flake8 support in toxMatthewLi2-2/+3
JIRA: DOVETAIL-168 Change-Id: I1659e906c8ec810b6e21cc13da4e54a06d5ab80b Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-21dovetail tool: fully tox supportedMatthewLi7-502/+15
JIRA: DOVETAIL-165 1, fully tox supported 2, previous easy setup abandoned 3, CI verify job changed accordingly 4, unittest bug fix this should merge after https://gerrit.opnfv.org/gerrit/#/c/26297/ results see https://etherpad.opnfv.org/p/dovetail_report Change-Id: I52ce3999fcde7e817854e4a39f4111eef081bc78 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-21Merge "updated the process flow of function exec_cmd"hongbo tian2-36/+35
2016-12-21dovetail tool: use command 'debug' to control both 'debug' and 'CON_DEBUG'xudan2-10/+5
JIRA: DOVETAIL-167 Change-Id: Ieb35f6aa2a6868af7d6dad5727bb3b345709275a Signed-off-by: xudan <xudan16@huawei.com>
2016-12-20Merge "bugfix for duration missed"hongbo tian2-1/+5
2016-12-20dovetail tool: .cache added in gitignoreMatthewLi1-0/+1
please see https://gerrit.opnfv.org/gerrit/#/c/26299/ patch set 3 Change-Id: I32dd107e0e8704482e1cdb659a02b774cb7d8482 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-20bugfix for duration missedMatthewLi2-1/+5
JIRA: DOVETAIL-162 Change-Id: Idc78790e49ab3e3552d45b902cfdf8cc37fd2847 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-19Merge "dovetail tool: bugfix about setup dovetail"hongbo tian5-9/+13
2016-12-19Merge "dovetail tool: move conf/dovetail_config.py into utils/"hongbo tian8-10/+11
2016-12-18[dovetail tool] fetch openstack rc files without installer infoLeo Wang5-2/+16
JIRA: DOVETAIL-157 dovetail tool must not depend on any installers or any SUT, so openstack rc files need to be provided to eliminate this dependency. 1. input parameters "SUT_IP"/"SUT_TYPE" must be optional, may be finally will be removed 2. new parameter "creds" to specify the file used to get access to openstack of SUT Change-Id: I877efb2a6abc198c32ed6d52b9418a35597d5867 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-16updated the process flow of function exec_cmdRyan.RCS2-36/+35
separate the log expressions to other functions removed statements that not necessary output error detail info in exception Change-Id: I721611d61dee83eb5f40ee954d433073114e231a JIRA: DOVETAIL-161 Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-12-16Merge "dovetail tool: document for dovetail CLI"hongbo tian2-0/+181
2016-12-16dovetail tool: show progress during executing test casesxudan1-0/+19
1. the utils exec_cmd() will take a long time for some cmds such as executing test cases and pull images. 2. if the time is longer than 3 seconds, progress bar will be shown on the screen. JIRA: DOVETAIL-159 Change-Id: I4ae04d6e884853d843baf8f547394247f4165377 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-15dovetail tool: bugfix about setup dovetailxudan5-9/+13
1. change the entry_points of setup.cfg into dovetail.run:main 2. after setup the command 'dovetail -d true --testsuite debug' can just be successfully executed under folder dovetail/dovetail. That is mainly because of the load functions of testcase.py using relative paths. 3. using absolute path instead of relative path can support the command successfully executed under any path. JIRA: DOVETAIL-154 Change-Id: I4a2ad39a1a60e7e63efc55515781d27b823aa894 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-15Merge "add example test area"hongbo tian2-8/+1
2016-12-15Merge "dovetail tool: fix docker version of client mismatches with server in ↵hongbo tian1-7/+1
Docker image"
2016-12-14add example test areaLeo Wang2-8/+1
1. use this config to support example test case Change-Id: I3fda73c408ed4b2bfb75aac52e0292fa4de9161b Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-15dovetail tool: move conf/dovetail_config.py into utils/xudan8-10/+11
1. move conf/dovetail_config.py into utils/ 2. change the open file path in dovetail_config.py 3. do some modification about all 'from conf.dovetail_config import ***' JIRA: DOVETAIL-158 Change-Id: I7670e6de993899e4e2a604cbc501dc3339896ef1 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-14Merge "[dovetail tool] support shell scripts for testcase validation"hongbo tian4-8/+16
2016-12-14[dovetail tool] support shell scripts for testcase validationLeo Wang8-75/+170
JIRA: DOVETAIL-46 1. for now a testcase has two kinds of validation types(functest, yardstick), and it is not enough to check the complete funcionality 2. add new validation type(shell) for extra validation of the test case to make result more accurate and more convincing. Change-Id: I5c049a71f11cca71a7914f8af704c1983aba3dca Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-14Merge "dovetail tool: improve cli to update non-envs automatically"hongbo tian4-67/+154
2016-12-14[dovetail tool] support shell scripts for testcase validationLeo Wang1-4/+5
JIRA: DOVETAIL-46 1. for now a testcase has two kinds of validation types(functest, yardstick), and it is not enough to check the complete funcionality 2. add new validation type(shell) for extra validation of the test case to make result more accurate and more convincing. Change-Id: I60c1b54335b94e0cb150232432adb958b8f5a143 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-13dovetail tool: fix docker version of client mismatches with server in Docker ↵MatthewLi1-7/+1
image JIRA: DOVETAIL-160 errors see https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-arm-pod3-debug-master/4/console Change-Id: I812453fa7ac26cfdf66609c1ca4ac96e29ca7e02 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-14dovetail tool: improve cli to update non-envs automaticallyxudan4-67/+154
1. modify cmd_config.yml a. change 'env' and 'non-env' into 'config' and 'control' b. add subsection 'path' for each block in 'config' c. delete 'DEPLOY_SCENARIO' and 'DEPLOY_TYPE' d. use 'func_tag' and 'yard_tag' to control container's tag 2. if cmd in config a. if its path is envs, it will be used to update envs in dovetail_config b. if its path is non_envs, it will be used to update other value in the dict JIRA: DOVETAIL-70 Change-Id: I1cf9bfcd1a19294a390a85bce6e458ce50672b7f Signed-off-by: xudan <xudan16@huawei.com>
2016-12-14Merge "bugfix of document error"hongbo tian4-16/+11
2016-12-13bugfix of document errorMatthewLi4-16/+11
JIRA: DOVETAIL-155 errors can refer to https://build.opnfv.org/ci/job/opnfv-docs-verify-master/3727/console Change-Id: I19e96239c8183bafca731477723615caff71388b Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-13[dovetail tool] support shell scripts for testcase validationLeo Wang47-150/+380
JIRA: DOVETAIL-46 1. for now a testcase has two kinds of validation types(functest, yardstick), and it is not enough to check the complete funcionality 2. add new validation type(shell) for extra validation of the test case to make result more accurate and more convincing. Change-Id: I45dca6b8dbd888757da163189d261f6e4dba5034 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-13bugfix for flake8 formatMatthewLi1-2/+2
error log see https://build.opnfv.org/ci/view/dovetail/job/dovetail-merge-master/58/console Change-Id: I7f5a7f290d82e79249561322259aa5e72186e126 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-13Merge "[WIP] Migrate to tox based environment"hongbo tian17-57/+83
2016-12-13[WIP] Migrate to tox based environmentLeif Madsen17-57/+83
Migrate the custom setup.py to a more formal setup environment using tox, in the same way that OpenStack configures their projects. Adds metadata to tox.ini from the setup.py file, and breaks out the dependencies from setup.py into requirements.txt and test-requirements.txt. Executes flake8 testing for pep8 coverage. Defaults to using Python 2 for the environment. Change-Id: Ieaea7d9f3dc227febd8fb1dc9142d478ba197a92 Signed-off-by: Leif Madsen <lmadsen@redhat.com> Signed-off-by: zshi <zshi@redhat.com>
2016-12-13Merge "Add more document and fix dockerfile for CentOS"hongbo tian2-3/+12
2016-12-13Merge "dovetail tool: add debug option to control the log level showing in ↵hongbo tian3-16/+23
screen"
2016-12-09[dovetail tool]: move config info from .py to config .yml fileMatthewLi9-39/+48
JIRA: DOVETAIL-145 Change-Id: Ia9b3c678f1a491e5daf2d280f05904ead3b0a296 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-09Add more document and fix dockerfile for CentOSTomofumi Hayashi2-3/+12
Add how to build container from dockerfile and add missing config for CentOS dockerfile. This fix is verified that functest/yeardstick are called successfully under debug/proposed_tests testsuite. Change-Id: Icb31331ecd78b8fccd69ac960c24340b605e54bf Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-12-082 config files description documentsMatthewLi1-0/+16
JIRA: DOVETAIL-50 Change-Id: I65c618ce3de78677b9e66a1c2d7f0af705e80cfb Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-07Merge "[RFC]Add dockerfile to support dovetail in CentOS"hongbo tian2-0/+22
2016-12-07Merge "Copy the jumphost ssh key into the container"hongbo tian1-2/+1
2016-12-07dovetail tool: document for dovetail CLIxudan2-0/+181
1. document for developers about how to add or delete commands by modifying cmd_config.yml file. 2. document for users about how to run dovetail tool with CLI JIRA: DOVETAIL-25 Change-Id: Iecf9d7a230e694bdda5634a87f7e5ddf7b7a57fd Signed-off-by: xudan <xudan16@huawei.com>
2016-12-06Copy the jumphost ssh key into the containerDan Radez1-2/+1
When functest runs against Apex it needs to ssh from the container to the undercloud to get the keystonerc file so it can authenticate to the overcloud. Change-Id: Iea3273d4d1611733f167ffab0b2a75330c413edc Signed-off-by: Dan Radez <dradez@redhat.com>
2016-12-06[RFC]Add dockerfile to support dovetail in CentOSTomofumi Hayashi2-0/+22
JIRA: DOVETAIL-151 This diff introduces an optional dovetail dockerfile based on CentOS. It provides users to have an alternative way to execute dovetail. It should be just a optional, so we should keep docker/Dockerfile as official one with dockerhub's image and we do not build docker images in CI phase for now. Change-Id: Ia694bcd49f65ff2bc175c1da3b42fbfa19b022a1 Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com> Signed-off-by: Zenghui Shi <zshi@redhat.com>
2016-12-05dovetail tool: add unit test into script unittest.shxudan2-2/+25
1. Since JIRA: DOVETAIL-55 has been merged, unit tests can't pass without load_config_files(). 2. Fix the bug by adding load_config_files(). 3. Add run_tests() into script unittest.sh to include all unit tests in tests/unit. JIRA: DOVETAIL-149 Change-Id: I7bdb0732fefde3a3f3b82441b4cc7e46ece66a1e Signed-off-by: xudan <xudan16@huawei.com>
2016-12-05dovetail tool: add debug option to control the log level showing in screenxudan3-16/+23
1. add debug option in cmd_config.yml for controling log showing in screen. 2. rename existent DEBUG as CON_DEBUG because it is used for functest/yardstick container to control the log level. 3. fix the bug in function update_config_envs(). If one key is not in system's envs, os.environ[key] get an error with ErrorKey. JIRA: DOVETAIL-148 Change-Id: If3d75109f51e2e91743b8f1134a76da42e57383a Signed-off-by: xudan <xudan16@huawei.com>
2016-12-02Merge "dovetail tool: reorganize statements in class DovetailConfig"hongbo tian2-10/+16
2016-12-02Merge "dovetail tool: add brackets to print message for consistency"hongbo tian1-1/+1
2016-12-02Merge "dovetail tool: fix unittest bugs"hongbo tian1-1/+2
2016-12-02Merge "[WIP] dovetail report improvement"hongbo tian5-47/+114
2016-12-02[WIP] dovetail report improvementMatthewLi5-47/+114
JIRA: DOVETAIL-49 1)details please refer to https://wiki.opnfv.org/display/dovetail/Dovetail+Reports 2)results please refer to one example https://etherpad.opnfv.org/p/dovetail_report Change-Id: I63a1ba3b6aa1ffe5fa043a11cd3777dd0e8d52d9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>