summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-11-29dovetail tool: reorganize statements in class DovetailConfigxudan2-10/+16
1. move some statements in class DovetailConfig into function load_config_files() 2. call load_config_files() in run.py 3. this can only work correctly after moving clean_results_dir() into run.py, see JIRA:DOVETAIL-80 and gerrit https://gerrit.opnfv.org/gerrit/#/c/24929/ JIRA: DOVETAIL-55 Change-Id: I217c1c21dc6ba8849da7c00564f62d3c22cdc391 Signed-off-by: xudan <xudan16@huawei.com>
2016-11-29Merge "dovetail tool: change CI_DEBUG to DEBUG"hongbo tian3-5/+7
2016-11-29dovetail tool: package all logger initializationxudan5-57/+122
1. For container.py, parser.py, report.py and testcase.py, they use functions in classes to create loggers. So each class will have its own logger. 2. run.py will create all the loggers by create_logs() function before the use of them. So logs will not be initialized until the call of create_logs(). 3. Move logger in run.py into function main(). JIRA: DOVETAIL-56 Change-Id: I53de090df270cc7a34762ff99cbc9115cfb09465 Signed-off-by: xudan <xudan16@huawei.com>
2016-11-29Merge "dovetail tool: testarea argument added"hongbo tian9-55/+88
2016-11-28Merge "Backend rest api mechanism"hongbo tian18-0/+1665
2016-11-28dovetail tool: change CI_DEBUG to DEBUGzshi3-5/+7
JIRA: DOVETAIL-42 1) change 'CI_DEBUG' to 'DEBUG' in cmd_config.yml and dovetail_logger.py 2) assign 'DEBUG' env value to 'CI_DEBUG' when updating functest and yardstick parameter 'envs' Change-Id: I6d6130e394fddf11d83be619f2c9684bf8c859f9 Signed-off-by: zshi <zshi@redhat.com>
2016-11-26dovetail tool: testarea argument addedMatthewLi9-55/+88
JIRA: DOVETAIL-71 1) argument testarea is added 2) terminology "scenario" change to "testsuite" 3) related documents amended 4) all word "certification" changed to "compliance" Change-Id: I038a9e04bf83cfdac20f0c59adb1841bf5470584 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-25Merge "dovetail tool: reorganize dovetail_config.py and modify related files"hongbo tian7-87/+86
2016-11-24[Dovetail Tool] Prepare env fail due to dependency on pyyamlLeo Wang1-4/+2
JIRA:DOVETAIL-92 root cause: 1. import dovetail_logger while it depends on dovetail_config 2. dovetail_config import yaml 3. yaml is not installed yet action: 1. remove dovetail_logger Change-Id: I51f5e8bab2451639a4a9ebf1978fe8a292df1704 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-20Backend rest api mechanismLeo Wang18-0/+1665
JIRA:DOVETAIL-63 provide rest api as the dashboard backend 1. using gunicorn as rest api server 2. using flask as rest api framework 3. using sqlalchemy as mysql database driver 4. implement basic report CRUD operations 5. implement basic session management in database operations Change-Id: Ifbd251462396c2cb414b1ae9150cfc1e2e2d00c0 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-17dovetail tool: upstream functest env preparation and CLI adaptionxudan1-2/+2
1. Functest has changed it's directory structure, so cmds in functest_config.yml cannot run successfully. 2. Use functest CLI to prepare and run test cases instead of running prepare_env.py or run_tests.py. JIRA: DOVETAIL-40 Change-Id: I7907dd70fd671efbed5f4132c0d76d6eb90b63eb Signed-off-by: xudan <xudan16@huawei.com>
2016-11-17dovetail tool: reorganize dovetail_config.py and modify related filesxudan7-87/+86
1. move all sentencs and functions into class DovetailConfig 2. delete dict container_config for it has been replaced by dovetail_config 2. modify files that import dovetail_config, including container.py, parser.py, report.py, run.py, dovetail_logger.py and testcase.py JIRA: DOVETAIL-55 Change-Id: Ib5ca3cadd751075c879f39e8cb2eb2e0adcef6aa Signed-off-by: xudan <xudan16@huawei.com>
2016-11-16Merge "Fix option handling in case of no '--tag' option."hongbo tian1-2/+2
2016-11-16Merge "dovetail tool: cleanup the result directory before running"hongbo tian1-2/+2
2016-11-16dovetail tool: cleanup the result directory before runningxudan1-2/+2
1. Jenkins will fail with error rm: cannot remove '/home/opnfv/dovetail/results': Device or resource busy 2. The reason is that Jenkins will mount this directory before running 3. The effective solution is removing all contents in this directory rather than removing this mounted directory JIRA: DOVETAIL-38 Change-Id: Ic32ea19341ad2048322ec11a4abc48e13019a7bb Signed-off-by: xudan <xudan16@huawei.com>
2016-11-15dovetail tool: replace the hard-coded "Tescase" and modify some classmethodLinghui Zeng4-34/+36
JIRA: DOVETAIL-45 1. In the testcase.py file, we replace the hard-coded "Tesecase" with "cls" or "self" based on the specific contexts. 2. For all the four committed files, we modify some classmethod into staticmethod because each method is basically just a function, called syntactically like a method, but without access to the object and its' internals (attributes and other methods). Change-Id: Ieb452f476a2d33ae9aca4c904ae7d2c92b68689e Signed-off-by: Linghui Zeng <linghui.zeng@huawei.com>
2016-11-15Fix option handling in case of no '--tag' option.Tomofumi Hayashi1-2/+2
In case of default, 'None' is in kwargs['tag'] so need to check it in option handling. The code is to fix it. Change-Id: Iaadf7e6f0f064dda819970346a810a6a8b47c74c Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-15Merge "dovetail tool: reorganize prepare_env.py"hongbo tian1-7/+15
2016-11-15Merge "generate report data for reuse"hongbo tian1-24/+48
2016-11-15Merge "Add "docker tag" option for each testcase containers."hongbo tian2-0/+27
2016-11-15generate report data for reuseLeo Wang1-24/+48
JIRA: DOVETAIL-22 1. report text is string, can not be reused by other module, 2. generate report data first, then this data can be uploaded to database or be translated to report text Change-Id: Ieecd87c827537c825c87a0db4ff170ae490d75ae Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-14dovetail tool: reorganize prepare_env.pyxudan1-7/+15
1. add main function and move statements into it JIRA: DOVETAIL-57 Change-Id: I69158fa64ffc10668fc39835de434f0b44b8754a Signed-off-by: xudan <xudan16@huawei.com>
2016-11-10Add "docker tag" option for each testcase containers.Tomofumi Hayashi2-0/+27
JIRA: DOVETAIL-69 This commit is to add new option to specify docker tags for each test containers, such as '--TAG "functest:stable"'. Change-Id: Ica11e16abfb21649a3eea9c7d7d5cd31502d2e21 Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-10dovetail tool: 2 config files, compliance_set and proposed_testsMatthewLi40-17/+341
JIRA: DOVETAIL-50 1)'proposed_tests.yml' is added, which runs as the total tests run. The 'compliance_set.yml' will run as dovetail certification tests; 2)ipv6 test cases added accroding to 'docs/testsuites/ipv6/ipv6_all_testcases', tc026 missed temporarily,yardstick ipv6tc026 only supports 2 installers by now according to https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Cases 3)vimops001-006 added for VIM images operation test cases 4)nfvi001-002 added for vping ssh/userdata in fucntest 5)more test cases can be added in future in proposed_tests.yml, besides, the test cases can be adjusted in future in proposed_tests.yml Change-Id: I8a8634583549a802f6f64fbea651e7be4efa361c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-09Merge "dovetail tool: ensure sub_testcase_list and testcase are not None"hongbo tian2-9/+22
2016-11-09Merge "dovetail tool: os name bugfix"hongbo tian1-3/+4
2016-11-09Merge "dovetail tool: cleanup result directory before running"hongbo tian1-3/+16
2016-11-07dovetail tool: os name bugfixMatthewLi1-3/+4
JIRA: DOVETAIL-54 bug: in some envs, return value platform_os is Ubuntu rather than ubuntu. Change-Id: I6a2aa964d00eff9f336f8204071a05a6b5f11134 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-08dovetail tool: ensure sub_testcase_list and testcase are not Nonezshi2-9/+22
JIRA: DOVETAIL-52 1) save return value of testcase.sub_testcase() in sub_testcase_list for multiple calls later 2) ensure sub_testcase_list is not called with None value 3) ensure testcase is not called with None value 4) identify None testcase with 'Undefined' in dovetail_report.txt Change-Id: Ifcf0c0846dc788575310f29932a4757752f1e3a3 Signed-off-by: zshi <zshi@redhat.com>
2016-11-03Merge "dovetail tool: Add cli mechanism for changing envs at run-time"hongbo tian5-13/+123
2016-11-03Merge "dovetail tool: rename report_file_path variable"hongbo tian1-4/+4
2016-11-03Merge "dovetail tool: Cleanup functest_conf.yml"hongbo tian1-4/+0
2016-11-03Merge "Add more distro support when preparing environment"hongbo tian1-1/+39
2016-11-03Merge "dovetail tool: ignore file amended"hongbo tian1-9/+8
2016-11-03dovetail tool: cleanup result directory before runningxudan1-3/+16
JIRA: DOVETAIL-38 1. Do cleaning at the beginning of each run. 2. Since some files and folders have the 'root root' privilege, no command except cmd 'sudo rm -rf <results_dir>' can work. Change-Id: If8cd5c8c9c35434af2a5fa38575c06f83f0afc4d Signed-off-by: xudan <xudan16@huawei.com>
2016-11-02dovetail tool: Add cli mechanism for changing envs at run-timexudan5-13/+123
JIRA: DOVETAIL-23 1. Add file cmd_config.yml for defining arguments and options. 2. Using python click module to add and parse cmds in cmd_config.yml 3. Using envs options to update envs in yardstick/functest config file Change-Id: Ie513c0f0a1ed76f29408419a4bcbbcf21334bb3f Signed-off-by: xudan <xudan16@huawei.com>
2016-10-30dovetail tool: ignore file amendedMatthewLi1-9/+8
JIRA: DOVETAIL-37 1)as much as possible to stay the same 2)*.mo deleted since no C used in this repo 3)unittest-log.txt added, it can be produced by using unittest.sh -f 4)document related added, including *.sw?, CI related /docs_build/ /docs_ouput/, results dir 5)other personal habit will not included in this Change-Id: I1e3c95d74f99c212838a987f1705af3902f6f58d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-29dovetail tool: Add unit tests for 'parser' modulemathsyouth4-0/+67
JIRA: DOVETAIL-45 1. Add two '__init__.py' files for packages 2. Add two test functions in 'test_parser.py' to verify the function of the method 'parser_cmd' 3. 'test_testcase.yaml' is used in 'test_parser.py' Change-Id: Ic3e2e6e67bcac3276fe47ec5584c0d9632b5286a Signed-off-by: mathsyouth <linghui.zeng@huawei.com>
2016-10-28dovetail tool: Cleanup functest_conf.ymlzshi1-4/+0
JIRA: DOVETAIL-43 JIRA: DOVETAIL-44 1) remove result_dir 2) remove pre_cmd, exec_cmd, post_cmd Change-Id: Iea8173026b1f467011a40c6954581f25cd5e1912 Signed-off-by: zshi <zshi@redhat.com>
2016-10-28Merge "dovetail tool: developer userguide document"hongbo tian8-225/+246
2016-10-26Add more distro support when preparing environmentzshi1-1/+39
Change-Id: I3ff4419e38872bc28e59699a11080777ea596dc3 Signed-off-by: zshi <zshi@redhat.com>
2016-10-26dovetail tool: developer userguide documentMatthewLi8-225/+246
JIRA: DOVETAIL-28 1) documents are reorganized, all dovetail tool related documents are moved to /docs/dovetailtool 2) some sections are rewritten to make it more clear Change-Id: Ib0c23b8c1771eb6de7d6cc264c101e8e26ed3d1f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-21dovetail tool: rename report_file_path variablezshi1-4/+4
the value assigned to report_file_path is a file name, not a path. Change-Id: I338ae2bb5e836d26c711bfa9144f16d06c08deb7 Signed-off-by: zshi <zshi@redhat.com>
2016-10-21Simplify getting pre_condition cmdszshi1-2/+1
Change-Id: I8ca04cbdc4236e9ff754bad816bb7282673b5b55 Signed-off-by: zshi <zshi@redhat.com>
2016-10-20dovetail tool : add @classmethod to post_condition_clszshi1-0/+1
JIRA: DOVETAIL-39 Turn post_condition_cls to classmethod function which will be consistent with pre_condition_cls Change-Id: If8457035493f2ed93bdae5be5f22a57255b2c474 Signed-off-by: zshi <zshi@redhat.com>
2016-10-19update the committer email addresshongbotian1-1/+1
JIRA: DOVETAIL-36 Update the email addrees for Wenjing Chu Change-Id: I61e378bba703806cef0cb829b855b822671ddbbe Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2016-10-17Get envs from environment variables to test multi-SUTzshi1-0/+7
JIRA: DOVETAIL-32 currently envs variable is hard-coded to specific values which are not suitable for multi-SUT platform, fix it by reading it from environment variable. this commit is for apex installer testing purpose. Change-Id: I2163b96208d42a91f2795de6a55b276b803dc5e8 Signed-off-by: zshi <zshi@redhat.com>
2016-10-17Merge "[dovetail_tool] Fix the python style scanned by flake8"hongbo tian9-103/+142
2016-10-14[dovetail_tool] Fix the python style scanned by flake8xudan9-103/+142
JIRA: DOVETAIL-34 Change-Id: Ib9a6dd254f1d77b0cbbfa66e8e1e44df1ce14a4b Signed-off-by: xudan <xudan16@huawei.com>
2016-10-14Merge "Add documentation for dovetail tool"hongbo tian6-2/+338