summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-12-02[WIP] dovetail report improvementMatthewLi5-47/+114
JIRA: DOVETAIL-49 1)details please refer to https://wiki.opnfv.org/display/dovetail/Dovetail+Reports 2)results please refer to one example https://etherpad.opnfv.org/p/dovetail_report Change-Id: I63a1ba3b6aa1ffe5fa043a11cd3777dd0e8d52d9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-30Merge "dovetail tool: run.py execution always wipes of results files"hongbo tian2-14/+16
2016-11-30dovetail: modify process flow in function update_envs()wu.zhihui1-3/+4
bugfix task DOVETAIL-144 1. If run command "python run.py" without options, e.g. --SUT_TYPE, --SUT_IP, env values will be updated by os enviromental parameter. 2. If run command "python run.py" with options, no update from os enviromental parameter. JIRA: DOVETAIL-144 Change-Id: Id3bde7546722a5f4defe52d4f00609d7049a288b Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-30Merge "fix flake8 test error for ez_setup.py"hongbo tian1-2/+3
2016-11-29dovetail tool: run.py execution always wipes of results filesxudan2-14/+16
1. move function clean_results_dir() into run.py 2. call this function at the beginning of function main() 3. this can only work correctly after all log initializations packaged, see JIRA: DOVETAIL-56 and gerrit https://gerrit.opnfv.org/gerrit/#/c/24059/ JIRA: DOVETAIL-80 Change-Id: I1cdda8f6d43f21c45c0537868cb7ed10d14ea9df Signed-off-by: xudan <xudan16@huawei.com>
2016-11-29dovetail tool: To exec testsuite loading after command line arguments is TrueMatthewLi1-2/+2
JIRA: DOVETAIL-142 Change-Id: I1d8a444580755b4f4d9a0f7098b4b17ea66d6f58 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-29Merge "dovetail tool: change CI_DEBUG to DEBUG"hongbo tian3-5/+7
2016-11-29dovetail tool: package all logger initializationxudan5-57/+122
1. For container.py, parser.py, report.py and testcase.py, they use functions in classes to create loggers. So each class will have its own logger. 2. run.py will create all the loggers by create_logs() function before the use of them. So logs will not be initialized until the call of create_logs(). 3. Move logger in run.py into function main(). JIRA: DOVETAIL-56 Change-Id: I53de090df270cc7a34762ff99cbc9115cfb09465 Signed-off-by: xudan <xudan16@huawei.com>
2016-11-29Merge "dovetail tool: testarea argument added"hongbo tian9-55/+88
2016-11-28Merge "Backend rest api mechanism"hongbo tian18-0/+1665
2016-11-28fix flake8 test error for ez_setup.pyzshi1-2/+3
Change-Id: Ibb764a41bac05599645d283c5fe3dbe409b2b006 Signed-off-by: zshi <zshi@redhat.com>
2016-11-28dovetail tool: change CI_DEBUG to DEBUGzshi3-5/+7
JIRA: DOVETAIL-42 1) change 'CI_DEBUG' to 'DEBUG' in cmd_config.yml and dovetail_logger.py 2) assign 'DEBUG' env value to 'CI_DEBUG' when updating functest and yardstick parameter 'envs' Change-Id: I6d6130e394fddf11d83be619f2c9684bf8c859f9 Signed-off-by: zshi <zshi@redhat.com>
2016-11-26dovetail tool: testarea argument addedMatthewLi9-55/+88
JIRA: DOVETAIL-71 1) argument testarea is added 2) terminology "scenario" change to "testsuite" 3) related documents amended 4) all word "certification" changed to "compliance" Change-Id: I038a9e04bf83cfdac20f0c59adb1841bf5470584 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-25Merge "dovetail tool: reorganize dovetail_config.py and modify related files"hongbo tian7-87/+86
2016-11-24[Dovetail Tool] Prepare env fail due to dependency on pyyamlLeo Wang1-4/+2
JIRA:DOVETAIL-92 root cause: 1. import dovetail_logger while it depends on dovetail_config 2. dovetail_config import yaml 3. yaml is not installed yet action: 1. remove dovetail_logger Change-Id: I51f5e8bab2451639a4a9ebf1978fe8a292df1704 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-20Backend rest api mechanismLeo Wang18-0/+1665
JIRA:DOVETAIL-63 provide rest api as the dashboard backend 1. using gunicorn as rest api server 2. using flask as rest api framework 3. using sqlalchemy as mysql database driver 4. implement basic report CRUD operations 5. implement basic session management in database operations Change-Id: Ifbd251462396c2cb414b1ae9150cfc1e2e2d00c0 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-17dovetail tool: upstream functest env preparation and CLI adaptionxudan1-2/+2
1. Functest has changed it's directory structure, so cmds in functest_config.yml cannot run successfully. 2. Use functest CLI to prepare and run test cases instead of running prepare_env.py or run_tests.py. JIRA: DOVETAIL-40 Change-Id: I7907dd70fd671efbed5f4132c0d76d6eb90b63eb Signed-off-by: xudan <xudan16@huawei.com>
2016-11-17dovetail tool: reorganize dovetail_config.py and modify related filesxudan7-87/+86
1. move all sentencs and functions into class DovetailConfig 2. delete dict container_config for it has been replaced by dovetail_config 2. modify files that import dovetail_config, including container.py, parser.py, report.py, run.py, dovetail_logger.py and testcase.py JIRA: DOVETAIL-55 Change-Id: Ib5ca3cadd751075c879f39e8cb2eb2e0adcef6aa Signed-off-by: xudan <xudan16@huawei.com>
2016-11-16Merge "Fix option handling in case of no '--tag' option."hongbo tian1-2/+2
2016-11-16Merge "dovetail tool: cleanup the result directory before running"hongbo tian1-2/+2
2016-11-16dovetail tool: cleanup the result directory before runningxudan1-2/+2
1. Jenkins will fail with error rm: cannot remove '/home/opnfv/dovetail/results': Device or resource busy 2. The reason is that Jenkins will mount this directory before running 3. The effective solution is removing all contents in this directory rather than removing this mounted directory JIRA: DOVETAIL-38 Change-Id: Ic32ea19341ad2048322ec11a4abc48e13019a7bb Signed-off-by: xudan <xudan16@huawei.com>
2016-11-15dovetail tool: replace the hard-coded "Tescase" and modify some classmethodLinghui Zeng4-34/+36
JIRA: DOVETAIL-45 1. In the testcase.py file, we replace the hard-coded "Tesecase" with "cls" or "self" based on the specific contexts. 2. For all the four committed files, we modify some classmethod into staticmethod because each method is basically just a function, called syntactically like a method, but without access to the object and its' internals (attributes and other methods). Change-Id: Ieb452f476a2d33ae9aca4c904ae7d2c92b68689e Signed-off-by: Linghui Zeng <linghui.zeng@huawei.com>
2016-11-15Fix option handling in case of no '--tag' option.Tomofumi Hayashi1-2/+2
In case of default, 'None' is in kwargs['tag'] so need to check it in option handling. The code is to fix it. Change-Id: Iaadf7e6f0f064dda819970346a810a6a8b47c74c Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-15Merge "dovetail tool: reorganize prepare_env.py"hongbo tian1-7/+15
2016-11-15Merge "generate report data for reuse"hongbo tian1-24/+48
2016-11-15Merge "Add "docker tag" option for each testcase containers."hongbo tian2-0/+27
2016-11-15generate report data for reuseLeo Wang1-24/+48
JIRA: DOVETAIL-22 1. report text is string, can not be reused by other module, 2. generate report data first, then this data can be uploaded to database or be translated to report text Change-Id: Ieecd87c827537c825c87a0db4ff170ae490d75ae Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-14dovetail tool: reorganize prepare_env.pyxudan1-7/+15
1. add main function and move statements into it JIRA: DOVETAIL-57 Change-Id: I69158fa64ffc10668fc39835de434f0b44b8754a Signed-off-by: xudan <xudan16@huawei.com>
2016-11-10Add "docker tag" option for each testcase containers.Tomofumi Hayashi2-0/+27
JIRA: DOVETAIL-69 This commit is to add new option to specify docker tags for each test containers, such as '--TAG "functest:stable"'. Change-Id: Ica11e16abfb21649a3eea9c7d7d5cd31502d2e21 Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-10dovetail tool: 2 config files, compliance_set and proposed_testsMatthewLi40-17/+341
JIRA: DOVETAIL-50 1)'proposed_tests.yml' is added, which runs as the total tests run. The 'compliance_set.yml' will run as dovetail certification tests; 2)ipv6 test cases added accroding to 'docs/testsuites/ipv6/ipv6_all_testcases', tc026 missed temporarily,yardstick ipv6tc026 only supports 2 installers by now according to https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Cases 3)vimops001-006 added for VIM images operation test cases 4)nfvi001-002 added for vping ssh/userdata in fucntest 5)more test cases can be added in future in proposed_tests.yml, besides, the test cases can be adjusted in future in proposed_tests.yml Change-Id: I8a8634583549a802f6f64fbea651e7be4efa361c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-09Merge "dovetail tool: ensure sub_testcase_list and testcase are not None"hongbo tian2-9/+22
2016-11-09Merge "dovetail tool: os name bugfix"hongbo tian1-3/+4
2016-11-09Merge "dovetail tool: cleanup result directory before running"hongbo tian1-3/+16
2016-11-07dovetail tool: os name bugfixMatthewLi1-3/+4
JIRA: DOVETAIL-54 bug: in some envs, return value platform_os is Ubuntu rather than ubuntu. Change-Id: I6a2aa964d00eff9f336f8204071a05a6b5f11134 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-08dovetail tool: ensure sub_testcase_list and testcase are not Nonezshi2-9/+22
JIRA: DOVETAIL-52 1) save return value of testcase.sub_testcase() in sub_testcase_list for multiple calls later 2) ensure sub_testcase_list is not called with None value 3) ensure testcase is not called with None value 4) identify None testcase with 'Undefined' in dovetail_report.txt Change-Id: Ifcf0c0846dc788575310f29932a4757752f1e3a3 Signed-off-by: zshi <zshi@redhat.com>
2016-11-03Merge "dovetail tool: Add cli mechanism for changing envs at run-time"hongbo tian5-13/+123
2016-11-03Merge "dovetail tool: rename report_file_path variable"hongbo tian1-4/+4
2016-11-03Merge "dovetail tool: Cleanup functest_conf.yml"hongbo tian1-4/+0
2016-11-03Merge "Add more distro support when preparing environment"hongbo tian1-1/+39
2016-11-03Merge "dovetail tool: ignore file amended"hongbo tian1-9/+8
2016-11-03dovetail tool: cleanup result directory before runningxudan1-3/+16
JIRA: DOVETAIL-38 1. Do cleaning at the beginning of each run. 2. Since some files and folders have the 'root root' privilege, no command except cmd 'sudo rm -rf <results_dir>' can work. Change-Id: If8cd5c8c9c35434af2a5fa38575c06f83f0afc4d Signed-off-by: xudan <xudan16@huawei.com>
2016-11-02dovetail tool: Add cli mechanism for changing envs at run-timexudan5-13/+123
JIRA: DOVETAIL-23 1. Add file cmd_config.yml for defining arguments and options. 2. Using python click module to add and parse cmds in cmd_config.yml 3. Using envs options to update envs in yardstick/functest config file Change-Id: Ie513c0f0a1ed76f29408419a4bcbbcf21334bb3f Signed-off-by: xudan <xudan16@huawei.com>
2016-10-30dovetail tool: ignore file amendedMatthewLi1-9/+8
JIRA: DOVETAIL-37 1)as much as possible to stay the same 2)*.mo deleted since no C used in this repo 3)unittest-log.txt added, it can be produced by using unittest.sh -f 4)document related added, including *.sw?, CI related /docs_build/ /docs_ouput/, results dir 5)other personal habit will not included in this Change-Id: I1e3c95d74f99c212838a987f1705af3902f6f58d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-29dovetail tool: Add unit tests for 'parser' modulemathsyouth4-0/+67
JIRA: DOVETAIL-45 1. Add two '__init__.py' files for packages 2. Add two test functions in 'test_parser.py' to verify the function of the method 'parser_cmd' 3. 'test_testcase.yaml' is used in 'test_parser.py' Change-Id: Ic3e2e6e67bcac3276fe47ec5584c0d9632b5286a Signed-off-by: mathsyouth <linghui.zeng@huawei.com>
2016-10-28dovetail tool: Cleanup functest_conf.ymlzshi1-4/+0
JIRA: DOVETAIL-43 JIRA: DOVETAIL-44 1) remove result_dir 2) remove pre_cmd, exec_cmd, post_cmd Change-Id: Iea8173026b1f467011a40c6954581f25cd5e1912 Signed-off-by: zshi <zshi@redhat.com>
2016-10-28Merge "dovetail tool: developer userguide document"hongbo tian8-225/+246
2016-10-26Add more distro support when preparing environmentzshi1-1/+39
Change-Id: I3ff4419e38872bc28e59699a11080777ea596dc3 Signed-off-by: zshi <zshi@redhat.com>
2016-10-26dovetail tool: developer userguide documentMatthewLi8-225/+246
JIRA: DOVETAIL-28 1) documents are reorganized, all dovetail tool related documents are moved to /docs/dovetailtool 2) some sections are rewritten to make it more clear Change-Id: Ib0c23b8c1771eb6de7d6cc264c101e8e26ed3d1f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-21dovetail tool: rename report_file_path variablezshi1-4/+4
the value assigned to report_file_path is a file name, not a path. Change-Id: I338ae2bb5e836d26c711bfa9144f16d06c08deb7 Signed-off-by: zshi <zshi@redhat.com>
2016-10-21Simplify getting pre_condition cmdszshi1-2/+1
Change-Id: I8ca04cbdc4236e9ff754bad816bb7282673b5b55 Signed-off-by: zshi <zshi@redhat.com>