summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-11-24[Dovetail Tool] Prepare env fail due to dependency on pyyamlLeo Wang1-4/+2
JIRA:DOVETAIL-92 root cause: 1. import dovetail_logger while it depends on dovetail_config 2. dovetail_config import yaml 3. yaml is not installed yet action: 1. remove dovetail_logger Change-Id: I51f5e8bab2451639a4a9ebf1978fe8a292df1704 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-17dovetail tool: upstream functest env preparation and CLI adaptionxudan1-2/+2
1. Functest has changed it's directory structure, so cmds in functest_config.yml cannot run successfully. 2. Use functest CLI to prepare and run test cases instead of running prepare_env.py or run_tests.py. JIRA: DOVETAIL-40 Change-Id: I7907dd70fd671efbed5f4132c0d76d6eb90b63eb Signed-off-by: xudan <xudan16@huawei.com>
2016-11-16Merge "Fix option handling in case of no '--tag' option."hongbo tian1-2/+2
2016-11-16Merge "dovetail tool: cleanup the result directory before running"hongbo tian1-2/+2
2016-11-16dovetail tool: cleanup the result directory before runningxudan1-2/+2
1. Jenkins will fail with error rm: cannot remove '/home/opnfv/dovetail/results': Device or resource busy 2. The reason is that Jenkins will mount this directory before running 3. The effective solution is removing all contents in this directory rather than removing this mounted directory JIRA: DOVETAIL-38 Change-Id: Ic32ea19341ad2048322ec11a4abc48e13019a7bb Signed-off-by: xudan <xudan16@huawei.com>
2016-11-15dovetail tool: replace the hard-coded "Tescase" and modify some classmethodLinghui Zeng4-34/+36
JIRA: DOVETAIL-45 1. In the testcase.py file, we replace the hard-coded "Tesecase" with "cls" or "self" based on the specific contexts. 2. For all the four committed files, we modify some classmethod into staticmethod because each method is basically just a function, called syntactically like a method, but without access to the object and its' internals (attributes and other methods). Change-Id: Ieb452f476a2d33ae9aca4c904ae7d2c92b68689e Signed-off-by: Linghui Zeng <linghui.zeng@huawei.com>
2016-11-15Fix option handling in case of no '--tag' option.Tomofumi Hayashi1-2/+2
In case of default, 'None' is in kwargs['tag'] so need to check it in option handling. The code is to fix it. Change-Id: Iaadf7e6f0f064dda819970346a810a6a8b47c74c Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-15Merge "dovetail tool: reorganize prepare_env.py"hongbo tian1-7/+15
2016-11-15Merge "generate report data for reuse"hongbo tian1-24/+48
2016-11-15Merge "Add "docker tag" option for each testcase containers."hongbo tian2-0/+27
2016-11-15generate report data for reuseLeo Wang1-24/+48
JIRA: DOVETAIL-22 1. report text is string, can not be reused by other module, 2. generate report data first, then this data can be uploaded to database or be translated to report text Change-Id: Ieecd87c827537c825c87a0db4ff170ae490d75ae Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-14dovetail tool: reorganize prepare_env.pyxudan1-7/+15
1. add main function and move statements into it JIRA: DOVETAIL-57 Change-Id: I69158fa64ffc10668fc39835de434f0b44b8754a Signed-off-by: xudan <xudan16@huawei.com>
2016-11-10Add "docker tag" option for each testcase containers.Tomofumi Hayashi2-0/+27
JIRA: DOVETAIL-69 This commit is to add new option to specify docker tags for each test containers, such as '--TAG "functest:stable"'. Change-Id: Ica11e16abfb21649a3eea9c7d7d5cd31502d2e21 Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-10dovetail tool: 2 config files, compliance_set and proposed_testsMatthewLi40-17/+341
JIRA: DOVETAIL-50 1)'proposed_tests.yml' is added, which runs as the total tests run. The 'compliance_set.yml' will run as dovetail certification tests; 2)ipv6 test cases added accroding to 'docs/testsuites/ipv6/ipv6_all_testcases', tc026 missed temporarily,yardstick ipv6tc026 only supports 2 installers by now according to https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Cases 3)vimops001-006 added for VIM images operation test cases 4)nfvi001-002 added for vping ssh/userdata in fucntest 5)more test cases can be added in future in proposed_tests.yml, besides, the test cases can be adjusted in future in proposed_tests.yml Change-Id: I8a8634583549a802f6f64fbea651e7be4efa361c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-09Merge "dovetail tool: ensure sub_testcase_list and testcase are not None"hongbo tian2-9/+22
2016-11-09Merge "dovetail tool: os name bugfix"hongbo tian1-3/+4
2016-11-09Merge "dovetail tool: cleanup result directory before running"hongbo tian1-3/+16
2016-11-07dovetail tool: os name bugfixMatthewLi1-3/+4
JIRA: DOVETAIL-54 bug: in some envs, return value platform_os is Ubuntu rather than ubuntu. Change-Id: I6a2aa964d00eff9f336f8204071a05a6b5f11134 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-08dovetail tool: ensure sub_testcase_list and testcase are not Nonezshi2-9/+22
JIRA: DOVETAIL-52 1) save return value of testcase.sub_testcase() in sub_testcase_list for multiple calls later 2) ensure sub_testcase_list is not called with None value 3) ensure testcase is not called with None value 4) identify None testcase with 'Undefined' in dovetail_report.txt Change-Id: Ifcf0c0846dc788575310f29932a4757752f1e3a3 Signed-off-by: zshi <zshi@redhat.com>
2016-11-03Merge "dovetail tool: Add cli mechanism for changing envs at run-time"hongbo tian5-13/+123
2016-11-03Merge "dovetail tool: rename report_file_path variable"hongbo tian1-4/+4
2016-11-03Merge "dovetail tool: Cleanup functest_conf.yml"hongbo tian1-4/+0
2016-11-03Merge "Add more distro support when preparing environment"hongbo tian1-1/+39
2016-11-03Merge "dovetail tool: ignore file amended"hongbo tian1-9/+8
2016-11-03dovetail tool: cleanup result directory before runningxudan1-3/+16
JIRA: DOVETAIL-38 1. Do cleaning at the beginning of each run. 2. Since some files and folders have the 'root root' privilege, no command except cmd 'sudo rm -rf <results_dir>' can work. Change-Id: If8cd5c8c9c35434af2a5fa38575c06f83f0afc4d Signed-off-by: xudan <xudan16@huawei.com>
2016-11-02dovetail tool: Add cli mechanism for changing envs at run-timexudan5-13/+123
JIRA: DOVETAIL-23 1. Add file cmd_config.yml for defining arguments and options. 2. Using python click module to add and parse cmds in cmd_config.yml 3. Using envs options to update envs in yardstick/functest config file Change-Id: Ie513c0f0a1ed76f29408419a4bcbbcf21334bb3f Signed-off-by: xudan <xudan16@huawei.com>
2016-10-30dovetail tool: ignore file amendedMatthewLi1-9/+8
JIRA: DOVETAIL-37 1)as much as possible to stay the same 2)*.mo deleted since no C used in this repo 3)unittest-log.txt added, it can be produced by using unittest.sh -f 4)document related added, including *.sw?, CI related /docs_build/ /docs_ouput/, results dir 5)other personal habit will not included in this Change-Id: I1e3c95d74f99c212838a987f1705af3902f6f58d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-29dovetail tool: Add unit tests for 'parser' modulemathsyouth4-0/+67
JIRA: DOVETAIL-45 1. Add two '__init__.py' files for packages 2. Add two test functions in 'test_parser.py' to verify the function of the method 'parser_cmd' 3. 'test_testcase.yaml' is used in 'test_parser.py' Change-Id: Ic3e2e6e67bcac3276fe47ec5584c0d9632b5286a Signed-off-by: mathsyouth <linghui.zeng@huawei.com>
2016-10-28dovetail tool: Cleanup functest_conf.ymlzshi1-4/+0
JIRA: DOVETAIL-43 JIRA: DOVETAIL-44 1) remove result_dir 2) remove pre_cmd, exec_cmd, post_cmd Change-Id: Iea8173026b1f467011a40c6954581f25cd5e1912 Signed-off-by: zshi <zshi@redhat.com>
2016-10-28Merge "dovetail tool: developer userguide document"hongbo tian8-225/+246
2016-10-26Add more distro support when preparing environmentzshi1-1/+39
Change-Id: I3ff4419e38872bc28e59699a11080777ea596dc3 Signed-off-by: zshi <zshi@redhat.com>
2016-10-26dovetail tool: developer userguide documentMatthewLi8-225/+246
JIRA: DOVETAIL-28 1) documents are reorganized, all dovetail tool related documents are moved to /docs/dovetailtool 2) some sections are rewritten to make it more clear Change-Id: Ib0c23b8c1771eb6de7d6cc264c101e8e26ed3d1f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-21dovetail tool: rename report_file_path variablezshi1-4/+4
the value assigned to report_file_path is a file name, not a path. Change-Id: I338ae2bb5e836d26c711bfa9144f16d06c08deb7 Signed-off-by: zshi <zshi@redhat.com>
2016-10-21Simplify getting pre_condition cmdszshi1-2/+1
Change-Id: I8ca04cbdc4236e9ff754bad816bb7282673b5b55 Signed-off-by: zshi <zshi@redhat.com>
2016-10-20dovetail tool : add @classmethod to post_condition_clszshi1-0/+1
JIRA: DOVETAIL-39 Turn post_condition_cls to classmethod function which will be consistent with pre_condition_cls Change-Id: If8457035493f2ed93bdae5be5f22a57255b2c474 Signed-off-by: zshi <zshi@redhat.com>
2016-10-19update the committer email addresshongbotian1-1/+1
JIRA: DOVETAIL-36 Update the email addrees for Wenjing Chu Change-Id: I61e378bba703806cef0cb829b855b822671ddbbe Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2016-10-17Get envs from environment variables to test multi-SUTzshi1-0/+7
JIRA: DOVETAIL-32 currently envs variable is hard-coded to specific values which are not suitable for multi-SUT platform, fix it by reading it from environment variable. this commit is for apex installer testing purpose. Change-Id: I2163b96208d42a91f2795de6a55b276b803dc5e8 Signed-off-by: zshi <zshi@redhat.com>
2016-10-17Merge "[dovetail_tool] Fix the python style scanned by flake8"hongbo tian9-103/+142
2016-10-14[dovetail_tool] Fix the python style scanned by flake8xudan9-103/+142
JIRA: DOVETAIL-34 Change-Id: Ib9a6dd254f1d77b0cbbfa66e8e1e44df1ce14a4b Signed-off-by: xudan <xudan16@huawei.com>
2016-10-14Merge "Add documentation for dovetail tool"hongbo tian6-2/+338
2016-10-13dovetail tool: setup.py added and path error amendMatthewLi5-2/+511
JIRA: DOVETAIL-26 1)ez_setup.py setup.py is added 2)flake8 is there, then format check can be easily achived in CI later 3)path error amend see details in DOVETAIL-33 Change-Id: Ic19dbac852694adaeecf5cdf6c2ae7c9ea9dbb33 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-12preparation for setup.pyMatthewLi18-2/+2
JIRA: DOVETAIL-26 1)change the directory scripts to dovetail, to make it unified in OPNFV and for setup.py 2)change the paths accordingly 3)this should be first merged, since docker is changed, then to add setup.py and run the local test Change-Id: I65974bde17f310ebbfe3c025532b05dae8752945 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-12Merge "Add yardstick crawler and checker for the results of testcase"hongbo tian1-3/+29
2016-10-11Add documentation for dovetail toolLeo Wang6-2/+338
JIRA:DOVETAIL-28 Change-Id: I2478655d951a65a11f39e9ceba10969e56274cc3 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-10-10Add yardstick crawler and checker for the results of testcasexudan1-3/+29
JIRA: DOVETAIL-18 Change-Id: Idaad0ee4f8e6304f18fa478f1cded6e256cb12fd Signed-off-by: xudan <xudan16@huawei.com>
2016-10-09Remove scripts in dovetail and use yarstick scripts to prepare environmentxudan8-251/+15
JIRA: DOVETAIL-20 Change-Id: I46a095d5714245a9399e3a33c72f5f4bc77a18bf Signed-off-by: xudan <xudan16@huawei.com>
2016-10-08Merge "Use template to unify commands in functest/yardstick"hongbo tian12-33/+191
2016-09-30Use template to unify commands in functest/yardstickLeo Wang12-33/+191
JIRA: DOVETAIL-19 1. use jinja2 to unify commands in config files 2. it simplify the process of test execution, put the dissimilarity in config 3. add precondition/postcondition for functest/yardstick config Change-Id: Ib996b11ea065b61910b34b78191bb7b1ffd92e59 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-09-28Merge "IPv6 test cases: Test case specification document example"hongbo tian5-44/+381
2016-09-27IPv6 test cases: Test case specification document exampleBin Hu5-44/+381
JIRA: DOVETAIL-9 1. We are keeping the test methodology simple and easy. We are reusing existing tests as much as we can from IPv6 projects and Tempest API and Scenario tests, which are run in FuncTest and Yardstick. 2. We modified "testplan.rst" to briefly describe the test plan, i.e. current IPv6 test cases for platform compliance, which have passed FuncTest and Yardstick test in Arno and Brahmaputra releases. We also leave room for additional IPv6 test cases if there are more contributions down the road 3. Original "designspecification.rst", "testprocedure.rst" and "testspecification.rst" are not applicable any more here. The test design, setup, and execution procedure related specification are covered by each test case. 4. Thus "index.rst" only covers "testplan.rst" and the list of test cases. 5. Two examples of test case specification documents are provided "ipv6.tc001.specification.rst" "ipv6.tc026.specification.rst" 6. A complete set of current IPv6 test cases are listed in "ipv6_all_testcases.rst". Once template is agreed, we will converted it into specific test case document. For more background of IPv6, and its features and technical details, please see: https://wiki.opnfv.org/display/ipv6/IPv6+Home http://artifacts.opnfv.org/ipv6/docs/installationprocedure/index.html Change-Id: I7e47c73c0f02a407df278c93a3da2142b5cc86e5 Signed-off-by: Bin Hu <bh526r@att.com>