summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-11-15Merge "generate report data for reuse"hongbo tian1-24/+48
2016-11-15Merge "Add "docker tag" option for each testcase containers."hongbo tian2-0/+27
2016-11-15generate report data for reuseLeo Wang1-24/+48
JIRA: DOVETAIL-22 1. report text is string, can not be reused by other module, 2. generate report data first, then this data can be uploaded to database or be translated to report text Change-Id: Ieecd87c827537c825c87a0db4ff170ae490d75ae Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-11-10Add "docker tag" option for each testcase containers.Tomofumi Hayashi2-0/+27
JIRA: DOVETAIL-69 This commit is to add new option to specify docker tags for each test containers, such as '--TAG "functest:stable"'. Change-Id: Ica11e16abfb21649a3eea9c7d7d5cd31502d2e21 Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-10dovetail tool: 2 config files, compliance_set and proposed_testsMatthewLi40-17/+341
JIRA: DOVETAIL-50 1)'proposed_tests.yml' is added, which runs as the total tests run. The 'compliance_set.yml' will run as dovetail certification tests; 2)ipv6 test cases added accroding to 'docs/testsuites/ipv6/ipv6_all_testcases', tc026 missed temporarily,yardstick ipv6tc026 only supports 2 installers by now according to https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Cases 3)vimops001-006 added for VIM images operation test cases 4)nfvi001-002 added for vping ssh/userdata in fucntest 5)more test cases can be added in future in proposed_tests.yml, besides, the test cases can be adjusted in future in proposed_tests.yml Change-Id: I8a8634583549a802f6f64fbea651e7be4efa361c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-09Merge "dovetail tool: ensure sub_testcase_list and testcase are not None"hongbo tian2-9/+22
2016-11-09Merge "dovetail tool: os name bugfix"hongbo tian1-3/+4
2016-11-09Merge "dovetail tool: cleanup result directory before running"hongbo tian1-3/+16
2016-11-07dovetail tool: os name bugfixMatthewLi1-3/+4
JIRA: DOVETAIL-54 bug: in some envs, return value platform_os is Ubuntu rather than ubuntu. Change-Id: I6a2aa964d00eff9f336f8204071a05a6b5f11134 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-08dovetail tool: ensure sub_testcase_list and testcase are not Nonezshi2-9/+22
JIRA: DOVETAIL-52 1) save return value of testcase.sub_testcase() in sub_testcase_list for multiple calls later 2) ensure sub_testcase_list is not called with None value 3) ensure testcase is not called with None value 4) identify None testcase with 'Undefined' in dovetail_report.txt Change-Id: Ifcf0c0846dc788575310f29932a4757752f1e3a3 Signed-off-by: zshi <zshi@redhat.com>
2016-11-03Merge "dovetail tool: Add cli mechanism for changing envs at run-time"hongbo tian5-13/+123
2016-11-03Merge "dovetail tool: rename report_file_path variable"hongbo tian1-4/+4
2016-11-03Merge "dovetail tool: Cleanup functest_conf.yml"hongbo tian1-4/+0
2016-11-03Merge "Add more distro support when preparing environment"hongbo tian1-1/+39
2016-11-03Merge "dovetail tool: ignore file amended"hongbo tian1-9/+8
2016-11-03dovetail tool: cleanup result directory before runningxudan1-3/+16
JIRA: DOVETAIL-38 1. Do cleaning at the beginning of each run. 2. Since some files and folders have the 'root root' privilege, no command except cmd 'sudo rm -rf <results_dir>' can work. Change-Id: If8cd5c8c9c35434af2a5fa38575c06f83f0afc4d Signed-off-by: xudan <xudan16@huawei.com>
2016-11-02dovetail tool: Add cli mechanism for changing envs at run-timexudan5-13/+123
JIRA: DOVETAIL-23 1. Add file cmd_config.yml for defining arguments and options. 2. Using python click module to add and parse cmds in cmd_config.yml 3. Using envs options to update envs in yardstick/functest config file Change-Id: Ie513c0f0a1ed76f29408419a4bcbbcf21334bb3f Signed-off-by: xudan <xudan16@huawei.com>
2016-10-30dovetail tool: ignore file amendedMatthewLi1-9/+8
JIRA: DOVETAIL-37 1)as much as possible to stay the same 2)*.mo deleted since no C used in this repo 3)unittest-log.txt added, it can be produced by using unittest.sh -f 4)document related added, including *.sw?, CI related /docs_build/ /docs_ouput/, results dir 5)other personal habit will not included in this Change-Id: I1e3c95d74f99c212838a987f1705af3902f6f58d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-29dovetail tool: Add unit tests for 'parser' modulemathsyouth4-0/+67
JIRA: DOVETAIL-45 1. Add two '__init__.py' files for packages 2. Add two test functions in 'test_parser.py' to verify the function of the method 'parser_cmd' 3. 'test_testcase.yaml' is used in 'test_parser.py' Change-Id: Ic3e2e6e67bcac3276fe47ec5584c0d9632b5286a Signed-off-by: mathsyouth <linghui.zeng@huawei.com>
2016-10-28dovetail tool: Cleanup functest_conf.ymlzshi1-4/+0
JIRA: DOVETAIL-43 JIRA: DOVETAIL-44 1) remove result_dir 2) remove pre_cmd, exec_cmd, post_cmd Change-Id: Iea8173026b1f467011a40c6954581f25cd5e1912 Signed-off-by: zshi <zshi@redhat.com>
2016-10-28Merge "dovetail tool: developer userguide document"hongbo tian8-225/+246
2016-10-26Add more distro support when preparing environmentzshi1-1/+39
Change-Id: I3ff4419e38872bc28e59699a11080777ea596dc3 Signed-off-by: zshi <zshi@redhat.com>
2016-10-26dovetail tool: developer userguide documentMatthewLi8-225/+246
JIRA: DOVETAIL-28 1) documents are reorganized, all dovetail tool related documents are moved to /docs/dovetailtool 2) some sections are rewritten to make it more clear Change-Id: Ib0c23b8c1771eb6de7d6cc264c101e8e26ed3d1f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-21dovetail tool: rename report_file_path variablezshi1-4/+4
the value assigned to report_file_path is a file name, not a path. Change-Id: I338ae2bb5e836d26c711bfa9144f16d06c08deb7 Signed-off-by: zshi <zshi@redhat.com>
2016-10-21Simplify getting pre_condition cmdszshi1-2/+1
Change-Id: I8ca04cbdc4236e9ff754bad816bb7282673b5b55 Signed-off-by: zshi <zshi@redhat.com>
2016-10-20dovetail tool : add @classmethod to post_condition_clszshi1-0/+1
JIRA: DOVETAIL-39 Turn post_condition_cls to classmethod function which will be consistent with pre_condition_cls Change-Id: If8457035493f2ed93bdae5be5f22a57255b2c474 Signed-off-by: zshi <zshi@redhat.com>
2016-10-19update the committer email addresshongbotian1-1/+1
JIRA: DOVETAIL-36 Update the email addrees for Wenjing Chu Change-Id: I61e378bba703806cef0cb829b855b822671ddbbe Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2016-10-17Get envs from environment variables to test multi-SUTzshi1-0/+7
JIRA: DOVETAIL-32 currently envs variable is hard-coded to specific values which are not suitable for multi-SUT platform, fix it by reading it from environment variable. this commit is for apex installer testing purpose. Change-Id: I2163b96208d42a91f2795de6a55b276b803dc5e8 Signed-off-by: zshi <zshi@redhat.com>
2016-10-17Merge "[dovetail_tool] Fix the python style scanned by flake8"hongbo tian9-103/+142
2016-10-14[dovetail_tool] Fix the python style scanned by flake8xudan9-103/+142
JIRA: DOVETAIL-34 Change-Id: Ib9a6dd254f1d77b0cbbfa66e8e1e44df1ce14a4b Signed-off-by: xudan <xudan16@huawei.com>
2016-10-14Merge "Add documentation for dovetail tool"hongbo tian6-2/+338
2016-10-13dovetail tool: setup.py added and path error amendMatthewLi5-2/+511
JIRA: DOVETAIL-26 1)ez_setup.py setup.py is added 2)flake8 is there, then format check can be easily achived in CI later 3)path error amend see details in DOVETAIL-33 Change-Id: Ic19dbac852694adaeecf5cdf6c2ae7c9ea9dbb33 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-12preparation for setup.pyMatthewLi18-2/+2
JIRA: DOVETAIL-26 1)change the directory scripts to dovetail, to make it unified in OPNFV and for setup.py 2)change the paths accordingly 3)this should be first merged, since docker is changed, then to add setup.py and run the local test Change-Id: I65974bde17f310ebbfe3c025532b05dae8752945 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-12Merge "Add yardstick crawler and checker for the results of testcase"hongbo tian1-3/+29
2016-10-11Add documentation for dovetail toolLeo Wang6-2/+338
JIRA:DOVETAIL-28 Change-Id: I2478655d951a65a11f39e9ceba10969e56274cc3 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-10-10Add yardstick crawler and checker for the results of testcasexudan1-3/+29
JIRA: DOVETAIL-18 Change-Id: Idaad0ee4f8e6304f18fa478f1cded6e256cb12fd Signed-off-by: xudan <xudan16@huawei.com>
2016-10-09Remove scripts in dovetail and use yarstick scripts to prepare environmentxudan8-251/+15
JIRA: DOVETAIL-20 Change-Id: I46a095d5714245a9399e3a33c72f5f4bc77a18bf Signed-off-by: xudan <xudan16@huawei.com>
2016-10-08Merge "Use template to unify commands in functest/yardstick"hongbo tian12-33/+191
2016-09-30Use template to unify commands in functest/yardstickLeo Wang12-33/+191
JIRA: DOVETAIL-19 1. use jinja2 to unify commands in config files 2. it simplify the process of test execution, put the dissimilarity in config 3. add precondition/postcondition for functest/yardstick config Change-Id: Ib996b11ea065b61910b34b78191bb7b1ffd92e59 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-09-28Merge "IPv6 test cases: Test case specification document example"hongbo tian5-44/+381
2016-09-27IPv6 test cases: Test case specification document exampleBin Hu5-44/+381
JIRA: DOVETAIL-9 1. We are keeping the test methodology simple and easy. We are reusing existing tests as much as we can from IPv6 projects and Tempest API and Scenario tests, which are run in FuncTest and Yardstick. 2. We modified "testplan.rst" to briefly describe the test plan, i.e. current IPv6 test cases for platform compliance, which have passed FuncTest and Yardstick test in Arno and Brahmaputra releases. We also leave room for additional IPv6 test cases if there are more contributions down the road 3. Original "designspecification.rst", "testprocedure.rst" and "testspecification.rst" are not applicable any more here. The test design, setup, and execution procedure related specification are covered by each test case. 4. Thus "index.rst" only covers "testplan.rst" and the list of test cases. 5. Two examples of test case specification documents are provided "ipv6.tc001.specification.rst" "ipv6.tc026.specification.rst" 6. A complete set of current IPv6 test cases are listed in "ipv6_all_testcases.rst". Once template is agreed, we will converted it into specific test case document. For more background of IPv6, and its features and technical details, please see: https://wiki.opnfv.org/display/ipv6/IPv6+Home http://artifacts.opnfv.org/ipv6/docs/installationprocedure/index.html Change-Id: I7e47c73c0f02a407df278c93a3da2142b5cc86e5 Signed-off-by: Bin Hu <bh526r@att.com>
2016-09-23Move copyfile to container and remove hard-codexudan21894-25/+22
JIRA: DOVETAIL-17 Change-Id: Id4ad126169cf83c6c72a7b599f3309f0f930e461 Signed-off-by: xudan <xudan16@huawei.com>
2016-09-21save dovetail report to diskLeo Wang2-17/+58
JIRA: DOVETAIL-16 Change-Id: I8aab0b34425b698fee556ef97d3b0942b1b149d2 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-09-20change workdir of docker container for ciLeo Wang1-1/+3
JIRA: DOVETAIL-15 - change workdir to /home/opnfv/dovetail/scripts for ci Change-Id: Ib289fb3e2e7af09a4a3a1fb7b124876155d811e7 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-09-20Merge "add prototype of dovetail tool"Christopher Price22-5/+955
2016-09-20add prototype of dovetail toolLeo Wang22-5/+955
JIRA: DOVETAIL-12 Change-Id: I1ee120ed8199589e1e7cbce9cbb55036e9e5f7ea Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-09-19add dockerfile of dovetail toolLeo Wang1-0/+22
JIRA:DOVETAIL-13 - add dockerfile Change-Id: I82d74013fef9b9203b531a1ba944e014d77a25cd Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-08-09Proposing a Dovetail test suite structure for IPv6ChristopherPrice7-0/+274
Adding the first draft of the IPv6 test suite. This patch attempts to start the documentation according to the proposal on https://wiki.opnfv.org/pages/viewpage.action?pageId=6827269 The text is neither complete nor accurate at this stage, this patch is intended to establish a concrete dialog for how we structure our test suites and reference test cases. Change-Id: I156ddafa3e8b7630390523864490426fc742eb3a Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2016-07-14project document reorganizationMatthewLi17-0/+42
JIRA: DOVETAIL-7 Change-Id: Ic17a05ea15858f6f93f112f26b532339f5904178 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-03-07Remove trailing spacesDave Neary1-3/+3