summaryrefslogtreecommitdiffstats
path: root/docs/testing
AgeCommit message (Collapse)AuthorFilesLines
2017-09-13Replacing references to "DefCore"Georg Kunz6-27/+19
This patch removes all references to the outdated term "DefCore" in the Dovetail documentation. The DefCore working group has been renamed OpenStack InterOp Working Group some time ago. This patch also proposes renaming the "defcore" test area to "osinterop". JIRA: DOVETAIL-499 Change-Id: I7bb2ca33cb1eaf17c3ca0fc79a4f923e5886ece4 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-11Merge "Clarify criteria for testcase inclusion as running in Functest/CI And ↵hongbo tian1-16/+32
additional clarifications."
2017-09-08Merge "add more information for the Identity testcases in the refstack"hongbo tian1-8/+148
2017-09-08Merge "Doc: update user guide due to add new test cases and features"hongbo tian1-27/+118
2017-09-07Merge "Add test area 'forwarding packets through virtual networks in data path'"hongbo tian2-0/+151
2017-09-07Merge "Test case specification for VIM Network"hongbo tian2-18/+343
2017-09-06Doc: update user guide due to add new test cases and featuresxudan1-27/+118
There has been added some new test cases and features, so user guide should be updated according to the latest dovetail version. - Add introduction about https (with cacert and without cacert) - Add introduction about adding hosts' info - Add introduction about downloading cirros images - Add introduction about special configurations for running defcore and tempest test cases - Add introduction about how to check defcore and tempest failed test cases JIRA: DOVETAIL-493 Change-Id: I13aca4ee433056bd21590743a412d5d95f45fec4 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Add test area 'forwarding packets through virtual networks in data path'xudan2-0/+151
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'forwarding packets through virtual networks in data path'. Add the test specification about this test area. Change-Id: I26416ecca6b89a94cf48ba0f55308df0fa6e1677 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Add test area 'simple virtual machine resource scheduling on multiple nodes'xudan2-0/+381
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'simple virtual machine resource scheduling on multiple nodes'. Add the test specification about this test area. Change-Id: I7a5ff426442424dbc364a68296facb0bac6401ca Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Merge "Add test area 'correct behavior after common virtual machine life ↵hongbo tian2-0/+775
cycles events'"
2017-09-06Merge "Test case specification for VIM Image"hongbo tian2-17/+386
2017-09-05Add test area 'correct behavior after common virtual machine life cycles events'xudan2-0/+775
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'correct behavior after common virtual machine life cycles events'. Add the test specification about this test area. Change-Id: I051b3c5b501ed833a613ea6a6601125c4fa80c3e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Merge "Add test area 'dynamic network runtime operations'"hongbo tian2-0/+422
2017-09-04Merge "Test case specification for VIM Compute"hongbo tian2-36/+627
2017-09-01Merge "Test case specification for VIM Volume"hongbo tian2-44/+1018
2017-09-01Add test area 'dynamic network runtime operations'xudan2-0/+422
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'dynamic network runtime operations through the life of a VNF'. Add the test specification about this test area. Change-Id: I59706bc4a5765cf779a03fc3c493e5a8d184c1dc Signed-off-by: xudan <xudan16@huawei.com>
2017-09-01Merge "Add test area 'filtering packets based on security rules and port ↵hongbo tian2-0/+461
security'"
2017-08-31Test case specification for VIM Computexudan2-36/+627
1. Add the alias VIM Compute test cases into testscope. 2. Add test case specification for VIM Compute. Change-Id: Icca09a58221511f607e43eb1d0415d9de4e452eb Signed-off-by: xudan <xudan16@huawei.com>
2017-08-25Added top-down scope analysis based on cvp objectives and end-user ↵Trevor Cooper1-0/+388
expectations. Also simplified to focus on scope only. Change-Id: Ibde9fdacfd026f7859bd6fd239d79fdbdeccad01 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-25Merge "Draft a workflow that will work with the CVP web portal and test API. ↵hongbo tian2-0/+132
Also made simplifications for the first release."
2017-08-22Clarify criteria for testcase inclusion as running in Functest/CIBryan Sullivan1-16/+32
And additional clarifications. JIRA: DOVETAIL-477 Replace tabs. Further clarify testing programs and optionality criteria. Change-Id: I8eebdf215fb7cc75a6da9748629b1a73d0b71d19 Signed-off-by: Bryan Sullivan <bryan.sullivan@att.com>
2017-08-18Draft a workflow that will work with the CVP web portal and test API. Also ↵Trevor Cooper2-0/+132
made simplifications for the first release. Change-Id: Ief92a7e71c546883fdf472346646a43c9ae26c94 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-18Test case specification for VIM Volumexudan2-44/+1018
1. Add the alias VIM Volume test cases into testscope. 2. Add test case specification for VIM Volume. Change-Id: I715a69aad380466659365cc554351efb4d6eb053 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Test case specification for VIM Networkxudan2-18/+343
1. Add the alias VIM Network test cases into testscope. 2. Add test case specification for VIM Network. Change-Id: I133ad13b1f926e0093d92a9a39d88947648122ea Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Tag dovetail with cvp.0.5.0xudan1-12/+12
JIRA: DOVETAIL-483 1. docker image used yardstick: danube.3.2 functest: cvp.0.5.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.5.0 dovetail: cvp.0.5.0 2. main changes Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd Signed-off-by: xudan <xudan16@huawei.com>
2017-08-14Add test area 'filtering packets based on security rules and port security'xudan2-0/+461
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'filtering packets based on security rules and port security in data path'. Add the test specification about this test area. Change-Id: I814204f16b79bc06d9bfb54d5a90692d8b8c7bfa Signed-off-by: xudan <xudan16@huawei.com>
2017-08-10Test case specification for VIM Imagehongbotian2-17/+386
1. Adding the alias VIM image test cases into testscope. 2. Adding test case specification for VIM Image. Change-Id: Ifa7aa5ddea22d2862ee5d8ad465523d450a78fde Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-08-04Merge "add user guide for results operations on web"hongbo tian1-1/+32
2017-08-04Tag dovetail with cvp.0.4.0xudan1-7/+10
JIRA: DOVETAIL-476 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.4.0 dovetail: cvp.0.4.0 2. main changes Add docs about vping test cases (test scope and test specification) Add 2 vping test cases into proposed_tests Bugfix: Build docker image failed because of lacking of packages Add resiliency.tc001 into proposed_tests 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: I5ce6bdc9a1daa957124309c9fadc532f9c7a2b1e Signed-off-by: xudan <xudan16@huawei.com>
2017-08-04add user guide for results operations on webgrakiss1-1/+32
JIRA: dovetail-471 User can access results through the web page browser the public results uploaded by others or himself upload the results, and set this results as public or private to others Change-Id: I9834a670f5dff6412a0290d9a5dd729bcece2933 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-02Merge "WIP: Test case description for vping test cases"hongbo tian2-0/+287
2017-07-28WIP: Test case description for vping test casesGeorg Kunz2-0/+287
Adding test case descriptions for both vping test cases implemented in Functest. Test case 1 makes use of the config drive mechanism of Nova to pass a test script. Test case 2 uses SSH to transfer and execute a script on one VM. Change-Id: Ic8be6ad4dfd4b0e7661064506b0ae92db2fc1463 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-07-21Tag dovetail with cvp.0.3.0xudan2-10/+9
JIRA: DOVETAIL-468 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 testapi: cvp.0.3.0 dovetail: cvp.0.3.0 2. main changes fix dovetail docker version to be 17.03.0-ce adapt yardstick danube.3.1 For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f Signed-off-by: xudan <xudan16@huawei.com>
2017-07-21Merge "Draft dovetail user guide first cut"Leo wang3-472/+498
2017-07-12Update the IPv6 for the remain commentshongbotian1-110/+121
JIRA: DOVETAIL-461 1. Lincoln’s comments about tc018-tc021: change “using DHCPv6” to “using DHCPv6 stateless” 2. Update tc018-tc025: give more details and modify some misunderstanding about these test cases. For more detail, please refer to jira or this patch. Change-Id: Ieb7ee9d0b8a31826c7f2f69cb5f209055fd7b928 Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-07-06Draft dovetail user guide first cutWenjing Chu3-472/+498
Fixing comment issues and updating to new version of dovetail. Change-Id: Iaa9243d0a835f1d050fb925fa75b2a770168a8f4 Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-06-25delete old ipv6 filesMatthewLi8-608/+0
JIRA: DOVETAIL-452 since https://gerrit.opnfv.org/gerrit/#/c/34577/ merged new ipv6 C&C documents are there, delete the old ones. Change-Id: Ic16cf03b3febd7cca158555e11ecd817ffc61139 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-24Merge "HA testcases"hongbo tian2-0/+760
2017-06-22HA testcasesfuqiao2-0/+760
Modify HA testcases.rst file to include detail discribtion of the 8 testcases. Rename the original rst file into HA testcases outline.rst. Please review and see if you need two of these file, or you prefer a single one, or maybe merge these two. as discussed,propose 8 HA testcases for mandatory test cases. JIRA: Change-Id: Ie6cd5a68897bb0208932d2e1fec65cc59bfa25b4 Signed-off-by: fuqiao@chinamobile.com
2017-06-09IPv6 Test CasesBin Hu2-1/+1910
Change-Id: Icdb2786076aa6a263449eca5db4a07d14f1e2adf Signed-off-by: Bin Hu <bh526r@att.com>
2017-06-05Adding SDNVPN test cases to the Optional Test areas of the CVP.Georg Kunz2-238/+702
Included the tests for SDNVPN in the docetail scope document Performed spell checking of the committed test area document and included the section around test suite structure. This patch should be reviewed and approved by the SDNVPN team prior to being merged. Change-Id: Ia2f9a1bddb02b9191da1239a73f121dce6687af1 Co-Authored-By: Georg Kunz <georg.kunz@ericsson.com> Co-Authored-By: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-05-23add more information for the Identity testcases in the refstackhongbotian1-8/+148
JIRA: DOVETAIL-431 in order to show more details of the test cases, all below information are added: the Use case specification, Test preconditions, Basic test flow execution description, pass/fail criteria, and Post conditions Change-Id: Id1886be6a868813f2cff6cacf42329494e94308c Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-05-07Proposing to move "post conditions" as an optional topic for a test case.ChristopherPrice1-12/+2
It is not clear that there are post conditions to be documented for all test cases. In the case a test cse creates an image and deletes it, there is littöe need for a post condition to be documented. If a test case establishes a network to be used for a subsequent test ina sequence this information should be clearly dcumented. Change-Id: Ifb4bb45f240921c180077ab7273988d973417f6f Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-05-05Merge "Uploading the initial draft of the first VPN test case "hongbo tian2-5/+132
2017-05-04Merge "Drafting the first "refstack" version of the test scope document."hongbo tian1-0/+363
2017-05-03Drafting the first "refstack" version of the test scope document.Georg Kunz1-0/+363
To be aligned with the committers and agreed as the "foundation" list of test scope for moving forward with DoveTail test selection. Requires a majority of committer approvals prior to merging. Change-Id: I5fb091d2190a183d24ba9e766d19aba9e6a7c094 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-05-02xipv6 testcase adjustmentMatthewLi2-7/+4
JIRA: DOVETAIL-418 1) ipv6 tc002-tc005 error fix, delete wrong testcases 2) ipv6 tc018-tc025 os-nosdn-nofeature scenario dependent, make it known to the users Change-Id: I8e63131b795403ee63566ae59bf46782524acd5a Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-02Uploading the initial draft of the first VPN test case ChristopherPrice2-5/+132
This should be considered in the danube CVP phase as an optional test area for OPNFV compliance Change-Id: I99494cf2246e1cf079b87414ef1bb34d9b26e6b3 Co-Authored-By: Tim Irnich <tim.irnich@ericsson.com> Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-04-27Setting the document directory structure according to the Plugfest outcome.ChristopherPrice23-13/+1598
Implemented a directory and file structure that supports the requirements defined in the plugfest etherpad: https://etherpad.opnfv.org/p/cvp_tooling_sketch Change-Id: Icb7d2db4b0132f2039c680883e173ff5d7fc0120 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-04-27Adding a stub document for a CVP reviewer guideGeorg Kunz1-0/+35
This document shall describe guidelines and evaluation criteria for reviewers on how to handle the review process of results. DOVETAIL-408 Change-Id: I78e669544bc172b74f94443176a48082a4c28a2f Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>