summaryrefslogtreecommitdiffstats
path: root/docs/testing/user
AgeCommit message (Collapse)AuthorFilesLines
2017-09-15Clearer structuring current and future test scope of CVP addendumGeorg Kunz1-101/+128
This patchset attempts to more clearly structure the outcome of the scope analysis by having dedicated "in scope" and "future scope" sections Change-Id: I6a42a8ac4495fa4e2e5e773a7f594704d9cc1e28 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-08Merge "add more information for the Identity testcases in the refstack"hongbo tian1-8/+148
2017-09-08Merge "Doc: update user guide due to add new test cases and features"hongbo tian1-27/+118
2017-09-07Merge "Add test area 'forwarding packets through virtual networks in data path'"hongbo tian1-0/+145
2017-09-07Merge "Test case specification for VIM Network"hongbo tian1-17/+324
2017-09-06Doc: update user guide due to add new test cases and featuresxudan1-27/+118
There has been added some new test cases and features, so user guide should be updated according to the latest dovetail version. - Add introduction about https (with cacert and without cacert) - Add introduction about adding hosts' info - Add introduction about downloading cirros images - Add introduction about special configurations for running defcore and tempest test cases - Add introduction about how to check defcore and tempest failed test cases JIRA: DOVETAIL-493 Change-Id: I13aca4ee433056bd21590743a412d5d95f45fec4 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Add test area 'forwarding packets through virtual networks in data path'xudan1-0/+145
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'forwarding packets through virtual networks in data path'. Add the test specification about this test area. Change-Id: I26416ecca6b89a94cf48ba0f55308df0fa6e1677 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Add test area 'simple virtual machine resource scheduling on multiple nodes'xudan1-0/+370
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'simple virtual machine resource scheduling on multiple nodes'. Add the test specification about this test area. Change-Id: I7a5ff426442424dbc364a68296facb0bac6401ca Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Merge "Add test area 'correct behavior after common virtual machine life ↵hongbo tian1-0/+757
cycles events'"
2017-09-06Merge "Test case specification for VIM Image"hongbo tian1-17/+375
2017-09-05Add test area 'correct behavior after common virtual machine life cycles events'xudan1-0/+757
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'correct behavior after common virtual machine life cycles events'. Add the test specification about this test area. Change-Id: I051b3c5b501ed833a613ea6a6601125c4fa80c3e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Merge "Add test area 'dynamic network runtime operations'"hongbo tian1-0/+413
2017-09-04Merge "Test case specification for VIM Compute"hongbo tian1-36/+625
2017-09-01Merge "Test case specification for VIM Volume"hongbo tian1-44/+955
2017-09-01Add test area 'dynamic network runtime operations'xudan1-0/+413
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'dynamic network runtime operations through the life of a VNF'. Add the test specification about this test area. Change-Id: I59706bc4a5765cf779a03fc3c493e5a8d184c1dc Signed-off-by: xudan <xudan16@huawei.com>
2017-09-01Merge "Add test area 'filtering packets based on security rules and port ↵hongbo tian1-0/+450
security'"
2017-08-31Test case specification for VIM Computexudan1-36/+625
1. Add the alias VIM Compute test cases into testscope. 2. Add test case specification for VIM Compute. Change-Id: Icca09a58221511f607e43eb1d0415d9de4e452eb Signed-off-by: xudan <xudan16@huawei.com>
2017-08-25Added top-down scope analysis based on cvp objectives and end-user ↵Trevor Cooper1-0/+388
expectations. Also simplified to focus on scope only. Change-Id: Ibde9fdacfd026f7859bd6fd239d79fdbdeccad01 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-25Merge "Draft a workflow that will work with the CVP web portal and test API. ↵hongbo tian2-0/+132
Also made simplifications for the first release."
2017-08-18Draft a workflow that will work with the CVP web portal and test API. Also ↵Trevor Cooper2-0/+132
made simplifications for the first release. Change-Id: Ief92a7e71c546883fdf472346646a43c9ae26c94 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-18Test case specification for VIM Volumexudan1-44/+955
1. Add the alias VIM Volume test cases into testscope. 2. Add test case specification for VIM Volume. Change-Id: I715a69aad380466659365cc554351efb4d6eb053 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Test case specification for VIM Networkxudan1-17/+324
1. Add the alias VIM Network test cases into testscope. 2. Add test case specification for VIM Network. Change-Id: I133ad13b1f926e0093d92a9a39d88947648122ea Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Tag dovetail with cvp.0.5.0xudan1-12/+12
JIRA: DOVETAIL-483 1. docker image used yardstick: danube.3.2 functest: cvp.0.5.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.5.0 dovetail: cvp.0.5.0 2. main changes Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd Signed-off-by: xudan <xudan16@huawei.com>
2017-08-14Add test area 'filtering packets based on security rules and port security'xudan1-0/+450
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'filtering packets based on security rules and port security in data path'. Add the test specification about this test area. Change-Id: I814204f16b79bc06d9bfb54d5a90692d8b8c7bfa Signed-off-by: xudan <xudan16@huawei.com>
2017-08-10Test case specification for VIM Imagehongbotian1-17/+375
1. Adding the alias VIM image test cases into testscope. 2. Adding test case specification for VIM Image. Change-Id: Ifa7aa5ddea22d2862ee5d8ad465523d450a78fde Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-08-04Merge "add user guide for results operations on web"hongbo tian1-1/+32
2017-08-04Tag dovetail with cvp.0.4.0xudan1-7/+10
JIRA: DOVETAIL-476 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.4.0 dovetail: cvp.0.4.0 2. main changes Add docs about vping test cases (test scope and test specification) Add 2 vping test cases into proposed_tests Bugfix: Build docker image failed because of lacking of packages Add resiliency.tc001 into proposed_tests 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: I5ce6bdc9a1daa957124309c9fadc532f9c7a2b1e Signed-off-by: xudan <xudan16@huawei.com>
2017-08-04add user guide for results operations on webgrakiss1-1/+32
JIRA: dovetail-471 User can access results through the web page browser the public results uploaded by others or himself upload the results, and set this results as public or private to others Change-Id: I9834a670f5dff6412a0290d9a5dd729bcece2933 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-02Merge "WIP: Test case description for vping test cases"hongbo tian1-0/+279
2017-07-28WIP: Test case description for vping test casesGeorg Kunz1-0/+279
Adding test case descriptions for both vping test cases implemented in Functest. Test case 1 makes use of the config drive mechanism of Nova to pass a test script. Test case 2 uses SSH to transfer and execute a script on one VM. Change-Id: Ic8be6ad4dfd4b0e7661064506b0ae92db2fc1463 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-07-21Tag dovetail with cvp.0.3.0xudan2-10/+9
JIRA: DOVETAIL-468 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 testapi: cvp.0.3.0 dovetail: cvp.0.3.0 2. main changes fix dovetail docker version to be 17.03.0-ce adapt yardstick danube.3.1 For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f Signed-off-by: xudan <xudan16@huawei.com>
2017-07-21Merge "Draft dovetail user guide first cut"Leo wang3-472/+498
2017-07-12Update the IPv6 for the remain commentshongbotian1-110/+121
JIRA: DOVETAIL-461 1. Lincoln’s comments about tc018-tc021: change “using DHCPv6” to “using DHCPv6 stateless” 2. Update tc018-tc025: give more details and modify some misunderstanding about these test cases. For more detail, please refer to jira or this patch. Change-Id: Ieb7ee9d0b8a31826c7f2f69cb5f209055fd7b928 Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-07-06Draft dovetail user guide first cutWenjing Chu3-472/+498
Fixing comment issues and updating to new version of dovetail. Change-Id: Iaa9243d0a835f1d050fb925fa75b2a770168a8f4 Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-06-25delete old ipv6 filesMatthewLi8-608/+0
JIRA: DOVETAIL-452 since https://gerrit.opnfv.org/gerrit/#/c/34577/ merged new ipv6 C&C documents are there, delete the old ones. Change-Id: Ic16cf03b3febd7cca158555e11ecd817ffc61139 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-24Merge "HA testcases"hongbo tian1-0/+743
2017-06-22HA testcasesfuqiao1-0/+743
Modify HA testcases.rst file to include detail discribtion of the 8 testcases. Rename the original rst file into HA testcases outline.rst. Please review and see if you need two of these file, or you prefer a single one, or maybe merge these two. as discussed,propose 8 HA testcases for mandatory test cases. JIRA: Change-Id: Ie6cd5a68897bb0208932d2e1fec65cc59bfa25b4 Signed-off-by: fuqiao@chinamobile.com
2017-06-09IPv6 Test CasesBin Hu1-0/+1776
Change-Id: Icdb2786076aa6a263449eca5db4a07d14f1e2adf Signed-off-by: Bin Hu <bh526r@att.com>
2017-06-05Adding SDNVPN test cases to the Optional Test areas of the CVP.Georg Kunz1-31/+456
Included the tests for SDNVPN in the docetail scope document Performed spell checking of the committed test area document and included the section around test suite structure. This patch should be reviewed and approved by the SDNVPN team prior to being merged. Change-Id: Ia2f9a1bddb02b9191da1239a73f121dce6687af1 Co-Authored-By: Georg Kunz <georg.kunz@ericsson.com> Co-Authored-By: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-05-23add more information for the Identity testcases in the refstackhongbotian1-8/+148
JIRA: DOVETAIL-431 in order to show more details of the test cases, all below information are added: the Use case specification, Test preconditions, Basic test flow execution description, pass/fail criteria, and Post conditions Change-Id: Id1886be6a868813f2cff6cacf42329494e94308c Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-05-05Merge "Uploading the initial draft of the first VPN test case "hongbo tian2-5/+132
2017-05-02xipv6 testcase adjustmentMatthewLi2-7/+4
JIRA: DOVETAIL-418 1) ipv6 tc002-tc005 error fix, delete wrong testcases 2) ipv6 tc018-tc025 os-nosdn-nofeature scenario dependent, make it known to the users Change-Id: I8e63131b795403ee63566ae59bf46782524acd5a Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-02Uploading the initial draft of the first VPN test case ChristopherPrice2-5/+132
This should be considered in the danube CVP phase as an optional test area for OPNFV compliance Change-Id: I99494cf2246e1cf079b87414ef1bb34d9b26e6b3 Co-Authored-By: Tim Irnich <tim.irnich@ericsson.com> Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-04-27Setting the document directory structure according to the Plugfest outcome.ChristopherPrice18-13/+955
Implemented a directory and file structure that supports the requirements defined in the plugfest etherpad: https://etherpad.opnfv.org/p/cvp_tooling_sketch Change-Id: Icb7d2db4b0132f2039c680883e173ff5d7fc0120 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-04-27Adding a stub document for a CVP reviewer guideGeorg Kunz1-0/+35
This document shall describe guidelines and evaluation criteria for reviewers on how to handle the review process of results. DOVETAIL-408 Change-Id: I78e669544bc172b74f94443176a48082a4c28a2f Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-04-26JIRA: DOVETAIL-352 Updating the test specification document with iterative ↵ChristopherPrice4-48/+632
inprovements. JIRA tasks are being created for specific sections of the document. Refer to the doc for links to relevant JIRA tasks. Change-Id: I1717d56b8817c38802a227db320f30029f68fbd0 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>
2017-03-29Draft one of the test specification.ChristopherPrice2-0/+367
JIRA: DOVETAIL-352 Needs a lot more work, but the directory tree and layout are according to our needs in order to have this published as a CVP document. Will push patches to restructure the repo according to the new requirements later. Change-Id: I9d4316407c94bc3096d322f6206eccf236d349da Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>