summaryrefslogtreecommitdiffstats
path: root/docs/testing/user/testspecification
AgeCommit message (Collapse)AuthorFilesLines
2018-09-20Eliminating docs build warningGeorg Kunz1-8/+12
Eliminating a build warning from the Tempest volume description and aligning its layout with other test case descriptions. Change-Id: Idb9ba8d77ef3cb7e14a5b24a8a81622fa0e3e30d Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> (cherry picked from commit 4413f0693b34158af4a4fd86eca5762e42f232ed)
2018-09-18Adapting local docs build and remove build warningsGeorg Kunz7-34/+37
The OPNFV docs project will remove its submodules and enable local docs builds. This patch prepares the Dovetail repo according to the official transition guide: https://docs.opnfv.org/en/latest/how-to-use-docs/local-build-transition.html This patch also applies syntactical changes which eliminate the sphinx doc build warnings. Change-Id: Ief8fd2d1c3e39b232d214a9ab392879ee4a492c8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> (cherry picked from commit a18e2b0d45c631709e457530f6f9d0b52f552156)
2018-09-17Align testcase formats and complete volume testcase descriptions.louie.long1-12/+80
Change-Id: Ie7497f6e5ef79726d8cbbcd9f05bffa2aac6c8b8 Signed-off-by: louie.long <longyu805@163.com> (cherry picked from commit 60f1c35c294d5d94a862db348315f8f3b9f870ba)
2018-09-05Remove identity v2 TCs,not supported by FunctestPanagiotis Karalis2-57/+0
As Functest does not support identity v2 anymore, it does not make sense to try to run tempest identity v2 tests. They need to be removed correspondingly. JIRA: DOVETAIL-735 Change-Id: I09c06faf52893cc535bbed1fd406b81a7665e787 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com> (cherry picked from commit c266472c9dea9f1a3d58e9a70f761d792ac798dd)
2018-08-27Shortening headings and testing building of docsGeorg Kunz1-3/+3
This patch shortens the headings and is used to test if the docs tool chain builds the right version. Change-Id: Ibc162be1b46ff787a90510c360881234391c5ba7 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> (cherry picked from commit 8e2c2b42dff66d9896bfc5a8da8ee86cb18e8cb8)
2018-08-14Test case descriptions for Tempest smoke testsdimitris.tsiolakis7-1/+506
Adding a high-level description of the Tempest smoke tests. As agreed on the last Dovetail call, we are aiming for a relatively low level of detail and instead point to available documentation. As the tests themselves are quite simple of read, this is the best, most concise, and up-to-date version of documentation we can find. JIRA: DOVETAIL-599 Change-Id: I985592c55fd415e254e70db6c6480c7bf3670a29 Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
2018-08-13Create a test case descriptions for Patrole RBAC testsxudan2-0/+307
JIRA: DOVETAIL-682 Change-Id: I37bb5ea2ba5b68407541e3e9d90d760e1720d3e7 Signed-off-by: xudan <xudan16@huawei.com>
2018-08-13Test case description for Yardstick HA caseMika Rautakumpu1-12/+91
This is test case description for HA test neutron-l3-agent. Yardstick TC058. JIRA: DOVETAIL-637 Change-Id: I90e0225e6f086982da9f6ea686fbc8c179f45984 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-08-09Test case descriptions for SNAPS smoke testsdimitris.tsiolakis2-0/+233
Adding a high-level description of the SNAPS smoke tests. As agreed on the last Dovetail call, we are aiming for a relatively low level of detail and instead point to available documentation. As the tests themselves are quite simple of read, this is the best, most concise, and up-to-date version of documentation we can find. JIRA: DOVETAIL-630 Change-Id: I38b072e29ec4cfe50baf0ac3350ea1a1d3e8d67a Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
2018-08-02Test case descriptions for Neutron Trunk Port testsGeorg Kunz1-0/+157
Adding a high-level description of the Neutron trunk port tempest tests. As agreed on the last Dovetail call, we are aiming for a relatively low level of detail and instead point to available documentation. As the tempest tests themselves are quite simple of read, this is the best, most concise, and up-to-date version of documentation we can find. JIRA: DOVETAIL-684 Change-Id: I76801b34f974bf7c77fded3ffa5588b7e5b2803c Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-01First test case description for HA testsMika Rautakumpu1-1/+101
This is one of three test case descriptions from jira ticket. Test case description is TC010 it is TC056 in yardstick. JIRA: DOVETAIL-605 Change-Id: I70afa882a667a6932aa7ec29bc5e0621b43fa0a4 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-07-27Create a test specification for vIMS test casePanagiotis Karalis1-3/+80
New test specification has been created for dovetail project. Test descriptions is related to cloudify_ims test case of functest project. JIRA: DOVETAIL-699 Change-Id: I033351ad7cf83256bd7a9e208a7ce406d5a4cd2b Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-18Create test case descriptions for Bottlenecks stress testxudan2-0/+160
This is coming from the former patch https://gerrit.opnfv.org/gerrit/#/c/37715/ JIRA: DOVETAIL-631 Change-Id: Ibe090fefaa92cb3fe6d7c3d96296724e8cfbcf1d Signed-off-by: xudan <xudan16@huawei.com>
2018-07-17Create a test specification for vEPC test casePanagiotis Karalis2-0/+150
New test specification has been created for dovetail project. Test descriptions is related to vEPC test case. JIRA: DOVETAIL-679 Change-Id: I72228f7f59a4aa704a620351ad8727c1b948dc66 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-16Test case description for BGPVPN Tempest API testsGeorg Kunz1-0/+196
Adding test case descriptions for the BGPVPN API tests which are implemented as Tempest plugin in the networking-bgpvpn repository. These tests have already been integrated for Euphrates into Functest test and are hence a candidate for inclusion in the test scope of the OVP Euphrates release as extension of the existing SDNVPN test cases. JIRA: DOVETAIL-598 Change-Id: Id8578ed1e198ddbde967793737c69a5940c22475 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-07-09New test specs for ha database/controller_restartPanagiotis Karalis1-0/+150
New test specifications have been created for dovetail project. Test descriptions are related to test cases: - dovetail.ha.database - dovetail.ha.controller_restart JIRA: DOVETAIL-680 JIRA: DOVETAIL-681 Change-Id: I632cb69f9166a46e76f38a467f078fe5f31b63b3 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-04Update all existing test specificationsxudan19-1287/+1224
1. Update the names of 2 vping test cases 2. Update the names of 8 ha test cases 3. Update the sub test cases within osinterop 2017.09 4. Split IPv6 into ipv6_api and ipv6_scenario 5. Update the names of sdnvpn test cases 6. Update the names of 4 tempest scenario test cases 7. Remove forwardingpackets JIRA: DOVETAIL-685 Change-Id: I0d91b8a0477576e18581eb2788fdb666063c89b7 Signed-off-by: xudan <xudan16@huawei.com>
2018-01-15Changing CVP to OVP in the documentationGeorg Kunz11-15/+15
Due to the name change from 'CVP' to 'OVP', the documentation has to be updated. Change-Id: Id934e8fc07f60802f7aa6b3d295d268c4c9b71f8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-12-13Remove all alias tempest test cases in osinterop test specificaion docsxudan5-211/+8
1. Some tempest test cases have alias test cases because of the different versions of tempest. 2. However, Dovetail fixes the version of tempest to be 14.0.0 in its first release. So the number of test cases that can be executed in osinterop is always 205. And for different SUTs, the 205 test cases are all the same. 3. In this situation, there is no need to list the alias test cases. 4. Just list all the 205 test cases which will not confuse users when they reading dovetail docs. JIRA: DOVETAIL-566 Change-Id: I5e39dd82314833c8c0a6c1732c990f671ae64420 Signed-off-by: xudan <xudan16@huawei.com>
2017-11-28Remove one sub test case from dovetail.tempest.tc004xudan1-61/+10
1. Currently, dovetail.tempest.tc004 has 13 sub test cases defined in its config file and specification document of the test case. All these sub test cases are picked from tempest based on it's version 15.0.0. 2. For Dovetail 1st release, it fixes the version of Functest to be opnfv/dovetail:cvp.0.5.0, and Functest integretes tempest 14.0.0 in this version and it's E release. 3. There is one sub test case in dovetail.tempest.tc004 that is new in tempest 15.0.0, so it can not be recognized and executed by Functest D and E release. It is 'test_server_connectivity_cold_migration_revert'. 4. Remove this sub test case from dovetail.tempest.tc004. This means remove it from the test case config file and specification document. JIRA: DOVETAIL-561 Change-Id: Ia927af040794c7027a741a282ed75fe401f99ff1 Signed-off-by: xudan <xudan16@huawei.com>
2017-11-01Add test case name into tempest testspecification docsxudan15-43/+78
1. All test cases' testspecification docs have no info about test case names. 2. User don't know which test case to run when they just want to run one special test case. 3. Add the info into testspecification docs. JIRA: DOVETAIL-530 Change-Id: I0ebe1b3b98be5609503814ea2a0cf71aefd06d35 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-23Fixing references and layout in the docsGeorg Kunz1-1/+1
This patchset introduces labels for documentation-internal references and replaces footnote-style citations with inline hyperlinks. Additional minor changes for a nicer rendering of bullet lists. JIRA: DOVETAIL-521 Change-Id: Ic847fc05d546d673dadc7b8efee86fcb688133f5 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-10-18Updating test case requirements documentGeorg Kunz1-12/+17
This patchset addresses review comments which were not incorporated in the previous version of the test case requirements description. Additionally, the text has been wrapped to 80 character lines. Change-Id: If817f6c44d94870d915791a1a11916ffe4871f06 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-13Replacing references to "DefCore"Georg Kunz5-17/+10
This patch removes all references to the outdated term "DefCore" in the Dovetail documentation. The DefCore working group has been renamed OpenStack InterOp Working Group some time ago. This patch also proposes renaming the "defcore" test area to "osinterop". JIRA: DOVETAIL-499 Change-Id: I7bb2ca33cb1eaf17c3ca0fc79a4f923e5886ece4 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-08Merge "add more information for the Identity testcases in the refstack"hongbo tian1-8/+148
2017-09-07Merge "Add test area 'forwarding packets through virtual networks in data path'"hongbo tian1-0/+145
2017-09-07Merge "Test case specification for VIM Network"hongbo tian1-17/+324
2017-09-06Add test area 'forwarding packets through virtual networks in data path'xudan1-0/+145
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'forwarding packets through virtual networks in data path'. Add the test specification about this test area. Change-Id: I26416ecca6b89a94cf48ba0f55308df0fa6e1677 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Add test area 'simple virtual machine resource scheduling on multiple nodes'xudan1-0/+370
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'simple virtual machine resource scheduling on multiple nodes'. Add the test specification about this test area. Change-Id: I7a5ff426442424dbc364a68296facb0bac6401ca Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Merge "Add test area 'correct behavior after common virtual machine life ↵hongbo tian1-0/+757
cycles events'"
2017-09-06Merge "Test case specification for VIM Image"hongbo tian1-17/+375
2017-09-05Add test area 'correct behavior after common virtual machine life cycles events'xudan1-0/+757
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'correct behavior after common virtual machine life cycles events'. Add the test specification about this test area. Change-Id: I051b3c5b501ed833a613ea6a6601125c4fa80c3e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Merge "Add test area 'dynamic network runtime operations'"hongbo tian1-0/+413
2017-09-04Merge "Test case specification for VIM Compute"hongbo tian1-36/+625
2017-09-01Merge "Test case specification for VIM Volume"hongbo tian1-44/+955
2017-09-01Add test area 'dynamic network runtime operations'xudan1-0/+413
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'dynamic network runtime operations through the life of a VNF'. Add the test specification about this test area. Change-Id: I59706bc4a5765cf779a03fc3c493e5a8d184c1dc Signed-off-by: xudan <xudan16@huawei.com>
2017-08-31Test case specification for VIM Computexudan1-36/+625
1. Add the alias VIM Compute test cases into testscope. 2. Add test case specification for VIM Compute. Change-Id: Icca09a58221511f607e43eb1d0415d9de4e452eb Signed-off-by: xudan <xudan16@huawei.com>
2017-08-18Test case specification for VIM Volumexudan1-44/+955
1. Add the alias VIM Volume test cases into testscope. 2. Add test case specification for VIM Volume. Change-Id: I715a69aad380466659365cc554351efb4d6eb053 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Test case specification for VIM Networkxudan1-17/+324
1. Add the alias VIM Network test cases into testscope. 2. Add test case specification for VIM Network. Change-Id: I133ad13b1f926e0093d92a9a39d88947648122ea Signed-off-by: xudan <xudan16@huawei.com>
2017-08-14Add test area 'filtering packets based on security rules and port security'xudan1-0/+450
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'filtering packets based on security rules and port security in data path'. Add the test specification about this test area. Change-Id: I814204f16b79bc06d9bfb54d5a90692d8b8c7bfa Signed-off-by: xudan <xudan16@huawei.com>
2017-08-10Test case specification for VIM Imagehongbotian1-17/+375
1. Adding the alias VIM image test cases into testscope. 2. Adding test case specification for VIM Image. Change-Id: Ifa7aa5ddea22d2862ee5d8ad465523d450a78fde Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-08-02Merge "WIP: Test case description for vping test cases"hongbo tian1-0/+279
2017-07-28WIP: Test case description for vping test casesGeorg Kunz1-0/+279
Adding test case descriptions for both vping test cases implemented in Functest. Test case 1 makes use of the config drive mechanism of Nova to pass a test script. Test case 2 uses SSH to transfer and execute a script on one VM. Change-Id: Ic8be6ad4dfd4b0e7661064506b0ae92db2fc1463 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-07-12Update the IPv6 for the remain commentshongbotian1-110/+121
JIRA: DOVETAIL-461 1. Lincoln’s comments about tc018-tc021: change “using DHCPv6” to “using DHCPv6 stateless” 2. Update tc018-tc025: give more details and modify some misunderstanding about these test cases. For more detail, please refer to jira or this patch. Change-Id: Ieb7ee9d0b8a31826c7f2f69cb5f209055fd7b928 Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-06-25delete old ipv6 filesMatthewLi8-608/+0
JIRA: DOVETAIL-452 since https://gerrit.opnfv.org/gerrit/#/c/34577/ merged new ipv6 C&C documents are there, delete the old ones. Change-Id: Ic16cf03b3febd7cca158555e11ecd817ffc61139 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-24Merge "HA testcases"hongbo tian1-0/+743
2017-06-22HA testcasesfuqiao1-0/+743
Modify HA testcases.rst file to include detail discribtion of the 8 testcases. Rename the original rst file into HA testcases outline.rst. Please review and see if you need two of these file, or you prefer a single one, or maybe merge these two. as discussed,propose 8 HA testcases for mandatory test cases. JIRA: Change-Id: Ie6cd5a68897bb0208932d2e1fec65cc59bfa25b4 Signed-off-by: fuqiao@chinamobile.com
2017-06-09IPv6 Test CasesBin Hu1-0/+1776
Change-Id: Icdb2786076aa6a263449eca5db4a07d14f1e2adf Signed-off-by: Bin Hu <bh526r@att.com>
2017-06-05Adding SDNVPN test cases to the Optional Test areas of the CVP.Georg Kunz1-31/+456
Included the tests for SDNVPN in the docetail scope document Performed spell checking of the committed test area document and included the section around test suite structure. This patch should be reviewed and approved by the SDNVPN team prior to being merged. Change-Id: Ia2f9a1bddb02b9191da1239a73f121dce6687af1 Co-Authored-By: Georg Kunz <georg.kunz@ericsson.com> Co-Authored-By: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: ChristopherPrice <christopher.price@ericsson.com> Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-05-23add more information for the Identity testcases in the refstackhongbotian1-8/+148
JIRA: DOVETAIL-431 in order to show more details of the test cases, all below information are added: the Use case specification, Test preconditions, Basic test flow execution description, pass/fail criteria, and Post conditions Change-Id: Id1886be6a868813f2cff6cacf42329494e94308c Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>