summaryrefslogtreecommitdiffstats
path: root/docs/testing
AgeCommit message (Collapse)AuthorFilesLines
2018-08-14Update user guidexudan1-83/+73
JIRA: DOVETAIL-710 Change-Id: If6150e75202851e80b3b945743eca3362dba69c7 Signed-off-by: xudan <xudan16@huawei.com>
2018-08-13Create a test case descriptions for Patrole RBAC testsxudan2-0/+307
JIRA: DOVETAIL-682 Change-Id: I37bb5ea2ba5b68407541e3e9d90d760e1720d3e7 Signed-off-by: xudan <xudan16@huawei.com>
2018-08-13Test case description for Yardstick HA caseMika Rautakumpu1-12/+91
This is test case description for HA test neutron-l3-agent. Yardstick TC058. JIRA: DOVETAIL-637 Change-Id: I90e0225e6f086982da9f6ea686fbc8c179f45984 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-08-09Test case descriptions for SNAPS smoke testsdimitris.tsiolakis2-0/+233
Adding a high-level description of the SNAPS smoke tests. As agreed on the last Dovetail call, we are aiming for a relatively low level of detail and instead point to available documentation. As the tests themselves are quite simple of read, this is the best, most concise, and up-to-date version of documentation we can find. JIRA: DOVETAIL-630 Change-Id: I38b072e29ec4cfe50baf0ac3350ea1a1d3e8d67a Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
2018-08-02Test case descriptions for Neutron Trunk Port testsGeorg Kunz1-0/+157
Adding a high-level description of the Neutron trunk port tempest tests. As agreed on the last Dovetail call, we are aiming for a relatively low level of detail and instead point to available documentation. As the tempest tests themselves are quite simple of read, this is the best, most concise, and up-to-date version of documentation we can find. JIRA: DOVETAIL-684 Change-Id: I76801b34f974bf7c77fded3ffa5588b7e5b2803c Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-01First test case description for HA testsMika Rautakumpu1-1/+101
This is one of three test case descriptions from jira ticket. Test case description is TC010 it is TC056 in yardstick. JIRA: DOVETAIL-605 Change-Id: I70afa882a667a6932aa7ec29bc5e0621b43fa0a4 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-07-27Create a test specification for vIMS test casePanagiotis Karalis1-3/+80
New test specification has been created for dovetail project. Test descriptions is related to cloudify_ims test case of functest project. JIRA: DOVETAIL-699 Change-Id: I033351ad7cf83256bd7a9e208a7ce406d5a4cd2b Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-18Create test case descriptions for Bottlenecks stress testxudan2-0/+160
This is coming from the former patch https://gerrit.opnfv.org/gerrit/#/c/37715/ JIRA: DOVETAIL-631 Change-Id: Ibe090fefaa92cb3fe6d7c3d96296724e8cfbcf1d Signed-off-by: xudan <xudan16@huawei.com>
2018-07-17Create a test specification for vEPC test casePanagiotis Karalis2-0/+150
New test specification has been created for dovetail project. Test descriptions is related to vEPC test case. JIRA: DOVETAIL-679 Change-Id: I72228f7f59a4aa704a620351ad8727c1b948dc66 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-16Test case description for BGPVPN Tempest API testsGeorg Kunz1-0/+196
Adding test case descriptions for the BGPVPN API tests which are implemented as Tempest plugin in the networking-bgpvpn repository. These tests have already been integrated for Euphrates into Functest test and are hence a candidate for inclusion in the test scope of the OVP Euphrates release as extension of the existing SDNVPN test cases. JIRA: DOVETAIL-598 Change-Id: Id8578ed1e198ddbde967793737c69a5940c22475 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-07-12Enable OVP tests to run on a DPDK-enabled systemPanagiotis Karalis2-10/+40
DPDK-enabled NFVIs require support for hugepages which in turn is configured by means of extra_specs in flavors. Currently, Functest enables hugepage support if the name of the scenario contains the substring "ovs". Dovetail allows end users to run all tests on DPDK-enabled systems and the documentation has been updates accordingly. JIRA: DOVETAIL-665 Change-Id: If4898da168f8b4c69a045ef3b00b8a8862f29b0c Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-09New test specs for ha database/controller_restartPanagiotis Karalis1-0/+150
New test specifications have been created for dovetail project. Test descriptions are related to test cases: - dovetail.ha.database - dovetail.ha.controller_restart JIRA: DOVETAIL-680 JIRA: DOVETAIL-681 Change-Id: I632cb69f9166a46e76f38a467f078fe5f31b63b3 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-04Update all existing test specificationsxudan19-1287/+1224
1. Update the names of 2 vping test cases 2. Update the names of 8 ha test cases 3. Update the sub test cases within osinterop 2017.09 4. Split IPv6 into ipv6_api and ipv6_scenario 5. Update the names of sdnvpn test cases 6. Update the names of 4 tempest scenario test cases 7. Remove forwardingpackets JIRA: DOVETAIL-685 Change-Id: I0d91b8a0477576e18581eb2788fdb666063c89b7 Signed-off-by: xudan <xudan16@huawei.com>
2018-06-15Running BGPVPN Tempest tests as tempest_custom testGeorg Kunz1-1/+11
We need to disable one BGPVPN tempest test due to a bug in ODL. Since the SDNVPN test framework does not allow for disabling a single test case, we are switching to tempest_custom. Change-Id: Ifbd7c1dc5e799d6a6c774e08e9fc1a3b2294b47c Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-29Adding reference to EXTERNAL_NETWORK to user guideGeorg Kunz1-2/+5
Adding a reference to the EXTERNAL_NETWORK environment variable to the user guide so that users add this to their env_config.sh. This variable is required, among others, to overwrite the default external network in Yarstick. Change-Id: I50e609a8c6e20b1dd01c61d5d950ffba792e98fa Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-28Update user guidexudan1-139/+199
1. Remove python related content because python is installed in Dovetail image. 2. Remove DB related content because there is no need to launch local DB now. 3. Update the infomation of Docker images and VM images. Change-Id: I010d3341aef9f2c74713fc0fc087b361331109d1 Signed-off-by: xudan <xudan16@huawei.com>
2018-05-27Changing the link to the updated participation formGeorg Kunz1-1/+1
The participation form on docusign has changed due to incorporating additional fields for the API validation exemption. This patch updates the links in the documentation accordingly. Note: this patch should only me merged after the new form is online. Change-Id: I697fa13d9afe2797faba2bf0478bbf27820bca20 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-19Updating user guide with new ssh key config in pod.yamlGeorg Kunz1-4/+5
Dovetail does not copy the ssh key from pre_config to /root/.ssh anymore inside Yardstick but instead, we point the pod.yaml file directly to the key inside the pre_config directory. JIRA: DOVETAIL-655 Change-Id: I23156d8940194547363bcf9a5cc581aab0d5c640 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-11Adding documentation for API validation exemptionGeorg Kunz3-4/+29
Updating the user guide and OVP addendum to include references to the detailed document describing the API response validation exemption. JIRA: DOVETAIL-651 Change-Id: I4026f84f021704f0986b45680471e8fb711fc314 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-07Adding a tox environment for locally building docsGeorg Kunz1-1/+1
Run tox -edocs to locally build the Dovetail docs. This is quite useful because the default OPNFV docs preview build toolchain is broken for Dovetail. Change-Id: I0a55a701b96437a20aa09edc47bc3e49e32c0b87 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-04-06Fixed typos in the license headerrpaik1-1/+1
Change-Id: Ib2aae63dd7576a8458f068250e9b6dda8678a1fd Signed-off-by: rpaik <rpaik@linuxfoundation.org>
2018-03-29Integrate dovetail with ONAPMoshe1-0/+3
Change-Id: I6a1fa5f27df2f5127eb00156b3135dc79caf5e77 Issue-ID: DOVETAIL-629 Signed-off-by: Moshe <moshehoa@amdocs.com>
2018-03-20Exemption process for disabling strict API validationGeorg Kunz1-0/+183
This document describes an exemption process for disabling strict API response validation. JIRA: DOVETAIL-617 Change-Id: I690efdcae7dd15a6c0781a837a62677904836fca Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-03-06Separate valid docker tags for functest and yardstickGeorg Kunz1-3/+3
Specifying separate valid docker tags for functest and yardstick for input validation. DOVETAIL-592 Change-Id: I3365cdbd9ab521bf1368750c3f34b6863b3f7ec8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-02-01Update OVP workflow documentEddie Arrage2-50/+53
- Fix typos and word changes - Remove editor's note - Adopt rewording suggestions - Add back toc that was inadvertently deleted - Modify to reflect process used during beta and current OVP web portal usage - Remove reference to application form and use online participation form instead. Add new fields required in participation form Change-Id: Ia51b7674315467e01081015b3aa780ec03652ebd Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-01-24Modify title and references in guidelines addendum docEddie Arrage1-3/+3
- Add 2018.01 to title to match reviewer guide, release notes, etc. as this document may change per release - Modify link for Governance Guidelines to reflect ratified doc on opnfv.org domain Change-Id: Ifdaa287b2919c44d408aa0ddd0b164b8ca4f406d Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-01-24Remove a sub test case under dovetail.tempest.tc004Eddie Arrage1-118/+23
- Fixed vping, ha, sdnvpn test case names to match test specs - Removed aliases from VIM operations and matched test case name changes in patch https://gerrit.opnfv.org/gerrit/#/c/47691/4 - CVP to OVP name change - A test case was removed from tempest tc004 because of the Tempest version from 15 to 14. A reference to it was still in this doc. Change-Id: If2e07e15b48ae6bca5ac0e262aead784cd67cd0f Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-01-18Transfer Danube reviewer guidelines from wikiEddie Arrage16-8/+190
The reviewer guidelines will be created per release, where the CVP/Dovetail releases are aligned to OPNFV releases. The guidelines outlined in this initial document are for the Danube release. Updated reviewer guidelines - Updated to account for issue where mandatory total always shows 215 in current version of web portal; removed one diagram and amended another - First section title change and wording for test area results - Removed white space - Added SUT info section and diagrams - Modified reference to cvp.opnfv.org with verified.opnfv.org - Modified reference to cvp@opnfv.org with verified@opnfv.org - Modified diagram filenames to reflect program name change - Changed CVP references to OVP and Danube to 2018.01 - Remove TODO for granting marks and escalation - this info is in other docs Change-Id: I01fc568ce6713d3c60daf339a2630e56e8dbcfcb Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-01-15Changing CVP to OVP in the documentationGeorg Kunz21-503/+128
Due to the name change from 'CVP' to 'OVP', the documentation has to be updated. Change-Id: Id934e8fc07f60802f7aa6b3d295d268c4c9b71f8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-01-15Update test user guide to improve usabilityEddie Arrage1-222/+300
- Modify hosts.yaml syntax to match patch by Serena - Modify result file references for new timestamp patch by Georg - Revise online/offline diagrams for OVP name change - Add XCF GIMP source files for diagrams with layers for new elements - New changes for cvp.0.9.0 to ovp.1.0.0 - Remove reference to bottlenecks container for now - Modify section/heading structure - Incorporate comments: results.json vs. result files - Incorporate comments: online/offline install headings - Incorporate comments: remove IP from launch_db.sh - Incorporate comments: remove sudo for wget - Incorporate comments: pod.yaml for SUT HW info - Incorporate comments: test case to config file requirement - Incorporate comments: suggested changes to env_config.sh - Modify the sequence of the guide to reflect installation steps - Outline all required configuration files earlier in the guide - Highlight configuration file key entries and pitfalls - Improve requirements for pod.yaml file for HA - Improve online/offline install instructions - Call out Dovetail docker run command and explain options - Clarify when testapi and local db ports need to be changed - Explain the dovetail run --testsuite and --testarea arguments more clearly - Improve --report option and default result result behavior - Make CVP portal a separate section - Explain CVP portal workflow to reflect current state of interface - Update references to cvp.0.8.0 with cvp.0.9.0 Change-Id: I41857c1b07c211a95f19c99054ca414351c75c20 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2017-12-13Remove all alias tempest test cases in osinterop test specificaion docsxudan5-211/+8
1. Some tempest test cases have alias test cases because of the different versions of tempest. 2. However, Dovetail fixes the version of tempest to be 14.0.0 in its first release. So the number of test cases that can be executed in osinterop is always 205. And for different SUTs, the 205 test cases are all the same. 3. In this situation, there is no need to list the alias test cases. 4. Just list all the 205 test cases which will not confuse users when they reading dovetail docs. JIRA: DOVETAIL-566 Change-Id: I5e39dd82314833c8c0a6c1732c990f671ae64420 Signed-off-by: xudan <xudan16@huawei.com>
2017-11-28Remove one sub test case from dovetail.tempest.tc004xudan1-61/+10
1. Currently, dovetail.tempest.tc004 has 13 sub test cases defined in its config file and specification document of the test case. All these sub test cases are picked from tempest based on it's version 15.0.0. 2. For Dovetail 1st release, it fixes the version of Functest to be opnfv/dovetail:cvp.0.5.0, and Functest integretes tempest 14.0.0 in this version and it's E release. 3. There is one sub test case in dovetail.tempest.tc004 that is new in tempest 15.0.0, so it can not be recognized and executed by Functest D and E release. It is 'test_server_connectivity_cold_migration_revert'. 4. Remove this sub test case from dovetail.tempest.tc004. This means remove it from the test case config file and specification document. JIRA: DOVETAIL-561 Change-Id: Ia927af040794c7027a741a282ed75fe401f99ff1 Signed-off-by: xudan <xudan16@huawei.com>
2017-11-03Minor docs change to test docs integrationGeorg Kunz1-11/+0
This is minor patch which updates the documentation in the dovetail repo in order to test the toolchain integration in opnfvdocs. Change-Id: Id91c57d1a38cf02d8ed4653bc9eddb7081f025e7 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-11-02Modify reference to online modeEddie Arrage1-6/+7
Changed reference to online mode to refer to installation rather than uploading results from Test Host to CVP portal directly, as current text is misleading. Change-Id: I9439d340beabb76f04b7782243c050064753a8ec Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2017-11-01Add test case name into tempest testspecification docsxudan15-43/+78
1. All test cases' testspecification docs have no info about test case names. 2. User don't know which test case to run when they just want to run one special test case. 3. Add the info into testspecification docs. JIRA: DOVETAIL-530 Change-Id: I0ebe1b3b98be5609503814ea2a0cf71aefd06d35 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-25Remove obsolete developer documentsEddie Arrage5-643/+0
Some developer documents are now old and suggested to be removed. Change-Id: Ifa26a1535d57a560a0525eafa300ae087feb3191 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2017-10-24Tag dovetail with cvp.0.8.0xudan1-7/+7
JIRA: DOVETAIL-536 Change-Id: I7a947b1aa57728e6add1d0ca881a6a62a46c0913 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-24System preparation guideWenjing Chu1-66/+55
Change-Id: I4fc982d7037466b48424b7ce97d6207fbe44a09b Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-10-23Fixing references and layout in the docsGeorg Kunz7-81/+90
This patchset introduces labels for documentation-internal references and replaces footnote-style citations with inline hyperlinks. Additional minor changes for a nicer rendering of bullet lists. JIRA: DOVETAIL-521 Change-Id: Ic847fc05d546d673dadc7b8efee86fcb688133f5 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-10-23Add testsuite cvp.0.8.0 for Beta testsxudan1-11/+16
1. Now there is a testsuite proposed_tests for beta tests which may cause some confusions. 2. Copy all test cases to testsuite cvp.0.8.0 for beta testers to use. 3. Update userguide with testsuite cvp.0.8.0 JIRA: DOVETAIL-528 Change-Id: I35bc7dee6e07a9125a4c1991b0049f6e2d705cc5 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-18Updating test case requirements documentGeorg Kunz2-59/+104
This patchset addresses review comments which were not incorporated in the previous version of the test case requirements description. Additionally, the text has been wrapped to 80 character lines. Change-Id: If817f6c44d94870d915791a1a11916ffe4871f06 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-10-18Term refstack is mentioned in dovetail Testing User Guidexudan1-3/+1
Remove refstack.log from the userguide because the refstack.log has been renamed dovetail.osinterop.tc00X.log JIRA: DOVETAIL-519 Change-Id: Icd0bd82ef78437ab96201e58b93e0a6997f9618a Signed-off-by: xudan <xudan16@huawei.com>
2017-10-18Add dovetail tool CLI documentxudan3-1/+205
According to the wiki page, add the CLI document. https://wiki.opnfv.org/display/dovetail/Dovetail+Command+Line JIRA: DOVETAIL-509 Change-Id: I6a32446cd4c1bcad83465b1f2e12d5c1487e954e Signed-off-by: xudan <xudan16@huawei.com>
2017-10-09Merge "Cvp application form"Wenjing Chu2-3/+92
2017-10-05Cvp application formWenjing Chu2-3/+92
Change-Id: I4bb0cea49179c7171ce766c52814f765e05ce9f8 Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-09-29Update user guide with the local DB operationsxudan1-62/+85
If users want to store results or upload results to CVP web portal, they need to build local DB adn testapi service. Should add more introduction about the local DB and testapi in the user guide. JIRA: DOVETAIL-504 Change-Id: I6493169b54104af8d7207d28fad93afedeae0b1b Signed-off-by: xudan <xudan16@huawei.com>
2017-09-25Merge "Replacing references to "DefCore""hongbo tian6-27/+19
2017-09-15Clearer structuring current and future test scope of CVP addendumGeorg Kunz1-101/+128
This patchset attempts to more clearly structure the outcome of the scope analysis by having dedicated "in scope" and "future scope" sections Change-Id: I6a42a8ac4495fa4e2e5e773a7f594704d9cc1e28 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-13Replacing references to "DefCore"Georg Kunz6-27/+19
This patch removes all references to the outdated term "DefCore" in the Dovetail documentation. The DefCore working group has been renamed OpenStack InterOp Working Group some time ago. This patch also proposes renaming the "defcore" test area to "osinterop". JIRA: DOVETAIL-499 Change-Id: I7bb2ca33cb1eaf17c3ca0fc79a4f923e5886ece4 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-11Merge "Clarify criteria for testcase inclusion as running in Functest/CI And ↵hongbo tian1-16/+32
additional clarifications."