summaryrefslogtreecommitdiffstats
path: root/docs/testing/user/userguide
AgeCommit message (Collapse)AuthorFilesLines
2019-12-09Update user guide including testing, api, cli guide docsxudan4-128/+423
JIRA: DOVETAIL-796 Signed-off-by: xudan <xudan16@huawei.com> Change-Id: I5dd491726ca2c7d0a85dc17af7a25b776c1c38a9
2019-09-10Introduce XCI installerPanagiotis Karalis1-0/+7
After the expression of the need to run the dovetail tool over the XCI installer, the investigation to that direction has been started. The aim of this patch is to introduce the relevant impact either on dovetail's code or on dovetail's documentation. JIRA: DOVETAIL-766 Change-Id: I6931506cb80baa4fa4288141ba86a858bc4215b0 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2019-09-10Use assertEqual instead of assertEqualsxudan1-2/+2
DeprecationWarning: Please use assertEqual instead Change-Id: I84db84e85a8a43486109bb948258e57c8b86fdfb Signed-off-by: xudan <xudan16@huawei.com>
2019-08-05Update Dovetail for XCI and Functest Hunterxudan2-5/+0
All info are recorded in etherpad https://etherpad.opnfv.org/p/Dovetail_XCI_TCs Change-Id: Iec54ecca63ef9d83a2e6cceb4c8664a9d107eab4 Signed-off-by: xudan <xudan16@huawei.com>
2019-07-10Add Swagger UI for dovetail APIxudan2-0/+115
Change-Id: If8f515b02f0372955739dd580967a3198930e98b Signed-off-by: xudan <xudan16@huawei.com>
2019-06-10Bugfix: Fix Dovetail 2 bugs found with CI resultsxudan1-4/+3
There are 2 bugs found with CI results of functest.tempest.neutron_tempest_plugin_api and all HA test cases. Yardtsick conf file does't mapping the keyfile to Yardstick container, so all HA test cases got SSHERROR. Also remove some useless debug msg to make dovetail.log more concise. Change-Id: I63c12d1b91ed5f8f8a893689384685ca9215f367 Signed-off-by: xudan <xudan16@huawei.com>
2019-05-23Change the OVP version to ovp.2019.0xPanagiotis Karalis2-6/+6
The OVP version is updated from ovp.2018.09 to ovp.2019.0x Change-Id: Ibbfe186f791c521155173fd405b0147844893cf8 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2019-05-22Remove sdnvpn test casesxudan2-8/+0
Functest removed test case 'bgpvpn' from scope of Hunter release. Also remove them from Dovetail for next release. The original link of refstack is invalid now. Changing it to interop link. Change-Id: I5b686496e106d688b8b3768401be95ac58fa2122 Signed-off-by: xudan <xudan16@huawei.com>
2019-04-26Change HEAT package from .tag.gz to be .zipxudan1-4/+4
As Trevor Lovett suggests, the Heat file is a zip file. So users need to package it different only for Dovetail testing. It will be better to change it to be .zip to keep it the same as what they do. JIRA: DOVETAIL-770 Change-Id: I5338720c5e1363081e1f8cdce33391a969f1cd97 Signed-off-by: xudan <xudan16@huawei.com>
2019-04-12Update user guidexudan2-7/+29
Change-Id: I595975d13630c81c5d15ac0051225143d0394ba4 Signed-off-by: xudan <xudan16@huawei.com>
2019-03-28Fix VVP test caseStamatis Katsaounis1-0/+1
This patch adds check for no environment variables provided to container configuration. Furthermore, it changes the check results file to a list of check result files. Change-Id: I2112ee1fd4b3156608d8a27dd3b9c90dbe35a24c Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com> Co-Authored-By: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2019-03-13Calculate checksum for input VNFStamatis Katsaounis1-9/+8
This patch adds checksum information inside ONAP related test case run results. The checksum is produced by the VNF input which can either be a CSAR file or an archive of Heat templates. Change-Id: I0ed58bdc9cc4031da08fd2ac220ef294520ef447 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2019-03-12Update release note and user guide before tagging ovp-2.2.0xudan1-6/+6
Change-Id: I1b1a1c96db933dc54242a226a6b8ea4a58147a14 Signed-off-by: xudan <xudan16@huawei.com>
2019-02-20Add a quick start guide for ONAP VNF tests with Dovetailxudan2-0/+157
JIRA: DOVETAIL-759 Change-Id: Id1032d758b618803f09d036dfa9ef8fd54ada6ce Signed-off-by: xudan <xudan16@huawei.com>
2018-11-22Add User Guide per installer - APEXPanagiotis Karalis1-48/+43
Trying to install the dovetail project on APEX, some instructions have been found that are not clear enough. The aim of introduction of new folder and user guide documents for each installer is to make a dovetail deployment easier, using tips and advices that are applicable for each installer respectively. JIRA: DOVETAIL-743 Change-Id: I907b694d859164031b170cb0c7bb4f69b9ec889b Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-09-21Updating the container tags of the test projectsGeorg Kunz1-28/+27
Setting the container versions of the test tools to a specific release tag. Change-Id: I3422be006ff80035cecc9ec22eba50b02ed97be6 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-17Adapting local docs build and remove build warningsGeorg Kunz1-1/+1
The OPNFV docs project will remove its submodules and enable local docs builds. This patch prepares the Dovetail repo according to the official transition guide: https://docs.opnfv.org/en/latest/how-to-use-docs/local-build-transition.html This patch also applies syntactical changes which eliminate the sphinx doc build warnings. Change-Id: Ief8fd2d1c3e39b232d214a9ab392879ee4a492c8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-13Update code base and docs to 2018.09xudan2-8/+8
The official name of the next release is going to be 2018.09. We need to rename all occurrences of 2018.08 in the code base, the documentation, and the web portal. JIRA: DOVETAIL-740 Change-Id: Ie0e532d6671b7590454e9afd960a2934f313a022 Signed-off-by: xudan <xudan16@huawei.com>
2018-09-03Remove identity v2 TCs,not supported by FunctestPanagiotis Karalis2-4/+0
As Functest does not support identity v2 anymore, it does not make sense to try to run tempest identity v2 tests. They need to be removed correspondingly. JIRA: DOVETAIL-735 Change-Id: I09c06faf52893cc535bbed1fd406b81a7665e787 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-08-27Shortening headings and testing building of docsGeorg Kunz1-3/+3
This patch shortens the headings and is used to test if the docs tool chain builds the right version. Change-Id: Ibc162be1b46ff787a90510c360881234391c5ba7 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-14Rename ovp.next to be ovp.2018.08xudan2-6/+6
Change-Id: I32aaee370512c3d7c8d6e1fbb6ef25aebc5d483f Signed-off-by: xudan <xudan16@huawei.com>
2018-08-14Update cli reference guidexudan1-47/+115
JIRA: DOVETAIL-713 Change-Id: Ie740c8bf24c297c2537b23e1d35e0b4d40cd3e35 Signed-off-by: xudan <xudan16@huawei.com>
2018-08-14Update user guidexudan1-83/+73
JIRA: DOVETAIL-710 Change-Id: If6150e75202851e80b3b945743eca3362dba69c7 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-12Enable OVP tests to run on a DPDK-enabled systemPanagiotis Karalis2-10/+40
DPDK-enabled NFVIs require support for hugepages which in turn is configured by means of extra_specs in flavors. Currently, Functest enables hugepage support if the name of the scenario contains the substring "ovs". Dovetail allows end users to run all tests on DPDK-enabled systems and the documentation has been updates accordingly. JIRA: DOVETAIL-665 Change-Id: If4898da168f8b4c69a045ef3b00b8a8862f29b0c Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-06-15Running BGPVPN Tempest tests as tempest_custom testGeorg Kunz1-1/+11
We need to disable one BGPVPN tempest test due to a bug in ODL. Since the SDNVPN test framework does not allow for disabling a single test case, we are switching to tempest_custom. Change-Id: Ifbd7c1dc5e799d6a6c774e08e9fc1a3b2294b47c Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-29Adding reference to EXTERNAL_NETWORK to user guideGeorg Kunz1-2/+5
Adding a reference to the EXTERNAL_NETWORK environment variable to the user guide so that users add this to their env_config.sh. This variable is required, among others, to overwrite the default external network in Yarstick. Change-Id: I50e609a8c6e20b1dd01c61d5d950ffba792e98fa Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-28Update user guidexudan1-139/+199
1. Remove python related content because python is installed in Dovetail image. 2. Remove DB related content because there is no need to launch local DB now. 3. Update the infomation of Docker images and VM images. Change-Id: I010d3341aef9f2c74713fc0fc087b361331109d1 Signed-off-by: xudan <xudan16@huawei.com>
2018-05-19Updating user guide with new ssh key config in pod.yamlGeorg Kunz1-4/+5
Dovetail does not copy the ssh key from pre_config to /root/.ssh anymore inside Yardstick but instead, we point the pod.yaml file directly to the key inside the pre_config directory. JIRA: DOVETAIL-655 Change-Id: I23156d8940194547363bcf9a5cc581aab0d5c640 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-11Adding documentation for API validation exemptionGeorg Kunz1-0/+11
Updating the user guide and OVP addendum to include references to the detailed document describing the API response validation exemption. JIRA: DOVETAIL-651 Change-Id: I4026f84f021704f0986b45680471e8fb711fc314 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-07Adding a tox environment for locally building docsGeorg Kunz1-1/+1
Run tox -edocs to locally build the Dovetail docs. This is quite useful because the default OPNFV docs preview build toolchain is broken for Dovetail. Change-Id: I0a55a701b96437a20aa09edc47bc3e49e32c0b87 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-03-29Integrate dovetail with ONAPMoshe1-0/+3
Change-Id: I6a1fa5f27df2f5127eb00156b3135dc79caf5e77 Issue-ID: DOVETAIL-629 Signed-off-by: Moshe <moshehoa@amdocs.com>
2018-03-06Separate valid docker tags for functest and yardstickGeorg Kunz1-3/+3
Specifying separate valid docker tags for functest and yardstick for input validation. DOVETAIL-592 Change-Id: I3365cdbd9ab521bf1368750c3f34b6863b3f7ec8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-01-15Changing CVP to OVP in the documentationGeorg Kunz2-21/+21
Due to the name change from 'CVP' to 'OVP', the documentation has to be updated. Change-Id: Id934e8fc07f60802f7aa6b3d295d268c4c9b71f8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-01-15Update test user guide to improve usabilityEddie Arrage1-222/+300
- Modify hosts.yaml syntax to match patch by Serena - Modify result file references for new timestamp patch by Georg - Revise online/offline diagrams for OVP name change - Add XCF GIMP source files for diagrams with layers for new elements - New changes for cvp.0.9.0 to ovp.1.0.0 - Remove reference to bottlenecks container for now - Modify section/heading structure - Incorporate comments: results.json vs. result files - Incorporate comments: online/offline install headings - Incorporate comments: remove IP from launch_db.sh - Incorporate comments: remove sudo for wget - Incorporate comments: pod.yaml for SUT HW info - Incorporate comments: test case to config file requirement - Incorporate comments: suggested changes to env_config.sh - Modify the sequence of the guide to reflect installation steps - Outline all required configuration files earlier in the guide - Highlight configuration file key entries and pitfalls - Improve requirements for pod.yaml file for HA - Improve online/offline install instructions - Call out Dovetail docker run command and explain options - Clarify when testapi and local db ports need to be changed - Explain the dovetail run --testsuite and --testarea arguments more clearly - Improve --report option and default result result behavior - Make CVP portal a separate section - Explain CVP portal workflow to reflect current state of interface - Update references to cvp.0.8.0 with cvp.0.9.0 Change-Id: I41857c1b07c211a95f19c99054ca414351c75c20 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2017-11-02Modify reference to online modeEddie Arrage1-6/+7
Changed reference to online mode to refer to installation rather than uploading results from Test Host to CVP portal directly, as current text is misleading. Change-Id: I9439d340beabb76f04b7782243c050064753a8ec Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2017-10-24Tag dovetail with cvp.0.8.0xudan1-7/+7
JIRA: DOVETAIL-536 Change-Id: I7a947b1aa57728e6add1d0ca881a6a62a46c0913 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-23Fixing references and layout in the docsGeorg Kunz1-0/+2
This patchset introduces labels for documentation-internal references and replaces footnote-style citations with inline hyperlinks. Additional minor changes for a nicer rendering of bullet lists. JIRA: DOVETAIL-521 Change-Id: Ic847fc05d546d673dadc7b8efee86fcb688133f5 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-10-23Add testsuite cvp.0.8.0 for Beta testsxudan1-11/+16
1. Now there is a testsuite proposed_tests for beta tests which may cause some confusions. 2. Copy all test cases to testsuite cvp.0.8.0 for beta testers to use. 3. Update userguide with testsuite cvp.0.8.0 JIRA: DOVETAIL-528 Change-Id: I35bc7dee6e07a9125a4c1991b0049f6e2d705cc5 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-18Term refstack is mentioned in dovetail Testing User Guidexudan1-3/+1
Remove refstack.log from the userguide because the refstack.log has been renamed dovetail.osinterop.tc00X.log JIRA: DOVETAIL-519 Change-Id: Icd0bd82ef78437ab96201e58b93e0a6997f9618a Signed-off-by: xudan <xudan16@huawei.com>
2017-10-18Add dovetail tool CLI documentxudan3-1/+205
According to the wiki page, add the CLI document. https://wiki.opnfv.org/display/dovetail/Dovetail+Command+Line JIRA: DOVETAIL-509 Change-Id: I6a32446cd4c1bcad83465b1f2e12d5c1487e954e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-29Update user guide with the local DB operationsxudan1-62/+85
If users want to store results or upload results to CVP web portal, they need to build local DB adn testapi service. Should add more introduction about the local DB and testapi in the user guide. JIRA: DOVETAIL-504 Change-Id: I6493169b54104af8d7207d28fad93afedeae0b1b Signed-off-by: xudan <xudan16@huawei.com>
2017-09-13Replacing references to "DefCore"Georg Kunz1-10/+9
This patch removes all references to the outdated term "DefCore" in the Dovetail documentation. The DefCore working group has been renamed OpenStack InterOp Working Group some time ago. This patch also proposes renaming the "defcore" test area to "osinterop". JIRA: DOVETAIL-499 Change-Id: I7bb2ca33cb1eaf17c3ca0fc79a4f923e5886ece4 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-06Doc: update user guide due to add new test cases and featuresxudan1-27/+118
There has been added some new test cases and features, so user guide should be updated according to the latest dovetail version. - Add introduction about https (with cacert and without cacert) - Add introduction about adding hosts' info - Add introduction about downloading cirros images - Add introduction about special configurations for running defcore and tempest test cases - Add introduction about how to check defcore and tempest failed test cases JIRA: DOVETAIL-493 Change-Id: I13aca4ee433056bd21590743a412d5d95f45fec4 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Tag dovetail with cvp.0.5.0xudan1-12/+12
JIRA: DOVETAIL-483 1. docker image used yardstick: danube.3.2 functest: cvp.0.5.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.5.0 dovetail: cvp.0.5.0 2. main changes Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd Signed-off-by: xudan <xudan16@huawei.com>
2017-08-04Merge "add user guide for results operations on web"hongbo tian1-1/+32
2017-08-04Tag dovetail with cvp.0.4.0xudan1-7/+10
JIRA: DOVETAIL-476 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.4.0 dovetail: cvp.0.4.0 2. main changes Add docs about vping test cases (test scope and test specification) Add 2 vping test cases into proposed_tests Bugfix: Build docker image failed because of lacking of packages Add resiliency.tc001 into proposed_tests 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: I5ce6bdc9a1daa957124309c9fadc532f9c7a2b1e Signed-off-by: xudan <xudan16@huawei.com>
2017-08-04add user guide for results operations on webgrakiss1-1/+32
JIRA: dovetail-471 User can access results through the web page browser the public results uploaded by others or himself upload the results, and set this results as public or private to others Change-Id: I9834a670f5dff6412a0290d9a5dd729bcece2933 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-07-21Tag dovetail with cvp.0.3.0xudan2-10/+9
JIRA: DOVETAIL-468 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 testapi: cvp.0.3.0 dovetail: cvp.0.3.0 2. main changes fix dovetail docker version to be 17.03.0-ce adapt yardstick danube.3.1 For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f Signed-off-by: xudan <xudan16@huawei.com>
2017-07-06Draft dovetail user guide first cutWenjing Chu3-472/+498
Fixing comment issues and updating to new version of dovetail. Change-Id: Iaa9243d0a835f1d050fb925fa75b2a770168a8f4 Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-04-26JIRA: DOVETAIL-352 Updating the test specification document with iterative ↵ChristopherPrice1-0/+479
inprovements. JIRA tasks are being created for specific sections of the document. Refer to the doc for links to relevant JIRA tasks. Change-Id: I1717d56b8817c38802a227db320f30029f68fbd0 Signed-off-by: ChristopherPrice <christopher.price@ericsson.com>