summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-02-14Updated OVP2019.12 documentationovp-3.0.1stable/hunterLincoln Lavoie9-157/+770
* Added table to index page for relationship between OVP release and OPFNV/ONAP release/tag * Added userguide for VNF testing * Updated OVP Addendum to include VNF testing * Updated release notes to include VNF testing * All documentation links point to stable-hunter, not latest * Fixed a couple of doc8 warnings for fomatting * Updated based on Trevor's review * Updated per CVC review and discussions on Feb. 10. * Fixed trailing whitespace issues * Added missing reference in ovpaddendum/index.rst Signed-off-by: Lincoln Lavoie <lylavoie@iol.unh.edu> Change-Id: Ibb099bb12873b114f1766d0aaabe4471d390a451
2019-12-28Fix all docker version and update all other docsovp-3.0.0xudan7-36/+36
JIRA: DOVETAIL-798 Change-Id: Ie10525d4534e7bf3bb263b9ad8cf200259a7bf7c Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit d7d898e0b1362810971f6230d2f18130f26c20ad)
2019-12-26Update Dovetail generic framework guidexudan1-52/+83
JIRA: DOVETAIL-797 Change-Id: I9be48de191591deeb356e4f2ad0e8508720d8e54 Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit 66bd34214337d934860e60463faaa301a121a9eb)
2019-12-25Update release note for OVP 2019.12 releasexudan1-79/+54
JIRA: DOVETAIL-793 Change-Id: I8f3cf425baae317866876f71e1fecaaea1d31b75 Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit a127d11a462fe429c942948d5d0e719529a237ad)
2019-12-19Update reviewer guidexudan9-81/+90
JIRA: DOVETAIL-794 Change-Id: I4ed52b05aa0eb2fb95bbf2c4e7ca5f441fb73e72 Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit 2cc610ce13a0dde2e054a25597292d030aa27353)
2019-12-19Update tox coverage criteriaxudan1-1/+1
Two lines in dovetail_utils.py will not be covered sometimes, then the total coverage is 99.89%. Signed-off-by: xudan <xudan16@huawei.com> Change-Id: Iec9d0c60735b33474ec02d2ff96cad178eefd462 (cherry picked from commit f8182a02158b21879e467a049991727f11c96d33)
2019-12-19Update all test specification docsxudan23-466/+655
JIRA: DOVETAIL-795 Change-Id: I807a750c92aa8b50cf3af242b1766e7407063db2 Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit e7059465f95bdd8222f2547af802346a04c79362)
2019-12-09Update user guide including testing, api, cli guide docsxudan5-129/+424
JIRA: DOVETAIL-796 Signed-off-by: xudan <xudan16@huawei.com> Change-Id: I5dd491726ca2c7d0a85dc17af7a25b776c1c38a9
2019-11-20Update the result check for rally testsxudan3-8/+13
JIRA: DOVETAIL-790 Change-Id: Ia3bacf307cd2543820eae86733f76a472e34ead2 Signed-off-by: xudan <xudan16@huawei.com>
2019-11-19Fix exception when running HA tests without pod.yamlxudan10-28/+108
1. use volumes '-v' to map files/directories which may be non-existing 2. use mounts '--mount' to map files/directories which couldn't be non-existing JIRA: DOVETAIL-789 Change-Id: I2184e5baed3d1491a2df4d3a1a77a11e3e9b4fc8 Signed-off-by: xudan <xudan16@huawei.com>
2019-11-15Change NFVI version of Dovetail tool from 2019.0x to 2019.12xudan4-7/+8
JIRA: DOVETAIL-788 Change-Id: I4b31be68f03525ffc03a2ce906909f25d863b6bb Signed-off-by: xudan <xudan16@huawei.com>
2019-11-08Update git patch script for new tempest versionxudan1-78/+267
Change-Id: I0d511e3e4570fed5d2afb09335fcbe7d90a2ab5f Signed-off-by: xudan <xudan16@huawei.com>
2019-11-04Refact API modulexudan3-242/+276
Change-Id: Ifa01fcbb848d3218619c1f8e726f26476773ce2f Signed-off-by: xudan <xudan16@huawei.com>
2019-10-25Update API to python3 and add some addtional APIsxudan3-24/+75
Update the unit test case to fix the py27 failure. Change-Id: Ic75b8fc037c320ec5599eb007dcee43788e32807 Signed-off-by: xudan <xudan16@huawei.com>
2019-10-22Add Functest Networking SFC testsPanagiotis Karalis2-0/+32
Add in the Dovetail project the networking-sfc tests which are part of Functest project (functest-smoke container). Signed-off-by: Panagiotis Karalis <panos.pkaralis@gmail.com> Change-Id: Id57d00e62000e47303f1678347acc3a5fda6dec7
2019-10-15Update check list with Hunterxudan1-32/+56
According to the results on CI, it needs to change the check list here. https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-optional-hunter/12/artifact/results/neutron_tempest_plugin_api_logs/ Change-Id: I6225331e1738e0f3a8ea0771c7a751a1fa3b15a1 Signed-off-by: xudan <xudan16@huawei.com>
2019-10-13bugfix: stree test failedxudan1-1/+1
Shouldn't change the command from python to python3 to run stress test, because this command is run in bottlenecks container and it hasn't transfer to python3 yet. Change-Id: I6875d855e75ae72e647e70c2feb34ed2cda38f15 Signed-off-by: xudan <xudan16@huawei.com>
2019-10-12Update blacklist scenario to match any scenariosxudan2-4/+2
Functest has supported regrex of scenario in tempest tests. See patch https://gerrit.opnfv.org/gerrit/c/functest/+/68399 Change-Id: Ia59d1ed02ac5a4a8dff6aa06270de421b8533cb6 Signed-off-by: xudan <xudan16@huawei.com>
2019-10-12Bugfix: got an error on ci when rally tests failedxudan2-22/+51
see https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-optional-hunter/10/console Change-Id: I7c9b0426603c22a2ef5f4b15ca26fbc0768bd19f Signed-off-by: xudan <xudan16@huawei.com>
2019-10-11Update all redirected links in Dovetail docsxudan24-102/+100
The pod ld-build2 only has python 3.6 installed, so change the tox env to be 3.6 Other pods has python 3.5 to verify pep8, py35 ... Change-Id: I0289d7ce96ffa49dd08ce4b855fe071a5e608cbf Signed-off-by: xudan <xudan16@huawei.com>
2019-09-18Fault fixing for cmd_exec util methodPanagiotis Karalis2-6/+6
When the 'dovetail run' command is assigned, the error "TypeError: must be str, not bytes" is appeared. Due to a different handling of strings in the Python3, this error is appeared during of command execution (i.e. exec_cmd method). Each piece of the string should be decoded, before it will be appended to the rest one. Signed-off-by: Panagiotis Karalis <panos.pkaralis@gmail.com> Change-Id: I65629f3f76cc3e44f3926a744d00791ef588d2aa
2019-09-16Move the proj to python3Panagiotis Karalis22-129/+133
The aim of this patch is to upgrade python version of this project from python2 to python3. Signed-off-by: Panagiotis Karalis <panos.pkaralis@gmail.com> Change-Id: I3d3ef01176fda1b23a0542a24625be2f3368c40e
2019-09-10Introduce XCI installerPanagiotis Karalis2-0/+227
After the expression of the need to run the dovetail tool over the XCI installer, the investigation to that direction has been started. The aim of this patch is to introduce the relevant impact either on dovetail's code or on dovetail's documentation. JIRA: DOVETAIL-766 Change-Id: I6931506cb80baa4fa4288141ba86a858bc4215b0 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2019-09-10Use assertEqual instead of assertEqualsxudan9-212/+211
DeprecationWarning: Please use assertEqual instead Change-Id: I84db84e85a8a43486109bb948258e57c8b86fdfb Signed-off-by: xudan <xudan16@huawei.com>
2019-09-02Add portal_key_file into all test case yml filesxudan53-0/+70
Change-Id: If111a8cc56c31ec3e22b090aca92ff56d41f7e01 Signed-off-by: xudan <xudan16@huawei.com>
2019-08-27Add validation disabled/enabled to results.jsonxudan6-11/+28
Change-Id: I918f85c5ac89cf2745efa8513946a2b5ab8638b1 Signed-off-by: xudan <xudan16@huawei.com>
2019-08-23Add run tests APIxudan8-14/+634
Change-Id: I456d5d1459faa20d9dd8afd0c235a4bb6cbfbcce Signed-off-by: xudan <xudan16@huawei.com>
2019-08-05Update Dovetail for XCI and Functest Hunterxudan27-336/+19
All info are recorded in etherpad https://etherpad.opnfv.org/p/Dovetail_XCI_TCs Change-Id: Iec54ecca63ef9d83a2e6cceb4c8664a9d107eab4 Signed-off-by: xudan <xudan16@huawei.com>
2019-07-12Update OVP Support Email AddressTrevor Bramwell3-4/+4
As the portals have moved from the opnfv.org domain to lfnetworking.org, the support address has changed as well from 'verified' to 'ovp-support'. Change-Id: I341093992e456ac90580b3b96206a402f98bf2d2 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2019-07-10Update the Certification Workflow documentTrevor Bramwell1-49/+51
These changes are at the request of Brandon Wick. Change-Id: Ieb4ea0164656e349451820071dc0c3d3f9bf67ac Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2019-07-10Add Swagger UI for dovetail APIxudan7-1/+195
Change-Id: If8f515b02f0372955739dd580967a3198930e98b Signed-off-by: xudan <xudan16@huawei.com>
2019-07-02Update osinterop check list with Hunter scopexudan1-217/+219
Change-Id: If8ca533772ad85a3789f5f448adbeb16491c23b0 Signed-off-by: xudan <xudan16@huawei.com>
2019-07-02Update trunk port list with Hunter and using blacklistxudan2-2/+32
1. Using blacklist to avoid running some sub test cases 2. Update the sub test cases according to Functest Hunter scope Change-Id: I61d6d796dcdfe0fef41ba7578d0f8f2221414686 Signed-off-by: xudan <xudan16@huawei.com>
2019-06-21Use Functest blacklist to exclude the sub test cases of patrolexudan2-6/+52
1. using blacklist to exclude some sub test cases 2. update the patrole scope according to Hunter using patrole 0.4.0 Change-Id: I32de419e482cf2f2d7289dba48155f3d09fdec91 Signed-off-by: xudan <xudan16@huawei.com>
2019-06-12Add RESTful APIs into Dovetail containerxudan8-5/+58
JIRA: DOVETAIL-774 Change-Id: Ifb934eaeda52c1d316d80d9bb9c1890ffb71049c Signed-off-by: xudan <xudan16@huawei.com>
2019-06-10Bugfix: Fix Dovetail 2 bugs found with CI resultsxudan7-26/+8
There are 2 bugs found with CI results of functest.tempest.neutron_tempest_plugin_api and all HA test cases. Yardtsick conf file does't mapping the keyfile to Yardstick container, so all HA test cases got SSHERROR. Also remove some useless debug msg to make dovetail.log more concise. Change-Id: I63c12d1b91ed5f8f8a893689384685ca9215f367 Signed-off-by: xudan <xudan16@huawei.com>
2019-05-23Change the OVP version to ovp.2019.0xPanagiotis Karalis6-12/+12
The OVP version is updated from ovp.2018.09 to ovp.2019.0x Change-Id: Ibbfe186f791c521155173fd405b0147844893cf8 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2019-05-23Fix doc link errorxudan1-1/+1
Change-Id: I405acb86132eb4f430e6df63e890b404af052ec7 Signed-off-by: xudan <xudan16@huawei.com>
2019-05-22Change Functest version from gambia to hunterxudan2-2/+2
Change-Id: I9842467035572e869a92099f11288c6b9d773600 Signed-off-by: xudan <xudan16@huawei.com>
2019-05-22Remove sdnvpn test casesxudan20-1450/+8
Functest removed test case 'bgpvpn' from scope of Hunter release. Also remove them from Dovetail for next release. The original link of refstack is invalid now. Changing it to interop link. Change-Id: I5b686496e106d688b8b3768401be95ac58fa2122 Signed-off-by: xudan <xudan16@huawei.com>
2019-05-16Fix the verdict of sub test casesxudan2-3/+10
Error to group skipped sub test cases to passed one. Example: Skipped sub test case will be parsed as passed in following case. skipped sub test case: tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router passed sub test case list includes this one: tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id Then the skipped one will be checked as pass. JIRA: DOVETAIL-775 Change-Id: I449f4968c23a9def1177a7c9645e5dcb89b2ec30 Signed-off-by: xudan <xudan16@huawei.com>
2019-05-09Add Licensexudan106-0/+954
Many files in Dovetail repo are lacking of License after LF scanning. Add all of them except the following files: 1. docker/Dockerfile.aarch64.patch 2. 0001-Allow-additional-properties-in-API-responses.patch 3. docs/images/dovetail_offline_mode.xcf 4. docs/images/dovetail_onfline_mode.xcf 5. all png files 6. all empty files Change-Id: If1a0b7c2d35d6682c87c4eb9106e1998dc4ca3bc Signed-off-by: xudan <xudan16@huawei.com>
2019-04-26Change HEAT package from .tag.gz to be .zipxudan4-9/+10
As Trevor Lovett suggests, the Heat file is a zip file. So users need to package it different only for Dovetail testing. It will be better to change it to be .zip to keep it the same as what they do. JIRA: DOVETAIL-770 Change-Id: I5338720c5e1363081e1f8cdce33391a969f1cd97 Signed-off-by: xudan <xudan16@huawei.com>
2019-04-17Failed to upload results to ONAP portalPanagiotis Karalis7-1/+137
The results.json file generated by running 'dovetail run --testsuite xxx' is different from the one generated by running 'dovetail run --testcase xxx'. The former can be uploaded to ONAP portal successfully but the latter one can't. The main reason is that the latter one lacking of 'vnf_type'. Keep the results.json with the same format for both running one test suite or several test cases. JIRA: DOVETAIL-769 Change-Id: I46af84f9f229f9e601439f68c9ed9df9477d002b Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2019-04-12Update user guidexudan2-7/+29
Change-Id: I595975d13630c81c5d15ac0051225143d0394ba4 Signed-off-by: xudan <xudan16@huawei.com>
2019-04-03Push CI results to OPNFV test DBxudan6-12/+129
In order to use OPNFV test results page to do the ayalysis of all OVP test cases, it needs to push all results generated by Dovetail CI jobs to test DB and then using http://testresults.opnfv.org/test/#/results to check all results. The following data must contain in the POST body: 1. project_name 2. case_name 3. details 4. installer 5. scenario 6. pod_name 7. build_tag 8. criteria 9. start_date 10. stop_date 11. version JIRA: DOVETAIL-767 Change-Id: I925ae249e24efd7bfb1c68a69150e9c22f0cdf36 Signed-off-by: xudan <xudan16@huawei.com>
2019-03-29Stamatis stepping down.Aric Gardner1-7/+7
https://lists.opnfv.org/g/opnfv-tech-discuss/message/22993 Change-Id: Ibce504958dce88bb20d22b7be2e9ca2478a626fe Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2019-03-28Fix VVP test caseStamatis Katsaounis5-9/+13
This patch adds check for no environment variables provided to container configuration. Furthermore, it changes the check results file to a list of check result files. Change-Id: I2112ee1fd4b3156608d8a27dd3b9c90dbe35a24c Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com> Co-Authored-By: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2019-03-20Improve DockerfileStamatis Katsaounis3-25/+19
This patch improves the Dockerfile which produces the Dovetail image. Change-Id: I65e65f155afe237b11c668e6486e48b55cc7e96c Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2019-03-18Replace subprocess commands with Docker SDKStamatis Katsaounis11-262/+282
JIRA: DOVETAIL-752 This patch replaces all python subprocess commands with the Docker SDK relevant commands. Change-Id: Iac7caffd80a863a8a022247d735b2a7f2792e49d Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>