summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-25Ignore Tox Error E722xudan1-1/+1
1. After updating tox from 2.5 to 2.9, pep8 failed. 2. https://build.opnfv.org/ci/job/dovetail-verify-master/1018/console 3. The Error is 'E722 do not use bare except'. 4. It needs to change all 'except:' into 'except Exception:'. 5. This won't affect Dovetail, so just ignore this Error. 6. Dovetail next release will consider to fix this error. JIRA: DOVETAIL-537 Change-Id: Ic3c7be4667685fc94025a47c3b17d07a087565da Signed-off-by: xudan <xudan16@huawei.com>
2017-10-24System preparation guideWenjing Chu1-66/+55
Change-Id: I4fc982d7037466b48424b7ce97d6207fbe44a09b Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-10-23Fixing references and layout in the docsGeorg Kunz7-81/+90
This patchset introduces labels for documentation-internal references and replaces footnote-style citations with inline hyperlinks. Additional minor changes for a nicer rendering of bullet lists. JIRA: DOVETAIL-521 Change-Id: Ic847fc05d546d673dadc7b8efee86fcb688133f5 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-10-23Use functest clean module to do the sdnvpn resources cleanupxudan5-0/+15
1. If there throw an exception during the test of one sdnvpn test case, it will not do the clean. 2. Then there are many resources left, such as network, subnet, server... 3. This is a bug of sdnvpn see JIRA: SDNVPN-184 4. The patch for fixing this bug https://gerrit.opnfv.org/gerrit/#/c/44777/ 5. Currently, use functest module "functest openstack clean" to clean the SUT. JIRA: DOVETAIL-524 Change-Id: I629fc6fdc9e4c95960f6122358ff219a467d441b Signed-off-by: xudan <xudan16@huawei.com>
2017-10-23Bugfix: the sdnvpn DB initialization information lacks two test casesxudan1-0/+2
1. The SDNVPN DB initialization information lacks two test cases, functest_testcase_4 and functest_testcase_8. 2. So the results of these 2 test cases cannot be pushed into DB. 3. Add these 2 test cases info to DB. JIRA: DOVETAIL-535 Change-Id: I1c6d049b942806924f15dd106452fd9b4d554454 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-23Bugfix: build docker image failedxudan1-0/+2
1. When build Dovetail docker image, the job failed. 2. https://build.opnfv.org/ci/view/dovetail/job/dovetail-docker-build-push-master/279/console 3. That's because the setuptools version is old. 4. It needs to upgrade setuptools in the Dockerfile. JIRA: DOVETAIL-534 Change-Id: If37a4d7c3b57ea79903565fd880c5447da97b13b Signed-off-by: xudan <xudan16@huawei.com>
2017-10-23Add testsuite cvp.0.8.0 for Beta testsxudan4-12/+75
1. Now there is a testsuite proposed_tests for beta tests which may cause some confusions. 2. Copy all test cases to testsuite cvp.0.8.0 for beta testers to use. 3. Update userguide with testsuite cvp.0.8.0 JIRA: DOVETAIL-528 Change-Id: I35bc7dee6e07a9125a4c1991b0049f6e2d705cc5 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-19[web-cvp]Additional columns in ‘My Results’grakiss11-11/+2991
JIRA: DOVETAIL-532 1. original filename 2. user editable label Change-Id: I1566cecb3d8ceacc14167bb2fb7fa41508f293be Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-10-20[web-cvp]share result by emailgrakiss5-16/+44
JIRA: DOVETAIL-529 It may be easier to get other people's email than his user id Change-Id: Ia5f9aa72d3c79bd3f5e69dad98b3f188cdaafc3d Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-10-19[web-cvp]Direct drill-down for failed testsgrakiss2-1/+15
JIRA: DOVETAIL-531 people may want to directly drill-down to the exact log file of each results, instead of searching in piles of log files. Change-Id: I6e18b8d57739fd695e20ee29147e796de5c9e404 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-10-18Updating test case requirements documentGeorg Kunz2-59/+104
This patchset addresses review comments which were not incorporated in the previous version of the test case requirements description. Additionally, the text has been wrapped to 80 character lines. Change-Id: If817f6c44d94870d915791a1a11916ffe4871f06 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-10-18Term refstack is mentioned in dovetail Testing User Guidexudan1-3/+1
Remove refstack.log from the userguide because the refstack.log has been renamed dovetail.osinterop.tc00X.log JIRA: DOVETAIL-519 Change-Id: Icd0bd82ef78437ab96201e58b93e0a6997f9618a Signed-off-by: xudan <xudan16@huawei.com>
2017-10-18Add dovetail tool CLI documentxudan3-1/+205
According to the wiki page, add the CLI document. https://wiki.opnfv.org/display/dovetail/Dovetail+Command+Line JIRA: DOVETAIL-509 Change-Id: I6a32446cd4c1bcad83465b1f2e12d5c1487e954e Signed-off-by: xudan <xudan16@huawei.com>
2017-10-16SDNVPN test cases resources left may effect the next test casesxudan1-5/+5
Move SDNVPN test cases after tempest test cases, then the resources left will not effect tempest test cases. JIRA: DOVETAIL-524 Change-Id: I815ae7f3a3be0225be1e9695f13d4552946bffb5 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-12[web-cvp]failed to build docker image due to setuptools versiongrakiss1-0/+1
JIRA: DOVETAIL-526 error on docker build, upgrade the setuptools: error in cryptography setup command: Invalid environment marker: python_version < '3' Change-Id: If3b2b2ecd3a3e23f66cacb6a2048f15f1715dcd4 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-10-12[web-cvp]add a api to fecth logs of backend apigrakiss4-0/+17
JIRA: DOVETAIL-525 provide a easy way to fetch logs of backend apis Change-Id: I72054a6e155e6970254ed391dfa8b25943eceb35 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-10-10Merge "[web-cvp]fix api&web service in dockerfiles"Leo wang2-6/+10
2017-10-09[web-cvp]fix api&web service in dockerfilesgrakiss2-6/+10
JIRA: DOVETAIL-523 api&web services is not running due to packages installation errors Change-Id: I5175d987dfda3cefe28a3a37754acc9fc8d7bc13 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-10-09Merge "[web-cvp]missing files in web sites"Leo wang4-1/+612
2017-10-09[web-cvp]missing files in web sitesgrakiss4-1/+612
JIRA: DOVETAIL-522 some files missing due to incorrect .gitignore settings Change-Id: I4d81842afcb6f2734abeebbdcde56ec5b3e1655b Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-10-09Merge "Cvp application form"Wenjing Chu2-3/+92
2017-10-09Merge "[web-cvp]osinteros is counted as optional test case"Leo wang1-1/+1
2017-10-09Merge "[web-cvp]failed to expand test results"Leo wang1-2/+2
2017-10-05Cvp application formWenjing Chu2-3/+92
Change-Id: I4bb0cea49179c7171ce766c52814f765e05ce9f8 Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>
2017-09-30Merge "Update user guide with the local DB operations"hongbo tian1-62/+85
2017-09-30[web-cvp]osinteros is counted as optional test casegrakiss1-1/+1
JIRA: DOVETAIL-518 'defcore' is changed to 'osinterop', counted as optional test case Change-Id: Ic5322c498869dcef9597530e343b053aebc376cf Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-09-30[web-cvp]failed to expand test resultsgrakiss1-2/+2
JIRA: DOVETAIL-517 When click on the "expand" button, nothing happens. Change-Id: Ibe1554baf047d56fa07e27e936c15b2664326382 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-09-29Update user guide with the local DB operationsxudan1-62/+85
If users want to store results or upload results to CVP web portal, they need to build local DB adn testapi service. Should add more introduction about the local DB and testapi in the user guide. JIRA: DOVETAIL-504 Change-Id: I6493169b54104af8d7207d28fad93afedeae0b1b Signed-off-by: xudan <xudan16@huawei.com>
2017-09-29Merge "Tag dovetail with cvp.0.7.0"hongbo tian1-1/+1
2017-09-29Tag dovetail with cvp.0.7.0xudan1-1/+1
docker image used 1. opnfv/yardstick: danube.3.2 2. opnfv/functest: cvp.0.5.0 3. opnfv/bottlenecks: cvp.0.4.0 4. opnfv/testapi: cvp.0.5.0 5. opnfv/dovetail:web.cvp.0.7.0 6. opnfv/dovetail:api.cvp.0.7.0 7. opnfv/dovetail: cvp.0.7.0 main changes 1. [cvp-web]correct dockerfile 2. [cvp-web]remove useless docker-compose yaml 3. Bugfix: sdnvpn test cases failed due to wrong module name 4. Support to run mandatory or optional test cases separately 5. [cvp-web]remove workflow on homepage 6. add api&web services for cvp 7. Don't generate tar file when run without pushing results to DB 8. Make Yardstick log level can be set by CLI 9. Update the script for building local DB and testapi 10. Bugfix: tar results dir cannot be parsed by web portal 11. Replacing references to "DefCore" 12. Updating the test specification document with iterative inprovements 13. Dovetail tool replaces defcore with osinterop 14. Clearer structuring current and future test scope of CVP addendum 15. Adding a stub document for a CVP reviewer guide 16. Clarify criteria for testcase inclusion as running in Functest/CI 17. And additional clarifications. 18. add more information for the Identity testcases in the refstack 19. Doc: update user guide due to add new test cases and features For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool JIRA: DOVETAIL-516 Change-Id: Ic65073fd749c1bcdbd0946d081ba2d2fe9105057 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-29Disable get DB schema in Dockerfilexudan1-3/+3
Dovetail provides files for init local DB. No need to get schema from opnfv DB when building docker image. Change-Id: I05fbf4f65f3a94bb3a36fe3c140ad7bff58a4f15 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-29Merge "[cvp-web]correct dockerfile"Leo wang2-2/+25
2017-09-29Merge "[cvp-web]remove useless docker-compose yaml"Leo wang2-67/+7
2017-09-29[cvp-web]correct dockerfilegrakiss2-2/+25
JIRA: DOVETAIL-515 correct dockerfile, git clone from dovetail Change-Id: I1dee7f8ae5278f55bcf5928bbf88cdb079388494 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-09-29Merge "Bugfix: sdnvpn test cases failed due to wrong module name"Leo wang14-41/+38
2017-09-28Bugfix: sdnvpn test cases failed due to wrong module namexudan14-41/+38
SDNVPN test cases failed due to wrong module name. The module name needs to be changed into "sdnvpn.test.functest.testcase_1" Refer to patch https://gerrit.opnfv.org/gerrit/#/c/41385/ Currently Dovetail uses functest:cvp.0.5.0 which uses module name "testcase_1". JIRA: DOVETAIL-510 Change-Id: I3232760d3af34125c7da71a5d2c62ca32693c82b Signed-off-by: xudan <xudan16@huawei.com>
2017-09-29Merge "Support to run mandatory or optional test cases separately"Leo wang6-27/+71
2017-09-28[cvp-web]remove useless docker-compose yamlgrakiss2-67/+7
JIRA: DOVETAIL-514 remove useless docker-compose yaml Change-Id: Ic754488611571c3464515772680ad94bbe5651ea Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-09-28[cvp-web]remove workflow on homepagegrakiss3-71/+3
JIRA: DOVETAIL-513 remove workflow on homepage, add a link to workflow instead Change-Id: Id8e551d4c593a2104c7cc8eb55468e9c29b5052a Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-09-28Merge "add api&web services for cvp"hongbo tian508-1/+115104
2017-09-28add api&web services for cvpgrakiss508-1/+115104
JIRA: DOVETAIL-512 add api&web services for cvp Change-Id: I9ef9525e980fe61dc3108035ef9a3ff8783b2697 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-09-28Merge "Don't generate tar file when run without pushing results to DB"Leo wang1-1/+2
2017-09-28Merge "Make Yardstick log level can be set by CLI"Leo wang5-14/+38
2017-09-28Don't generate tar file when run without pushing results to DBxudan1-1/+2
1. Dovetail generate a tar file for uploading results to CVP web portal. 2. If users don't run with option --report, it shouldn't generate the tar file. Because users can not upload results to CVP if they don't run with --report. 3. If it generates the tar file when user run dovetail without --report, the tar file is invalid because it lacks of results.json. JIRA: DOVETAIL-511 Change-Id: I4d21f21f0b278962564d810369df03100b38f003 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-27Merge "Update the script for building local DB and testapi"Leo wang5-667/+31
2017-09-26Update the script for building local DB and testapixudan5-667/+31
1. When test dovetail, users can build local DB and testapi to store and report the results. 2. The script for building local DB and testapi needs some updates. JIRA: DOVETAIL-507 Change-Id: I8bc96bfea27f424468cafaa2e05894065ef44ad9 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-26Bugfix: tar results dir cannot be parsed by web portalxudan1-3/+9
The directory tree of results tar file is wrong, so web portal cannot parse it. Reset the tar file. JIRA: DOVETAIL-508 Change-Id: I8475323294e84ca51242b700570926d5c0177390 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-26Make Yardstick log level can be set by CLIxudan5-14/+38
1. Currently, the log level of yardstick is DEBUG and cannot be modified. 2. Make it can be changed from CLI. 3. When use dovetail run --debug, can see all Yardstick logs (including DEBUG) in dovetail.log. 4. When run without debug option, cannot see Yardstick debug logs in dovetail.logs. 5. yardstick.log always doesn't include debug logs. JIRA: DOVETAIL-506 Change-Id: Iaafb61232a22e16fff2fa4605bf7e262b022085e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-25Support to run mandatory or optional test cases separatelyxudan6-27/+71
1. Currently, dovetail can run a test suite or a test area in that test suite. 2. The test areas in one test suite are not divided into optional and mandatory. 3. Split them and support to run just mandatory or optional. 4. Support to run multiple test areas. JIRA: DOVETAIL-505 Change-Id: I42cd7b4e11c3e3674c806e9bc999b782bf5c85c6 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-25Merge "Replacing references to "DefCore""hongbo tian6-27/+19