summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-12-11Enable ShellRunnerxudan6-117/+49
1. fix the bug 'ShellRunner' object has no attribute 'archive_logs' 2. remove the testarea_supported because it's not very necessary for the test cases themselves and can make it a little more simple to add a test case with new test area JIRA: DOVETAIL-750 Change-Id: I71ee74615200376adca2a0db040753e5fce329bc Signed-off-by: xudan <xudan16@huawei.com>
2018-12-06Update the docs of patrolexudan3-2/+53
JIRA: DOVETAIL-756 Change-Id: Iad2bd02f3991aa3b551b8065ee25cf7b3213c423 Signed-off-by: xudan <xudan16@huawei.com>
2018-12-03Move 2 sub test cases in patrole to optional listxudan3-2/+27
JIRA: DOVETAIL-756 Change-Id: I8931f4b0c83acca24b5220d16e935194d4bc8ae7 Signed-off-by: xudan <xudan16@huawei.com>
2018-11-23Integrate k8s test cassesxudan20-506/+554
In order to integrate k8s test cases, Dovetail framework should do some refactor and make it more general for k8s test cases as well as ONAP ones. Integrate 2 k8s test cases. JIRA: DOVETAIL-748 Change-Id: Ibd87754ffb5fb29f6b4ce79232af860c2ed2da9c Signed-off-by: xudan <xudan16@huawei.com>
2018-11-22Add User Guide per installer - APEXPanagiotis Karalis4-48/+216
Trying to install the dovetail project on APEX, some instructions have been found that are not clear enough. The aim of introduction of new folder and user guide documents for each installer is to make a dovetail deployment easier, using tips and advices that are applicable for each installer respectively. JIRA: DOVETAIL-743 Change-Id: I907b694d859164031b170cb0c7bb4f69b9ec889b Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-11-20Add missing unit tests for report fileStamatis Katsaounis2-19/+1176
JIRA: DOVETAIL-724 This patch adds unit tests for report file methods of Dovetail which were missing. Change-Id: I2ba7c8f9fcfb962988b2904b01538e9f89a0d849 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-20Add missing unit tests for run fileStamatis Katsaounis4-51/+744
JIRA: DOVETAIL-724 This patch adds unit tests for run file methods of Dovetail which were missing. Change-Id: I1700c8c97430899abdc2b752a3dcbd4d09a334ac Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-15Add missing unit tests for testcase fileStamatis Katsaounis2-2/+661
JIRA: DOVETAIL-724 This patch adds unit tests for Tescases classes methods of Dovetail which were missing. Change-Id: Ie1b665249ce8afaa76b59b0dbe7f132e404a5569 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-14Add missing unit tests for test_runner fileStamatis Katsaounis2-8/+660
JIRA: DOVETAIL-724 This patch adds unit tests for Runners classes methods of Dovetail which were missing. Change-Id: Ib985a44db86be02a7b9cefb8deca187bb50e78cc Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-14Add missing unit tests for container fileStamatis Katsaounis2-3/+768
JIRA: DOVETAIL-724 This patch adds unit tests for container class methods of Dovetail which were missing. Change-Id: Iaba3bbfbb8838278e20ac9f63ef6e01f9ada1cbc Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-14Add missing unit tests for cli filesStamatis Katsaounis5-1/+284
JIRA: DOVETAIL-724 This patch adds unit tests for cli methods of Dovetail which were missing. Change-Id: I99c584007659401e298e58aebb1764df1c543894 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-14Add missing unit tests for utils filesStamatis Katsaounis7-29/+1615
JIRA: DOVETAIL-724 This patch adds unit tests which were missing from dovetail code base. Furthermore it updates the test_parser existing unit test. Finally, it fixes some minor issues in dovetail_utils itself. Change-Id: I8fd7cd4f6b1ede11664914746d2279f062511639 Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-14Improve tox testingStamatis Katsaounis5-22/+31
This patch removes unused test requirements. In addition, it runs coverage together with unit tests by py.test. In addition, it adds sone docs links which were missing. Finally, it adds coverage reports to .gitignore file. Change-Id: I68e65781b17929c60fbb3f4c318b1366c35d185f Signed-off-by: Stamatis Katsaounis <mokats@intracom-telecom.com>
2018-11-08Remove the offline scriptsxudan3-156/+0
As we discussed in Dovetail weekly meeting, there is no need to maintain all the offline scripts. Change-Id: I360d1a211856626af91310f142c1777a77398a12 Signed-off-by: xudan <xudan16@huawei.com>
2018-11-07Update BGPVPN and VNF test casesxudan9-60/+60
Due to change to Functest Gambia, bgpvpn and vnf test cases failed. Update the testcases.yaml according to Functest's new format. Change-Id: Ia5d9ba291161f7da84a0aadf241e9ab81d83cfa9 Signed-off-by: xudan <xudan16@huawei.com>
2018-11-06Update classes in report.pyxudan2-48/+46
Change-Id: Ia17bf7ef3e304eef7b3f0b2f7aa04e3be75bc8c3 Signed-off-by: xudan <xudan16@huawei.com>
2018-11-07Update tests based on tempest_customxudan12-11/+36
All tempest_custom test cases should be updated and defined with the new test case config yaml file. Change-Id: Iaff99fcfcef61060a8ca02819cac2763c4bdd2a0 Signed-off-by: xudan <xudan16@huawei.com>
2018-11-01Update classes in testcase.pyxudan3-63/+12
1. Remove the functions which are not called anywhere 2. Change some class methods to be static methods and instance methods Change-Id: I2e754cdff61aa34ffe899e352653ff767d4ac69d Signed-off-by: xudan <xudan16@huawei.com>
2018-10-31Update class in container.pyxudan2-110/+98
Change-Id: I4fb24f86c6d15aea5a62baaca20531b2891437ff Signed-off-by: xudan <xudan16@huawei.com>
2018-10-31CI verify jobs failed due to the update of toxxudan4-11/+9
The LF pod used to run the CI verify jobs have updated the version of tox. So the CI verify jobs failed. See https://build.opnfv.org/ci/view/dovetail/job/dovetail-merge-master/476/console Fix the python format errors Ignore error 'W503 line break before binary operator'. Change-Id: Ic2df070447bbea39c877ce7a394d733a95064bb1 Signed-off-by: xudan <xudan16@huawei.com>
2018-10-25Stop redefine testcases.yaml for some test casesxudan10-235/+46
1. For Functest healthcheck, patrole, refstack_defcore, neutron_trunk and vping test cases, stop to redefine testcases.yaml. 2. For VNF and bgpvpn, they still have scenario dependencies for Functest. How to handle them are still under consideration. 3. For other tempest test cases, they rely on tempest_custom. Leave them under discussion. JIRA: DOVETAIL-673 Change-Id: Ibd10c9883d8df3749f4a93e280deaca77fe6bc00 Signed-off-by: xudan <xudan16@huawei.com>
2018-10-18New PTL for DovetailGeorg Kunz1-9/+9
This patch is used as a basis for voting on the new Dovetail PTL. After the nomination period [1] has ended, there is one candidate [2]. In order to complete the PTL election process, all Dovetail committers shall review this patch and cast a vote (-1, +1). The voting period ends in a week from now on October 24. The vote passes if a majority of committers +1 this patch. [1] https://lists.opnfv.org/g/opnfv-tech-discuss/message/22133 [2] https://lists.opnfv.org/g/opnfv-tech-discuss/message/22145 Change-Id: Iacf53f5c0bbe7e0c5f3c47131569be72ed8623ec Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-10-11Change to Gambia version by using latest docker imagesxudan3-3/+3
Functest use gambia tag. Other projects use their latest one. Change-Id: Ibbfde50727149822d8331d998f6b4e173f19e244 Signed-off-by: xudan <xudan16@huawei.com>
2018-10-04Committer promotion for Panos and StamatisGeorg Kunz1-0/+8
Panos and Stamatis have significantly contributed to Dovetail and projects utilized by Dovetail (e.g. Functest, Dovetail-webporal). Hence, I'd like to propose their promotion to committer. Panos: https://gerrit.opnfv.org/gerrit/#/q/owner:%22Panagiotis+Karalis+%253Cpkaralis%2540intracom-telecom.com%253E%22 Stamatis: https://gerrit.opnfv.org/gerrit/#/q/owner:%22Stamatis+Katsaounis+%253Cmokats%2540intracom-telecom.com%253E%22 Change-Id: Ibed0a5e3dc387d9de63c201db902133bd813c041 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-10-01Bugfix: There is an exception when crawling Yardstick resultsxudan1-1/+2
If there is no pod.yaml, the results data looks like, {"status": 2, "result": "[Errno 2] No such file or directory: u'/home/opnfv/userconfig/pre_config/pod.yaml'"} It will get an exception when reading value from file, File "/usr/local/lib/python2.7/dist-packages/dovetail/report.py", line 327, in crawl_from_file criteria = data['result']['criteria'] TypeError: string indices must be integers https://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-baremetal-default-mandatory-master/52/console Change-Id: I73ca3e5ae73433a2dc139789df4d67e8c583be08 Signed-off-by: xudan <xudan16@huawei.com>
2018-09-30Delete the invalid url which causes jenkins-ci failedxudan1-6/+2
For Functest, it uses Shade instead of openstack python client. Remove the link of openstack python client and replace with shade. Change-Id: I5660ecdc243468a1da7854cde3a98ce424dbffe4 Signed-off-by: xudan <xudan16@huawei.com>
2018-09-24Update link to participation formGeorg Kunz2-2/+2
Change-Id: Ice4ac73f8ea7253e5ad510796486afa129f26699 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-21Updating the container tags of the test projectsGeorg Kunz5-48/+47
Setting the container versions of the test tools to a specific release tag. Change-Id: I3422be006ff80035cecc9ec22eba50b02ed97be6 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-20Eliminating docs build warningGeorg Kunz1-8/+12
Eliminating a build warning from the Tempest volume description and aligning its layout with other test case descriptions. Change-Id: Idb9ba8d77ef3cb7e14a5b24a8a81622fa0e3e30d Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-20Updating the link to the updated participation formGeorg Kunz2-2/+2
Updating all links to the new participation form. Change-Id: I41811fff3516ed5c8c91fbee16a3b50d432258d4 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-19Reviewers Guide document for fraser release.dimitris.tsiolakis10-4/+4
Images have been updated to depict the latest changes in Dovetail Web portal. Change-Id: I4dc928141856fab34670272fcc465bea3f6156db Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
2018-09-17Adapting local docs build and remove build warningsGeorg Kunz19-640/+341
The OPNFV docs project will remove its submodules and enable local docs builds. This patch prepares the Dovetail repo according to the official transition guide: https://docs.opnfv.org/en/latest/how-to-use-docs/local-build-transition.html This patch also applies syntactical changes which eliminate the sphinx doc build warnings. Change-Id: Ief8fd2d1c3e39b232d214a9ab392879ee4a492c8 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-17Align testcase formats and complete volume testcase descriptions.louie.long1-12/+80
Change-Id: Ie7497f6e5ef79726d8cbbcd9f05bffa2aac6c8b8 Signed-off-by: louie.long <longyu805@163.com>
2018-09-13Update code base and docs to 2018.09xudan11-52/+51
The official name of the next release is going to be 2018.09. We need to rename all occurrences of 2018.08 in the code base, the documentation, and the web portal. JIRA: DOVETAIL-740 Change-Id: Ie0e532d6671b7590454e9afd960a2934f313a022 Signed-off-by: xudan <xudan16@huawei.com>
2018-09-10Remove neutron trunk test cases with href linksxudan1-2/+0
There is a bug with neutron when using href links to get url. This is fixed with Pike. This is the patch, https://review.openstack.org/#/c/356707/ These are the related files of Ocata and Pike, https://github.com/openstack/neutron/blob/stable/ocata/neutron/api/api_common.py#L68 https://github.com/openstack/neutron/blob/stable/pike/neutron/api/api_common.py#L95 There are 2 test cases in neutron trunk related to this. Remove these 2 test cases since Dovetail should support 4 versions from M to P. Change-Id: I8aac88e4688157def1d6642eaa64bba56dde49ba Signed-off-by: xudan <xudan16@huawei.com>
2018-09-05Enable the web portal to show all endpointsxudan2-11/+29
The endpoints info for the 2018.08 has been changed. The web portal needs some adaptions for the new data format. It keeps the same as 2018.01 and doesn't need to change dovetail-webportal. JIRA: DOVETAIL-725 Change-Id: I74cde3aa6032c7afac4b6ce1d2146e09a0f99fe5 Signed-off-by: xudan <xudan16@huawei.com>
2018-09-04Update test list for OS interop testsGeorg Kunz2-6/+2
The OpenStack Interop WG has recently deprecated [1] 4 cinder volume reservation tests. As a result, they are not part of Functest's set of interop tests anymore. This patch cleans up the test case validation list for the web portal. [1] https://review.openstack.org/#/c/583970/ Change-Id: I183602b099cb4d44c6cb3d21af6acaa4d3ee01ca Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-09-03Remove identity v2 TCs,not supported by FunctestPanagiotis Karalis9-96/+0
As Functest does not support identity v2 anymore, it does not make sense to try to run tempest identity v2 tests. They need to be removed correspondingly. JIRA: DOVETAIL-735 Change-Id: I09c06faf52893cc535bbed1fd406b81a7665e787 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-08-31Reviewer guide update for OVP 2018.08 releasedimitris.tsiolakis23-113/+126
JIRA: DOVETAIL-701 Change-Id: I940bdd16762dd36ee338f41e5b2aab352c70600f Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
2018-08-31Updating OVP addendum doc for 2018.09 releaseGeorg Kunz1-202/+200
Updating the OVP addendum document for the next release. JIRA: DOVETAIL-733 Change-Id: I7b7679f96bff4837f69769bb71256bc30602dced Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-29Updating test case requirementsGeorg Kunz1-18/+15
Updating the test case requirements document to match the new test case naming convention which was introduced for the 2018.08 release. Additionally, minor syntactic fixes. Change-Id: I34b4b90eb4f8bab4f59df2415c98c27169e98332 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-29Release notes for OVP 2018.08 releasedimitris.tsiolakis1-175/+137
JIRA: DOVETAIL-700 Change-Id: I6835a6d6987d8e45c85fab851304a455db3ab0d6 Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
2018-08-28Change Bottlenecks volume mappingxudan2-1/+4
If mapping to host's /tmp, it won't clean all .log and .out files before run a new test. It causes the results file including all previous results. See https://build.opnfv.org/ci/view/dovetail/job/dovetail-apex-baremetal-default-mandatory-master/26/artifact/results/stress_logs/bottlenecks.stress.ping.out/*view*/ It will affect the results check. Mapping to DOVETAIL_HOME/results/bottlenecks, which will always be cleaned before running another test. Change-Id: I22bfc871d6f041ae38308bf8e8f685993a376973 Signed-off-by: xudan <xudan16@huawei.com>
2018-08-27Shortening headings and testing building of docsGeorg Kunz4-12/+12
This patch shortens the headings and is used to test if the docs tool chain builds the right version. Change-Id: Ibc162be1b46ff787a90510c360881234391c5ba7 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-22Add a volume mapping for Bottlenecksxudan1-0/+1
All results files including the .out files are stored in Yardstick /tmp Need to map that with host's /tmp to parse the results. JIRA: DOVETAIL-727 Change-Id: I5a81e6e6bdf79b2e0074df505deb425c37b93300 Signed-off-by: xudan <xudan16@huawei.com>
2018-08-20Bottlenecks SSH connectivity brokenxudan1-1/+1
For ping, it set the ssh login username to be ubuntu. So need to use ubuntu image rather than cirros. JIRA: DOVETAIL-727 Change-Id: Iaac8c8280a464efe3a431d4eb260c4a0a626e12d Signed-off-by: xudan <xudan16@huawei.com>
2018-08-14Rename ovp.next to be ovp.2018.08xudan5-10/+10
Change-Id: I32aaee370512c3d7c8d6e1fbb6ef25aebc5d483f Signed-off-by: xudan <xudan16@huawei.com>
2018-08-14Test case descriptions for Tempest smoke testsdimitris.tsiolakis7-1/+506
Adding a high-level description of the Tempest smoke tests. As agreed on the last Dovetail call, we are aiming for a relatively low level of detail and instead point to available documentation. As the tests themselves are quite simple of read, this is the best, most concise, and up-to-date version of documentation we can find. JIRA: DOVETAIL-599 Change-Id: I985592c55fd415e254e70db6c6480c7bf3670a29 Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
2018-08-14Update cli reference guidexudan1-47/+115
JIRA: DOVETAIL-713 Change-Id: Ie740c8bf24c297c2537b23e1d35e0b4d40cd3e35 Signed-off-by: xudan <xudan16@huawei.com>
2018-08-13Remove one sub test cases from neutron trunkxudan1-1/+0
There is one sub test case that can't work correctly on Mitaka, neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description It will get a 'Bad request' error. Details: {u'message': u"Unrecognized attribute(s) 'description'", u'type': u'HTTPBadRequest', u'detail': u''}. That's mainly because of that, For Mitaka, there's only several extension resources that support attribute 'description', which is 'security_group_rules', 'security_groups', 'ports', 'subnets', 'networks', 'routers', 'floatingips' and 'subnetpools'. All other extension resources including trunk port can't create with description. See https://github.com/openstack/neutron/blob/mitaka-eol/neutron/extensions/standardattrdescription.py#L22 For Newton, all subclasses of class 'HasStandardAttributes' support the attribute 'description' including class Trunk. See https://github.com/openstack/neutron/blob/newton-eol/neutron/extensions/standardattrdescription.py#L49, https://github.com/openstack/neutron/blob/newton-eol/neutron/db/standard_attr.py#L158 and https://github.com/openstack/neutron/blob/newton-eol/neutron/services/trunk/models.py#L26 JIRA: DOVETAIL-723 Change-Id: Ifdfea7c54a1888d933c8ddd78a6feea1db93368c Signed-off-by: xudan <xudan16@huawei.com>