summaryrefslogtreecommitdiffstats
path: root/docs/submodules/dovetail
AgeCommit message (Collapse)AuthorFilesLines
2018-08-02Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Test case descriptions for Neutron Trunk Port tests Adding a high-level description of the Neutron trunk port tempest tests. As agreed on the last Dovetail call, we are aiming for a relatively low level of detail and instead point to available documentation. As the tempest tests themselves are quite simple of read, this is the best, most concise, and up-to-date version of documentation we can find. JIRA: DOVETAIL-684 Change-Id: I76801b34f974bf7c77fded3ffa5588b7e5b2803c Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-01Update git submodulesMika Rautakumpu1-0/+0
* Update docs/submodules/dovetail from branch 'master' - First test case description for HA tests This is one of three test case descriptions from jira ticket. Test case description is TC010 it is TC056 in yardstick. JIRA: DOVETAIL-605 Change-Id: I70afa882a667a6932aa7ec29bc5e0621b43fa0a4 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-08-01Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Dovetail should update testcases.yaml file It failed to run trunk_port test case because of the wrong class name. See CI results https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-default-mandatory-fraser/7/artifact/results/tempest_logs/dovetail.tempest.neutron_trunk_ports.functest.log/*view*/ Update the testcases.yaml file based on the latest version of Functest Fraser. JIRA: DOVETAIL-715 Change-Id: Ib102d1489d1e5610a04d76aab0553d5171ec3d3e Signed-off-by: xudan <xudan16@huawei.com>
2018-08-01Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Renaming test cases to include test framework names Replacing the generic "dovetail" prefix of the testcase definitions with the name of the OPNFV test framework which hosts the test. JIRA: DOVETAIL-719 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> Change-Id: I8f90423b8908197bdc7adddf82c61ff394893f52
2018-07-30Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Dovetail failed to archive tempest.log and tempest-report.html files It failed to archive tempest.log and tempest-report.html files. See CI results https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-default-mandatory-fraser/7/artifact/results/ That's because the path of them have been changed 1. from tempest to tempest_custom 2. from refstack to refstack_defcore There seems to be no file bgpvpn.log, remove the copy operation. JIRA: DOVETAIL-714 Change-Id: I77d88124a44d3e5d869ada209760f69d1f6553bf Signed-off-by: xudan <xudan16@huawei.com>
2018-07-27Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Delete 2 sub test cases from patrole These 2 test cases failed on OSP10 with reasons 1. Provided object does not match schema 'image': u'shared' is not one of ['public', 'private'] 2. Provided object does not match schema 'image': u'community' is not one of ['public', 'private'] 'shared' and 'community' was added in the Image API v2.5 https://developer.openstack.org/api-ref/image/v2/index.html#images JIRA: DOVETAIL-704 Change-Id: Ie7ab06d5e2abe7bde25fdb7318abe341f0119bc7 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-27Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update bottlenecks conf 1. Copy a ubuntu image to Bottlenecks to support offline 2. Add an env DEPLOY_SCENARIO to bottlenecks to support DPDK 3. Set push results to DB False JIRA: DOVETAIL-706 JIRA: DOVETAIL-707 Change-Id: I81f293bb9fddc63fd8be455546ba4642ca670fc7 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-27Update git submodulesPanagiotis Karalis1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Create a test specification for vIMS test case New test specification has been created for dovetail project. Test descriptions is related to cloudify_ims test case of functest project. JIRA: DOVETAIL-699 Change-Id: I033351ad7cf83256bd7a9e208a7ce406d5a4cd2b Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-26Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Cleaning up proposed-tests test suite We have moved all newly proposed tests to the next OVP test suite, so these tests do not need to be in here anymore - and do not need to be run in CI. Change-Id: I5f51b76a37b706c5b4abc75272ad799a72841f67 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-07-25Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Move OVP web portal code to a separate repo The new repo for web portal is https://gerrit.opnfv.org/gerrit/dovetail-webportal JIRA: DOVETAIL-671 Change-Id: Iac085abc3d175b9a091d70d0448af56c7a6845e9 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-25Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Making the results file a proper json file The results.json file is currently not a properly formated json file, but contains one json structure per line/testcase. Whit this change, all test results are being collected at runtime and then written to a properly formated json file at the end of a test run. Moreover, this patch introduces 'mandatory' and 'optional' sections to the test suites definition files in order to clearly indicate if a test is part of the corresponding test scope. The web portal needs to be adapted accordingly to be able to read the new results file. JIRA: DOVETAIL-672 Change-Id: Id0706c7e82622fc9c2c2fece26b2d6c07c1580be Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-07-24Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Delete skipped sub test cases from patrole and neutron_trunk check list According to Apex, Compass, Fuel CI results, delete the skipped sub test cases from patrole and trunk_port check list. JIRA: DOVETAIL-703 Change-Id: I86e3036a287d9cf56d78e43f92ce0d9ffed5941c Signed-off-by: xudan <xudan16@huawei.com>
2018-07-23Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Remove functest_testsuite and functest_testcase in dovetail_config.yml The 2 sections 'functest_testsuite' and 'functest_testcase' are used by all Functest test cases. They aim to parse the results of Tempest sub test cases. Remove them, and check the sub test case list, 1. if it's empty, that means no need to check sub test cases 2. if it is not empty, check the sub test cases one by one. Additional, remove some useless keys in dovetail_config.yml JIRA: DOVETAIL-658 Change-Id: Ic829264b0c8eaedd8e2b3fa55b38a34644482c20 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-18Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Create test case descriptions for Bottlenecks stress test This is coming from the former patch https://gerrit.opnfv.org/gerrit/#/c/37715/ JIRA: DOVETAIL-631 Change-Id: Ibe090fefaa92cb3fe6d7c3d96296724e8cfbcf1d Signed-off-by: xudan <xudan16@huawei.com>
2018-07-18Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update test suite ovp.next Update test suite ovp.next according to the latest OVP scope. Modify Dovetail daily jobs to run all the scope. There should be 2 jobs. One for all mandatory test cases and the other for all optional ones. That's mainly because of that the total executed time will be too large (more than 300 minutes). Then the job will always failed because of time out. It's hard to enlarge the time because it's already larger than common 3 hours. Split it into 2 jobs can avoid the time out issue and make the results clearer for reviewing. JIRA: DOVETAIL-694 Change-Id: Ie0ea6221868941781af1477f7c7719f7cb4351a4 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-17Update git submodulesPanagiotis Karalis1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Create a test specification for vEPC test case New test specification has been created for dovetail project. Test descriptions is related to vEPC test case. JIRA: DOVETAIL-679 Change-Id: I72228f7f59a4aa704a620351ad8727c1b948dc66 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-16Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Test case description for BGPVPN Tempest API tests Adding test case descriptions for the BGPVPN API tests which are implemented as Tempest plugin in the networking-bgpvpn repository. These tests have already been integrated for Euphrates into Functest test and are hence a candidate for inclusion in the test scope of the OVP Euphrates release as extension of the existing SDNVPN test cases. JIRA: DOVETAIL-598 Change-Id: Id8578ed1e198ddbde967793737c69a5940c22475 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-07-16Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update cirros image for bottlenecks The fraser-based OPNFV tools use the newer cirros-0.4.0 image and we hence only ask users to download this version in the user guide. This updates the bottlenecks test to comply with this. Change-Id: I5a94d6a7196ae04e00150dc17a4a16add2d3fef6 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-07-13Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Remove the yardstick_tag and functest_tag These 2 commands can't work now. Also there is no need to support them, so remove them. JIRA: DOVETAIL-695 Change-Id: I6707c7fc1d19fe06690cd14ef39f9d421d00a2bc Signed-off-by: xudan <xudan16@huawei.com>
2018-07-13Update git submodulesPanagiotis Karalis1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Enable OVP tests to run on a DPDK-enabled system DPDK-enabled NFVIs require support for hugepages which in turn is configured by means of extra_specs in flavors. Currently, Functest enables hugepage support if the name of the scenario contains the substring "ovs". Dovetail allows end users to run all tests on DPDK-enabled systems and the documentation has been updates accordingly. JIRA: DOVETAIL-665 Change-Id: If4898da168f8b4c69a045ef3b00b8a8862f29b0c Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-11Update git submodulesPanagiotis Karalis1-0/+0
* Update docs/submodules/dovetail from branch 'master' - CI ERROR - File contains violation on test_runner Proposed solution by CI server: "Avoid dangerous file parsing & serialization libs, use yaml.safe_load" Change-Id: Iff9764601bc135cec271e16444d0bbbb4da8d459 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-10Update git submodulesPanagiotis Karalis1-0/+0
* Update docs/submodules/dovetail from branch 'master' - New test specs for ha database/controller_restart New test specifications have been created for dovetail project. Test descriptions are related to test cases: - dovetail.ha.database - dovetail.ha.controller_restart JIRA: DOVETAIL-680 JIRA: DOVETAIL-681 Change-Id: I632cb69f9166a46e76f38a467f078fe5f31b63b3 Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-06Update git submodulesTrevor Bramwell1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Add dovetail-webportal repo to INFO file Listing Change-Id: I429e5bb1dffb1c63301ad5e9aba34d08d788ca27 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-07-04Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update all existing test specifications 1. Update the names of 2 vping test cases 2. Update the names of 8 ha test cases 3. Update the sub test cases within osinterop 2017.09 4. Split IPv6 into ipv6_api and ipv6_scenario 5. Update the names of sdnvpn test cases 6. Update the names of 4 tempest scenario test cases 7. Remove forwardingpackets JIRA: DOVETAIL-685 Change-Id: I0d91b8a0477576e18581eb2788fdb666063c89b7 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-03Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Adapt Yardstick fraser Yardstick fraser has changed from openstack python client to shade. OS_INSECURE is not a key for shade. It needs to be OS_VERIFY. Change-Id: I0973853d0527b04ec371ad4f6ce2f6c67ef50ccf Signed-off-by: xudan <xudan16@huawei.com>
2018-07-02Update git submodulesPanagiotis Karalis1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Fix syntax error on clean_results_dir method Change-Id: I9f33bb320452efab79be5a22e625efac820183eb Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
2018-07-02Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Splitting the networking tests in API and scenario tests Split the networking tempest test case in Tempest API tests and scenario tests. The API tests will be promoted to mandatory while the scenario tests will remain optional. JIRA: DOVETAIL-678 Change-Id: I03022316076809536782e82fd531d98f45105caa Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-29Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Removing unused test suite and updating debug test suite The compliance_set test suite is not used. Updating the description of the debug test suite. Change-Id: Id2c3ca922ffb083f3443e00e5ca1a0648aec3e4a Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-29Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update licence headers to comply with guidelines Updating the licence headers to comply with the community guidelines [1] and anteater checks. [1] https://wiki.opnfv.org/display/DEV/Contribution+Guidelines#ContributionGuidelines-License Change-Id: Idec787e32daf76c0b1bd6108977b78828125da5e Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-29Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Splitting IPv6 tests in API and scenario tests Spliting the IPv6 test case in Tempest API tests and scenario tests. The API tests will be promoted to mandatory while the scenario tests will remain optional. JIRA: DOVETAIL-677 Change-Id: If3dca5ecf2ce5c9e02de5c6d45e674da029b609f Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-28Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Fixing a typo in the API validation warning of the web portal. Change-Id: I0489d1e2fbd53bc90c24781a9d62140e2299c5a4 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-20Update git submodulesEddie Arrage1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update OVP portal docker images for missing package - The missing futures packages was added in patch: https://gerrit.opnfv.org/gerrit/#/c/58833/ - The patch above does resolve the issue and has been valdiated on a development instance. - The issue was likely introduced in patch https://gerrit.opnfv.org/gerrit/#/c/56623/ Change-Id: I850947e386024e6b65514bdb518799c359234811 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-06-20Update git submodulesTrevor Bramwell1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Add Missing Futures Package This is needed by the motor package. Change-Id: Ie19958040bc026b834fd3891da3a205cb248df92 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-20Update git submodulesTrevor Bramwell1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update CVP Container Tags These include updates for the new web portal. Change-Id: I2951c8a1b00947a4546b4f90440ff8e0af8640e4 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-20Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Adding IDs to the list of OpenStack interop tests In Fraser, the RefStack / OpenStack interop tests are executed through Rally in Functest. Rally requires the fully qualified name of a tempest test, including its tier and ID, in order to find and run it. This patch add the missing information. JIRA: DOVETAIL-662 Change-Id: I3a38b7b8d0fe79dd6ad0c0023c62c6647611d231 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-19Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Removing test_mtu_sized_frames Tempest test This test fails in CI on all installers (Apex, Compass, Fuel) and on virtual deployments. Change-Id: I3a451e880c2a5d2151cb88aaf8e5a6895368e63b Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-19Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Create specific flavor for neutron-l3-agent HA test The neutron-l3-agent test assumes that a default image and flavor are available. On current OPNFV deployments, these resources do not exist anymore by default and hence the test case fails. This patch enables Dovetail to create a specific flavor as part of the test case config. This is temporary workaround until the test case itself takes care of checking and creating all resources needed. A ticket for the HA project has been created accordingly: https://jira.opnfv.org/browse/HA-36 Change-Id: I6523d8411fe853a5645566b2fabe1409b5715491 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-19Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Running BGPVPN Tempest tests as tempest_custom test We need to disable one BGPVPN tempest test due to a bug in ODL. Since the SDNVPN test framework does not allow for disabling a single test case, we are switching to tempest_custom. Change-Id: Ifbd7c1dc5e799d6a6c774e08e9fc1a3b2294b47c Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-15Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Copy tempest_conf.yaml file for neutron_port and patrole Change-Id: I58e37c14cb4a287436e86b345919deff3d3674d0 Signed-off-by: xudan <xudan16@huawei.com>
2018-06-15Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Cosmetic cleanup of tempest test case lists There are some superflouos lines separating the list of tempest test cases. These are restructuring artifacts which can be deleted. Change-Id: I7b3474090fa3d7b1506d5a4f3dcd1b32dd68900a Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-14Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Replace openstack commands with shade Use openstack shade to get endpoint infomation rather than executing openstack commands directly. The next step can replace openstack commands by shade for some test cases that need to create openstack resources (images, flavors) if we agree to use shade. JIRA: DOVETAIL-659 Change-Id: I72b302fb2d4a61e9249a7e53f81ea9464944dcd3 Signed-off-by: xudan <xudan16@huawei.com>
2018-06-08Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Upgrading image version of HA test of neutron L3 agent In line with the updated documentation, this patch upgrades the cirros image from version 0.3.5 to 0.4.0 of the HA neutron-l3-agent test Change-Id: I352e861f3d3099491ff6f367a3129dc8f3115394 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-07Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Updating the API response validation patch Functest has switched from Tempest 14 in Danube to 17.1.0 in Fraser. This updates the patch used to disable strict API response validation. Change-Id: Ief47eba3bc91c222d5ad30e65ab1fdaf39fc169e Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-06-07Update git submodulesEddie Arrage1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Add improvements to OVP directory and logo upload - Formatting changes to directory on home page based on OPNFV marketing - Updated branding guide link - Added test_id field to mongo applications collection to associate to approved results for directory - Set Test ID from user accounts with administrator role in Applications view - Provide file upload function for administrator to post company logos for OVP directory - Company logos are stored and served through tornado from cvp-cvpapi container rather than cvp-web JIRA: DOVETAIL-663 JIRA: DOVETAIL-664 Change-Id: I1226b42883afa2ea2eb5551e3836211abbb94b20 Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
2018-06-07Update git submodulesMiikka Koistinen1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Make exit status a constant in run.py JIRA: DOVETAIL-625 Change-Id: Ib96e6e39bad708f495af97ed43884909e394da10 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-06-06Update git submodulesMiikka Koistinen1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Fix error status when executing CLI run command This commit fixes CLI run command to exit with non-zero exit status when bad arguments are given for '--testsuite' or '--testarea'. JIRA: DOVETAIL-660 Change-Id: I4539b19978d9e93d8a90be9000f36d0aa1895f71 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-06-06Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Correct reporting of vEPC test case The configuration of the vEPC test case was missing information for generating a correct report and hence it incorrectlt reported FAILed despite passing. JIRA:DOVETAIL-666 Change-Id: Id296fa0fd750e47dc841ef37acb2018b23de0643 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-29Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Adding reference to EXTERNAL_NETWORK to user guide Adding a reference to the EXTERNAL_NETWORK environment variable to the user guide so that users add this to their env_config.sh. This variable is required, among others, to overwrite the default external network in Yarstick. Change-Id: I50e609a8c6e20b1dd01c61d5d950ffba792e98fa Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-29Update git submodulesGeorg Kunz1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Adding vEPC test case to Dovetail and proposed_tests suite Adding the vEPC test case to Dovetail. The test deploys a vEPC using Juju as VNF manager and performs application level tests. JIRA: DOVETAIL-650 Change-Id: I15c2cdddee510e12a5faf18efc8950af5cf7b664 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-28Update git submodulesxudan1-0/+0
* Update docs/submodules/dovetail from branch 'master' - Update user guide 1. Remove python related content because python is installed in Dovetail image. 2. Remove DB related content because there is no need to launch local DB now. 3. Update the infomation of Docker images and VM images. Change-Id: I010d3341aef9f2c74713fc0fc087b361331109d1 Signed-off-by: xudan <xudan16@huawei.com>