Age | Commit message (Collapse) | Author | Files | Lines |
|
* Update docs/submodules/dovetail from branch 'master'
- Remove the yardstick_tag and functest_tag
These 2 commands can't work now.
Also there is no need to support them, so remove them.
JIRA: DOVETAIL-695
Change-Id: I6707c7fc1d19fe06690cd14ef39f9d421d00a2bc
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Enable OVP tests to run on a DPDK-enabled system
DPDK-enabled NFVIs require support for hugepages which
in turn is configured by means of extra_specs in flavors.
Currently, Functest enables hugepage support if the name
of the scenario contains the substring "ovs".
Dovetail allows end users to run all tests on DPDK-enabled systems
and the documentation has been updates accordingly.
JIRA: DOVETAIL-665
Change-Id: If4898da168f8b4c69a045ef3b00b8a8862f29b0c
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- CI ERROR - File contains violation on test_runner
Proposed solution by CI server:
"Avoid dangerous file parsing & serialization libs, use yaml.safe_load"
Change-Id: Iff9764601bc135cec271e16444d0bbbb4da8d459
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- New test specs for ha database/controller_restart
New test specifications have been created for dovetail project.
Test descriptions are related to test cases:
- dovetail.ha.database
- dovetail.ha.controller_restart
JIRA: DOVETAIL-680
JIRA: DOVETAIL-681
Change-Id: I632cb69f9166a46e76f38a467f078fe5f31b63b3
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Add dovetail-webportal repo to INFO file Listing
Change-Id: I429e5bb1dffb1c63301ad5e9aba34d08d788ca27
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Update all existing test specifications
1. Update the names of 2 vping test cases
2. Update the names of 8 ha test cases
3. Update the sub test cases within osinterop 2017.09
4. Split IPv6 into ipv6_api and ipv6_scenario
5. Update the names of sdnvpn test cases
6. Update the names of 4 tempest scenario test cases
7. Remove forwardingpackets
JIRA: DOVETAIL-685
Change-Id: I0d91b8a0477576e18581eb2788fdb666063c89b7
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adapt Yardstick fraser
Yardstick fraser has changed from openstack python client to shade.
OS_INSECURE is not a key for shade.
It needs to be OS_VERIFY.
Change-Id: I0973853d0527b04ec371ad4f6ce2f6c67ef50ccf
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Fix syntax error on clean_results_dir method
Change-Id: I9f33bb320452efab79be5a22e625efac820183eb
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Splitting the networking tests in API and scenario tests
Split the networking tempest test case in Tempest API tests and scenario
tests. The API tests will be promoted to mandatory while the scenario
tests will remain optional.
JIRA: DOVETAIL-678
Change-Id: I03022316076809536782e82fd531d98f45105caa
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Removing unused test suite and updating debug test suite
The compliance_set test suite is not used. Updating the description of
the debug test suite.
Change-Id: Id2c3ca922ffb083f3443e00e5ca1a0648aec3e4a
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Update licence headers to comply with guidelines
Updating the licence headers to comply with the community guidelines [1]
and anteater checks.
[1] https://wiki.opnfv.org/display/DEV/Contribution+Guidelines#ContributionGuidelines-License
Change-Id: Idec787e32daf76c0b1bd6108977b78828125da5e
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Splitting IPv6 tests in API and scenario tests
Spliting the IPv6 test case in Tempest API tests and scenario tests. The
API tests will be promoted to mandatory while the scenario tests will
remain optional.
JIRA: DOVETAIL-677
Change-Id: If3dca5ecf2ce5c9e02de5c6d45e674da029b609f
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Fixing a typo in the API validation warning of the web portal.
Change-Id: I0489d1e2fbd53bc90c24781a9d62140e2299c5a4
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Update OVP portal docker images for missing package
- The missing futures packages was added in patch:
https://gerrit.opnfv.org/gerrit/#/c/58833/
- The patch above does resolve the issue and has
been valdiated on a development instance.
- The issue was likely introduced in patch
https://gerrit.opnfv.org/gerrit/#/c/56623/
Change-Id: I850947e386024e6b65514bdb518799c359234811
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Add Missing Futures Package
This is needed by the motor package.
Change-Id: Ie19958040bc026b834fd3891da3a205cb248df92
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Update CVP Container Tags
These include updates for the new web portal.
Change-Id: I2951c8a1b00947a4546b4f90440ff8e0af8640e4
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adding IDs to the list of OpenStack interop tests
In Fraser, the RefStack / OpenStack interop tests are executed through
Rally in Functest. Rally requires the fully qualified name of a tempest
test, including its tier and ID, in order to find and run it. This patch
add the missing information.
JIRA: DOVETAIL-662
Change-Id: I3a38b7b8d0fe79dd6ad0c0023c62c6647611d231
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Removing test_mtu_sized_frames Tempest test
This test fails in CI on all installers (Apex, Compass, Fuel) and on
virtual deployments.
Change-Id: I3a451e880c2a5d2151cb88aaf8e5a6895368e63b
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Create specific flavor for neutron-l3-agent HA test
The neutron-l3-agent test assumes that a default image and flavor are
available. On current OPNFV deployments, these resources do not exist
anymore by default and hence the test case fails.
This patch enables Dovetail to create a specific flavor as part of the
test case config. This is temporary workaround until the test case
itself takes care of checking and creating all resources needed. A
ticket for the HA project has been created accordingly:
https://jira.opnfv.org/browse/HA-36
Change-Id: I6523d8411fe853a5645566b2fabe1409b5715491
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Running BGPVPN Tempest tests as tempest_custom test
We need to disable one BGPVPN tempest test due to a bug in ODL. Since
the SDNVPN test framework does not allow for disabling a single test
case, we are switching to tempest_custom.
Change-Id: Ifbd7c1dc5e799d6a6c774e08e9fc1a3b2294b47c
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Copy tempest_conf.yaml file for neutron_port and patrole
Change-Id: I58e37c14cb4a287436e86b345919deff3d3674d0
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Cosmetic cleanup of tempest test case lists
There are some superflouos lines separating the list of tempest test
cases. These are restructuring artifacts which can be deleted.
Change-Id: I7b3474090fa3d7b1506d5a4f3dcd1b32dd68900a
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Replace openstack commands with shade
Use openstack shade to get endpoint infomation rather than executing
openstack commands directly.
The next step can replace openstack commands by shade for some test cases that
need to create openstack resources (images, flavors) if we agree to use shade.
JIRA: DOVETAIL-659
Change-Id: I72b302fb2d4a61e9249a7e53f81ea9464944dcd3
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Upgrading image version of HA test of neutron L3 agent
In line with the updated documentation, this patch upgrades the cirros
image from version 0.3.5 to 0.4.0 of the HA neutron-l3-agent test
Change-Id: I352e861f3d3099491ff6f367a3129dc8f3115394
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Updating the API response validation patch
Functest has switched from Tempest 14 in Danube to 17.1.0 in Fraser.
This updates the patch used to disable strict API response validation.
Change-Id: Ief47eba3bc91c222d5ad30e65ab1fdaf39fc169e
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Add improvements to OVP directory and logo upload
- Formatting changes to directory on home page based
on OPNFV marketing
- Updated branding guide link
- Added test_id field to mongo applications collection
to associate to approved results for directory
- Set Test ID from user accounts with administrator
role in Applications view
- Provide file upload function for administrator to
post company logos for OVP directory
- Company logos are stored and served through tornado
from cvp-cvpapi container rather than cvp-web
JIRA: DOVETAIL-663
JIRA: DOVETAIL-664
Change-Id: I1226b42883afa2ea2eb5551e3836211abbb94b20
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Make exit status a constant in run.py
JIRA: DOVETAIL-625
Change-Id: Ib96e6e39bad708f495af97ed43884909e394da10
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Fix error status when executing CLI run command
This commit fixes CLI run command to exit with non-zero exit status
when bad arguments are given for '--testsuite' or '--testarea'.
JIRA: DOVETAIL-660
Change-Id: I4539b19978d9e93d8a90be9000f36d0aa1895f71
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Correct reporting of vEPC test case
The configuration of the vEPC test case was missing information for
generating a correct report and hence it incorrectlt reported FAILed
despite passing.
JIRA:DOVETAIL-666
Change-Id: Id296fa0fd750e47dc841ef37acb2018b23de0643
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adding reference to EXTERNAL_NETWORK to user guide
Adding a reference to the EXTERNAL_NETWORK environment variable to the
user guide so that users add this to their env_config.sh. This variable
is required, among others, to overwrite the default external network in
Yarstick.
Change-Id: I50e609a8c6e20b1dd01c61d5d950ffba792e98fa
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adding vEPC test case to Dovetail and proposed_tests suite
Adding the vEPC test case to Dovetail. The test deploys a vEPC using
Juju as VNF manager and performs application level tests.
JIRA: DOVETAIL-650
Change-Id: I15c2cdddee510e12a5faf18efc8950af5cf7b664
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Update user guide
1. Remove python related content because python is installed in Dovetail image.
2. Remove DB related content because there is no need to launch local DB now.
3. Update the infomation of Docker images and VM images.
Change-Id: I010d3341aef9f2c74713fc0fc087b361331109d1
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Archive all test case result files
1. All detailed tempest test cases results are recorded with
file tempest-report.html rather than tempest.log now.
2. Archive all results files include functest.log, yardstick.log ...
for each test case. Otherwise, they will all be in one log file.
3. Support to set the source files and dest files need to be archived with
the test case config files rather than hardcode with the source code.
4. Give the file which used to be parse the results (PASS/FAIL) with the
test case config files rather than hardcode with the source code.
Change-Id: I30f435d91ab90cf20def47007f177fe98187484d
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Changing the link to the updated participation form
The participation form on docusign has changed due to incorporating
additional fields for the API validation exemption. This patch updates
the links in the documentation accordingly.
Note: this patch should only me merged after the new form is online.
Change-Id: I697fa13d9afe2797faba2bf0478bbf27820bca20
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Implemented directory within OVP portal
- Added OVP directory to portal home page as summary view to
showcase vendors offerings that have received marks
- Each row of table in directory summary represents a product
offering that has received compliance verification marks and
will be ordered by approve date
- Currently, a vendor with multiple products will be displayed as
separate rows, as agreed by OPNFV marketing
- Added new angular component/controller for OVP directory secondary
drill-down view, which provides more detailed info including
Description, Product Info, SUT HW Version (optional from vendor)
and SUT Version. Product info links to product_documentation field
in Applications collection but can be improved as requirements are
flushed out
- Added new db fields to existing applications collection in mongodb
- Applications collection is fetched on home page and detailed
directory views
- Updated Applications management view (administrator role) with
new db fields including description, ovp_category, ovp_version,
company_logo, approve_date, approved, sut_version, sut_hw_version,
allowing admin to delete and add back with updates.
- Updated participation form link for exemption process addition
- Consider for another patch - upload form for company logos in
Applications view for administrator to add. The initial wave of logos
will need to be included in the patch for now when available
from OPNFV marketing
- Consider for another patch - improve 'Product Info' field to
accept HTML as input allowing administrator to add raw HTML in
mongod
- Consider for another patch - update an existing application
for admin role in Applications view rather than forcing a
delete/add operation for an update
Change-Id: I41d08a7164ee4513106bd09ea30d20be5abd911e
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Updating user guide with new ssh key config in pod.yaml
Dovetail does not copy the ssh key from pre_config to /root/.ssh anymore
inside Yardstick but instead, we point the pod.yaml file directly to the
key inside the pre_config directory.
JIRA: DOVETAIL-655
Change-Id: I23156d8940194547363bcf9a5cc581aab0d5c640
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Bugfix the name of test case dovetail.neutron_l3_agent
CI broken because of the wrong test case name.
https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-master/294/console
Change-Id: I6674acf92c8f67ae2bd8dba082186a16211dcd8a
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Got an exception when test suite is empty
1. Return empty test case list when test suite is empty.
2. Don't quite understand why comment out all proposed_tests.
3. Move stress ping test case at the end of the list,
because it may broken the message queue.
Change-Id: Ib717fc91e3763be03f243f82e53679462ecdae04
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Correct the names of sub test cases due to the new Tempest version
1. Change from Functest Danube to Fraser, the Tempest version it integrates
is from 14.0.0 to 17.1.0.
2. Some sub test cases names have been changed.
3. Some are removed from tempest_smoke.
4. Some are new added into tempest_smoke.
JIRA: DOVETAIL-657
Change-Id: Ie5611f5b7a5888bea3942667907341bd071d399d
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adding OpenStack controller database HA test case
Adding the OpenStack controller database HA test case (Yardstick tc090)
to Dovetail and the proposed_tests test suite.
JIRA: DOVETAIL-654
Change-Id: I4d20b907de8df2e9567891354b49e832cce13c7c
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Committer resignation of zenghui
Removing zengshui from the list of committers.
Change-Id: I5821b324445f21fc43b45164024a508de00ef5b5
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Updating the list of OS interop tests
Updating the list of test cases used in the OpenStack Interop test case
to match
i) the tests used in the 2017.09 guideline, and
ii) the version of Tempest used by Functest
We keep the explicit list of test cases in the test case definition file
for now to enable Dovetail to verify the list of executed tests
corresponds to the tests we want to run.
JIRA: DOVETAIL-644
Change-Id: Ic627ef2bbad1dcfa5dd8773301c68dffb545a3b2
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Renaming test cases for better readability
This patchset proposes a new naming scheme for test cases. The ides is
to replace the current numbered scheme
<testarea>.tc<number>
with:
<testarea>.<capability/test case description>
The motivation for this is that a the numbering does not convey any
information about what the test case is doing and hides to which test
case implementation in Functest or Yardstick a test case spec refers.
Note: this patchset has not yet been tested in Dovetail itself. Its goal
is start a discussion about the naming scheme.
JIRA: DOVETAIL-647
Change-Id: If33b4bf88e451b372c2af10895ff92a87d9d961d
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Split tempest_smoke test case
1. Total number of sub test cases is 119
2. Remove all 14 object_storage test cases which need swift
3. Remove 26 test cases already included in osinterop test area
4. Remove 21 test cases already included in ipv6 test area
5. Remove 2 scenario test cases already included in tempest test area
6. Split other 56 test cases into 8 groups
Change-Id: I9eef20593ebf5f69347a2ec3a612c9ebc5a753db
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Switching to functest:fraser container tag
switching to functest:fraser from functest:opnfv-6.0.0 to incorporate
bug fixes which have been backported to stable/fraser.
Change-Id: Ieab9064ac0187b3460b09fe74861fc844b0b0195
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adding documentation for API validation exemption
Updating the user guide and OVP addendum to include references to the
detailed document describing the API response validation exemption.
JIRA: DOVETAIL-651
Change-Id: I4026f84f021704f0986b45680471e8fb711fc314
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adding Neutron trunk port tests to proposed_tests suite
Adding the Neutron trunk port tempest tests to Dovetail and the
proposed_tests test suite.
JIRA: DOVETAIL-648
Change-Id: Ia77980a245fd1bca6e5f0e567467432e12bf974e
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Fix the versions of openstack python client in Dovetail container
1. Now the openstack python clients installed are always the latest.
2. Fix them to certain versions according to the openstack requirements.
3. The first version openstack requirements provided is newton.
https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt?h=stable/newton
JIRA: DOVETAIL-615
Change-Id: I107f8d3a4dbd95af3441c0ba410de37ba8128be3
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Fixing SDNVPN tempest API tests
The code to run Tempest tests has changed in SDNVPN between Euphrates
and Fraser, causing these tests to fail. Moreover, due to a bug in
SDNVPN, not all bgpvpn API tests are currently being run. This is being
addressed by https://gerrit.opnfv.org/gerrit/#/c/57299/ and needs to be
cherrypicked to Fraser 6.1 for inclusion in OVP 2.0.
Change-Id: I0a7575e8a9ebc23af5edaa26c1a9ce1e8149919c
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Improve the CLI of Dovetail tool
The CLI of dovetail tool needs some improvement.
1. Add an option '--testcase' to support specify test case.
2. Add an option '--no-clean' to keep functest/yardstick/bottlenecks containers
for debugging after running the test cases.
3. Improve the local report section.
a. Remove some info that is not necessary
b. Make the info more clearly
JIRA: DOVETAIL-588
Change-Id: Ic769a6e2788b407c3df08ccd593a0ecdaa35e5ea
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/dovetail from branch 'master'
- Adding a tox environment for locally building docs
Run tox -edocs to locally build the Dovetail docs. This is quite
useful because the default OPNFV docs preview build toolchain is
broken for Dovetail.
Change-Id: I0a55a701b96437a20aa09edc47bc3e49e32c0b87
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|