Age | Commit message (Collapse) | Author | Files | Lines |
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Support pre-Provisioned credentials
If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for
/home/opnfv/functest/data/accounts.yaml which contains the set of
pre-existing credentials to use for testing [1].
It also sets admin_domain_scope and default_credentials_domain_name.
[1] https://docs.openstack.org/tempest/latest/configuration.html
Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 7e0f65a25f1c83c90051e13e4aa5333aaaa8c6d5)
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Allow adding a specific role to users created by tempest
It may allow bypassing RBAC policies if required.
Change-Id: I3b7ad44d7b80f8ea757846afdcd787b686c52856
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit ea596bbf094c8e45961b1b1379e58631942e4864)
|
|
* Update docs/submodules/releng from branch 'master'
- xci: Remove leftover VMs before proceeding with the deployment
Change-Id: I12e1dc7d79ca74df1ba02e16e55e91f4f47a818c
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
* Update docs/submodules/dovetail from branch 'stable/fraser'
- Updating test case requirements
Updating the test case requirements document to match the new test case
naming convention which was introduced for the 2018.08 release.
Additionally, minor syntactic fixes.
Change-Id: I34b4b90eb4f8bab4f59df2415c98c27169e98332
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
(cherry picked from commit fe8866c96dd7081a1a2b5a231574c36dde660f3f)
|
|
* Update docs/submodules/dovetail from branch 'stable/fraser'
- Release notes for OVP 2018.08 release
JIRA: DOVETAIL-700
Change-Id: I6835a6d6987d8e45c85fab851304a455db3ab0d6
Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
(cherry picked from commit 3d71b619bc869a99ce8f755d36c358f6698aaffa)
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Bugfix: ansible version should be the same both in Dockerfile and requirements.txt
Because Dockerfile is using ansible script to install yardstick requirements.
Or it may lead to exception when installing Yardstick.
Change-Id: Ia83cf76675a7f3f1d0aa5c311e7b72be5c7ca5c3
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 662de49b9f6c116d15882aed9e678cd3cf67494b)
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Merge "Bugfix: openstack router list broken in Yardstick container - dovetail" into stable/fraser
- Bugfix: openstack router list broken in Yardstick container - dovetail
Dependancy of python-openstackclient is not constrained.
This patch specify openstacksdk and openstackclient's version according to [1].
This patch apply for bugfix and need to backported to fraser stable branch.
Continual work need to be done in Gambia according to YARDSTICK-1398.
[1]
https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt
JIRA: DOVETAIL-728
Change-Id: I57c718e192699ac322150458d18508b06c93d22b
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 1e53af56c278921dad5671a5c4b8cafcdaa54ba9)
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "Add option --deploy-scenario <deploy_scenario_name> to support DPDK"
- Add option --deploy-scenario <deploy_scenario_name> to support DPDK
JIRA: DOVETAIL-729
Change-Id: I78c464300e329a9356cffa81e53263912486c2c2
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "Bottlenecks results dir has been changed"
- Bottlenecks results dir has been changed
Change-Id: I18a5b51c7c72a33db9864caf2635b2fcde3e8de6
Signed-off-by: xudan <xudan16@huawei.com>
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Merge "ping bottlenecks failed when security group rule do not support ipv6 - dovetail" into stable/fraser
- ping bottlenecks failed when security group rule do not support ipv6 - dovetail
JIRA: YARDSTICK-1380
Change-Id: I2163eeb9ab17e4f0216ddaed688e78acdf51a1ff
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 1c5d667f11d9d8a67a262eb6cc5ac53ff9d0cadd)
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Merge "Make security group configurable - dovetail" into stable/fraser
- Make security group configurable - dovetail
Make sercurity group can be configured via the context.
The format would be:
context:
name: demo
image: yardstick-image
flavor: yardstick-flavor
user: ubuntu
security_group:
rules:
- remote_ip_prefix: "0.0.0.0/0"
protocol: "tcp"
port_range_min: 1
port_range_max: 65535
- remote_ip_prefix: "0.0.0.0/0"
protocol: "udp"
port_range_min: 1
port_range_max: 65535
- remote_ip_prefix: "0.0.0.0/0"
protocol: "icmp"
JIRA: YARDSTICK-1360
Change-Id: I00c45767ee2d70b790590e824599d5a4c274bced
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit cea576574ac0554c1320179bffe6965ac1333972)
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "remove congress test in Daisy"
- remove congress test in Daisy
As Daisy don't support congress currently.
Change-Id: I1d70c01ef12555622d3e2800d2eba12b652fb23b
Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "xci: Create virtual daily jobs for scenarios"
- xci: Create virtual daily jobs for scenarios
Change-Id: I2cb52d85a86bf70dfaf151606138d671e618e5d0
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Fix snaps commit id
Snaps is part of main Functest testcases (Healthcheck).
A fixed version has to be pulled.
We will switch later to snaps packages instead of commit ids.
Change-Id: I8df681625864ed6929e28b37c574b8d89c7de409
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/releng from branch 'master'
- container4nfv: fix command line syntax error
Change-Id: Ib4bbf639c3a1c80eec9a9e3d52c17e934a465ce1
Signed-off-by: Yibo Cai <yibo.cai@arm.com>
|
|
* Update docs/submodules/dovetail from branch 'stable/fraser'
- Shortening headings and testing building of docs
This patch shortens the headings and is used to test if the docs
tool chain builds the right version.
Change-Id: Ibc162be1b46ff787a90510c360881234391c5ba7
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
(cherry picked from commit 8e2c2b42dff66d9896bfc5a8da8ee86cb18e8cb8)
- Add a volume mapping for Bottlenecks
All results files including the .out files are stored in Yardstick /tmp
Need to map that with host's /tmp to parse the results.
JIRA: DOVETAIL-727
Change-Id: I5a81e6e6bdf79b2e0074df505deb425c37b93300
Signed-off-by: xudan <xudan16@huawei.com>
- Bottlenecks SSH connectivity broken
For ping, it set the ssh login username to be ubuntu.
So need to use ubuntu image rather than cirros.
JIRA: DOVETAIL-727
Change-Id: Iaac8c8280a464efe3a431d4eb260c4a0a626e12d
Signed-off-by: xudan <xudan16@huawei.com>
- Rename ovp.next to be ovp.2018.08
Change-Id: I32aaee370512c3d7c8d6e1fbb6ef25aebc5d483f
Signed-off-by: xudan <xudan16@huawei.com>
- Test case descriptions for Tempest smoke tests
Adding a high-level description of the Tempest smoke tests.
As agreed on the last Dovetail call, we are aiming for a relatively low
level of detail and instead point to available documentation. As the
tests themselves are quite simple of read, this is the best,
most concise, and up-to-date version of documentation we can find.
JIRA: DOVETAIL-599
Change-Id: I985592c55fd415e254e70db6c6480c7bf3670a29
Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
- Update cli reference guide
JIRA: DOVETAIL-713
Change-Id: Ie740c8bf24c297c2537b23e1d35e0b4d40cd3e35
Signed-off-by: xudan <xudan16@huawei.com>
- Remove one sub test cases from neutron trunk
There is one sub test case that can't work correctly on Mitaka,
neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description
It will get a 'Bad request' error.
Details: {u'message': u"Unrecognized attribute(s) 'description'",
u'type': u'HTTPBadRequest', u'detail': u''}.
That's mainly because of that,
For Mitaka, there's only several extension resources that support
attribute 'description', which is 'security_group_rules', 'security_groups',
'ports', 'subnets', 'networks', 'routers', 'floatingips' and 'subnetpools'.
All other extension resources including trunk port can't create with description.
See https://github.com/openstack/neutron/blob/mitaka-eol/neutron/extensions/standardattrdescription.py#L22
For Newton, all subclasses of class 'HasStandardAttributes' support
the attribute 'description' including class Trunk.
See https://github.com/openstack/neutron/blob/newton-eol/neutron/extensions/standardattrdescription.py#L49,
https://github.com/openstack/neutron/blob/newton-eol/neutron/db/standard_attr.py#L158
and
https://github.com/openstack/neutron/blob/newton-eol/neutron/services/trunk/models.py#L26
JIRA: DOVETAIL-723
Change-Id: Ifdfea7c54a1888d933c8ddd78a6feea1db93368c
Signed-off-by: xudan <xudan16@huawei.com>
- Update user guide
JIRA: DOVETAIL-710
Change-Id: If6150e75202851e80b3b945743eca3362dba69c7
Signed-off-by: xudan <xudan16@huawei.com>
- Remove 2 sub test cases from neutron_trunk check list
1. neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_create_update_trunk
This test case will get the value of key 'revision_number' [1],
While this is a new extension for Newton and not support by Mitaka.
Please refer to the history of neutron github and the differences between
mitaka tag [3] (which has no file revisions.py) and newton [4].
2. neutron.tests.tempest.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id
This test case requires extension 'project-id' [5], while this is also a new
extension for Newton. Please refer to the history of neutron [6] and the difference
between mitaka tag [3] (which has no file project_id.py) and newton [7].
Also it is a little unreasonable to check both tenant_id and project_id.
For some products, they may only have either tenant_id or project_id (not both).
Has sent an email to the neutron_trunk team but get no feedback until now.
[1] https://github.com/openstack/neutron/blob/stable%2Fpike/neutron/tests/tempest/api/test_trunk.py#L123
[2] https://github.com/openstack/neutron/commits/newton-eol/neutron/extensions/revisions.py
[3] https://github.com/openstack/neutron/tree/mitaka-eol/neutron/extensions
[4] https://github.com/openstack/neutron/blob/newton-eol/neutron/extensions/revisions.py
[5] https://github.com/openstack/neutron/blob/stable%2Fpike/neutron/tests/tempest/api/test_trunk.py#L110
[6] https://github.com/openstack/neutron/commits/newton-eol/neutron/extensions/project_id.py
[7] https://github.com/openstack/neutron/blob/master/neutron/extensions/project_id.py
JIRA: DOVETAIL-723
Change-Id: Idb4a56d47148b14ae4674549f98b1be65e9b8f15
Signed-off-by: xudan <xudan16@huawei.com>
- Clean results directory to reduce the size of the package uploaded
JIRA: DOVETAIL-726
Change-Id: I57cb14cd5fe03a51e1691d7b48359bdd9b472ae4
Signed-off-by: xudan <xudan16@huawei.com>
- Create a test case descriptions for Patrole RBAC tests
JIRA: DOVETAIL-682
Change-Id: I37bb5ea2ba5b68407541e3e9d90d760e1720d3e7
Signed-off-by: xudan <xudan16@huawei.com>
- Test case description for Yardstick HA case
This is test case description for HA
test neutron-l3-agent. Yardstick TC058.
JIRA: DOVETAIL-637
Change-Id: I90e0225e6f086982da9f6ea686fbc8c179f45984
Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
- Test case descriptions for SNAPS smoke tests
Adding a high-level description of the SNAPS smoke tests.
As agreed on the last Dovetail call, we are aiming for a relatively low
level of detail and instead point to available documentation. As the
tests themselves are quite simple of read, this is the best,
most concise, and up-to-date version of documentation we can find.
JIRA: DOVETAIL-630
Change-Id: I38b072e29ec4cfe50baf0ac3350ea1a1d3e8d67a
Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com>
- Test case descriptions for Neutron Trunk Port tests
Adding a high-level description of the Neutron trunk port tempest tests.
As agreed on the last Dovetail call, we are aiming for a relatively low
level of detail and instead point to available documentation. As the
tempest tests themselves are quite simple of read, this is the best,
most concise, and up-to-date version of documentation we can find.
JIRA: DOVETAIL-684
Change-Id: I76801b34f974bf7c77fded3ffa5588b7e5b2803c
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- First test case description for HA tests
This is one of three test case descriptions from jira
ticket. Test case description is TC010 it is TC056 in
yardstick.
JIRA: DOVETAIL-605
Change-Id: I70afa882a667a6932aa7ec29bc5e0621b43fa0a4
Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
- Dovetail should update testcases.yaml file
It failed to run trunk_port test case because of the wrong class name.
See CI results
https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-default-mandatory-fraser/7/artifact/results/tempest_logs/dovetail.tempest.neutron_trunk_ports.functest.log/*view*/
Update the testcases.yaml file based on the latest version of Functest Fraser.
JIRA: DOVETAIL-715
Change-Id: Ib102d1489d1e5610a04d76aab0553d5171ec3d3e
Signed-off-by: xudan <xudan16@huawei.com>
- Renaming test cases to include test framework names
Replacing the generic "dovetail" prefix of the testcase definitions with
the name of the OPNFV test framework which hosts the test.
JIRA: DOVETAIL-719
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
Change-Id: I8f90423b8908197bdc7adddf82c61ff394893f52
- Dovetail failed to archive tempest.log and tempest-report.html files
It failed to archive tempest.log and tempest-report.html files.
See CI results
https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-default-mandatory-fraser/7/artifact/results/
That's because the path of them have been changed
1. from tempest to tempest_custom
2. from refstack to refstack_defcore
There seems to be no file bgpvpn.log, remove the copy operation.
JIRA: DOVETAIL-714
Change-Id: I77d88124a44d3e5d869ada209760f69d1f6553bf
Signed-off-by: xudan <xudan16@huawei.com>
- Delete 2 sub test cases from patrole
These 2 test cases failed on OSP10 with reasons
1. Provided object does not match schema 'image': u'shared'
is not one of ['public', 'private']
2. Provided object does not match schema 'image': u'community'
is not one of ['public', 'private']
'shared' and 'community' was added in the Image API v2.5
https://developer.openstack.org/api-ref/image/v2/index.html#images
JIRA: DOVETAIL-704
Change-Id: Ie7ab06d5e2abe7bde25fdb7318abe341f0119bc7
Signed-off-by: xudan <xudan16@huawei.com>
- Update bottlenecks conf
1. Copy a ubuntu image to Bottlenecks to support offline
2. Add an env DEPLOY_SCENARIO to bottlenecks to support DPDK
3. Set push results to DB False
JIRA: DOVETAIL-706
JIRA: DOVETAIL-707
Change-Id: I81f293bb9fddc63fd8be455546ba4642ca670fc7
Signed-off-by: xudan <xudan16@huawei.com>
- Create a test specification for vIMS test case
New test specification has been created for dovetail project.
Test descriptions is related to cloudify_ims test case of functest
project.
JIRA: DOVETAIL-699
Change-Id: I033351ad7cf83256bd7a9e208a7ce406d5a4cd2b
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
- Cleaning up proposed-tests test suite
We have moved all newly proposed tests to the next OVP test suite, so
these tests do not need to be in here anymore - and do not need to be
run in CI.
Change-Id: I5f51b76a37b706c5b4abc75272ad799a72841f67
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Move OVP web portal code to a separate repo
The new repo for web portal is https://gerrit.opnfv.org/gerrit/dovetail-webportal
JIRA: DOVETAIL-671
Change-Id: Iac085abc3d175b9a091d70d0448af56c7a6845e9
Signed-off-by: xudan <xudan16@huawei.com>
- Making the results file a proper json file
The results.json file is currently not a properly formated json file,
but contains one json structure per line/testcase. Whit this change, all
test results are being collected at runtime and then written to a
properly formated json file at the end of a test run.
Moreover, this patch introduces 'mandatory' and 'optional' sections to
the test suites definition files in order to clearly indicate if a test
is part of the corresponding test scope.
The web portal needs to be adapted accordingly to be able to read the
new results file.
JIRA: DOVETAIL-672
Change-Id: Id0706c7e82622fc9c2c2fece26b2d6c07c1580be
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Delete skipped sub test cases from patrole and neutron_trunk check list
According to Apex, Compass, Fuel CI results, delete the skipped sub test cases
from patrole and trunk_port check list.
JIRA: DOVETAIL-703
Change-Id: I86e3036a287d9cf56d78e43f92ce0d9ffed5941c
Signed-off-by: xudan <xudan16@huawei.com>
- Remove functest_testsuite and functest_testcase in dovetail_config.yml
The 2 sections 'functest_testsuite' and 'functest_testcase' are used by
all Functest test cases.
They aim to parse the results of Tempest sub test cases.
Remove them, and check the sub test case list,
1. if it's empty, that means no need to check sub test cases
2. if it is not empty, check the sub test cases one by one.
Additional, remove some useless keys in dovetail_config.yml
JIRA: DOVETAIL-658
Change-Id: Ic829264b0c8eaedd8e2b3fa55b38a34644482c20
Signed-off-by: xudan <xudan16@huawei.com>
- Create test case descriptions for Bottlenecks stress test
This is coming from the former patch
https://gerrit.opnfv.org/gerrit/#/c/37715/
JIRA: DOVETAIL-631
Change-Id: Ibe090fefaa92cb3fe6d7c3d96296724e8cfbcf1d
Signed-off-by: xudan <xudan16@huawei.com>
- Update test suite ovp.next
Update test suite ovp.next according to the latest OVP scope.
Modify Dovetail daily jobs to run all the scope.
There should be 2 jobs.
One for all mandatory test cases and the other for all optional ones.
That's mainly because of that the total executed time will be too large
(more than 300 minutes). Then the job will always failed because of time out.
It's hard to enlarge the time because it's already larger than common 3 hours.
Split it into 2 jobs can avoid the time out issue and make the results
clearer for reviewing.
JIRA: DOVETAIL-694
Change-Id: Ie0ea6221868941781af1477f7c7719f7cb4351a4
Signed-off-by: xudan <xudan16@huawei.com>
- Create a test specification for vEPC test case
New test specification has been created for dovetail project.
Test descriptions is related to vEPC test case.
JIRA: DOVETAIL-679
Change-Id: I72228f7f59a4aa704a620351ad8727c1b948dc66
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
- Test case description for BGPVPN Tempest API tests
Adding test case descriptions for the BGPVPN API tests which are
implemented as Tempest plugin in the networking-bgpvpn repository. These
tests have already been integrated for Euphrates into Functest test and
are hence a candidate for inclusion in the test scope of the OVP
Euphrates release as extension of the existing SDNVPN test cases.
JIRA: DOVETAIL-598
Change-Id: Id8578ed1e198ddbde967793737c69a5940c22475
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Update cirros image for bottlenecks
The fraser-based OPNFV tools use the newer cirros-0.4.0 image and we
hence only ask users to download this version in the user guide.
This updates the bottlenecks test to comply with this.
Change-Id: I5a94d6a7196ae04e00150dc17a4a16add2d3fef6
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Remove the yardstick_tag and functest_tag
These 2 commands can't work now.
Also there is no need to support them, so remove them.
JIRA: DOVETAIL-695
Change-Id: I6707c7fc1d19fe06690cd14ef39f9d421d00a2bc
Signed-off-by: xudan <xudan16@huawei.com>
- Enable OVP tests to run on a DPDK-enabled system
DPDK-enabled NFVIs require support for hugepages which
in turn is configured by means of extra_specs in flavors.
Currently, Functest enables hugepage support if the name
of the scenario contains the substring "ovs".
Dovetail allows end users to run all tests on DPDK-enabled systems
and the documentation has been updates accordingly.
JIRA: DOVETAIL-665
Change-Id: If4898da168f8b4c69a045ef3b00b8a8862f29b0c
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
- CI ERROR - File contains violation on test_runner
Proposed solution by CI server:
"Avoid dangerous file parsing & serialization libs, use yaml.safe_load"
Change-Id: Iff9764601bc135cec271e16444d0bbbb4da8d459
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
- New test specs for ha database/controller_restart
New test specifications have been created for dovetail project.
Test descriptions are related to test cases:
- dovetail.ha.database
- dovetail.ha.controller_restart
JIRA: DOVETAIL-680
JIRA: DOVETAIL-681
Change-Id: I632cb69f9166a46e76f38a467f078fe5f31b63b3
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
- Add dovetail-webportal repo to INFO file Listing
Change-Id: I429e5bb1dffb1c63301ad5e9aba34d08d788ca27
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
- Update all existing test specifications
1. Update the names of 2 vping test cases
2. Update the names of 8 ha test cases
3. Update the sub test cases within osinterop 2017.09
4. Split IPv6 into ipv6_api and ipv6_scenario
5. Update the names of sdnvpn test cases
6. Update the names of 4 tempest scenario test cases
7. Remove forwardingpackets
JIRA: DOVETAIL-685
Change-Id: I0d91b8a0477576e18581eb2788fdb666063c89b7
Signed-off-by: xudan <xudan16@huawei.com>
- Adapt Yardstick fraser
Yardstick fraser has changed from openstack python client to shade.
OS_INSECURE is not a key for shade.
It needs to be OS_VERIFY.
Change-Id: I0973853d0527b04ec371ad4f6ce2f6c67ef50ccf
Signed-off-by: xudan <xudan16@huawei.com>
- Fix syntax error on clean_results_dir method
Change-Id: I9f33bb320452efab79be5a22e625efac820183eb
Signed-off-by: Panagiotis Karalis <pkaralis@intracom-telecom.com>
- Splitting the networking tests in API and scenario tests
Split the networking tempest test case in Tempest API tests and scenario
tests. The API tests will be promoted to mandatory while the scenario
tests will remain optional.
JIRA: DOVETAIL-678
Change-Id: I03022316076809536782e82fd531d98f45105caa
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Removing unused test suite and updating debug test suite
The compliance_set test suite is not used. Updating the description of
the debug test suite.
Change-Id: Id2c3ca922ffb083f3443e00e5ca1a0648aec3e4a
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Update licence headers to comply with guidelines
Updating the licence headers to comply with the community guidelines [1]
and anteater checks.
[1] https://wiki.opnfv.org/display/DEV/Contribution+Guidelines#ContributionGuidelines-License
Change-Id: Idec787e32daf76c0b1bd6108977b78828125da5e
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Splitting IPv6 tests in API and scenario tests
Spliting the IPv6 test case in Tempest API tests and scenario tests. The
API tests will be promoted to mandatory while the scenario tests will
remain optional.
JIRA: DOVETAIL-677
Change-Id: If3dca5ecf2ce5c9e02de5c6d45e674da029b609f
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Fixing a typo in the API validation warning of the web portal.
Change-Id: I0489d1e2fbd53bc90c24781a9d62140e2299c5a4
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Update OVP portal docker images for missing package
- The missing futures packages was added in patch:
https://gerrit.opnfv.org/gerrit/#/c/58833/
- The patch above does resolve the issue and has
been valdiated on a development instance.
- The issue was likely introduced in patch
https://gerrit.opnfv.org/gerrit/#/c/56623/
Change-Id: I850947e386024e6b65514bdb518799c359234811
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
- Add Missing Futures Package
This is needed by the motor package.
Change-Id: Ie19958040bc026b834fd3891da3a205cb248df92
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
- Update CVP Container Tags
These include updates for the new web portal.
Change-Id: I2951c8a1b00947a4546b4f90440ff8e0af8640e4
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
- Adding IDs to the list of OpenStack interop tests
In Fraser, the RefStack / OpenStack interop tests are executed through
Rally in Functest. Rally requires the fully qualified name of a tempest
test, including its tier and ID, in order to find and run it. This patch
add the missing information.
JIRA: DOVETAIL-662
Change-Id: I3a38b7b8d0fe79dd6ad0c0023c62c6647611d231
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Removing test_mtu_sized_frames Tempest test
This test fails in CI on all installers (Apex, Compass, Fuel) and on
virtual deployments.
Change-Id: I3a451e880c2a5d2151cb88aaf8e5a6895368e63b
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Create specific flavor for neutron-l3-agent HA test
The neutron-l3-agent test assumes that a default image and flavor are
available. On current OPNFV deployments, these resources do not exist
anymore by default and hence the test case fails.
This patch enables Dovetail to create a specific flavor as part of the
test case config. This is temporary workaround until the test case
itself takes care of checking and creating all resources needed. A
ticket for the HA project has been created accordingly:
https://jira.opnfv.org/browse/HA-36
Change-Id: I6523d8411fe853a5645566b2fabe1409b5715491
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Running BGPVPN Tempest tests as tempest_custom test
We need to disable one BGPVPN tempest test due to a bug in ODL. Since
the SDNVPN test framework does not allow for disabling a single test
case, we are switching to tempest_custom.
Change-Id: Ifbd7c1dc5e799d6a6c774e08e9fc1a3b2294b47c
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Copy tempest_conf.yaml file for neutron_port and patrole
Change-Id: I58e37c14cb4a287436e86b345919deff3d3674d0
Signed-off-by: xudan <xudan16@huawei.com>
- Cosmetic cleanup of tempest test case lists
There are some superflouos lines separating the list of tempest test
cases. These are restructuring artifacts which can be deleted.
Change-Id: I7b3474090fa3d7b1506d5a4f3dcd1b32dd68900a
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Replace openstack commands with shade
Use openstack shade to get endpoint infomation rather than executing
openstack commands directly.
The next step can replace openstack commands by shade for some test cases that
need to create openstack resources (images, flavors) if we agree to use shade.
JIRA: DOVETAIL-659
Change-Id: I72b302fb2d4a61e9249a7e53f81ea9464944dcd3
Signed-off-by: xudan <xudan16@huawei.com>
- Upgrading image version of HA test of neutron L3 agent
In line with the updated documentation, this patch upgrades the cirros
image from version 0.3.5 to 0.4.0 of the HA neutron-l3-agent test
Change-Id: I352e861f3d3099491ff6f367a3129dc8f3115394
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Updating the API response validation patch
Functest has switched from Tempest 14 in Danube to 17.1.0 in Fraser.
This updates the patch used to disable strict API response validation.
Change-Id: Ief47eba3bc91c222d5ad30e65ab1fdaf39fc169e
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Add improvements to OVP directory and logo upload
- Formatting changes to directory on home page based
on OPNFV marketing
- Updated branding guide link
- Added test_id field to mongo applications collection
to associate to approved results for directory
- Set Test ID from user accounts with administrator
role in Applications view
- Provide file upload function for administrator to
post company logos for OVP directory
- Company logos are stored and served through tornado
from cvp-cvpapi container rather than cvp-web
JIRA: DOVETAIL-663
JIRA: DOVETAIL-664
Change-Id: I1226b42883afa2ea2eb5551e3836211abbb94b20
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
- Make exit status a constant in run.py
JIRA: DOVETAIL-625
Change-Id: Ib96e6e39bad708f495af97ed43884909e394da10
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
- Fix error status when executing CLI run command
This commit fixes CLI run command to exit with non-zero exit status
when bad arguments are given for '--testsuite' or '--testarea'.
JIRA: DOVETAIL-660
Change-Id: I4539b19978d9e93d8a90be9000f36d0aa1895f71
Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
- Correct reporting of vEPC test case
The configuration of the vEPC test case was missing information for
generating a correct report and hence it incorrectlt reported FAILed
despite passing.
JIRA:DOVETAIL-666
Change-Id: Id296fa0fd750e47dc841ef37acb2018b23de0643
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Adding reference to EXTERNAL_NETWORK to user guide
Adding a reference to the EXTERNAL_NETWORK environment variable to the
user guide so that users add this to their env_config.sh. This variable
is required, among others, to overwrite the default external network in
Yarstick.
Change-Id: I50e609a8c6e20b1dd01c61d5d950ffba792e98fa
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Adding vEPC test case to Dovetail and proposed_tests suite
Adding the vEPC test case to Dovetail. The test deploys a vEPC using
Juju as VNF manager and performs application level tests.
JIRA: DOVETAIL-650
Change-Id: I15c2cdddee510e12a5faf18efc8950af5cf7b664
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Update user guide
1. Remove python related content because python is installed in Dovetail image.
2. Remove DB related content because there is no need to launch local DB now.
3. Update the infomation of Docker images and VM images.
Change-Id: I010d3341aef9f2c74713fc0fc087b361331109d1
Signed-off-by: xudan <xudan16@huawei.com>
- Archive all test case result files
1. All detailed tempest test cases results are recorded with
file tempest-report.html rather than tempest.log now.
2. Archive all results files include functest.log, yardstick.log ...
for each test case. Otherwise, they will all be in one log file.
3. Support to set the source files and dest files need to be archived with
the test case config files rather than hardcode with the source code.
4. Give the file which used to be parse the results (PASS/FAIL) with the
test case config files rather than hardcode with the source code.
Change-Id: I30f435d91ab90cf20def47007f177fe98187484d
Signed-off-by: xudan <xudan16@huawei.com>
- Changing the link to the updated participation form
The participation form on docusign has changed due to incorporating
additional fields for the API validation exemption. This patch updates
the links in the documentation accordingly.
Note: this patch should only me merged after the new form is online.
Change-Id: I697fa13d9afe2797faba2bf0478bbf27820bca20
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Implemented directory within OVP portal
- Added OVP directory to portal home page as summary view to
showcase vendors offerings that have received marks
- Each row of table in directory summary represents a product
offering that has received compliance verification marks and
will be ordered by approve date
- Currently, a vendor with multiple products will be displayed as
separate rows, as agreed by OPNFV marketing
- Added new angular component/controller for OVP directory secondary
drill-down view, which provides more detailed info including
Description, Product Info, SUT HW Version (optional from vendor)
and SUT Version. Product info links to product_documentation field
in Applications collection but can be improved as requirements are
flushed out
- Added new db fields to existing applications collection in mongodb
- Applications collection is fetched on home page and detailed
directory views
- Updated Applications management view (administrator role) with
new db fields including description, ovp_category, ovp_version,
company_logo, approve_date, approved, sut_version, sut_hw_version,
allowing admin to delete and add back with updates.
- Updated participation form link for exemption process addition
- Consider for another patch - upload form for company logos in
Applications view for administrator to add. The initial wave of logos
will need to be included in the patch for now when available
from OPNFV marketing
- Consider for another patch - improve 'Product Info' field to
accept HTML as input allowing administrator to add raw HTML in
mongod
- Consider for another patch - update an existing application
for admin role in Applications view rather than forcing a
delete/add operation for an update
Change-Id: I41d08a7164ee4513106bd09ea30d20be5abd911e
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
- Updating user guide with new ssh key config in pod.yaml
Dovetail does not copy the ssh key from pre_config to /root/.ssh anymore
inside Yardstick but instead, we point the pod.yaml file directly to the
key inside the pre_config directory.
JIRA: DOVETAIL-655
Change-Id: I23156d8940194547363bcf9a5cc581aab0d5c640
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Bugfix the name of test case dovetail.neutron_l3_agent
CI broken because of the wrong test case name.
https://build.opnfv.org/ci/view/dovetail/job/dovetail-fuel-baremetal-proposed_tests-master/294/console
Change-Id: I6674acf92c8f67ae2bd8dba082186a16211dcd8a
Signed-off-by: xudan <xudan16@huawei.com>
- Got an exception when test suite is empty
1. Return empty test case list when test suite is empty.
2. Don't quite understand why comment out all proposed_tests.
3. Move stress ping test case at the end of the list,
because it may broken the message queue.
Change-Id: Ib717fc91e3763be03f243f82e53679462ecdae04
Signed-off-by: xudan <xudan16@huawei.com>
- Correct the names of sub test cases due to the new Tempest version
1. Change from Functest Danube to Fraser, the Tempest version it integrates
is from 14.0.0 to 17.1.0.
2. Some sub test cases names have been changed.
3. Some are removed from tempest_smoke.
4. Some are new added into tempest_smoke.
JIRA: DOVETAIL-657
Change-Id: Ie5611f5b7a5888bea3942667907341bd071d399d
Signed-off-by: xudan <xudan16@huawei.com>
- Adding OpenStack controller database HA test case
Adding the OpenStack controller database HA test case (Yardstick tc090)
to Dovetail and the proposed_tests test suite.
JIRA: DOVETAIL-654
Change-Id: I4d20b907de8df2e9567891354b49e832cce13c7c
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Committer resignation of zenghui
Removing zengshui from the list of committers.
Change-Id: I5821b324445f21fc43b45164024a508de00ef5b5
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Updating the list of OS interop tests
Updating the list of test cases used in the OpenStack Interop test case
to match
i) the tests used in the 2017.09 guideline, and
ii) the version of Tempest used by Functest
We keep the explicit list of test cases in the test case definition file
for now to enable Dovetail to verify the list of executed tests
corresponds to the tests we want to run.
JIRA: DOVETAIL-644
Change-Id: Ic627ef2bbad1dcfa5dd8773301c68dffb545a3b2
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Renaming test cases for better readability
This patchset proposes a new naming scheme for test cases. The ides is
to replace the current numbered scheme
<testarea>.tc<number>
with:
<testarea>.<capability/test case description>
The motivation for this is that a the numbering does not convey any
information about what the test case is doing and hides to which test
case implementation in Functest or Yardstick a test case spec refers.
Note: this patchset has not yet been tested in Dovetail itself. Its goal
is start a discussion about the naming scheme.
JIRA: DOVETAIL-647
Change-Id: If33b4bf88e451b372c2af10895ff92a87d9d961d
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Split tempest_smoke test case
1. Total number of sub test cases is 119
2. Remove all 14 object_storage test cases which need swift
3. Remove 26 test cases already included in osinterop test area
4. Remove 21 test cases already included in ipv6 test area
5. Remove 2 scenario test cases already included in tempest test area
6. Split other 56 test cases into 8 groups
Change-Id: I9eef20593ebf5f69347a2ec3a612c9ebc5a753db
Signed-off-by: xudan <xudan16@huawei.com>
- Switching to functest:fraser container tag
switching to functest:fraser from functest:opnfv-6.0.0 to incorporate
bug fixes which have been backported to stable/fraser.
Change-Id: Ieab9064ac0187b3460b09fe74861fc844b0b0195
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Adding documentation for API validation exemption
Updating the user guide and OVP addendum to include references to the
detailed document describing the API response validation exemption.
JIRA: DOVETAIL-651
Change-Id: I4026f84f021704f0986b45680471e8fb711fc314
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Adding Neutron trunk port tests to proposed_tests suite
Adding the Neutron trunk port tempest tests to Dovetail and the
proposed_tests test suite.
JIRA: DOVETAIL-648
Change-Id: Ia77980a245fd1bca6e5f0e567467432e12bf974e
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Fix the versions of openstack python client in Dovetail container
1. Now the openstack python clients installed are always the latest.
2. Fix them to certain versions according to the openstack requirements.
3. The first version openstack requirements provided is newton.
https://git.openstack.org/cgit/openstack/requirements/plain/upper-constraints.txt?h=stable/newton
JIRA: DOVETAIL-615
Change-Id: I107f8d3a4dbd95af3441c0ba410de37ba8128be3
Signed-off-by: xudan <xudan16@huawei.com>
- Fixing SDNVPN tempest API tests
The code to run Tempest tests has changed in SDNVPN between Euphrates
and Fraser, causing these tests to fail. Moreover, due to a bug in
SDNVPN, not all bgpvpn API tests are currently being run. This is being
addressed by https://gerrit.opnfv.org/gerrit/#/c/57299/ and needs to be
cherrypicked to Fraser 6.1 for inclusion in OVP 2.0.
Change-Id: I0a7575e8a9ebc23af5edaa26c1a9ce1e8149919c
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Improve the CLI of Dovetail tool
The CLI of dovetail tool needs some improvement.
1. Add an option '--testcase' to support specify test case.
2. Add an option '--no-clean' to keep functest/yardstick/bottlenecks containers
for debugging after running the test cases.
3. Improve the local report section.
a. Remove some info that is not necessary
b. Make the info more clearly
JIRA: DOVETAIL-588
Change-Id: Ic769a6e2788b407c3df08ccd593a0ecdaa35e5ea
Signed-off-by: xudan <xudan16@huawei.com>
- Adding a tox environment for locally building docs
Run tox -edocs to locally build the Dovetail docs. This is quite
useful because the default OPNFV docs preview build toolchain is
broken for Dovetail.
Change-Id: I0a55a701b96437a20aa09edc47bc3e49e32c0b87
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Decoupling Bottlenecks Docker config items from source code
There are some special Docker setting items when creating
Bottlenecks Docker Cntainers.
Move the special settings to config files.
Disable the function to push results to DB.
JIRA: DOVETAIL-645
Change-Id: Icc033222edf74c0fe4853dede2794f4226fd4252
Signed-off-by: xudan <xudan16@huawei.com>
- Remove local DB
Remove local DB and can just report without launch local DB.
Need to do a little modification with the web portal code.
JIRA: DOVETAIL-593
Change-Id: I595db39cce4156596ee0522d4b7e642a23d78ab9
Signed-off-by: xudan <xudan16@huawei.com>
- Integrating Functest Patrole test case
Adding the new Patrole test case of Functest to Dovetail and to the
proposed_tests test suite.
JIRA: DOVETAIL-649
Change-Id: I2c3f583cdbd3af75cec020b0fe97f287d23498a5
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Extend web portal to show if API exemption was used during a test run
JIRA: DOVETAIL-634
The OVP web port needs to read from the test results if the strict API
response validation exemption was used or not and show it
correspondingly.
Detailed description:
As discussed on the Dovetail call on 2018-04-11, the web portal should
show if API response validation was enabled or disabled. The information
if API response validation was enabled or disabled is to be determined
based on the dovetail.log file. If API response validation was
disabled,** the log file contains the line "Strict API response
validation DISABLED.". Upon uploading a result tar-package, the web
portal should extract this information from the log file, store it in
the database, and display it as follows:
This indication shall be displayed along with the test summary on the
Test Run Results page as either:
"API response validation enabled" or
"API response validation disabled"
For clarification: API response validation is enabled by default. API
response validation is disabled only if the --no-api-validation command
line option is given.
Change-Id: Ifacb1eb2127cc8dc6364c98dead1217aeedfd359
Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
- The refstack file name has been changed
The original refstack results file is refstack/refstack.log
For Fraser, it has been changed into refstack/tempest.log
Change-Id: I7d40abe0c5a366b5fbb1912ec58d15109f22c0d0
Signed-off-by: xudan <xudan16@huawei.com>
- Switch to OPNFV Fraser release
1. Use Functest Fraser docker images whose tag is fraser
2. Use Yardstick stable docker images
3. Functest fraser has moved testcases.yaml file from functest/ci to xtesting/ci
4. Functest fraser has removed 'functest env prepare' command
5. Functest uses rally to execute osinterop test cases
instead of refstack_client
Change-Id: I81ebefe6ea959ca77c2c87f1d75ef56ac18c165f
Signed-off-by: xudan <xudan16@huawei.com>
- Implementation of API validaton exemption in dovetail
This patch adds the ability to Dovetail to disable strict API
response validation in Tempest-based test cases run by Functest.
Corresponding updates of the web portal and backporting of this patch to
OVP 1.0.0 (Danube) will follow.
JIRA: DOVETAIL-633
Change-Id: Iace99ea1b6224ea907a2c3af8676e9285e6ad3ee
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
- Add functest healthcheck test suite
- Add Functest healthcheck tier to Dovetail as new test suite
- Intention is that these test cases are not part of mandatory
test cases in compliance program
- Use for debug and SUT pre-flight check
- May consider running tc001 (connection_check) at other
test execution stages to determine if SUT is still functioning, as
this test takes < 10 sec (more important as test complexity increases
such as in vnf test tier)
- Replacement for patch:
https://gerrit.opnfv.org/gerrit/#/c/52461/
- Removed CI filters, as suggested
Change-Id: I2e72931b27e43359d6250f6959a17af8526c5094
Signed-off-by: Eddie Arrage <eddie.arrage@huawei.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Avoid duplicating jjb names
It allows loading functest and functest-kubernetes jjbs in one
Jenkins.
Change-Id: Ia52e84583bc25aad0d1508096b536cbd5585d261
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 890bc75c29ef98fe2eb0dd8e456ad6eafa9d26a1)
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Merge "Decrease Sampling interval - Invalid Port results" into stable/fraser
- Decrease Sampling interval - Invalid Port results
JIRA: YARDSTICK-1219
The computed in/fwd throughputs displayed on the L2FWD,
L3FWD and VPE dashboards. The computed value is likely
4x the expected value.
It is required to return sampling information form Generator AND VNF at
least every 1 second.
Change-Id: I4435fd05ba3116ead836843a4c2fce133b767a28
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
(cherry picked from commit 2d10b0bf7238f5417d46f89c76b856f7e345f738)
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
(also picking from commit 68aaa8ce8b20ba39040aa2469b384f59709620a7)
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Set juju wait version
It's mandatory before releasing.
Change-Id: Iac7b49fb1061b39ee6683e7b30f163cfc2060a95
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 381a70d86ce49bd55b298042dc11cb16f9710d82)
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Merge "the recovery action of "baremetal down" should be triggered mandatory" into stable/fraser
- the recovery action of "baremetal down" should be triggered mandatory
YARDSTICK-1222 has made attacker recover only when the sla not pass.
But for baremetal down test case, the node need to power on even the sla pass.
TODO:
Make attacker can support mandatory recover in some situation.
JIRA: YARDSTICK-1337
Change-Id: Ib567b9b9025e5ee421ea47140c468537ad16f090
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit 5f11cb9f55aa0529fddfe916a2976a9aa5b4c08f)
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Merge "Bugfix: HA test case baremetal down ipmi power off failed - dovetail" into stable/fraser
- Bugfix: HA test case baremetal down ipmi power off failed - dovetail
Test case tc025 baremetal down failed to ipmi power off the node.
This patch target to solve:
ipmi_password is not correctly fetched
JIRA: YARDSTICK-1326
Change-Id: Ia915cd07cba420643fa9a679975178328be55700
Signed-off-by: rexlee8776 <limingjiang@huawei.com>
(cherry picked from commit fb895253e4ceeff2df53043b5b994f63c740b1f6)
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Create new project/user for snaps tests
JIRA: FUNCTEST-1003
Change-Id: Ic55998977386f95f619a355d22bd285782fe81f0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 5d9acb84f492dca4da863c60e30a5463fe165cb5)
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "Revert "CPERF: Fix csit odltools install""
- Revert "CPERF: Fix csit odltools install"
This reverts commit 38ca028551d2e498fdfe41627f8bf79a43a6a0fa.
Change-Id: If37f0d40a50b410004d563bed5887f8237110d44
|
|
* Update docs/submodules/releng from branch 'master'
- xci: Adjust build blockers and fix functest preparation
Functest preparation is moved into the deployment job to ensure
things are prepared before we are done and functest job gets
triggered. Making the preparation in functest job will cause
us to either reinitialize venv or depend on deployment job directory.
Apart from that, the env vars necessary for functest are available
within deployment job anyways so reusing that will make running
functest simpler.
See the comments in xci-daily-jobs.yaml builder macros.
Change-Id: I4c5bbe5f4b31bb620986d75ba78de6c0fe442975
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Redirect stderr to stdout when running tempest
JIRA: FUNCTEST-999
Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit c4b3f91c6bb79c50adc1c5a4397666ebcd1f7375)
- Stop building tempest container in fraser gate.yaml
It should have been removed when cherry-picking "Publish Functest
daily and gate jobs".
It adds parser-basics which is hosted by its own container.
Change-Id: I6b5c4de0bffabab9bf927bf045b228113deeb375
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/releng from branch 'master'
- xci: Fix XCI_DISTRO vars and remove clean_vm cleanup steps
Change-Id: Ie1d652607f8f56f5e1cf0409dc628b1add615cd9
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "xci: Reconfigure xci-daily-virtual jobs"
- xci: Reconfigure xci-daily-virtual jobs
The execute shell parts need to be switched to existing
scripts but since the scripts were mainly written for
verify jobs, the adaptations they require has potential
to cause issues so it needs to be done in a separate
change.
Apart from that, the verify and daily jobs can't be run
on same slave at the moment due to a bug in opnfv vm
creation playbook. If clean vm exists on the node, the
playbook fails. Build blocker is enable for verify and
daily jobs to ensure the jobs don't end up on same slave
for the timebeing.
Change-Id: Iefaf5a5c2d4a79bd48a5f9da28d68748bc67f511
Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "[fuel] Add Docker build jobs"
- [fuel] Add Docker build jobs
JIRA: FUEL-383
Change-Id: I80049726c256d2891ae1cfbacbc54781d3d81c70
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "[Compass4NFV]Add os-stor4nfv-ha scenarios"
- [Compass4NFV]Add os-stor4nfv-ha scenarios
Change-Id: I845f4fb0c51d9d1adccc8cfc3fe838a01882f52d
Signed-off-by: wutianwei <wutianwei1@huawei.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "container4nfv: update arm64 cni deployment jobs"
- container4nfv: update arm64 cni deployment jobs
- add vhost-vpp test
- deploy k8s only once for all cni deployment tests
Change-Id: I0d3966b15dc7f23713b5729bb7617b0c46e0ac83
Signed-off-by: Yibo Cai <yibo.cai@arm.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Create output directory
The rally.conf gets copied before the target directory has been created.
JIRA: FUNCTEST-1007
JIRA: DOVETAIL-730
Change-Id: Ie774fce994ada644c1163600e6c62e1231fde443
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
(cherry picked from commit b55aa749c379ce7af918f43558f2195e2259d872)
|
|
* Update docs/submodules/releng from branch 'master'
- Https now works for artifacts.opnfv.org
Change-Id: Ic3aa4bea2b546c95ce8187927a5762009adbd429
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
|
|
* Update docs/submodules/yardstick from branch 'stable/fraser'
- Update docker image tag to 6.2.1
JIRA: YARDSTICK-1137
Change-Id: I5cb4a06a3c8f6582cdc8d0fa82a7413bc4f2e022
Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Execute refstack_defcore in ci/run.yaml
Change-Id: Ib65203e74244d87f7ac6b24f6e6abf723c57a786
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 72ea3965f80691b6660ce9716103030d3e6d9a6b)
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Publish Functest daily and gate jobs
As opposed to the Releng ones, they are designed to be easily
executed by endusers as well. They can be considered as a first step
towards a full Functest CI/CD toolchain deployed via docker-compose.
All components testcases are enabled here.
They hugely leverage on templates to load the right yamls per branch
and multijobs to run testcases in parallel. Many steps are proposed
allowing running part of the chain.
Executors have to be increased to allow running them (it was tested
vs 10 and more).
At first, all docker images are downloaded to avoid different
versions between testcases.
They will be improved in a second change to ensure that only one node
is selected and to take all Functest env vars into account.
Change-Id: I99c7b8ee5d0ddbb00102b3147739b5e8b5c65c23
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 69f0b2665b397e5128bf7a83541d3567c4834af3)
|
|
* Update docs/submodules/releng from branch 'master'
- CPERF: Fix csit odltools install
PIP installing odltools attempts to install/update chardet which was
already managed by yum in the container so need to remove it.
Change-Id: Id07b76b080ff5b7e77d4c110c90a15018397d039
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Apex: Add SFC to daily
Change-Id: I51e5ecce1e7e5ef851e3c031aeb7819c0712c72d
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "[fuel, armband] Add os-nosdn-vpp scenarios"
- [fuel, armband] Add os-nosdn-vpp scenarios
Added the triggers for both ha and noha versions of the scenario
Change-Id: Ibba782d82712b69b755592a878fc69bf6696cba7
Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Fix fixed_network_name in tempest.conf
It also copies rally.conf and tempest.log in res_dir.
Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 0fd76322f95b755d347826f707c092105506311b)
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "Update Releng PTL for Anteater Reports"
- Update Releng PTL for Anteater Reports
Ensures Fatih is still listed for the releng-xci repository.
Change-Id: I4e4d8f474ed35ec07d840e38151956d832fb5692
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
|
|
* Update docs/submodules/releng from branch 'master'
- Apex: Fix verify blocking with csit
Make apex verify virtual deployment occur on the same node where
apex-verify job is running. Block apex-verify from starting if csit
promote is running.
Change-Id: I86e76232003b509db516e8d78703d43d36456d14
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "[dovetail] set correct Cinder process name on Apex"
- [dovetail] set correct Cinder process name on Apex
In fraser, cinder-api runs as an apache module called cinder_wsgi.
JIRA: DOVETAIL-690
Change-Id: I6660e1e17e61c0010295431290d5db20777af0d4
Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
|
|
* Update docs/submodules/releng from branch 'master'
- CPERF: Add CSIT top level suite name arg
Change-Id: I9b6dd3887c84ab035284400b8d3912fb691f1975
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
* Update docs/submodules/releng from branch 'master'
- CPERF: Install ODL tools and log
Adds pip installing odltools into the cperf container. CSIT jobs now
fetch ODL and other OS logs via apex.
Change-Id: I532d3a6fed156709cb305a9f7a6721d1db2eaebc
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
* Update docs/submodules/releng from branch 'master'
- Merge "Apex: Add nosdn ipv6 to daily"
- Apex: Add nosdn ipv6 to daily
Adds ipv6 nosdn scenario to daily. Also includes a fix where the
trailing new line in the template would be removed and fail jjb check in
jenkins.
Change-Id: I928f7b1cf12381cb2af3a8c7e4beb8e8014451c9
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
* Update docs/submodules/releng from branch 'master'
- releng-macros: Update & adopt email-fuel-ptl
Change-Id: I24cc328cdefcd7ac5f34292f0cf1635f797f8f00
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Update Xtesting to 0.36.0
It returns the right status if exception in constructor.
Change-Id: Ic9d857868fb58928164bee2f32d841c64b9b723c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Typos (ressources)
Change-Id: Ifcf1d4bd48b64bc9175c3b0d594f897f4f3f5e7d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 873e5f5c868027d34f36d494719b4dad2bdb1e7d)
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Split modules in apidoc
Change-Id: I467be9a70c74ff4eebfc50b8407fa503468f47ea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Fix rtd requirement order
Change-Id: Ie2fbd978ed0bb9772d66eb367f1bdad32c5afd61
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 10d98efb0cc45e989beceda411ce615347b2a946)
|
|
* Update docs/submodules/functest from branch 'stable/fraser'
- Add rtd-requirements
It's required by rtd which doesn't leverage on PBR.
Change-Id: Ia7ac5ecbb626d5c8b4c9095a1238db55e20790b0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit a72b43b2356625d680d46f5ada201fcfe6ab7222)
|