Age | Commit message (Collapse) | Author | Files | Lines |
|
* Update docs/submodules/functest from branch 'master'
- Conforms Vmtp with create_server_timeout
https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/387/console
Change-Id: I3ef130bf5ad4b46f26776feeaa434ca528965f36
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Disable Vmtp if POD_ARCH = aarch64
Vmtp package delivers amd64 binaries in both architectures.
JIRA: ARMBAND-396
Change-Id: I4c6e010e47c8aa9adfafb373c261262d23ef382a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Allow setting two image extra properties per testcase
It conforms with the flavor extra specs model [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/60713/
Change-Id: I1555a313aaf56ae47f9ad2a4529eb8b94e636c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Update all patch configs
It takes all new testcases into account.
It allows running vnfs vs dpdk scenarios too.
Change-Id: I789f6bb1c3df891b1a94f2a674c15085f81f2f23
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Update to Xtesting 0.56
Change-Id: Ia7eb5f6c7448bcd760ebb19e2ad66ba183242e83
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "Test OpenStack vGPU feature"
- Test OpenStack vGPU feature
XCI will be able to deploy this feature
on top of pharos lab with GPU so we have test it
This test can be improved in the future with OpenCL tests etc
| DEPLOY_SCENARIO | os-nosdn-vgpu-ha |
+-------------------+-------------------+------------------+----------------+
| TEST CASE | PROJECT | DURATION | RESULT |
+-------------------+-------------------+------------------+----------------+
| vgpu | functest | 01:00 | PASS |
+-------------------+-------------------+------------------+----------------+
Change-Id: I50618f47097a0257b1834b3966054d20458715df
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Fix rally args when serial (tempest_scenario)
Change-Id: I04c2389310d1377452a171da9bf50fde67e94e7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "Publish rally logs to ease debugging."
- Publish rally logs to ease debugging.
It also redirect stderr to stdout as tempest mainly prints in stderr.
JIRA: FUNCTEST-999
Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "Remove explicit Rally task validation"
- Remove explicit Rally task validation
Utilize the output of Rally task execution since it internally
validates the task.
Use Popen.communicate to get the output from the running Rally task.
Change-Id: I9b1299bc26129ff4f89adccec611c78195a3ab02
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Switch to vmtp commit id
The patch "Reuse the router passed as config if available" [1] was
merged.
[1] https://review.openstack.org/#/c/588459/
Change-Id: Iad8a1ff694f0bff3e13922a6c248dbe49b313a11
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "Fix method name in Vmtp"
- Fix method name in Vmtp
Change-Id: Ie23628f39979e3497c81e23d99f30e0dc7564055
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Add networking-sfc Tempest test suite
Change-Id: I6f1452469cb5ffaf9b538ba87edaa174977b91c4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Add networking-bgpvpn Tempest test suite
Change-Id: If3191d8e8c16854aa059e6483b3c0ea704777c05
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Add timeout when running shaker
Else shaker may run until job timeout if deployment misconfigurations [1]
[1] https://jira.opnfv.org/browse/FUNCTEST-998
JIRA: FUNCTEST-998
Change-Id: I948ff8ffeeccdab637927614193d2c2ef03fe5c8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Install Tempest master if OpenStack master
It seems that gates override the upper-constraints in case of Tempest
[1][2].
[1] http://logs.openstack.org/80/585180/3/check/tempest-full/aa8b698/controller/logs/pip2-freeze.txt.gz
[2] http://artifacts.opnfv.org/logs/functest/lf-virtual3/2018-08-08_16-26-16/tempest_smoke/tempest-report.html
JIRA: FUNCTEST-1000
Change-Id: I48530083b453a4a6d6027763210259050b4d0040
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Conform with OpenStack gates
It adds testcases and updates regexes to conform with OpenStack gates:
- tempest-full
- neutron-tempest-plugin-api
It should be noted that tempest-smoke is no longer run in gates and
two testcases are available for tempest-full as we can't manage
Tempest combine.
Criteria is set to 100% for tempest_full (it works in OpenStack
gates).
JIRA: FUNCTEST-1000
Change-Id: I77a0f533255483bdf61f0a5f60c9c437ce843591
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Fix swift operator role
[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console
Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Update Xtesting to 0.55.0
It allows calling one skipped test via run_tests (parallel testing).
Change-Id: I04e5c69f2129e28f1451815938cd5d0f8bbe9e44
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Change juju_epc cidr
juju cannot bootstrap if cidr already exists which now happens only
if a shared network with the same cidr is defined (it should be
considered as a bug about juju).
By allocation its own cidr, it protects vs remaining rally or tempest
remaining shared networks or vs parallel testing.
juju_epc can already run twice in parallel as it creates a new
project and a private network.
Change-Id: I76c4971d631f763307315478e6cf5a383c91ed36
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Make synchronous Shade calls
It makes difficult to find the issues (floating ip, boot, ssh
connection, etc...) for a small benefit regarding the current
testcase implementations.
It increases the default floating ip timeout because it has been
reached when running Functest multiple times in parallel. It may
be the root cause when running singlevm vs XCI (in that case,
neutron api and agents are hosted in a nested vm).
Change-Id: Ia97e04902321644c207c59987283754318aee5e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Setup tempest_smoke images for arm64
Configure the images to be used for tempest_smoke
testcase for ARM
JIRA: ARMBAND-395
Change-Id: Ia13507d70fd05ef541a5154886d52fa388731cee
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "Fix timeout (switch to synchronous calls)"
- Fix timeout (switch to synchronous calls)
It completes "Switch create_server timeout to default value" [1]
which forbids waiting more that 180s (create_server was asynchronous).
[1] https://gerrit.opnfv.org/gerrit/#/c/60423/2
Change-Id: Icbf9ee48024fe9e10571c2bb7ca895d5828fb561
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Protect VMTP vs cidr conflicts
It now runs vtmp via a new admin member. Else it fails due to cidr
already used.
It only creates a router and both tenant networks are still created
by VMTP.
Change-Id: I05ed41a3b7a01ee97c720176c404929bf8ea97a0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Fix typo (ressources)
Change-Id: Ibe131e0cf02493f0f3a82c1e179848605bd0a292
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "Fix parse error in tempest_smoke"
- Fix parse error in tempest_smoke
Test failes to parse /etc/rally/rally.conf
(RALLY_CONF_FILE) whith inplace=1 keyword argument
for fileinput
One new space is added in second line
JIRA: ARMBAND-395
Change-Id: I8adb333047f9962f4105a6a74e2f8ef83d5745e0
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Increase Cloudify create_server_timeout
The timeout has been reached when running multiple vnfs in parallel.
Only few additional seconds seemed required here.
Change-Id: I0d6e38e827c581edb617bb0cc13249645468a2aa
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Upgrade Shaker create_server timeout
It ends after a little bit more than 3 minutes in Apex [1].
It increases to 5 minutes like Cloudify.
[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-30_11-30-01/functest.log
Change-Id: I8362034107e694ddd5a1e4a1f9e11362100d7cb0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Remove hw_video_model and hw_firmware_type from metadata
Starting with the Openstack Queens release,
hw_firmware_type=uefi is implied on AArch64 by default
Using virtio-video, now default in nova, should be used
instead of VGA
JIRA: ARMBAND-388
Change-Id: I393093c5a1a9dd9c8259b3987db22650313cf249
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Add fallback mechanism if vlan
private_v4 and public_v4 are incorrectly set when vlan is used as
overlay.
JIRA: FUNCTEST-996
Change-Id: I120a247e92e0fd295769b2a0eeb15ce82a0eabc8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Print stderr in logs when calling cmd over ssh
Change-Id: I152ac898661a0e99a6232df86689c70c468ceaa5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Switch create_server timeout to default value
60s was successfully reached when running all containers (3
containers * 3 branches) in parallel.
It also removes the wait attribute (the current impl will meet
a possible next asynchronous design) which is useless here.
For the time being, only cloudify needs an extra timeout.
Change-Id: Ic7741b4c1a3223be076fb69ef70a3cb6c05456c2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Update Xtesting to 0.54.0
It protects vs uncaught exceptions and then avoids skipping testcases
in that case (see cloudify_ims and juju_epc in [1]).
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: I8e39f7e742b9fec2e6f6bab542d5f497159f50ac
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Delete alt images before removing the account
Else it could raise unauthorized exceptions [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Protect vs exceptions when creating secrets
cloudify_ims sometimes faces with exceptions when creating secrets
[1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console
Change-Id: I197748bf97752575dc14650e1e1c382774811cce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Fix clearwater test results parsing
Before it could extract part of the skipped tests [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console
Change-Id: I7e7564cb7b96705940051fccf0ff1987f34bb962
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Allow backporting a pylint error
Change-Id: I2df0964d63c80abbc5c5cc438e1fdd32f24fd52f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Fix clean() in cloudify ims and router
It raised exceptions in both branches [1]
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console
Change-Id: I87b33cedae768f92296efa4570d2a47cd9cdbdf2
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Release floating ips used by juju_epc
It also cleans flavor_alt and image_alt.
Change-Id: I62296075eca75c3c18caac4a3cddeef1fdb26e1b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Remove VnfOnBoarding
All the vnfs are now inherating from scenarios.
Change-Id: I63509102067676ca0676b773db542086caa02d84
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Update juju_epc to leverage on new scenarios
It avoids duplicating codes across all OPNFV testcases.
It also fixes the issues when starting mongodb [1] by upgrading juju agent.
It stops supporting keystone v2 as the other testcases.
[1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/lastFailedBuild/console
Change-Id: I06cddddef1121292ffb695dcb73aa79a07c23192
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Leverage vyos_vrouter on Cloudify
It also stop rebooting the VMs.
Change-Id: Ib0f9e1aac1dd8505378b0688930eb41a590a11f1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Stop redirecting output to json files
Rally may print additional data to console which results in an
invalid json files. The json files are generated via rally instead of
dumping stdout.
It's mandatory to backport the next bugfix [1] in stable/fraser.
[1] https://gerrit.opnfv.org/gerrit/#/c/60265/
Change-Id: Ifbd90e685a7b52c70b3110a46e3c7991eddc05f4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Reduce cloudify manager disk size
40 Gb is enough
Change-Id: Iae6a72fcf91fda67bbd036f478e344478d48264f
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "Revert "Temporarily disable Snaps CreateRouterSuccessTests""
- Revert "Temporarily disable Snaps CreateRouterSuccessTests"
This reverts commit 74c4e99c18d00d80ce7a2c2f0c36e656a842b966.
Change-Id: I6fdfd080e0e3b46e1d65b992e680daefe260add9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Merge "New Heat IMS testcase"
- New Heat IMS testcase
In order to validate OpenStack Master deployment
we create this new testcase using OpenStack Heat
as an Orchestrator for Clearwater VNF
JIRA: FUNCTEST-995
Change-Id: I8b7b74a3753c2d4d4614e9a2798283bd3f99d5d2
Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Protect vs OS_TENANT_NAME or _ID in shaker
It fixes the possible mismatch if both OS_TENANT and OS_PROJECT are
set [1].
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console
Change-Id: I66b6e3cf30a34aff1234da00cdd6b40da92089e5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Detect admin or Admin role
As Keystone roles are case insensitive, Admin is checked as well.
Change-Id: I28a611add7890c3188a289d1e24c043d88c34ea1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Create heat_stack_owner if required
It allows testing OpenStack Queens and older [1].
It will be improved in a second change for latest OpenStack releases
(if deprecated).
[1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/174/console
Change-Id: I6e91e8c45d335aa606370c35b0a03b990e22c165
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Revert "Temporarily disable HOT including OS::Nova::FloatingIPAssociation"
This reverts commit 59ba5abb31018282bca796ee0c0652d61192c6bf.
Change-Id: I87a01b828668123dc9d96f5ac7823686ff0fb10e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Add secrets operations in cloudify.py
It tries to prevent race conditions when running cloudify_ims.
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 411, in run
if not self.execute():
File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 120, in execute
self.cfy_client.secrets.create(k, val)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 86, in create
response = self.api.put('/secrets/{0}'.format(key), data=data)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 263, in put
timeout=timeout)
File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request
'SSL, but the client does'.format(e)
ConnectionError: ('Connection aborted.', BadStatusLine("''",))
Change-Id: Id2603bbda462b50d3140b6f45894c8810d542e4c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Add helper to find string in console
It allows checking when cloud-init is finished (see heat_ims).
Change-Id: I951aabff29457d7b7544a809f9fce1f83706035e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Skip Snaps testcases when OpenStack Rocky
Snaps is testing vs OpenStack Queens following the traditional
release track. Then Snaps testcases must be skipped vs OpenStack
master as deployed by Apex.
Snaps isn't compatible yet with the last Cinder changes (API
microversions) which is out of its current scope [1].
[1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-19_05-29-02/functest.log
Change-Id: I1e93527d9c87eb11bf7fd0cc9d04597614d32370
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Add helpers to detect OpenStack versions
It leverages on Nova API Microversions [1].
[1] https://docs.openstack.org/nova/latest/reference/api-microversion-history.html
Change-Id: I60abf9089036e56fcbcd6c2b734666ea20875ceb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Increase create server timeout for shaker test
Change-Id: Ie0fdfd2bbd93952bcd35a30c96b7980ffeb0d87c
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Minor change about subnet pool
It reverts the subnet pool to 192.168.120.0/24.
It avoids conflicts with default CPE private subnets.
It also increases cloudify spawning timeout.
Change-Id: I70183cede0690c2cbc74f9c30a38892d829db2c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Allow overriding the default role
It allows testing controllers which implements other RBAC policies.
Defining NEW_USER_ROLE=admin will easily raise side effects for
orchestrators such as Juju and Cloudify.
Change-Id: Ia78a25381aeb8aa81fd1872661629e1c08432b8f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Stop Fuel logics in odl
Fuel is setting the right env vars [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/59929/
Change-Id: Ieb0ae1887859e0b7d3f77dfb5100a633b6479a37
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Cover cinder testcases
JIRA: FUNCTEST-908
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ie9662877cba89ea96de4403ee2b736c118a044d5
Signed-off-by: Delia Popescu <delia.popescu@enea.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Temporarily disable test_image_signing tests
They don't pass in two different Queens deployments.
The topic will continue upstream.
Change-Id: I43d6b8306aee6934fa1545ec3ed8130bb9b23ee4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
- Remove logics about Daisy in odl
Daisy is now setting the right env vars [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/59839/1
Change-Id: If23c0ac0b5ab2f4f4b9515e27d845cb9c4d07ded
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
* Update docs/submodules/functest from branch 'master'
- Switch VMTP_TAG to the new commit id
The related review has been merged [1].
[1] https://review.openstack.org/#/c/580914/
Change-Id: I64dc2a38b08d02ea653582159d2af83fc7e16e31
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|