aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-08-10Publish rally logs to ease debugging.Cédric Ollivier1-10/+17
It also redirect stderr to stdout as tempest mainly prints in stderr. JIRA: FUNCTEST-999 Change-Id: I64bfa31b01aa2ce5444b6e0f0ac46f8cde8dbaa3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add networking-sfc Tempest test suiteCédric Ollivier4-1/+42
Change-Id: I6f1452469cb5ffaf9b538ba87edaa174977b91c4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add networking-bgpvpn Tempest test suiteCédric Ollivier3-1/+40
Change-Id: If3191d8e8c16854aa059e6483b3c0ea704777c05 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Add timeout when running shakerCédric Ollivier1-2/+3
Else shaker may run until job timeout if deployment misconfigurations [1] [1] https://jira.opnfv.org/browse/FUNCTEST-998 JIRA: FUNCTEST-998 Change-Id: I948ff8ffeeccdab637927614193d2c2ef03fe5c8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-09Install Tempest master if OpenStack masterCédric Ollivier1-3/+10
It seems that gates override the upper-constraints in case of Tempest [1][2]. [1] http://logs.openstack.org/80/585180/3/check/tempest-full/aa8b698/controller/logs/pip2-freeze.txt.gz [2] http://artifacts.opnfv.org/logs/functest/lf-virtual3/2018-08-08_16-26-16/tempest_smoke/tempest-report.html JIRA: FUNCTEST-1000 Change-Id: I48530083b453a4a6d6027763210259050b4d0040 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-08Conform with OpenStack gatesCédric Ollivier3-10/+92
It adds testcases and updates regexes to conform with OpenStack gates: - tempest-full - neutron-tempest-plugin-api It should be noted that tempest-smoke is no longer run in gates and two testcases are available for tempest-full as we can't manage Tempest combine. Criteria is set to 100% for tempest_full (it works in OpenStack gates). JIRA: FUNCTEST-1000 Change-Id: I77a0f533255483bdf61f0a5f60c9c437ce843591 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Fix swift operator roleCédric Ollivier1-1/+1
[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Update Xtesting to 0.55.0Cédric Ollivier2-4/+32
It allows calling one skipped test via run_tests (parallel testing). Change-Id: I04e5c69f2129e28f1451815938cd5d0f8bbe9e44 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-06Change juju_epc cidrCédric Ollivier1-0/+2
juju cannot bootstrap if cidr already exists which now happens only if a shared network with the same cidr is defined (it should be considered as a bug about juju). By allocation its own cidr, it protects vs remaining rally or tempest remaining shared networks or vs parallel testing. juju_epc can already run twice in parallel as it creates a new project and a private network. Change-Id: I76c4971d631f763307315478e6cf5a383c91ed36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-04Make synchronous Shade callsCédric Ollivier3-12/+16
It makes difficult to find the issues (floating ip, boot, ssh connection, etc...) for a small benefit regarding the current testcase implementations. It increases the default floating ip timeout because it has been reached when running Functest multiple times in parallel. It may be the root cause when running singlevm vs XCI (in that case, neutron api and agents are hosted in a nested vm). Change-Id: Ia97e04902321644c207c59987283754318aee5e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Setup tempest_smoke images for arm64Delia Popescu1-2/+4
Configure the images to be used for tempest_smoke testcase for ARM JIRA: ARMBAND-395 Change-Id: Ia13507d70fd05ef541a5154886d52fa388731cee Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-08-03Merge "Fix timeout (switch to synchronous calls)"Cedric Ollivier2-3/+1
2018-08-03Protect VMTP vs cidr conflictsCédric Ollivier4-10/+53
It now runs vtmp via a new admin member. Else it fails due to cidr already used. It only creates a router and both tenant networks are still created by VMTP. Change-Id: I05ed41a3b7a01ee97c720176c404929bf8ea97a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Fix timeout (switch to synchronous calls)Cédric Ollivier2-3/+1
It completes "Switch create_server timeout to default value" [1] which forbids waiting more that 180s (create_server was asynchronous). [1] https://gerrit.opnfv.org/gerrit/#/c/60423/2 Change-Id: Icbf9ee48024fe9e10571c2bb7ca895d5828fb561 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Fix typo (ressources)Cédric Ollivier1-2/+2
Change-Id: Ibe131e0cf02493f0f3a82c1e179848605bd0a292 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-03Merge "Fix parse error in tempest_smoke"Cedric Ollivier1-1/+1
2018-08-03Increase Cloudify create_server_timeoutCédric Ollivier1-1/+1
The timeout has been reached when running multiple vnfs in parallel. Only few additional seconds seemed required here. Change-Id: I0d6e38e827c581edb617bb0cc13249645468a2aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-02Fix parse error in tempest_smokeDelia Popescu1-1/+1
Test failes to parse /etc/rally/rally.conf (RALLY_CONF_FILE) whith inplace=1 keyword argument for fileinput One new space is added in second line JIRA: ARMBAND-395 Change-Id: I8adb333047f9962f4105a6a74e2f8ef83d5745e0 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-08-02Upgrade Shaker create_server timeoutCédric Ollivier1-0/+1
It ends after a little bit more than 3 minutes in Apex [1]. It increases to 5 minutes like Cloudify. [1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-30_11-30-01/functest.log Change-Id: I8362034107e694ddd5a1e4a1f9e11362100d7cb0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-01Remove hw_video_model and hw_firmware_type from metadataDelia Popescu1-45/+0
Starting with the Openstack Queens release, hw_firmware_type=uefi is implied on AArch64 by default Using virtio-video, now default in nova, should be used instead of VGA JIRA: ARMBAND-388 Change-Id: I393093c5a1a9dd9c8259b3987db22650313cf249 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-07-31Add fallback mechanism if vlanCédric Ollivier2-5/+12
private_v4 and public_v4 are incorrectly set when vlan is used as overlay. JIRA: FUNCTEST-996 Change-Id: I120a247e92e0fd295769b2a0eeb15ce82a0eabc8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-31Print stderr in logs when calling cmd over sshCédric Ollivier3-4/+6
Change-Id: I152ac898661a0e99a6232df86689c70c468ceaa5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-31Switch create_server timeout to default valueCédric Ollivier2-3/+2
60s was successfully reached when running all containers (3 containers * 3 branches) in parallel. It also removes the wait attribute (the current impl will meet a possible next asynchronous design) which is useless here. For the time being, only cloudify needs an extra timeout. Change-Id: Ic7741b4c1a3223be076fb69ef70a3cb6c05456c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Update Xtesting to 0.54.0Cédric Ollivier1-1/+1
It protects vs uncaught exceptions and then avoids skipping testcases in that case (see cloudify_ims and juju_epc in [1]). [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: I8e39f7e742b9fec2e6f6bab542d5f497159f50ac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Delete alt images before removing the accountCédric Ollivier5-7/+5
Else it could raise unauthorized exceptions [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Protect vs exceptions when creating secretsCédric Ollivier1-6/+17
cloudify_ims sometimes faces with exceptions when creating secrets [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: I197748bf97752575dc14650e1e1c382774811cce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Fix clearwater test results parsingCédric Ollivier1-2/+2
Before it could extract part of the skipped tests [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console Change-Id: I7e7564cb7b96705940051fccf0ff1987f34bb962 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Allow backporting a pylint errorCédric Ollivier1-1/+1
Change-Id: I2df0964d63c80abbc5c5cc438e1fdd32f24fd52f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Fix clean() in cloudify ims and routerCédric Ollivier2-5/+12
It raised exceptions in both branches [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console Change-Id: I87b33cedae768f92296efa4570d2a47cd9cdbdf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Release floating ips used by juju_epcCédric Ollivier1-0/+6
It also cleans flavor_alt and image_alt. Change-Id: I62296075eca75c3c18caac4a3cddeef1fdb26e1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Remove VnfOnBoardingCédric Ollivier5-393/+0
All the vnfs are now inherating from scenarios. Change-Id: I63509102067676ca0676b773db542086caa02d84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-29Update juju_epc to leverage on new scenariosCédric Ollivier1-273/+100
It avoids duplicating codes across all OPNFV testcases. It also fixes the issues when starting mongodb [1] by upgrading juju agent. It stops supporting keystone v2 as the other testcases. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/lastFailedBuild/console Change-Id: I06cddddef1121292ffb695dcb73aa79a07c23192 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-28Leverage vyos_vrouter on CloudifyCédric Ollivier7-414/+112
It also stop rebooting the VMs. Change-Id: Ib0f9e1aac1dd8505378b0688930eb41a590a11f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-27Stop redirecting output to json filesCédric Ollivier2-15/+11
Rally may print additional data to console which results in an invalid json files. The json files are generated via rally instead of dumping stdout. It's mandatory to backport the next bugfix [1] in stable/fraser. [1] https://gerrit.opnfv.org/gerrit/#/c/60265/ Change-Id: Ifbd90e685a7b52c70b3110a46e3c7991eddc05f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-24Reduce cloudify manager disk sizeValentin Boucher1-1/+1
40 Gb is enough Change-Id: Iae6a72fcf91fda67bbd036f478e344478d48264f Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-07-24Merge "Revert "Temporarily disable Snaps CreateRouterSuccessTests""Cedric Ollivier1-10/+7
2018-07-24Merge "New Heat IMS testcase"Cedric Ollivier11-107/+447
2018-07-24Protect vs OS_TENANT_NAME or _ID in shakerCédric Ollivier1-1/+4
It fixes the possible mismatch if both OS_TENANT and OS_PROJECT are set [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/lastFailedBuild/console Change-Id: I66b6e3cf30a34aff1234da00cdd6b40da92089e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-23Detect admin or Admin roleCédric Ollivier1-1/+7
As Keystone roles are case insensitive, Admin is checked as well. Change-Id: I28a611add7890c3188a289d1e24c043d88c34ea1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-23Create heat_stack_owner if requiredCédric Ollivier1-0/+11
It allows testing OpenStack Queens and older [1]. It will be improved in a second change for latest OpenStack releases (if deprecated). [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/174/console Change-Id: I6e91e8c45d335aa606370c35b0a03b990e22c165 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-23New Heat IMS testcaseValentin Boucher11-107/+447
In order to validate OpenStack Master deployment we create this new testcase using OpenStack Heat as an Orchestrator for Clearwater VNF JIRA: FUNCTEST-995 Change-Id: I8b7b74a3753c2d4d4614e9a2798283bd3f99d5d2 Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-07-22Revert "Temporarily disable Snaps CreateRouterSuccessTests"Cédric Ollivier1-10/+7
This reverts commit 74c4e99c18d00d80ce7a2c2f0c36e656a842b966. Change-Id: I6fdfd080e0e3b46e1d65b992e680daefe260add9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-22Revert "Temporarily disable HOT including OS::Nova::FloatingIPAssociation"Cédric Ollivier1-13/+11
This reverts commit 59ba5abb31018282bca796ee0c0652d61192c6bf. Change-Id: I87a01b828668123dc9d96f5ac7823686ff0fb10e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-22Add secrets operations in cloudify.pyCédric Ollivier1-2/+5
It tries to prevent race conditions when running cloudify_ims. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 411, in run if not self.execute(): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 120, in execute self.cfy_client.secrets.create(k, val) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 86, in create response = self.api.put('/secrets/{0}'.format(key), data=data) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 263, in put timeout=timeout) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request 'SSL, but the client does'.format(e) ConnectionError: ('Connection aborted.', BadStatusLine("''",)) Change-Id: Id2603bbda462b50d3140b6f45894c8810d542e4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-22Add helper to find string in consoleCédric Ollivier1-0/+21
It allows checking when cloud-init is finished (see heat_ims). Change-Id: I951aabff29457d7b7544a809f9fce1f83706035e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-21Skip Snaps testcases when OpenStack RockyCédric Ollivier1-0/+13
Snaps is testing vs OpenStack Queens following the traditional release track. Then Snaps testcases must be skipped vs OpenStack master as deployed by Apex. Snaps isn't compatible yet with the last Cinder changes (API microversions) which is out of its current scope [1]. [1] http://artifacts.opnfv.org/logs/functest/lf-pod1/2018-07-19_05-29-02/functest.log Change-Id: I1e93527d9c87eb11bf7fd0cc9d04597614d32370 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-21Add helpers to detect OpenStack versionsCédric Ollivier2-2/+184
It leverages on Nova API Microversions [1]. [1] https://docs.openstack.org/nova/latest/reference/api-microversion-history.html Change-Id: I60abf9089036e56fcbcd6c2b734666ea20875ceb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-20Increase create server timeout for shaker testDelia Popescu1-1/+1
Change-Id: Ie0fdfd2bbd93952bcd35a30c96b7980ffeb0d87c Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-07-20Minor change about subnet poolCédric Ollivier2-2/+2
It reverts the subnet pool to 192.168.120.0/24. It avoids conflicts with default CPE private subnets. It also increases cloudify spawning timeout. Change-Id: I70183cede0690c2cbc74f9c30a38892d829db2c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-20Allow overriding the default roleCédric Ollivier4-2/+18
It allows testing controllers which implements other RBAC policies. Defining NEW_USER_ROLE=admin will easily raise side effects for orchestrators such as Juju and Cloudify. Change-Id: Ia78a25381aeb8aa81fd1872661629e1c08432b8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>