summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-08-19Typos (ressources)Cédric Ollivier2-14/+14
Change-Id: Ifcf1d4bd48b64bc9175c3b0d594f897f4f3f5e7d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 873e5f5c868027d34f36d494719b4dad2bdb1e7d)
2018-08-18Split modules in apidocCédric Ollivier6-30/+34
Change-Id: I467be9a70c74ff4eebfc50b8407fa503468f47ea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Fix rtd requirement orderCédric Ollivier1-2/+2
Change-Id: Ie2fbd978ed0bb9772d66eb367f1bdad32c5afd61 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 10d98efb0cc45e989beceda411ce615347b2a946)
2018-08-18Add rtd-requirementsCédric Ollivier2-37/+4
It's required by rtd which doesn't leverage on PBR. Change-Id: Ia7ac5ecbb626d5c8b4c9095a1238db55e20790b0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a72b43b2356625d680d46f5ada201fcfe6ab7222)
2018-08-18Generate API doc rst filesCédric Ollivier7-38/+73
It also fixes few docstrings Change-Id: I09b3456e82953f64ec49628e2979115cc7bbec55 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-18Publish Functest doc onlineCédric Ollivier10-74/+8
It reverts Sphinx theme to the default one as it's hugely better for API docs. Change-Id: Ic489e9b65d67d71fadb8ef78176a04cc382a3f5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 20ee61db8d38bf12127afd12e34ac601d36b3ff5)
2018-08-17Allocate OperatorCloud instead of OpenStackCloudCédric Ollivier1-1/+1
Else it fails for Rally which lists computes [1]. Former Shade releases split Openstack operations into 2 classes. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-fraser/269/console Change-Id: Icdf01c540ff62d7e7ef609929e806334823d2969 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-16Create new project/user for rally testJuha Kosonen4-11/+30
FUNCTEST-1002 Change-Id: Id19b9aa70aeded6d99978084b3de4a63e31a81ad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit 4b7d89de42fe9a3867b12ea39721ad92aff96340)
2018-08-13Fix typo (ressources)Cédric Ollivier1-2/+2
Change-Id: Ibe131e0cf02493f0f3a82c1e179848605bd0a292 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8cfa994563a238bbd34d01e97de1fcfd40535e6e)
2018-08-13Allow setting two image extra properties per testcaseCédric Ollivier1-13/+17
It conforms with the flavor extra specs model [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/60713/ Change-Id: I1555a313aaf56ae47f9ad2a4529eb8b94e636c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8d3eb364d84f90b19f9e7234d01add8764843081)
2018-08-13Update all patch configsCédric Ollivier3-6/+99
It takes all new testcases into account. It allows running vnfs vs dpdk scenarios too. Change-Id: I789f6bb1c3df891b1a94f2a674c15085f81f2f23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 484acb3716b6f6261793b8a6a0220cce62ccb0c3)
2018-08-12Update to Xtesting 0.35Cédric Ollivier1-1/+1
Change-Id: I2a38fca608d866ed643f5d021cb85488f35c79f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-07Fix swift operator roleCédric Ollivier1-1/+1
[1] https://build.opnfv.org/ci/view/functest/job/functest-fuel-armband-baremetal-daily-master/35/console Change-Id: I7236bf5a74f36941f499da32c5c77dcd0b98b6f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3d1986d1a8035e93b7ad7e4331cb1cbe126a857f)
2018-08-07Update Xtesting to 0.34.0Cédric Ollivier3-7/+32
It mainly fixes negative regex operations and allows calling one skipped test via run_tests (parallel testing). Change-Id: Ibf34ecf2dae46c4c3af15d05af2946c9eb33f6cd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-06Change juju_epc cidrCédric Ollivier1-0/+2
juju cannot bootstrap if cidr already exists which now happens only if a shared network with the same cidr is defined (it should be considered as a bug about juju). By allocation its own cidr, it protects vs remaining rally or tempest remaining shared networks or vs parallel testing. juju_epc can already run twice in parallel as it creates a new project and a private network. Change-Id: I76c4971d631f763307315478e6cf5a383c91ed36 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 27bc4acea711b5e6e09102bdc4209c9ef13283f3)
2018-08-04Make synchronous Shade callsCédric Ollivier1-10/+14
It makes difficult to find the issues (floating ip, boot, ssh connection, etc...) for a small benefit regarding the current testcase implementations. It increases the default floating ip timeout because it has been reached when running Functest multiple times in parallel. It may be the root cause when running singlevm vs XCI (in that case, neutron api and agents are hosted in a nested vm). Change-Id: Ia97e04902321644c207c59987283754318aee5e5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8faf2e3365fc5acc0167a05a919eef564f11491a)
2018-08-03Fix timeout (switch to synchronous calls)Cédric Ollivier2-3/+1
It completes "Switch create_server timeout to default value" [1] which forbids waiting more that 180s (create_server was asynchronous). [1] https://gerrit.opnfv.org/gerrit/#/c/60423/2 Change-Id: Icbf9ee48024fe9e10571c2bb7ca895d5828fb561 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f31841906a7cddcecc4c8fba9b641265811e9b7f)
2018-08-03Increase Cloudify create_server_timeoutCédric Ollivier1-1/+1
The timeout has been reached when running multiple vnfs in parallel. Only few additional seconds seemed required here. Change-Id: I0d6e38e827c581edb617bb0cc13249645468a2aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 9c19bb9bb41e36d4ca70563649ced92ce7ab9b82)
2018-08-01Add fallback mechanism if vlanCédric Ollivier2-5/+12
private_v4 and public_v4 are incorrectly set when vlan is used as overlay. JIRA: FUNCTEST-996 Change-Id: I120a247e92e0fd295769b2a0eeb15ce82a0eabc8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 5522ecd302ee54b494714cb2e1af0fe2381e5c37)
2018-08-01Print stderr in logs when calling cmd over sshCédric Ollivier3-4/+6
Change-Id: I152ac898661a0e99a6232df86689c70c468ceaa5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit b66827d753e09c29cd6f541119dc0ec4c6344511)
2018-07-31Switch create_server timeout to default valueCédric Ollivier1-2/+2
60s was successfully reached when running all containers (3 containers * 3 branches) in parallel. It also removes the wait attribute (the current impl will meet a possible next asynchronous design) which is useless here. For the time being, only cloudify needs an extra timeout. Change-Id: Ic7741b4c1a3223be076fb69ef70a3cb6c05456c2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 1b75bbbc4e842ca2c8c14957261c88692f9e4828)
2018-07-30Delete alt images before removing the accountCédric Ollivier5-7/+5
Else it could raise unauthorized exceptions [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: Ia9b857069f775e2c8ecc5e07cf39b3a1fb7e3540 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 28a706149ede8c644f63c7b5a4f3b02a9806e548)
2018-07-30Fix cloudify src dirsValentin Boucher3-5/+5
It completes "Refactor Ims testing" [1]. [1] https://gerrit.opnfv.org/gerrit/60331 Change-Id: I3d971a07ad1199ab48f81f7484d33e7f35d12377 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-30Protect vs exceptions when creating secretsCédric Ollivier1-6/+17
cloudify_ims sometimes faces with exceptions when creating secrets [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/188/console Change-Id: I197748bf97752575dc14650e1e1c382774811cce Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cfb241ab63898eb4a550fc571d34952d33996e9c)
2018-07-30Fix clearwater test results parsingCédric Ollivier1-2/+2
Before it could extract part of the skipped tests [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console Change-Id: I7e7564cb7b96705940051fccf0ff1987f34bb962 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 3d6f7e8b3a6cfe4c926bd93d45861c80970e35f7)
2018-07-30Fix clean() in cloudify ims and routerCédric Ollivier2-5/+12
It raised exceptions in both branches [1] [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/209/console Change-Id: I87b33cedae768f92296efa4570d2a47cd9cdbdf2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 6ff2161dd0af56bcbac49fd1417dc52031c55bf5)
2018-07-30Refactor Ims testingValentin Boucher4-98/+108
Change-Id: I8b7b74a3753c2d4d4614e9a2798283bd3f99d5d2 Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com> (cherry picked from commit 026a9bfaa656d0e5ade327feda64f17796d6f209)
2018-07-30Release floating ips used by juju_epcCédric Ollivier1-0/+6
It also cleans flavor_alt and image_alt. Change-Id: I62296075eca75c3c18caac4a3cddeef1fdb26e1b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit d072a425f48640780ca6a6d1f6332ec73d6bf5be)
2018-07-30Remove VnfOnBoardingCédric Ollivier5-393/+0
All the vnfs are now inherating from scenarios. Change-Id: I63509102067676ca0676b773db542086caa02d84 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 366adc757e3beaeb1db7811df511a0e38c3eee6d)
2018-07-30Leverage vyos_vrouter on CloudifyCédric Ollivier7-427/+119
It also stop rebooting the VMs. Change-Id: Ib0f9e1aac1dd8505378b0688930eb41a590a11f1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit e2fe0591bcfc462a91c028a857d967f4b9832bbe)
2018-07-29Update juju_epc to leverage on new scenariosCédric Ollivier1-273/+100
It avoids duplicating codes across all OPNFV testcases. It also fixes the issues when starting mongodb [1] by upgrading juju agent. It stops supporting keystone v2 as the other testcases. [1] https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/lastFailedBuild/console Change-Id: I06cddddef1121292ffb695dcb73aa79a07c23192 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 592584fbde2fb9b3b58015d374b2100026310d24)
2018-07-291) Cleanup floating IPs that are assigned through Juju Deployment.soumaya1-10/+64
2) Add SCTP rule explicitly to the retrieved Security Group. Change-Id: I38e5b1267dbcdcf8e5aadb3c06dd784044e774d4 Signed-off-by: soumaya <soumaya.nayek@rebaca.com> (cherry picked from commit 92b52ef2bd3567c6c34288a22801249adb5ee7ab)
2018-07-27Stop overriding neutron extension discoveryCédric Ollivier4-31/+4
Tempest is able to discover Trunk extensions [1]. Then it's useless to override tempest.conf for Neutron trunk testing. [1] http://artifacts.opnfv.org/logs/functest/huawei-pod2/fraser/2018-07-26_12-11-20/tempest/tempest.log Change-Id: Ie5f90d5b15b5535526db01b3f08ec55d3ab1e0c0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-07-27Stop redirecting output to json filesCédric Ollivier2-15/+11
Rally may print additional data to console which results in an invalid json files. The json files are generated via rally instead of dumping stdout. It's mandatory to backport the next bugfix [1] in stable/fraser. [1] https://gerrit.opnfv.org/gerrit/#/c/60265/ Change-Id: Ifbd90e685a7b52c70b3110a46e3c7991eddc05f4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 18c96abe8b6a3d6e919ff7ba64952454830357b3)
2018-07-27Refactor task results manipulation in rallyJuha Kosonen2-75/+130
Use data provided by report generation since the output of task results is not available as valid JSON if task didn't finish gracefully. JIRA: FUNCTEST-966 Change-Id: Ieb906bc209cc26055babd5f4e6b2bb556724f9a8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com> (cherry picked from commit a4ed4eb2b6802bcf10aa944854a68b16147245cc)
2018-07-27Set filename_alt in tempestCédric Ollivier1-0/+1
Change-Id: I9137ee30bd2107ec23ef6cfea92ccfc5f010410d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 29bd4108c51180a4d74443f676fc72866af6f1f6)
2018-07-27Allow overriding the default roleCédric Ollivier4-2/+18
It allows testing controllers which implements other RBAC policies. Defining NEW_USER_ROLE=admin will easily raise side effects for orchestrators such as Juju and Cloudify. Change-Id: Ia78a25381aeb8aa81fd1872661629e1c08432b8f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 51f3e7a3cc4409fb9dda03bffa1252a8660f38b0)
2018-07-27TypoCédric Ollivier1-1/+1
Change-Id: Ibff3b01c50bfee266d0b99fab5b7baf271d43de4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 59fa6d205d03464246442a362cbed3caa8e32a2a)
2018-07-27Leverage cloudify_ims on CloudifyCédric Ollivier7-339/+138
It also defines 2 new methods to avoid duplicating code: - TenantNetwork1.get_public_auth_url() - VmReady1.publish_image_alt() Shaker and Tempest are updated as well. Change-Id: Ie9095c57c580b95f067d5a8275ad71818b4df335 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 8e96ddfb6a6548a9a7a9b4a686e01378425a1cd8)
2018-07-27Support py3 in uncovered packagesCédric Ollivier6-20/+25
It has to be noted that cloudify_rest_client doesn't support py3 then next unit tests vs cloudify-based testcases would be excluded. Change-Id: I0b0e64929d1238665c778ce51fd6abd5ccf06b6c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7f2d7515e068c2ba072d4f3b4cf0997e06ae8460)
2018-07-27Add py3 support in tempest and rallyCédric Ollivier6-23/+28
Change-Id: I009d38a0db409ab4ec641cba9173ab2386d0ce2a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 09d6e6feef33fa47bca440a096894b851b1ebca5)
2018-07-27Remove cloudify_ims_perfCédric Ollivier12-18105/+0
All that modules are uncovered, unverified and deprecated. They will be safely reverted as soon as they are updated, verified by gates and unit tests are added. Change-Id: Iac0893f9f0ccb485d91cd17305e744aff9bf9414 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cd8edb720d2e72842c35e9d6271fc81e6717679d)
2018-07-27Force region to RegionOne if OS_REGION_NAME is unsetCédric Ollivier4-7/+11
tempest still selects the first one if unset [1]. JIRA: FUNCTEST-990 [1] https://docs.openstack.org/tempest/latest/sampleconf.html Change-Id: I238d47173c2c4aa1db694028e4d44b80b0e280f1 Signed-off-by: Cédric Ollivier <ollivier.cedric@gmail.com> (cherry picked from commit 8b2f524f0f17f06bf1de02e0165230bad218132b)
2018-07-27Refactor tempest commonCédric Ollivier10-384/+84
It also renames two testcases and updates all docs because tests run in parallel in case of tempest smoke. To force one thread as before: run: module: 'functest.opnfv_tests.openstack.tempest.tempest' class: 'TempestCommon' args: mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' option: - '--concurrency=1' JIRA: FUNCTEST-989 Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit eb8f57466325f398c6b8b5f4d15005c71879a269)
2018-07-26Add helper to find string in consoleCédric Ollivier1-0/+21
It allows checking when cloud-init is finished (see heat_ims). Change-Id: I951aabff29457d7b7544a809f9fce1f83706035e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a80ebe8794dd2693203ceea65a13a69dcf508f94)
2018-07-26Minor change about subnet poolCédric Ollivier2-2/+2
It reverts the subnet pool to 192.168.120.0/24. It avoids conflicts with default CPE private subnets. It also increases cloudify spawning timeout. Change-Id: I70183cede0690c2cbc74f9c30a38892d829db2c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit cb7e4e1e0687b79a0528ebe6a37683049d960210)
2018-07-26Increase timeout when creating serversCédric Ollivier2-3/+4
It takes times to prepare disk on compute nodes (spawning). The default value is enough for all cirros VMs but it has to be increased for all cloudify VMs (4.1G). Change-Id: I3f1fc0142a73c586e9219a2718bfc467cc48e275 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c391f57e6797e544d14285ca433b2499ed84cd5f)
2018-07-26Reduce cloudify manager disk sizeValentin Boucher1-1/+1
40 Gb is enough Change-Id: Iae6a72fcf91fda67bbd036f478e344478d48264f Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com> (cherry picked from commit 363060485f107bb0af09977e101abc54f1fa207c)
2018-07-26Add secrets operations in cloudify.pyCédric Ollivier1-2/+5
It tries to prevent race conditions when running cloudify_ims. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 411, in run if not self.execute(): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 120, in execute self.cfy_client.secrets.create(k, val) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 86, in create response = self.api.put('/secrets/{0}'.format(key), data=data) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 263, in put timeout=timeout) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request 'SSL, but the client does'.format(e) ConnectionError: ('Connection aborted.', BadStatusLine("''",)) Change-Id: Id2603bbda462b50d3140b6f45894c8810d542e4c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit f426c72f2bb6381c631794a4b9f4c3322832e0d3)
2018-07-26Force a GET operations on cloudify APICédric Ollivier1-0/+2
Cloudify is considered as running by the client but sometimes it failed when listing secrets right after. It adds that check in cloudify.py. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/core/singlevm.py", line 391, in run if not self.execute(): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/cloudify_ims.py", line 119, in execute secrets_list = self.cfy_client.secrets.list() File "/usr/lib/python2.7/site-packages/cloudify_rest_client/secrets.py", line 113, in list response = self.api.get('/secrets', params=params) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 252, in get timeout=timeout) File "/usr/lib/python2.7/site-packages/cloudify_rest_client/client.py", line 233, in do_request 'SSL, but the client does'.format(e) ConnectionError: ('Connection aborted.', BadStatusLine("''",)) Change-Id: Ie1b25ff529cfbf9f7476821499da369a46126e81 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit c4c3a33b9e6ae87c15331bf95e5544f0f680e4f0)