summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-09-03Merge "Refactor RallyBase"Cedric Ollivier5-118/+69
2018-09-03Refactor RallyBaseJuha Kosonen5-118/+69
This provides a more generic way to integrate test case lists which are not hosted in Functest. Also removes vm scenarios since they have never been a part of actual rally runs. Change-Id: Ib0a020fe72800915bbf2d10ecc690a248d33c246 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-09-03Update tempest plugins tagsCédric Ollivier1-2/+2
Neutron and Barbican tempest plugins have just been released. Change-Id: Ib9c523e9a75dae31249fd84ba454d0ef8537ca1d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-03Switch from tempest section to openstackCédric Ollivier1-10/+10
Rally warns from these deprecated conf sections. Change-Id: I15933c4f2cda14384e53202ec22f438a586d7b05 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Move shaker and vmtp into functest-benchmarkingCédric Ollivier17-50/+152
It also updates all jobs and fixes Dockerhub hooks. Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Update Xtesting to 0.60Cédric Ollivier9-172/+110
Xtesting leverages on stevedore [1] which will bring much more flexibility (discovery, module or class renaming, etc). OPNFV Features have to be updated as well: - https://gerrit.opnfv.org/gerrit/61713 - https://gerrit.opnfv.org/gerrit/61715 - https://gerrit.opnfv.org/gerrit/61717 - https://gerrit.opnfv.org/gerrit/61719 [1] https://docs.openstack.org/stevedore/latest/ Change-Id: I0ce45eb6c9af66546c2c020eb962fa457f6c7e1a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Merge "Optimize fetch"Cedric Ollivier4-10/+10
2018-09-02Optimize fetchCédric Ollivier4-10/+10
depth 1 is set when fetching. Change-Id: I1b470d1e370e18de9b3cfa51e5aea0374f76cac6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-02Merge changes Ib7384772,I94e94c21Cedric Ollivier4-4/+6
* changes: Update to Alpine 3.8 Publish unit test report
2018-09-01Update to Alpine 3.8Cédric Ollivier2-4/+4
https://alpinelinux.org/posts/Alpine-3.8.0-released.html Change-Id: Ib7384772175dd83f735d8cfbfafa1cef3fdc382c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-01Merge changes I4079fa36,I3ad7a38eCedric Ollivier6-31/+37
* changes: Allow refs as vnf requirement versions Avoid downloading git history
2018-09-01Publish unit test reportCédric Ollivier2-0/+2
It leverages on nosehtmloutput [1] [1] https://github.com/openstack-infra/nose-html-output Change-Id: I94e94c2127b4ff8e032e121dd2bd56b3c22809f8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-01Allow refs as vnf requirement versionsCédric Ollivier1-3/+9
Change-Id: I4079fa3641373eee40f8a876a2a525635f2752eb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-09-01Avoid downloading git historyCédric Ollivier6-28/+28
It decreases container build duration. depth 1 is set only when TAG is not a commit id because github.com doesn't advertise commit ids. It switches to git.openstack.org as much as possible. Change-Id: I3ad7a38eda0f7023302d71bb55de23828120f599 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-31Merge "Add concurrency parameter to refstack_defcore tests"Cedric Ollivier2-0/+6
2018-08-30Ensure len(project_name) < 64Cédric Ollivier1-1/+1
https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/259/console https://build.opnfv.org/ci/view/functest/job/functest-fuel-baremetal-daily-master/428/console Change-Id: Ib64878962a71b6b45ef039fce8bfaa43172b2498 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-29Merge "Create new project/user for tempest tests"Cedric Ollivier4-30/+37
2018-08-29Add concurrency parameter to refstack_defcore testsDimitrios Markou2-0/+6
In fraser release we observed that refstack tests are executed in parallel and that might causes problems in CI because without concurrency parameter it will try to use as many cpus as possible and that might lead to race condition issues. This patch is created for backporting purposes to fraser branch where the problem occurs. JIRA: DOVETAIL-662 Change-Id: I6cf0ad3a32e88f04abd00d69523aa8ac47c39470 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-08-29Create new project/user for tempest testsJuha Kosonen4-30/+37
JIRA: FUNCTEST-1009 Change-Id: I6b9bca3827ba6cc804c25689a896ca63eec6a78b Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-29Merge "Support pre-Provisioned credentials"Cedric Ollivier3-3/+16
2018-08-28Support pre-Provisioned credentialsCédric Ollivier3-3/+16
If USE_DYNAMIC_CREDENTIALS = False, Functest is expected for /home/opnfv/functest/data/accounts.yaml which contains the set of pre-existing credentials to use for testing [1]. It also sets admin_domain_scope and default_credentials_domain_name. [1] https://docs.openstack.org/tempest/latest/configuration.html Change-Id: Ie7b81f0c56049260ca99b8e3a6d58cb8a2660659 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Merge "Remove installer type from rally blacklist"Cedric Ollivier3-17/+2
2018-08-28Merge "Remove installer type from tempest blacklist"Cedric Ollivier2-10/+3
2018-08-28Merge "Allow adding a specific role to users created by tempest"Cedric Ollivier1-0/+2
2018-08-28Allow adding a specific role to users created by tempestCédric Ollivier1-0/+2
It may allow bypassing RBAC policies if required. Change-Id: I3b7ad44d7b80f8ea757846afdcd787b686c52856 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Remove installer type from tempest blacklistJuha Kosonen2-10/+3
Enables utilization of blacklist also on non-OPNFV environments since there is no link to installer type. JIRA: FUNCTEST-1008 Change-Id: I3a012b8b7e7dbd049f8794dff3c9d56dcc1cadad Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-28Merge "Protect vs TypeErrors when cleaning stacks"Cedric Ollivier1-0/+3
2018-08-28Remove installer type from rally blacklistJuha Kosonen3-17/+2
Enables utilization of blacklist also on non-OPNFV environments since there is no link to installer type. JIRA: FUNCTEST-1008 Change-Id: I3eb4377af153480794c1a71c5d7ef3e78dacacb9 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-28Protect vs TypeErrors when cleaning stacksCédric Ollivier1-0/+3
It protects vs exceptions raised by shade when cleaning stacks. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/vnf/ims/heat_ims.py", line 226, in clean self.cloud.delete_stack(self.stack.id, wait=True) File "/usr/lib/python2.7/site-packages/shade/openstackcloud.py", line 1416, in delete_stack marker=marker) File "/usr/lib/python2.7/site-packages/shade/_heat/event_utils.py", line 90, in poll_for_events stack_status = stack['stack_status'] TypeError: 'NoneType' object has no attribute '__getitem__' Change-Id: I1a0ed0cd669d5234ca1ff3b6bbc9d1b13f14b02f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-28Fix snaps commit idCédric Ollivier1-1/+1
Snaps is part of main Functest testcases (Healthcheck). A fixed version has to be pulled. We will switch later to snaps packages instead of commit ids. Change-Id: Ibbc3f1009233ccfb67463b49203b756ea86d3121 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-27Support VIO (VMware in OpenStack)Cédric Ollivier5-1/+125
It allows converting all images to vmdk and then patching all testcases. DEPLOY_SCENARIO should match vio to do so. convert_images.sh has to be called as prerequisite. JIRA: FUNCTEST-992 JIRA: FUNCTEST-993 Change-Id: Ie35bf80af1cd9610a8c416ec01b81b61c6148cfe Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-27Use only one image in heat_imsCédric Ollivier2-20/+9
It calls VmReady2.run instead of publishing alt image. Change-Id: If24741fbc5bf7fa3f61ef39a054b148ce53fc4fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-26Avoid duplicating jjb namesCédric Ollivier4-54/+58
It allows loading functest and functest-kubernetes jjbs in one Jenkins. Change-Id: Ia52e84583bc25aad0d1508096b536cbd5585d261 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-26Set juju wait versionCédric Ollivier1-1/+2
It's mandatory before releasing. Change-Id: Iac7b49fb1061b39ee6683e7b30f163cfc2060a95 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Set Neutron and Barbican tempest plugins commit idsCédric Ollivier1-2/+6
They are mandatory before releasing. Change-Id: I2980536e28d183343ff0a9520ca9ee663e437fee Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Remove INSTALLER_TYPE logics in odlCédric Ollivier2-40/+1
JIRA: APEX-621 JIRA: COMPASS-606 Change-Id: I76dde66aefc67f80b40496f705f2864ea9355dcf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Update pip to last versionCédric Ollivier1-0/+4
It allows downloading refs (gerrit reviews). Change-Id: I303f9b753f560fdf945997c7a86e1e29fbd59a06 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Fully remove CreateInstanceSingleNetworkTestsCédric Ollivier1-6/+0
It's linked to a specific configuration on purpose which doesn't meet all OpenStack deployments [1]. JIRA: SNAPS-322 Change-Id: I372f8ed56600e1846383d1da76720a0d3783e901 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-25Merge "Auto Generated INFO.yaml file"Cedric Ollivier1-0/+68
2018-08-25Merge "Integrate Stor4NFV feature openstack test case"Cedric Ollivier4-0/+31
2018-08-25Auto Generated INFO.yaml fileagardner1-0/+68
INFO.yaml meant to be machine readable. This file was auto generated from an ldap lookup and your projects INFO file. Meeting times are not currently filled out. please ammend this patchset to complete Going forward comitter promotions should be done against this file. PTLs: Must be merged for you to gain delete access on testresults.opnfv.org Change-Id: Icbe20cdc100c37203a305617fa931ef9e76e4e12 Signed-off-by: agardner <agardner@linuxfoundation.org>
2018-08-25Integrate Stor4NFV feature openstack test caseQiaowei Ren4-0/+31
Change-Id: I245d0fbe8f026a24138ede4041caae4dccc15cc0 Signed-off-by: Qiaowei Ren <qiaowei.ren@intel.com>
2018-08-24Merge "Create new project/user for snaps tests"valentin boucher3-16/+85
2018-08-24Create new project/user for snaps testsJuha Kosonen3-16/+85
JIRA: FUNCTEST-1003 Change-Id: Ic55998977386f95f619a355d22bd285782fe81f0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2018-08-23Create output directoryGeorg Kunz1-0/+2
The rally.conf gets copied before the target directory has been created. JIRA: FUNCTEST-1007 JIRA: DOVETAIL-730 Change-Id: Ie774fce994ada644c1163600e6c62e1231fde443 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-08-22Execute refstack_defcore in ci/run.yamlCédric Ollivier1-0/+1
Change-Id: Ib65203e74244d87f7ac6b24f6e6abf723c57a786 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-22Temporarily disable shelveCédric Ollivier1-0/+1
They are blocking in Orange Openlab as the support is missing. A dynamic check has to be implemented before activating it. Change-Id: I8d87251fa4589f96d3515e411aeec5e79b7e7960 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-21Fix fixed_network_name in tempest.confCédric Ollivier1-1/+7
It also copies rally.conf and tempest.log in res_dir. Change-Id: Ib907a29ba3f47ca861d3af8afc0ee74446222e89 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-08-20ci/download_images.sh: Reduce wget dot reportingAlexandru Avadanii1-0/+1
Downloading large images outputs a lot of useless dots to show progress. Switch to 1M per dot (from 1K). Change-Id: I00e3d09ef28e7722798eeadc27649a96398aac32 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-08-20Publish Functest daily and gate jobsCédric Ollivier5-0/+366
As opposed to the Releng ones, they are designed to be easily executed by endusers as well. They can be considered as a first step towards a full Functest CI/CD toolchain deployed via docker-compose. All components testcases are enabled here. They hugely leverage on templates to load the right yamls per branch and multijobs to run testcases in parallel. Many steps are proposed allowing running part of the chain. Executors have to be increased to allow running them (it was tested vs 10 and more). At first, all docker images are downloaded to avoid different versions between testcases. They will be improved in a second change to ensure that only one node is selected and to take all Functest env vars into account. Change-Id: I99c7b8ee5d0ddbb00102b3147739b5e8b5c65c23 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>