summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-04-18Merge "Introduction of PDF/IDF"Manuel Buil2-0/+237
2018-04-18Start documenting CI Loops and Confidence Loops applied by XCIFatih Degirmenci1-0/+74
Please note that the document you are about to review contains information about the existing CI Loops and promotion criterias applied by XCI in order to record the current state of affairs. Once this change gets merged, a new change will be proposed and that change will be the one where the existing criterias will be updated and the new ones will be introduced. This document is created to start the conversation around determining the promotion criterias (test scopes) for each of the current and upcoming CI Loops XCI uses. The expectation with this document is to update it collaboratively with scenario owners, projects, XCI Team, Test Projects, and Release Management to find the necessary level of testing as much as possible. The information this document contains and the criterias set in it will be superseded by the CD-Based Release model once it becomes available. Change-Id: I7b4afd87a4f7694eb78c996e7870b8dc1e833fbf Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-17xci: infra: bifrost: Use XCI virtual environment for bifrostMarkos Chandras1-2/+10
We have already prepared a virtual environment for XCI so we may as well use it for bifrost as well. Change-Id: I084e5da7259a392c5d58e62e7985feb75bb45fb2 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-17Merge "xci: osa: Fix OpenStack-Ansible bootstrap"Fatih Degirmenci1-0/+1
2018-04-17xci: osa: Fix OpenStack-Ansible bootstrapMarkos Chandras1-0/+1
Commit 269b5fc033b1ee8d14d9d4694f4f0d3765866c0a ("xci: installer: osa: Fix status report when bootstrapping OSA") removed the 'chdir' parameter by accident and this broke the OpenStack-Ansible bootstrapping. This patch brings the missing parameter back. Change-Id: I0ecfa0eb4c91a9f1dfa2d86a8a50bacdbd224533 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-17Merge "xci: kubespray: Fix inventory when configuring keys on targethosts"Markos Chandras3-17/+10
2018-04-17Merge "xci: Add k8-nosdn-nofeature role"Markos Chandras6-6/+74
2018-04-17Introduction of PDF/IDFBlaisonneau David2-0/+237
this is a proposition of self sufficient PDF/IDF to describe the POD where XCI is running. The PDF [Pod Description File] is describing the physical level of the POD where XCI will run the installer. It lists servers and their description (CPU/RAM/DISK/NICS) The IDF [Installer Description File] is describing how the installers will use the POD. 2 sections are today important in this IDF: - idf.net_config is describing the network topology - xci section is set to describe how common steps (network, nfs, ceph,...) of XCI will use the pod. Another section of IDF idf.[installer], curretnly empty, will contain all pod specificities that are linked to an installer (osa, kolla, k8s,...) and not shared with the others. Those 2 files are describing the vitual pod as it is already deployed by the XCI. Those default files can be replaced by the ones describing the target pod (done manually or with the CI). It would then be to the install process to take into account these files (to be done). Change-Id: I3dcbd965f8c84b03d34eb0fd68599d7bec402dbd Signed-off-by: Blaisonneau David <david.blaisonneau@orange.com>
2018-04-17Merge "Create directory to move xci scripts from releng/jjb/xci"Fatih Degirmenci1-0/+7
2018-04-16Merge "xci: installer: osa: Fix status report when bootstrapping OSA"Markos Chandras1-3/+0
2018-04-16xci: kubespray: Fix inventory when configuring keys on targethostsMarkos Chandras3-17/+10
The SSH keys for the OPNFV host have been configured in the configure-opnfvhost.yml playbook so we shouldn't do that in a playbook that is only meant to configure the target hosts. As such, fix the group to use 'k8s-cluster' instead. Since the targethosts playbook does not apply to all hosts anymore, we can simply drop the list of required packages and only install 'netaddr' on the OPNFV host which is the host that needs it. Similarly, the dbus package is only needed on the targethosts. Change-Id: I293ad83a3a95797d9025f2cddd7849be7b3a49da Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-16xci: Add k8-nosdn-nofeature rolewutianwei6-6/+74
Move default k8s-cluster.yml from kubespray/files/ to role/k8-nosdn-nofeature/files/k8s-cluster.yml since it's scenario specific. Moreover, we set 'cloud' as kube_network_plugin, which would use kubnet as network plugin. The kubenet network plugin requires routing between to be setup by the administrator so we need to add static routes on every host since they are connected using a bridge instead of a router. installer-type:kubespray deploy-scenario:k8-nosdn-nofeature Change-Id: I6ab7288c966d7f17e9d61279056f7673be37bebe Signed-off-by: wutianwei <wutianwei1@huawei.com> Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-16Create directory to move xci scripts from releng/jjb/xciFatih Degirmenci1-0/+7
This change proposes creation of a folder named ci in releng-xci in order to move the XCI scripts from Releng. The reason to name the directory ci is that this directory has been in use by the majority of OPNFV Projects and Releng either executes the scripts directly or with the help of wrapper scripts that do not contain project specific logic. Scripts developed in releng/jjb/xci has too much XCI specific stuff in them, making it difficult to keep the separation between XCI framework and CI itself. Apart from that, having scripts in Releng makes it troublesome to verify them properly. Another importance of moving the scripts here is to ensure these scripts can be used by other CI/automation tooling such as Zuul in future. It is better to move the scripts now before things get even more complicated to move. Change-Id: Id22c2c2e09950b49a36a04a78208a3404de9c088 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-14Download only the needed images for OpenStack Functest HealthcheckFatih Degirmenci1-1/+9
Some of the files needed by Functest are pretty big and it takes time to download them all so this change ensures that the files are needed by healthcheck is downloaded and the rest is not. Further changes are needed to make the list even smaller for smoke test but we need Functest guidance to identify which of them are needed for what testing. It could be done by having suite specific download_images.sh like download_images_healthcheck.sh, download_images_smoke.sh and so on. deploy-scenario:os-nosdn-nofeature installer-type:osa Change-Id: Ib2c5867adfad8097d1a084c39ad08cc4df2e4549 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-13xci: installer: osa: Fix status report when bootstrapping OSAMarkos Chandras1-3/+0
Fixes the following ansible-lint warning [WARNING]: While constructing a mapping from /home/devuser/releng- xci/xci/installer/osa/playbooks/configure-opnfvhost.yml, line 113, column 7, found a duplicate dict key (args). Using last defined value only. We also remove the changed_when value since we now use 'args' to get proper status report. Change-Id: I382e3183b66e590462fbcb8663d53cade0e5d92c Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-13xci: opnfv-scenario-requirements: Add openSUSE to k8-canal-nofeatureMarkos Chandras1-0/+1
openSUSE is supported in kubespray so we add it to the k8s-canal-nofeature scenario. installer-type:kubespray deploy-scenario:k8-canal-nofeature Change-Id: I626e98beef220f724ae72329be42b959a03ce87b Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-13xci: opnfv-scenario-requirements: Add openSUSE to k8-calico-nofeatureMarkos Chandras1-1/+2
openSUSE is supported in kubespray so we add it to the k8s-calico-nofeature scenario. installer-type:kubespray deploy-scenario:k8-calico-nofeature Change-Id: I1ffa972b7bb1f949645bb585d2a8688cf4580342 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-13Merge "Integrate the k8-flannel-nofeature scenario"Markos Chandras4-0/+327
2018-04-13Merge "Simplify odl scenarios"Periyasamy Palanisamy3-12/+4
2018-04-13Integrate the k8-flannel-nofeature scenarioTaseer Ahmed4-0/+327
installer-type:kubespray deploy-scenario:k8-flannel-nofeature Change-Id: Ie47efe4759b2cf52421cd2edf5e7817442b0026f Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2018-04-13xci: kubespray: Bump SHA to include openSUSE supportMarkos Chandras2-8/+1
The upstream PR to include openSUSE support has been merged so we need to bump the SHA to make it available in XCI. Change-Id: Ida5bd05ce8b0c883b6d7582a495ca934ecc4b1f1 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-13Merge "Create the k8-calico-nofeature scenario"Markos Chandras4-1/+327
2018-04-13Merge "Remove duplicated info line for bifrost version"Fatih Degirmenci1-2/+1
2018-04-13Create the k8-calico-nofeature scenariowutianwei4-1/+327
installer-type:kubespray deploy-scenario:k8-calico-nofeature Change-Id: Ief8557149fd47faab43f8f4bedcf6466dac2275f Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-04-13Merge "Redirect virsh output to /dev/null in cleanup script"Fatih Degirmenci1-4/+4
2018-04-13Merge "Switch to Gerrit for scenario source urls"Fatih Degirmenci1-3/+3
2018-04-12Switch to Gerrit for scenario source urlsFatih Degirmenci1-3/+3
In the past, there were cases where the Git mirrors were out of sync with Gerrit which caused the use of outdated repos. This change switches all scenarios to Gerrit. Apart from that, it also aligns the urls across all scenarios. Change-Id: I5301630a71446df8668f16c81bf26d81bcea8031 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-12Create the k8-canal-nofeature scenariowutianwei5-0/+327
add the k8-nosdn-noeature and k8-canal-nofeature roles under scenarios directory run different roles to configure the k8s-cluster according to the deploy scenario installer-type:kubespray deploy-scenario:k8-canal-nofeature Change-Id: Ia96b01f79fb058e045c5b7d9d9aecb7f15a21e63 Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-04-12Simplify odl scenariosManuel Buil3-12/+4
So far we were building the repo url variable in the odl scenarios. Moving that logic to ODL role probably makes more sense as it can be reused by all scenarios. This patch passes the odl_version to OSA. That variable will be processed by the ODL role, which will finally generate the repo url variable deploy-scenario:os-odl-nofeature installer-type:osa Change-Id: I0c9da069238348af6d00d8422ca478cb4be4cfad Signed-off-by: Manuel Buil <mbuil@suse.com>
2018-04-12Update prepare-functest role for k8s and fix fetching xci.envFatih Degirmenci4-25/+66
This change updates prepare-functest role for testing k8s scenarios using functest healthcheck. The changes include - update tasks to skip checking/creation of public gateway which is needed for OpenStack based scenarios - update run-functest.sh.j2 template and set the used docker image name based on FUNCTEST_SUITE_NAME that is going to be used - update run-functest.sh.j2 template and add commands needed to run tests using functest-kubernetes-${FUNCTEST_SUITE_NAME} docker image - update env.j2 to exclude setting the var EXTERNAL_NETWORK which is needed for OpenStack based scenarios Apart from updating the the prepare-functest role, a bug has also been fixed by adding the fetching of xci.env for installer kubespray. installer-type:kubespray deploy-scenario:k8-nosdn-nofeature Change-Id: Ia701db9748ea9509a2dc165341285fb189aa7266 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-12Remove duplicated info line for bifrost versionFatih Degirmenci1-2/+1
Change-Id: If49cebc6ac6b1a80fbddceaf55a2cf1df299583a Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-11Set additional variables for functestFatih Degirmenci2-3/+12
CI_LOOP, NODE_NAME, and BUILD_TAG are needed for logging info to console. FUNCTEST_MODE and FUNCTEST_SUITE_NAME are important for stating what level of testing we do for verify and merge jobs. Change-Id: Iaa5499155b4b94a1cfc6b5c70fe6f8f7417502a6 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-11Export OPENSTACK_REQUIREMENTS_VERSIONVictor Morales2-4/+4
The hash value for the OpenStack requirements project is consumed for other projects which can be out of the openstack-ansible scope. This change creates the OPENSTACK_REQUIREMENTS_VERSION variable using the openstack_services.yml value as default one. Change-Id: I4544bcc3f14c107aab8ebba1dced1ba203f07f68 Signed-off-by: Victor Morales <victor.morales@intel.com>
2018-04-10shabump: Bump SHA to make sfc scenario workManuel Buil1-1/+1
sfc scenario fails when running the functest snaps-healthcheck. The reason is a race condition found in ODL Nitrogen. This race condition is gone in ODL Oxygen. We need latest ODL role to include the ODL Oxygen version Depends-On: I59802f467a77ae755886e4cc389c2406e9d17d4c deploy-scenario:os-odl-sfc installer-type:osa Change-Id: I6d575370834eabb1b6a0532f74e1b2fc733e500c Signed-off-by: Manuel Buil <mbuil@suse.com>
2018-04-10Merge "Revert "display the correct deploy scenario for the functest run""Fatih Degirmenci1-1/+1
2018-04-10Merge "export LANG="C" rather than export LANG="c""Aric Gardner1-1/+1
2018-04-10Merge "xci: kubespray: Generate and use SSL certificate for HAProxy"Manuel Buil2-0/+5
2018-04-10Merge "xci: osa: Move SSL certification tasks to a new file"Manuel Buil2-19/+36
2018-04-10Merge "xci: kubespray: Use the common tasks to manage the SSH keys"Manuel Buil2-25/+4
2018-04-10xci: osa: Fix conditional for copying OSA files to OPNFV hostMarkos Chandras1-3/+3
The conditional was wrong since it was being treated as a string instead of actually evaluating it as a boolean value. Change-Id: I59802f467a77ae755886e4cc389c2406e9d17d4c Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-09Redirect virsh output to /dev/null in cleanup scriptFatih Degirmenci1-4/+4
deploy-scenario:k8-nosdn-nofeature installer-type:kubespray Change-Id: I540eb8bad2f35d7029ae8a2148c431f7664fbad0 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-04-09Revert "display the correct deploy scenario for the functest run"Manuel Buil1-1/+1
This reverts commit 5dc7b76e38019c059cea159769cdb2c37af98ded. OPENSTACK_OSA_VERSION was removed by this patch and that variable is needed. By looking at the patch, it seems theat variable was removed by mistake Change-Id: I73dc7a7ec393231717f847ff303f9b2f99a00cc0
2018-04-08[XCI] Fix ansible synchronize module parameterwutianwei1-1/+1
synchronize module unsupported parameter "recurse", it would be failed, when trying to synchronize the directory. we need change it to "recursive", more information please refer to http://docs.ansible.com/ansible/devel/modules/synchronize_module.html Change-Id: If18ce8a3411ba9425dd573f090c5f4e0c41858e0 Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-04-06xci: kubespray: Generate and use SSL certificate for HAProxyMarkos Chandras2-0/+5
In the OpenStack-Ansible installers we are using the XCI ssl certificates for the endpoints but in kubespray we are generating them on the fly. In order to keep both setups as close as possible, we can use the XCI certificates in kubespray as well. Change-Id: I1ca55127fe747618205394c02b3d44bb573435f4 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-06xci: osa: Move SSL certification tasks to a new fileMarkos Chandras2-19/+36
The tasks for creating and managing the XCI SSL certificates can be shared between installers so move them to a common file. Change-Id: I9df82517e737681420429a992aa8d68e78528fd4 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-06Move configuration network templatesVictor Morales11-5/+5
The jinja templates that are used for networking setup are based on the openstack-ansible needs, those needs can differ for another installers. This change propose to make the network configuration depending on the installer. Signed-off-by: Victor Morales <victor.morales@intel.com> Change-Id: Ie805c3c7716393377d4dfcb32ed794cc1039d515
2018-04-06xci: bifrost: Fix unbound variable errorMarkos Chandras1-1/+1
If we are not in a virtual environment, then VIRTUAL_ENV is going to be unset and we will fail with the following error: ./scripts/bifrost-provision.sh: line 105: VIRTUAL_ENV: unbound variable As such, we need to provide a default value if that variable is unset. We also fix a typo in the _sudo variable. Change-Id: Ic018716c03ffba6e8e742e34720ea462b85341be Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-06xci: kubespray: Use the common tasks to manage the SSH keysMarkos Chandras2-25/+4
Drop the kubespray specific tasks for managing the SSH keys in favor of the common ones. Change-Id: Ib8e18fcc14c4c0126cae72740dbb33921a21af6b Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-06Merge "xci: kubespray: Fix failures to due task checks"Markos Chandras2-5/+6
2018-04-06Merge "xci: osa: Fix task status when bootstrapping OpenStack-Ansible"Markos Chandras1-0/+4