summaryrefslogtreecommitdiffstats
path: root/xci/installer/osa
AgeCommit message (Collapse)AuthorFilesLines
2018-07-04xci: osa: Disable haproxy ssl configurationMarkos Chandras3-3/+9
The self-signed certificates are causing troubles so until we implement a proper certificate chain in XCI we should disable the SSL endpoints. Change-Id: Ife4ef78de1569121c435a806924a3f90917fd85b Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-06-06xci: osa: switch back from GitHub to OpenStack OSA reposMarkos Chandras2-80/+80
Switching to github.com for the gitclones did not make much of a difference since we are still seeing randomg SSL failures during git clones. So we can switch back to git://git.openstack.org hoping that the git protocol will be more efficient than https. Moreover some projects are moving away from github mirroring and this breaks our tests. Change-Id: I8188ec7cbfbf16eeb4634bd9a44b12a104ce1059 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-06-06xci: OSA: Bump Queens SHAs to fix spice-html5 repo relocationMarkos Chandras1-3/+4
The spice-html5 repository moved from github to its own gitlab hosting and that broke everything. As such, we update the OSA roles which contain the correct URL for the new repository. Change-Id: I3e2883c0436c9c93d2a8a338343ca3a75a1431e4 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-05-14Merge "xci: osa: Add initial dynamic inventory from PDF/IDF files"Markos Chandras11-137/+2
2018-05-11Merge "New SHA for ODL"Markos Chandras1-1/+1
2018-05-10New SHA for ODLManuel Buil1-1/+1
We need a patch in the ODL role to be able to deploy a stable ODL. Before this patch, it is not possible to deploy with a stable version of ODL and we are always deploying with the tip of the branch. However, it is useful to deploy with a version which we know for sure that it is working. deploy-scenario:os-odl-sfc installer-type:osa Change-Id: I539a5afa41598f54c3eeb2f1096022c73aa942b9 Signed-off-by: Manuel Buil <mbuil@suse.com>
2018-05-10xci: installer: Do not use XCI_ANSIBLE_PARAMS on remote nodesMarkos Chandras1-4/+4
The XCI_ANSIBLE_PARAMS is used to pass extra Ansible parameters to XCI. However, these parameters may not make sense when Ansible is running on any of the remote nodes, so we should't use it there. If passing information to "remote" Ansible is required, then we need to come up with a new variable. deploy-scenario:os-nosdn-nofeature installer-type:osa Change-Id: Ib6343fbfe3af1514c2e7e8948c12e3b19b455fe3 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-05-09xci: osa: Add initial dynamic inventory from PDF/IDF filesMarkos Chandras11-137/+2
The PDF and IDF files contain all the information we need for the virtual XCI deployment, so we can use it to create a dynamic inventory and get rid of all the static ones which could easily get outdated as PDF and IDF files evolve over time. This inital version of the dynamic inventory contains a lot of unnecessary generated information but we do that in order to ease the migration from static files to the dynamic inventory. The dynamic inventory will be improved in the future as we consume more and more information from the PDF and IDF files. Change-Id: Id9f07a61c67a5cffcbc18079a341e5d395020a27 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-05-08xci: osa: Bump SHA to fix resolv.conf file creation and git-clone issuesMarkos Chandras1-2/+2
Container images have recently changed and this breaks lxc_hosts during cache preparation as shown below: May 04 07:59:47 fatal: [controller00]: FAILED! => {"ansible_job_id": "362521755821.32697", "attempts": 1, "changed": true, "cmd": "chroot /var/lib/machines/ubuntu-xenial-amd64 /usr/local/bin/cache-prep-commands.sh > /var/log/lxc-cache-prep-commands.log 2>&1", "delta": "0:00:00.018827", "end": "2018-05-04 07:59:45.614668", "finished": 1, "msg": "non-zero return code", "rc": 1, "start": "2018-05-04 07:59:45.595841", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} As such, we need to bump the SHA from the Queens branch to include the fix in XCI. We also need to bump SHA for repo_build role in order to bring in some upstream fixes when cloning git repositories. Change-Id: I9f04313f7eb1606e5e71ab8ecee7148d1c5b75ad Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-30xci: Remove intermediate scenarios tasks fileMarkos Chandras1-1/+9
Now that the scenario role is recorded as a local fact, we can include the role directly directly so we don't need the the intermediate file anymore. deploy-scenario:os-nosdn-nofeature installer-type:osa Change-Id: Ia3c5658826f115538b2a103d987ee8f33d3048b9 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-27xci: Add XCI OSA variables fileMarkos Chandras2-0/+18
We can use an XCI specific YAML file to add OSA options which are common across flavors. Right now, it only overrides the default openSUSE mirror to use a more stable one. Change-Id: Iae7d542787ead33be1e64cdeda60761aa401cfde Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-17xci: osa: Fix OpenStack-Ansible bootstrapMarkos Chandras1-0/+1
Commit 269b5fc033b1ee8d14d9d4694f4f0d3765866c0a ("xci: installer: osa: Fix status report when bootstrapping OSA") removed the 'chdir' parameter by accident and this broke the OpenStack-Ansible bootstrapping. This patch brings the missing parameter back. Change-Id: I0ecfa0eb4c91a9f1dfa2d86a8a50bacdbd224533 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-13xci: installer: osa: Fix status report when bootstrapping OSAMarkos Chandras1-3/+0
Fixes the following ansible-lint warning [WARNING]: While constructing a mapping from /home/devuser/releng- xci/xci/installer/osa/playbooks/configure-opnfvhost.yml, line 113, column 7, found a duplicate dict key (args). Using last defined value only. We also remove the changed_when value since we now use 'args' to get proper status report. Change-Id: I382e3183b66e590462fbcb8663d53cade0e5d92c Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-10shabump: Bump SHA to make sfc scenario workManuel Buil1-1/+1
sfc scenario fails when running the functest snaps-healthcheck. The reason is a race condition found in ODL Nitrogen. This race condition is gone in ODL Oxygen. We need latest ODL role to include the ODL Oxygen version Depends-On: I59802f467a77ae755886e4cc389c2406e9d17d4c deploy-scenario:os-odl-sfc installer-type:osa Change-Id: I6d575370834eabb1b6a0532f74e1b2fc733e500c Signed-off-by: Manuel Buil <mbuil@suse.com>
2018-04-10Merge "xci: osa: Move SSL certification tasks to a new file"Manuel Buil1-19/+4
2018-04-10xci: osa: Fix conditional for copying OSA files to OPNFV hostMarkos Chandras1-3/+3
The conditional was wrong since it was being treated as a string instead of actually evaluating it as a boolean value. Change-Id: I59802f467a77ae755886e4cc389c2406e9d17d4c Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-06xci: osa: Move SSL certification tasks to a new fileMarkos Chandras1-19/+4
The tasks for creating and managing the XCI SSL certificates can be shared between installers so move them to a common file. Change-Id: I9df82517e737681420429a992aa8d68e78528fd4 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-06Merge "xci: osa: Fix task status when bootstrapping OpenStack-Ansible"Markos Chandras1-0/+4
2018-04-04xci: osa: Fix task status when bootstrapping OpenStack-AnsibleMarkos Chandras1-0/+4
The bootstrap script from the OpenStack-Ansible repository creates several things in /opt/ansible-runtime and /usr/local/bin so we can check if the final 'openstack-ansible' symlink exists in order to report a proper status for that task and even skip if everything is prepared already. Change-Id: I4ca3a733746f8d757aa1156b533e4b4de90188e6 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-04xci: osa: Use Ansible modules to create ssl certificatesMarkos Chandras1-24/+21
Ansible already provides modules to create ssl certificates so we can use these instead of running the openssl commands directly. Moreover, we can drop all the tasks which create the ssl directories since there are being created by the openssl package which also creates the appropriate symlinks. Finally, there is no need to generate the certificate on localhost if only the OPNFV host consumes it, so move these steps to the appropriate playbook. Change-Id: I0045945c502013be3d76440876e894a44a092690 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-03xci: osa: Move tasks for managing SSH keys to a new fileMarkos Chandras2-60/+4
The tasks that manage the SSH keys are common across hosts and also common across different installers. As such, lets move them to a new file so we can share them more easily. Change-Id: If235877394f224a47a2f2b8de748a2330eabcec1 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-04-03Merge changes from topic 'misc-simplifications-osa'Markos Chandras2-107/+114
* changes: xci: bootstrap-host: Make active network interface consistent xci: osa: Simplify tasks for copying OSA configuration files xci: Use proper Ansible modules to manage SSH keys
2018-04-03shabump: Bump SHAs to bring cinder, lxc_hosts, and pip fixes inFatih Degirmenci1-6/+6
This change brings the fix for - cinder haproxy check for ha deployments - pip related fixes - fixes for lxc_hosts Change-Id: I4af64041a4a76c10361456f73577e7c7040edf8a Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-03-28xci: osa: Simplify tasks for copying OSA configuration filesMarkos Chandras1-65/+48
We can use a loop to copy all these files instead of multiple tasks. This simplifies the playbook quite a bit. Change-Id: I5f0d387ac090d81fc577b5ebeaeb6131e75cffa1 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-28xci: Use proper Ansible modules to manage SSH keysMarkos Chandras2-42/+66
We can use the 'user', 'slurp' and 'authorized_key' modules to manage the various SSH configurations across the hosts instead of using command line tools. Change-Id: I2dde4d584fc336e267868607d5a58f5ee2c1feed Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-26xci: playbooks: Fixes various ansible-lint warningsMarkos Chandras1-16/+43
In preparation for adding support for the 'ansible-lint' tool we fix various problems in our playbooks to make the tool happy before we make it mandatory. Some of the problems that are fixed here are - [ANSIBLE0011] All tasks should be named - [ANSIBLE0012] Commands should not change things if nothing needs doing - [ANSIBLE0013] Use shell only when shell functionality is required - [ANSIBLE0010] Package installs should not use latest installer-type:osa deploy-scenario:os-nosdn-nofeature Change-Id: I66c759d3932a414b81b2846393d2d98ce80c0b6d Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-22Merge "xci: osa: Configure the ARA callback plugin on OPNFV host"Fatih Degirmenci1-0/+21
2018-03-22Merge "Move bootstrap-scenarios.yml to common playbooks directory"Fatih Degirmenci2-28/+1
2018-03-22Merge "Use package_state:present to avoid package installation issues"Fatih Degirmenci3-0/+9
2018-03-22xci: osa: Configure the ARA callback plugin on OPNFV hostMarkos Chandras1-0/+21
The OSA deployment is driven by the OPNFV host so we need to install and configure the ARA plugin there as well. Change-Id: Ib583f5771a8c2da7531f0a42612d7c0b34fb4898 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-22Move bootstrap-scenarios.yml to common playbooks directorywutianwei2-28/+1
Move bootstrap-scenarios.yml from installer/osa/playbooks/bootstrap-scenarios.yml to playbooks/bootstrap-scenarios.yml as a common playbook. So we can use this file to bootstarap k8s-* scenarios, instead of creating a new file under installer/kubespray/playbooks/bootstrap-scenarios.yml Change-Id: Ic31ee00e1a0863f48fb86298d7c00fa8420fa28a Signed-off-by: wutianwei <wutianwei1@huawei.com>
2018-03-21xci: Bump SHAs for os_neutron and opendaylight ansible roleFatih Degirmenci1-2/+2
This change brings the SHAs needed for os-odl-bgpvpn scenario and will be tested using os-odl-nofeature scenario. installer-type:osa deploy-scenario:os-odl-nofeature Change-Id: I3ab8be557d78710f47c8a2e558078e13eb70553c Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-03-21xci: Bump OpenStack Ansible SHAsFatih Degirmenci2-80/+80
Change-Id: Iae3f642bea54feae4c033b61e8ea4cfe759848ec Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-03-21Use package_state:present to avoid package installation issuesFatih Degirmenci3-0/+9
Using package_state:present should give our jobs better chance to finish on time and perhaps improve the overall deployment times even. Change-Id: Ifa4e01318fe364a91c32f5326024d34c364e25c8 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-03-21Clean up opnfv ansible vars and switch to lowercaseFatih Degirmenci3-48/+48
This change removes the variables that are not used in any of the playbooks/roles from opnfv ansible vars. Apart from that, all caps ansible vars replaced with lowercase ones and impacted playbooks/roles are updated. installer-type:osa deploy-scenario:os-nosdn-nofeature Change-Id: I99ebdc155b3903176ac5940b64cef0c0f3aa0f0d Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-03-20Add proxy supportVictor Morales4-0/+57
In some cases the XCI development environment can be located behind a corporate proxy resulting in a additional layer to consider to configure. These changes pretend to include proxy support for all linux distros in all the posible flavors. Change-Id: Iab469268809ac471d09e244bb3ccd83de1a41b88 Signed-off-by: Victor Morales <victor.morales@intel.com>
2018-03-17Merge "xci: osa: Simplify OpenStack host playbooks"Fatih Degirmenci5-35/+29
2018-03-17xci: osa: Simplify OpenStack host playbooksMarkos Chandras5-35/+29
The configure-targethost playbook is configuring all the OSA hosts so we can simplify all that by introducing a new 'openstack' host group with the controller and the compute nodes and configure all of them in parallel. Change-Id: I21f8709e7649b041575dab45fc4e070aa01e0a6f Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-17xci: osa: Drop haproxy workaroundMarkos Chandras1-6/+0
There is no reference on the actual upstream problem so lets assume this is fixed and drop the workaround we had locally. Change-Id: I3f71ea2e6fdc67e342f014e572f74760a78d3816 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-16xci: Copy XCI environment to deployment hostsMarkos Chandras2-0/+9
The XCI hosts may need some of the XCI env variables to perform certain tasks so dump the XCI environment to /root/xci.env file and make that available to every host on the deployment. Change-Id: I286a01ca7da8ff206438c261798167f5e4daf7f2 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-14Merge "Do not grep log text to determine failure"Fatih Degirmenci1-10/+1
2018-03-14Merge "xci: Merge configure-network and syncronize-time roles"Markos Chandras2-10/+4
2018-03-14Merge "xci: Fix group for the OPFNV host"Markos Chandras4-4/+4
2018-03-13Merge "xci: osa: Switch git repositories to github.com"Markos Chandras2-79/+79
2018-03-13xci: Merge configure-network and syncronize-time rolesMarkos Chandras2-10/+4
Those roles were too small and only used as part of the host bootstrapping process. As such, we merge them into a common 'bootstrap-host' role which can be used to prepare the hosts after the initial deployment Change-Id: Ifc84cf40b98ced91b31aae699dc28e9642380550 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-13xci: Fix group for the OPFNV hostMarkos Chandras4-4/+4
Ansible gets upset if we use the same name for a host and a group so add the OPNFV host to the deployment group. This fixes the following warning: [WARNING]: Found both group and host with same name: opnfv Change-Id: Idbaff712d40e8234721332aee6d10d5ba44c62ce Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-13Merge changes from topics 'allow-pass-ansible-arguments', ↵Markos Chandras1-7/+7
'allow-pass-ansible-arguments-force-verify' * changes: xci: OSA: Fix warning about missing inventory file xci: Pass the XCI_PATH variable to all Ansible calls xci: Rename XCI_ANSIBLE_VERBOSITY to XCI_ANSIBLE_PARAMS
2018-03-13xci: osa: Switch git repositories to github.comMarkos Chandras2-79/+79
CI sometimes fails with the following error "msg": "fatal: unable to access 'https://git.openstack.org/openstack/dragonflow/': Failed to connect to git.openstack.org port 443: Connection timed out" We assume that the upstream OpenStack mirrors may get very busy at times or the connectivity between the CI and the OpenStack repos is not very stable. As such, lets switch to github.com for the majority of OSA repositories such as the roles and the services which may improve the situation. Change-Id: Ia4668d692077a785c76adeda128eb4cf9f4516a7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2018-03-13Do not grep log text to determine failureFatih Degirmenci1-10/+1
Pipefail should be sufficient to determine the failure so this change gets rid of grepping the logs for failure and unreachable to leave the evaluation to bash itself. Change-Id: Ie928438c1503b086159276af4308f5549b58cb71 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2018-03-12Merge "Combine vars setting installer type in INSTALLER_TYPE"Fatih Degirmenci1-1/+1