summaryrefslogtreecommitdiffstats
path: root/xci
AgeCommit message (Collapse)AuthorFilesLines
2017-09-15xci: playbooks: Add task for loading distribution variablesMarkos Chandras4-15/+49
vars_files doesn't support loading files with variables in their names. As such we add a new task to include these files before running any of the roles. This fixes warnings like this: Info: Starting provisining VM nodes using openstack/bifrost ------------------------------------------------------------------------- No config file found; using defaults skipping vars_file '../var/{{ ansible_os_family }}.yml' due to an undefined variable skipping vars_file '../var/{{ ansible_os_family }}.yml' due to an undefined variable skipping vars_file '../var/{{ ansible_os_family }}.yml' due to an undefined variable skipping vars_file '../var/{{ ansible_os_family }}.yml' due to an undefined variable skipping vars_file '../var/{{ ansible_os_family }}.yml' due to an undefined variable skipping vars_file '../var/{{ ansible_os_family }}.yml' due to an undefined variable Change-Id: I0a49e2ed8d811bb40a99612462752f8691133e0f Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-15xci: env-vars: Bump Ansible version to 2.3.2.0Markos Chandras3-8/+9
Now that bifrost uses virtual env for Ansible we can go ahead and bump the Ansible version to match the one from OSA so we can make use of the latest features. Furthremore, we stop passing ANSIBLE_VERBOSITY to the command line since it's an environment variable so Ansible already knows about it. Change-Id: I52d9a211fc0ced1f7830f6945b2943f35d38109b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-15Disable strict host key checking for galera cluster checkFatih Degirmenci1-3/+3
The command to check the galera cluster fails due to having strict host key checking enabled. This change disables strict host key checking for galera_container to ensure we can verify if the database cluster is operational. OSA does this for aio on their gate and put host key checking configuration to group_vars which we might need to do as well. Change-Id: Ifc59581d979c71f1db1b87126659470dc85cc2db Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-15Merge "Generate and use certificates for OSA"Fatih Degirmenci11-3/+123
2017-09-14Merge "synchronize-time: Retry if chrony failed due to NTP issues"Fatih Degirmenci1-0/+4
2017-09-14Generate and use certificates for OSAYolanda Robla11-3/+123
Instead of making OSA to generate self signed certs, bring our own and pass them. By this way we will be able to trust in that certs, and start consuming OpenStack easily. It will also generate proper openrc file to source it and start consuming the cloud properly. Change-Id: Ic72a8b05e6efb222926fc5fa0800e033b2dbd22f Closes-Bug: RELENG-266 Signed-off-by: Yolanda Robla <yroblamo@redhat.com>
2017-09-14synchronize-time: Retry if chrony failed due to NTP issuesMarkos Chandras1-0/+4
chrony randomly fails with the following issue TASK [synchronize-time : synchronize time] ************************************* fatal: [controller00]: FAILED! => {"changed": true, "cmd": "chronyc -a 'burst 4/4' && chronyc -a makestep", "delta": "0:00:00.004991", "end": "2017-09-14 19:30:37.561972", "failed": true, "rc": 1, "start": "2017-09-14 19:30:37.556981", "stderr": "", "stdout": "200 OK\n503 No such source", "stdout_lines": ["200 OK", "503 No such source"],"warnings": []} As such, lets retry a few more times before giving up. Change-Id: I20767bb3031061c03c9ba8dbc65859c7312bfac9 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-14Merge "xci: xci-deploy.sh: Do not 'tee' ssh output"Markos Chandras1-10/+10
2017-09-14xci: xci-deploy.sh: Do not 'tee' ssh outputMarkos Chandras1-10/+10
Using 'tee' to capture 'ssh' command output randomly breaks with the following error: tee: standard output: Resource temporarily unavailable Lets just store the log on the host and copy it back in the end. Change-Id: I41edac138b8642e8765d5c1e5974b375b5b3203b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-13Merge "xci: SHA bump as of September 5th 2017"Markos Chandras2-52/+52
2017-09-13Merge "xci: scripts: Update wording for comments"Markos Chandras1-1/+1
2017-09-08Add ~/.local/bin to PATH if it is not there alreadyTapio Tallgren1-0/+4
Change-Id: Ie9481ce8ec891313b613d824a8f8943e706884f7 Signed-off-by: Tapio Tallgren <tapio.tallgren@nokia.com>
2017-09-06xci: SHA bump as of September 5th 2017Markos Chandras2-52/+52
The SHA bump is required for SUSE support. Change-Id: If21e7658ee2ee967c458c08d186b5c1d07b5d93c Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-06xci: scripts: Update wording for commentsMarkos Chandras1-1/+1
Update wording so it matches the upstream one and minimize the noise on a-r-r updates. Change-Id: I216c1ee1ac4f24ab2c5a382bfe5e2aacf324024a Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-04bugfix: Add symlinks for interface files for additional hostsFatih Degirmenci3-0/+3
This is a temporary fix to get noha and ha flavors working. We should normally use bifrost inventory and have templates for opnfv, controller, and compute groups rather than per host basis. But since that is still pending to be done, this change tries to make sure what we have now continues working. Change-Id: I9132c474754f4d11d1b9e4b1288b449703994db8 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-08-31Merge "cinder: Bring in the fix for cinder online migrations command"Fatih Degirmenci2-2/+2
2017-08-31Merge "keepalived: Bring in the fix for iteritems for python3"Fatih Degirmenci3-14/+1
2017-08-31Merge changes from topic 'initial-multi-distro-support'Markos Chandras8-43/+63
* changes: xci: playbooks: configure-nfs: Prepare for multi-distro support xci: playbooks: configure-network: Prepare for multi-distro support
2017-08-31Merge "xci: Vagrantfile: Add openSUSE Leap 42.2 and 42.3 support"Markos Chandras1-0/+50
2017-08-31cinder: Bring in the fix for cinder online migrations commandFatih Degirmenci2-2/+2
This change fixes the bug with cinder online migration command by moving osa version to commit 691c59 and moving the cinder role version to commit 96160f. [1][2] The issue appears when the flavor is set to ha. [1] https://review.openstack.org/gitweb?p=openstack/openstack-ansible.git;a=commit;h=691c59f25e5d271c670c24d12e8d60fa422441e1 [2] https://review.openstack.org/gitweb?p=openstack/openstack-ansible-os_cinder.git;a=commit;h=96160f084d89355ba62980b1ebbedf0eef7c7b20 Change-Id: I5339d1fd00a1b108f09c1221e5a3cbecc2f35182 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-08-31Add note to explain how role versions can be adjustedFatih Degirmenci2-1/+26
The OSA version can be overriden by users to move to a later version of it (such as master). This change adds cautionary note to README to explain what they can do in this situation. Change-Id: I3e4943c2c4af10001b07ffd289bd300bb5f80244 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-08-31keepalived: Bring in the fix for iteritems for python3Fatih Degirmenci3-14/+1
This change moves the keepalived role version to commit b13e08 in order to bring the fix applied in upstream, switching from iteritems to items for python3. [1] The flavor ha is enabled back due to incorporating the fix to xci and the note in README.rst is removed as well. https://github.com/evrardjp/ansible-keepalived/commit/b13e0840b09154a6d2470f71fea8eaa968525c5b Change-Id: I6e03f579f1107475f4b4adf54699fc4f924beec3 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-08-28Disable tempest playbookFatih Degirmenci1-1/+0
download.cirros-cloud.net is having trouble and failing patchset verification jobs. Apart from that, we are switching to healtcheck tests using OPNFV test framework so this patch fixes the current issue and prepares for the future. Change-Id: I593d3b2424250f12c8f32701007e97408e72e40d Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-08-25xci: playbooks: configure-nfs: Prepare for multi-distro supportMarkos Chandras2-34/+51
There is nothing Ubuntu specific in this role apart from the nfs server service name. As such we remove the block statement and make the service name configurable in order to prepare for multidistribution support. Change-Id: I3c8202315fc49b5e5afc2a0d03eaf80d83db5f4c Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-25xci: playbooks: configure-network: Prepare for multi-distro supportMarkos Chandras6-9/+12
Move the network templates inside the role since it's their only user. Moreover, remove the arguments when we include the role in playbooks and move the distro logic to the role itself. Change-Id: I938686fdb31b9896b9e97339799a0edd4c34bf36 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-24xci: Vagrantfile: Add openSUSE Leap 42.2 and 42.3 supportMarkos Chandras1-0/+50
Add support for testing the XCI in the latest openSUSE Leap releases. Change-Id: I9b649b7076e031b162a10a976debf305299cf4f7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-23xci: Bump OSA SHA to Pre-PikeFatih Degirmenci9-71/+459
This change bumps osa sha to 4d39f2cc. [1] The reason for going to a later osa sha is to include ODL and Tacker commits in upstream to ease the work done for ODL and SFC scenarios. However, this osa sha seems to be having issues with the flavor ha so the users should be aware of the problems which is added into the readme as known issue and the flavor is disabled in xci-deploy.sh. Another reason to bump sha right now is that upstream changed a lot during last 2 months and waiting longer will probably result in more changes, making it harder to move to a later osa sha even harder. Other changes included by this change are - update ansible role requirements to move to shas pinned by upstream for pike. - add odl and tacker roles into ansible role requirements. - update how aio is deployed due to removal of an upstream script. (this could perhaps have been done in a better way but the time pressure required this to be fixed in the way as proposed.) - ensure facts are gathered for all the hosts and containers before running setup-infrastructure.yml playbook. - stop grepping for failed in the log of setup-hosts.yml playbook due to existence of rescue block in rabbitmq_cluster_create.yml [2]. - reduce the resource needs by updating the user_variables that are based on upstream osa gate which uses aio. The values for none-aio xci flavors will be adjusted in a separate change once the sha bump is complete. - fix a bug in ha-vars. [1] https://review.openstack.org/gitweb?p=openstack/openstack-ansible.git;a=commit;h=4d39f2cc29417153780210fc0bb86223387e9968 [2] https://review.openstack.org/gitweb?p=openstack/openstack-ansible-rabbitmq_server.git;a=blob;f=tasks/rabbitmq_cluster_create.yml;h=4aaad5adafa42684c0d791b49539069fe1b45635;hb=HEAD#l24 Change-Id: Ia7fc495e315e4a41359641f8be4b3c8bbf7b61fa Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-08-17Merge "Refactor releng/prototypes/xci to releng-xci/xci in the code"Fatih Degirmenci8-42/+43
2017-08-17Merge "prototypes: xci: xci-deploy.sh: Only allow XCI on Ubuntu"Markos Chandras1-0/+9
2017-08-17Merge "prototypes: xci: config: Allow users to set VM specs"Markos Chandras4-16/+16
2017-08-17prototypes: xci: xci-deploy.sh: Only allow XCI on UbuntuMarkos Chandras1-0/+9
There is no support for openSUSE or CentOS right now yet the script runs happily on these hosts until it breaks in horrible ways. The only place we explicitly ask for Ubuntu hosts is the wiki which can easily be missed by newcomers. As such, modify the script to only run on Ubuntu hosts. Change-Id: If9b355da51367fc95948a2b12a7f6c4d6b3bbbbf Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-17prototypes: xci: config: Allow users to set VM specsMarkos Chandras4-16/+16
The default VM spec may not be good enough for every host so allow users to override the default VM_* variables. Change-Id: Ie846620ab81b7fedcbe4b23da735379ab75d3cc2 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-16Refactor releng/prototypes/xci to releng-xci/xci in the codeDave Urschatz8-42/+43
These changes are needed as part of migrating xci from releng repo to the releng-xci repo. They cover: - README updates - Re-point configuration from releng/prototypes to releng-xci The changes have been tested as follows: - XCI_FLAVOR=aio - OPENSTACK_OSA_VERSION=adfaa66d6108f87599e0595591b39cad2c8fb658 xci: aio has been installed real 107m5.310s user 11m50.180s sys 4m11.152s ubuntu@rack-IRA2-SymKloudBlade4:~/releng-xci/xci$ Change-Id: I8fd86c2442ee3a7c6996eedb6510dbc6eebd30b0 Signed-off-by: Dave Urschatz <dave.urschatz@cengn.ca>
2017-08-15xci: Vagrantfile: Add Vagrantfile to simplify testingMarkos Chandras1-0/+90
Add a Vagrantfile based on the upstream AIO one which can be used to easily test XCI without modifying the host. Change-Id: Icced4ff4cd80c43d4b0cec2282629fedaf44cb8c Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11Fix missing python packages for password generationJuan Vidal Allende4-0/+10
These packages are needed by pw-token-gen.py tool Change-Id: Ib9d165274449551a469e201da9feeffac5a7a4cf Signed-off-by: Juan Vidal Allende <juan.vidal.allende@ericsson.com>
2017-08-11prototypes: xci: xci-deploy: Set default value for devel parametersMarkos Chandras1-1/+1
Commit 68412ffc734e ("prototypes: xci: xci-deploy.sh: Append trailing slash for rsync vars") modified xci-deploy.sh script to append a trailing slash to the devel variables but it broke the script when one of these variables was not set (since we run with 'set -eu') with the following error: ./xci-deploy.sh: line 45: !local_user_var: unbound variable Fixes: I0103b754585931fa1dcd3966c52d7e4a8f2f63f6 Change-Id: Ic2465ff07348b61e74e191516425cd10d80c1fce Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11prototypes: xci: xci-deploy.sh: Append trailing slash for rsync varsMarkos Chandras1-0/+9
The 'synchronize' Ansible module uses rsync and for that we need to indicate that we want to copy the contents of the development path and not the development path itself. As such we need to ensure that a trailing slash is always appended to the user variables but we need to also ensure that we will not end up with double slashes. Change-Id: I0103b754585931fa1dcd3966c52d7e4a8f2f63f6 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11xci: Fix README for setting dev path instructionsFatih Degirmenci1-2/+4
Change-Id: I56c727c242b6826f87a64246b6b4736a637c1abe Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-08-11prototypes: xci: scripts: Update SHA datesMarkos Chandras2-4/+6
Update the dates in the pinned-versions file whenever we update the SHAs. Change-Id: I23ebd90a3fc688a7501fcb2d32217357f8c31657 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11prototypes: xci: update-osa-version-files: Add support for updating bifrost SHAsMarkos Chandras2-4/+9
Add a second optional argument to update the bifrost SHA instead of doing this bit manually. Change-Id: I0fab8745ae08ad4f54a2a1f5b0b7a64fde4b8295 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11prototypes: xci: Update SHAs for OSA and its rolesMarkos Chandras3-57/+60
This also updates the second (pre_release) argument of 'update_ansible_role_requirements' from 'false' to 'true' so that non-openstack roles can be updated as well. Change-Id: Id424499f44c9b51c02d56e5d93580faeea50ad12 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11Talk about development mode for XCIYolanda Robla1-0/+17
Explain the usage of OPNFV_RELENG_DEV_PATH Change-Id: I19e3946c9ea78a6bb0521818b58af297a396d80d
2017-08-11prototypes: xci: config: Update bifrost SHAMarkos Chandras1-1/+1
Update bifrost SHA to 7c9bb5e07c6bc3b42c9a9e8457e5eef511075b38 which is the current HEAD on 16th of June 2017. Change-Id: I91cd98221fda7a1dd689abbfbf07474bd8aac4e1 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11prototypes: xci: scripts: Add update-osa-version-files.sh scriptMarkos Chandras1-0/+85
Add new prototypes/xci/scripts/update-osa-version-files.sh which can be used to update the XCI ansible-role-requirements.yml file as well as the OSA pinned SHA string. This file is using the upstream 'sources-branch-updater-lib.sh' library from the openstack-ansible repository. Change-Id: I51b88c50cb2bffe0cf1b7aa054a5b237103fd92f Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11prototypes: xci: Add 'ansible-hardening' role to the requirements fileMarkos Chandras1-0/+4
Upstream commit 2798cf403c47d165cd8d34d7888990dce1f827f8 ("Use new ansible-hardening role") added the new 'ansible-hardening' role to the ansible-role-requirements.yml file and as such we also need to take that into consideration. The sha hash does not matter much at this point since it will be fixed the next time we tag all the roles. Change-Id: I5444af948e2b83de49863e7e28f3918fed88c90d Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11Define an extra vars path and copy into playbooksYolanda Robla3-0/+13
This will allow to define the XCI_EXTRA_VARS_PATH, that can contain group_vars/all (or any other valid files), and those will be copied inside releng and bifrost playbooks. Change-Id: I95e4b0bfb67f26bfa1eb10c97096784eb7f3a87a Signed-Off-By: Yolanda Robla <yroblamo@redhat.com>
2017-08-11Explain the need of having an ssh keyYolanda Robla1-0/+6
In order for XCI to work, the user needs to have a ssh key. Explain that on the README and show the command to generate it. Change-Id: I517e15de15ba1b09977dbd62881bc2625c8b2833
2017-08-11prototypes: xci: Make CLEAN_DIB_IMAGES variable configurableMarkos Chandras2-1/+2
The CLEAN_DIB_IMAGES variable determines whether the /httpboot or /tftpboot directories will be removed before running the xci-deploy script. This forces XCI to re-create the target OS images. We moved this variable from env-vars to user-vars since this is something that users normally want to tweak in their deployments. Change-Id: Ia48bd63979e3837aab7e47c906c2501e7c7dd0e1 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-11Fix ansible installation for non-rootYolanda Robla1-2/+2
Currently ansible was set to be installed with pip, but this fails for non-root user. Instead of that, execute pip with --user flag, so we don't need root permissions and it is only installed for the current user. Change-Id: Ib37a2a3866b4b48aca834b894cdd128ee63b31d6
2017-08-11Remove sudo usage from xci-deployYolanda Robla1-1/+1
The script was refactored to don't need sudo on the latest versions, and the documentation is still referencing it. Change-Id: I7064317ab7b756a78638f7474f2944472d3a4ba2