summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-07xci: scripts: start-new-vm.sh: Do not destroy user's configuration fileMarkos Chandras1-16/+20
As we move towards making this script useful for developers, we shouldn't destroy the existing ssh configuration file but rather create a new one just for XCI. This also move the destruction of previous instances sooner, even before building the OS image so we can free resources as soon as possible. Finally, this also uses the hostname to ssh to the new VM instead of its IP to ensure that everything is setup up properly on the physical host. Change-Id: I185befd8943fdb8ebcdb635aefb4d4b03473258b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-06Merge "Made minor edits througout the document"Fatih Degirmenci1-35/+35
2017-10-06Made minor edits througout the documentrpaik1-35/+35
Change-Id: I35aefb46661a89615b207398341705dd483b6797 Signed-off-by: rpaik <rpaik@linuxfoundation.org> Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-06xci: playbooks: configure-opnfvhost: Copy all user_*.yml filesMarkos Chandras1-2/+2
OpenStack-Ansible can make use of all the user_*.yml files so scenarios can make use of this facility to override the default ones we provide for every flavor. As such, lets copy all the user_*.yml files to the deployment host. Change-Id: I5ddce48677f66a3ff3ec127f0fc0163f9f45b200 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-06bifrost: bifrost-provision.sh: Always initialize XCI_ANSIBLE_VERBOSITYMarkos Chandras1-0/+3
The XCI_ANSIBLE_VERBOSITY is normally exported by the XCI bootstrapping process. However, sometimes it's necessary to run bifrost-provision.sh by itself so we can debug machine provisioning. As a result of which, we need to initialize this variable properly so we don't fail with 'unbound variable' errors. Change-Id: I81c59cf8eb3369c001e952c2c0a2846ed8d95cdf Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-06xci: Bump bifrost SHAMarkos Chandras4-15/+3
The latest bifrost code contains a fix when setting up DNS from a glean configuration drive and also a few virtualenv improvements. This allows us to get rid of all the workarounds we had in the past to switch Ansible versions in the middle of the XCI deployment. Change-Id: If49e290315ec96efdc07d04ff6624439c53aee19 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-05Remove the quotes from the external network nameManuel Buil1-1/+1
If we leave the quotes, functest will search for a neutron network with the name "ext-net" instead of ext-net and will fail Change-Id: I4ef62fa6ea69573f5872b864402ddb8644ce432d Signed-off-by: Manuel Buil <mbuil@suse.com>
2017-10-05xci: scripts: build-dib-os.sh: chmod and chown files using sudoMarkos Chandras2-2/+14
Some of the files may be owned by root so we need to ensure that everything is reset properly. Moreover, only clean the image files for the one we are building. Change-Id: I45b78db6715534187f19d9f513e8288fd076cb6b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-05Merge "Install docker-py when running xci as part of CI"Markos Chandras2-6/+12
2017-10-05Merge changes from topics 'copy-hidden-skip-verify', 'xci-cache-skip-verify'Markos Chandras2-39/+110
* changes: xci: scripts: start-new-vm.sh: Copy hidden files and directories xci: scripts: vm: Add ability to use cached images for clean VM
2017-10-04Install docker-py when running xci as part of CIManuel Buil2-6/+12
docker-py package is required by the docker_container module in ansible: http://docs.ansible.com/ansible/latest/docker_container_module.html#docker-container Change-Id: Ib051ae09c84cfa973ef814852e78626499471d0f Signed-off-by: Manuel Buil <mbuil@suse.com>
2017-10-04xci: file: ansible-role-requirements.yml: Bump SHA for lxc_hostsMarkos Chandras1-1/+1
Bump the SHA for lxc_hosts so we can start using lxc-2.X.X on SUSE hosts. Change-Id: Ia4830996a66b5694a9d22f8cd067ca12163939a3 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-04Fix the figure size in user guideFatih Degirmenci1-1/+2
Change-Id: I550860f574765a3035e9025e254f6d7ba110e0e4 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-04xci: scripts: start-new-vm.sh: Copy hidden files and directoriesMarkos Chandras1-1/+1
Fix the rsync command to also copy the hidden files and directories. Copying the .git directory allows us to quickly inspect any file changes when investigating bug reports and other problems. Change-Id: I4e6feeea77d5c3b23362a216206c5970b4900169 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-04xci: scripts: vm: Add ability to use cached images for clean VMMarkos Chandras2-38/+109
Make it possible to use the hosted dib images from artifacts.opnfv.org instead of building a new one on every CI run. This way, we can reduce the time it takes to start the actual XCI deployment. Change-Id: Idb1f5e3929cc14502c3f7383a61d2fbd0a6eefaf Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03xci: scripts: start-new-vm.sh: Set JENKINS_HOME on local runsMarkos Chandras1-0/+5
If we are creating a new virtual machine for local testing, then we should set JENKINS_HOME since some playbooks use this variable to determine if the deployment happens on a CI or not. That script aims to simulate a CI deployment so it should have this variable set. Change-Id: I1165c8b2cd467ba92fcf6f6c178a69b07834894e Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03xci: xci-deploy.sh: Extend regexp when collecting env variablesMarkos Chandras1-1/+1
Not all variables start with XCI, OPNFV or OPENSTACK so extend the regexp to look for more variables. Change-Id: If3693d65eec697f6c81c608da3be5799333c28d7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03xci: scripts: start-new-vm.sh: Do not break on idle SSH connectionsMarkos Chandras1-0/+2
Add ServerAliveInterval and ServerAliveCountMax directives in order to try and keep SSH connections alive. This aims to solve ssh timeouts like the following one on busy hypervisors: packet_write_wait: Connection to UNKNOWN port 0: Broken pipe Change-Id: I58029b41226098d6a44181434ad8653f72384e9d Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03Merge "xci: xci-deploy: Add simple error handler"Markos Chandras1-1/+29
2017-10-03xci: xci-deploy: Add simple error handlerMarkos Chandras1-1/+29
Add a simple function to collect useful information when submitting bug reports. Change-Id: If24b76d2742edffa2269d39dcc998675d1388214 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-02Merge "xci: scripts: start-new-vm.sh: Use Docker to build OS images"Markos Chandras2-104/+85
2017-10-02Merge "docs: Fix env var OPNFV_RELENG_DEV_PATH"Markos Chandras1-2/+2
2017-10-02Merge "Add the name for CentOS NFS server package"Markos Chandras1-0/+11
2017-10-02Merge "xci: xci-deploy.sh: Fix variable names for bifrost and OSA"Markos Chandras1-1/+1
2017-10-02docs: Fix env var OPNFV_RELENG_DEV_PATHFatih Degirmenci1-2/+2
Change-Id: I95fd4efe4d1a47ce682489ffd7c2ce588a1764e5 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-02xci: scripts: start-new-vm.sh: Use Docker to build OS imagesMarkos Chandras2-104/+85
Use a docker container to build the OS images so we can build images and start new virtual machines on all supported operating systems. This way all developers can now launch a virtual machine to quickly reproduce Jenkins results which should assist with debugging problems. Since the container runs with elevated privileges it's best to ensure that we have exclusive access to devices. Finally, we remove the build-dib-os.sh script which is now part of the container itself. The build image process now becomes more stable since it runs on clean evnironment all the time so the only external factor is the upstream distribution repositories. Change-Id: I6b443192419ee2546a23430f421b152766d16333 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-02xci: xci-deploy.sh: Fix variable names for bifrost and OSAMarkos Chandras1-1/+1
The correct variable name is OPENSTACK_{BIFROST,OSA}_DEV_PATH instead of OPNFV_{BIFROST,OSA}_DEV_PATH. JIRA: RELENG-312 Change-Id: I6c1349434d2ff8f82e1bccd1a758467c3ee0a61f Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-02Merge "Install python-openstackclient by default"Markos Chandras1-2/+0
2017-10-02Merge "xci: install-ansible.sh: Fix distribution detection"Markos Chandras1-8/+14
2017-10-02Merge "xci: scripts: start-new-vm.sh: Fix default test case"Markos Chandras1-1/+2
2017-10-02Add the name for CentOS NFS server packageTapio Tallgren1-0/+11
Change-Id: I5a8ff4c358ab9f1d548c9cc834faa2465ec63d41 Signed-off-by: Tapio Tallgren <tapio.tallgren@nokia.com>
2017-10-02Install python-openstackclient by defaultFatih Degirmenci1-2/+0
It is important to have the client installed for the ease of the users so they can use the client for trying out their new deployment. Change-Id: I091c1e23ff320cb9fcdb2743998483a6bc1fcdad Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-02xci: scripts: start-new-vm.sh: Fix default test caseMarkos Chandras1-1/+2
Export XCI_FLAVOR to mini to minic the CI. Moreover, fix the script to not use relative paths. Change-Id: I16947c596b8bbff20371b6d345dffd215f76aecc Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-02Merge "Update .gitignore for documentation"Fatih Degirmenci1-0/+4
2017-10-02Merge "Add documentation for user guide and sandbox"Markos Chandras4-6/+393
2017-10-02xci: install-ansible.sh: Fix distribution detectionMarkos Chandras1-8/+14
Relying on the installed package manager to detect the distribution is not reliable since it's possible to install multiple package managers at the same time. As such, lets simply use the information in the os-release files. Change-Id: Ic170d2aee1398d5c82403c3469365822bf053de7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-01xci: file: ansible-role-requirements: Bump SHA for rabbitmq-serverMarkos Chandras1-1/+1
The rabbitmq-server contains some fixes for SUSE so lets just bump this role instead of switching the entire OSA pin SHA so close to the Euphrates release. Change-Id: Ic034ed4bd9e290cadc5336d781b0e24036d5cd46 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-30Add documentation for user guide and sandboxFatih Degirmenci4-6/+393
This change adds the user guide and sandbox information. The documentation is created by using the information we have on Wiki and README.rst. Wiki pages and README.rst will be removed once all the documentation is moved to docs.opnfv.org. Parts of the README.rst such as more advanced ways to use the sandbox will be placed in developer guide and it is accessible by a link placed in user guide. Change-Id: I7214a53d7ab39125d2164c5b3468b1ba18933b31 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-29Update .gitignore for documentationFatih Degirmenci1-0/+4
Change-Id: I39a8b8a874345f90cd60f34ca10422b20f66e32b Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-29Merge "Check if /etc/ssl/certs exists before creating it"Markos Chandras2-3/+10
2017-09-29Create the structure for the documentationFatih Degirmenci4-0/+91
This change puts the initial structure for the documentation. Change-Id: I4ff075874815bfcd1834049ae205a02b72bae75f Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-29Check if /etc/ssl/certs exists before creating itTapio Tallgren2-3/+10
In CentOS and Suse, /etc/ssl/certs is a symbolic link to /etc/ssl/pki/tls/certs. The Ansible module "file" will fail if it is asked to create a directory which is already a symbolic link. This patch will check if /etc/ssl/certs exists before trying to create it. The same check is done both on the host and the opnfv guest VM. Also, /etc/certs is only writable by root, so we need a "become: true" clause to be able to modify it in localhost (but not in opnvf VM). Change-Id: Iab6c3c162548f84ad6082829e4a7c2ab63d2cfa0 Signed-off-by: Tapio Tallgren <tapio.tallgren@nokia.com>
2017-09-29Merge changes from topic 'fix-vm-on-jenkins'Markos Chandras5-24/+10
* changes: xci: xci-deploy.sh: Apply workaround for checking db cluster on SUSE xci: playbooks: synchronize-time: Fix service name for openSUSE xci: configure-opnfvhost: Do not run 'remove-folders' xci: scripts: build-dib-os.sh: Pin diskimage-builder xci: configure-opnfvhost: Do not check /etc/ssl/certs on SUSE
2017-09-28xci: xci-deploy.sh: Apply workaround for checking db cluster on SUSEMarkos Chandras1-0/+7
The mysql socket path is wrong on SUSE which leads to problems when trying to verify the status of the db cluster. Apply workaround until it's fixed upstream controller00_galera_container-56c89184 | FAILED | rc=1 >> ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2 "No such file or directory") Change-Id: I23192f4079526ae7820a1db023a097a651a09140 Link: https://review.openstack.org/508154 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-28xci: playbooks: synchronize-time: Fix service name for openSUSEMarkos Chandras1-1/+1
In openSUSE, the chrony service is 'chronyd'. Change-Id: Ifb946b0ba49783108a84dd5b998d9d45f5c9df51 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-28Ensure the pinned versions of components match to the pinned OSAFatih Degirmenci3-2/+240
The versions for the OpenStack services and global requirements need to be pinned alongside with the OSA SHA1 and the role versions to ensure we pinned everything. This change is required for osa-periodic jobs as well since that job will use sources-branch-updater.sh script and the script updates these files to ensure things are pinned correctly. modified: ansible-role-requirements.yml modified: global-requirement-pins.txt modified: playbooks/defaults/repo_packages/openstack_services.yml modified: releasenotes/notes/glance-init-config-overrides-d1c8c3dcc50c109a.yaml modified: releasenotes/notes/neutron-init-config-overrides-9d1d2b3b908705ed.yaml modified: releasenotes/notes/trove-init-config-overrides-a78ed428a32adef8.yaml By doing this change, we do not need to have any magic to capture updates to those files. Just updating the files we keep in xci/file folder will be sufficient and they get copied over during the playbook execution. Change-Id: Iae0db22574a0368e896132469a8587d1457ce177 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-28xci: configure-opnfvhost: Do not run 'remove-folders'Markos Chandras2-22/+0
The OPNFV node is brand new and it doesn't have any traces of XCI directories so there is no point in running the 'remove-folders' role. Change-Id: Ic9b9203cc14abda2dab406de6a5feeef6a1b7e2a Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-28xci: scripts: build-dib-os.sh: Pin diskimage-builderMarkos Chandras1-1/+1
diskimage-builder does very frequent releases and sometimes things break. There is no particular reason to always fetch the latest version so lets do it in a controlled way after proper testing. Change-Id: Ie9685a9a15fa7fefa1c5ecea49090ac9d92e63ff Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-28xci: configure-opnfvhost: Do not check /etc/ssl/certs on SUSEMarkos Chandras1-0/+1
This is similar to Ibc188b76f47c4f7d1c5aa452a21e838420d65e6a /etc/ssl/certs is a symlink so skip this task on SUSE. Change-Id: Iae38640501748dc3dd802ce795acfaeefd836c97 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-09-28Merge changes from topic 'fix-vm-on-jenkins'Markos Chandras4-21/+44
* changes: xci: scripts: start-new-vm.sh: Fix paths for default XCI test xci: Replace ANSIBLE_VERBOSITY with XCI_ANSIBLE_VERBOSITY xci: scripts: start-new-vm.sh: Print dib output when running on CI xci: scripts: start-new-vm.sh: Use 'unsafe' cache for the clean vm disk xci: xci-deploy.sh: Make sure all local Ansible installations are gone xci: scripts: start-new-vm.sh: Do not allow multiple build-dib-os processes