summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-10-19xci: playbooks: Add generic playbook for scenarios to plug their rolesMarkos Chandras2-0/+11
The new bootstrap-scenarios.yml playbook is aimed to be used by scenarios to configure themselves right before we proceed with the bootstrapping. This way we can avoid having scenario specific stuff into the generic code. Change-Id: I3026013719a50458c65405439712270f25f569ff Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-19xci: Clone all XCI scenarios in advance similar to a-r-rMarkos Chandras4-1/+100
In order to plug the scenarios' roles properly, we need to have all roles physically present in advance. As such, add a opnfv-scenario-requirements.yml file which can be used to populate the roles directory with all the scenarios. Change-Id: I0cdadb63849e4565c31559817660d23217879053 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-17xci: scripts: start-new-vm.sh: Remove empty lineMarkos Chandras1-1/+0
The empty line is wrong and it may cause some issues so drop it. Change-Id: I4120e00df1dd9b7061dc1175e0ea6db8e0a9df88 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-17xci: xci-deploy.sh: Allow scenarios to overrides XCI variables.Markos Chandras1-0/+7
Scenario may want to override variables exported by the XCI so allow them to define their own 'xci_overrides' file in the root directory of the role to do so. Change-Id: I6648eb43831a2aecc08d745a8c0fc191ce56e1b2 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-17docs: Add XCI overview documentFatih Degirmenci6-25/+254
Change-Id: I23405aec19a7e9bfce1c58d770b80b1c9c550d00 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-17Merge "xci: AIO: Disable tempest on AIO"Markos Chandras1-0/+9
2017-10-16Merge "xci: scripts: start-new-vm.sh: Make VM specs configurable"Aric Gardner1-4/+4
2017-10-16xci: scripts: start-new-vm.sh: Skip all qcow2 filesMarkos Chandras1-0/+2
We may have qcow2 files around from previous deployments so make sure they are not copied to the newly created VM. Change-Id: I35a8d72355ffff4678b611e09aedc8667f29a7f1 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-14xci: AIO: Disable tempest on AIOMarkos Chandras1-0/+9
In a similar fashion to the rest of the flavors, we disable the tempest tests. Change-Id: Id4a9912d87d1dabe3e433456f4b145d319e174d5 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-14Create the basic structure for generic scenariosFatih Degirmenci4-0/+1
Change-Id: I158d4e61e627e47ffa89d8229280011a2b615cac Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-13xci: scripts: start-new-vm.sh: Make VM specs configurableMarkos Chandras1-4/+4
We should be able to configure the VM specs so we can fit it in smaller environments. Change-Id: I56850df2f6842b6ef757500fecdc21bd1382b7e7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-10Merge "Create the prepare-tests playbook"Fatih Degirmenci1-0/+19
2017-10-10Merge "xci: Bump bifrost SHA"Markos Chandras4-15/+3
2017-10-10Merge "xci: scripts: start-new-vm.sh: Do not run multiple package manager ↵Markos Chandras1-7/+29
processes"
2017-10-10Merge "xci: scripts: start-new-vm.sh: Add option to clean VM on failure"Markos Chandras1-0/+15
2017-10-10Merge "xci: playbooks: configure-opnfvhost: Copy all user_*.yml files"Markos Chandras1-2/+2
2017-10-10Merge "xci: scripts: start-new-vm.sh: Do not destroy user's configuration file"Markos Chandras1-16/+20
2017-10-10Create the prepare-tests playbookManuel Buil1-0/+19
This playbook should be executed in case we want to use the osa deployment as platform for testing a scenario. The playbook currently includes a call to the prepare-functest role which installs and sets-up everything to run functest based tests Change-Id: Ibb59825e64c5889f36fd3bfb38a4d23b67b11866 Signed-off-by: Manuel Buil <mbuil@suse.com>
2017-10-09xci: scripts: start-new-vm.sh: Do not run multiple package manager processesMarkos Chandras1-7/+29
Package managers get upset if multiple instances run in parallel since the last one will fail to aquire some sort of DB locking and fail. As such, lets fix that and only run one package manager process at any time. Change-Id: I4ab13f61eee861ef70cb4115403d0e239ec14308 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-09xci: scripts: start-new-vm.sh: Add option to clean VM on failureMarkos Chandras1-0/+15
Sometimes we may want to remove the clean VM in case of failure. This is mostly true for CI tests because developers do not normally have access to the deployed VMs to debug problems since they can easily recreate the same environment using this script. If they ever want direct access to the slaves then that option can easily be turned off and retrigger the job. In the meantime, this patch allows slaves to free resources when a job fails instead of keeping the broken tests around. Change-Id: I07d56661e45fc64e1ec0db7a359522e4ebd2891a Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-07xci: scripts: start-new-vm.sh: Do not destroy user's configuration fileMarkos Chandras1-16/+20
As we move towards making this script useful for developers, we shouldn't destroy the existing ssh configuration file but rather create a new one just for XCI. This also move the destruction of previous instances sooner, even before building the OS image so we can free resources as soon as possible. Finally, this also uses the hostname to ssh to the new VM instead of its IP to ensure that everything is setup up properly on the physical host. Change-Id: I185befd8943fdb8ebcdb635aefb4d4b03473258b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-06Merge "Made minor edits througout the document"Fatih Degirmenci1-35/+35
2017-10-06Made minor edits througout the documentrpaik1-35/+35
Change-Id: I35aefb46661a89615b207398341705dd483b6797 Signed-off-by: rpaik <rpaik@linuxfoundation.org> Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-06xci: playbooks: configure-opnfvhost: Copy all user_*.yml filesMarkos Chandras1-2/+2
OpenStack-Ansible can make use of all the user_*.yml files so scenarios can make use of this facility to override the default ones we provide for every flavor. As such, lets copy all the user_*.yml files to the deployment host. Change-Id: I5ddce48677f66a3ff3ec127f0fc0163f9f45b200 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-06bifrost: bifrost-provision.sh: Always initialize XCI_ANSIBLE_VERBOSITYMarkos Chandras1-0/+3
The XCI_ANSIBLE_VERBOSITY is normally exported by the XCI bootstrapping process. However, sometimes it's necessary to run bifrost-provision.sh by itself so we can debug machine provisioning. As a result of which, we need to initialize this variable properly so we don't fail with 'unbound variable' errors. Change-Id: I81c59cf8eb3369c001e952c2c0a2846ed8d95cdf Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-06xci: Bump bifrost SHAMarkos Chandras4-15/+3
The latest bifrost code contains a fix when setting up DNS from a glean configuration drive and also a few virtualenv improvements. This allows us to get rid of all the workarounds we had in the past to switch Ansible versions in the middle of the XCI deployment. Change-Id: If49e290315ec96efdc07d04ff6624439c53aee19 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-05Remove the quotes from the external network nameManuel Buil1-1/+1
If we leave the quotes, functest will search for a neutron network with the name "ext-net" instead of ext-net and will fail Change-Id: I4ef62fa6ea69573f5872b864402ddb8644ce432d Signed-off-by: Manuel Buil <mbuil@suse.com>
2017-10-05xci: scripts: build-dib-os.sh: chmod and chown files using sudoMarkos Chandras2-2/+14
Some of the files may be owned by root so we need to ensure that everything is reset properly. Moreover, only clean the image files for the one we are building. Change-Id: I45b78db6715534187f19d9f513e8288fd076cb6b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-05Merge "Install docker-py when running xci as part of CI"Markos Chandras2-6/+12
2017-10-05Merge changes from topics 'copy-hidden-skip-verify', 'xci-cache-skip-verify'Markos Chandras2-39/+110
* changes: xci: scripts: start-new-vm.sh: Copy hidden files and directories xci: scripts: vm: Add ability to use cached images for clean VM
2017-10-04Install docker-py when running xci as part of CIManuel Buil2-6/+12
docker-py package is required by the docker_container module in ansible: http://docs.ansible.com/ansible/latest/docker_container_module.html#docker-container Change-Id: Ib051ae09c84cfa973ef814852e78626499471d0f Signed-off-by: Manuel Buil <mbuil@suse.com>
2017-10-04xci: file: ansible-role-requirements.yml: Bump SHA for lxc_hostsMarkos Chandras1-1/+1
Bump the SHA for lxc_hosts so we can start using lxc-2.X.X on SUSE hosts. Change-Id: Ia4830996a66b5694a9d22f8cd067ca12163939a3 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-04Fix the figure size in user guideFatih Degirmenci1-1/+2
Change-Id: I550860f574765a3035e9025e254f6d7ba110e0e4 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-04xci: scripts: start-new-vm.sh: Copy hidden files and directoriesMarkos Chandras1-1/+1
Fix the rsync command to also copy the hidden files and directories. Copying the .git directory allows us to quickly inspect any file changes when investigating bug reports and other problems. Change-Id: I4e6feeea77d5c3b23362a216206c5970b4900169 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-04xci: scripts: vm: Add ability to use cached images for clean VMMarkos Chandras2-38/+109
Make it possible to use the hosted dib images from artifacts.opnfv.org instead of building a new one on every CI run. This way, we can reduce the time it takes to start the actual XCI deployment. Change-Id: Idb1f5e3929cc14502c3f7383a61d2fbd0a6eefaf Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03xci: scripts: start-new-vm.sh: Set JENKINS_HOME on local runsMarkos Chandras1-0/+5
If we are creating a new virtual machine for local testing, then we should set JENKINS_HOME since some playbooks use this variable to determine if the deployment happens on a CI or not. That script aims to simulate a CI deployment so it should have this variable set. Change-Id: I1165c8b2cd467ba92fcf6f6c178a69b07834894e Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03xci: xci-deploy.sh: Extend regexp when collecting env variablesMarkos Chandras1-1/+1
Not all variables start with XCI, OPNFV or OPENSTACK so extend the regexp to look for more variables. Change-Id: If3693d65eec697f6c81c608da3be5799333c28d7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03xci: scripts: start-new-vm.sh: Do not break on idle SSH connectionsMarkos Chandras1-0/+2
Add ServerAliveInterval and ServerAliveCountMax directives in order to try and keep SSH connections alive. This aims to solve ssh timeouts like the following one on busy hypervisors: packet_write_wait: Connection to UNKNOWN port 0: Broken pipe Change-Id: I58029b41226098d6a44181434ad8653f72384e9d Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-03Merge "xci: xci-deploy: Add simple error handler"Markos Chandras1-1/+29
2017-10-03xci: xci-deploy: Add simple error handlerMarkos Chandras1-1/+29
Add a simple function to collect useful information when submitting bug reports. Change-Id: If24b76d2742edffa2269d39dcc998675d1388214 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-02Merge "xci: scripts: start-new-vm.sh: Use Docker to build OS images"Markos Chandras2-104/+85
2017-10-02Merge "docs: Fix env var OPNFV_RELENG_DEV_PATH"Markos Chandras1-2/+2
2017-10-02Merge "Add the name for CentOS NFS server package"Markos Chandras1-0/+11
2017-10-02Merge "xci: xci-deploy.sh: Fix variable names for bifrost and OSA"Markos Chandras1-1/+1
2017-10-02docs: Fix env var OPNFV_RELENG_DEV_PATHFatih Degirmenci1-2/+2
Change-Id: I95fd4efe4d1a47ce682489ffd7c2ce588a1764e5 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-10-02xci: scripts: start-new-vm.sh: Use Docker to build OS imagesMarkos Chandras2-104/+85
Use a docker container to build the OS images so we can build images and start new virtual machines on all supported operating systems. This way all developers can now launch a virtual machine to quickly reproduce Jenkins results which should assist with debugging problems. Since the container runs with elevated privileges it's best to ensure that we have exclusive access to devices. Finally, we remove the build-dib-os.sh script which is now part of the container itself. The build image process now becomes more stable since it runs on clean evnironment all the time so the only external factor is the upstream distribution repositories. Change-Id: I6b443192419ee2546a23430f421b152766d16333 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-02xci: xci-deploy.sh: Fix variable names for bifrost and OSAMarkos Chandras1-1/+1
The correct variable name is OPENSTACK_{BIFROST,OSA}_DEV_PATH instead of OPNFV_{BIFROST,OSA}_DEV_PATH. JIRA: RELENG-312 Change-Id: I6c1349434d2ff8f82e1bccd1a758467c3ee0a61f Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-10-02Merge "Install python-openstackclient by default"Markos Chandras1-2/+0
2017-10-02Merge "xci: install-ansible.sh: Fix distribution detection"Markos Chandras1-8/+14
2017-10-02Merge "xci: scripts: start-new-vm.sh: Fix default test case"Markos Chandras1-1/+2