summaryrefslogtreecommitdiffstats
path: root/jjb/infra
AgeCommit message (Collapse)AuthorFilesLines
2017-02-02jjb: infra: bifrost-verify.sh: Always print the GS URLMarkos Chandras1-3/+4
Previously, the GS URL was only printed when the job succeeded and we were able to collect all bifrost logs. However, it's also helpful to be able to see the URL when a job fails so move it outside of the 'if' block. Moreover, improve the wording in other informative messages. Change-Id: I080d5c1ff49de5abe50cc1049bb38f6e42123587 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-02-01merge GIT_BRANCH and GERRIT_BRANCH into BRANCHRyota MIBU1-1/+1
GIT_BRANCH parameter is different; master or stable/danube in daily jobs, but 'refs/changes/57/27657/6' in verify jobs. This breaks some job builders triggered by the both types of jobs. We have GERRIT_BRANCH parameter for verify jobs to identify stream and expected branch into the patch will be merged after it got +2 and submitted. To avoid further confusion and to have common job builders for daily and verify jobs, this patch introduce BRANCH parameter. GERRIT_BRANCH is now deprecated. Change-Id: Ibcd42c1cd8a0be0f330878b21d3011f1ec97043b Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-31bifrost: Use 'unsafe' disk cache for test VMsMarkos Chandras1-0/+4
The VMs which are created by bifrost are not meant to be used in production so improve the overall CI job performance by switching to the 'unsafe' disk cache mode. Make it also the default mode when using bifrost outside of the Jenkins job. Change-Id: If88f6c9395617a4aa860f8d00e22abfdd18d2922 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-28jjb: infra: bifrost-verity: Ignore missing landing pageMarkos Chandras1-1/+1
if this a new build, there is no landing page to remove and 'gsutil rm' will return false breaking the build. Ignore such failures. Change-Id: If5969b06b7a65a8e36abda57e8cb75e8684a716a Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-27Merge "jjb: infra: bifrost-verify: Add links to Jenkins jobs"Fatih Degirmenci1-8/+16
2017-01-27Merge "jjb: infra: bifrost-verify-jobs: Ignore jjb patchsets"Fatih Degirmenci1-2/+0
2017-01-27jjb: infra: bifrost-verify-jobs: Ignore jjb patchsetsMarkos Chandras1-2/+0
There is no point testing changes in the jjb/infra/* files since they only come into effect once the patchset is merged and the job is updated. Let not wait cycles testing such patchsets. Change-Id: I858c07cd2ea887fe30ff7ffe4372ff378be05754 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-27jjb: infra: bifrost-verify: Use the same defaults on all slavesMarkos Chandras1-6/+3
We are now using virtual machines as slaves so use the same defaults everywhere Change-Id: I2260b859aa031106e1458dd8af697919122c0b77 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-27jjb: infra: bifrost-verify: Add links to Jenkins jobsMarkos Chandras1-8/+16
It's helpful to provide links to the Jenkins jobs in case further analysis of the build is needed. Moreover, move the console upload step at the end to make sure we also capture the output from the 'exit' handler itself. Change-Id: I7efa363cd248c99783b8a3f66d7dd4d7fd898ef2 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-24jjb: infra: bifrost-verify.sh: Always create the landing pageMarkos Chandras1-16/+19
Previously, the function would have returned if no bifrost logs were present. However, this prevented the landing page from being generated and uploaded since that happens at the very end of that function. We rewored the code to always create a landing page even if there are no bifrost logs to upload. Change-Id: Ice557d0a42324a135d7f0e5ec94ec22811cc0ae7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-24Merge "jjb: infra: bifrost-verify.sh: Replace 'exit' with 'return'"Fatih Degirmenci1-1/+1
2017-01-24jjb: infra: bifrost-verify.sh: Replace 'exit' with 'return'Markos Chandras1-1/+1
When there are no bifrost logs (possibly because the build broke far too early) we shouldn't exit at all. This is a valid scenario so we should return back to the caller and exit using the bifrost 'exit code' instead. Change-Id: I55a847dea7a6f4209b0e4fb71fad6bb00f6df08b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-24Merge "[macro] property logrotate"Ryota Mibu1-0/+1
2017-01-20jjb: infra: bifrost-verify.sh: Download the build log to $WORKDIRMarkos Chandras1-3/+3
We need to store the build log into a location where we have write access. We will use the $WORKDIR for that. Fixes the following problem. /tmp/hudson5015921933634723839.sh: line 23: build_log.txt: Permission denied Change-Id: Ib8f00853a84a42bcc90155e4ca11bb89d921a867 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-20jjb: infra: bifrost-verify.sh: Rework code for uploading the build logMarkos Chandras1-1/+3
gsutil does not support compression on streaming uploads so rework the code to save the log into a temporary file first. Fixes the following error: CommandException: gzip compression is not currently supported on streaming uploads. Remove the compression flag or save the streamed output temporarily to a file before uploading. Change-Id: I3976bf3271be3aff8bc7b656ac49de6986ca6c36 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-20[macro] property logrotateRyota MIBU1-0/+1
This patch defines 'logrotate-default' property and replace 'logrotate' by it, as 'logrotate' is deprecated on jenkins>=1.637 . Change-Id: I900975e5b3f590bb7a4d430e2f623931ae782bf4 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-19jjb: infra: bifrost-upload-logs.sh: Consolidate upload step to main jobMarkos Chandras3-60/+50
In case of job failures, the upload builder is not executed so the published links are dead. We move the upload step to the EXIT handler which is always executed despite the main job exit code. Moreover, The gsutil tool can compress the files itself but in such a way that the web browser can still display the contents without the need for the user to download and uncompress the file himself. This makes debugging more convenient. We also make the whole upload process somewhat less noisy. Finally, we include the $GERRIT_PATCHSET_NUMBER in the title and hyperlink since we provide and retain build results for each patchset instead of a single set just for the latest one. Change-Id: I43efd519a5743661d1f258aa338fb0769f59b6ed Suggested-by: Julien Zhang <zhang.jun3g@zte.com.cn> # compression only Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-18jjb: infra: bifrost-upload-logs.sh: Copy landing page to the GS serverMarkos Chandras1-3/+5
Moreover, rename 'console.txt' to 'build_log.txt' to make it clearer what this log is about. Finally, make the webpage title a hyperlink to the actual Gerrit page. Change-Id: I251bcd75ac1a559e64e17ba10f7f8b6af069743d Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-18jjb: infra: bifrost-upload-logs.sh: Generate a landing pageMarkos Chandras2-4/+25
Create a basic web page to contain all the collected build logs. The reason for creating this page is that the OPNFV web server does not list the subdirectory contents so we need another way to expose all the uploaded logs. Moreover, hide the gsutils stdout output since it just adds extra noise to the already massive console log. Finally, drop the 'popd' command argument since it causes the command to fail and mark the whole build as failed. Change-Id: Iad25e5cf62fda650bad3c9d83671cde84c7467d8 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-17jjb: infra: bifrost-upload-logs: Fix Google storage variableMarkos Chandras1-1/+1
BIFROST_GS_STORAGE is an old artifact so replace it with BIFROST_LOG_URL. Change-Id: I4b9d56e4b3478850152f7eca9b41b5cc36807049 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-17Merge "infra: bifrost: Upload build logs to artifacts.opnfv.org"Fatih Degirmenci2-5/+58
2017-01-12infra: bifrost: Upload build logs to artifacts.opnfv.orgMarkos Chandras2-5/+58
Change-Id: I0ba0fe05911dc7ea7cf31286b2f083f85ec5c549 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-09Revert "jjb: infra: bifrost-verify-jobs: Remove triggers due to HW relocation"Markos Chandras1-0/+4
This reverts commit 24691266ad858494cc06660b9c013af36c548bbd. The hardware is back online Change-Id: Ib7d21a5da3e41e4007e1e5363f82a02d2d1c4f0c Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-12-21jjb: infra: bifrost-verify-jobs: Remove triggers due to HW relocationMarkos Chandras1-4/+0
The hardware, where the slaves for this job are located, is being relocated so prevent scheduling of jobs until it's back online. Change-Id: I9028b6401bc0b743f83e5184e1131cb4aa9417c8 Link: https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2016-December/014210.html Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-12-08jjb: infra: bifrost-verify-jobs: Remove python-xml workaroundMarkos Chandras1-2/+1
python-xml is now being pulled in as dependency in the pip-and-virtualenv dib element so remove the explicit package installation. Change-Id: I94ea6a3b0f35cc62b945a8ced0a641ded7b36fea Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-29jjb: infra: bifrost-verify.sh: Make sure the cache directory existsMarkos Chandras1-0/+3
Fixes the following problem on new slaves: chown: cannot access '/home/jenkins/.cache': No such file or directory Change-Id: Ia461acd44466819e47a459e23ee6fd47ac1bad69 Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-28jjb: infra: Fix and enable the SUSE job for bifrostMarkos Chandras1-4/+29
Fix SUSE parameters for os, release, packages and elements and enable the job. Change-Id: I0fc0fbc5fcf8df04186d6c19aaf363020d31a44c Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-28bifrost: Make use of the new 'openssh-server' dib elementMarkos Chandras1-2/+8
Make use of the new 'openssh-server' dib element to achieve a consistent behavior of ssh server across all distributions. Change-Id: Ib10066a244fe44530969702cd465cdd79454b8fe Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-02Fix perms and sed for bridge_nameYolanda Robla Mota1-3/+3
Change-Id: I0b2b6e31a456398958bf1997ed6f6394322191c8 Signed-Off-By: Yolanda Robla <yroblamo@redhat.com>
2016-11-02Start using centos7 instead of centos-minimalYolanda Robla Mota1-1/+1
Current builds with centos-minimal are failing on 7, so start using centos7 element instead. Change-Id: I80d986fd7613e1807a119447a01c62e6f8a93ddf Signed-Off-By: Yolanda Robla <yroblamo@redhat.com>
2016-11-02Fix automated job to properly create the bridgeYolanda Robla Mota1-0/+7
The element that creates the bridge was moved from file to template. But in the case of VMs we are not running puppet to install bifrost, so that is not applied. Manually place the file in the right path, and replace the bridge name with the expected br_opnfv. Change-Id: I22b2213b529343b24c358b3c80fd1849ec40979c Signed-Off-By: Yolanda Robla <yroblamo@redhat.com>
2016-10-18Set a Custom URL for Bifrost Verification JobsTrevor Bramwell1-0/+2
OpenStack-CI documentation states[1] a custom URL needs to be set in order for Jenkins comments to be correctly formatted by the OpenStack Gerrit server. [1] http://docs.openstack.org/infra/system-config/third_party.html#the-jenkins-gerrit-trigger-plugin-way Change-Id: Id10c9839b823f0b3841cfcaa16a6dd384d34cbbe Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2016-10-13bifrost: Vote on upstream patchesFatih Degirmenci1-6/+0
Bifrost core wants OPNFV CI to vote on upstream bifrost patches to increase the visibility. Change-Id: Ia4fbdf5fa551750b6063dfb8610b6699039c4fbe Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-10-03jjb: infra: Trigger the Jenkins jobs when the jobs themselves changeMarkos Chandras1-0/+2
Making changes to the Jenkins jobs should trigger the CI to ensure that our changes did not break anything. Change-Id: I59e1d45fb82492ff03926cd4273367aca9060c74 Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-10-03jjb: infra: Fix ownership for the cache directoryMarkos Chandras1-0/+4
Fixes the following error when the ${HOME}/.cache permissions are bad: The directory '/home/jenkins/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Change-Id: I16310817e1f36bd8086e196ef61ec10c09ad7366 Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-09-27bifrost: Refactor bifrost jobsFatih Degirmenci7-338/+192
This change - Creates job templates to verify opnfv/bifrost patches - Introduces type in order to prepare verification on baremetal - Fixes git cloning so the job shows changes for the corresponding project - Gets rid of unnecessary slave parameters from slave-params.yml - Fixes build blocking - Updates the bifrost-verify.sh script and includes in shell so we don't have to clone releng repo separately - Updates destroy-env.sh to create /httpboot and /tftpboot with permissions 755 - Removes daily infra-bifrost job and scripts as we don't use them at the moment Change-Id: Icb5a543628d3321bfe4e549ab92c67443ac578d8 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-15Revert "infra: Fix ownerships for successful runs as well"Fatih Degirmenci1-3/+0
This reverts commit f915ff044fc6330db6e0971f49af1b44509c9cfb. Change-Id: I33134b44952a287216ab7ad63f9bb042cba51f6a Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-15infra: Fix ownerships for successful runs as wellFatih Degirmenci1-0/+3
Change-Id: I11b73104b5a80351537109fcb504bb250c641220 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-15infra: Change the ownership of stuff back to jenkinsFatih Degirmenci1-0/+10
Change-Id: I869a2e44b78ed33e3419077c32f5c0a08b63191f Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com> Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-09-15infra: Remove /opt/stack to prevent leftovers from causing troubleFatih Degirmenci1-1/+1
Change-Id: I924f40a363fcaf50eb7e4c6f8cd1c5acba7c330b Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-12infra: infra-daily-jobs: Use of the infra-{smoketest,deploy} scriptsMarkos Chandras1-2/+2
The Jenkins jobs for smoketest and deploy use inline scripts which are essentially no-ops but they should use the respective scripts instead which are also no-ops at the moment but they could potentially become more useful in the future. Change-Id: Ic91f65b43468aaba503e71773098853bf43f229f Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-09-09infra: Fix the gerrit project name and preserve env for sudoFatih Degirmenci1-2/+2
Change-Id: I9b86f285ac0a3e3f8ea95550f7490ced8d3ca2a3 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-09infra: Create 3rd party CI job to verify bifrost patches in OPNFVFatih Degirmenci3-1/+164
This change creates job to run patchset verification for openstack/bifrost. The verification is done by checking out the patch from upstream bifrost repo and combining opnfv bifrost stuff with it to see if any change that is proposed upstream breaks opnfv bifrost. The verification is done only for trusty and this can be expanded to support centos7 and suse as well. Due to change in slave label, impacted files are also updated. Change-Id: Id34b7ddcf5e3f424a5999aa1a9fa69ff53d95fc4 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-01infra: Do not run provisioning in deploy & smoketest phasesFatih Degirmenci1-2/+2
Change-Id: I326053d863f0f06ceb293cda3cd2405cf2d25f13 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-01infra: Fix small doc/script issues and enable mail notificationFatih Degirmenci2-1/+8
This change - Fixes readme of puppet-infracloud - renames destroy_env.sh script - enables mail notification - disables removal of DIB images by default Change-Id: I628b26b976e38772cbbc69b737a545fe801639ba Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-08-31Create daily job for infra deployment, remove sandbox jobs and fix bugsFatih Degirmenci4-0/+199
This change - creates upstream daily job to trigger and control the execution of jobs that provision nodes using bifrost, deployment using puppet-infracloud, and simple smoke test job. - fixes the hashbang placement in 2 of the scripts. - removes sandbox dummy jobs as the infra jobs can serve as examples now. Only the node provisioning job is functional at the moment. Change-Id: I311d159956d8b7ce3f7a500fac5a7dcb459104cf Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>