summaryrefslogtreecommitdiffstats
path: root/jjb/infra
AgeCommit message (Collapse)AuthorFilesLines
2017-03-15jjb: infra: bifrost-cleanup-job: Do not trigger on new patchsetsMarkos Chandras1-0/+2
Commit f6bba721fd13 ("jjb: infra: bifrost-cleanup-job: Do not trigger on patchset creation") changed the job to not trigger on new patchsets but this does not work as expected because it seems that the default value for this option is 'true'. Set 'patchset-uploaded-event' to 'false' in order to really disable that trigger. Fixes: f6bba721fd13 ("jjb: infra: bifrost-cleanup-job: Do not trigger on patchset creation") Change-Id: Id19474511f37ebd13d1933f5d13f185dc5c8e3c9 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-03-15jjb: Set disable-strict-forbidden-file-verification to 'true'Markos Chandras2-0/+4
Previously, if an upstream patchset contained a change for a file listed in 'forbidden-file-paths' the job would not be triggered. This is not desirable since such a patchset may contain important changes so we enable the 'disable-strict-forbidden-file-verification' option which triggers the job unless the patchset only contains changes for the files listed in 'forbidden-file-paths'. Note: The diff was generated using the following script: for i in $(grep -l -r forbidden-file-paths *);do sed -i "s/\(^.*\)forbidden-file-paths/\1disable-strict-forbidden-file-verification: \'true\'\n&/" $i; done Please double check that the changes look sensible for each team's project. Change-Id: Ifa86d3a39b36375b2fd52b449e29c8dc757499b4 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-03-01Merge "jjb: infra: bifrost-cleanup-job: Ignore jjb patchsets"Fatih Degirmenci1-2/+0
2017-02-27jjb: infra: bifrost-cleanup-job: Do not trigger on patchset creationMarkos Chandras1-14/+4
There are no logs to remove when a patchset is created. Change-Id: Ieae8e8e142d69f741d43e740371110ce13255436 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-02-24jjb: infra: bifrost-cleanup-job: Ignore jjb patchsetsMarkos Chandras1-2/+0
This is similar to ebaf0be9a53d ("jjb: infra: bifrost-verify-jobs: Ignore jjb patchsets"). There are no CI logs when a patchset is about the jjb files so there is nothing for this job to do in that case. Change-Id: I7b815b612da0407ddefaee9cf9826e9003b668ef Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-02-24jjb: infra: bifrost-cleanup-job.yml: Use -m gsutil option for removalsMarkos Chandras1-1/+1
Use the -m gsutil option to perform parallel object removal insted of a sequential one to reduce the job's execution time. Change-Id: I87d21b07674035113883f7952514555dec1750ca Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-02-22jjb: infra: bifrost-cleanup-job: Fix job triggersMarkos Chandras1-11/+3
Add new trigger when a patchset is abandoned and drop the one for 'recheck' and 'reverify' comments since the logs will be eventually deleted when the patchset is merged or abandoned. Moreover, fix quoting for the BIFROST_GS_URL variable which prevented logs from being deleted properly. This fixes the following error: CommandException: No URLs matched: gs://artifacts.opnfv.org/cross-community-ci/openstack/bifrost/$GERRIT_NAME/$GERRIT_CHANGE_NUMBER/ Change-Id: I8f6ca7a9b2af4a7a4b204f15abf6a223144637a6
2017-02-22Merge "jjb: infra: bifrost-cleanup-job.yml: Add new bifrost cleanup job"Markos Chandras1-0/+156
2017-02-13jjb: infra: bifrost-cleanup-job.yml: Add new bifrost cleanup jobMarkos Chandras1-0/+156
Add new job which will wipe the build logs from artifacts.opnfv.org once the proposed gerrit patchset is merged. This job is only triggered when a patchset is accepted and it can be executed on any of the bifrost slaves provided none of the bifrost-verify-* jobs is running. Change-Id: Ice708b978fbf283d5134f5cf7f7e1e541ec61003 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-02-12Update emailboxJulien1-1/+1
company emailbox is not efficient for dealing with community emails. Change-Id: Ic159bae1d622214b720023fa07508c79324c3538 Signed-off-by: Julien <zhang.jun3g@zte.com.cn>
2017-02-02jjb: infra: bifrost-verify.sh: Always print the GS URLMarkos Chandras1-3/+4
Previously, the GS URL was only printed when the job succeeded and we were able to collect all bifrost logs. However, it's also helpful to be able to see the URL when a job fails so move it outside of the 'if' block. Moreover, improve the wording in other informative messages. Change-Id: I080d5c1ff49de5abe50cc1049bb38f6e42123587 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-02-01merge GIT_BRANCH and GERRIT_BRANCH into BRANCHRyota MIBU1-1/+1
GIT_BRANCH parameter is different; master or stable/danube in daily jobs, but 'refs/changes/57/27657/6' in verify jobs. This breaks some job builders triggered by the both types of jobs. We have GERRIT_BRANCH parameter for verify jobs to identify stream and expected branch into the patch will be merged after it got +2 and submitted. To avoid further confusion and to have common job builders for daily and verify jobs, this patch introduce BRANCH parameter. GERRIT_BRANCH is now deprecated. Change-Id: Ibcd42c1cd8a0be0f330878b21d3011f1ec97043b Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-31bifrost: Use 'unsafe' disk cache for test VMsMarkos Chandras1-0/+4
The VMs which are created by bifrost are not meant to be used in production so improve the overall CI job performance by switching to the 'unsafe' disk cache mode. Make it also the default mode when using bifrost outside of the Jenkins job. Change-Id: If88f6c9395617a4aa860f8d00e22abfdd18d2922 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-28jjb: infra: bifrost-verity: Ignore missing landing pageMarkos Chandras1-1/+1
if this a new build, there is no landing page to remove and 'gsutil rm' will return false breaking the build. Ignore such failures. Change-Id: If5969b06b7a65a8e36abda57e8cb75e8684a716a Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-27Merge "jjb: infra: bifrost-verify: Add links to Jenkins jobs"Fatih Degirmenci1-8/+16
2017-01-27Merge "jjb: infra: bifrost-verify-jobs: Ignore jjb patchsets"Fatih Degirmenci1-2/+0
2017-01-27jjb: infra: bifrost-verify-jobs: Ignore jjb patchsetsMarkos Chandras1-2/+0
There is no point testing changes in the jjb/infra/* files since they only come into effect once the patchset is merged and the job is updated. Let not wait cycles testing such patchsets. Change-Id: I858c07cd2ea887fe30ff7ffe4372ff378be05754 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-27jjb: infra: bifrost-verify: Use the same defaults on all slavesMarkos Chandras1-6/+3
We are now using virtual machines as slaves so use the same defaults everywhere Change-Id: I2260b859aa031106e1458dd8af697919122c0b77 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-27jjb: infra: bifrost-verify: Add links to Jenkins jobsMarkos Chandras1-8/+16
It's helpful to provide links to the Jenkins jobs in case further analysis of the build is needed. Moreover, move the console upload step at the end to make sure we also capture the output from the 'exit' handler itself. Change-Id: I7efa363cd248c99783b8a3f66d7dd4d7fd898ef2 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-24jjb: infra: bifrost-verify.sh: Always create the landing pageMarkos Chandras1-16/+19
Previously, the function would have returned if no bifrost logs were present. However, this prevented the landing page from being generated and uploaded since that happens at the very end of that function. We rewored the code to always create a landing page even if there are no bifrost logs to upload. Change-Id: Ice557d0a42324a135d7f0e5ec94ec22811cc0ae7 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-24Merge "jjb: infra: bifrost-verify.sh: Replace 'exit' with 'return'"Fatih Degirmenci1-1/+1
2017-01-24jjb: infra: bifrost-verify.sh: Replace 'exit' with 'return'Markos Chandras1-1/+1
When there are no bifrost logs (possibly because the build broke far too early) we shouldn't exit at all. This is a valid scenario so we should return back to the caller and exit using the bifrost 'exit code' instead. Change-Id: I55a847dea7a6f4209b0e4fb71fad6bb00f6df08b Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-24Merge "[macro] property logrotate"Ryota Mibu1-0/+1
2017-01-20jjb: infra: bifrost-verify.sh: Download the build log to $WORKDIRMarkos Chandras1-3/+3
We need to store the build log into a location where we have write access. We will use the $WORKDIR for that. Fixes the following problem. /tmp/hudson5015921933634723839.sh: line 23: build_log.txt: Permission denied Change-Id: Ib8f00853a84a42bcc90155e4ca11bb89d921a867 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-20jjb: infra: bifrost-verify.sh: Rework code for uploading the build logMarkos Chandras1-1/+3
gsutil does not support compression on streaming uploads so rework the code to save the log into a temporary file first. Fixes the following error: CommandException: gzip compression is not currently supported on streaming uploads. Remove the compression flag or save the streamed output temporarily to a file before uploading. Change-Id: I3976bf3271be3aff8bc7b656ac49de6986ca6c36 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-20[macro] property logrotateRyota MIBU1-0/+1
This patch defines 'logrotate-default' property and replace 'logrotate' by it, as 'logrotate' is deprecated on jenkins>=1.637 . Change-Id: I900975e5b3f590bb7a4d430e2f623931ae782bf4 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-19jjb: infra: bifrost-upload-logs.sh: Consolidate upload step to main jobMarkos Chandras3-60/+50
In case of job failures, the upload builder is not executed so the published links are dead. We move the upload step to the EXIT handler which is always executed despite the main job exit code. Moreover, The gsutil tool can compress the files itself but in such a way that the web browser can still display the contents without the need for the user to download and uncompress the file himself. This makes debugging more convenient. We also make the whole upload process somewhat less noisy. Finally, we include the $GERRIT_PATCHSET_NUMBER in the title and hyperlink since we provide and retain build results for each patchset instead of a single set just for the latest one. Change-Id: I43efd519a5743661d1f258aa338fb0769f59b6ed Suggested-by: Julien Zhang <zhang.jun3g@zte.com.cn> # compression only Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-18jjb: infra: bifrost-upload-logs.sh: Copy landing page to the GS serverMarkos Chandras1-3/+5
Moreover, rename 'console.txt' to 'build_log.txt' to make it clearer what this log is about. Finally, make the webpage title a hyperlink to the actual Gerrit page. Change-Id: I251bcd75ac1a559e64e17ba10f7f8b6af069743d Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-18jjb: infra: bifrost-upload-logs.sh: Generate a landing pageMarkos Chandras2-4/+25
Create a basic web page to contain all the collected build logs. The reason for creating this page is that the OPNFV web server does not list the subdirectory contents so we need another way to expose all the uploaded logs. Moreover, hide the gsutils stdout output since it just adds extra noise to the already massive console log. Finally, drop the 'popd' command argument since it causes the command to fail and mark the whole build as failed. Change-Id: Iad25e5cf62fda650bad3c9d83671cde84c7467d8 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-17jjb: infra: bifrost-upload-logs: Fix Google storage variableMarkos Chandras1-1/+1
BIFROST_GS_STORAGE is an old artifact so replace it with BIFROST_LOG_URL. Change-Id: I4b9d56e4b3478850152f7eca9b41b5cc36807049 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-17Merge "infra: bifrost: Upload build logs to artifacts.opnfv.org"Fatih Degirmenci2-5/+58
2017-01-12infra: bifrost: Upload build logs to artifacts.opnfv.orgMarkos Chandras2-5/+58
Change-Id: I0ba0fe05911dc7ea7cf31286b2f083f85ec5c549 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-01-09Revert "jjb: infra: bifrost-verify-jobs: Remove triggers due to HW relocation"Markos Chandras1-0/+4
This reverts commit 24691266ad858494cc06660b9c013af36c548bbd. The hardware is back online Change-Id: Ib7d21a5da3e41e4007e1e5363f82a02d2d1c4f0c Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-12-21jjb: infra: bifrost-verify-jobs: Remove triggers due to HW relocationMarkos Chandras1-4/+0
The hardware, where the slaves for this job are located, is being relocated so prevent scheduling of jobs until it's back online. Change-Id: I9028b6401bc0b743f83e5184e1131cb4aa9417c8 Link: https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2016-December/014210.html Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-12-08jjb: infra: bifrost-verify-jobs: Remove python-xml workaroundMarkos Chandras1-2/+1
python-xml is now being pulled in as dependency in the pip-and-virtualenv dib element so remove the explicit package installation. Change-Id: I94ea6a3b0f35cc62b945a8ced0a641ded7b36fea Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-29jjb: infra: bifrost-verify.sh: Make sure the cache directory existsMarkos Chandras1-0/+3
Fixes the following problem on new slaves: chown: cannot access '/home/jenkins/.cache': No such file or directory Change-Id: Ia461acd44466819e47a459e23ee6fd47ac1bad69 Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-28jjb: infra: Fix and enable the SUSE job for bifrostMarkos Chandras1-4/+29
Fix SUSE parameters for os, release, packages and elements and enable the job. Change-Id: I0fc0fbc5fcf8df04186d6c19aaf363020d31a44c Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-28bifrost: Make use of the new 'openssh-server' dib elementMarkos Chandras1-2/+8
Make use of the new 'openssh-server' dib element to achieve a consistent behavior of ssh server across all distributions. Change-Id: Ib10066a244fe44530969702cd465cdd79454b8fe Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-11-02Fix perms and sed for bridge_nameYolanda Robla Mota1-3/+3
Change-Id: I0b2b6e31a456398958bf1997ed6f6394322191c8 Signed-Off-By: Yolanda Robla <yroblamo@redhat.com>
2016-11-02Start using centos7 instead of centos-minimalYolanda Robla Mota1-1/+1
Current builds with centos-minimal are failing on 7, so start using centos7 element instead. Change-Id: I80d986fd7613e1807a119447a01c62e6f8a93ddf Signed-Off-By: Yolanda Robla <yroblamo@redhat.com>
2016-11-02Fix automated job to properly create the bridgeYolanda Robla Mota1-0/+7
The element that creates the bridge was moved from file to template. But in the case of VMs we are not running puppet to install bifrost, so that is not applied. Manually place the file in the right path, and replace the bridge name with the expected br_opnfv. Change-Id: I22b2213b529343b24c358b3c80fd1849ec40979c Signed-Off-By: Yolanda Robla <yroblamo@redhat.com>
2016-10-18Set a Custom URL for Bifrost Verification JobsTrevor Bramwell1-0/+2
OpenStack-CI documentation states[1] a custom URL needs to be set in order for Jenkins comments to be correctly formatted by the OpenStack Gerrit server. [1] http://docs.openstack.org/infra/system-config/third_party.html#the-jenkins-gerrit-trigger-plugin-way Change-Id: Id10c9839b823f0b3841cfcaa16a6dd384d34cbbe Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2016-10-13bifrost: Vote on upstream patchesFatih Degirmenci1-6/+0
Bifrost core wants OPNFV CI to vote on upstream bifrost patches to increase the visibility. Change-Id: Ia4fbdf5fa551750b6063dfb8610b6699039c4fbe Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-10-03jjb: infra: Trigger the Jenkins jobs when the jobs themselves changeMarkos Chandras1-0/+2
Making changes to the Jenkins jobs should trigger the CI to ensure that our changes did not break anything. Change-Id: I59e1d45fb82492ff03926cd4273367aca9060c74 Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-10-03jjb: infra: Fix ownership for the cache directoryMarkos Chandras1-0/+4
Fixes the following error when the ${HOME}/.cache permissions are bad: The directory '/home/jenkins/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag. Change-Id: I16310817e1f36bd8086e196ef61ec10c09ad7366 Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-09-27bifrost: Refactor bifrost jobsFatih Degirmenci7-338/+192
This change - Creates job templates to verify opnfv/bifrost patches - Introduces type in order to prepare verification on baremetal - Fixes git cloning so the job shows changes for the corresponding project - Gets rid of unnecessary slave parameters from slave-params.yml - Fixes build blocking - Updates the bifrost-verify.sh script and includes in shell so we don't have to clone releng repo separately - Updates destroy-env.sh to create /httpboot and /tftpboot with permissions 755 - Removes daily infra-bifrost job and scripts as we don't use them at the moment Change-Id: Icb5a543628d3321bfe4e549ab92c67443ac578d8 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-15Revert "infra: Fix ownerships for successful runs as well"Fatih Degirmenci1-3/+0
This reverts commit f915ff044fc6330db6e0971f49af1b44509c9cfb. Change-Id: I33134b44952a287216ab7ad63f9bb042cba51f6a Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-15infra: Fix ownerships for successful runs as wellFatih Degirmenci1-0/+3
Change-Id: I11b73104b5a80351537109fcb504bb250c641220 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-09-15infra: Change the ownership of stuff back to jenkinsFatih Degirmenci1-0/+10
Change-Id: I869a2e44b78ed33e3419077c32f5c0a08b63191f Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com> Signed-off-by: Markos Chandras <mchandras@suse.de>
2016-09-15infra: Remove /opt/stack to prevent leftovers from causing troubleFatih Degirmenci1-1/+1
Change-Id: I924f40a363fcaf50eb7e4c6f8cd1c5acba7c330b Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>