summaryrefslogtreecommitdiffstats
path: root/jjb/global/releng-macros.yml
AgeCommit message (Collapse)AuthorFilesLines
2017-12-21xci: Create periodic jobs for upstream osaFatih Degirmenci1-0/+10
This change takes xci-verify-jobs as base and adjusts osa-periodic jobs to ensure they do what they are supposed to. The structure of periodic jobs is pretty similar to xci-verify-jobs and the differences comparing to them are - OPENSTACK_OSA_VERSION is set to master. - SCM type changed to git-scm from gerrit - Voting is removed. - Triggering will be done using pollscm to ensure we only run jobs when something changes upstream. Triggers are not enabled yet until the basics are verified working. This change requires https://gerrit.opnfv.org/gerrit/#/c/49275/ in order for periodic jobs to work as expected. Further changes are needed to finalize the structure. Change-Id: I8f6519ccce93e6b8b65509638294419459fd36e8 Signed-off-by: Fatih Degirmenci <fdegir@gmail.com>
2017-11-30Update Releng Testresults PTL MacroTrevor Bramwell1-1/+6
Send emails to Serena after weekly Anteater scans on the releng-testresults repository. Change-Id: Ic4d61137ea8e30985f5330651e8d2da37b71fca3 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-11-29Fix Anteater Weekly Reporting JobTrevor Bramwell1-26/+18
- Does not output the full scan to the console log - Updates the email-ext defaults to include any *.log file in the root of the workspace. This should include securityaudit.log - Adds 'GERRIT_REFSPEC' to the list of job parameters as required by 'git-scm-gerrit' - Fixes email-ptl macros so projects with extra repos have the proper recipients. Change-Id: Ibf22bf0683fc1f88de07ef3bb4717769c6ea0174 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-11-27Email Weekly Anteater Reports to PTLsTrevor Bramwell1-0/+501
Completely replaces the current weekly security scan job. Instead of publishing weekly security scan reports they will be emailed to individual project PTLs. Uses a modified copy of 'anteater-security-audit.sh' to ensure the security scan job is not affected in this change. A later change will be made to merge the file back in and update the jobs. This is why 'anteater-parameters' are added to both jobs-templates. Change-Id: Ia8ebffbfce7a2d4feb83ef68ff0ab0c7bb4d2104 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-11-13Merge "fix the bug of patch verify"Trevor Bramwell1-1/+6
2017-11-10Remove Artifacts JSON JobTrevor Bramwell1-22/+0
As far as I know the site that consumed this resource was never actually published, and given this runs frequently on master, removing it should save resources. Change-Id: I383fcffcef98e0e12a38d15dcb1204419283b833 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-11-09fix the bug of patch verifywutianwei1-1/+6
If one patch don't modify the "yml" or "yaml" file, the script will exit with 1 at egrep "ya?ml$", then mark build as failure. In my opinion, if not modify the "yml" or "yaml" file, the yamllint should be successful. So we need mark the result of egrep "ya?ml$" as true, then judge the $YAML_FILES. Change-Id: I8abcadc9e4c85935ac7b20cdf54713b9800108ba Signed-off-by: wutianwei <wutianwei1@huawei.com>
2017-11-08Sudo pip install.agardner1-1/+1
not in a venv, so build fails if called by jenkins user without sudo Change-Id: I612a20777cc70a33542f767a63075939782e3201 Signed-off-by: agardner <agardner@linuxfoundation.org>
2017-11-08Merge "Update Yamllint Version"Trevor Bramwell1-1/+1
2017-11-02Merge "Switch yamllint job to only run against new files"Trevor Bramwell1-7/+8
2017-11-02Need to change directory check for new docs verifyagardner1-1/+1
old dir is no longer generated grab dir created by tox -e docs Change-Id: If52e931f6abdc8dcb39fbe7aac3c6b3342ce81c8 Signed-off-by: agardner <agardner@linuxfoundation.org>
2017-11-02Merge "Move all doc verfication to docs-verify-rtd-*"Aric Gardner1-61/+1
2017-11-01Move all doc verfication to docs-verify-rtd-*agardner1-61/+1
Ready for review (tested locally) 1) remove opnfvdocs-daily-{stream}: We don't need a timed docs build. and it did not build anything usefull 2) remove opnfv-docs-verify-{stream}: This uses depreciated and unmaintained opnfvdocs/scripts/docs-build.sh It does not clone submodules and gives no usefull feedback but it does post to artifacts and give a gerrit comment move that functionality to docs-*-rtd-* 3) remove opnfv-docs-merge-{stream}: does not upload anything meaningful 4) remove macro upload-generated-docs-to-opnfv-artifacts: is no longer needed since we use read the docs 5) improve docs-verify-rtd-{stream}: generate single page html and post to artifacts send gerrit commment with location of single page html, errors (like malformed table) are embedded nicely in the single page output and give devs a single source of feedback on their work 6) improve docs-merge-rtd-{stream}: this job now needs to remove review documenation created by docs-verify-rtd-{stream} TODO, after this is merged: remove now unused opnfvdocs/scripts/docs-build.sh Change-Id: I802eb11712d42555d34f986d061bf0dfc623c1e9 Signed-off-by: agardner <agardner@linuxfoundation.org>
2017-10-31Add Gerrit Trigger on Tag CreationTrevor Bramwell1-0/+14
We should be able to capture a tag creation event by triggering on 'ref-updated' but looking specifically at the 'refs/tags/' branch prefix. Though this will trigger a build against a specific tag, scripts will still need to examine the GERRIT_REFSPEC to determine the tag name. Change-Id: Ic18a3e11530fb71735431240f93d2074dacf4e1c Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-10-18Switch yamllint job to only run against new filesTrevor Bramwell1-7/+8
Intead of yamllint all files at once yamllint will only run against new or modified yaml files. Change-Id: I10b951427966409e15fb773b959adbd780497bad Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-10-16Update Yamllint VersionTrevor Bramwell1-1/+1
1.6.0 is quite a bit out of date; Updating Yamllint to 1.8.2 will enable some nicer feature of yamllint (like single line rule disables). Change-Id: I88d1c14539516ccef4f5e2e7e95b0017503dd98f Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-09-08installers: Use global macro 'clean-workspace'Alexandru Avadanii1-0/+10
Change-Id: I34a555697d963efc38064a7b53f25191d6bf1382 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-08-29Fix Yamllint Violations for jjb/globalTrevor Bramwell1-337/+338
Includes a default .yamllint configuration file with line-length producing a warning (instead of the default error) after 120 characters. JIRA: RELENG-254 Change-Id: Ia46ec6451201c5e91d98901a6ff65360079b2c81 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-08-17jjb: global: releng-macros: Add timeout wrapperMarkos Chandras1-0/+8
Add new timeout wrapper which can be used to kill a job if it take too long to finish Change-Id: I15a20fc92ea7855d11983b5734064aace138a2b5 Signed-off-by: Markos Chandras <mchandras@suse.de>
2017-08-02Create experimental job for qtip integrationYujun Zhang1-1/+1
Note that - experimental trigger is modified to allow trigger the build from changes outside `tests` folder - doctor jobs modified to adapt the change in common trigger Change-Id: Iaaa26651f9ea1d14cb6c77a713ff657c330dce6e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-07-10Merge "Send Build Notifications to Jenkins Admins"Trevor Bramwell1-0/+14
2017-06-23Send Build Notifications to Jenkins AdminsTrevor Bramwell1-0/+14
Given the number of jobs in OPNFV there isn't an easy way to discover when there is an issue affecting a large number of jobs without looking into individual job logs. By sending out email notifications on failed builds (using the email-ext plugin), we will have insight into causes for large sets of job failures, and also be able to identify non-job specific issues. This macro still needs to be added to jobs that already have publishers set, but by just adding it to defaults it should cover about half of all current jobs. JIRA: RELENG-257 Change-Id: I9d55bdd929a60004a16fa3c21bf1f7069f8786db Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-06-20Merge "Generalize Gerrit non-voting Review Macro Name"Aric Gardner1-3/+6
2017-06-19Generalize Gerrit non-voting Review Macro NameTrevor Bramwell1-3/+6
This patch updates the 'report-docs-build-result-to-gerrit' macro name to reflect that it can work well for more than just the opnfvdocs project. To take advantage of this macro a build merely needs to write out the file 'gerrit_comment.txt' with the information they want posted back to gerrit, and include the macro in the list of builders. Change-Id: Ifbdc5734fe7e7231be0cfd16d6b8d69cb1383bfd Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-06-07fix workspace permission errorMatthewLi1-1/+1
after https://gerrit.opnfv.org/gerrit/#/c/35833/ merged still fails https://build.opnfv.org/ci/job/compass-verify-deploy-virtual-xenial-master/360/console by checking the host the file was changed to <jenkins root> it should be <jenkins jenkins> Change-Id: I44bab9aaedaa18fc2c2b654bf156703904c220c7 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-29Make prescm step workspace permission fix a macro available to allFatih Degirmenci1-0/+8
bifrost-verify jobs have been using this without issues and it is needed for many other jobs in order to avoid unnecessary failures. This change makes workspace permission fix prescm step a macro. Change-Id: Ib5678dbf21c17ce640a600d2a06ebed9674663fa Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-03-23Removing shallow clone optionShubhamRathi1-1/+0
Change-Id: Iaae8a4b524ae804fd0efd75c656aae94c1c92a7e Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-03-02Made new doc job votingShubhamRathi1-4/+7
1. New has been made voting. Old doc job has been made non voting. 2. Adding files variable which triggers job on changes in 'docs/' Merge job earlier did not trigger on merge. Change-Id: Id19c02949a0a5f2b1da0682f18ed6051403aa77e Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-02-28Remove auto update barsJulien1-2/+2
auto update the bars will make the project submit new codes more and more difficult. now it is blocking project in qtip: no verify +1 and reivew -1 Change-Id: I559125c8e467b2cab9e95c493c60689b9d13016e Signed-off-by: Julien <zhang.jun3g@zte.com.cn>
2017-02-22Add coverage supportJulien1-0/+20
Add publish-coverage macro and used in qtip JIRA:QTIP-204 Change-Id: Ic0a0ca5f082bcaf10074b6312debd8549f99d065 Signed-off-by: Julien <zhang.jun3g@zte.com.cn>
2017-02-17Need to have these under submoduleAric Gardner1-2/+2
increase timeout and ask for shallow clone Change-Id: I93848c17b4f0d71271fe8bfa30bca6b8a0f509ba Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2017-02-17Shallow clone and increate timeout for rtd verifyAric Gardner1-0/+2
Change-Id: I45dc0ef41e88cd8be593ae14b28702a6aed147f9 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2017-02-16Add reverify alongside recheckAric Gardner1-0/+2
for gerrit-trigger-patchset-created used by: docs-verify-rtd-master Change-Id: Iedd6bb129d5dc94da9972b380f24ee4489beb5fc Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2017-02-16Fix bugs for new doc jobsShubhamRathi1-2/+21
Added new macro and changed parameters in docs-rtd.yml Change-Id: Ibb3306853e241674099ae0227719af6dc1280d1f Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-02-15[doctor] fix log cleaner and exclude joid testingRyota MIBU1-1/+1
Change-Id: Ibf5a23efa8948eb8da693d302e5a8b0a984e3237 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-02-08qtip is using 'gerrit-trigger-change-merged'Aric Gardner1-4/+4
Need to add it back from the last revert Change-Id: Ibc2f225c94121e89cc1db1b03b085e588b5a732c Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2017-02-08Revert "Add new jobs for doc merge and verify"Aric Gardner1-4/+5
This reverts commit fd8d915b212fb8adc943a74b537b5b5efffeaaad. Change-Id: I9e56196f2ac84b72af2f9b51bbcd663fdc4e02c3
2017-02-08Merge "Add new jobs for doc merge and verify"Aric Gardner1-4/+3
2017-02-08Add new jobs for doc merge and verifyShubhamRathi1-5/+4
New jobs for merge and verify added in tandem to ODLDocs. Intent of keeping these doc jobs between ODL & OPNFV as similar as possible is to keep the scope for common jobs and cross collaboration possible. The archiving feature that is included in post build configuration of ODLDoc jobs has been left out for now until CI Team can take it up. Change-Id: Ifb494f1491f07ad0af39cd2644f895372b98edf3 Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-02-05dovetail: set weekly triggerMatthewLi1-2/+2
JIRA: DOVETAIL-180 Change-Id: I26c02cd0805a8daf5a647e6c862f7befd0dbc34a Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-05Refactor qtip jobsYujun Zhang1-2/+1
- rename jobs to verify and validate - add job for validate-setup - move all scripts to helpers folder - use auto variables to merge job templates Change-Id: Ie1199e35e48b6a95861d9b7281fa7bdcc94212d9 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-03[doctor] enable joid jobsRyota MIBU1-0/+6
This patch enables doctor joid jobs for verification. This patch also makes sure there is no log files before starting tests. Change-Id: Idee794490c4ce794f3e7b7621fffcd5edeed9c83 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-02-01merge GIT_BRANCH and GERRIT_BRANCH into BRANCHRyota MIBU1-6/+6
GIT_BRANCH parameter is different; master or stable/danube in daily jobs, but 'refs/changes/57/27657/6' in verify jobs. This breaks some job builders triggered by the both types of jobs. We have GERRIT_BRANCH parameter for verify jobs to identify stream and expected branch into the patch will be merged after it got +2 and submitted. To avoid further confusion and to have common job builders for daily and verify jobs, this patch introduce BRANCH parameter. GERRIT_BRANCH is now deprecated. Change-Id: Ibcd42c1cd8a0be0f330878b21d3011f1ec97043b Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-30Revert "[doctor] not to reset verified status with experimental jobs"Yujun Zhang1-1/+0
This reverts commit 75c49787bd6cc357d44769e30a2b6d9832eca765. `silent-start` didn't resolve the issue of losing verified status when experimental jobs are triggered. Change-Id: Ib0f2b05594cac2cd378321a84b42873b16808b7b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-25dovetail: Create jenkins jobs to deploy compass colorado and run dovetail ↵MatthewLi1-0/+5
from master JIRA: DOVETAIL-180 Change-Id: I745e4747418a880a635922ea7a0cc5d6ec09e872 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-20[macro] property logrotateRyota MIBU1-0/+9
This patch defines 'logrotate-default' property and replace 'logrotate' by it, as 'logrotate' is deprecated on jenkins>=1.637 . Change-Id: I900975e5b3f590bb7a4d430e2f623931ae782bf4 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-20[doctor] fix doctor profiling jobRyota MIBU1-0/+24
Doctor profiling jobs have to be executed on ool-* pods, since we need pre-deployed OpenStack for those jobs. This patch also: - merge job templates for verify job and profiling job - move experimental trigger to jjb/global/releng-macros.yml Change-Id: If0283a734bec77d3f1bbab72d169f44ff1cd1c99 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-05Merge "cleanup releng-macros"Ryota Mibu1-23/+28
2017-01-04cleanup releng-macrosRyota MIBU1-23/+28
- sort in execution order - remove unused macro ('weekly-trigger-disabled') Change-Id: If72f2554985e8e632ad731c3dc17a23fbc8cd630 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-03Add YAMLLint for static checkKingPoo1-2/+3
JIRA: OCTO-160 1)Install yamllint first in case pod didn't install. If installed, it would info "already satisfied". 2)delete virtualenv of releng_yamllint. Current CI commit gate is simple, just have flake8 check in part of projects, it's better to apply more check tools to more projects. Yaml files could be checked by YAMLLint when the project is configed in releng. YAMLLint does not only check for syntax validity, but for weirdnesses like key repetition and cosmetic problems such as lines length, trailing spaces, indentation, etc. Change-Id: I8591385ed32942e0af7f7afdde435313af5707e5 Signed-off-by: KingPoo <haojingbo@huawei.com>