summaryrefslogtreecommitdiffstats
path: root/jjb/releng
AgeCommit message (Collapse)AuthorFilesLines
2018-10-05Update LaaS Container Build contextTrevor Bramwell1-2/+4
Updates the docker builds for LaaS to share the same context but point at different Dockerfiles. This way the dashboard code can be copied into the container instead of requiring to be volume mounted. Change-Id: I26fe345c8901b772a2e9da56fac71956a8a76583 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-04Enable yardstick-docker-build-arm-push-gambia jobPatrice Buriez1-1/+1
Similar to https://gerrit.opnfv.org/gerrit/63177 (done for x86_64). It replaces the yardstick-docker-build-arm-push-fraser job, for the same reasons. Depends on https://gerrit.opnfv.org/gerrit/63179 Change-Id: I482bc05d4c6d1316bfde799a44360decacb60a5e Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-04Make Gambia stream available to ARM Docker buildsPatrice Buriez1-0/+4
Similar to https://gerrit.opnfv.org/gerrit/63047 (done for x86_64). Change-Id: Ie61a11c60ce0fd7c724f308ecfdcca982ebdf3ec Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-04Enable yardstick-docker-build-push-gambia jobPatrice Buriez1-2/+2
It replaces the yardstick-docker-build-push-fraser job, because the logic in jjb/releng/opnfv-docker.sh L106-L119 has limited options for docker image tags: - 'latest', for git commits on master branch - tag-name, for git tags - 'stable' otherwise, i.e. for git commits on *any* stable branch. This means we can have only one (stable) job building and pushing docker images, in order to prevent the 'stable'-tagged image from switching between fraser and gambia contents, depending on the stable branch where the most recent change was cherry-picked and committed. Unfortunately, disabling the yardstick-docker-build-push-fraser job also means that further git tags on the stable/fraser branch will not result anymore in building and pushing new docker images with the intended tag-name and contents. Change-Id: Ieec1cdc6230e4c000c159cd743c587561c788fc3 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-03Merge "Make the Gambia stream available to Docker builds"Aric Gardner1-0/+4
2018-10-01Remove LaaS Container build for RabbitMQTrevor Bramwell1-5/+0
LaaS is using the upstream rabbitmq container now, so there is no need for this build. Change-Id: I08d2dc07eb6cd9cc732b25fd6dee2f342117d857 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-01Add builds for Clover controller, collector, jmeterearrage1-0/+24
- Push OPNFV docker builds for clover-controller, clover-collector, clover-jmeter-master and clover-jmeter-slave. Change-Id: I9541f9ca5e368c5e2ee833ce85948716f5dd66db Signed-off-by: earrage <eddie.arrage@huawei.com>
2018-09-28Make the Gambia stream available to Docker buildsTrevor Bramwell1-0/+4
Change-Id: Iac803fe18e6c1fcfcefb61dfb7ea03cbed5a51d1 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-10-10Keep Repository Archiving Job on lf-build2Trevor Bramwell1-1/+2
This node has permissions for Google Storage to upload the archive while master does not. Also adds myself to list of recipients so I'll get notified when the job fails. Change-Id: I07a13dcc72c59854222f6e5ace9d1e18c24e6479 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-09-24Pharos Dashboard Container BuildsTrevor Bramwell1-0/+19
Adds jobs for building the following LaaS containers: - opnfv/pharos-tools-laas-dashboard - opnfv/pharos-tools-laas-celery - opnfv/pharos-tools-laas-mq Having these containers built seperately from docker-compose decouples the build and deployment phases for the dashboard. Change-Id: I919066f5defd02fe1bbf96cfdf8ec2a6b3d8757d Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-09-24macros, docs, releng: Use `sudo -H` pip installAlexandru Avadanii1-1/+1
This is still far from a clean and secure approach, as `pip install` should not be ran with `sudo`. However, `-H` limits the area we touch and also fixes some incompat between disto-provided pip and pip-provided pip. Change-Id: I0e19dfeaf66f6f453e3868c71016305ae050f0c8 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2018-09-20[dovetail] add fraser docker build jobxudan1-0/+4
Change-Id: Ic54f6fe21dc0e9d2b3a9a2f3db1ba82f08446b6c Signed-off-by: xudan <xudan16@huawei.com>
2018-09-18Create branches via ssh rather than the httpsAric Gardner2-2/+15
Previously we created the branches over Gerrit's HTTPS interface. One or two projects from the previous release did not have their stable branches created at the correct place. Switch to using ssh for branch creation will be more reliable and easier for us to verify. Change-Id: If7f24d2b19e74513b59889bd64d25919aa048e4c Signed-off-by: Aric Gardner <agardner@linuxfoundation.org> Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-09-12Merge changes from topic 'stable-branch'Serena Feng1-0/+2
* changes: Create Gambia and Hunter Release Jobs Create stable/hunter Branch for Functest repos
2018-09-11Create Gambia and Hunter Release JobsTrevor Bramwell1-0/+2
This will create the release jobs needed for the OPNFV Gambia and Hunter stable-stream release process. Change-Id: Icdb9a337dcbad26fccb0e1e2935f8082f17bb220 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-09-11Add build "yardstick-image-k8s" docker image jobrexlee87761-1/+12
JIRA: RELENG-408 Change-Id: Ie6ac842ebd1bb6264c88a7f8ee0446d76fc3dbdd Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-09-06Merge "Move global-jjb parameter from releng to global"Fatih Degirmenci1-5/+0
2018-09-06Merge "Set NODE_NAME as the description for ansible runs"Trevor Bramwell1-0/+3
2018-09-05Move global-jjb parameter from releng to globalTrevor Bramwell1-5/+0
As these only affect jobs defined in global-jjb (no other jobs used these variable names) they should be safe to define at the global level. Change-Id: I646c3afc73757bff561cc84b80df064e13680080 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-08-26[Clover] Add docker build job for sample-appJunaid Ali1-0/+6
Change-Id: Iac612137bd4b1a45550849c3180525cfe74f4a7f Signed-off-by: Junaid Ali <junaidali.yahya@gmail.com>
2018-07-17Merge "Ensure docker prunning can be done"Trevor Bramwell1-0/+1
2018-07-13Set NODE_NAME as the description for ansible runsTrevor Bramwell1-0/+3
When the ansible-build-server job runs it helps to know which job ran on which server without clicking through to the job description. Change-Id: I2d5ef3b843fc839c8706837c74f00503de8808d5 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-07-12Ensure docker prunning can be doneCristina Pauna1-0/+1
Sometimes the docker build fails and the docker process hangs on a container, withouth being able to stop it. This causes spurious failures on other builds that shouldn't fail. The prune job should cleanup the hanging containers and images, but it fails when the docker process is hanged. This change adds a docker restart to the prune job, in order to assure that the hanged container is shut down and can be removed. JIRA: ARMBAND-358 Change-Id: I9d04fa1099a6fc53bf773a2eba33be89db7d0aa1 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2018-07-10[dovetail-webportal] Add docker build jobs for dovetail-webportalxudan1-5/+10
Add 2 docker build jobs for the new repo dovetail-webportal. One is dovetail-webportal-api, the other is dovetail-webportal-web. Once there is a new patch merged, it will auto trigger the jobs to build and upload the new docker images with tag 'latest'. According to the Dovetail release plan and develpoment of the web, can tag this repo and release with certain tag (e.g. ovp.2.0.0) JIRA: DOVETAIL-671 Change-Id: I1becc084617bb52f8c8e23275202bd7be4a7b2b3 Signed-off-by: xudan <xudan16@huawei.com>
2018-07-03jjb/releng: fix partial image name matchingYibo Cai1-7/+23
Docker image building script opnfv-docker.sh tries to remove existing images before and after building. It simply uses grep to matching image names, which may cause partial name matching problems. Ex. opnfv/compass-tasks will match both opnfv/compass-tasks and opnfv/compass-tasks-base, and may lead to accidentally removing of images still in use when several building tasks run concurrently. Error log: https://build.opnfv.org/ci/job/compass-tasks-build-arm64-master/6/console Change-Id: I1a83f801c5e0cc889cd9e17b8d1b4d895f1f68a9 Signed-off-by: Yibo Cai <yibo.cai@arm.com>
2018-06-29Fix release tagging scriptTrevor Bramwell1-1/+1
git cat-file can't output the tag information for a tag, but it can output the commit information a tag points to. Change-Id: I147941e2c0ba6defe212dbd0fc8c8a3a1fe0c728 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-28Fix Git URL Parameter for Release Merge JobTrevor Bramwell1-3/+3
This was incorrectly set to GIT_BASE, which includes the Project name, and should be set to GIT_URL, which does not. GIT_URL is used instead as each release file can contain multiple repos. Change-Id: I82b5e80f20f8999745cb5008c8057c81c4993574 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-27Merge "Restrict RTD Verify and Merge jobs to Releng"Trevor Bramwell1-0/+1
2018-06-26Merge "Fix release tagging noop"Trevor Bramwell1-1/+1
2018-06-26Restrict RTD Verify and Merge jobs to RelengTrevor Bramwell1-0/+1
By default the rtd jobs from global-jjb trigger against all projects. Setting 'project-pattern' to releng will restrict it to just the releng project. Change-Id: I9586577e8d83c6bf189eaee9159b1e49726740a5 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-20Fix release tagging noopTrevor Bramwell1-1/+1
When the release job runs to tag the repos it should push the tags back to Gerrit. This was originally a 'noop' for testing. Change-Id: Ifbecbccda1ae123c7b8f0d59eefa727784d10acd Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-14Add RTD Verify and Merge jobs for RelengTrevor Bramwell1-0/+4
These jobs come from global-jjb[1]. On verify, 'tox -e docs' is ran against releng, and on merge at webhook it curl-ed on RTD to build the docs. The merge job additionally requires jq installed to verify the build was triggered. [1] https://docs.releng.linuxfoundation.org/projects/global-jjb/en/latest/jjb/lf-rtd-jobs.html Change-Id: Ib0d752a904a9fdda2ab13016509a0b82d34ec3ee Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-13Merge "Update repo archive script to handle empty repos"Trevor Bramwell1-1/+1
2018-06-13Merge "jjb/releng: fix compass-container $DOCKERFILE"mei mei1-1/+0
2018-06-12Merge "Add separate fraser jobs to Barometer container builds"Trevor Bramwell1-0/+30
2018-06-12Update repo archive script to handle empty reposTrevor Bramwell1-1/+1
After an empty repo is cloned, and we attempt to pull in changes, git fails due to not know which branch to pull from. Explicitily pulling from origin into master should resolve this. Change-Id: I6bed85779c1bb571559c263800e8ea55ece3aa62 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-06-04jjb/releng: fix compass-container $DOCKERFILEYibo Cai1-1/+0
Use default $DOCKERFILE setting from downstream projects. Change-Id: I0bfee5dcaef9a9eb7601548a1e5da5a5f8d51bb5 Signed-off-by: Yibo Cai <yibo.cai@arm.com>
2018-06-01jjb/releng: fix compass container build errorYibo Cai1-10/+16
Error log: https://build.opnfv.org/ci/job/compass-tasks-base-build-arm64-master/1/console Change-Id: I47ef2ede64d63fb3e9a500dc48cdd510ee9ff235 Signed-off-by: Yibo Cai <yibo.cai@arm.com>
2018-05-31Add separate fraser jobs to Barometer container buildsEmma Foley1-0/+30
In order to support additonal features that have been added to collectd since the 5.8 release, there needs to be a separate stable and master container so we can support the new features as well as the stable release. This change will allow us to increment the version of collectd as we add functest support, config guides and documentation, while keeping the stable version container intact and available for users to download. JIRA: BAROMETER-102 Change-Id: I06ca84581a2e0f1a994cedf53aebc8f5cc3e7535 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-05-30Merge "jjb/releng: support multi arch compass images"mei mei1-10/+89
2018-05-26Revert "Remove noop for tag creation."Aric Gardner1-1/+1
This reverts commit dc4b9d1ad316e9055ccb3767c4572ad22cbe43a5. Change-Id: I3bec4ef84dcb7e56d80b4df78b487f7caa931f3e
2018-05-26Remove noop for tag creation.Aric Gardner1-1/+1
This script is tested, and should now be allowed to create tags. Change-Id: Ia87341c9cb6397700442a11c38d502fed8dd4743 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-05-25Verify and Create Tags from Release FileTrevor Bramwell3-32/+93
Updates the releases verify and merge jobs to check release files for the following: - commits exist - commits are on stable-branch If both of these criteria are met and the patch is merged, the repos will be tagged at the specified commits and pushed. If a repo has already been tagged but not on stable-branch the job will not exit, but will warn that the commit doesn't exist on the correct branch. This is because tags should never be removed. This adds an additional script 'repos.py' that provides an quick interface for pulling out information from release files, along with the script 'release-status.sh' for checking the status of tags. NOTE: The branch creation script has been disabled until it can be reworked. Change-Id: I498bc74f20aa50d2bd321771f20a77905b246399 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-05-23Adding a new verification job for testapi UI.Sakala Venkata Krishna Rohit1-2/+61
TestAPI web portal is being developed as part of an intern project. Angular JS framework is being used to develop UI functionalities. Also, corresponding unit tests have been written. Grunt JS is javascript task runner which is used to run tasks such as unit tests, coverage report etc. grunt e2e is the name of the task to run unit tests. Tasks are defiend in Gruntfile.js. To run the unit tests, google chrome is required. Here, the unit tests are ran using headless google chrome. Finally cobertura coverage report is generated. JIRA: RELENG-382 Change-Id: Ib12f8dd851276ab0e4116beb122518e9431d5b61 Signed-off-by: Sakala Venkata Krishna Rohit <rohitsakala@gmail.com>
2018-05-21Fix Manual Triggering of Docker JobsTrevor Bramwell1-1/+1
When manually triggering a docker job (or even through timed builds), GERRIT_EVENT_TYPE will not get set. This does gets set when the job is triggered by a Gerrit event (ex: ref-updated, comment-added). Specifying the variable lookup to default to nothing (ex: "${FOO:-}") should allow non-Gerrit triggered jobs to complete successfully. Change-Id: Ic1ba8ebef0967b0f20a2d6385ce0e0b4876901dc Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-05-18Merge "Fix Docker Container Build Tagging"Aric Gardner1-1/+8
2018-05-17Fix Docker Container Build TaggingTrevor Bramwell1-1/+8
Builds triggered by tags have a typo in the extraction of the tag name. This change includes a method for retriggering a tag build with the comment "retag TAG_NAME". Change-Id: Ie035e0922f8c073d3e360917ea7ccd6fa76d7b20 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-05-17Remove reverify for opnfv-lint and gate-securityAric Gardner1-2/+0
This is temporary, using reverify does not work in global-jjb for for now remove surrounding jobs so that users dont think its working. I've been told we can add reverify into global-jjb after that is done, I will re-add these. Change-Id: I533ff7c15d55d2630504ca18416583c167228c0d Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-05-17Bump JJB Build Timeout to 60 MinutesTrevor Bramwell1-1/+1
Without caching enable or when updating the JJB version all jobs get reconfigured, which can take upwards of 30 minutes. Setting this to a higher value should keep the build from being failed while still running. Change-Id: Ie2ed11da919ed9114700423591ebfaef94e61c88 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-05-17Update JJB to 2.0.3 and Global-JJB to 0.18.0Trevor Bramwell1-1/+1
Also updates global-jjb to 0.18.0 as it includes fixes to Postbuildscript required by the update to JJB 2.0.3. Link to Global-JJB 0.18.0 commit: https://gerrit.linuxfoundation.org/infra/#/c/10101/ Change-Id: I246e60d6c63cf6ba40aeba30d2a7e3985e57d5ad Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>