summaryrefslogtreecommitdiffstats
path: root/jjb/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2018-02-28[Yardstick] add apt-get autoremove to free up disk spaceRoss Brattain1-0/+12
yardstick builds are failing due to running out of disk space when too many kernels are left installed. Try apt-get autoremove to cleanup before updating [yardstick-verify-master] $ /bin/bash /tmp/jenkins4572301318127685434.sh Reading package lists... Building dependency tree... Reading state information... build-essential is already the newest version (12.1ubuntu2). python3-dev is already the newest version (3.5.1-3). python-dev is already the newest version (2.7.12-1~16.04). The following packages were automatically installed and are no longer required: linux-headers-4.4.0-101 linux-headers-4.4.0-101-generic linux-headers-4.4.0-103 linux-headers-4.4.0-103-generic linux-headers-4.4.0-104 linux-headers-4.4.0-104-generic linux-headers-4.4.0-108 linux-headers-4.4.0-108-generic linux-headers-4.4.0-109 linux-headers-4.4.0-109-generic linux-image-4.4.0-101-generic linux-image-4.4.0-103-generic linux-image-4.4.0-104-generic linux-image-4.4.0-108-generic linux-image-4.4.0-109-generic linux-image-extra-4.4.0-101-generic linux-image-extra-4.4.0-103-generic linux-image-extra-4.4.0-104-generic linux-image-extra-4.4.0-108-generic linux-image-extra-4.4.0-109-generic Use 'sudo apt autoremove' to remove them. 0 upgraded, 0 newly installed, 0 to remove and 111 not upgraded. 4 not fully installed or removed. After this operation, 0 B of additional disk space will be used. Setting up linux-image-extra-4.4.0-116-generic (4.4.0-116.140) ... run-parts: executing /etc/kernel/postinst.d/apt-auto-removal 4.4.0-116-generic /boot/vmlinuz-4.4.0-116-generic run-parts: executing /etc/kernel/postinst.d/dkms 4.4.0-116-generic /boot/vmlinuz-4.4.0-116-generic run-parts: executing /etc/kernel/postinst.d/initramfs-tools 4.4.0-116-generic /boot/vmlinuz-4.4.0-116-generic update-initramfs: Generating /boot/initrd.img-4.4.0-116-generic W: mdadm: /etc/mdadm/mdadm.conf defines no arrays. gzip: stdout: No space left on device E: mkinitramfs failure cpio 141 gzip 1 update-initramfs: failed for /boot/initrd.img-4.4.0-116-generic with 1. Change-Id: I79396162c5300c8cbaecc474473af81842f79db8 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-02-28Merge "Modify the daisy slavel-label in yardstick daily jobs"Fatih Degirmenci1-1/+1
2018-02-27[Yardstick] set yardstick ci debug switch onrexlee87761-1/+1
Yardsitck CI default print INFO level message, this patch turn the DEBUG on for Fraser debug. Change-Id: I3d4436e6610648ab64439ba410f4fe07a54d6dc0 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-02-23Modify the daisy slavel-label in yardstick daily jobsAlex Yang1-1/+1
Accoding to https://gerrit.opnfv.org/gerrit/#/c/52063/, the jobs of daisy master branch have been moved from zte-pod3 to daisy-baremetal. Change-Id: I6f2a93bd89f606c0506ef2bf60fe67f96ade0571 Signed-off-by: Alex Yang <yangyang1@zte.com.cn>
2018-01-05Enable kubernetes test suite for compasschenjiankun2-11/+14
Compass will put admin.conf file in /opt/admin.conf in compass-tasks container. We need to cp it to $HOME/admin.conf, then do a volume mapping so that yardstick docker container can have this file. Change-Id: I33b9ab4e44e363bd8375805bad7d8e5bf6af97fa Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-12-05Add separate builders for Yardstick project jobsRodolfo Alonso Hernandez1-5/+85
Added separate builders for Yardstick project jobs, in order to test each context individually. The new builders are: - Unit tests in Python 2.7 - Unit tests in Python 3 - Functional tests in Python 2.7 - Functional tests in Python 3 - Coverage tests - Style guidelines (PEP8) tests JIRA: YARDSTICK-877 Change-Id: I625a956bdaad88277b6ba36852639f23c8cda198 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-10-19Integrate yardstick on daisy master branchAlex Yang1-7/+29
JIRA: DAISY-9 1. Trigger yardstick job in daisy-baremetal-daily-master on zte-pod3 2. Add daisy pods in yardstick 3. Add EXTERNAL_NETWORK in installer params Change-Id: Ia8e69e503102c1fb282d6d2c5acac2ac3cbfe747 Signed-off-by: Alex Yang <yangyang1@zte.com.cn>
2017-10-16yardstick: remove apexlakeRoss Brattain2-12/+0
apexlake was removed from yardstick codebase Change-Id: I8eb826aa725dfb0e2c2c7a0bc1b15931fa245967 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-10Fix Yamllint violations for jjb/yardstickTrevor Bramwell2-402/+416
JIRA: RELENG-254 Change-Id: Icbfff8c0368c227451a09ac7f1f81df3e0f3563a Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-10-04Add OPNRC file to Yardstick container for fuel installer typeDelia Popescu1-4/+2
OPNRC file (openstack.creds) is needed to call openstack services It was not added any longer because we added a specific case for fuel installer to send SSH_KEY, OPNRC file and OS_CACERT to the container Change-Id: I235b138a77e06cded86a0b163ef383c1c37a0469 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2017-10-03Add CACERT file to Yardstick Container for fuel installerDelia Popescu1-4/+3
CACERT file is needed for authentication to and between openstack services. Change-Id: Ic6c48ad0ac6f16c2dca82214f5b44d2f8dcac4fc Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2017-09-30[Yardstick]Enable using the CACERT file in all compass branchesJingLu51-1/+1
Change-Id: Ia699a23d292ea2c18f309022352f83a22041626a Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-09-29Add mcp.rsa in the yardstick container for fuelCristina Pauna1-0/+8
For Fuel, the mcp.rsa key is needed in the container to be able to connect to the POD nodes. The key is set in the global installer parameters and passed to the container. Also the SSH_KEY enviroment variable is set with the path of the key. Change-Id: I1888414abc9f6c2d8ac741f2d6f04f5e7a37912b Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-09-19yardstick: Create jobs for EuphratesFatih Degirmenci2-19/+19
This change switches jobs to euphrates and removes danube jobs. Change-Id: I421b3927e05712a62409e768b1b6a2e36c462537 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-09-14Merge "yardstick-cleanup.sh: try to fix docker rmi failure"Aric Gardner1-13/+13
2017-09-13yardstick: AArch64: Pull from arch-specific repoAlexandru Avadanii1-4/+8
AArch64 Docker images for Yardstick reside in "opnfv/yardstick_aarch64" repo. Change-Id: Ic2621aabd535bbfcd274650ee590eebed4806efa Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-09-11yardstick-cleanup.sh: try to fix docker rmi failureRoss Brattain1-13/+13
apex builds seem to be failing to remove the yardstick containers https://build.opnfv.org/ci/job/yardstick-apex-baremetal-daily-master/400/console [yardstick-apex-baremetal-daily-master] $ /bin/bash /tmp/hudson8974425724638109512.sh Cleaning up docker containers/images... Docker images to remove: REPOSITORY TAG IMAGE ID CREATED SIZE opnfv/yardstick latest 5b83d8e60fb7 6 days ago 1.84GB Removing docker image opnfv/yardstick:latest... Error response from daemon: No such image: opnfv/yardstick:latest Build step 'Execute shell' marked build as failure For some reason we can't remove the yardstick container. Try instead to remove based on ID Replace grep | awk with just awk. Also fixed shellcheck warnings: In jjb/yardstick/yardstick-cleanup.sh line 6: if [[ -n ${dangling_images} ]]; then ^-- SC2128: Expanding an array without an index only gives the first element. In jjb/yardstick/yardstick-cleanup.sh line 10: containers=$(docker ps -a | grep $image_id | awk '{print $1}') ^-- SC2086: Double quote to prevent globbing and word splitting. In jjb/yardstick/yardstick-cleanup.sh line 12: docker rm -f $containers >${redirect} ^-- SC2086: Double quote to prevent globbing and word splitting. In jjb/yardstick/yardstick-cleanup.sh line 14: docker rmi $image_id >${redirect} ^-- SC2086: Double quote to prevent globbing and word splitting. In jjb/yardstick/yardstick-cleanup.sh line 20: if [[ ! -z $(docker ps -a | grep opnfv/yardstick) ]]; then ^-- SC2143: Use ! grep -q instead of comparing output with [ -z .. ]. In jjb/yardstick/yardstick-cleanup.sh line 27: if [[ ! -z $(docker images | grep opnfv/yardstick) ]]; then ^-- SC2143: Use ! grep -q instead of comparing output with [ -z .. ]. In jjb/yardstick/yardstick-cleanup.sh line 33: docker rmi opnfv/yardstick:$tag >$redirect ^-- SC2086: Double quote to prevent globbing and word splitting. Change-Id: I6545ac7f568161e5620e31d487faf70fa21da075 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-09-11Add flex-pod1 details in yardstick daily jobsSiddharth Gogar1-0/+13
Add slave params for flex-pod1 Change-Id: I25e93fe2231e604321f8ea7ca18eba45ecc3ee13 Signed-off-by: Siddharth Gogar <siddharth.gogar@flex.com>
2017-09-01Merge "Missing "-y" when install docker.io"Jun Li1-1/+1
2017-09-01Missing "-y" when install docker.iochenjiankun1-1/+1
Change-Id: I1c94d148bf62aba6e21fcabe1908931c6732327f Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-31cleanup of obsolete non-CI arm PODsCharalampos Kominos1-53/+0
Change-Id: I134feba421d12c4ca428b098aaa2bf52b3dec0ca
2017-08-31Using juju ssh command to run kubernetes test casechenjiankun1-2/+8
On joid kubernetes deployment we can't ssh container from jumpserver. So we need to start yardstick on kubernetes master node. Change-Id: I9a1308d401cdacef63690088ac22bd555927bea3 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-30Bugfix: Bad substitution wthen run shell scriptchenjiankun1-0/+1
When run yardstick-get-k8s-conf.sh, there is an error: /tmp/hudson2171423090360971912.sh: 6: /tmp/hudson2171423090360971912.sh: Bad substitution To solve this problem, we need set using /bin/bash to run script. If we do not set it, it will using /bin/sh by default. Change-Id: Ic3aa58dfad009c42974f98ea4366b6e5f50752ca Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-28Fetch admin.conf from master on kubernetes scenariochenjiankun3-6/+24
Now we have joid deploy kubernetes scenario We need admin.conf when run test case We can fetch admin.conf by: juju scp kubernetes-master/0:config admin.conf Also we need a jenkins job to fetch it. Change-Id: I13a6a17ca13e247cfc50774bf5104480fc03631a Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-28yardstick pod4 job Offlineliyin1-1/+1
This changes will make yardstick huawei-pod4 job offline. Change-Id: Id0bc805e93ff2e38383717af4b486f4f3bddfc66 Signed-off-by: liyin <liyin11@huawei.com>
2017-08-25Pod name changes in ARMBANDDelia Popescu1-6/+6
arm-pod3 pod name is changed to arm-pod5 arm-virtual1 pod name is changed to arm-virtual2 Change-Id: I6746fcdd52bbed5b6a61147d0abc5db64876dc97 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2017-08-02Send 'Build Failed' Emails to Jenkins AdminsTrevor Bramwell1-0/+1
Adds the 'email-jenkins-admins-on-build-failures' publishers for jobs which have overridden the default list of publishers. This will provide Jenkins administrators a time-series list of build failures to assist in debugging issues with the master and agents. JIRA: RELENG-257 Change-Id: I28f12877562113c9197ed6429ee2a7f3cdbaf346 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-07-25[yardstick]Add cacert file in yardstick job for compass master environmentJingLu51-1/+6
Compass4nfv in master now enables https, so a cacert file is required when executing openstack command in yardstick container. This patch adds a "cacert_file_ vol" binding to the yardstick container. Change-Id: Id69c3e71de6c73fc7834b3ac03f423e3636377b6 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-07-13[Yardstick]Update Apex CI pod info for Yardstick CI jobsJingLu51-29/+45
Change-Id: I2ec55ccba540979148abdf0ab028e114c36eff76 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-07-10[Yardstick]Use volume-binding to provide rc file to yardstick containerJingLu52-6/+10
The 'fetch_os_creds' script is preferred to run on jump server to get OS creds as mand projects do, this patch unify the way to get OS creds by volume-binding. Change-Id: I0da54545ee088458c952f216945c29232d487692 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-06-26[yardstick] Pass "BRANCH" variable to yardstick docekr containerJingLu51-1/+2
Recently update of utils/fetch_os_creds.sh in commit 8359219bae93a028f6205cdc9460654f9e45c217 use a "BRANCH" varibale in fuel environmet Currently Yardstick didn't pass such variable to yardstick docker, which causes the following error: /home/opnfv/repos/releng/utils/fetch_os_creds.sh: line 75: BRANCH: unbound variable This patch fix this error by Pass "BRANCH" variable to yardstick docekr container Change-Id: Ifcf3df7107b2f4b493b37c7ef5473f170a8edb94 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-06-20[yardstick] add Ross to email recipientsRoss Brattain1-1/+1
as yardstick PTL I'd like to get Jenkins results emails Change-Id: If053ab72902c145a13e0dc965ff69211f33c4a88 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-06-07yardstick: Rename yardstick-ci-jobs to align with functestFatih Degirmenci1-0/+0
Change-Id: I1b88ca7f25431b48e3fce3ebec20274062204718 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2017-05-18Build Timeout Wrapper for YardstickTrevor Bramwell1-0/+13
Yardstick builds are hanging and not being caught for 19+ hours. Using the build timeout plugin we should be able to quickly stop these builds and let the project know much sooner there is an issue with their builds. The default timeout is set to fail if the job takes longer than 30 minutes. This can be adjusted later if the time is too long or too short. ssh-agent-wrapper is included as it is the default from globals, and defaults are superceded by fields added to jobs. Change-Id: I9529ab7b6ab8819ceb91694fefbb4ecb3f5cf81c Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2017-04-18Make arm-virtual1 pod not available for CI jobsAlexandru Nemes1-0/+17
Change-Id: I1ae47f2105744bfea8c8c589f41282d1c4ae2159 Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com>
2017-04-01change openrc file path to /etc/yardstick/openstack.credschenjiankun1-1/+1
JIRA: YARDSTICK-623 Now almost yardstick openrc file is in /etc/yardstick/openstack.creds. But only in prepare_env.sh it is /home/opnfv/openrc. So I unified it and change it to /etc/yardstick/openstack.creds in the follow patch: https://gerrit.opnfv.org/gerrit/#/c/32005/ Also there is some adapt work to do in releng. Change-Id: I7764582dec1d9a8f74e53b23e23d98021a20589b Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-24Use docker image id instead of tag to remove yardstick Docker image with ↵JingLu51-1/+15
tag:<None> JIRA: RELENG-194 Now, in CI, bottlenecks job will pull yardstick Docker image again, which may cause the tag of the Docker image previous used by Yardstick changed to 'None'. Using 'None' tag to remove Docker image will cause error. Change-Id: I5c63c6c515ede5da4f6a40be6bb22fa6771f8f09 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-02-25yardstick: email receiver changeMatthewLi1-1/+1
Change-Id: I3cf28afe76bc0cd0bbabae28ad2620a565756e93 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-10Move the compass centos job to intel-pod8wutianwei1-11/+2
We fixed the issue of accessing database failed on intel-pod8. Some problem happened in Huawei Munich Lab.So we move the CI job to this pod. Change-Id: Iefddcf2bef2cc296b1abd2d224b78c6dbc522295 Signed-off-by: wutianwei <wutianwei1@huawei.com>
2017-02-05yardstick: install python3-dev so we can build librariesRoss Brattain1-0/+2
We need python3-dev so we can install Python3 libraries like lxml Otherwise we fail with: building 'lxml.etree' extension creating build/temp.linux-x86_64-3.5 creating build/temp.linux-x86_64-3.5/src creating build/temp.linux-x86_64-3.5/src/lxml x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/libxml2 -Isrc/lxml/includes -I/usr/include/python3.5m -I/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/include/python3.5m -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-3.5/src/lxml/lxml.etree.o -w src/lxml/lxml.etree.c:85:20: fatal error: Python.h: No such file or directory compilation terminated. Compile failed: command 'x86_64-linux-gnu-gcc' failed with exit status 1 creating tmp cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /tmp/xmlXPathInitmtir1fki.c -o tmp/xmlXPathInitmtir1fki.o /tmp/xmlXPathInitmtir1fki.c:2:1: warning: return type defaults to ‘int’ [-Wimplicit-int] main (int argc, char **argv) { ^ cc tmp/xmlXPathInitmtir1fki.o -lxml2 -o a.out error: command 'x86_64-linux-gnu-gcc' failed with exit status 1 JIRA: RELENG-190 Change-Id: Icea4cff9bb9699fbd4bfc25dd201ff8bc6e6a902 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-02-02yardstick: use tox to add support for python3Ross Brattain1-14/+1
We need to start adding support to Python3 to match Openstack support for Python3. Use tox and move all the env setup to tox.ini JIRA: YARDSTICK-452 Change-Id: Ie57b5edd87ab6fad641a174f468d3265757e0f71 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-02-01merge GIT_BRANCH and GERRIT_BRANCH into BRANCHRyota MIBU3-5/+2
GIT_BRANCH parameter is different; master or stable/danube in daily jobs, but 'refs/changes/57/27657/6' in verify jobs. This breaks some job builders triggered by the both types of jobs. We have GERRIT_BRANCH parameter for verify jobs to identify stream and expected branch into the patch will be merged after it got +2 and submitted. To avoid further confusion and to have common job builders for daily and verify jobs, this patch introduce BRANCH parameter. GERRIT_BRANCH is now deprecated. Change-Id: Ibcd42c1cd8a0be0f330878b21d3011f1ec97043b Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-26Bugfix: yardstick verify failedJingLu51-0/+1
JIRA: RELENG-187 see log: https://build.opnfv.org/ci/job/yardstick-verify-master/1688/console Change-Id: Id6ac66a34fba5a0d18ab4a60e457582bbb4f03d0 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-01-24Bugfix: yardstick verify failedchenjiankun1-1/+1
JIRA: RELENG-187 yardstick verify failed. There is some wrong with setuptools new version 34.0.1 I will change it to 33.1.1 see log: https://build.opnfv.org/ci/job/yardstick-verify-master/1688/console Change-Id: If3c65a9a8047b57549c40501b0a83118cd5dc3e7 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-01-20[macro] property logrotateRyota MIBU1-0/+1
This patch defines 'logrotate-default' property and replace 'logrotate' by it, as 'logrotate' is deprecated on jenkins>=1.637 . Change-Id: I900975e5b3f590bb7a4d430e2f623931ae782bf4 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-09Remove colorado jobs and create danube jobsFatih Degirmenci2-16/+16
Danube stream for the projects with daily jobs is disabled. Danube stream for the projects without daily jobs is left as enabled as there will be no changes coming to danube branch until branch is created. Dovetail, Apex and Fuel jobs have not been updated yet. Change-Id: Ice39826c8f829157fa864370557837290838f634 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-12-30improve yardstick logger to output Debug info to artifactsrexlee87762-1/+15
JIRA: RELENG-158 Change-Id: I3bd91c671fa3dcac5cd47ca12610457fd1ab5a5b Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-12-19fix ci jobs (daily && no branch param)Ryota MIBU1-0/+2
Change-Id: Iad856adf625a56c2f5c366fb414746d1e9e16691 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-12-19clean scm defenitionsRyota MIBU2-12/+3
This patch makes sure we use 2 types of scm, and allows us to specify them by adding one line in job-templates. - git-scm # for daily jobs and merge jobs - git-scm-gerrit # for verify jobs [New] Change-Id: Iddc8a5e0e115193c7081a6d6c53da209900e95c8 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-12-01Restrict Gerrit Triggers to OPNFV Gerrit ServerTrevor Bramwell1-0/+2
With the addition of ODL and OpenStack Gerrit servers, it's important we don't generate additional noise by accidentally building against these Gerrit servers when we don't intend to. JIRA: RELENG-179 Change-Id: Ia163c6c3eaa58e8e21dc6548a839062fcbde39ed Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>