summaryrefslogtreecommitdiffstats
path: root/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-01-13Do not hide unit tests execution failRodolfo Alonso Hernandez1-0/+7
While moving tests from ./tests/ to ./yardstick/tests, both unit tests directories are executed. If the first test run fails, do not hide the error and exit immediately. Change-Id: Ib6c64ccf2f4b19722722eb43b3d45d5ad5f0169d Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-11pylint: try to change formatting for Jenkins againRoss Brattain1-1/+1
looks like we have to add var to tox passenv Change-Id: Iba2da2123ae531e026897308769aa832c7eb6d04 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-11Move tests: functional/Emma Foley1-1/+0
All tests in tests/functional have been moved to yardstick/tests/functional JIRA: YARDSTICK-837 Change-Id: I89276b36635de74dd7b8f70e961c71aa0d2c494e Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-11pylint: make Jenkins output parseableRoss Brattain1-2/+7
Jenkins doesn't handle the color and the output is hard to read in Jenkins logs Change-Id: Ie8fc5a78e89f72c829e4bbbcbd1291a723dfde72 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-11Run tests in yardstick/tests/Emma Foley2-17/+20
* Edit .testr.conf and tools/run_tests.sh * Run functional and unit tests in tests/ and yardstick/tests/ * Add yardstick/tests/unit/__init__.py and yardstick/tests/__init__.py * Update pylintrc rules to disable: * missing-docstring * fixme * protected-access Test will run in both tests/ and yardstick/tests/ initially Change-Id: Iccd0df0d1b85b5d08f7faa56669bc32687925f7e JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-17Move test scripts to tools/Emma Foley3-0/+231
Move the scripts that tox uses for running tests to the tools/ directory: * run_tests.sh -> tools/run_tests.sh * tests/ci/cover.{sh,awk} -> tools/ JIRA: YARDSTICK-837 Change-Id: I817c9e5f58c06b45f1de3f369318f4bb24168677 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-17Tox: add a pep8 targetEmma Foley1-0/+59
Adds a pep8, pep8-full targets to tox: * pep8 target: runs pylint on the changed files * pep8-full target: runs pylint on whole repo Adds scripts to run pylint: * stored in tools/ Documentation: changeed the command for running tests (run_tests.sh -> tox). This runs the same set of tests as before. JIRA: YARDSTICK-832 Change-Id: I652da87723682d958f3fcbc2eb4cd88422636a3b Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-10Check requirements against OpenStack requirementsRodolfo Alonso Hernandez1-0/+111
Added a new tox environment to check the project requirements against the OpenStack requirements. The openstack/requirements branch used will depends on Yardstick release development. At this point, Yardstick F release must be compliant with OpenStack Pike release. Change-Id: I77a4cfa4f99674176c3f5711dc1b6787bb400ecf Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-08-15Integrate vsperf in Tgen modeJing Zhang3-0/+250
Problem: Running Vsperf in Tgen mode is supported but the integration is not complete at the code level i.e. not ready-to-use, and dpdk loopback is not supported inside the VM. Solution: (1) Completely automates VM image generation and supports 1G huge pages. (2) Adds a new test scenario VsperfDPDK for testpmd based loopback inside the VM. Update 1-2: Fixed "line too long" issues not reported by local run_tests.sh (why?) Update 3: Per comment change to use SSH.from_node() and add unit test cases Update 4: Add more unit test cases for coverage and ready the code for merge JIRA: YARDSTICK-661 Change-Id: Iea3014d4c83e1b0c079019a4ed27771d40a7eed8 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-08-11Merge "yardstick setup ansible, including load_images"Ross Brattain1-2/+34
2017-08-08yardstick setup ansible, including load_imagesMalanik Jan1-2/+34
also update to cirros 0.3.5 added PROX compilation add create_node_pod_yaml role JIRA: YARDSTICK-639 Change-Id: If5999841287a54c7e5c64a7cc487c6394df90424 Signed-off-by: Malanik Jan <janx.malanik@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-03New storage test case: Bonnie++JingLu51-0/+1
JIRA: YARDSTICK-770 Bonnie++ is a disk and file system benchmarking tool for measuring I/O performance. With Bonnie++ you can quickly and easily produce a meaningful value to represent your current file system performance. This work is add new storage test case using Bonnie++. Change-Id: I752fee156707cda730962c68d17fda4d4e9cd472 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-21aarch64: Fix missing qemu-aarch64-static in chrootPaul Vaduva2-11/+5
During recent rework, we lost the explicit copy of qemu-aarch64-static from docker to chroot; so when trying to execute AArch64 binaries inside chroot, no emulator was present to handle it. This change brings back (inside chroot) the missing emulator binary. JIRA: YARDSTICK-595 Change-Id: I146e2eeec2e9452a0db36f0bf0a466a8affc2005 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2017-03-21Merge "Bugfix: remove vivid as it is EOL"Jing Lu2-57/+3
2017-03-20Bugfix: remove vivid as it is EOLRoss Brattain2-57/+3
Vivid is end of life, and thus not supported. Change-Id: Ia293fcd6fd2a3279a642a6dbbb7ad1811334c3e1 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-20Bugfix: replace MD5SUM with SHA256SUMsRoss Brattain3-18/+18
MD5 is broken and should not be used Change-Id: Ib168932387f58f0a538d865f8ef4e3cda046a35a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-17Bugfix: yardstick-image built without test toolsJingLu51-6/+2
JIRA: YARDSTICK-593 The yardstick-image now built dosen't have test tools in it. This patch aims to fix this issus. Change-Id: I9863a933106236835c16e21f84aa107ffd554df7 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-13Bugfix: fatal: destination path '/opt/tempT' already exists and is not an ↵chenjiankun1-11/+16
empty directory. JIRA: YARDSTICK-588 ubuntu-server-cloudimg-modify.sh: fixes and cleanup https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-virtual-daily-master/1233/console saw this in an error log, not sure if it is a real error + [[ amd64 = \a\r\m\6\4 ]] + git clone https://github.com/kdlucas/byte-unixbench.git /opt/tempT fatal: destination path '/opt/tempT' already exists and is not an empty directory. + error_trap + local rc=128 + set +e + '[' -z '' ']' + exitcode=128 workaround by deletign /opt/tempT always before cloning also improve ln with relative symlink and forcing filename target Change-Id: Ia9c35a877207494623055b1b2134f7834fadedf8 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-13Merge "ubuntu-server-cloudimg-modify.sh: shellcheck fixes"Jing Lu1-1/+1
2017-03-13Merge "Bugfix: ubuntu-server-cloudimg-modify.sh: fix grep syntax with if"Jing Lu1-1/+1
2017-03-09ubuntu-server-cloudimg-modify.sh: shellcheck fixesRoss Brattain1-1/+1
fixes for shellcheck warning ubuntu-server-cloudimg-modify.sh:51:23: warning: Quote this to prevent word splitting. [SC2046] ubuntu-server-cloudimg-modify.sh:51:30: note: Double quote to prevent globbing and word splitting. [SC2086] Change-Id: I6cff0713a0471e5ce94211d42a7c8b45e3761c4d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-09Bugfix: ubuntu-server-cloudimg-modify.sh: fix grep syntax with ifRoss Brattain1-1/+1
https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-virtual-daily-master/1233/console + '[' grep -q trusty /etc/apt/sources.list ']' /ubuntu-server-cloudimg-modify.sh: line 27: [: too many arguments If will check exit status itself, we don't need to use test Change-Id: I3edcf6ef2cbbf888f1089345764a00f9dbd206bd Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-09ubuntu-server-cloudimg-dpdk-modify.sh: fixes and cleanupRoss Brattain1-8/+11
https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-virtual-daily-master/1233/console saw this in an error log, not sure if it is a real error + [[ amd64 = \a\r\m\6\4 ]] + git clone https://github.com/kdlucas/byte-unixbench.git /opt/tempT fatal: destination path '/opt/tempT' already exists and is not an empty directory. + error_trap + local rc=128 + set +e + '[' -z '' ']' + exitcode=128 workaround by deletign /opt/tempT always before cloning also improve ln with relative symlink and forcing filename target Change-Id: I6715e6dba76b79706d396b616eae980e5ace773b Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-08Merge "Add uefi image support for yardstick"Rex Lee2-37/+50
2017-03-03Add uefi image support for yardstickCatalina Focsa2-37/+50
Add support for downloading and building an uefi single part image. Keep three part image support if needed. Keep modifications required for arm64, when using vivid. Install and use parted required for GPT partitioning. Change-Id: I1a9a20701e2fe1f6f644f2c687c5da2e09b69d89 Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>
2017-02-17Update missing license headersDeepak S2-0/+17
Change-Id: I063fd37fe25754c94d164ae5a209d15b69322093 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-02-13New reliability/availability testcase - IP datagram error rate and etc.JingLu52-0/+6
JIRA: YARDSTICK-534 This test case uses nstat to monitor network metrics provided by the kernel in a host and calculate IP datagram error rate, ICMP message error rate, TCP segment error rate and UDP datagram error rate. Change-Id: I2fe6457bb5c95d0446c1463991ae31cc664b09f8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-12-21restore the yardstick-img-modify cleanup() funcRyan.RCS1-3/+5
There is a result failed again after last update. So i restore the clean() function to its original codes and avoid CI failed. But i'm not sure something about the clean() function, and I will check this failed clearly in future. Change-Id: I8f49533788c7ccb2016e7a484368a72028579fa8 JIRA: YARDSTICK-502 Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-12-21fixed issue in yardstick-img-modify cleanup() funRyan.RCS1-1/+5
1. when run yardstick-img-modify script, sometimes it show below error. + '[' -f /tmp/workspace/yardstick/yardstick-xenial-server.raw ']' + kpartx -dv /tmp/workspace/yardstick/yardstick-xenial-server.raw ioctl: LOOP_CLR_FD: No such device or address del devmap : loop0p1 can't del loop : /dev/loop0 + test 1 -eq 1 -o 1 -eq 2 2. so i added a expression to check if the .raw file map deleted or not 3. if the devmap not deleted, then we delete it, otherwise, we do nothing JIRA: YARDSTICK-502 Change-Id: Ia050121ed6bf837bab05e38f2e9e9628ca31627a Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-12-15Bugfixed:run command: "yardstick-img-modify" fail!Ryan.RCS1-1/+1
Avoid incorrect deletion of $raw_imgfile when the command: "kpartx -dv $raw_imgfile" execute failed. JIRA: YARDSTICK-424 Change-Id: I34dac60bda6c028c4b0f0bfd9ad077e2d5dbb0ff Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-11-09Upgrade yardstick VM image from Ubuntu 14.04 to 16.04JingLu52-6/+8
JIRA: YARDSTICK-365 This patch upgrades the base Ubuntu version of Yardstick VM image from trusty(14.04) to xenial(16.04). If you still want to use Ubuntu 14.04 to build Yardstick custom image you can use command: sudo ./tools/yardstick-img-modify tools/ubuntu-server-cloudimg-modify.sh trusty And now the "yardstick-trusty-server" is rename as "yardstick-image". Change-Id: I0765f3aee2d17eea1ad2257d0f576cdb9ef2b18d Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-10-17Bugfix: Add image modify scripts into environment variablesJingLu51-1/+1
JIRA: YARDSTICK-371 JIRA: YARDSTICK-372 This patch fixs two bugs. One is add image modify scripts into environment variables; The other is fixng a format error in ubuntu-server-cloudimg-modify.sh Change-Id: Ie2381400e469ddcbb02f0b0de250274f3bcb0396 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-10-11Provide yardstick-trusty-server.tar.gz for lxd scenarioJingLu51-0/+135
JIRA: YARDSTICK-325 This patch removes ping_lxd_test.yaml and changes vm image used for lxd senarios. In the *-lxd-* scenariois, Cirros LXC 0.3 image will be used for Ping test case. For yardstick generic test, a dedicated yardstick vm image will be used. Change-Id: I5f9e7a92e3e5dded0014baec77085d80cc904b52 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-09-10yardstick: modify e2fsck command to run with -p paramPaul Vaduva1-1/+1
e2fsck command will not run without human intervention if we do not use -p option. Jira issue: ARMBAND-74 Change-Id: Ie7f9b526a568e49ad44c4ee3b4fe75a1065bb1b3 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2016-08-31ARM64: Add support for aarch64 architecturePaul Vaduva2-15/+82
Added support for arm64 architecture so that yardstick framework can be ran on arm-pod1 the armband CI pod. The modifications include testing for presence of arm64 architecture nodes in the pod and running arm64 specific code (building yardstick server image on arm64 version of ubuntu cloud. Openstack doesn't boot 3.13 kernel(arm64) so it was replaced with 3.19 kernel(also arm64), available for vivid cloud image of ubuntu. The Dockerfile for building the ci image was also mofied to add necessary tools for cross-building an arm64 image on amd64 host (the jumpserver) The jira case for this commit is ARMBAND-40. Change-Id: I906d4adbcf2ec2c0f1d695d9916ede42f4151080 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2016-08-09Two modifications for DPDK imagewu.zhihui2-2/+5
1. workaround for creating snapshot 2. modify the parameters of Hugepage in vm JIRA:YARDSTICK-233 Change-Id: I9cea76ed30dabe4fe2cb644e58ed0acd7dd8ecde Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-08-04[Yardstick-233]DPDK image for TC042wu.zhihui4-0/+423
These file is based on Akos's code. (https://gerrit.opnfv.org/gerrit/#/c/16095/) The different places: 1. create flavor and import yardstick_key.pub with heat template. 2. remove handle code about eth0 in user_data. 3. update heat cli and delete step "nova stop" which is not necessary. 4. clean the stack in final. 5. add eth2 for vm. JIRA: YARDSTICK-233 Change-Id: I04f2051fb4bcfeed2df4868d758fd92011c62233 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-06-06ubuntu-server-cloudimg-modify: adjust install location of RAMspeedJingLu51-3/+2
Unify tool install location Change-Id: I45fc76a0631187136a2602d1a9c26f3df94ce9dd Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-06-03Merge "ubuntu-server-cloudimg-modify: fix location of #! shell line"liang gao1-2/+1
2016-06-01ubuntu-server-cloudimg-modify: fix location of #! shell lineBilly O'Mahony1-2/+1
The #!/bin/bash was not on the first line of the script so the script was run as sh not bash. This meant some obvious things like ${VAR} do not work. Change-Id: Ieac3e4aca8e7f34ac7985cca5b6ef12e7705f202 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Szilard Cserey <szilard.cserey@gmail.com> Reviewed-by: Liang Gao <jean.gaoliang@huawei.com>
2016-06-01Add cachestat scenarioJingLu51-0/+2
JIRA: YARDSTICK-267 This scenario reads system cache hit/miss ratio and other statistics using cachestat tool. Change-Id: I601cb7e64d234571c0a0fd65a5e32604b3a617ec Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-05-19add support for RAMspeedJingLu51-0/+7
JIRA: YARDSTICK-255 add RAMspeed scenario for measuring memory bandwidth. Change-Id: Iba740d7fdb394d96f32ee824925bbbf8fb689614 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-04-20ubuntu_cloud_img: Allow pwd console accessBilly O'Mahony1-0/+4
Currently if there is a port bind failure it is impossible to access a VM based on Ubuntu server cloud image to debug. This change allows access on the console for user ubuntu by was of a password that is printed to the console during start up; The same way as VMs based on the cirros image do. Change-Id: Iac242ba1f3f14ae77a7b00cf2befd6fa4b65af09 Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com> Reviewed-by: Ana Cunha <ana.cunha@ericsson.com> Reviewed-by: Jorgen Karlsson <jorgen.w.karlsson@ericsson.com> Reviewed-by: Jonas Bjurel <jonas.bjurel@ericsson.com> Reviewed-by: Daniel Smith <daniel.smith@ericsson.com> Reviewed-by: Mark D. Gray <mark.d.gray@intel.com>
2016-02-12Add more debug to image buildJo¶rgen Karlsson1-1/+5
Change-Id: Icfbed0433cb9cfb6f8f479fc69699d08ad49602b Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-02-08yardstick image build cleanupsJo¶rgen Karlsson1-3/+6
- reduce progress verbosity when downloading with wget - added some debug printouts for trouble shooting mount issues Change-Id: Ic608f847b0fe74df231ce3d7d419dcf6c19807ed Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-29Add debug info to solve image build errorsJo¶rgen Karlsson1-1/+5
Add more debug output and clear devmap table in order to solve build problems in YARDSTICK-226. Change-Id: Idfdbb925501c8debb67406f2dd316e1d4bfbaaa8 JIRA: YARDSTICK-226 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2015-12-26add scenario and sample file for Unixbench.kubi1-0/+7
JIRA:YARDSTICK-184 Change-Id: Iedd4a3708e08305b1c8fa7a8e1766ceef03ab8bb Signed-off-by: kubi <jean.gaoliang@huawei.com>
2015-12-10Fix for DNS problems on LF POD2 when building glance imageJo¶rgen Karlsson1-0/+2
Add google DNS servers. Change-Id: If365ff3940a87d64db88482a1354059f75284412 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2015-12-08Add scenario for reading processor loadJo¶rgen Karlsson1-2/+2
This scenario reads processor and system load statistics and does not run any benchmark tests. The scenario is intended to be run in parallell with other scenarios in order to collect processor and system load statistics. System load is read from /proc/loadavg. Processor usage stats is read using the 'mpstat' utility if it has been installed on the host. If 'mpstat' is not installed on the host processor usage stats is read from /proc/stats. Change-Id: I7156e0c941100023571db750de7540786a4fedb8 JIRA: YARDSTICK-181 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2015-11-11Update /etc/hosts in yardstick cloud imageJo¶rgen Karlsson1-0/+5
Adding the hostname to /etc/hosts prevents some 'unable to resolve host' error messages. Change-Id: I1fd16007955287d436e895d53db6ce19b0b6fe3e Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>