summaryrefslogtreecommitdiffstats
path: root/tools
AgeCommit message (Collapse)AuthorFilesLines
2018-06-18Stop running tests from tests/unitEmma Foley2-18/+4
Since all tests have been moved into yardstick/tests, temperary code to run tests in both tests and yardstick/tests should be removed. JIRA: YARDSTICK-837 Change-Id: I3bf3c9ece9bc8457d992e53ee8cc5cadb1dec8f0 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-04-26OpenStack deployment using kollaStepan Andrushko1-1/+25
OpenStack deployment using Kolla installer for all-in-one mode and multinode inside VMs which are already created. Two types of OpenStack nodes are supported as input in sample files, like infra_deploy_two.yaml.sample: controller and compute. JIRA: YARDSTICK-1078 Change-Id: I51616a7a17ac565a01ec6da57b589290237d18ee Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-04-17OpenStack deployment: delete RS or all VMsStepan Andrushko1-2/+2
New parameter is added to shell script to delete data for VMs either from input file or all. Added disk images removal as per new input parameter. JIRA: YARDSTICK-1123 Change-Id: I8d2cee4a3a7ad7147f4d59303bab656d80370221 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-02-09Delete any previous configurationJohn O Loughlin1-1/+1
Delete any previous configuration using the virsh module in ansible: Networks, VMs and local IPs. JIRA: YARDSTICK-950 Change-Id: Ie4963ab8210ce50ba2e9fa22642ec27a3b2031e1 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-01-24Merge "Check RS for virtualized OpenStack/Yardstick"Ross Brattain1-0/+21
2018-01-24Check RS for virtualized OpenStack/YardstickStepan Andrushko1-0/+21
Draft for env requirements reading and validation Script can be run from tools/virt_ci_rampup.sh. First requirement file is parsed/stored. This file must be created in ahead and named as 'infra_deploy.yaml'. Then separate ansible role is used to validate resources. Ansible-role fails if there is not enough resources on the host for cpu, ram, disk space. JIRA: YARDSTICK-945 Change-Id: I86cd4bdc963de3aa51392fc73a239cbd426bc64a Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-01-13Do not hide unit tests execution failRodolfo Alonso Hernandez1-0/+7
While moving tests from ./tests/ to ./yardstick/tests, both unit tests directories are executed. If the first test run fails, do not hide the error and exit immediately. Change-Id: Ib6c64ccf2f4b19722722eb43b3d45d5ad5f0169d Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-11pylint: try to change formatting for Jenkins againRoss Brattain1-1/+1
looks like we have to add var to tox passenv Change-Id: Iba2da2123ae531e026897308769aa832c7eb6d04 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-11Move tests: functional/Emma Foley1-1/+0
All tests in tests/functional have been moved to yardstick/tests/functional JIRA: YARDSTICK-837 Change-Id: I89276b36635de74dd7b8f70e961c71aa0d2c494e Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-11pylint: make Jenkins output parseableRoss Brattain1-2/+7
Jenkins doesn't handle the color and the output is hard to read in Jenkins logs Change-Id: Ie8fc5a78e89f72c829e4bbbcbd1291a723dfde72 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-11Run tests in yardstick/tests/Emma Foley2-17/+20
* Edit .testr.conf and tools/run_tests.sh * Run functional and unit tests in tests/ and yardstick/tests/ * Add yardstick/tests/unit/__init__.py and yardstick/tests/__init__.py * Update pylintrc rules to disable: * missing-docstring * fixme * protected-access Test will run in both tests/ and yardstick/tests/ initially Change-Id: Iccd0df0d1b85b5d08f7faa56669bc32687925f7e JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-17Move test scripts to tools/Emma Foley3-0/+231
Move the scripts that tox uses for running tests to the tools/ directory: * run_tests.sh -> tools/run_tests.sh * tests/ci/cover.{sh,awk} -> tools/ JIRA: YARDSTICK-837 Change-Id: I817c9e5f58c06b45f1de3f369318f4bb24168677 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-17Tox: add a pep8 targetEmma Foley1-0/+59
Adds a pep8, pep8-full targets to tox: * pep8 target: runs pylint on the changed files * pep8-full target: runs pylint on whole repo Adds scripts to run pylint: * stored in tools/ Documentation: changeed the command for running tests (run_tests.sh -> tox). This runs the same set of tests as before. JIRA: YARDSTICK-832 Change-Id: I652da87723682d958f3fcbc2eb4cd88422636a3b Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2017-11-10Check requirements against OpenStack requirementsRodolfo Alonso Hernandez1-0/+111
Added a new tox environment to check the project requirements against the OpenStack requirements. The openstack/requirements branch used will depends on Yardstick release development. At this point, Yardstick F release must be compliant with OpenStack Pike release. Change-Id: I77a4cfa4f99674176c3f5711dc1b6787bb400ecf Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2017-08-15Integrate vsperf in Tgen modeJing Zhang3-0/+250
Problem: Running Vsperf in Tgen mode is supported but the integration is not complete at the code level i.e. not ready-to-use, and dpdk loopback is not supported inside the VM. Solution: (1) Completely automates VM image generation and supports 1G huge pages. (2) Adds a new test scenario VsperfDPDK for testpmd based loopback inside the VM. Update 1-2: Fixed "line too long" issues not reported by local run_tests.sh (why?) Update 3: Per comment change to use SSH.from_node() and add unit test cases Update 4: Add more unit test cases for coverage and ready the code for merge JIRA: YARDSTICK-661 Change-Id: Iea3014d4c83e1b0c079019a4ed27771d40a7eed8 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-08-11Merge "yardstick setup ansible, including load_images"Ross Brattain1-2/+34
2017-08-08yardstick setup ansible, including load_imagesMalanik Jan1-2/+34
also update to cirros 0.3.5 added PROX compilation add create_node_pod_yaml role JIRA: YARDSTICK-639 Change-Id: If5999841287a54c7e5c64a7cc487c6394df90424 Signed-off-by: Malanik Jan <janx.malanik@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-03New storage test case: Bonnie++JingLu51-0/+1
JIRA: YARDSTICK-770 Bonnie++ is a disk and file system benchmarking tool for measuring I/O performance. With Bonnie++ you can quickly and easily produce a meaningful value to represent your current file system performance. This work is add new storage test case using Bonnie++. Change-Id: I752fee156707cda730962c68d17fda4d4e9cd472 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-21aarch64: Fix missing qemu-aarch64-static in chrootPaul Vaduva2-11/+5
During recent rework, we lost the explicit copy of qemu-aarch64-static from docker to chroot; so when trying to execute AArch64 binaries inside chroot, no emulator was present to handle it. This change brings back (inside chroot) the missing emulator binary. JIRA: YARDSTICK-595 Change-Id: I146e2eeec2e9452a0db36f0bf0a466a8affc2005 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2017-03-21Merge "Bugfix: remove vivid as it is EOL"Jing Lu2-57/+3
2017-03-20Bugfix: remove vivid as it is EOLRoss Brattain2-57/+3
Vivid is end of life, and thus not supported. Change-Id: Ia293fcd6fd2a3279a642a6dbbb7ad1811334c3e1 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-20Bugfix: replace MD5SUM with SHA256SUMsRoss Brattain3-18/+18
MD5 is broken and should not be used Change-Id: Ib168932387f58f0a538d865f8ef4e3cda046a35a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-17Bugfix: yardstick-image built without test toolsJingLu51-6/+2
JIRA: YARDSTICK-593 The yardstick-image now built dosen't have test tools in it. This patch aims to fix this issus. Change-Id: I9863a933106236835c16e21f84aa107ffd554df7 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-13Bugfix: fatal: destination path '/opt/tempT' already exists and is not an ↵chenjiankun1-11/+16
empty directory. JIRA: YARDSTICK-588 ubuntu-server-cloudimg-modify.sh: fixes and cleanup https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-virtual-daily-master/1233/console saw this in an error log, not sure if it is a real error + [[ amd64 = \a\r\m\6\4 ]] + git clone https://github.com/kdlucas/byte-unixbench.git /opt/tempT fatal: destination path '/opt/tempT' already exists and is not an empty directory. + error_trap + local rc=128 + set +e + '[' -z '' ']' + exitcode=128 workaround by deletign /opt/tempT always before cloning also improve ln with relative symlink and forcing filename target Change-Id: Ia9c35a877207494623055b1b2134f7834fadedf8 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-13Merge "ubuntu-server-cloudimg-modify.sh: shellcheck fixes"Jing Lu1-1/+1
2017-03-13Merge "Bugfix: ubuntu-server-cloudimg-modify.sh: fix grep syntax with if"Jing Lu1-1/+1
2017-03-09ubuntu-server-cloudimg-modify.sh: shellcheck fixesRoss Brattain1-1/+1
fixes for shellcheck warning ubuntu-server-cloudimg-modify.sh:51:23: warning: Quote this to prevent word splitting. [SC2046] ubuntu-server-cloudimg-modify.sh:51:30: note: Double quote to prevent globbing and word splitting. [SC2086] Change-Id: I6cff0713a0471e5ce94211d42a7c8b45e3761c4d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-09Bugfix: ubuntu-server-cloudimg-modify.sh: fix grep syntax with ifRoss Brattain1-1/+1
https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-virtual-daily-master/1233/console + '[' grep -q trusty /etc/apt/sources.list ']' /ubuntu-server-cloudimg-modify.sh: line 27: [: too many arguments If will check exit status itself, we don't need to use test Change-Id: I3edcf6ef2cbbf888f1089345764a00f9dbd206bd Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-09ubuntu-server-cloudimg-dpdk-modify.sh: fixes and cleanupRoss Brattain1-8/+11
https://build.opnfv.org/ci/view/fuel/job/yardstick-fuel-virtual-daily-master/1233/console saw this in an error log, not sure if it is a real error + [[ amd64 = \a\r\m\6\4 ]] + git clone https://github.com/kdlucas/byte-unixbench.git /opt/tempT fatal: destination path '/opt/tempT' already exists and is not an empty directory. + error_trap + local rc=128 + set +e + '[' -z '' ']' + exitcode=128 workaround by deletign /opt/tempT always before cloning also improve ln with relative symlink and forcing filename target Change-Id: I6715e6dba76b79706d396b616eae980e5ace773b Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-08Merge "Add uefi image support for yardstick"Rex Lee2-37/+50
2017-03-03Add uefi image support for yardstickCatalina Focsa2-37/+50
Add support for downloading and building an uefi single part image. Keep three part image support if needed. Keep modifications required for arm64, when using vivid. Install and use parted required for GPT partitioning. Change-Id: I1a9a20701e2fe1f6f644f2c687c5da2e09b69d89 Signed-off-by: Catalina Focsa <catalina.focsa@enea.com>
2017-02-17Update missing license headersDeepak S2-0/+17
Change-Id: I063fd37fe25754c94d164ae5a209d15b69322093 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-02-13New reliability/availability testcase - IP datagram error rate and etc.JingLu52-0/+6
JIRA: YARDSTICK-534 This test case uses nstat to monitor network metrics provided by the kernel in a host and calculate IP datagram error rate, ICMP message error rate, TCP segment error rate and UDP datagram error rate. Change-Id: I2fe6457bb5c95d0446c1463991ae31cc664b09f8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-12-21restore the yardstick-img-modify cleanup() funcRyan.RCS1-3/+5
There is a result failed again after last update. So i restore the clean() function to its original codes and avoid CI failed. But i'm not sure something about the clean() function, and I will check this failed clearly in future. Change-Id: I8f49533788c7ccb2016e7a484368a72028579fa8 JIRA: YARDSTICK-502 Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-12-21fixed issue in yardstick-img-modify cleanup() funRyan.RCS1-1/+5
1. when run yardstick-img-modify script, sometimes it show below error. + '[' -f /tmp/workspace/yardstick/yardstick-xenial-server.raw ']' + kpartx -dv /tmp/workspace/yardstick/yardstick-xenial-server.raw ioctl: LOOP_CLR_FD: No such device or address del devmap : loop0p1 can't del loop : /dev/loop0 + test 1 -eq 1 -o 1 -eq 2 2. so i added a expression to check if the .raw file map deleted or not 3. if the devmap not deleted, then we delete it, otherwise, we do nothing JIRA: YARDSTICK-502 Change-Id: Ia050121ed6bf837bab05e38f2e9e9628ca31627a Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-12-15Bugfixed:run command: "yardstick-img-modify" fail!Ryan.RCS1-1/+1
Avoid incorrect deletion of $raw_imgfile when the command: "kpartx -dv $raw_imgfile" execute failed. JIRA: YARDSTICK-424 Change-Id: I34dac60bda6c028c4b0f0bfd9ad077e2d5dbb0ff Signed-off-by: Ryan.RCS <lihainong@huawei.com>
2016-11-09Upgrade yardstick VM image from Ubuntu 14.04 to 16.04JingLu52-6/+8
JIRA: YARDSTICK-365 This patch upgrades the base Ubuntu version of Yardstick VM image from trusty(14.04) to xenial(16.04). If you still want to use Ubuntu 14.04 to build Yardstick custom image you can use command: sudo ./tools/yardstick-img-modify tools/ubuntu-server-cloudimg-modify.sh trusty And now the "yardstick-trusty-server" is rename as "yardstick-image". Change-Id: I0765f3aee2d17eea1ad2257d0f576cdb9ef2b18d Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-10-17Bugfix: Add image modify scripts into environment variablesJingLu51-1/+1
JIRA: YARDSTICK-371 JIRA: YARDSTICK-372 This patch fixs two bugs. One is add image modify scripts into environment variables; The other is fixng a format error in ubuntu-server-cloudimg-modify.sh Change-Id: Ie2381400e469ddcbb02f0b0de250274f3bcb0396 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-10-11Provide yardstick-trusty-server.tar.gz for lxd scenarioJingLu51-0/+135
JIRA: YARDSTICK-325 This patch removes ping_lxd_test.yaml and changes vm image used for lxd senarios. In the *-lxd-* scenariois, Cirros LXC 0.3 image will be used for Ping test case. For yardstick generic test, a dedicated yardstick vm image will be used. Change-Id: I5f9e7a92e3e5dded0014baec77085d80cc904b52 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-09-10yardstick: modify e2fsck command to run with -p paramPaul Vaduva1-1/+1
e2fsck command will not run without human intervention if we do not use -p option. Jira issue: ARMBAND-74 Change-Id: Ie7f9b526a568e49ad44c4ee3b4fe75a1065bb1b3 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2016-08-31ARM64: Add support for aarch64 architecturePaul Vaduva2-15/+82
Added support for arm64 architecture so that yardstick framework can be ran on arm-pod1 the armband CI pod. The modifications include testing for presence of arm64 architecture nodes in the pod and running arm64 specific code (building yardstick server image on arm64 version of ubuntu cloud. Openstack doesn't boot 3.13 kernel(arm64) so it was replaced with 3.19 kernel(also arm64), available for vivid cloud image of ubuntu. The Dockerfile for building the ci image was also mofied to add necessary tools for cross-building an arm64 image on amd64 host (the jumpserver) The jira case for this commit is ARMBAND-40. Change-Id: I906d4adbcf2ec2c0f1d695d9916ede42f4151080 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2016-08-09Two modifications for DPDK imagewu.zhihui2-2/+5
1. workaround for creating snapshot 2. modify the parameters of Hugepage in vm JIRA:YARDSTICK-233 Change-Id: I9cea76ed30dabe4fe2cb644e58ed0acd7dd8ecde Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-08-04[Yardstick-233]DPDK image for TC042wu.zhihui4-0/+423
These file is based on Akos's code. (https://gerrit.opnfv.org/gerrit/#/c/16095/) The different places: 1. create flavor and import yardstick_key.pub with heat template. 2. remove handle code about eth0 in user_data. 3. update heat cli and delete step "nova stop" which is not necessary. 4. clean the stack in final. 5. add eth2 for vm. JIRA: YARDSTICK-233 Change-Id: I04f2051fb4bcfeed2df4868d758fd92011c62233 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-06-06ubuntu-server-cloudimg-modify: adjust install location of RAMspeedJingLu51-3/+2
Unify tool install location Change-Id: I45fc76a0631187136a2602d1a9c26f3df94ce9dd Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-06-03Merge "ubuntu-server-cloudimg-modify: fix location of #! shell line"liang gao1-2/+1
2016-06-01ubuntu-server-cloudimg-modify: fix location of #! shell lineBilly O'Mahony1-2/+1
The #!/bin/bash was not on the first line of the script so the script was run as sh not bash. This meant some obvious things like ${VAR} do not work. Change-Id: Ieac3e4aca8e7f34ac7985cca5b6ef12e7705f202 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Szilard Cserey <szilard.cserey@gmail.com> Reviewed-by: Liang Gao <jean.gaoliang@huawei.com>
2016-06-01Add cachestat scenarioJingLu51-0/+2
JIRA: YARDSTICK-267 This scenario reads system cache hit/miss ratio and other statistics using cachestat tool. Change-Id: I601cb7e64d234571c0a0fd65a5e32604b3a617ec Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-05-19add support for RAMspeedJingLu51-0/+7
JIRA: YARDSTICK-255 add RAMspeed scenario for measuring memory bandwidth. Change-Id: Iba740d7fdb394d96f32ee824925bbbf8fb689614 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-04-20ubuntu_cloud_img: Allow pwd console accessBilly O'Mahony1-0/+4
Currently if there is a port bind failure it is impossible to access a VM based on Ubuntu server cloud image to debug. This change allows access on the console for user ubuntu by was of a password that is printed to the console during start up; The same way as VMs based on the cirros image do. Change-Id: Iac242ba1f3f14ae77a7b00cf2befd6fa4b65af09 Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com> Reviewed-by: Ana Cunha <ana.cunha@ericsson.com> Reviewed-by: Jorgen Karlsson <jorgen.w.karlsson@ericsson.com> Reviewed-by: Jonas Bjurel <jonas.bjurel@ericsson.com> Reviewed-by: Daniel Smith <daniel.smith@ericsson.com> Reviewed-by: Mark D. Gray <mark.d.gray@intel.com>
2016-02-12Add more debug to image buildJo¶rgen Karlsson1-1/+5
Change-Id: Icfbed0433cb9cfb6f8f479fc69699d08ad49602b Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>