summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-04-11Add a new runner to test end-to-end fast data pathJing Zhang1-0/+8
This runner caters testing fast host data path (e.g. SRIOV) plus fast VM data path (VM running pktgen-dpdk). It is implemented as a new flavor of the existing Iteration runner. (1) Add a new SLA action rate-control (2) While the SLA target is not met, reduce packet rate until packet loss target is met. Change-Id: I633f391f1790f03ff31458458d79d3f272475ab5 JIRA: YARDSTICK-615 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-03-28Merge "Bugfix: Error validating value 'cirros-0.3.5'"Jing Lu1-21/+25
2017-03-28Merge "Bugfix:add storperf flavor for TC074"Jing Lu4-6/+18
2017-03-28Bugfix: Error validating value 'cirros-0.3.5'JingLu51-21/+25
JIRA: YARDSTICK-607 some scenarios come with a Cirros-0.3.5 image, Yardstick's load_images.sh will load a second cirros-0.3.5 image, causing the following error: 2017-03-27 07:42:58,317 yardstick.orchestrator.heat heat.py:449 INFO Creating stack 'demo-2ada98f3' error: failed to deploy stack: 'ERROR: Property error: : resources.ares.demo-2ada98f3.properties.image: : Error validating value 'cirros-0.3.5': No images unique match found for {'name': u'cirros-0.3.5'} This patch fixs this error by skipping load cirros image if there already exist one in the glance. Change-Id: I4d43d82d331f6575efd4560be9b6be175e03cd1b Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-27Merge "pathspec 'master' did not match any file(s) known to git"Jing Lu1-2/+1
2017-03-27Merge "model: pylint fixes"Rex Lee2-3/+3
2017-03-27pathspec 'master' did not match any file(s) known to gitchenjiankun1-2/+1
JIRA: YARDSTICK-605 On stable branch, exec_tests.sh will also try to git checkout master branch, which cause error "pathspec 'master' did not match any file(s) known to git." This is a remianing bug from the previous release. see at: https://build.opnfv.org/ci/view/yardstick/job/yardstick-apex-lf-pod1-daily-danube/62/console This error occur in line 48. But the reason is 'set -e' If we set 'set -e': 'git checkout master && git pull' return 1 but it will go on executing; but 'git checkout master' will return 1 and terminate immediately. If we do not set, it will return 1 but will terminate immediately. Actually we not need 'git checkout master' here because it is already in stable/danube branch. So I remove it. Change-Id: I106a1da28cf2deee90ebcb25adaf638a210928ee Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-27Merge "Bugfix:HA test cases rely on dynamic ip addresses in fuel pods"Jing Lu10-10/+30
2017-03-25Bugfix:HA test cases rely on dynamic ip addresses in fuel podsJingLu510-10/+30
JIRA: YARDSTICK-602 change HA test cases to rely on dynamical generated pod.yaml in fuel pods Change-Id: I0efb01489eb2dd94babf1a45bff2fbf6adef5f6e Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-25Bugfix:add storperf flavor for TC074JingLu54-6/+18
JIRA: YARDSTICK-604 the storperf container now uses a flavor called "storperf", if this flavor is absent, stack creating process will fail. also the openstack variables that passed to the storperf container also needs a update Change-Id: Iab4be6491cc9b24526948e5571f0476ec885a93d Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-24Update cirros image to latest versionMichael Polenchuk19-24/+24
Change-Id: Iffa1e4529e5b6e9664ac503a5815ea9a034d7515 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-03-23model: pylint fixesRoss Brattain2-3/+3
remove redundnant parens replace type with isinstance fix import order Change-Id: I0407cbbf6993290f392f17c398827603b5bc1ebd Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-23Merge "Update yardstick framework architecture in userguide"Jing Lu13-141/+300
2017-03-23Merge "Bugfix: Could not load EntryPoint.parse when using 'openstack -h'"Jing Lu1-10/+10
2017-03-23Bugfix: TC002 image error in fuel-arm pod scenariosJingLu51-2/+2
JIRA: YARDSTICK-601 This error is cause because the TC 002 configuration file has been modified in image section, the old sed command in load_images.sh "sed -i 's/image: cirros-0.3.3/image: TestVM/g' tests/opnfv/test_cases/opnfv_yardstick_tc002.yaml samples/ping.yaml" didn't work properly. Change-Id: Ie897213622d05bb267f94b466eb2529e797d484e Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-22Merge "Yardstick: User interface for Yardstick."Jing Lu10-1/+405
2017-03-22Merge "aarch64: Improve arch detection snippet"Jing Lu1-7/+8
2017-03-22Merge "aarch64: Fix missing qemu-aarch64-static in chroot"Jing Lu2-11/+5
2017-03-22Merge "Refine test case description for tc076"Jing Lu1-10/+53
2017-03-22Update yardstick framework architecture in userguideJingLu513-141/+300
JIRA: YARDSTICK-590 This patch update the yardstick framework architecture in the userguide, also fix some rst grammar mistakes Change-Id: I84e7c24b4cd936a01f4c191e9f530f15f9f711de Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-21aarch64: Fix missing qemu-aarch64-static in chrootPaul Vaduva2-11/+5
During recent rework, we lost the explicit copy of qemu-aarch64-static from docker to chroot; so when trying to execute AArch64 binaries inside chroot, no emulator was present to handle it. This change brings back (inside chroot) the missing emulator binary. JIRA: YARDSTICK-595 Change-Id: I146e2eeec2e9452a0db36f0bf0a466a8affc2005 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2017-03-21Bugfix: Could not load EntryPoint.parse when using 'openstack -h'JingLu51-10/+10
JIRA: YARDSTICK-599 Python-openstackclient 3.7.0 has a issus that cause -help info can not be loaded properly when executing 'openstack -h' command. Change-Id: I0a5f7a0943d56764b1c4d5d7335aa67b30f39b4c Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-21Merge "yardstick offline support"Jing Lu1-2/+2
2017-03-21Merge "Dockerfile: Use qemu-user-static from xenial "Kubi1-1/+3
2017-03-21Merge "update lxd image disk format for openstack CLI"Jing Lu1-1/+1
2017-03-21Merge "Bugfix: remove vivid as it is EOL"Jing Lu3-58/+4
2017-03-21Merge "Bugfix: replace MD5SUM with SHA256SUMs"Jing Lu3-18/+18
2017-03-21Merge "Bugfix: netperf_bottleneck execute failed because ↵Jing Lu1-1/+0
is_same_heat_context return True"
2017-03-21Merge "add missing test suite files for new scenarios"Jing Lu2-0/+76
2017-03-20aarch64: Improve arch detection snippetMatei Valeanu1-7/+8
Get the arch from a compute node Also move code that depends on YARD_IMG_ARCH, after YARD_IMG_ARCH gets set JIRA: YARDSTICK-591 Change-Id: I5ed3ef9cfa92e5bf9e6ada21396d18643cf1a55c Signed-off-by: Matei Valeanu <Matei.Valeanu@enea.com>
2017-03-20Bugfix: netperf_bottleneck execute failed because is_same_heat_context ↵chenjiankun1-1/+0
return True JIRA: YARDSTICK-600 Bugfix: netperf_bottleneck execute failed because is_same_heat_context return True So it exit without warning. I will remove the 'return True' from it. Change-Id: I48d62bd15ec359e2121f236c48d9d349174f2c10 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-20Merge "Add NUMA pinning support for node context"Jing Lu4-0/+160
2017-03-20Merge "Add CPU pinning support for node context"Jing Lu16-20/+309
2017-03-20Bugfix: remove vivid as it is EOLRoss Brattain3-58/+4
Vivid is end of life, and thus not supported. Change-Id: Ia293fcd6fd2a3279a642a6dbbb7ad1811334c3e1 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-20Bugfix: replace MD5SUM with SHA256SUMsRoss Brattain3-18/+18
MD5 is broken and should not be used Change-Id: Ib168932387f58f0a538d865f8ef4e3cda046a35a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-03-20update lxd image disk format for openstack CLIJingLu51-1/+1
JIRA: YARDSTICK-598 As we have replaced 'glance image-create' command with 'openstack image create' command, we also need to update the disk-format for openstack CLI. the 'root-tar' is no longer a valid choice. (choose from 'ami', 'ari', 'aki', 'vhd', 'vmdk', 'raw', 'qcow2', 'vhdx', 'vdi', 'iso', 'ploop') Change-Id: I53f839f658c5a6f216f5bb942b1c4f4dcdbf9814 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-20yardstick offline supportchenjiankun1-2/+2
JIRA: YARDSTICK-597 Currently yardstick can not run offline. The reason is yardstick will pull the latest code when run in CI. Actually we need not pull the latest code because the code in yardstick is already the latest code. So I remove them. Change-Id: Ief87c529625ccaa26e758a2206318b3797bbfd74 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-20add missing test suite files for new scenariosJingLu52-0/+76
JIRA: YARDSTICK-589 Change-Id: I1690d4e2bd741fe1514c8496ee6ff10b72158859 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-20Merge "Bugfix: load_images cleanup, shellcheck fixes"Kubi1-26/+28
2017-03-18Merge "add missing test suite files for new scenarios"Jing Lu2-0/+178
2017-03-17Dockerfile: Use qemu-user-static from xenial Paul Vaduva1-1/+3
qemu-user-static from Trusty crashes when ssl is used in chroot. JIRA: YARDSTICK-592 Change-Id: I81e8f04d7469082ceb6512cb09e11dfa672e5e98 Signed-off-by: Paul Vaduva <Paul.Vaduva@enea.com>
2017-03-17Merge "Bugfix: yardstick-image built without test tools"Jing Lu1-6/+2
2017-03-17Yardstick: User interface for Yardstick.rajesh_4k10-1/+405
Currently Yardstick doesnt have any UI which gives detail analysis of the test-results. This commit generates a HTML page after the execution of a command "yardstick report generate <task-ID> <TC-name>" which intern can be executed after the execution of test-case. Used: Highcharts.js for the graphs. JIRA: YARDSTICK-280 Change-Id: Ic98cc348719f3922bff178f52e7944a4a931763a Signed-off-by: Rajesh K <4k.rajesh@gmail.com>
2017-03-17Merge "Bugfix: network_utilization: parse error"Kubi1-15/+14
2017-03-17Merge "Bug Fix: force the network to attacht to trex to start the traffic"Kubi2-1/+4
2017-03-17Merge "Adding Labels"Kubi4-0/+8
2017-03-17add missing test suite files for new scenariosJingLu52-0/+178
JIRA: YARDSTICK-589 Some new scenarios, e.g, opnfv_k8-nosdn-nofeature-noha_daily, have been added in the Danube release, test suite files for these scenarios should be added. Change-Id: If3f4ef233b7b1516e182ed28f15feece1728e6d9 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-17Refine test case description for tc076JingLu51-10/+53
JIRA: YARDSTICK-594 Change-Id: Ieaf13a875d00c279d4da57dcdba5bcfb09f44e8f Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-17Bugfix: yardstick-image built without test toolsJingLu51-6/+2
JIRA: YARDSTICK-593 The yardstick-image now built dosen't have test tools in it. This patch aims to fix this issus. Change-Id: I9863a933106236835c16e21f84aa107ffd554df7 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-15fix fuel plugin installation issueGuo Ruijing1-2/+1
Change-Id: Ie17ba0ac941d1b96148ee23ed9522a93309f56c5 Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>