aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-03-20Add "YARDSTICK_REPO_DIR" into tests pathting wu1-1/+1
In the CI flow, script "load_images.sh", variable ${YARDSTICK_REPO_DIR} needs to be added in front of tests path to avoid the error: sed: can't read tests/opnfv/test_cases/*: No such file or directory This fix is specific to arm64 JIRA: YARDSTICK-1086 Change-Id: If19b295233bb7313226dae70df016ad236bed2ac Signed-off-by: ting wu <ting.wu@enea.com>
2018-03-20Merge "update scenario test cases according to gating release"Emma Foley1-67/+75
2018-03-20Merge "Bugfix: sutie -> suite in documentation"Emma Foley1-1/+1
2018-03-20Dashboard for TC056Mika Rautakumpu1-0/+301
This is dashboard for Yardstick test case TC056. JIRA: YARDSTICK-1085 Change-Id: I8bf2149f8dd9081022deb280101815cb1dd417ec Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-03-20Running Test Case in Latest Yardstick Docker Image shows Errorchenjiankun1-3/+13
JIRA: YARDSTICK-1080 This bug will only occur in kubernetes test case. In openstack, we use 'stack_name.context', but some kubernetes resources(pod, etc) do not support this format. So we use 'name-context'. Change-Id: I87d61c027d55449914bc283672eb98be3d3fe22f Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-20update scenario test cases according to gating releaserexlee87761-67/+75
JIRA: YARDSTICK-1046 Change-Id: I12223876d1cf1f3e45152f6b7996b75a66b16fe6 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-19yardstick image: use growpart instead of partedRoss Brattain1-1/+7
parted doesn't handle growing GPT partition correctly, so switch to growpart see https://github.com/opnfv/fuel/blob/master/mcp/scripts/lib.sh#L133 for example If the yardstick image uses GPT then parted complains about the GPT table The warning is "Warning: Not all of the space available to DEVICE appears to be used, you can fix the GPT to use all of the space (an extra 500 blocks) or continue with the current setting?" The backup GPT table is not at the end of the disk, as it should be. This might mean that another operating system believes the disk is smaller. Fix, by moving the backup to the end (and removing the old backup)? echo 'f' to fix the GPT table Instead use growpart JIRA: YARDSTICK-1058 Change-Id: Ib0e90feef1e3766408b4f742036f2a48af942f32 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-19Bugfix: sutie -> suite in documentationchenjiankun1-1/+1
Change-Id: Ia898a7a6d95e74b16cfc754b615cccfd9c5380ad Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-19Bugfix: storperf fails on ci when install pluginrexlee87761-2/+2
JIRA: YARDSTICK-1060 Change-Id: I6356bf16c547a1bd15f83f3ff6390822b7980f28 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-19temp unblock unittestsRoss Brattain1-88/+0
====================================================================== ERROR: common.test_packages (unittest.loader._FailedTest) ---------------------------------------------------------------------- ImportError: Failed to import test module: common.test_packages Traceback (most recent call last): File "/usr/lib/python3.5/unittest/loader.py", line 428, in _find_test_path module = self._get_module_from_name(name) File "/usr/lib/python3.5/unittest/loader.py", line 369, in _get_module_from_name __import__(name) File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 17, in <module> from pip.operations import freeze File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/__init__.py", line 45, in <module> from pip.vcs import git, mercurial, subversion, bazaar # noqa File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/vcs/mercurial.py", line 9, in <module> from pip.download import path_to_url File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/download.py", line 40, in <module> from pip._vendor import requests, six File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/__init__.py", line 98, in <module> from . import packages File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/packages.py", line 12, in <module> sys.modules['pip._vendor.requests.packages.' + mod] = sys.modules["pip._vendor." + mod] KeyError: 'pip._vendor.urllib3.contrib' File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 16, in <module> from pip import exceptions as pip_exceptions ====================================================================== ERROR: common.test_packages (unittest.loader._FailedTest) ---------------------------------------------------------------------- ImportError: Failed to import test module: common.test_packages Traceback (most recent call last): File "/usr/lib/python3.5/unittest/loader.py", line 428, in _find_test_path module = self._get_module_from_name(name) File "/usr/lib/python3.5/unittest/loader.py", line 369, in _get_module_from_name __import__(name) File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 16, in <module> from pip import exceptions as pip_exceptions File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/__init__.py", line 45, in <module> from pip.vcs import git, mercurial, subversion, bazaar # noqa File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/vcs/mercurial.py", line 9, in <module> from pip.download import path_to_url File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/download.py", line 40, in <module> from pip._vendor import requests, six File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/__init__.py", line 98, in <module> from . import packages File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/packages.py", line 12, in <module> sys.modules['pip._vendor.requests.packages.' + mod] = sys.modules["pip._vendor." + mod] KeyError: 'pip._vendor.urllib3.packages.backports.makefile' Change-Id: I43b1edc23cebe0db97b6b56a551acd376986dfea Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-16Merge "Add ODL noHA testcase"Ross Brattain2-0/+285
2018-03-16Merge "Improve ansible code for network xml creation"Rodolfo Alonso Hernandez1-42/+7
2018-03-16Merge "NSB userguide: run TC in heat context & sriov ports"Rodolfo Alonso Hernandez5-4/+486
2018-03-16Merge "NSB PROX L3FWD Dropping packets"Abhijit Sinha11-97/+221
2018-03-16Merge "Replace assert statements in tests"Abhijit Sinha3-21/+21
2018-03-16NSB userguide: run TC in heat context & sriov portsMytnyk, Volodymyr5-4/+486
Add section that describeds steps to be able to run sample vFW TC in heat context with sriov ports confiured in the OpenStack. JIRA: YARDSTICK-1022 Change-Id: I764933e26ca7cb10aa1094901ec3304156054333 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-03-16Merge "Supporting user config task parameters in GUI"Jack Chan7-29/+143
2018-03-16Merge "Update API documentation"Jack Chan1-71/+156
2018-03-16Merge "Add SUT page in GUI"Jack Chan9-2/+125
2018-03-16Merge "Create API to get SUT information"Jack Chan7-1/+205
2018-03-16Merge "testcase start service script fail on centos env"Jing Lu10-19/+72
2018-03-16Add SUT page in GUIchenjiankun9-2/+125
JIRA: YARDSTICK-1076 We need to show SUT information in GUI. Change-Id: I885773894fc9f6aa5975b39383af1fdf1b88b8bb Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-16Test case description and configuration file for yardstick_tc090:Controltjuyinkanglin2-0/+229
Node Openstack Service High Availability - Database Instances JIRA: YARDSTICK-960 Change-Id: Ibe47a9b4d1f095971857fcbaee57a3c7f64f9911 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2018-03-16Test case description and configuration file for yardstick_tc091:Controltjuyinkanglin2-0/+197
Node Openstack Service High Availability - Heat Api JIRA: YARDSTICK-961 Change-Id: I49fc2b2d8fc4fa090a74f1838f5ac386e39eaf49 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2018-03-15NSB PROX L3FWD Dropping packetsDanielMartinBuckley11-97/+221
JIRA: YARDSTICK-1037 NSB PROX L3FWD was incorrect. The routing table (ipv4.lua) was incorrect. Also a specific ipv4 for 2 port configuration is required. Change-Id: I3a5fd1ea1d1ddf74cbdd6a5d9e7ced42d3c1d6e9 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-03-15Merge "support for Bottlenecks soak throughputs"Jing Lu2-1/+74
2018-03-15Create API to get SUT informationchenjiankun7-1/+205
JIRA: YARDSTICK-1072 We need to show SUT information in GUI. Change-Id: I40bcd513f3c6a443c82764687637ac5258b99584 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-15Update API documentationchenjiankun1-71/+156
JIRA: YARDSTICK-1070 Our current API documentation is out-of-date. We need to update it. Change-Id: If5133c0350a91affb8d3f856d23b23a9903c8620 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-15support for Bottlenecks soak throughputsYang Yu2-1/+74
JIRA: YARDSTICK-1049 Changes: 1. NetperfNode -> Netperf, it seems that yardstick-image has not correctly complied Netperf since cpuutil is not available, resulting that LOCAL_CPU_UTIL=-1 for the output. Will create another JIRA ticket for this. Change-Id: I26a85f4aafcc5d5e1eda3e04272ecf3b059238fc Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2018-03-14Merge "Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml""Rex Lee1-0/+1
2018-03-14Fix retrieving "options" section in "scenario"Rodolfo Alonso Hernandez2-2/+32
In [1] a new method to rename the "scenario" host names was implemented. This method parses all sections with host names and applies the "qualified" name. Some malformed test cases define the "options" section without content. This causes that [2] retrieves "None" value instead of an empty dictionary. This possibility must be handled in the new method. [1]I44da30dac562c1a4166e084645ae91c17798651d [2]https://github.com/opnfv/yardstick/blob/4b8b674b65830a24230faed71e8d9a1048139c89/yardstick/benchmark/core/task.py#L630 JIRA: YARDSTICK-1073 Change-Id: I8864b428734ead8c5aa39de5091d3a2a691be060 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-14Improve ansible code for network xml creationJohn O Loughlin1-42/+7
JIRA: YARDSTICK-1018 Change-Id: Ia94fb1ceb9cb55bd54e512f356f85a263c32d1cf Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-03-14Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml"Rodolfo Alonso Hernandez1-0/+1
"YARD_IMG_ARCH" variable is added as input parameter to "build_yardstick_image.yml" ansible script, in order to generate the correct image for the running architecture. JIRA: YARDSTICK-1058 Change-Id: I33954c236695478eaae34fcfca2e9d5b40791bbf Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-14Merge "Get SUT information"Jack Chan2-0/+69
2018-03-13Test case spec for SDN controller resilience in non-HA configGeorg Kunz2-0/+183
This is the test case specification for verifying the HA capabilities of a SDN controller running in a non-HA configuration. JIRA: HA-31 JIRA: YARDSTICK-955 Change-Id: I10f9ce4a2888092c033d2c02bf9a5a950b8b12dc Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-03-13Merge "Add support for VNC to VMs created by ansible"Ross Brattain1-0/+14
2018-03-13Merge "[Bug Fix] Support nova create instance operation"Ross Brattain2-0/+50
2018-03-12Modify the Docker diff file for ARM64Rodolfo Alonso Hernandez1-1/+1
In I5d9e135449b2d35f051ecf5fa63a1ce11030de4a the Dockerfile was modified. Until we can handle the Dockerfile generation for each architecture in a better way, we need to keep updated the Docker diff file for ARM64. JIRA: YARDSTICK-1030 Change-Id: Ibd9224dcb9a7a897b0da8aab126f62983b5e70bd Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-12Merge changes from topics 'delete_router', 'neutron_subnet_create', ↵Emma Foley9-117/+359
'neutron_create' * changes: Replace neutron router deletion with shade. Replace neutron subnet creation with shade. Replace neutron network creation with shade.
2018-03-12Merge "Add context name to Dummy test"Abhijit Sinha1-0/+1
2018-03-12Merge "Reduce the log level if TRex client is no connected"Emma Foley1-1/+1
2018-03-12Replace neutron router deletion with shade.Shobhi Jain5-30/+88
Function delete_neutron_router now uses shade client instead of neutron client. JIRA: YARDSTICK-890 Change-Id: I5b557b640396f343b85b5f5eff415384decc083c Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
2018-03-12Replace neutron subnet creation with shade.Shobhi Jain5-46/+157
Function 'create_neutron_subnet' now uses shade client instead of neutron client. JIRA: YARDSTICK-890 Change-Id: I8eb5295cecd73742bfb5a7d0764af6f45ef0685e Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
2018-03-12Replace neutron network creation with shade.Shobhi Jain5-41/+114
Function create_neutron_net now uses shade client instead of neutron client. JIRA: YARDSTICK-890 Change-Id: I456078e98550901c1f736640c9f9bd0d5f9c3df6 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
2018-03-12Add support for VNC to VMs created by ansibleJohn O Loughlin1-0/+14
JIRA: YARDSTICK-1017 Change-Id: I76ca53c12a6791ecbf7f546f9074b16c5f6d215a Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-03-12Merge "assertTrue(mock.called) -> mock.assert_called"Rodolfo Alonso Hernandez33-92/+92
2018-03-12Merge "Update the fuel pod.yaml"Ross Brattain2-1/+22
2018-03-12Merge changes from topic 'YARDSTICK-1040'Ross Brattain4-0/+83
* changes: Fetch Nova instance's private IP Assign nova instance to security group
2018-03-12Get SUT informationchenjiankun2-0/+69
JIRA: YARDSTICK-1063 We have the demand to get SUT information. In this patch, we use ansible to get the SUT information. Change-Id: I983675d6d367fa528f00c1b50bc6fa2a9cee03f7 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-09Do NOT hardcode interface speed for PROX testsDanielMartinBuckley10-42/+75
JIRA: YARDSTICK-1035 Do not hardcode NIC/interface speed in PROX test. Test assumes NIC used is 10Gbps. This is incorrect. It could support 1Gbps, 10Gbps, 25Gbps, 40Gbps or something else. This is used to calculate pps (Packets Per Second) In Baremetal the NIC speed could be extracted. however when run on a virtual machine this is not possible. Solution: Add in options section of test file. eg. Options: interface_speed_gbps: 10 Where 10 refers to a 10Gbps. In a setup where multiple interfaces are used. This will refer to the speed of the slowest connection. Change-Id: I89ab16479a2cdd1d79e52cbcc5a972762c60d057 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>