aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-03-21Install RabitMQ for RPC messaging between processesRodolfo Alonso Hernandez3-3/+9
In NetworkServices Tescases, the TGs (traffic generators) run the traffic in a separate process. In order to synchronize the traffic injection and the runner interval loops, an RPC server is needed to publish/subscribe events. RabbitMQ is a well supported MQ in Linux (used in OpenStack or collectd) and supported by Python implemented projects like oslo.messaging [1]. RabbitMQ default configuration: - Port: 5672 - User/password: yardstick/yardstick [1]https://github.com/openstack/oslo.messaging JIRA: YARDSTICK-1068 Change-Id: I15db294ee430fb38e574a59b9ce1bf0f8b651a67 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-21Add "Scenario" class wait methods for runnersRodolfo Alonso Hernandez5-4/+51
"Duration" and "Iteration" runners execute a passive wait during the execution of the work process. This wait time is done at the end of the scenario "run" method execution. This patch adds a pre-run and post-run wait period, which will depends on the Scenario executed. The wait time will be always the same, but the execution order (pre-wait time, run method, post-wait time) will depends on the Scenario. By default, any Scenario will execute the "run" method and them will wait the specified time. NetworkServicesTestCase Scenario will wait the specified time and them will execute the "run" method to retrieve the KPIs. JIRA: YARDSTICK-1067 Change-Id: I6ad6bfc6978815b6b2d4df63f2ac2f8815fb5b8a Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-21Make "Scenario" class abstractRodolfo Alonso Hernandez2-8/+18
All scenario child classes must implement "run" method. JIRA: YARDSTICK-1065 Change-Id: I35b78e380620967b49cd8cd23777a1aee6dfd140 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-21Merge "Offline support for bottlenecks project"Rex Lee3-6/+144
2018-03-21Merge "Enforce pip version during installation"Rex Lee2-2/+2
2018-03-21Merge "Replace neutron router creation with shade."Rex Lee5-44/+115
2018-03-21Offline support for bottlenecks projectliyin3-6/+144
JIRA: YARDSTICK-1053 Those three yaml files are for bottlenecks support offiline flavor The ssh time out problem will fix in changing the duration time Change-Id: Ifd317404a820d0446ffab5070211e48def1a0d2f Signed-off-by: liyin <liyin11@huawei.com>
2018-03-21Bugfix: update test case base on node parameters in cirexlee877644-125/+125
JIRA: YARDSTICK-1082 Change-Id: I00080d0317a54b73a6cd571198e9446962c11b5a Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-21Merge "Fix for datasource field value"Rex Lee9-35/+35
2018-03-20Merge "Fix retrieving "options" section in "scenario""Ross Brattain2-2/+32
2018-03-20Merge "Add "YARDSTICK_REPO_DIR" into tests path"Ross Brattain1-1/+1
2018-03-20Merge "Modify the Docker diff file for ARM64"Ross Brattain1-1/+1
2018-03-20Fix for datasource field valueMika Rautakumpu9-35/+35
This is fix for grafana dashboard templates where variable "${DS_YARDSTICK}" is replaced by "yardstick". JIRA: YARDSTICK-1089 Change-Id: I0647d5bfd772a2d9ffa18bac59cdbbb39c8ec0ab Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-03-20Replace neutron router creation with shade.Shobhi Jain5-44/+115
Function create_neutron_router now uses shade client instead of neutron client. JIRA: YARDSTICK-890 Change-Id: I819d26f4edb3af5e50f777e8ddbadf4d24820b7f Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
2018-03-20Enforce pip version during installationRodolfo Alonso Hernandez2-2/+2
Currently there is a reported problem in pip library [1]. To avoid this problem, the pip version should be enforced during the installation. [1]https://github.com/pypa/pip/issues/5079 JIRA: YARDSTICK-1087 Change-Id: I2ee28749f146cd3b0e1bf4ed92b51cbe6db8b2f3 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-20Add "YARDSTICK_REPO_DIR" into tests pathting wu1-1/+1
In the CI flow, script "load_images.sh", variable ${YARDSTICK_REPO_DIR} needs to be added in front of tests path to avoid the error: sed: can't read tests/opnfv/test_cases/*: No such file or directory This fix is specific to arm64 JIRA: YARDSTICK-1086 Change-Id: If19b295233bb7313226dae70df016ad236bed2ac Signed-off-by: ting wu <ting.wu@enea.com>
2018-03-20Merge "update scenario test cases according to gating release"Emma Foley1-67/+75
2018-03-20Merge "Bugfix: sutie -> suite in documentation"Emma Foley1-1/+1
2018-03-20update scenario test cases according to gating releaserexlee87761-67/+75
JIRA: YARDSTICK-1046 Change-Id: I12223876d1cf1f3e45152f6b7996b75a66b16fe6 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-19yardstick image: use growpart instead of partedRoss Brattain1-1/+7
parted doesn't handle growing GPT partition correctly, so switch to growpart see https://github.com/opnfv/fuel/blob/master/mcp/scripts/lib.sh#L133 for example If the yardstick image uses GPT then parted complains about the GPT table The warning is "Warning: Not all of the space available to DEVICE appears to be used, you can fix the GPT to use all of the space (an extra 500 blocks) or continue with the current setting?" The backup GPT table is not at the end of the disk, as it should be. This might mean that another operating system believes the disk is smaller. Fix, by moving the backup to the end (and removing the old backup)? echo 'f' to fix the GPT table Instead use growpart JIRA: YARDSTICK-1058 Change-Id: Ib0e90feef1e3766408b4f742036f2a48af942f32 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-19Bugfix: sutie -> suite in documentationchenjiankun1-1/+1
Change-Id: Ia898a7a6d95e74b16cfc754b615cccfd9c5380ad Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-19Bugfix: storperf fails on ci when install pluginrexlee87761-2/+2
JIRA: YARDSTICK-1060 Change-Id: I6356bf16c547a1bd15f83f3ff6390822b7980f28 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-03-19temp unblock unittestsRoss Brattain1-88/+0
====================================================================== ERROR: common.test_packages (unittest.loader._FailedTest) ---------------------------------------------------------------------- ImportError: Failed to import test module: common.test_packages Traceback (most recent call last): File "/usr/lib/python3.5/unittest/loader.py", line 428, in _find_test_path module = self._get_module_from_name(name) File "/usr/lib/python3.5/unittest/loader.py", line 369, in _get_module_from_name __import__(name) File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 17, in <module> from pip.operations import freeze File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/__init__.py", line 45, in <module> from pip.vcs import git, mercurial, subversion, bazaar # noqa File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/vcs/mercurial.py", line 9, in <module> from pip.download import path_to_url File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/download.py", line 40, in <module> from pip._vendor import requests, six File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/__init__.py", line 98, in <module> from . import packages File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/packages.py", line 12, in <module> sys.modules['pip._vendor.requests.packages.' + mod] = sys.modules["pip._vendor." + mod] KeyError: 'pip._vendor.urllib3.contrib' File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 16, in <module> from pip import exceptions as pip_exceptions ====================================================================== ERROR: common.test_packages (unittest.loader._FailedTest) ---------------------------------------------------------------------- ImportError: Failed to import test module: common.test_packages Traceback (most recent call last): File "/usr/lib/python3.5/unittest/loader.py", line 428, in _find_test_path module = self._get_module_from_name(name) File "/usr/lib/python3.5/unittest/loader.py", line 369, in _get_module_from_name __import__(name) File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/yardstick/tests/unit/common/test_packages.py", line 16, in <module> from pip import exceptions as pip_exceptions File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/__init__.py", line 45, in <module> from pip.vcs import git, mercurial, subversion, bazaar # noqa File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/vcs/mercurial.py", line 9, in <module> from pip.download import path_to_url File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/download.py", line 40, in <module> from pip._vendor import requests, six File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/__init__.py", line 98, in <module> from . import packages File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/.tox/py3/lib/python3.5/site-packages/pip/_vendor/requests/packages.py", line 12, in <module> sys.modules['pip._vendor.requests.packages.' + mod] = sys.modules["pip._vendor." + mod] KeyError: 'pip._vendor.urllib3.packages.backports.makefile' Change-Id: I43b1edc23cebe0db97b6b56a551acd376986dfea Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-03-16Merge "Add ODL noHA testcase"Ross Brattain2-0/+285
2018-03-16Merge "Improve ansible code for network xml creation"Rodolfo Alonso Hernandez1-42/+7
2018-03-16Merge "NSB userguide: run TC in heat context & sriov ports"Rodolfo Alonso Hernandez5-4/+486
2018-03-16Merge "NSB PROX L3FWD Dropping packets"Abhijit Sinha11-97/+221
2018-03-16Merge "Replace assert statements in tests"Abhijit Sinha3-21/+21
2018-03-16NSB userguide: run TC in heat context & sriov portsMytnyk, Volodymyr5-4/+486
Add section that describeds steps to be able to run sample vFW TC in heat context with sriov ports confiured in the OpenStack. JIRA: YARDSTICK-1022 Change-Id: I764933e26ca7cb10aa1094901ec3304156054333 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-03-16Merge "Supporting user config task parameters in GUI"Jack Chan7-29/+143
2018-03-16Merge "Update API documentation"Jack Chan1-71/+156
2018-03-16Merge "Add SUT page in GUI"Jack Chan9-2/+125
2018-03-16Merge "Create API to get SUT information"Jack Chan7-1/+205
2018-03-16Merge "testcase start service script fail on centos env"Jing Lu10-19/+72
2018-03-16Add SUT page in GUIchenjiankun9-2/+125
JIRA: YARDSTICK-1076 We need to show SUT information in GUI. Change-Id: I885773894fc9f6aa5975b39383af1fdf1b88b8bb Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-15NSB PROX L3FWD Dropping packetsDanielMartinBuckley11-97/+221
JIRA: YARDSTICK-1037 NSB PROX L3FWD was incorrect. The routing table (ipv4.lua) was incorrect. Also a specific ipv4 for 2 port configuration is required. Change-Id: I3a5fd1ea1d1ddf74cbdd6a5d9e7ced42d3c1d6e9 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-03-15Merge "support for Bottlenecks soak throughputs"Jing Lu2-1/+74
2018-03-15Create API to get SUT informationchenjiankun7-1/+205
JIRA: YARDSTICK-1072 We need to show SUT information in GUI. Change-Id: I40bcd513f3c6a443c82764687637ac5258b99584 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-15Update API documentationchenjiankun1-71/+156
JIRA: YARDSTICK-1070 Our current API documentation is out-of-date. We need to update it. Change-Id: If5133c0350a91affb8d3f856d23b23a9903c8620 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-03-15support for Bottlenecks soak throughputsYang Yu2-1/+74
JIRA: YARDSTICK-1049 Changes: 1. NetperfNode -> Netperf, it seems that yardstick-image has not correctly complied Netperf since cpuutil is not available, resulting that LOCAL_CPU_UTIL=-1 for the output. Will create another JIRA ticket for this. Change-Id: I26a85f4aafcc5d5e1eda3e04272ecf3b059238fc Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2018-03-14Merge "Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml""Rex Lee1-0/+1
2018-03-14Fix retrieving "options" section in "scenario"Rodolfo Alonso Hernandez2-2/+32
In [1] a new method to rename the "scenario" host names was implemented. This method parses all sections with host names and applies the "qualified" name. Some malformed test cases define the "options" section without content. This causes that [2] retrieves "None" value instead of an empty dictionary. This possibility must be handled in the new method. [1]I44da30dac562c1a4166e084645ae91c17798651d [2]https://github.com/opnfv/yardstick/blob/4b8b674b65830a24230faed71e8d9a1048139c89/yardstick/benchmark/core/task.py#L630 JIRA: YARDSTICK-1073 Change-Id: I8864b428734ead8c5aa39de5091d3a2a691be060 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-14Improve ansible code for network xml creationJohn O Loughlin1-42/+7
JIRA: YARDSTICK-1018 Change-Id: Ia94fb1ceb9cb55bd54e512f356f85a263c32d1cf Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-03-14Add "YARD_IMG_ARCH" input variable to "build_yardstick_image.yml"Rodolfo Alonso Hernandez1-0/+1
"YARD_IMG_ARCH" variable is added as input parameter to "build_yardstick_image.yml" ansible script, in order to generate the correct image for the running architecture. JIRA: YARDSTICK-1058 Change-Id: I33954c236695478eaae34fcfca2e9d5b40791bbf Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-14Merge "Get SUT information"Jack Chan2-0/+69
2018-03-13Merge "Add support for VNC to VMs created by ansible"Ross Brattain1-0/+14
2018-03-13Merge "[Bug Fix] Support nova create instance operation"Ross Brattain2-0/+50
2018-03-12Modify the Docker diff file for ARM64Rodolfo Alonso Hernandez1-1/+1
In I5d9e135449b2d35f051ecf5fa63a1ce11030de4a the Dockerfile was modified. Until we can handle the Dockerfile generation for each architecture in a better way, we need to keep updated the Docker diff file for ARM64. JIRA: YARDSTICK-1030 Change-Id: Ibd9224dcb9a7a897b0da8aab126f62983b5e70bd Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-03-12Merge changes from topics 'delete_router', 'neutron_subnet_create', ↵Emma Foley9-117/+359
'neutron_create' * changes: Replace neutron router deletion with shade. Replace neutron subnet creation with shade. Replace neutron network creation with shade.
2018-03-12Merge "Add context name to Dummy test"Abhijit Sinha1-0/+1