summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-08-15Integrate vsperf in Tgen modeJing Zhang7-0/+984
Problem: Running Vsperf in Tgen mode is supported but the integration is not complete at the code level i.e. not ready-to-use, and dpdk loopback is not supported inside the VM. Solution: (1) Completely automates VM image generation and supports 1G huge pages. (2) Adds a new test scenario VsperfDPDK for testpmd based loopback inside the VM. Update 1-2: Fixed "line too long" issues not reported by local run_tests.sh (why?) Update 3: Per comment change to use SSH.from_node() and add unit test cases Update 4: Add more unit test cases for coverage and ready the code for merge JIRA: YARDSTICK-661 Change-Id: Iea3014d4c83e1b0c079019a4ed27771d40a7eed8 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-08-15Merge "Add yardstick report for each task"Ross Brattain4-0/+75
2017-08-14Ansible typo fix, whitespaceRoss Brattain3-2/+1
Change-Id: I3639ab84ab5b9e802e1bbd23674b0fbda46fdc66 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-14PROX VNF and TGRoss Brattain66-31/+40815
PROX was added to samplevnf project https://git.opnfv.org/samplevnf/tree/VNFs/DPPD-PROX JIRA: YARDSTICK-638 Change-Id: If9875b1130c6bed87deb8720b0d8b28ede9289d9 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-14Merge "cli: typo, s/dispath/dispatch/g"Ross Brattain1-4/+4
2017-08-14Add yardstick report for each taskchenjiankun4-0/+75
JIRA: YARDSTICK-784 Currently we have yardstick report in GUI. But if users do not use GUI, they can't see this report. So we need generate a report each task. After run each test case, we can see report: http://ip:port/report/report.html Change-Id: Ic76cf57f55aa6680b91272e210135136f0225373 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-13cli: typo, s/dispath/dispatch/gRoss Brattain1-4/+4
Change-Id: I3df6bc606f2ac78baf611aee22b9247f6f9d5136 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-12Move the comment above the config parameter line to avoid the expectionDeepak S1-1/+2
Traceback (most recent call last): File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/cmd/commands/task.py", line 54, in do_start result = Task().start(param, **kwargs) File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/benchmark/core/task.py", line 148, in start self._do_output(output_config, result) File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/benchmark/core/task.py", line 227, in _do_output dispatchers = DispatcherBase.get(output_config) File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/dispatcher/base.py", line 46, in get for out_type in config['DEFAULT']['dispatcher']] File "/opt/nsb_bin/yardstick_venv/lib/python2.7/site-packages/yardstick-0.1.dev0-py2.7.egg/yardstick/dispatcher/base.py", line 38, in get_cls raise RuntimeError("No such dispatcher_type %s" % dispatcher_type) RuntimeError: No such dispatcher_type Http # setup multiple dipatcher with comma deperted e.g. file Change-Id: I497d0d9ce7fdb7ea2913af6ebeb4bb9008344fed Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-08-11Add Ansible executor class for node contextRoss Brattain5-22/+853
import the AnsibleCommon class to execute Ansible playbooks Update node context support to use AnsibleCommon needs unittests We must call ansible-playbook as an executable, so we must create temp files for inventory, and for the playbooks. AnsibleCommon has evolved to be quite flexible, it auto-generates the inventory from the context['nodes'] and generates groups from the node Role. We also support either a single playbook filename, or a list of filenames. If given a list we dynamically generate a playbook that includes the other playbooks. We support adding any number of extra_vars using a temp JSON file. Also designed to be extended by subclassing. Change-Id: I5bd0a2b4547feaadd70b7e2b8801f19371b99df0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11ixia: VNF id must match class nameRoss Brattain1-2/+2
The class name is IxiaTrafficGen Change-Id: Ie18be44c7b58d50f13e9a5df50afa3e02fc0cce3 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11Merge "yardstick setup ansible, including load_images"Ross Brattain129-3/+5265
2017-08-11Add real time log view in GUIchenjiankun13-21/+159
JIRA: YARDSTICK-775 We have GUI now, but we can't see real time log in GUI view. So I add real time log view in GUI. Change-Id: Ie83f327ef0a94302afa6b3def764fec6ef5818d1 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-11Merge "Add common openstack opertation scenarios: image & volume"Jing Lu9-0/+467
2017-08-11Merge "bugfix: tc038 ssh default wait 3600s"Kubi2-3/+4
2017-08-11Merge "Add common openstack opertation scenarios: flavor & server"Kubi9-62/+433
2017-08-11bugfix: tc038 ssh default wait 3600srexlee87762-3/+4
JIRA: YARDSTICK-771 Change-Id: Ibcd2228505d341feb09b0d477e5f4ed6062c1e89 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-11Merge "UDP relay"Ross Brattain5-0/+732
2017-08-11Merge "New storage test case: Bonnie++"Jing Lu6-0/+337
2017-08-11Add common openstack opertation scenarios: image & volumeJingLu59-0/+467
JIRA: YARDSTICK-781 This patch adds some common openstack opertation scenarios Change-Id: I3de7dbb30eaebac4feebcf07dd6a0d2bdcf428d9 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-08-10UDP relayDeepak S5-0/+732
Change-Id: I598f6f98f94f70334139966cc170832c90ea9aa6 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11Merge "Sample CGNAPT VNF"Ross Brattain18-0/+2707
2017-08-10Sample VFW VNFDeepak S18-0/+2556
Change-Id: I32ca166cd6d818b57bbcfaf7c7e5a65b7147ba8d Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-10Sample CGNAPT VNFDeepak S18-0/+2707
Change-Id: I0f5555a1674a5ecb7e2afb508d495b7872c90757 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11Add common openstack opertation scenarios: flavor & serverJingLu59-62/+433
JIRA: YARDSTICK-781 This patch adds some common openstack opertation scenarios Change-Id: I9e84a8894fe9b9c1754a45a0ddfdf93739164b9a Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-08-10Merge "NSB fixes: docstring, whitespace, etc."Ross Brattain4-6/+3
2017-08-10Merge "bugfix: tc037/38 multiprocessing failed sometimes"Kubi1-4/+4
2017-08-10Merge "pip_license: quick hack script to add license info to requirements.txt"Ross Brattain1-0/+80
2017-08-10Merge "requirements.txt: add license info"Ross Brattain1-87/+89
2017-08-09NSB fixes: docstring, whitespace, etc.Ross Brattain4-6/+3
remove unused docstring params remove whitespace fix sudo vnf_build command ignore stdout Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> Change-Id: I6fcdbb0ed4bc6b7fc2f557529f5ff9fd960c05e9
2017-08-10Merge "Collectd"Ross Brattain5-99/+483
2017-08-10Merge "constants: cache YAML config values"Ross Brattain3-18/+27
2017-08-10Merge "IXIA traffic generator"Ross Brattain22-0/+4210
2017-08-10Merge "Sample ACL VNF"Ross Brattain29-0/+3153
2017-08-10bugfix: tc037/38 multiprocessing failed sometimesrexlee87761-4/+4
set runner.join timeout JIRA: YARDSTICK-771 Change-Id: Iec7d04549a45c0fbd0eb48dcaad7770fd5ca1f4e Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-10Merge "bugfix: tc025 and tc054 fail"Kubi4-23/+41
2017-08-10Merge "bugfix: hosts should be clean if update_hosts twice"Kubi1-3/+11
2017-08-09requirements.txt: add license infoRoss Brattain1-87/+89
Change-Id: I9de6a51e7efb9e49da5bbd541c466f106c3a52e3 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-09Bugfix: remove ping package for it is GPL licensechenjiankun1-1/+0
JIRA: YARDSTICK-777 In migrate test case, we use ping to count downtime. But ping package is GPL license, so we need remove it. Since ping command tool can not set timeout less then 1 second, and the downtime is less then 1 second, so we need find another package to replace. For now, I find most ping tool is GPL license, so maybe later we need to implement ping ourselves. And the migrate case can not calculate downtime unless user install ping themselves. Change-Id: I78cba5e4af9de2e3c0bb16b27570bed951caf440 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-08constants: cache YAML config valuesRoss Brattain3-18/+27
don't reparse the yardstick.yaml file each time we lookup an option. Since it is global data, just cache it in a global var Use pkg_resources.resource_filename to lookup the path of yardstick tests, intsead of using __file__ pkg_resources is slightly more proper than __file__ at least for packages Change-Id: I05d9748390a37bd45c53013fc084d23069ab7c51 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-09bugfix: tc025 and tc054 failrexlee87764-23/+41
also modify tc025 an tc054 to be able to pass paras JIRA: YARDSTICK-772 Change-Id: Ibeba931804cccfd74fc70fcf4fdb6af9d5c8ab77 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-09bugfix: hosts should be clean if update_hosts twicerexlee87761-3/+11
JIRA: YARDSTICK-774 Change-Id: Id610d43d236ab3a7d1aa4b8cfd230a40958fac38 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-08yardstick setup ansible, including load_imagesMalanik Jan129-3/+5265
also update to cirros 0.3.5 added PROX compilation add create_node_pod_yaml role JIRA: YARDSTICK-639 Change-Id: If5999841287a54c7e5c64a7cc487c6394df90424 Signed-off-by: Malanik Jan <janx.malanik@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-08CollectdDeepak S5-99/+483
Change-Id: I15e4ac38b347a08350b71c68469e2793eeed92ab Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-08Sample ACL VNFDeepak S29-0/+3153
Change-Id: I33de47ac6ca353d6c69f0d166809b4c95d3fd90f Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-08IXIA traffic generatorDeepak S22-0/+4210
Change-Id: I09bcb3f2c4b945283070d442589d3bf00468abbc Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-08NSB updateDeepak S82-4801/+12372
Refactored main NSB VNF classes accroding to class diagram https://wiki.opnfv.org/display/yardstick/NSB+class+diagram All the SampleVNFs have been separated and placed under the SampleVNF class. Added AutoConnectSSH to automatically create SSH conneciton on demand. Added VnfdHelper class to wrap the VNFD dictionary in prepartion for class-based modeling. Extracted DpdkVnfSetupEnvHelper for DPDK based VNF setup. Extracted Stats and other client config to ResourceHelper Had to replace dict_key_flatten with deepgetitem due to Python 2.7 Jinja2 infinite recursion. Change-Id: Ia8840e9c44cdbdf39aab6b02e6d2176b31937dc9 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-07pip_license: quick hack script to add license info to requirements.txtRoss Brattain1-0/+80
Change-Id: Ic41772cb32cd53d405b16880bd43cf89307b4716 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-03fix heatclient importRoss Brattain1-1/+1
for some reason, maybe apexlake, we didn't do the correct import we need to import heatclient.client directly Change-Id: I682c88ae780845adb0b5aa898390697197e3af5d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-03Merge "DRAFT: remove apexlake"Ross Brattain110-11580/+4
2017-08-03New storage test case: Bonnie++JingLu56-0/+337
JIRA: YARDSTICK-770 Bonnie++ is a disk and file system benchmarking tool for measuring I/O performance. With Bonnie++ you can quickly and easily produce a meaningful value to represent your current file system performance. This work is add new storage test case using Bonnie++. Change-Id: I752fee156707cda730962c68d17fda4d4e9cd472 Signed-off-by: JingLu5 <lvjing5@huawei.com>