aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2017-08-15Enable ixnet traffic generator to run trafficDeepak S2-10/+11
Change-Id: I8d7cea75aa864c37a058a154a38c9828ea5da434 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-15deepgetitem: try string index before intRoss Brattain1-4/+9
Change-Id: I3b353c5887db0ebbe33e37db505e72b85167b54e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-15Merge "task: initialize result"Ross Brattain1-0/+2
2017-08-14task: initialize resultRoss Brattain1-0/+2
Change-Id: I8d6b9bed24c9afa4be54296515e6aa91e84fe650 Signed-off-by: Martin Banszel <martinx.banszel@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-15dynamictp: fix flake8 warningRoss Brattain1-1/+1
flake8 warns about indent Change-Id: Ib7a57dcb8462de24a2ccb1fdbc60db995cc60d33 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-15Integrate vsperf in Tgen modeJing Zhang2-0/+407
Problem: Running Vsperf in Tgen mode is supported but the integration is not complete at the code level i.e. not ready-to-use, and dpdk loopback is not supported inside the VM. Solution: (1) Completely automates VM image generation and supports 1G huge pages. (2) Adds a new test scenario VsperfDPDK for testpmd based loopback inside the VM. Update 1-2: Fixed "line too long" issues not reported by local run_tests.sh (why?) Update 3: Per comment change to use SSH.from_node() and add unit test cases Update 4: Add more unit test cases for coverage and ready the code for merge JIRA: YARDSTICK-661 Change-Id: Iea3014d4c83e1b0c079019a4ed27771d40a7eed8 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-08-15Merge "Add yardstick report for each task"Ross Brattain3-0/+71
2017-08-14PROX VNF and TGRoss Brattain12-25/+1851
PROX was added to samplevnf project https://git.opnfv.org/samplevnf/tree/VNFs/DPPD-PROX JIRA: YARDSTICK-638 Change-Id: If9875b1130c6bed87deb8720b0d8b28ede9289d9 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-14Add yardstick report for each taskchenjiankun3-0/+71
JIRA: YARDSTICK-784 Currently we have yardstick report in GUI. But if users do not use GUI, they can't see this report. So we need generate a report each task. After run each test case, we can see report: http://ip:port/report/report.html Change-Id: Ic76cf57f55aa6680b91272e210135136f0225373 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-13cli: typo, s/dispath/dispatch/gRoss Brattain1-4/+4
Change-Id: I3df6bc606f2ac78baf611aee22b9247f6f9d5136 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11Add Ansible executor class for node contextRoss Brattain3-18/+638
import the AnsibleCommon class to execute Ansible playbooks Update node context support to use AnsibleCommon needs unittests We must call ansible-playbook as an executable, so we must create temp files for inventory, and for the playbooks. AnsibleCommon has evolved to be quite flexible, it auto-generates the inventory from the context['nodes'] and generates groups from the node Role. We also support either a single playbook filename, or a list of filenames. If given a list we dynamically generate a playbook that includes the other playbooks. We support adding any number of extra_vars using a temp JSON file. Also designed to be extended by subclassing. Change-Id: I5bd0a2b4547feaadd70b7e2b8801f19371b99df0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11Add real time log view in GUIchenjiankun2-2/+16
JIRA: YARDSTICK-775 We have GUI now, but we can't see real time log in GUI view. So I add real time log view in GUI. Change-Id: Ie83f327ef0a94302afa6b3def764fec6ef5818d1 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-11Merge "Add common openstack opertation scenarios: image & volume"Jing Lu5-0/+315
2017-08-11Merge "bugfix: tc038 ssh default wait 3600s"Kubi1-2/+3
2017-08-11Merge "Add common openstack opertation scenarios: flavor & server"Kubi5-62/+286
2017-08-11bugfix: tc038 ssh default wait 3600srexlee87761-2/+3
JIRA: YARDSTICK-771 Change-Id: Ibcd2228505d341feb09b0d477e5f4ed6062c1e89 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-11Merge "UDP relay"Ross Brattain1-0/+97
2017-08-11Merge "New storage test case: Bonnie++"Jing Lu1-0/+97
2017-08-11Add common openstack opertation scenarios: image & volumeJingLu55-0/+315
JIRA: YARDSTICK-781 This patch adds some common openstack opertation scenarios Change-Id: I3de7dbb30eaebac4feebcf07dd6a0d2bdcf428d9 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-08-10UDP relayDeepak S1-0/+97
Change-Id: I598f6f98f94f70334139966cc170832c90ea9aa6 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11Merge "Sample CGNAPT VNF"Ross Brattain1-0/+123
2017-08-10Sample VFW VNFDeepak S1-0/+67
Change-Id: I32ca166cd6d818b57bbcfaf7c7e5a65b7147ba8d Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-10Sample CGNAPT VNFDeepak S1-0/+123
Change-Id: I0f5555a1674a5ecb7e2afb508d495b7872c90757 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-11Add common openstack opertation scenarios: flavor & serverJingLu55-62/+286
JIRA: YARDSTICK-781 This patch adds some common openstack opertation scenarios Change-Id: I9e84a8894fe9b9c1754a45a0ddfdf93739164b9a Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-08-10Merge "NSB fixes: docstring, whitespace, etc."Ross Brattain3-5/+2
2017-08-10Merge "bugfix: tc037/38 multiprocessing failed sometimes"Kubi1-4/+4
2017-08-09NSB fixes: docstring, whitespace, etc.Ross Brattain3-5/+2
remove unused docstring params remove whitespace fix sudo vnf_build command ignore stdout Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> Change-Id: I6fcdbb0ed4bc6b7fc2f557529f5ff9fd960c05e9
2017-08-10Merge "Collectd"Ross Brattain4-88/+274
2017-08-10Merge "constants: cache YAML config values"Ross Brattain2-16/+24
2017-08-10Merge "IXIA traffic generator"Ross Brattain9-0/+1151
2017-08-10Merge "Sample ACL VNF"Ross Brattain1-0/+72
2017-08-10bugfix: tc037/38 multiprocessing failed sometimesrexlee87761-4/+4
set runner.join timeout JIRA: YARDSTICK-771 Change-Id: Iec7d04549a45c0fbd0eb48dcaad7770fd5ca1f4e Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-08constants: cache YAML config valuesRoss Brattain2-16/+24
don't reparse the yardstick.yaml file each time we lookup an option. Since it is global data, just cache it in a global var Use pkg_resources.resource_filename to lookup the path of yardstick tests, intsead of using __file__ pkg_resources is slightly more proper than __file__ at least for packages Change-Id: I05d9748390a37bd45c53013fc084d23069ab7c51 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-09bugfix: tc025 and tc054 failrexlee87762-2/+4
also modify tc025 an tc054 to be able to pass paras JIRA: YARDSTICK-772 Change-Id: Ibeba931804cccfd74fc70fcf4fdb6af9d5c8ab77 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-08CollectdDeepak S4-88/+274
Change-Id: I15e4ac38b347a08350b71c68469e2793eeed92ab Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-08Sample ACL VNFDeepak S1-0/+72
Change-Id: I33de47ac6ca353d6c69f0d166809b4c95d3fd90f Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-08IXIA traffic generatorDeepak S9-0/+1151
Change-Id: I09bcb3f2c4b945283070d442589d3bf00468abbc Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-08NSB updateDeepak S25-1394/+3211
Refactored main NSB VNF classes accroding to class diagram https://wiki.opnfv.org/display/yardstick/NSB+class+diagram All the SampleVNFs have been separated and placed under the SampleVNF class. Added AutoConnectSSH to automatically create SSH conneciton on demand. Added VnfdHelper class to wrap the VNFD dictionary in prepartion for class-based modeling. Extracted DpdkVnfSetupEnvHelper for DPDK based VNF setup. Extracted Stats and other client config to ResourceHelper Had to replace dict_key_flatten with deepgetitem due to Python 2.7 Jinja2 infinite recursion. Change-Id: Ia8840e9c44cdbdf39aab6b02e6d2176b31937dc9 Signed-off-by: Deepak S <deepak.s@linux.intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-03fix heatclient importRoss Brattain1-1/+1
for some reason, maybe apexlake, we didn't do the correct import we need to import heatclient.client directly Change-Id: I682c88ae780845adb0b5aa898390697197e3af5d Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-03Merge "DRAFT: remove apexlake"Ross Brattain89-10106/+0
2017-08-03New storage test case: Bonnie++JingLu51-0/+97
JIRA: YARDSTICK-770 Bonnie++ is a disk and file system benchmarking tool for measuring I/O performance. With Bonnie++ you can quickly and easily produce a meaningful value to represent your current file system performance. This work is add new storage test case using Bonnie++. Change-Id: I752fee156707cda730962c68d17fda4d4e9cd472 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-08-03Merge "replace yaml.load with yaml.safe_load"Ross Brattain8-8/+9
2017-08-02Merge "Add spec cpu2006 test case"Jing Lu1-0/+141
2017-08-01replace yaml.load with yaml.safe_loadRoss Brattain8-8/+9
yaml.safe_load is safer, obviously. anteater will check for this template_format use specialized constructor based on yaml.SafeLoader JIRA: YARDSTICK-760 Change-Id: Ia3b0b3aa0765385a0ee472a4d83f49d424b5a77f Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-01Bugfix: port_security_enabled issueJingLu51-3/+4
JIRA: YARDSTICK-765 When port_security_enabled is not set, VMs are assigned with security group 'default'. When using 'default' security group, all egress traffic and intercommunication in the default group are allowed and all ingress from outside of the default group is dropped by default (in the default security group). This causes yardstick cannot ssh into VMs. If port_security_enabled is not set, we should still add the security group that created by yardstick to the VMs. Change-Id: Ifd22fb452e0077581b6900f8f51c4e3c342a30aa Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-07-31DRAFT: remove apexlakeRoss Brattain89-10106/+0
apexlake is unmaintained, so remove it From some reason orchestrator/heat.py started failing so fixup those unittests Change-Id: Ie06508b5ab7c9dcf9fdfca83e173a188a894d564 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-01Merge "Bugfix: yardstick always report 'PASS' to DB"Rex Lee1-1/+7
2017-07-31NSBperf: don't exit during import timeRoss Brattain1-7/+0
This was breaking testr unittests. Don't do this like this during import time, only do them in if __name__ sections, otherwise when anything else tries to import this module it exists. Change-Id: Ia17f5e1a5cbe07ab287d3b95e96489b8a6248170 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-07-31Merge "Testing live migration using qemu"Rex Lee2-0/+223
2017-07-31Bugfix: yardstick always report 'PASS' to DBchenjiankun1-1/+7
JIRA: YARDSTICK-768 Now yardstick will not stop if test case failed, so that we can run the rest test case in the suite. CI judge task status by the cmd return code. In this way, the 'yardstick task start' cmd will always return 0. So we will always report 'PASS' to DB. In this patch I add a judgement in cmd, if the status is not 'PASS', we will raise a RuntimeError. Change-Id: I655424dd9cd3782869986963a17b24acfb340345 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>