aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-12-14Ansible: fix lowercasing issue with ConfigParserRoss Brattain2-22/+60
by default ConfigParser will lowercase everything, unless you override optionxform. also sort key value in inventory line for consistency https://docs.python.org/3/library/configparser.html#configparser.ConfigParser.optionxform Transforms the option name option as found in an input file or as passed in by client code to the form that should be used in the internal structures. The default implementation returns a lower-case version of option; subclasses may override this or client code can set an attribute of this name on instances to affect this behavior. You don’t need to subclass the parser to use this method, you can also set it on an instance, to a function that takes a string argument and returns a string. Setting it to str, for example, would make option names case sensitive: cfgparser = ConfigParser() cfgparser.optionxform = str Note that when reading configuration files, whitespace around the option names is stripped before optionxform() is called. YARDSTICK-833 Change-Id: Ia1810b0c77922d84e11c9e538540b38816338593 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 3e93bb8ff3ef9ff454d6be13295198dbeac75df7)
2017-12-14Merge "Fix controller IP parsing in "nsb_setup.sh" script" into stable/euphratesRoss Brattain1-1/+1
2017-12-14Merge "NSB Prox BM test case fixes for scale up" into stable/euphratesRoss Brattain28-337/+99
2017-12-14Merge "Add vfw ixload testcase for heat" into stable/euphratesRoss Brattain7-11/+2953
2017-12-14Merge "NSB "Prox" : Cleanup duplicated traffic profile" into stable/euphratesRoss Brattain3-195/+1
2017-12-14Merge "NSB: update vfw tc_heat_external tests" into stable/euphratesRoss Brattain2-11/+107
2017-12-14Merge "NSB TRex: convert DPDK port number to logical TRex port number" into ↵Ross Brattain4-7/+87
stable/euphrates
2017-12-14Merge "NSB: Fix IndexError in pin_vcpu_for_perf" into stable/euphratesRoss Brattain1-1/+1
2017-12-14NSB Prox BM test case fixes for scale upAbhijit Sinha28-337/+99
YARDSTICK-839 In a scale-up test the VNF number can start from 0 to MAX (num_vnf-1) The NSB PROX BM test nodes are currently marked as: tg__0: trafficgen_1.yardstick vnf__0: vnf.yardstick They need to be changed to the below: tg__0: tg_0.yardstick vnf__0: vnf_0.yardstick Changes done are: - All BM Prox test cases have tg_0 and vnf_0 as default test nodes - The prox-baremetal-1/2/4.yaml sample pod file - Cleaned Up some unused Prox test/config files Change-Id: I819011bcb35eda62b17dd3e1035918918c582b13 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 4b0bf9ea920b461b6464d0c6888b3b0bcc9a0004)
2017-12-14Merge "NSB Prox LW_AFTR Test" into stable/euphratesRoss Brattain11-3/+68726
2017-12-14Fix controller IP parsing in "nsb_setup.sh" scriptRodolfo Alonso Hernandez1-1/+1
Fixed the controller IP parsing in "nsb_setup.sh" script. The new regex expression now accepts "OS_AUTH_URL" as: * http://10.237.223.168/identity * http://10.237.223.168:5000/identity * http://hostname/identity * http://hostname:5000/identity JIRA: YARDSTICK-829 Change-Id: Ifaeab991bcbb6aa7b22c3533ab7554527184878b Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit b5e35986a77831841b064e435a6041a121634bec)
2017-12-14Add vfw ixload testcase for heatJennifer Li7-11/+2953
- concurrency - connections/second - throughput Change-Id: Idb977462952fba2e6a9684e916dfeca810f1ee94 Signed-off-by: Jennifer Li <jennifer.li@intel.com> (cherry picked from commit 4e679598b82b5fe6931374452476b6d057868535)
2017-12-14NSB "Prox" : Cleanup duplicated traffic profileAbhijit Sinha3-195/+1
JIRA: YARDSTICK-848 The NSB PROX MPLS test uses Binsearch traffic profile and the mpls traffic profile is a duplicate. Change-Id: Ie2124cebf306fd6917b70ecd7c23ae12ef4850dc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 1b9cc8a38a4866797bd49d006e22607b348f42ac)
2017-12-14NSB: update vfw tc_heat_external testsRoss Brattain2-11/+107
rename xe0, xe1 to uplink_0, downlink_0 enumerate tgs/vnfs starting from 0. add disable_dhcp Change-Id: Ia4f08b3ad5ab298192c249d04b10a6efbe4f210e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit b3a48eddc398c23523e379e6838160d456cf4368)
2017-12-14NSB TRex: convert DPDK port number to logical TRex port numberRoss Brattain4-7/+87
when we create TRex config we sort based on PCI bus address and create a logical port ordering. We need to save this port ordering and re-use it everywhere. redirect vnfd_helper.port_num() to resource_helper.port_num() to use the logical mapping Change-Id: Ibff628556d5e11e686e15716a66a3210758c4ff0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit ce52059f5f78912eeff2d97235c1028c218bf960)
2017-12-14Merge "Adding vFirewall HTTP Traffic Profiles for tests including ↵Ross Brattain40-0/+73520
Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports" into stable/euphrates
2017-12-14Merge "Adding vFirewall HTTP Traffic Profiles." into stable/euphratesRoss Brattain6-1/+121
2017-12-14Merge "Dockerfile: apt-get clean to save layer space" into stable/euphratesRoss Brattain1-1/+1
2017-12-14Merge "Heat: add availability_zone" into stable/euphratesRoss Brattain3-22/+48
2017-12-14NSB Prox LW_AFTR TestDanielMartinBuckley11-3/+68726
JIRA: YARDSTICK-802 Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py - This support BM and Openstack Heat - This supports 4 Ports ONLY - Grafana Dashboards included - Code Coverage / Unit testing Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7 Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit b9e394b2f0955c76f883021c4f65c136b80d9261)
2017-12-14Merge "Addition of IPv6 icpm, udp and tcp to Neutron Security Group" into ↵Ross Brattain1-2/+15
stable/euphrates
2017-12-14NSB: Fix IndexError in pin_vcpu_for_perfDino Madarang1-1/+1
This addresses the IndexError in Standalone SRIOV/OVSDPDK context. The correct sys_cpu number should be sys_cpu-1 Error: threads = "%s-%s" % (soc_cpu[socket][sys_cpu], soc_cpu[socket][-1]) IndexError: list index out of range Tested platform: (Hyper-Threading disabled) NUMA node0 CPU(s): 0-21 NUMA node1 CPU(s): 22-43 With socket equal to 0, sys_cpu value was 22 which resulted to IndexError. Change-Id: I36b045cacce4caff4b5ddafaa9b6737f1c6df0a1 Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Reviewed-by: Alain Jebara <alain.jebara@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com> (cherry picked from commit 78fff64b00e255d7e4624bcc62faddc0d135e5a2)
2017-12-14Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, ↵Phani Kiran Thaticharla40-0/+73520
TPUT, TPS for 2Ports and 4Ports Change-Id: I3c7f047dc6d1545093aed6f64ccaed9f90d85af3 Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com> Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>  (cherry picked from commit 61bf9771f05f0347f12617b7013b13d5fcb4981b)
2017-12-14Adding vFirewall HTTP Traffic Profiles.Phani Kiran Thaticharla6-1/+121
Modified http_locator location for 64K, 256K, 512K and 1024K concurrency files. The traffic profiles include various http locator image sizes i.e 4K,64K,256K,512K and 1024K The traffic schema is changed to "nsb" from "isb" for all the traffic profiles Change-Id: I012da8daaa880ca80db2d3b08cebd9a73c19cd47 Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com> Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>  (cherry picked from commit bb2da407193d6a5747cf15069d61cceb4c6bf1f7)
2017-12-14Dockerfile: apt-get clean to save layer spaceRoss Brattain1-1/+1
it seems like normally Dockerfiles do an apt-get clean to remove apt cache and save space on docker layers Change-Id: I2ac9d30daa917973c3ba76a50cda67d6ecb8c47a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 952c68f74c03facff84b987aa508040dd43ee30b)
2017-12-14Heat: add availability_zoneRoss Brattain3-22/+48
Users would like to ensure placement of VMs on specific compute nodes so that the measurements are meaningful. Examples: Measure network performance in different scenarios (VMs in same host, in different hosts, across fabric, across tenants) Example: context: name: yardstick placement_groups: pgrp1: policy: "availability" servers: tg_0: floating_ip: true placement: "pgrp1" availability_zone: "zone2" vnf_0: floating_ip: true placement: "pgrp1" availability_zone: "zone1" Change-Id: I28a757c25ae3f5b3571ab3edd82d51ceba32c302 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 81b9d338268f47f3d8863f10ef3940f0ea79d618)
2017-12-14Update links to documentation in README.rstEmma Foley1-3/+3
The links to the docs in README were pointing to Colorodo documentation. For master, this should not be pinned to a particular release, but should show the most recent docs at all times. Change-Id: I3186ea0dbc5105812407a0f87e02d99899a951a0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 9ea682e950598d39fa53ccabe6c1cd0a4fe426bd)
2017-12-14Addition of IPv6 icpm, udp and tcp to Neutron Security GroupDanielMartinBuckley1-2/+15
When creating a Neutron security group for a heat template. Add IPv6 security group rules to access the resouces. Change-Id: I0b541dfe400121e35908a70778665ee1576f0622 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 3cfdda00a291cf911e2948da774929ad23a60452)
2017-12-13Merge "KVMFORNFV: Reverting LiveMigration changes" into stable/euphratesJing Lu3-23/+20
2017-12-12heat: allow overriding Heat/Neutron private IP for DPDK testsRoss Brattain4-5/+208
For some L2/L3 DPDK testcases we need to use a custom IP address space different from what Heat provides. These testcases require port_security_enabled = False so Neutron should allow for unrestricted L2 traffic. This will work because we bind the ports to DPDK and thus don't need DHCP. vnf_0: floating_ip: true placement: "pgrp1" network_ports: mgmt: - mgmt uplink_0: - xe0: local_ip: 10.44.0.20 netmask: 255.255.255.0 downlink_0: - xe1: local_ip: 10.44.0.30 netmask: 255.255.255.0 Also fixup flake8 errors in unittests Change-Id: Id29dfffa692f16fb1f526d208db43e476e2f7830 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit ec6a90d449f8b1ab2b17083188ec65f75ab7818b)
2017-12-12Add "How to work with test case" into devguidekubi1-0/+250
JIRA: YARDSTICK-73 add a new chapter about how to work with test case, now just add three sub chapter, sample test case, release test case, test case description file, will update more for how to write a new test case. Change-Id: I44906917e76ad6d4890f345c963b9e4440f6be39 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit 1ca9d52152d54b51b4d9dcd6c429f114ad4fe24c)
2017-12-04KVMFORNFV: Reverting LiveMigration changesNavya Bathula3-23/+20
This patch consists of reverting the changes of patch 45227 and incudes redirecting the console output of the LiveMigration execution to /dev/null as the stdout contains only the statistics, i.e., totaltime, downtime and setuptime. This reverts commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65. Change-Id: I252b5a4045657cfa8362e9aae755249480cd3b77 Signed-off-by: Navya <navyax.bathula@intel.com> (cherry picked from commit 3ca70b916c386b7ec4d9a7f2f9bb6fec2e917785)
2017-12-04KVMFORNFV: To avoid livemigration result update to jsonNavya2-12/+13
This patch is used to remove the livemigration testcase result loaded to json as there is no dashboard implemented for the testcase Change-Id: I7a9589a0bbc5f2a28587c2878da042fc50af18e0 Signed-off-by: Navya Bathula <navyax.bathula@intel.com> (cherry picked from commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65)
2017-11-10Merge "NSB: fix vpe_config license" into stable/euphratesRoss Brattain1-27/+10
2017-11-10Merge "Fixed incorrect Copyright Notice" into stable/euphratesRoss Brattain1-27/+10
2017-11-10Fixed incorrect Copyright NoticeDanielMartinBuckley1-27/+10
Changed Copyright notice on tuples.lua from "Intel Copyright" to Apache 2.0 Change-Id: I85e6f9eb86c116d552f86cddf05b3b368b32f776 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 204702db384241faffbf0848ad0bc63fa476b52d)
2017-11-10NSB: fix vpe_config licenseRoss Brattain1-27/+10
Use Apache 2.0 Change-Id: I199d09f04a5c84a25bd91dceba5e4ed1f93075f6 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 3e62c0669b73fd5a4b4d0d7e7a214853b343574a)
2017-11-10pmu: remove event_download_local workaround scriptRoss Brattain4-239/+0
intel_pmu needs to download a config file based on the CPU model. When generating VNF images we don't have access to the actual vCPU that will be used, so we can't predownload. This code was meant to be a fix for that by downloading all the configs and then selecting one that matched the vCPU. However we have license issues with intel_pmu enven GPLv2 code, so remove it for now. Change-Id: I5257ff7c4ddc1d40537dadb29efa40d1d68cb852 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 7a5c45daa9b146dfc50068165aba5ec6bc2e1e2c)
2017-10-23BugFix: Fix to pod filename ext and prox pathAbhijit Sinha38-99/+99
As per defect: - the "context:" stanza of every tc_prox_baremetal*.yaml" file has an incorrect pathname for the config file - tc_prox_baremetal_binsearch.yaml and tc_prox_baremetal_ramp.yaml refer to "prox-baremetal.yml", which idoes not exist - incorrect prox bin path Resolution: - Unify the pod file name and path for all BM tests - Prox bin path changed to "/opt/nsb_bin/prox" Change-Id: I16b25189104ad5585ddc1c2c0dd71b3c4c2aecd3 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 2ebe6693b09a221de154a697ba24817a61e8548d)
2017-10-20Merge "Fix Malformed Table in User Guide docs" into stable/euphratesopnfv-5.0.0Jing Lu1-2/+2
2017-10-20Fix Malformed Table in User Guide docsTrevor Bramwell1-2/+2
Change-Id: I2f98b75e9bbcd3d0cd4666c097a3280dd89eb02a Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org> (cherry picked from commit 74c2176823913f09821ea2671c9008e5c74954b8)
2017-10-20Added NSB sample Test Case documentation.Maciej Skrocki10-0/+911
Update: Added Prox NSB test case documentation Change-Id: Ia2f47d823581fc7f193d3123f080dd87f29d4b99 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 10c595ad0301d02944ae412e994e65027e9d69e6)
2017-10-20Docs: add yardstick gui descrption in userguideopnfv-5.0.RC1JingLu51-0/+10
Change-Id: I09bc55e296d2c641f10819972ec0d48a289432b8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-10-20Docs: update new test cases in release noteJingLu51-12/+31
Change-Id: Ie5ff6fe4f867ce68a33a3a857d8d051ba0020395 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit b463496e6515a42e29b814194d8b19ed2f639239)
2017-10-20DRAFT: update release notes for EuphratesRoss Brattain1-562/+313
Change-Id: I7e437612ca52b75b71e38962a84d0dcdb453d5dd Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 540659ee051d8c5b570541e1e4e0b92fa8b0e2ec)
2017-10-20Merge "Add missing RFC2544 Ethernet frame sizes" into stable/euphratesJing Lu1-0/+8
2017-10-20Add missing RFC2544 Ethernet frame sizesDino Madarang1-0/+8
RFC2544 tests should include the following frame sizes: 9.1 Frame sizes to be used on Ethernet 64, 128, 256, 512, 1024, 1280, 1518 Change-Id: I6ab9cccf2bb3b2678f50da157a9a49c0d9564cbd Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Reviewed-by: Alain Jebara <alain.jebara@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com> (cherry picked from commit 7046a9139a60e0bc3e65f5dc6dcb8e6999528136)
2017-10-20nsb_installation: updatesRoss Brattain5-787/+1168
JIRA: YARDSTICK-500 Change-Id: I6eef884ef6262abe49fc13bc353ca14a72a5b648 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> Signed-off-by: Martin Banszel <martinx.banszel@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com> (cherry picked from commit 97b961aee6653553c5a35ecee5cb766924cd10f1)
2017-10-19NSB: fix trex config to use dpdk port numberRoss Brattain2-12/+16
From some reason Heat/Neutron is now creating interfaces such that xe0 and xe1 are swapped. xe0 fa:16:3e:38:c7:66 0000:00:05.0 xe1 fa:16:3e:2f:f3:e2 0000:00:03.0 this causes the DPDK port numbering to be swapped. xe0 is DPDK port 1 because it has higher PCI address xe1 is DPDK port 0 because it has lower PCI address. The VNF is configured correctly because it uses DPDK port numbers, whereas TRex was using interface list ordering. Modify trex_cfg.yaml to use DPDK port ordering. This also requires running generate_cfg() after setup() in instantiate() +------------------------------------+-------------------+------------------------------+--------+ | Name | MAC Address | Fixed IP Addresses | Status | +------------------------------------+-------------------+------------------------------+--------+ | vnf_0.yardstick-af5ccb47-xe0-port | fa:16:3e:66:a5:e4 | ip_address='10.1.0.7', | ACTIVE | | vnf_0.yardstick-af5ccb47-mgmt-port | fa:16:3e:fa:98:fe | ip_address='10.0.1.10', | ACTIVE | | tg_0.yardstick-af5ccb47-xe1-port | fa:16:3e:2f:f3:e2 | ip_address='10.1.1.9', | ACTIVE | | vnf_0.yardstick-af5ccb47-xe1-port | fa:16:3e:f3:1d:f5 | ip_address='10.1.1.4', | ACTIVE | | | fa:16:3e:e3:8c:65 | ip_address='10.0.1.1', | ACTIVE | | | fa:16:3e:ff:d1:b7 | ip_address='11.191.14.110', | N/A | | tg_0.yardstick-af5ccb47-xe0-port | fa:16:3e:38:c7:66 | ip_address='10.1.0.8', | ACTIVE | | | fa:16:3e:ff:53:5f | ip_address='11.191.14.101', | DOWN | | | fa:16:3e:23:5d:2c | ip_address='10.0.1.2', | ACTIVE | | tg_0.yardstick-af5ccb47-mgmt-port | fa:16:3e:7a:df:4e | ip_address='10.0.1.5', | ACTIVE | | | fa:16:3e:22:65:36 | ip_address='11.191.14.109', | N/A | +------------------------------------+-------------------+------------------------------+--------+ /sys/devices/pci0000:00/0000:00:03.0/virtio0/net/ens3/address:fa:16:3e:2f:f3:e2 /sys/devices/pci0000:00/0000:00:05.0/virtio2/net/ens5/address:fa:16:3e:38:c7:66 Change-Id: Iaef2c7d9a5af7f45bd805a8ad6ee545ce0495cb1 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 7ed018cddf88ac1c5a92f71fa5e421e66d259bc0)
2017-10-19BugFix: Negative dropped packets in Prox testsAbhijit Sinha2-5/+5
Removed the abs function which can potentially mask negative dropped packets. Dropped packets in Prox workload VNF = max((tx_packets - rx_packets), 0) Change-Id: I510a351e899cdf9a1f366d632b9f0528b1d9dcce Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit a27278dacaa54ae60cd3bdfa6e6145643f76fa02)