summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-12-16update release notes for Euphrates 5.1.0opnfv-5.1.0Ross Brattain1-24/+61
Change-Id: I11b248882dd314baebd3ab4e7e676a1f3e0b50cd Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 9d0f99349d2ea4499670708aacb1569cad0389aa)
2017-12-16Addition of NSB Prox test documentation of vPE and LW-AFTR test casesDanielMartinBuckley3-0/+217
YARDSTICK-840 NSB Prox test documentation of vPE and LW-AFTR test cases documenation. Change-Id: Ic6da6546faf0494fdee71962a515083e6e10a410 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit db6083d91499521bf3a486623e985cc3b1703524)
2017-12-16fix docker client don't have trex_clientAce Lee2-0/+10
JIRA: YARDSTICK-854 Add trex_client in docker, so we could run NSB testcase in docker container. Change-Id: Iac1393d6e3a175137973190936ab69a1f2ce8272 Signed-off-by: Ace Lee <liyin11@huawei.com> (cherry picked from commit 75606db72e5d3afb6afe590e76b3baef3af3f5c6)
2017-12-16bugfix: tc078 have no data stored or dashboard to show resultsrexlee87761-0/+8
JIRA: YARDSTICK-867 1.print result in the log, showing the txt format result Change-Id: I6deeb4cf44895ef7a6c6d231c77b3843eec285d7 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 36c24ec9fc68c081d0bca507cff3ec81f8a001dc)
2017-12-16bugfix: tc078 fails in some situationsrexlee87767-22/+23
1. make "SPECint_benchmark, runspec_iterations, runspec_tune, runspec_size, runspec_rate" parameterized and change the default value "int^429" to "int" 2. remove "become: true" in some roles since it does not need root privilege JIRA: YARDSTICK-852 Change-Id: Icb384bddc12911e2681a981d0504e0e142d1a8ec Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 7bd43b239b7be6f478399526a177922d4482bcc2)
2017-12-16bugfix: kill process do not accurately kill "nova-api"rexlee877611-20/+30
JIRA: YARDSTICK-849 1. update the kill process RegEx pattern to be more accurate 2. make attack_process to be parameter so it can be customized if the SUT is using a different name of attack_process Change-Id: I569730ced6c24aafbffcf2fc5752d3560d0adac5 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 4bbd919e2b26fe606bb1b83efc579e0f2557593e)
2017-12-16samples: Add generic L3 forwarder testsDino Madarang68-3/+7600
A generic throughput test case that can be used as a stub code for a Linux-based VNF configured as an L3 forwarder. Supported context: * Standalone OVSDPDK and SRIOV * Baremetal Code changes: * Allow pmd-cpu-mask and lcore mask for OVS DPDK * router_vnf.py - configures interface IP addresses and static arp entries using ip command * NFVi KPIs * Allow cputune tag for standalone context to be able to PIN on NUMA 1 cpus SRIOV Test cases: * RFC2544 Ethernet framesizes, 128K Flows * 2,4 and 6 ports * 2 and 3 vcpus per port * OVSDPDK Test cases: * RFC2544 Ethernet framesizes, 128K Flows * 2 and 4 ports * 2 vcpus per port * 2 PMD threads per port TODO: * Documentation * Add 6 ports tests References: * router_vnf.py is based on sample_vnf.py * tc_*.yaml files are based on acl/vfw test case files Added unitests Added get_stats to parse ip -s link Change-Id: Id1b969d5420dfcab7c1e695acbd2cd1655747efe Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Signed-off-by: Kavindya Deegala <kavindya.s.deegala@intel.com> Reviewed-by: Alain Jebara <alain.jebara@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Emma Foley <emma.l.foley@intel.com> Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Dhaval Patel <dhaval.r.patel@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 9bf492e01dad7309287e8491ec7ac29f43032aed)
2017-12-16Merge "tc053 kill haproxy wrong mismatch" into stable/euphratesRoss Brattain1-0/+5
2017-12-15Merge "Refactor userguide "Yardstick Installation"" into stable/euphratesRoss Brattain1-320/+392
2017-12-15Merge "bugfix: tc006, tc079, tc082 miss grafana dashboard in local ↵Ross Brattain3-0/+1097
deployment" into stable/euphrates
2017-12-15Refactor userguide "Yardstick Installation"Rodolfo Alonso Hernandez1-320/+392
[1] must be refactored in order to: * Include proxy options. * Use OpenStack client, instead of project CLI. * Use sudo in some commands. * Adapt the document to rst coding style. * Fix minor errors. JIRA: YARDSTICK-828 [1] https://github.com/opnfv/yardstick/blob/923aa1738cbf5a8053e77e00937fc26f2142f6a3/docs/testing/user/userguide/04-installation.rst Change-Id: Ice63f344a8a87221bdf4daa6153b9ccac321e5b7 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit d20b876a02904653cf390a97c2ed9973821dc508)
2017-12-15NSB: Fix standalone.model.Libvirt SR-IOV modelingDino Madarang7-190/+407
Fixed standalone.model.Libvirt SR-IOV XML interface modeling, acording to [1]: - All PCI attributes now are printed in hexadecimal format. - The PCI address is now added in the correct section, 'interface'. network_services.utils.PciAddress was refactored to accept both 'domain: bus:slot:function' and 'bus:slot:function' format inputs. This class is used as input in the previous class, Libvirt, to print in XML the PCI address of a SR-IOV interface. network_services.utils.PciAddress.parse_address is now deprecated. Instead the class standard instantiation must be used: libvirt_obj = utils.PciAddress(text_with_address) A deprecation decorator is implemented along with this patch. This decorator is used for the first time in the previously mentioned function. This decorator stores every decorated function name and deprecation message and raises a logging warning message the first time this function is used. [1] https://goo.gl/so2Mrp Change-Id: I22e95c488e27d6e2a8fdf6c1a07faab275fa6bba Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Reviewed-by: Alain Jebara <alain.jebara@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit 6cfec77db6b95af5b31b741d513955ee3dfa3bb2)
2017-12-14bugfix: tc006, tc079, tc082 miss grafana dashboard in local deploymentrexlee87763-0/+1097
JIRA: YARDSTICK-847 Change-Id: I0750f2d17bac9e0214caf640e4ea1141ea3b4a03 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 1839527cfef72b58182d3c7bb2b06423684c0d46)
2017-12-14bugfix: tc023 miss description and tc050-58 wrong descriptionrexlee877616-29/+34
also modify tc019,025,045-49 descrition to be unified JIRA: YARDSTICK-850 Change-Id: I3f775f1ebff4063edc53b9bc26d7ba10b8af8a9d Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 84a532cc7fbe2d99300d43b5431a7e3c5b2d22cc)
2017-12-14Ansible: fix lowercasing issue with ConfigParserRoss Brattain2-22/+60
by default ConfigParser will lowercase everything, unless you override optionxform. also sort key value in inventory line for consistency https://docs.python.org/3/library/configparser.html#configparser.ConfigParser.optionxform Transforms the option name option as found in an input file or as passed in by client code to the form that should be used in the internal structures. The default implementation returns a lower-case version of option; subclasses may override this or client code can set an attribute of this name on instances to affect this behavior. You don’t need to subclass the parser to use this method, you can also set it on an instance, to a function that takes a string argument and returns a string. Setting it to str, for example, would make option names case sensitive: cfgparser = ConfigParser() cfgparser.optionxform = str Note that when reading configuration files, whitespace around the option names is stripped before optionxform() is called. YARDSTICK-833 Change-Id: Ia1810b0c77922d84e11c9e538540b38816338593 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 3e93bb8ff3ef9ff454d6be13295198dbeac75df7)
2017-12-14Merge "Fix controller IP parsing in "nsb_setup.sh" script" into stable/euphratesRoss Brattain1-1/+1
2017-12-14Merge "NSB Prox BM test case fixes for scale up" into stable/euphratesRoss Brattain28-337/+99
2017-12-14Merge "Add vfw ixload testcase for heat" into stable/euphratesRoss Brattain7-11/+2953
2017-12-14Merge "NSB "Prox" : Cleanup duplicated traffic profile" into stable/euphratesRoss Brattain3-195/+1
2017-12-14Merge "NSB: update vfw tc_heat_external tests" into stable/euphratesRoss Brattain2-11/+107
2017-12-14Merge "NSB TRex: convert DPDK port number to logical TRex port number" into ↵Ross Brattain4-7/+87
stable/euphrates
2017-12-14Merge "NSB: Fix IndexError in pin_vcpu_for_perf" into stable/euphratesRoss Brattain1-1/+1
2017-12-14NSB Prox BM test case fixes for scale upAbhijit Sinha28-337/+99
YARDSTICK-839 In a scale-up test the VNF number can start from 0 to MAX (num_vnf-1) The NSB PROX BM test nodes are currently marked as: tg__0: trafficgen_1.yardstick vnf__0: vnf.yardstick They need to be changed to the below: tg__0: tg_0.yardstick vnf__0: vnf_0.yardstick Changes done are: - All BM Prox test cases have tg_0 and vnf_0 as default test nodes - The prox-baremetal-1/2/4.yaml sample pod file - Cleaned Up some unused Prox test/config files Change-Id: I819011bcb35eda62b17dd3e1035918918c582b13 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 4b0bf9ea920b461b6464d0c6888b3b0bcc9a0004)
2017-12-14Merge "NSB Prox LW_AFTR Test" into stable/euphratesRoss Brattain11-3/+68726
2017-12-14Fix controller IP parsing in "nsb_setup.sh" scriptRodolfo Alonso Hernandez1-1/+1
Fixed the controller IP parsing in "nsb_setup.sh" script. The new regex expression now accepts "OS_AUTH_URL" as: * http://10.237.223.168/identity * http://10.237.223.168:5000/identity * http://hostname/identity * http://hostname:5000/identity JIRA: YARDSTICK-829 Change-Id: Ifaeab991bcbb6aa7b22c3533ab7554527184878b Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit b5e35986a77831841b064e435a6041a121634bec)
2017-12-14Add vfw ixload testcase for heatJennifer Li7-11/+2953
- concurrency - connections/second - throughput Change-Id: Idb977462952fba2e6a9684e916dfeca810f1ee94 Signed-off-by: Jennifer Li <jennifer.li@intel.com> (cherry picked from commit 4e679598b82b5fe6931374452476b6d057868535)
2017-12-14NSB "Prox" : Cleanup duplicated traffic profileAbhijit Sinha3-195/+1
JIRA: YARDSTICK-848 The NSB PROX MPLS test uses Binsearch traffic profile and the mpls traffic profile is a duplicate. Change-Id: Ie2124cebf306fd6917b70ecd7c23ae12ef4850dc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 1b9cc8a38a4866797bd49d006e22607b348f42ac)
2017-12-14NSB: update vfw tc_heat_external testsRoss Brattain2-11/+107
rename xe0, xe1 to uplink_0, downlink_0 enumerate tgs/vnfs starting from 0. add disable_dhcp Change-Id: Ia4f08b3ad5ab298192c249d04b10a6efbe4f210e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit b3a48eddc398c23523e379e6838160d456cf4368)
2017-12-14NSB TRex: convert DPDK port number to logical TRex port numberRoss Brattain4-7/+87
when we create TRex config we sort based on PCI bus address and create a logical port ordering. We need to save this port ordering and re-use it everywhere. redirect vnfd_helper.port_num() to resource_helper.port_num() to use the logical mapping Change-Id: Ibff628556d5e11e686e15716a66a3210758c4ff0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit ce52059f5f78912eeff2d97235c1028c218bf960)
2017-12-14Merge "Adding vFirewall HTTP Traffic Profiles for tests including ↵Ross Brattain40-0/+73520
Concurrency, CPS, TPUT, TPS for 2Ports and 4Ports" into stable/euphrates
2017-12-14Merge "Adding vFirewall HTTP Traffic Profiles." into stable/euphratesRoss Brattain6-1/+121
2017-12-14Merge "Dockerfile: apt-get clean to save layer space" into stable/euphratesRoss Brattain1-1/+1
2017-12-14Merge "Heat: add availability_zone" into stable/euphratesRoss Brattain3-22/+48
2017-12-14NSB Prox LW_AFTR TestDanielMartinBuckley11-3/+68726
JIRA: YARDSTICK-802 Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py - This support BM and Openstack Heat - This supports 4 Ports ONLY - Grafana Dashboards included - Code Coverage / Unit testing Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7 Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit b9e394b2f0955c76f883021c4f65c136b80d9261)
2017-12-14Merge "Addition of IPv6 icpm, udp and tcp to Neutron Security Group" into ↵Ross Brattain1-2/+15
stable/euphrates
2017-12-14NSB: Fix IndexError in pin_vcpu_for_perfDino Madarang1-1/+1
This addresses the IndexError in Standalone SRIOV/OVSDPDK context. The correct sys_cpu number should be sys_cpu-1 Error: threads = "%s-%s" % (soc_cpu[socket][sys_cpu], soc_cpu[socket][-1]) IndexError: list index out of range Tested platform: (Hyper-Threading disabled) NUMA node0 CPU(s): 0-21 NUMA node1 CPU(s): 22-43 With socket equal to 0, sys_cpu value was 22 which resulted to IndexError. Change-Id: I36b045cacce4caff4b5ddafaa9b6737f1c6df0a1 Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Reviewed-by: Alain Jebara <alain.jebara@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> Reviewed-by: Edward MacGillivray <edward.s.macgillivray@intel.com> (cherry picked from commit 78fff64b00e255d7e4624bcc62faddc0d135e5a2)
2017-12-14Adding vFirewall HTTP Traffic Profiles for tests including Concurrency, CPS, ↵Phani Kiran Thaticharla40-0/+73520
TPUT, TPS for 2Ports and 4Ports Change-Id: I3c7f047dc6d1545093aed6f64ccaed9f90d85af3 Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com> Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>  (cherry picked from commit 61bf9771f05f0347f12617b7013b13d5fcb4981b)
2017-12-14Adding vFirewall HTTP Traffic Profiles.Phani Kiran Thaticharla6-1/+121
Modified http_locator location for 64K, 256K, 512K and 1024K concurrency files. The traffic profiles include various http locator image sizes i.e 4K,64K,256K,512K and 1024K The traffic schema is changed to "nsb" from "isb" for all the traffic profiles Change-Id: I012da8daaa880ca80db2d3b08cebd9a73c19cd47 Signed-off-by: Phani Kiran Thaticharla <phani.kiran.thaticharla@intel.com> Reviewed-by: Oscar Medina-Duran <oscar.medina-duran@intel.com> Reviewed-by: Deepak S <deepak.s@linux.intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com>  (cherry picked from commit bb2da407193d6a5747cf15069d61cceb4c6bf1f7)
2017-12-14Dockerfile: apt-get clean to save layer spaceRoss Brattain1-1/+1
it seems like normally Dockerfiles do an apt-get clean to remove apt cache and save space on docker layers Change-Id: I2ac9d30daa917973c3ba76a50cda67d6ecb8c47a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 952c68f74c03facff84b987aa508040dd43ee30b)
2017-12-14Heat: add availability_zoneRoss Brattain3-22/+48
Users would like to ensure placement of VMs on specific compute nodes so that the measurements are meaningful. Examples: Measure network performance in different scenarios (VMs in same host, in different hosts, across fabric, across tenants) Example: context: name: yardstick placement_groups: pgrp1: policy: "availability" servers: tg_0: floating_ip: true placement: "pgrp1" availability_zone: "zone2" vnf_0: floating_ip: true placement: "pgrp1" availability_zone: "zone1" Change-Id: I28a757c25ae3f5b3571ab3edd82d51ceba32c302 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 81b9d338268f47f3d8863f10ef3940f0ea79d618)
2017-12-14Update links to documentation in README.rstEmma Foley1-3/+3
The links to the docs in README were pointing to Colorodo documentation. For master, this should not be pinned to a particular release, but should show the most recent docs at all times. Change-Id: I3186ea0dbc5105812407a0f87e02d99899a951a0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 9ea682e950598d39fa53ccabe6c1cd0a4fe426bd)
2017-12-14Addition of IPv6 icpm, udp and tcp to Neutron Security GroupDanielMartinBuckley1-2/+15
When creating a Neutron security group for a heat template. Add IPv6 security group rules to access the resouces. Change-Id: I0b541dfe400121e35908a70778665ee1576f0622 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 3cfdda00a291cf911e2948da774929ad23a60452)
2017-12-13Merge "KVMFORNFV: Reverting LiveMigration changes" into stable/euphratesJing Lu3-23/+20
2017-12-13tc053 kill haproxy wrong mismatchrexlee87761-0/+5
JIRA: YARDSTICK-831 Change-Id: I587c486572f439952b8a31da664d1e2c1fb8dc27 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit d70cbc5c6bd03cb68a13dcab50a12178982f5c44)
2017-12-12heat: allow overriding Heat/Neutron private IP for DPDK testsRoss Brattain4-5/+208
For some L2/L3 DPDK testcases we need to use a custom IP address space different from what Heat provides. These testcases require port_security_enabled = False so Neutron should allow for unrestricted L2 traffic. This will work because we bind the ports to DPDK and thus don't need DHCP. vnf_0: floating_ip: true placement: "pgrp1" network_ports: mgmt: - mgmt uplink_0: - xe0: local_ip: 10.44.0.20 netmask: 255.255.255.0 downlink_0: - xe1: local_ip: 10.44.0.30 netmask: 255.255.255.0 Also fixup flake8 errors in unittests Change-Id: Id29dfffa692f16fb1f526d208db43e476e2f7830 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit ec6a90d449f8b1ab2b17083188ec65f75ab7818b)
2017-12-12Add "How to work with test case" into devguidekubi1-0/+250
JIRA: YARDSTICK-73 add a new chapter about how to work with test case, now just add three sub chapter, sample test case, release test case, test case description file, will update more for how to write a new test case. Change-Id: I44906917e76ad6d4890f345c963b9e4440f6be39 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit 1ca9d52152d54b51b4d9dcd6c429f114ad4fe24c)
2017-12-04KVMFORNFV: Reverting LiveMigration changesNavya Bathula3-23/+20
This patch consists of reverting the changes of patch 45227 and incudes redirecting the console output of the LiveMigration execution to /dev/null as the stdout contains only the statistics, i.e., totaltime, downtime and setuptime. This reverts commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65. Change-Id: I252b5a4045657cfa8362e9aae755249480cd3b77 Signed-off-by: Navya <navyax.bathula@intel.com> (cherry picked from commit 3ca70b916c386b7ec4d9a7f2f9bb6fec2e917785)
2017-12-04KVMFORNFV: To avoid livemigration result update to jsonNavya2-12/+13
This patch is used to remove the livemigration testcase result loaded to json as there is no dashboard implemented for the testcase Change-Id: I7a9589a0bbc5f2a28587c2878da042fc50af18e0 Signed-off-by: Navya Bathula <navyax.bathula@intel.com> (cherry picked from commit 5a1f65d3e7d67488ee6f558dccfa5ca5581ddb65)
2017-11-10Merge "NSB: fix vpe_config license" into stable/euphratesRoss Brattain1-27/+10
2017-11-10Merge "Fixed incorrect Copyright Notice" into stable/euphratesRoss Brattain1-27/+10