aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-08-23Merge "Fix issues with 'Success_' stats reported by ProxBinSearchProfile"Abhijit Sinha3-200/+243
2018-08-23Merge "Runners crash on test startup."Abhijit Sinha2-3/+5
2018-08-23Merge "Provide access to VM in Standalone context"Rodolfo Alonso Hernandez6-52/+261
2018-08-23Merge "Provide average latency results in IXIA KPIs"Rodolfo Alonso Hernandez2-14/+60
2018-08-23Runners crash on test startup.DanielMartinBuckley2-3/+5
JIRA: YARDSTICK-1393 The problem resides in this traffic generator class: this class is inheriting from SampleVNFTrafficGen and overriding the __init__ method but is NOT calling the parent class __init__ one. Change-Id: I206a66e361a3e2eb50bb5fa01ddadae25b4a9f54 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-23Provide access to VM in Standalone contextStepan Andrushko6-52/+261
Add possibility to access VM with SampleVNF image, which is spawned on baremetal server using password or key pairs (provided or generated). Changes provided for OVS-DPDK and SRIOV cases. JIRA: YARDSTICK-1260 Change-Id: I89cf17dc83f02abe23d206b24b9d0ec1298d3231 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-23Fix issues with 'Success_' stats reported by ProxBinSearchProfileSerhiy Pshyk3-200/+243
List of changes: - Added 'Status' field to indicate status of each search iteration. Possible values are 'Success', 'Failure', 'Result'. - Removed reporting of duplicated stats with 'Success_' prefix. Instead 'Status' field is set to 'Success' - Removed reporting of duplicated stats with 'Result_' prefix. Instead 'Status' field is set to 'Result' - Updated Prox_BM_L2FWD-4Port_MultiSize-1518452496550.json dashboard to query success and result status by 'Status' field value. JIRA: YARDSTICK-1386 Change-Id: I9a21a102af6cb4db137e805011b5d81c4943d77b Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-08-22Provide average latency results in IXIA KPIsRodolfo Alonso Hernandez2-14/+60
IXIA KPIs will provide an average value of all port latency values: max, min and avg. JIRA: YARDSTICK-1394 Change-Id: Ib7c7b5300e8343a1af0a20cb4e49c0bd669c1143 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-21Merge "Add virtual image generation to install script"Rodolfo Alonso Hernandez13-26/+513
2018-08-21Merge "Improvie TRex RFC2544 throughput calculation"Rodolfo Alonso Hernandez3-33/+37
2018-08-21Merge "Convert IXIA latency statistics to integer"Rodolfo Alonso Hernandez4-3/+45
2018-08-21Convert IXIA latency statistics to integerRodolfo Alonso Hernandez4-3/+45
JIRA: YARDSTICK-1385 Change-Id: Id50c393da7ded4b3c8e127f7d7a6501832a68446 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-21Merge "Make TRex latency statistics optional"Rodolfo Alonso Hernandez11-12/+25
2018-08-21Merge "NSB NFVi PROX BNG and vPE losing many packets"Abhijit Sinha9-10/+109
2018-08-21Merge "the recovery action of "baremetal down" should be triggered mandatory"Rex Lee5-3/+59
2018-08-20Make TRex latency statistics optionalRodolfo Alonso Hernandez11-12/+25
Because of performance issues in TRex due to the extra power needed to retrieve the latency statistics, this parameter will be optional and disabled by default. JIRA: YARDSTICK-1388 Change-Id: I07c0ec7bef86fd438d078cbd6748b98bc8cc0b37 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-20Improvie TRex RFC2544 throughput calculationRodolfo Alonso Hernandez3-33/+37
Improve TRex RFC2544 throughput calculation by using the in/out packets instead of using the throughput samples. JIRA: YARDSTICK-1387 Change-Id: I877e901c3226d31c6435a877a2924bb95deb1cf0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-20Fix RFC2544 IXIA latency informationRodolfo Alonso Hernandez1-16/+15
Do not overwrite the samples information with the latency parameters. JIRA: YARDSTICK-1385 Change-Id: I2f144800ad19d7736eedf5c7b6783731031c4bf4 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-17Merge "Improve IXIA TG Rx/TX throughput calculation"Rodolfo Alonso Hernandez3-38/+24
2018-08-17Add RFC2544 IXIA latency informationRodolfo Alonso Hernandez1-9/+8
JIRA: YARDSTICK-1385 Change-Id: Icecceaabc0389279a3a7154884c50259f794eb76 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-16Merge "IXIA traffic stops running after first iteration"Emma Foley2-12/+11
2018-08-16Merge "Disk Initialization and Custom Workload"Rex Lee4-81/+441
2018-08-16Improve IXIA TG Rx/TX throughput calculationMytnyk, Volodymyr3-38/+24
Use float instead of integer to convert TG throughtput IXIA statistic. JIRA: YARDSTICK-1378 Change-Id: I39bd143adc4b10035c6f0986a06d407a18aa0887 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-15Add virtual image generation to install scriptStepan Andrushko13-26/+513
Update install.yaml with image generation: nsb and normal. JIRA: YARDSTICK-1198 Change-Id: I3b8773e9b3b9890ae8623bb6536d05f1151d84a8 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-15Merge "[docs] Remove the VTC chapter in the userguide"Abhijit Sinha7-139/+1
2018-08-15Merge "Fix KPI data reported by ProxBinSearchProfile"Abhijit Sinha1-10/+6
2018-08-14Fix TRex RFC2544 traffic profile tolerance definitionRodolfo Alonso Hernandez6-15/+22
In TRex RFC2544 traffic profile, the tolerance limit is not set correctly. The parameters "tol_high" and "tol_low" in "get_drop_percentage" are incorrect. The tolerance limit should be reduced to 0.01. JIRA: YARDSTICK-1382 Change-Id: If5fc1f3aec86effabd7903e0924724fe7eeb42ab Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-14Merge "Bugfix: pylint fix for yardstick/orchestrator/heat.py ↵Rex Lee1-7/+3
(no-value-for-parameter)"
2018-08-13Fix KPI data reported by ProxBinSearchProfileSerhiy Pshyk1-10/+6
List of changes made in ProxBinSearchProfile: - Removed reporting of redundant records with zero values - Fixed issue with results data from one step reported in the next step - Added 'Step_Id' field to reflect to which search step current record belongs - Added 'Confirmation_Retry' field to reflect retry number of current test. This value depends on 'confirmation' configuration option of a runner. JIRA: YARDSTICK-1379 Change-Id: Idc3f7e26ece41ac0dfbfee659daf310a2879e024 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-08-10Merge "Add QinQ support for IXIA traffic profile"Abhijit Sinha3-6/+92
2018-08-10IXIA traffic stops running after first iterationMytnyk, Volodymyr2-12/+11
IXIA traffic stops running after first iteration when traffic profile duration is set to 60 sec. JIRA: YARDSTICK-1374 Change-Id: I216b98d43b66aabc72ed88e895b89e28572b264f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-08-10Disk Initialization and Custom Workloadmbeierl4-81/+441
Removes the deprecated nowarm and nosdd parameters from the call to StorPerf. Adds a call to initialize the disk right after the stack creation is complete so that the results from the performance run are valid and not skewed by a disk that is not operating at a consistent level of performance. Adds the jobs API v2.0 when the custom parameter 'workloads' is used instead of workload. Improves documentation and adds more info about the workload and workloads parameters. Co-Authored-By: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> Change-Id: I17e96028f6a82e2c800c8f73c7be866e1cab6ad8 JIRA: YARDSTICK-1322 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-09Merge "Add UT: DurationRunner worker exception handling"Abhijit Sinha1-1/+131
2018-08-09Merge "Add UT: DurationRunner worker normal operation"Abhijit Sinha1-0/+146
2018-08-09Add QinQ support for IXIA traffic profileMyron Sosyak3-6/+92
Implemented logic for parsing and applying QinQ in IXIA traffic profile. For QinQ configuration add QinQ section to outerl2 section. For example: ... outerl2: QinQ: S-VLAN: id: 128 priority: 0 cfi: 0 C-VLAN: id: 512 priority: 0 cfi: 0 ... JIRA: YARDSTICK-1370 Change-Id: I29caa9eb7dd038e7de66faab316f03c7c29a742f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-08-09Bugfix: pylint fix for yardstick/orchestrator/heat.py (no-value-for-parameter)rexlee87761-7/+3
Problem op_utils.get_volume_id takes 2 arguments and only pass 1. This would cause tc006 fail! volume_id = op_utils.get_volume_id(volume_name) it will cause: Running pylint... You can speed this up by running it on 'HEAD~[0-9]' (e.g. HEAD~0, this change only)... Using config file /home/opnfv/repos/yardstick/.pylintrc ************* Module yardstick.orchestrator.heat E:235,20: No value for argument 'volume_name' in function call (no-value-for-parameter) To Do It doesn't need to call get_volume_id here, just use heat get_resource would be enough. This fix should work with tc006 test case. JIRA: YARDSTICK-1371 Change-Id: I913ffd085f742ae4464dbcc4269719e2c50e37b5 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-08Fix duration value for IXIA traffic itemMyron Sosyak2-1/+5
Removed code that overrides duration value in the update_frame function JIRA: YARDSTICK-1369 Change-Id: Ice06e4fbba4ec93ae086671a2530d521510f89da Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-08-07Merge "Change assert statements to raises in CheckValue"Rex Lee3-29/+56
2018-08-07Merge "Separate out test_parse_to_value_exception()"Rex Lee1-4/+9
2018-08-07Merge "[workaround] Disable gui for aarch64"Rex Lee1-8/+18
2018-08-07Merge "Bugfix: HA test case baremetal down ipmi power off failed - dovetail"Rex Lee2-29/+5
2018-08-03Merge "Add UT: ArithmeticRunner worker normal operation"Abhijit Sinha1-0/+182
2018-08-03Merge "Add unit test file for ArithmeticRunner"Abhijit Sinha1-0/+38
2018-08-03Merge "IXIA: Add IP random range `seed` configuration option"Abhijit Sinha6-2/+18
2018-08-03Merge "Add UDP ports configuration to IXIA traffic profile"Abhijit Sinha9-5/+174
2018-08-03Merge "Change AutoConnectSSH to return error code by default"Abhijit Sinha2-1/+24
2018-08-03IXIA: Add IP random range `seed` configuration optionMyron Sosyak6-2/+18
Added IP random range `seed` configuration option into IXIA traffic profile. JIRA: YARDSTICK-1364 Change-Id: Ic050b6cc48ea75ac6d0470bf7ec1b188649811e1 Signed-off-by: Sosyak, Myronx <myronx.sosyak@intel.com> Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-02NSB NFVi PROX BNG and vPE losing many packetsDanielMartinBuckley9-10/+109
JIRA: YARDSTICK-1101 The traffic generated by the generator in bng-4 result in non-symmetrical use of the cores on the SUT, as a whole range of IP addresses is skipped. Update cpe0 and cpe1 in gen files. In addition, for the routing table (ipv4.lua) for the BNG should be slighly different: while the BNG is a 4 ports test, only 2 of the ports are used as outgoing routing ports (the inet ports). Hence, the routing table should only use the mac of those two ports. The bad configuration (using 4 ports) result in an issue when BNG SUT and GEN are connected through a switch, packets are sent by the BNG SUT through the INET interfaces, but sometimes with the MAC of the CPE interface... Hence, packets are received on the wrong interface on the Gen site (resulting in some interfaces, the CPE ones, being overloaded) Created ipv4_bng.lua and remove mac 0 and 2 Change-Id: I97019f0415d2f58d50ec855d04800eb705f41541 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-02Add UDP ports configuration to IXIA traffic profileMyron Sosyak9-5/+174
- Implemented handling of UDP source and destination ports from IXIA traffic profile. - UDP ports can be defined as a single value or as a random range. Ports range is configured with two parameters 'fixed_bits' and 'mask_bits'. - For example '8-48' range definition will create a repeatable pattern of four values that fall within the range of 8 and 56. JIRA: YARDSTICK-1363 Change-Id: I0ace722f6be843ea79c3d3f4de22cb8fa5669d4f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Pshyk Serhiy <serhiyx.pshyk@intel.com> Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-02Merge "Remove hw_video_model and hw_firmware_type from metadata"Abhijit Sinha1-15/+1