aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-08-16Fix setting `flow` configuration in TC yamlMytnyk, Volodymyr3-10/+12
The `flow` configuration is not applied to the traffic profile if `seed` or `count` option is missing in the TC definition. - Fix `seed` backward compatibility. JIRA: YARDSTICK-1383 Change-Id: Ic874fb2be1c13009f94eb3a80194bfe81d7a923b Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-15Add virtual image generation to install scriptStepan Andrushko13-26/+513
Update install.yaml with image generation: nsb and normal. JIRA: YARDSTICK-1198 Change-Id: I3b8773e9b3b9890ae8623bb6536d05f1151d84a8 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-15Merge "[docs] Remove the VTC chapter in the userguide"Abhijit Sinha7-139/+1
2018-08-15Merge "Fix KPI data reported by ProxBinSearchProfile"Abhijit Sinha1-10/+6
2018-08-14Fix TRex RFC2544 traffic profile tolerance definitionRodolfo Alonso Hernandez6-15/+22
In TRex RFC2544 traffic profile, the tolerance limit is not set correctly. The parameters "tol_high" and "tol_low" in "get_drop_percentage" are incorrect. The tolerance limit should be reduced to 0.01. JIRA: YARDSTICK-1382 Change-Id: If5fc1f3aec86effabd7903e0924724fe7eeb42ab Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-14Change tc_trex files to execute standalone testsStepan Andrushko9-53/+53
Changes made in test cases for trex TG files to be able to run tests for standalone setup (OVS-DPDK/SRIOV). - tg__0: trafficgen_1 Changes to improve templates for tc_trex: - flavor: images: changed to default name: yardstick-nsb-image.img - default path for files under contexts section - RAM size JIRA: YARDSTICK-1368 Change-Id: Ida85de219acd566840de1a94975b8050c7f59b9b Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-14Merge "Bugfix: pylint fix for yardstick/orchestrator/heat.py ↵Rex Lee1-7/+3
(no-value-for-parameter)"
2018-08-13Fix KPI data reported by ProxBinSearchProfileSerhiy Pshyk1-10/+6
List of changes made in ProxBinSearchProfile: - Removed reporting of redundant records with zero values - Fixed issue with results data from one step reported in the next step - Added 'Step_Id' field to reflect to which search step current record belongs - Added 'Confirmation_Retry' field to reflect retry number of current test. This value depends on 'confirmation' configuration option of a runner. JIRA: YARDSTICK-1379 Change-Id: Idc3f7e26ece41ac0dfbfee659daf310a2879e024 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-08-10Merge "Add QinQ support for IXIA traffic profile"Abhijit Sinha3-6/+92
2018-08-10IXIA traffic stops running after first iterationMytnyk, Volodymyr2-12/+11
IXIA traffic stops running after first iteration when traffic profile duration is set to 60 sec. JIRA: YARDSTICK-1374 Change-Id: I216b98d43b66aabc72ed88e895b89e28572b264f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-08-10Disk Initialization and Custom Workloadmbeierl4-81/+441
Removes the deprecated nowarm and nosdd parameters from the call to StorPerf. Adds a call to initialize the disk right after the stack creation is complete so that the results from the performance run are valid and not skewed by a disk that is not operating at a consistent level of performance. Adds the jobs API v2.0 when the custom parameter 'workloads' is used instead of workload. Improves documentation and adds more info about the workload and workloads parameters. Co-Authored-By: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> Change-Id: I17e96028f6a82e2c800c8f73c7be866e1cab6ad8 JIRA: YARDSTICK-1322 Signed-off-by: mbeierl <mark.beierl@dell.com>
2018-08-09Merge "Add UT: DurationRunner worker exception handling"Abhijit Sinha1-1/+131
2018-08-09Merge "Add UT: DurationRunner worker normal operation"Abhijit Sinha1-0/+146
2018-08-09Add QinQ support for IXIA traffic profileMyron Sosyak3-6/+92
Implemented logic for parsing and applying QinQ in IXIA traffic profile. For QinQ configuration add QinQ section to outerl2 section. For example: ... outerl2: QinQ: S-VLAN: id: 128 priority: 0 cfi: 0 C-VLAN: id: 512 priority: 0 cfi: 0 ... JIRA: YARDSTICK-1370 Change-Id: I29caa9eb7dd038e7de66faab316f03c7c29a742f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-08-09Bugfix: pylint fix for yardstick/orchestrator/heat.py (no-value-for-parameter)rexlee87761-7/+3
Problem op_utils.get_volume_id takes 2 arguments and only pass 1. This would cause tc006 fail! volume_id = op_utils.get_volume_id(volume_name) it will cause: Running pylint... You can speed this up by running it on 'HEAD~[0-9]' (e.g. HEAD~0, this change only)... Using config file /home/opnfv/repos/yardstick/.pylintrc ************* Module yardstick.orchestrator.heat E:235,20: No value for argument 'volume_name' in function call (no-value-for-parameter) To Do It doesn't need to call get_volume_id here, just use heat get_resource would be enough. This fix should work with tc006 test case. JIRA: YARDSTICK-1371 Change-Id: I913ffd085f742ae4464dbcc4269719e2c50e37b5 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-08Fix duration value for IXIA traffic itemMyron Sosyak2-1/+5
Removed code that overrides duration value in the update_frame function JIRA: YARDSTICK-1369 Change-Id: Ice06e4fbba4ec93ae086671a2530d521510f89da Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-08-07Merge "Change assert statements to raises in CheckValue"Rex Lee3-29/+56
2018-08-07Merge "Separate out test_parse_to_value_exception()"Rex Lee1-4/+9
2018-08-07Merge "[workaround] Disable gui for aarch64"Rex Lee1-8/+18
2018-08-07Merge "Bugfix: HA test case baremetal down ipmi power off failed - dovetail"Rex Lee2-29/+5
2018-08-03Merge "Add UT: ArithmeticRunner worker normal operation"Abhijit Sinha1-0/+182
2018-08-03Merge "Add unit test file for ArithmeticRunner"Abhijit Sinha1-0/+38
2018-08-03Merge "IXIA: Add IP random range `seed` configuration option"Abhijit Sinha6-2/+18
2018-08-03Merge "Add UDP ports configuration to IXIA traffic profile"Abhijit Sinha9-5/+174
2018-08-03Merge "Change AutoConnectSSH to return error code by default"Abhijit Sinha2-1/+24
2018-08-03IXIA: Add IP random range `seed` configuration optionMyron Sosyak6-2/+18
Added IP random range `seed` configuration option into IXIA traffic profile. JIRA: YARDSTICK-1364 Change-Id: Ic050b6cc48ea75ac6d0470bf7ec1b188649811e1 Signed-off-by: Sosyak, Myronx <myronx.sosyak@intel.com> Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-02NSB NFVi PROX BNG and vPE losing many packetsDanielMartinBuckley9-10/+109
JIRA: YARDSTICK-1101 The traffic generated by the generator in bng-4 result in non-symmetrical use of the cores on the SUT, as a whole range of IP addresses is skipped. Update cpe0 and cpe1 in gen files. In addition, for the routing table (ipv4.lua) for the BNG should be slighly different: while the BNG is a 4 ports test, only 2 of the ports are used as outgoing routing ports (the inet ports). Hence, the routing table should only use the mac of those two ports. The bad configuration (using 4 ports) result in an issue when BNG SUT and GEN are connected through a switch, packets are sent by the BNG SUT through the INET interfaces, but sometimes with the MAC of the CPE interface... Hence, packets are received on the wrong interface on the Gen site (resulting in some interfaces, the CPE ones, being overloaded) Created ipv4_bng.lua and remove mac 0 and 2 Change-Id: I97019f0415d2f58d50ec855d04800eb705f41541 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-02Add UDP ports configuration to IXIA traffic profileMyron Sosyak9-5/+174
- Implemented handling of UDP source and destination ports from IXIA traffic profile. - UDP ports can be defined as a single value or as a random range. Ports range is configured with two parameters 'fixed_bits' and 'mask_bits'. - For example '8-48' range definition will create a repeatable pattern of four values that fall within the range of 8 and 56. JIRA: YARDSTICK-1363 Change-Id: I0ace722f6be843ea79c3d3f4de22cb8fa5669d4f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Pshyk Serhiy <serhiyx.pshyk@intel.com> Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-02Merge "Remove hw_video_model and hw_firmware_type from metadata"Abhijit Sinha1-15/+1
2018-08-02Merge "Replace assert statements in PipelineRules"Abhijit Sinha3-6/+22
2018-08-02Change AutoConnectSSH to return error code by defaultMytnyk, Volodymyr2-1/+24
AutoConnectSSH execute method always returns exception when remote command returns non 0 ret code. This behavior has been introduced by https://gerrit.opnfv.org/gerrit/#/c/58579/ changes which break the NSB functionality. There are 200+ places where return code (event non zoro) is expected to be returned by AutoConnectSSH.execute() method. Right now the method returns always exception in case of remote command return not zero which causes the problem. Changed execute() method to have previous behavior (raise_on_error is always False by default) and the exception is raised only in case if raise_on_error=True is set explicitly. Added UT. JIRA: YARDSTICK-1365 Change-Id: Ib067583ea5eb704b9174084b45b920c24eb307ac Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-02Separate out test_parse_to_value_exception()John O'Loughlin1-4/+9
Separate out test_parse_to_value_exception(self) into 3 different methods:     test_parse_scanner(self)     test_parse_parser(self)     test_parse_reader(self) This ensures that each side effect is tested, even if one fails. JIRA: YARDSTICK-940 Change-Id: Ifdc84284c633fe1ddc1acf9cd985c5144030b430 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-08-01Remove hw_video_model and hw_firmware_type from metadataDelia Popescu1-15/+1
Starting with the Openstack Queens release, hw_firmware_type=uefi is implied on AArch64 by default Using virtio-video, now default in nova, should be used instead of VGA JIRA: ARMBAND-388 Change-Id: If52206e2a2f0a05bde5632c91de9367fffdc2eb3 Signed-off-by: Delia Popescu <delia.popescu@enea.com>
2018-07-31Replace assert statements in PipelineRulesMiikka Koistinen3-6/+22
The class PipelineRules uses assert statements to check the correctness of an input parameter IP address. This commit will modify these lines to use a dedicated function "common.utils.make_ipv4_address". JIRA: YARDSTICK-966 Change-Id: I1c4cc439a7716d36548125c87dfb0bc200714a56 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-31[workaround] Disable gui for aarch64Cristina Pauna1-8/+18
Currently the aarch64 yardstick image doesn't build because phantomsj and bower don't install properly. Temporarily disable gui for aarch64 only so we can still get the other updates. JIRA: ARMBAND-391 Change-Id: I64f892641c7bdb1cb3a65b210f71b093878b1688 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2018-07-31Fix remote command execution in common.utilsMiikka Koistinen3-8/+37
yardstick.common.utils get_port_mac and get_port_ip both raise a RuntimeError on positive remote command exit status. This commit fixes them to use the error raising mechanism in yardstick.ssh.SSH. Additionally, the class AutoConnectSSH class needed an additional argument to allow the raising mechanism to work correctly. JIRA: YARDSTICK-1240 Change-Id: Idad125ebbd668cef10a6149eb3e601a437a8d40d Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-31Cleanup pktgen_dpdk unit testsMiikka Koistinen1-128/+69
* Improve test execution * Use common functionality in setUp() * Disable logging * Remove tests that test common/utils code. These tests are moved to common/utils's unit tests in a follow-up patch. JIRA: YARDSTICK-1239 Change-Id: I88d047fe25c4c13bea446c9fc9bda92306420296 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-31Change assert statements to raises in CheckValueMiikka Koistinen3-29/+56
* Instead of using assert statements, raise a custom exception. * Modify the unit tests so that they do not test unused parameters for equality. * Fix pylint and pep8 errors. JIRA: YARDSTICK-966 Change-Id: I41e13a5a22086827792eaf9de8da2e4ed6dd42de Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-31Merge "Check for network already created k8"Emma Foley4-8/+97
2018-07-31Merge "Cleanup pktgen unit tests"Emma Foley1-490/+274
2018-07-31Merge "Change assert statement to raise in common/utils"Rex Lee3-2/+18
2018-07-31Merge "Refactor remote command execution in vsperf_dpdk"Rex Lee2-42/+26
2018-07-31Merge "Refactor remote command execution in vsperf"Rex Lee2-34/+22
2018-07-31the recovery action of "baremetal down" should be triggered mandatoryrexlee87765-4/+60
YARDSTICK-1222 has made attacker recover only when the sla not pass. But for baremetal down test case, the node need to power on even the sla pass. TODO: Make attacker can support mandatory recover in some situation. JIRA: YARDSTICK-1337 Change-Id: Ib567b9b9025e5ee421ea47140c468537ad16f090 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-07-30Cleanup pktgen unit testsMiikka Koistinen1-490/+274
* Improve test execution * Use common functionality in setUp() * Disable logging JIRA: YARDSTICK-1238 Change-Id: I0904bf99f0e151b437d506bf322da83f706dcf8f Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-30Change assert statement to raise in common/utilsMiikka Koistinen3-2/+18
This modification utilises a custom exception to be raised if an invalid mac address is passed to the function "mac_address_to_hex_list". JIRA: YARDSTICK-966 Change-Id: Ic2940276f500e9710c54963a445a137e73bd6b25 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-30Make ixnet a class attribute in TestIxNextgenEmma Foley1-151/+85
Change-Id: Iad8e8397f4ef339f70c6eef80ef58b1b045ef3fa Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-07-27Refactor remote command execution in vsperf_dpdkMiikka Koistinen2-42/+26
* Remove unneeded variables * Do not raise RuntimeError when a remote command fails, instead leave it for the yardstick ssh module to handle. * Prevent CsvReader from raising StopIteration if csv output cannot be parsed. The SLA validation will take care of errors in that case. JIRA: YARDSTICK-1166 Change-Id: I9e353d39dfd3bd27407dde32744ce71b5762e84e Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-27Refactor remote command execution in vsperfMiikka Koistinen2-34/+22
* Remove unneeded variables * Do not raise RuntimeError when a remote command fails, instead leave it for the yardstick ssh module to handle. * Prevent CsvReader from raising StopIteration if csv output cannot be parsed. The SLA validation will take care of errors in that case. JIRA: YARDSTICK-1166 Change-Id: I6cf550bd7bc8f511b3c0f25c67f8caab18bccd28 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-07-27Add UT: ArithmeticRunner worker normal operationMiikka Koistinen1-0/+182
* Use time.sleep to avoid multiprocessing.Queue broken pipe error. JIRA: YARDSTICK-1245 Change-Id: I0176c062f44830804ddbeebeb012afc1f9e20d41 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>