aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-12-20Merge "Addition of IRQ Mode to NSB NFVI (PROX)"Abhijit Sinha3-0/+916
2018-12-19Add report generate-nsb commandPatrice Buriez1-20/+32
JIRA: YARDSTICK-1367 Topic: report/html_table (8 of 12) Change-Id: I8a2f96224a745334b67dd71875bebb3b69b9adc3 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-19Merge "Extend ixnet api"Volodymyr Mytnyk1-0/+31
2018-12-19Extend ixnet apiChornyi, TarasX1-0/+31
Add protocol interface creation. Add static protocols ipv4 configuration. JIRA: YARDSTICK-1566 Change-Id: I484d212873ce7e638626053baaf6a972a6ef9f69 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-17Merge "Cleanup unittests for test_attacker_baremetal"Abhijit Sinha1-33/+40
2018-12-17Merge "Extend vBNG PPPoE test cases functionality"Volodymyr Mytnyk2-9/+143
2018-12-17Merge "Add support for configuring frame rate per traffic flow for IXIA"Volodymyr Mytnyk1-8/+8
2018-12-13Add support for configuring frame rate per traffic flow for IXIASerhiy Pshyk1-8/+8
Frame rate can be configured per traffic profile and per traffic flow. By default traffic profile is applied to all traffic flows. If per flow rate is specified it overrides default value from profile. JIRA: YARDSTICK-1568 Change-Id: I388ed78869358de17d6485be0cd0d058983390e2 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-13Add raise for iteration exception in IterationRunnercope.li1-0/+45
When we run the testcase, if there was a exception in iteration _work_process, the process will still run on ,and the test result will not affected by the exception. JIRA: YARDSTICK-1555 Change-Id: I03803c0473015379bb0eb20ed7d474a2d923a4e3 Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-11Extend vBNG PPPoE test cases functionalityOleksandr Naumets2-9/+143
Extended Ixia traffic generator with functionality to create traffic flows between device groups. JIRA: YARDSTICK-1521 Change-Id: Iaaa822f2f3da876629576d4101be29c9a65296d0 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-07Cleanup unittests for test_attacker_baremetalEmma Foley1-33/+40
unused-arg check was re-enabled after being disabled at a file level. Changes were made so that the file conforms to our testing conventions. JIRA: YARDSTICK-1384 Change-Id: I27b41e79fd6e4e9fbefccf8b72c4a43926e25312 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-12-07Add vBNG PPPoE test cases functionalitySerhiy Pshyk2-5/+395
Added vBNG PPPoE test cases functionality which allows to: - create and configure access network connections (PPPoE subscribers); - create and configure core network connections; - configure and run traffic between access and core network topologies. JIRA: YARDSTICK-1508 Change-Id: I90975505fe7318227a837d97e8db4a06712de7eb Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-11-29Merge "Distribute dpdk/vhostuser between CPUs for SA OVS"Volodymyr Mytnyk1-0/+7
2018-11-28Addition of IRQ Mode to NSB NFVI (PROX)DanielMartinBuckley3-0/+916
JIRA: YARDSTICK-1524 Add dashboard, Traffic Profile support, PROX IRQ support, topology Change-Id: I0c0cde66f4f4d3d25aa77c502bd4349cc1b3eca2 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-28Merge "NSB NFVi PROX Should report realtime port activity not historical data"Abhijit Sinha3-8/+177
2018-11-27NSB NFVi PROX Should report realtime port activity notDanielMartinBuckley3-8/+177
historical data JIRA: YARDSTICK-1458 The TG is only sampled at the end of every test interval. This is incorrect. It should be sampled every interval. Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-22Add parser to support jsTree in reportPatrice Buriez1-0/+70
Allow the user to select what data to show in the report using jsTree to navigate a hierarchical metrics list. JIRA: YARDSTICK-1367 Topic: report/html_table (4 of 11) Change-Id: I86d782a0a70b80a1cdfaab2f41afb7668066cbf7 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-11-22Fix OvS-DPDK context mem allocation problemMytnyk, Volodymyr1-1/+2
The hugepages allocated for OvS-DPDK context is not correct, thus it is causing an issue to allocate the required amount of memory for VM. JIRA: YARDSTICK-1538 Change-Id: I1a34199d4f78c999476603fa86d79ffc1fbf27c8 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-21Update unit tests for yardstick/benchmark/core/report.pyPatrice Buriez1-44/+70
* Remove redundant imports * Rename some constants * Add additional unit tests * Reword KeyError message JIRA: YARDSTICK-1367 Topic: report/html_table (1 of 11) Change-Id: I3d89c1ed9acaeb7421a0734e33075ebae252c035 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-11-20Make VM machine type as a user configurationMytnyk, Volodymyr1-2/+3
For backward compatibility, the default value of this option has been left unchanged. JIRA: YARDSTICK-1528 Change-Id: I42ceca96501f1136cba27d85c2d82240bd45c10c Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-14Remove unused functions vpeJohn O Loughlin1-73/+0
JIRA: YARDSTICK-1473 Change-Id: Ib9d3eb01f3fd900cbb08d55fc21fb95beceec941 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-13Distribute dpdk/vhostuser between CPUs for SA OVSStepan Andrushko1-0/+7
Update Yardstick with ability to distribute DPDK/vhost-user ports/queues between CPU cores. Extended OVS add vhost-user interface command with option "n_rxq", provided in the test case. Ordered ports added to OVS. JIRA: YARDSTICK-1490 Change-Id: I71f5d878a9ee3a11f636762fc16b04ee6bc79e14 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-11-12Merge "Implement functionality for updating http client"Volodymyr Mytnyk2-2/+77
2018-11-12Implement functionality for updating http clientMyron Sosyak2-2/+77
Implemented functionality for updating http client configuration. Extended http_ixload.py with functions for update page object and count of simulated users in http client on netTraffic. JIRA: YARDSTICK-1435 Change-Id: I9a0be226d4201d861d3a764864b42e5d87a4a305 Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>
2018-11-08Cleanup of ixia_profile attribute for IxNetwork TGOrest Voznyy1-3/+2
Remove obsolete attribute "ixia_profile" from - test cases using IxNetwork as a TG - from unit tests related to IxNetwork Remove ixncfg files from repo. Remove mention of ixncfg files from test case files JIRA: YARDSTICK-1506 Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-11-07Merge "Setup hugepages on SA host(sriov, ovs_dpdk)"Abhijit Sinha4-54/+47
2018-11-07Merge "Make OvS max_idle & queues configuration optional"Abhijit Sinha2-2/+2
2018-11-07Merge "Add IxNextgen API for settings IP priority"Abhijit Sinha1-3/+64
2018-11-07Merge "Add API for PPPoE clients statistic retrieval"Abhijit Sinha1-4/+16
2018-11-07Merge "Update: assign static IP to VM for standalone"Abhijit Sinha1-0/+2
2018-11-05Add API for PPPoE clients statistic retrievalOleksandr Naumets1-4/+16
Add IxNextgen API for PPPoE clients per port statistics retrieval. JIRA: YARDSTICK-1480 Change-Id: Ic22cf4a085ad957891575e9728584aee939a6630 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-11-05Update Multi Port Stats reading for PROXDanielMartinBuckley2-55/+276
JIRA: YARDSTICK-1458 Removed excessive jitter by removing extra sleeps in start/stop/reset ssh Removed extra retries when bad data returned Added a slep at end of test to give runner a chance to empty the queue on shutdown Added a timeout on port retry attempts Change-Id: Ica60b11c7af242817a83c154157827581f60d16a Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-05Merge "Test case override of traffic profile settings."Abhijit Sinha2-7/+39
2018-11-02Make OvS max_idle & queues configuration optionalMytnyk, Volodymyr2-2/+2
Remove hardcoded rx queue value JIRA: YARDSTICK-1493 Change-Id: Ia4944db21d94399c724bcabf4e0eae809518e7e9 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-01Merge "Add IxNextgen API for setting tracking options"Abhijit Sinha1-0/+20
2018-11-01Merge "Add IxNextgen API for checking protocols status"Abhijit Sinha1-0/+18
2018-10-30Update: assign static IP to VM for standaloneStepan Andrushko1-0/+2
Updated cloud-init network file to be used on Ubuntu 16.04 and Ubuntu 18.04. Fields 'macaddress' and 'prefix' modified in network-config file. JIRA: YARDSTICK-1402 Change-Id: Ibe7fb9dbf23326a0a6106f98d3b2b9fedf81f79a Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-30Add RFC2544 iteration status fieldMytnyk, Volodymyr2-5/+8
Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-30Merge "Add test library name update in DMF and mainflows"Abhijit Sinha1-5/+33
2018-10-29Add IxNextgen API for settings IP priorityOleksandr Naumets1-3/+64
Add IxNextgen API for setting IP priority which includes: - Raw priority; - ToS; - Diff-Serv. JIRA: YARDSTICK-1488 Change-Id: I83d85db113a5374fdafc3d50130e5e3584edfc4a Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-27Setup hugepages on SA host(sriov, ovs_dpdk)Serhiy Pshyk4-54/+47
JIRA: YARDSTICK-1461 Change-Id: Ia1f5026eee989672aac57775ec9dd182df658fa4 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-26Add traffic duration support in test caseOrest Voznyy1-3/+18
Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-26Add test library name update in DMF and mainflowsOrest Voznyy1-5/+33
Add automatic update of traffic profile items library name update, as well as update of session profile Dmf library name, to avoid the need of user changing it in template files. Update affected unit tests. JIRA: YARDSTICK-1474 Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-26Add IxNextgen API for checking protocols statusOleksandr Naumets1-0/+18
Added IxNextgen API methods which allows to check status of created protocols JIRA: YARDSTICK-1468 Change-Id: Id40b59ac258bcce6501862520bd042d31d926783 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-26fix yardstick verify jobrexlee87761-2/+7
The regex is not compatible with pip version 18. JIRA: INFRA-310 Change-Id: I6eaf1e3fac183f85c277934929e9065efa88d877 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-10-17Merge "Added traffic update capability to Ixload TG"Abhijit Sinha3-1/+155
2018-10-16Add IxNextgen API for setting tracking optionsOleksandr Naumets1-0/+20
Added IxNextgen API for setting: - ingress flows tracking options - egress flows tracking options JIRA: YARDSTICK-1472 Change-Id: Ia604025a7d181213200c6562260b25cf11d4d73e Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-12Merge "Modify handling Ixia traffic profile parameters"Abhijit Sinha1-0/+3
2018-10-11Test case override of traffic profile settings.DanielMartinBuckley2-7/+39
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-10-11Added traffic update capability to Ixload TGMyron Sosyak3-1/+155
Allow yardstick to update IP/MAX of Net traffic - Implemented functionality for updating traffics IP/MAC address in ixloadconfiguration. - Extended http_ixload.py with functions for update IP/MAC address of netTraffic. - In HTTP-vFW_IPv4_2Ports_Concurrency.rxf changed name's of networks from "client network" to "uplink_0 and the same for server JIRA: YARDSTICK-1418 Change-Id: I28ef68b77466fff15af589954e3ef63e8099428f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>