aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-10-30Add RFC2544 iteration status fieldMytnyk, Volodymyr5-10/+36
Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-30Merge "Pod file fix for Prox 2 port"Abhijit Sinha1-2/+0
2018-10-30Merge "Fix latency for ACL test cases"Abhijit Sinha2-8/+18
2018-10-30add error logs to storperfAmeed Ashour1-16/+21
add error logs to storperf.py in order to show the errors in task log API JIRA: YARDSTICK-1407 Change-Id: I7cefd09cbd7bdefca98c9220f886675b6a5b02a4 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-10-30Dashboard with Network and Platform NFVi metricsAbhijit Sinha1-0/+13889
Added the PROX L3FWD Grafana dashboard with NFVi metrics collected from barometer collectd container. The dashboard has template field for HOST/SUT name to get the collectd metrics from that SUT. JIRA: YARDSTICK-1412 Update: - Added table and graphs for TG NFVi metrics - Added TG and SUT templates as IP address - Added IPC(instruction per cycles) metric Change-Id: I1f8971f551df27ad6a16241693527285610fc82d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-10-30[docs] Fix links to remove references to submodulesAric Gardner2-6/+6
All references to submodules must be removed for docs to work going forward. Can be tested once your project has a local tox file Change-Id: Id74581cc584f70ae0b31e31c9dd91593c7be6615 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-10-30[docs] Update on Yardstick installationStepan Andrushko2-0/+113
Added details how to install Yardstick using install.yaml. Updated: - 04-installation.rst - 13-nsb-installation.rst JIRA: YARDSTICK-1335 Change-Id: I526c328f1b197833a2cf496cfef15ba89c11fab1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-30Merge "Add test library name update in DMF and mainflows"Abhijit Sinha2-10/+54
2018-10-30Merge "Add traffic duration support in test case"Abhijit Sinha3-3/+26
2018-10-30Merge "Proposing Volodymyr Mytnyk as a committer to Yardstick"Rex Lee2-0/+5
2018-10-30Merge "[docs] Add developer guidelines for contribution"Rex Lee1-0/+89
2018-10-30Merge "[docs] Add conventions for writing unit tests."Rex Lee1-0/+51
2018-10-30[docs] Add conventions for writing unit tests.Emma Foley1-0/+51
Added details of conventions used when writing unit tests. JIRA: YARDSTICK-1335 Change-Id: I7bb141126968c88c8a2d7e0dce4f33ed6f79cee4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30[docs] Add developer guidelines for contributionEmma Foley1-0/+89
A new section was added to the devguide, stating expectations for code contributions. * What to include in a change * Code style guidelines * How to run tests JIRA: YARDSTICK-1335 Change-Id: Idfe7790042a3a3fe6cd8763374b10f2268bd63cd Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30[docs] Update the glossaryEmma Foley1-13/+62
Add some new terms (OpenStack, Docker, PROX). JIRA: YARDSTICK-1335 Change-Id: I948957cf7b1540f7a027ab9da2d829e5e05c87c8 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-29Fix latency for ACL test casesPatrice Buriez2-8/+18
JIRA: YARDSTICK-1460 Cores running "mode=lat" must be properly configured with a correct "lat pos" parameter. When this parameter is missing, PROX exits with an error message. When the "lat pos" parameter is missing for cores running "mode=gen", latency values are not written into the packets. Also fixed some typos, packet inline format, IP len and UDP len. Change-Id: Ice06c5d74686c80f09bc60f568993dbf3165b338 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-29Add IxNextgen API for settings IP priorityOleksandr Naumets3-3/+117
Add IxNextgen API for setting IP priority which includes: - Raw priority; - ToS; - Diff-Serv. JIRA: YARDSTICK-1488 Change-Id: I83d85db113a5374fdafc3d50130e5e3584edfc4a Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-29Merge "Allow to see steady state status in the yardstick logs"Rex Lee1-3/+12
2018-10-27Setup hugepages on SA host(sriov, ovs_dpdk)Serhiy Pshyk8-70/+76
JIRA: YARDSTICK-1461 Change-Id: Ia1f5026eee989672aac57775ec9dd182df658fa4 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-26Merge "Add Testcase for Prox Standalone OvS-DPDK."Abhijit Sinha1-0/+97
2018-10-26Merge "Add Testcase for Prox Standalone SRIOV."Abhijit Sinha2-0/+123
2018-10-26Merge "Trex KPI are not collected due to rabbitmq user"Abhijit Sinha3-8/+40
2018-10-26Add traffic duration support in test caseOrest Voznyy3-3/+26
Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-26Add Testcase for Prox Standalone SRIOV.Carey, Alan2-0/+123
No sample testcase for prox SRIOV standalone. Renamed pod file so that other prox testcases can use this file JIRA: YARDSTICK-1471 Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33 Signed-off-by: Carey, Alan <alan.carey@intel.com>
2018-10-26Add Testcase for Prox Standalone OvS-DPDK.Carey, Alan1-0/+97
No sample testcase for prox OvS-DPDK standalone. JIRA: YARDSTICK-1475 Change-Id: Ide65444d08d6c90e7e98d59b7d1f4cba8ca7397f Signed-off-by: Carey, Alan <alan.carey@intel.com>
2018-10-26Add IOMMU to grub to support OVS/SRIOV SA contextsStepan Andrushko5-34/+39
It is required to setup IOMMU in grub to run standalone context tests: OVS/DPDK and SRIOV. Updated existing "enable_iommu_on_boot" role and NSB setup scripts: "ansible/install.yaml" and "ansible/ubuntu_server_baremetal_deploy_samplevnfs.yml". JIRA: YARDSTICK-1469 Change-Id: I348e4ebbffe89c7356352f43b7a6c1fdc4d81479 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-26Proposing Volodymyr Mytnyk as a committer to YardstickEmma Foley2-0/+5
Volodymyr has contributed to Yardstick in the following ways over the last year: * Regular reviews * Validation of changes * Bug fixes across different contexts, TGs and SampleVNFs * Tested and updated many sample testcases for NSB * Installer improvements Change-Id: I9a28ac15bd6ceb5f5c599e602fb2651bd7b9e622 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-26Add test library name update in DMF and mainflowsOrest Voznyy2-10/+54
Add automatic update of traffic profile items library name update, as well as update of session profile Dmf library name, to avoid the need of user changing it in template files. Update affected unit tests. JIRA: YARDSTICK-1474 Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-26Add IxNextgen API for checking protocols statusOleksandr Naumets2-0/+52
Added IxNextgen API methods which allows to check status of created protocols JIRA: YARDSTICK-1468 Change-Id: Id40b59ac258bcce6501862520bd042d31d926783 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-26Pod file fix for Prox 2 portAbhijit Sinha1-2/+0
Removing the "keyfile" from the pod file to align with other pod files for 1 and 4 port. The file when used as such currently gives an error. This change will fix that. JIRA:YARDSTICK-1477 Change-Id: Ibfa9387d068a0098ea0eb0b31ad96108d0602abc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-10-26Trex KPI are not collected due to rabbitmq userStepan Andrushko3-8/+40
Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-26Fix default IPv4 mask for IxNetwork traffic configSerhiy Pshyk1-5/+2
IP mask is set depending on the IP range provided by the user in the traffic profile. In case of single IP in range, IPV4LENGTH value is used as mask should cover all address bits. JIRA: YARDSTICK-1478 Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-26fix yardstick verify jobrexlee87761-2/+7
The regex is not compatible with pip version 18. JIRA: INFRA-310 Change-Id: I6eaf1e3fac183f85c277934929e9065efa88d877 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-10-17Merge "Added traffic update capability to Ixload TG"Abhijit Sinha9-50/+335
2018-10-17Merge "[docs] Transition to local docs build job."Rex Lee6-0/+39
2018-10-16Add IxNextgen API for setting tracking optionsOleksandr Naumets2-0/+53
Added IxNextgen API for setting: - ingress flows tracking options - egress flows tracking options JIRA: YARDSTICK-1472 Change-Id: Ia604025a7d181213200c6562260b25cf11d4d73e Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-16Merge "Adds option parameters to TC074"Kubi3-1/+24
2018-10-12Merge "Add 4 port topology for agnostic vnf and Ixia tg"Abhijit Sinha1-0/+71
2018-10-12Merge "Add OvS 2.8.1 support into SA context"Abhijit Sinha1-1/+2
2018-10-12Merge "Configure n_rxq DPDK port option when adding the port"Abhijit Sinha1-7/+5
2018-10-12Merge "Modify handling Ixia traffic profile parameters"Abhijit Sinha3-94/+127
2018-10-11Test case override of traffic profile settings.DanielMartinBuckley3-8/+49
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-10-11Added traffic update capability to Ixload TGMyron Sosyak9-50/+335
Allow yardstick to update IP/MAX of Net traffic - Implemented functionality for updating traffics IP/MAC address in ixloadconfiguration. - Extended http_ixload.py with functions for update IP/MAC address of netTraffic. - In HTTP-vFW_IPv4_2Ports_Concurrency.rxf changed name's of networks from "client network" to "uplink_0 and the same for server JIRA: YARDSTICK-1418 Change-Id: I28ef68b77466fff15af589954e3ef63e8099428f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>
2018-10-11Fix python lib path for ixload control subprocessChornyi, TarasX1-1/+9
JIRA: YARDSTICK-1390 Change-Id: I3ef5242862c98d3b389ba127f909f47e26c0711d Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-10-10Modify handling Ixia traffic profile parametersOleksandr Naumets3-94/+127
Modified Ixia traffic profile class to handle all traffic parameters as optional. JIRA: YARDSTICK-1456 Change-Id: Ib7ee1728baad0f271dd6a923b94bc686bc9bffc6 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-10Add IxNextgen API for creating BGP protocol layerOleksandr Naumets2-0/+41
Added functionality to create BGP protocol layer for device group JIRA: YARDSTICK-1465 Change-Id: Ib18b979ce09589b5eda438f01f4f8845295e4c71 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-09[docs] Transition to local docs build job.Emma Foley6-0/+39
Docs builds have transitioned to using local build jobs. This allows Yardstick docs to be built and verified locally. The time taken to build and verify docs in the gate for new changes should be reduced, as the docs for each project will be built separately. This change also allow contributers to test their docs builds locally, using tox:: tox -e docs tox -e docs-linkcheck TODO: Update the dev guide to include new tox environment Related: DOCS-191 JIRA: YARDSTICK-1415 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ib8bab85475dcd5127a2c41a2d55dce8f8d9da574
2018-10-05Add 4 port topology for agnostic vnf and Ixia tgSerhiy Pshyk1-0/+71
JIRA: YARDSTICK-1466 Change-Id: I2e4b7f54591489a90c44535a09207de8a46d0e24 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-05Update Ixia tg to use new API for traffic model creationSerhiy Pshyk1-1/+4
JIRA: YARDSTICK-1464 Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-04Configure n_rxq DPDK port option when adding the portMytnyk, Volodymyr1-7/+5
On some platform, setting n_rxq option on port separately does not work well and causes issues like port link down, so changed the logic to set n_rxq DPDK port option during adding the port to the bridge which help to resolve the problem. JIRA: YARDSTICK-1463 Change-Id: Icdb064153a38afd53b835de8742e6fcef08f66bb Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>