aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-10-30[docs] Update on Yardstick installationStepan Andrushko2-0/+113
Added details how to install Yardstick using install.yaml. Updated: - 04-installation.rst - 13-nsb-installation.rst JIRA: YARDSTICK-1335 Change-Id: I526c328f1b197833a2cf496cfef15ba89c11fab1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-30Merge "Add test library name update in DMF and mainflows"Abhijit Sinha2-10/+54
2018-10-30Merge "Add traffic duration support in test case"Abhijit Sinha3-3/+26
2018-10-30Merge "Proposing Volodymyr Mytnyk as a committer to Yardstick"Rex Lee2-0/+5
2018-10-30Merge "[docs] Add developer guidelines for contribution"Rex Lee1-0/+89
2018-10-30Merge "[docs] Add conventions for writing unit tests."Rex Lee1-0/+51
2018-10-30[docs] Add conventions for writing unit tests.Emma Foley1-0/+51
Added details of conventions used when writing unit tests. JIRA: YARDSTICK-1335 Change-Id: I7bb141126968c88c8a2d7e0dce4f33ed6f79cee4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30[docs] Add developer guidelines for contributionEmma Foley1-0/+89
A new section was added to the devguide, stating expectations for code contributions. * What to include in a change * Code style guidelines * How to run tests JIRA: YARDSTICK-1335 Change-Id: Idfe7790042a3a3fe6cd8763374b10f2268bd63cd Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30[docs] Update the glossaryEmma Foley1-13/+62
Add some new terms (OpenStack, Docker, PROX). JIRA: YARDSTICK-1335 Change-Id: I948957cf7b1540f7a027ab9da2d829e5e05c87c8 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-29Fix latency for ACL test casesPatrice Buriez2-8/+18
JIRA: YARDSTICK-1460 Cores running "mode=lat" must be properly configured with a correct "lat pos" parameter. When this parameter is missing, PROX exits with an error message. When the "lat pos" parameter is missing for cores running "mode=gen", latency values are not written into the packets. Also fixed some typos, packet inline format, IP len and UDP len. Change-Id: Ice06c5d74686c80f09bc60f568993dbf3165b338 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-29Merge "Allow to see steady state status in the yardstick logs"Rex Lee1-3/+12
2018-10-26Merge "Add Testcase for Prox Standalone OvS-DPDK."Abhijit Sinha1-0/+97
2018-10-26Merge "Add Testcase for Prox Standalone SRIOV."Abhijit Sinha2-0/+123
2018-10-26Merge "Trex KPI are not collected due to rabbitmq user"Abhijit Sinha3-8/+40
2018-10-26Add traffic duration support in test caseOrest Voznyy3-3/+26
Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-26Add Testcase for Prox Standalone SRIOV.Carey, Alan2-0/+123
No sample testcase for prox SRIOV standalone. Renamed pod file so that other prox testcases can use this file JIRA: YARDSTICK-1471 Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33 Signed-off-by: Carey, Alan <alan.carey@intel.com>
2018-10-26Add Testcase for Prox Standalone OvS-DPDK.Carey, Alan1-0/+97
No sample testcase for prox OvS-DPDK standalone. JIRA: YARDSTICK-1475 Change-Id: Ide65444d08d6c90e7e98d59b7d1f4cba8ca7397f Signed-off-by: Carey, Alan <alan.carey@intel.com>
2018-10-26Proposing Volodymyr Mytnyk as a committer to YardstickEmma Foley2-0/+5
Volodymyr has contributed to Yardstick in the following ways over the last year: * Regular reviews * Validation of changes * Bug fixes across different contexts, TGs and SampleVNFs * Tested and updated many sample testcases for NSB * Installer improvements Change-Id: I9a28ac15bd6ceb5f5c599e602fb2651bd7b9e622 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-26Add test library name update in DMF and mainflowsOrest Voznyy2-10/+54
Add automatic update of traffic profile items library name update, as well as update of session profile Dmf library name, to avoid the need of user changing it in template files. Update affected unit tests. JIRA: YARDSTICK-1474 Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-26Add IxNextgen API for checking protocols statusOleksandr Naumets2-0/+52
Added IxNextgen API methods which allows to check status of created protocols JIRA: YARDSTICK-1468 Change-Id: Id40b59ac258bcce6501862520bd042d31d926783 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-26Pod file fix for Prox 2 portAbhijit Sinha1-2/+0
Removing the "keyfile" from the pod file to align with other pod files for 1 and 4 port. The file when used as such currently gives an error. This change will fix that. JIRA:YARDSTICK-1477 Change-Id: Ibfa9387d068a0098ea0eb0b31ad96108d0602abc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-10-26Trex KPI are not collected due to rabbitmq userStepan Andrushko3-8/+40
Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-26Fix default IPv4 mask for IxNetwork traffic configSerhiy Pshyk1-5/+2
IP mask is set depending on the IP range provided by the user in the traffic profile. In case of single IP in range, IPV4LENGTH value is used as mask should cover all address bits. JIRA: YARDSTICK-1478 Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-26fix yardstick verify jobrexlee87761-2/+7
The regex is not compatible with pip version 18. JIRA: INFRA-310 Change-Id: I6eaf1e3fac183f85c277934929e9065efa88d877 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-10-17Merge "Added traffic update capability to Ixload TG"Abhijit Sinha9-50/+335
2018-10-17Merge "[docs] Transition to local docs build job."Rex Lee6-0/+39
2018-10-16Add IxNextgen API for setting tracking optionsOleksandr Naumets2-0/+53
Added IxNextgen API for setting: - ingress flows tracking options - egress flows tracking options JIRA: YARDSTICK-1472 Change-Id: Ia604025a7d181213200c6562260b25cf11d4d73e Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-16Merge "Adds option parameters to TC074"Kubi3-1/+24
2018-10-12Merge "Add 4 port topology for agnostic vnf and Ixia tg"Abhijit Sinha1-0/+71
2018-10-12Merge "Add OvS 2.8.1 support into SA context"Abhijit Sinha1-1/+2
2018-10-12Merge "Configure n_rxq DPDK port option when adding the port"Abhijit Sinha1-7/+5
2018-10-12Merge "Modify handling Ixia traffic profile parameters"Abhijit Sinha3-94/+127
2018-10-11Test case override of traffic profile settings.DanielMartinBuckley3-8/+49
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-10-11Added traffic update capability to Ixload TGMyron Sosyak9-50/+335
Allow yardstick to update IP/MAX of Net traffic - Implemented functionality for updating traffics IP/MAC address in ixloadconfiguration. - Extended http_ixload.py with functions for update IP/MAC address of netTraffic. - In HTTP-vFW_IPv4_2Ports_Concurrency.rxf changed name's of networks from "client network" to "uplink_0 and the same for server JIRA: YARDSTICK-1418 Change-Id: I28ef68b77466fff15af589954e3ef63e8099428f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>
2018-10-11Fix python lib path for ixload control subprocessChornyi, TarasX1-1/+9
JIRA: YARDSTICK-1390 Change-Id: I3ef5242862c98d3b389ba127f909f47e26c0711d Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-10-10Modify handling Ixia traffic profile parametersOleksandr Naumets3-94/+127
Modified Ixia traffic profile class to handle all traffic parameters as optional. JIRA: YARDSTICK-1456 Change-Id: Ib7ee1728baad0f271dd6a923b94bc686bc9bffc6 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-10Add IxNextgen API for creating BGP protocol layerOleksandr Naumets2-0/+41
Added functionality to create BGP protocol layer for device group JIRA: YARDSTICK-1465 Change-Id: Ib18b979ce09589b5eda438f01f4f8845295e4c71 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-09[docs] Transition to local docs build job.Emma Foley6-0/+39
Docs builds have transitioned to using local build jobs. This allows Yardstick docs to be built and verified locally. The time taken to build and verify docs in the gate for new changes should be reduced, as the docs for each project will be built separately. This change also allow contributers to test their docs builds locally, using tox:: tox -e docs tox -e docs-linkcheck TODO: Update the dev guide to include new tox environment Related: DOCS-191 JIRA: YARDSTICK-1415 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ib8bab85475dcd5127a2c41a2d55dce8f8d9da574
2018-10-05Add 4 port topology for agnostic vnf and Ixia tgSerhiy Pshyk1-0/+71
JIRA: YARDSTICK-1466 Change-Id: I2e4b7f54591489a90c44535a09207de8a46d0e24 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-05Update Ixia tg to use new API for traffic model creationSerhiy Pshyk1-1/+4
JIRA: YARDSTICK-1464 Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-04Configure n_rxq DPDK port option when adding the portMytnyk, Volodymyr1-7/+5
On some platform, setting n_rxq option on port separately does not work well and causes issues like port link down, so changed the logic to set n_rxq DPDK port option during adding the port to the bridge which help to resolve the problem. JIRA: YARDSTICK-1463 Change-Id: Icdb064153a38afd53b835de8742e6fcef08f66bb Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-04Add OvS 2.8.1 support into SA contextMytnyk, Volodymyr1-1/+2
JIRA: YARDSTICK-1462 Change-Id: I001a173fc728be6e88f5ae6d38c64b740e536ff2 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-03Merge "Fix influxdb "field type conflict" error"Emma Foley1-3/+3
2018-10-03Merge "Fix NSB PROX L3FWD dropping packets"Abhijit Sinha2-2/+14
2018-10-03Merge "NSB PROX NFVi Test does not stop after reaching expected precision"Abhijit Sinha12-19/+36
2018-10-03Adds option parameters to TC074Ameed Ashour3-1/+24
Add option parameters to TC074 to allow the user to specify volume type, volume count, availability zone, stack name, and subnet cidr. JIRA:YARDSTICK-1294 Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-10-02Fix NSB PROX L3FWD dropping packetsPatrice Buriez2-2/+14
JIRA: YARDSTICK-1037 Adjusted number of RX/TX descriptors to 2048, instead of default 256, in order to cope with interrupts during which no packets are received by the core, which results in the NIC dropping packets when it gets out of available descriptors to buffer them. Also adjusted mempool size, because more descriptors need more mbufs. This change aligns L3FWD test case with other test cases, for which number of RX/TX descriptors is already set to 2048. Change-Id: I11378c078398aca799295b619bb3d14dbee04ca3 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-02Fix influxdb "field type conflict" errorPatrice Buriez1-3/+3
JIRA: YARDSTICK-1457 Field types must be consistent across points in a measurement, otherwise influxdb rejects newer points with "field type conflict" error. This error was faced when "theor_max_throughput" field, meant to be assigned as a float from "TxThroughput" sample, was instead assigned as an int from initial value of theor_max_thruput variable. This especially occured for subsequent packet sizes, when theor_max_thruput variable was reset to its default int value. This fix changes the default value of theor_max_thruput variable to 0.0, and also makes sure that the default value for "Actual_throughput" field is consistently a float. Change-Id: If8d4f1297094709fe9657ab3e2b8adaad09815b2 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-02Modify IxNextgen API for traffic model configurationSerhiy Pshyk2-31/+97
Changes to IxNextgen API: - modify API for traffic model configuration so that it can be used to create/configure different models - add methods to start and stop protocols on IxNetwork - add method for getting assigned ports JIRA: YARDSTICK-1455 Change-Id: I43c10fea9ba83994caf373ceff8b0252a45439b3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-02NSB PROX NFVi Test does not stop after reaching expected precisionDanielMartinBuckley12-19/+36
JIRA: YARDSTICK-1419 When using prox_binsearch algorithm, a binary search is performed, increasing lower bound when step was successful and decreasing upper bound when the step was a failure. This runs until the test_precision (as specified in the traffic profile) is reached. When the test precision is reached, the test is not completed until the runner duration is reached. As runner duration is usually high (e.g. 1800sec), the tests take much too long to execute. This makes it difficult to create test suites. Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>