summaryrefslogtreecommitdiffstats
path: root/docs/submodules/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2018-11-07Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Allow to see steady state status in the yardstick logs" into stable/gambia - Allow to see steady state status in the yardstick logs Change-Id: Ic2281b300ed1de6ecd3daf14b5273db22688de8d JIRA: YARDSTICK-1454 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit ad08f101fa3a23e9a35fa9ba3e28dd22a054ef52)
2018-11-07Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Add Testcase for Prox Standalone SRIOV." into stable/gambia - Add Testcase for Prox Standalone SRIOV. No sample testcase for prox SRIOV standalone. Renamed pod file so that other prox testcases can use this file JIRA: YARDSTICK-1471 Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 0eaa53d46f1f2ced9a1d40ebf820580bf314b4a1)
2018-11-06Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Update Multi Port Stats reading for PROX" into stable/gambia - Update Multi Port Stats reading for PROX JIRA: YARDSTICK-1458 Removed excessive jitter by removing extra sleeps in start/stop/reset ssh Removed extra retries when bad data returned Added a slep at end of test to give runner a chance to empty the queue on shutdown Added a timeout on port retry attempts Change-Id: Ica60b11c7af242817a83c154157827581f60d16a Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit b2fd601c33e3322ccc9e675242f091dba2eeb644)
2018-11-06Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Test case override of traffic profile settings." into stable/gambia - Test case override of traffic profile settings. JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 383c438cda94a1004bc9552a5993fe3ff3e6da8f)
2018-11-06Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Add Testcase for Prox Standalone OvS-DPDK." into stable/gambia - Add Testcase for Prox Standalone OvS-DPDK. No sample testcase for prox OvS-DPDK standalone. JIRA: YARDSTICK-1475 Change-Id: Ide65444d08d6c90e7e98d59b7d1f4cba8ca7397f Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit b0e92a357658f4ece21e356653e8eb52d7ab8d98)
2018-11-06Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "[docs] Add vEPC test case preparation steps" into stable/gambia - [docs] Add vEPC test case preparation steps Add documentation to review the changes to original vEPC infrastructure files to configure NSB test run in a specific test setup. Add initial steps to prepare NSB to use Spirent Landslide for vEPC tests. JIRA: YARDSTICK-1459 Change-Id: I3b937b1a21d6ec6851a92946e46c679385fdff9c Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit dc55a775f7aa62be7ed17cc33aa1b0bac54c081f)
2018-11-06Update git submodulesRex Lee1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "[docs] Test case documentation for vEPC testing" into stable/gambia - [docs] Test case documentation for vEPC testing JIRA: YARDSTICK-1349 The test case document will cover the following: - test purpose - test configuration - pre-test conditions - test sequence - test verdict Change-Id: I2841a7ff3d248bb3e4739579fad722dc02b5504f Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit c8bde3b59031b352bf09302ae7644436860602d7)
2018-11-06Update git submodulesRex Lee1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge changes I526c328f,I7bb14112,Idfe77900 into stable/gambia * changes: [docs] Update on Yardstick installation [docs] Add conventions for writing unit tests. [docs] Add developer guidelines for contribution - [docs] Update on Yardstick installation Added details how to install Yardstick using install.yaml. Updated: - 04-installation.rst - 13-nsb-installation.rst JIRA: YARDSTICK-1335 Change-Id: I526c328f1b197833a2cf496cfef15ba89c11fab1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com> - [docs] Add conventions for writing unit tests. Added details of conventions used when writing unit tests. JIRA: YARDSTICK-1335 Change-Id: I7bb141126968c88c8a2d7e0dce4f33ed6f79cee4 Signed-off-by: Emma Foley <emma.l.foley@intel.com> - [docs] Add developer guidelines for contribution A new section was added to the devguide, stating expectations for code contributions. * What to include in a change * Code style guidelines * How to run tests JIRA: YARDSTICK-1335 Change-Id: Idfe7790042a3a3fe6cd8763374b10f2268bd63cd Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-11-01Update git submodulesMytnyk, Volodymyr1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Make OvS to listen on TCP by default JIRA: YARDSTICK-1492 Change-Id: I81c682d473ffe3d70ecbb42cce40c2d16e608b41 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-01Update git submodulesEmma Foley1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge changes Ia8783de8,I61421095 into stable/gambia * changes: Update: Trex KPI not collected no rabbitmq user Trex KPI are not collected due to rabbitmq user - Update: Trex KPI not collected no rabbitmq user Update of review #63707: missed yardstick password hash. This must be set on top of changes on review. JIRA: YARDSTICK-1479 Change-Id: Ia8783de81ad91ea7421c6bbff87a30c59db2d44c Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com> - Trex KPI are not collected due to rabbitmq user Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I6142109563fcdb27e0ec554dd08567a1a43237e7 (cherry picked from commit d06e6da19db545dfcc6fdfdc706b9cccdb75c498) formerly: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-11-01Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Fix default IPv4 mask for IxNetwork traffic config" into stable/gambia - Fix default IPv4 mask for IxNetwork traffic config IP mask is set depending on the IP range provided by the user in the traffic profile. In case of single IP in range, IPV4LENGTH value is used as mask should cover all address bits. JIRA: YARDSTICK-1478 Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-31Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Adding Grafana dashboard for visualizing the vEPC default bearer metrics." into stable/gambia - Adding Grafana dashboard for visualizing the vEPC default bearer metrics. The dashboard will highlight the Network metrics captured from Spirent landslide traffic generator. JIRA: YARDSTICK-1350 Change-Id: I47920446181355a97e875fd82afd633b336c8da6 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 5bf76a7a2ead6e8c3a0d8bc05c7ec89d9faaa5a5)
2018-10-31Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Revert "Trex KPI are not collected due to rabbitmq user"" into stable/gambia - Revert "Trex KPI are not collected due to rabbitmq user" This causes the docker-build jobs to fail in the CI. This reverts commit ce809669d3051524508edf5a3d69e83dde8a9080. Change-Id: Iea66bc92eaee39c5b7427ea55c190f8c0dbf5ad4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-31Update git submodulesEmma Foley1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "[docs] Update the glossary" into stable/gambia - [docs] Update the glossary Add some new terms (OpenStack, Docker, PROX). JIRA: YARDSTICK-1335 Change-Id: I948957cf7b1540f7a027ab9da2d829e5e05c87c8 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 78b5a19e3071cbc080eeae0bdf22f5ab80c03180)
2018-10-31Update git submodulesRex Lee1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Adds option parameters to TC074" into stable/gambia - Adds option parameters to TC074 Add option parameters to TC074 to allow the user to specify volume type, volume count, availability zone, stack name, and subnet cidr. JIRA:YARDSTICK-1294 Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit 43c28852a9c9abfe7fc66fca0dcc703b468db0cf)
2018-10-31Update git submodulesEmma Foley1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Dashboard with Network and Platform NFVi metrics" into stable/gambia - Dashboard with Network and Platform NFVi metrics Added the PROX L3FWD Grafana dashboard with NFVi metrics collected from barometer collectd container. The dashboard has template field for HOST/SUT name to get the collectd metrics from that SUT. JIRA: YARDSTICK-1412 Update: - Added table and graphs for TG NFVi metrics - Added TG and SUT templates as IP address - Added IPC(instruction per cycles) metric Change-Id: I1f8971f551df27ad6a16241693527285610fc82d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit e63084495f47a9f5b5b61b23529792d6898841bb)
2018-10-31Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Add RFC2544 iteration status field" into stable/gambia - Add RFC2544 iteration status field Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 0ff5b131fa3f93f8d47b46c2f13661c5b88d37a1)
2018-10-30Update git submodulesEmma Foley1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Add test library name update in DMF and mainflows" into stable/gambia - Add test library name update in DMF and mainflows Add automatic update of traffic profile items library name update, as well as update of session profile Dmf library name, to avoid the need of user changing it in template files. Update affected unit tests. JIRA: YARDSTICK-1474 Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit 1fd3806d6a6bac19f3173da4d6cb94cef81fd7f5)
2018-10-30Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Pod file fix for Prox 2 port" into stable/gambia - Pod file fix for Prox 2 port Removing the "keyfile" from the pod file to align with other pod files for 1 and 4 port. The file when used as such currently gives an error. This change will fix that. JIRA:YARDSTICK-1477 Change-Id: Ibfa9387d068a0098ea0eb0b31ad96108d0602abc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 31eac948bba5cf442981fdc7b1392992aaef1f15)
2018-10-30Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Fix latency for ACL test cases" into stable/gambia - Fix latency for ACL test cases JIRA: YARDSTICK-1460 Cores running "mode=lat" must be properly configured with a correct "lat pos" parameter. When this parameter is missing, PROX exits with an error message. When the "lat pos" parameter is missing for cores running "mode=gen", latency values are not written into the packets. Also fixed some typos, packet inline format, IP len and UDP len. Change-Id: Ice06c5d74686c80f09bc60f568993dbf3165b338 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 7bc7bfb1b43e6329bbfc0ed7a7c5554ebcf10c2b)
2018-10-30Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Add traffic duration support in test case" into stable/gambia - Add traffic duration support in test case Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit ae2ceba66519555749c67eefe2170ea716a1411b)
2018-10-30Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Trex KPI are not collected due to rabbitmq user" into stable/gambia - Trex KPI are not collected due to rabbitmq user Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com> (cherry picked from commit d06e6da19db545dfcc6fdfdc706b9cccdb75c498)
2018-10-30Update git submodulesEmma Foley1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Merge "Add OvS 2.8.1 support into SA context" into stable/gambia - Add OvS 2.8.1 support into SA context JIRA: YARDSTICK-1462 Change-Id: I001a173fc728be6e88f5ae6d38c64b740e536ff2 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit ad63af7f42d07cffde73c32727f170973ce5ba46)
2018-10-30Update git submodulesMytnyk, Volodymyr1-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - Configure n_rxq DPDK port option when adding the port On some platform, setting n_rxq option on port separately does not work well and causes issues like port link down, so changed the logic to set n_rxq DPDK port option during adding the port to the bridge which help to resolve the problem. JIRA: YARDSTICK-1463 Change-Id: Icdb064153a38afd53b835de8742e6fcef08f66bb Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit adcc29e56130f0f047b99528ce72b6f149643da7)
2018-10-27Update git submodulesrexlee87761-0/+0
* Update docs/submodules/yardstick from branch 'stable/gambia' - fix yardstick verify job The regex is not compatible with pip version 18. JIRA: INFRA-310 Change-Id: I6eaf1e3fac183f85c277934929e9065efa88d877 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit a4084d27de22c64ecb690369c7bed49175703adf) - Update Ixia tg to use new API for traffic model creation JIRA: YARDSTICK-1464 Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> (cherry picked from commit 81ed5cdea4c36d45c6463523c6a0bc38495e544a) - Merge "Fix influxdb "field type conflict" error" into stable/gambia - Merge "Fix NSB PROX L3FWD dropping packets" into stable/gambia - Merge "NSB PROX NFVi Test does not stop after reaching expected precision" into stable/gambia - Fix NSB PROX L3FWD dropping packets JIRA: YARDSTICK-1037 Adjusted number of RX/TX descriptors to 2048, instead of default 256, in order to cope with interrupts during which no packets are received by the core, which results in the NIC dropping packets when it gets out of available descriptors to buffer them. Also adjusted mempool size, because more descriptors need more mbufs. This change aligns L3FWD test case with other test cases, for which number of RX/TX descriptors is already set to 2048. Change-Id: I11378c078398aca799295b619bb3d14dbee04ca3 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 3adfba6bac0133bdbaa3db62e16f662e11d84fb8) - Merge "Modify IxNextgen API for traffic model configuration" into stable/gambia - Fix influxdb "field type conflict" error JIRA: YARDSTICK-1457 Field types must be consistent across points in a measurement, otherwise influxdb rejects newer points with "field type conflict" error. This error was faced when "theor_max_throughput" field, meant to be assigned as a float from "TxThroughput" sample, was instead assigned as an int from initial value of theor_max_thruput variable. This especially occured for subsequent packet sizes, when theor_max_thruput variable was reset to its default int value. This fix changes the default value of theor_max_thruput variable to 0.0, and also makes sure that the default value for "Actual_throughput" field is consistently a float. Change-Id: If8d4f1297094709fe9657ab3e2b8adaad09815b2 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 2f4418798a3cf245f863a617410403f226062ac8) - NSB PROX NFVi Test does not stop after reaching expected precision JIRA: YARDSTICK-1419 When using prox_binsearch algorithm, a binary search is performed, increasing lower bound when step was successful and decreasing upper bound when the step was a failure. This runs until the test_precision (as specified in the traffic profile) is reached. When the test precision is reached, the test is not completed until the runner duration is reached. As runner duration is usually high (e.g. 1800sec), the tests take much too long to execute. This makes it difficult to create test suites. Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 7d5ff45a3b793f5e50b4a32b2438ab11fed6c899) - Modify IxNextgen API for traffic model configuration Changes to IxNextgen API: - modify API for traffic model configuration so that it can be used to create/configure different models - add methods to start and stop protocols on IxNetwork - add method for getting assigned ports JIRA: YARDSTICK-1455 Change-Id: I43c10fea9ba83994caf373ceff8b0252a45439b3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> (cherry picked from commit 7237241a396871d637f9906c1fc93a8587a7b726) - Update the pinned sampleVNF version JIRA: YARDSTICK-1414 Updated the sampleVNF version to the most recent validated commit. Provided comments on accepted version types and values, and on where users can find alternative values, in case they want to try something different than the version recommended and validated for Yardstick/NSB. Change-Id: I336f96237fcfa8b580c91c787d722d368cc6c015 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit ee5d6413dbcbab40234e47ed3e74b85b704d6493)
2018-10-17Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Added traffic update capability to Ixload TG" - Added traffic update capability to Ixload TG Allow yardstick to update IP/MAX of Net traffic - Implemented functionality for updating traffics IP/MAC address in ixloadconfiguration. - Extended http_ixload.py with functions for update IP/MAC address of netTraffic. - In HTTP-vFW_IPv4_2Ports_Concurrency.rxf changed name's of networks from "client network" to "uplink_0 and the same for server JIRA: YARDSTICK-1418 Change-Id: I28ef68b77466fff15af589954e3ef63e8099428f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>
2018-10-17Update git submodulesRex Lee1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "[docs] Transition to local docs build job." - [docs] Transition to local docs build job. Docs builds have transitioned to using local build jobs. This allows Yardstick docs to be built and verified locally. The time taken to build and verify docs in the gate for new changes should be reduced, as the docs for each project will be built separately. This change also allow contributers to test their docs builds locally, using tox:: tox -e docs tox -e docs-linkcheck TODO: Update the dev guide to include new tox environment Related: DOCS-191 JIRA: YARDSTICK-1415 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ib8bab85475dcd5127a2c41a2d55dce8f8d9da574
2018-10-16Update git submodulesKubi1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Adds option parameters to TC074" - Adds option parameters to TC074 Add option parameters to TC074 to allow the user to specify volume type, volume count, availability zone, stack name, and subnet cidr. JIRA:YARDSTICK-1294 Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-10-12Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Add 4 port topology for agnostic vnf and Ixia tg" - Add 4 port topology for agnostic vnf and Ixia tg JIRA: YARDSTICK-1466 Change-Id: I2e4b7f54591489a90c44535a09207de8a46d0e24 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-12Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Add OvS 2.8.1 support into SA context" - Add OvS 2.8.1 support into SA context JIRA: YARDSTICK-1462 Change-Id: I001a173fc728be6e88f5ae6d38c64b740e536ff2 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-12Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Configure n_rxq DPDK port option when adding the port" - Configure n_rxq DPDK port option when adding the port On some platform, setting n_rxq option on port separately does not work well and causes issues like port link down, so changed the logic to set n_rxq DPDK port option during adding the port to the bridge which help to resolve the problem. JIRA: YARDSTICK-1463 Change-Id: Icdb064153a38afd53b835de8742e6fcef08f66bb Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-12Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Modify handling Ixia traffic profile parameters" - Modify handling Ixia traffic profile parameters Modified Ixia traffic profile class to handle all traffic parameters as optional. JIRA: YARDSTICK-1456 Change-Id: Ib7ee1728baad0f271dd6a923b94bc686bc9bffc6 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-12Update git submodulesOleksandr Naumets1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Add IxNextgen API for creating BGP protocol layer Added functionality to create BGP protocol layer for device group JIRA: YARDSTICK-1465 Change-Id: Ib18b979ce09589b5eda438f01f4f8845295e4c71 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-05Update git submodulesSerhiy Pshyk1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Update Ixia tg to use new API for traffic model creation JIRA: YARDSTICK-1464 Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-03Update git submodulesEmma Foley1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Fix influxdb "field type conflict" error" - Fix influxdb "field type conflict" error JIRA: YARDSTICK-1457 Field types must be consistent across points in a measurement, otherwise influxdb rejects newer points with "field type conflict" error. This error was faced when "theor_max_throughput" field, meant to be assigned as a float from "TxThroughput" sample, was instead assigned as an int from initial value of theor_max_thruput variable. This especially occured for subsequent packet sizes, when theor_max_thruput variable was reset to its default int value. This fix changes the default value of theor_max_thruput variable to 0.0, and also makes sure that the default value for "Actual_throughput" field is consistently a float. Change-Id: If8d4f1297094709fe9657ab3e2b8adaad09815b2 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-03Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Fix NSB PROX L3FWD dropping packets" - Fix NSB PROX L3FWD dropping packets JIRA: YARDSTICK-1037 Adjusted number of RX/TX descriptors to 2048, instead of default 256, in order to cope with interrupts during which no packets are received by the core, which results in the NIC dropping packets when it gets out of available descriptors to buffer them. Also adjusted mempool size, because more descriptors need more mbufs. This change aligns L3FWD test case with other test cases, for which number of RX/TX descriptors is already set to 2048. Change-Id: I11378c078398aca799295b619bb3d14dbee04ca3 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-10-03Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "NSB PROX NFVi Test does not stop after reaching expected precision" - NSB PROX NFVi Test does not stop after reaching expected precision JIRA: YARDSTICK-1419 When using prox_binsearch algorithm, a binary search is performed, increasing lower bound when step was successful and decreasing upper bound when the step was a failure. This runs until the test_precision (as specified in the traffic profile) is reached. When the test precision is reached, the test is not completed until the runner duration is reached. As runner duration is usually high (e.g. 1800sec), the tests take much too long to execute. This makes it difficult to create test suites. Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-10-02Update git submodulesSerhiy Pshyk1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Modify IxNextgen API for traffic model configuration Changes to IxNextgen API: - modify API for traffic model configuration so that it can be used to create/configure different models - add methods to start and stop protocols on IxNetwork - add method for getting assigned ports JIRA: YARDSTICK-1455 Change-Id: I43c10fea9ba83994caf373ceff8b0252a45439b3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-09-25Update git submodulesPatrice Buriez1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Update the pinned sampleVNF version JIRA: YARDSTICK-1414 Updated the sampleVNF version to the most recent validated commit. Provided comments on accepted version types and values, and on where users can find alternative values, in case they want to try something different than the version recommended and validated for Yardstick/NSB. Change-Id: I336f96237fcfa8b580c91c787d722d368cc6c015 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-09-21Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "SA: Fix private key file name generation issue" - SA: Fix private key file name generation issue In current implementation of Yardstick, SA context uses the same SSH key file name for each VM created. E.g. the Yardstick overrides the key file context each time the new VM is created. As a result, the key file is valid only for last VM created by Yardstick causing the connection problem for other VMs. Solution is to generate different key file name for each VM name separately. JIRA: YARDSTICK-1436 Change-Id: I22ae2874695736255aa3314654a2cced9338b53d Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-09-21Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "[NSB] Adds support for running "black box" test cases for VNFs" - [NSB] Adds support for running "black box" test cases for VNFs Using AgnosticVNF is now possible to create a "black box" testcase for any VNF. Example rfc2544 test with TRex as trafficgen samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml and Ixia samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml NOTE: Yardstick will not interact with VNF. No KPIs from VNF will be collected JIRA: YARDSTICK-1438 Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-09-20Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge changes from topics 'YARDSTICK-1354', 'YARDSTICK-1348', 'YARDSTICK-1359', 'YARDSTICK-1356' * changes: Add vEPC service request test cases Add network initiated dedicated bearers creation Add UE initiated dedicated bearer creation test Add vEPC infrastructure for Landslide TG Add vEPC default bearers relocation test case Add vEPC default bearers create/delete test case Add Spirent Landslide traffic profile templates Update LSResourceHelper unittests Add Spirent Landslide TG API Added Landslide Resource Helper implementation Add TclClients for Spirent Landslide TG - Add vEPC service request test cases Add UE and network initiated testcase and related session profiles. JIRA: YARDSTICK-1429 Change-Id: I16d6c065cf346db31e235ac5add57509cfbc8009 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Add network initiated dedicated bearers creation Adding related pod file, session profile and testcase file. JIRA: YARDSTICK-1355 Change-Id: Ic97d59ef3a36ac05c6c369c36f917ae95d18d863 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Add UE initiated dedicated bearer creation test Adding session profile and test case file. JIRA: YARDSTICK-1353 Change-Id: Iaa98fd8cb3ed243f9ac157089de32fa23ec0e6b4 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Add vEPC infrastructure for Landslide TG 1. Add yardstick topology and model for fully emulated environment. 2. Add support for black-box testing of real vEPC VNF vs Spirent Landslide traffic generator: - vEPC VNF pod file - topology and model files aware of vEPC VNF connection to Spirent Landslide TG - stub class for vEPC VNF, and related unit tests JIRA: YARDSTICK-1424 Change-Id: If7b6d19919679347c4360f4a0f2e420716e7fd2d Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Add vEPC default bearers relocation test case This test case runs on Spirent Landslide TG. All vEPC entities are emulated on Landslide test servers. Test case actions sequence: - create default bearers - start sending traffic - partial/full bearers relocation between two ENodeB's, Intra-MME - disconnect all bearers JIRA: YARDSTICK-1354 Change-Id: I95c7b0001ddb363402013d83ae8617b88b2a4bd9 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Add vEPC default bearers create/delete test case This test case runs on Spirent Landslide TG. All vEPC entities are emulated on Landslide test server. Test run configuration is performed in following files: 1. test case file 2. pod file 3. session profile file (landslide_session_default_bearer*.yaml) The structure of these files represents configuration of different parts of test cases in this test session. The order of test cases should always match. Spirent Landslide test types involved: "SGW_Node", "SGW_Nodal". Test case actions sequence: - create default bearers (as per value of "Sessions" key) with specified rate (session profile key "StartRate") - send traffic flow(s) (pre-configured in traffic profile) for a number of seconds (specified in session profile key "duration") - remove N default bearers with specified rate (session profile key "DisconnectRate") Parameters with ALL_CAPS values are placeholders. User should replace them with their own condifuration. Session profile file placeholders do not need to be replaced as long as these parameters are overriden in other files (e.g. pod, test case). Test results are dispatched according to runner configuration options. For fully emulated test runs like this one, best suited runner is "Search" type. In case of testing against real EPC VNFs, user could prefer different runner type. JIRA: YARDSTICK-1348 Change-Id: I5caf4878fb212b38d4148a297c5dba03b8ab98a8 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Add Spirent Landslide traffic profile templates These files are templates of Spirent Landslide data message flow (DMF) representing traffic profile of one or multiple traffic flows. Template files should not be edited directly. Instead, their parameters could be overriden in test case YAML file, in section "dmf". JIRA: YARDSTICK-1359 Change-Id: I4980a784a78ca870c18457227248e6e2ac0b8eda Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Update LSResourceHelper unittests New unit tests have been added to make sure the right commands are sent to Spirent LS. This helps to ensure that the correct commands are sent to Spirent, so that potentially breaking changes can be flagged. JIRA: YARDSTICK-1356 Change-Id: I23f452355afcec2705da7d4665a34b178e2ba729 Signed-off-by: Emma Foley <emma.l.foley@intel.com> - Add Spirent Landslide TG API New TG class "LandslideTrafficGen" represents an interface to use Spirent Landslide API to configure and execute vEPC test cases on hardware/software Spirent environment. For that purpose this class and its helper classes use Spirent Landslide REST API calls and Landslide TCL API calls via library module lsapi.py. Change-Id: Ib6560d5cd2483c6c9f5c95568345ac39bfebbd4d Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Added Landslide Resource Helper implementation Class "LandslideResourceHelper" provides API for operations needed - to configure Landslide test session - manage test session execution (start/stop/abort) - collect measurements during test run This helper class API is responsible to for configure Landslide test runs: - create test user - create test servers (for emulation of specific vEPC blocks) - create SUTs (actual tested VNFs performing specific vEPC roles) - create test session (contains actual test cases) - create DMFs (pre-defined traffic flows in traffic profile) - operate traffic run execution (start, stop, abort) - monitor test run status - collect KPIs on TG side Some of these features use Landslide REST API. Other ones use Landslide TCL API. JIRA: YARDSTICK-1356 Change-Id: I8fc8a7d85301121da465d054b8d38ae09a541c36 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> - Add TclClients for Spirent Landslide TG Add class "LandslideTclClient" which holds TCL calls wrappers for operations on the LandSlide TG. It also introduces several new parameters in - test case YAML file structure: * session_profile: YAML file holding a template of Landslide test session for specific vEPC test scenario * dmf: test case options member holding traffic flow specific parameters for designated test scenario, that override ones in traffic_profile YAML file * test_cases: test case options member holding parameters specific to designated vEPC test case, overriding those in session_profile template file - pod YAML file structure: * tas_manager: holds parameters used to connect to Spirent Landslide TAS * config: list of entries describing Landslide test servers access, their network interfaces configuration, information of vEPC elements emulated by specific test server Class "LandslideProfile" implements access to traffic profile template from "LandslideResourceHelper" class. JIRA: YARDSTICK-1356 Change-Id: Ia6428072b1e72025be17c94e5141bd23f7993247 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-19Update git submodulesSerhiy Pshyk1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Add IxNextgen API for creating Vlans configurations New IxNextgen API allows to configure Vlans(vlan id, priority, tp id) to Ethernet layer of device group. JIRA: YARDSTICK-1420 Change-Id: I1c5fe37b5beb11daf1c539933fcad60832553bb9 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-09-14Update git submodulesPatrice Buriez1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Fix Yardstick Docker image ARM build Soften sed pattern, in order to cope with new contents of ansible/install.yaml, recently modified by change 61173. Previous sed pattern does not work anymore against this changed line: https://gerrit.opnfv.org/gerrit/#/c/61173/4/ansible/install.yaml@39 JIRA: YARDSTICK-1411 Change-Id: I1e1ebd454900252c29263e746470e18e3139e016 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-09-13Update git submodulesAbhijit Sinha1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Cleanup unittests for test_lmbench" - Cleanup unittests for test_lmbench unused-arg check was re-enabled after being disabled at a file level. Changes were made so that the file conforms to our testing conventions. Change-Id: Ie34a0088258c1aaff6cb0fdf0b86b37920d35bd6 JIRA: YARDSTICK-1384 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-09-13Update git submodulesMytnyk, Volodymyr1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Assign IXIA ports in one call instead of one by one Assigning IXIA ports one by one takes more time than assign all ports by once. Also, assigning ports in one call resolves the assign port issues caused on some IXIA chassis versions. JIRA: YARDSTICK-1425 Change-Id: Ibb08e40ee1a8762573f6752bdd1f583c5a1d9d2a Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-09-13Update git submodulesEmma Foley1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Add UT: ArithmeticRunner exception handling" - Add UT: ArithmeticRunner exception handling * Use time.sleep to avoid multiprocessing.Queue broken pipe error. JIRA: YARDSTICK-1245 Change-Id: I1ef1f8e68a553278996b38c226314c13dd974faa Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-09-13Update git submodulesMytnyk, Volodymyr1-0/+0
* Update docs/submodules/yardstick from branch 'master' - IXIA traffic mac address is set incorrectly IXIA API sets the src/dst mac of the traffic always into default value. The `srcmac`/`dstmac` is never set in `traffic_param` map [1]. Instead the src/dst mac is stored in traffic_param[`outer_l2`]. [1] https://gerrit.opnfv.org/gerrit/gitweb?p=yardstick.git;a=blob;f=yardstick/network_services/traffic_profile/ixia_rfc2544.py;h=44bf2eafc7f8cf03ebd2c8520d316358fe1e5fc2;hb=HEAD#l92 JIRA: YARDSTICK-1423 Change-Id: Iabab7a54404b284d3b95bbea6c8624233c138351 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-09-13Update git submodulesRex Lee1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Update configure_uwsgi run in baremetal/container" - Update configure_uwsgi run in baremetal/container Now "daemonize" prevents from installing Yardstick on baremetal. Configuring: "daemonize" in case "container" installation mode; "logto" in case "baremetal" installation mode; JIRA: YARDSTICK-1395 Change-Id: Ie390464db9c0816583edc711ed6526629d091bd3 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-09-13Update git submodulesRex Lee1-0/+0
* Update docs/submodules/yardstick from branch 'master' - Merge "Revert "Bugfix: ansible version should be the same both in Dockerfile and requirements.txt"" - Revert "Bugfix: ansible version should be the same both in Dockerfile and requirements.txt" This reverts commit 662de49b9f6c116d15882aed9e678cd3cf67494b. JIRA: YARDSTICK-1411 Change-Id: Id277aa8711c9ff77e085d26c90546eecc3490535 Signed-off-by: rexlee8776 <limingjiang@huawei.com>