aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-11-01Make OvS to listen on TCP by defaultMytnyk, Volodymyr1-2/+2
JIRA: YARDSTICK-1492 Change-Id: I81c682d473ffe3d70ecbb42cce40c2d16e608b41 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-01Merge changes Ia8783de8,I61421095 into stable/gambiaEmma Foley3-8/+40
* changes: Update: Trex KPI not collected no rabbitmq user Trex KPI are not collected due to rabbitmq user
2018-11-01Merge "Fix default IPv4 mask for IxNetwork traffic config" into stable/gambiaAbhijit Sinha1-5/+4
2018-10-31Update: Trex KPI not collected no rabbitmq userStepan Andrushko1-1/+1
Update of review #63707: missed yardstick password hash. This must be set on top of changes on review. JIRA: YARDSTICK-1479 Change-Id: Ia8783de81ad91ea7421c6bbff87a30c59db2d44c Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-31Trex KPI are not collected due to rabbitmq userStepan Andrushko3-8/+40
Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I6142109563fcdb27e0ec554dd08567a1a43237e7 (cherry picked from commit d06e6da19db545dfcc6fdfdc706b9cccdb75c498) formerly: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-31Merge "Adding Grafana dashboard for visualizing the vEPC default bearer ↵Abhijit Sinha1-0/+1354
metrics." into stable/gambia
2018-10-31Merge "Revert "Trex KPI are not collected due to rabbitmq user"" into ↵Abhijit Sinha3-40/+8
stable/gambia
2018-10-31Revert "Trex KPI are not collected due to rabbitmq user"Emma Foley3-40/+8
This causes the docker-build jobs to fail in the CI. This reverts commit ce809669d3051524508edf5a3d69e83dde8a9080. Change-Id: Iea66bc92eaee39c5b7427ea55c190f8c0dbf5ad4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-31Adding Grafana dashboard for visualizing the vEPC default bearer metrics.Carey, Alan1-0/+1354
The dashboard will highlight the Network metrics captured from Spirent landslide traffic generator. JIRA: YARDSTICK-1350 Change-Id: I47920446181355a97e875fd82afd633b336c8da6 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 5bf76a7a2ead6e8c3a0d8bc05c7ec89d9faaa5a5)
2018-10-31Merge "[docs] Update the glossary" into stable/gambiaEmma Foley1-13/+62
2018-10-31Fix default IPv4 mask for IxNetwork traffic configSerhiy Pshyk1-5/+4
IP mask is set depending on the IP range provided by the user in the traffic profile. In case of single IP in range, IPV4LENGTH value is used as mask should cover all address bits. JIRA: YARDSTICK-1478 Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-31Merge "Adds option parameters to TC074" into stable/gambiaRex Lee3-1/+24
2018-10-31Merge "Dashboard with Network and Platform NFVi metrics" into stable/gambiaEmma Foley1-0/+13889
2018-10-31Merge "Add RFC2544 iteration status field" into stable/gambiaAbhijit Sinha5-10/+36
2018-10-30Merge "Add test library name update in DMF and mainflows" into stable/gambiaEmma Foley2-10/+54
2018-10-30Add RFC2544 iteration status fieldMytnyk, Volodymyr5-10/+36
Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 0ff5b131fa3f93f8d47b46c2f13661c5b88d37a1)
2018-10-30Dashboard with Network and Platform NFVi metricsAbhijit Sinha1-0/+13889
Added the PROX L3FWD Grafana dashboard with NFVi metrics collected from barometer collectd container. The dashboard has template field for HOST/SUT name to get the collectd metrics from that SUT. JIRA: YARDSTICK-1412 Update: - Added table and graphs for TG NFVi metrics - Added TG and SUT templates as IP address - Added IPC(instruction per cycles) metric Change-Id: I1f8971f551df27ad6a16241693527285610fc82d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit e63084495f47a9f5b5b61b23529792d6898841bb)
2018-10-30Merge "Pod file fix for Prox 2 port" into stable/gambiaAbhijit Sinha1-2/+0
2018-10-30Add Testcase for Prox Standalone OvS-DPDK.Carey, Alan1-0/+97
No sample testcase for prox OvS-DPDK standalone. JIRA: YARDSTICK-1475 Change-Id: Ide65444d08d6c90e7e98d59b7d1f4cba8ca7397f Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit b0e92a357658f4ece21e356653e8eb52d7ab8d98)
2018-10-30Merge "Fix latency for ACL test cases" into stable/gambiaAbhijit Sinha2-8/+18
2018-10-30Merge "Add traffic duration support in test case" into stable/gambiaAbhijit Sinha3-3/+26
2018-10-30Merge "Trex KPI are not collected due to rabbitmq user" into stable/gambiaAbhijit Sinha3-8/+40
2018-10-30Pod file fix for Prox 2 portAbhijit Sinha1-2/+0
Removing the "keyfile" from the pod file to align with other pod files for 1 and 4 port. The file when used as such currently gives an error. This change will fix that. JIRA:YARDSTICK-1477 Change-Id: Ibfa9387d068a0098ea0eb0b31ad96108d0602abc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 31eac948bba5cf442981fdc7b1392992aaef1f15)
2018-10-30Fix latency for ACL test casesPatrice Buriez2-8/+18
JIRA: YARDSTICK-1460 Cores running "mode=lat" must be properly configured with a correct "lat pos" parameter. When this parameter is missing, PROX exits with an error message. When the "lat pos" parameter is missing for cores running "mode=gen", latency values are not written into the packets. Also fixed some typos, packet inline format, IP len and UDP len. Change-Id: Ice06c5d74686c80f09bc60f568993dbf3165b338 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 7bc7bfb1b43e6329bbfc0ed7a7c5554ebcf10c2b)
2018-10-30Allow to see steady state status in the yardstick logsAmeed Ashour1-3/+12
Change-Id: Ic2281b300ed1de6ecd3daf14b5273db22688de8d JIRA: YARDSTICK-1454 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit ad08f101fa3a23e9a35fa9ba3e28dd22a054ef52)
2018-10-30[docs] Update the glossaryEmma Foley1-13/+62
Add some new terms (OpenStack, Docker, PROX). JIRA: YARDSTICK-1335 Change-Id: I948957cf7b1540f7a027ab9da2d829e5e05c87c8 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 78b5a19e3071cbc080eeae0bdf22f5ab80c03180)
2018-10-30Merge "Add OvS 2.8.1 support into SA context" into stable/gambiaEmma Foley1-1/+2
2018-10-30[docs] Update on Yardstick installationStepan Andrushko2-0/+113
Added details how to install Yardstick using install.yaml. Updated: - 04-installation.rst - 13-nsb-installation.rst JIRA: YARDSTICK-1335 Change-Id: I526c328f1b197833a2cf496cfef15ba89c11fab1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-30[docs] Add conventions for writing unit tests.Emma Foley1-0/+51
Added details of conventions used when writing unit tests. JIRA: YARDSTICK-1335 Change-Id: I7bb141126968c88c8a2d7e0dce4f33ed6f79cee4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30[docs] Add developer guidelines for contributionEmma Foley1-0/+89
A new section was added to the devguide, stating expectations for code contributions. * What to include in a change * Code style guidelines * How to run tests JIRA: YARDSTICK-1335 Change-Id: Idfe7790042a3a3fe6cd8763374b10f2268bd63cd Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30Adds option parameters to TC074Ameed Ashour3-1/+24
Add option parameters to TC074 to allow the user to specify volume type, volume count, availability zone, stack name, and subnet cidr. JIRA:YARDSTICK-1294 Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit 43c28852a9c9abfe7fc66fca0dcc703b468db0cf)
2018-10-30Configure n_rxq DPDK port option when adding the portMytnyk, Volodymyr1-7/+5
On some platform, setting n_rxq option on port separately does not work well and causes issues like port link down, so changed the logic to set n_rxq DPDK port option during adding the port to the bridge which help to resolve the problem. JIRA: YARDSTICK-1463 Change-Id: Icdb064153a38afd53b835de8742e6fcef08f66bb Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit adcc29e56130f0f047b99528ce72b6f149643da7)
2018-10-30Add OvS 2.8.1 support into SA contextMytnyk, Volodymyr1-1/+2
JIRA: YARDSTICK-1462 Change-Id: I001a173fc728be6e88f5ae6d38c64b740e536ff2 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit ad63af7f42d07cffde73c32727f170973ce5ba46)
2018-10-30Add test library name update in DMF and mainflowsOrest Voznyy2-10/+54
Add automatic update of traffic profile items library name update, as well as update of session profile Dmf library name, to avoid the need of user changing it in template files. Update affected unit tests. JIRA: YARDSTICK-1474 Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit 1fd3806d6a6bac19f3173da4d6cb94cef81fd7f5)
2018-10-30Add traffic duration support in test caseOrest Voznyy3-3/+26
Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit ae2ceba66519555749c67eefe2170ea716a1411b)
2018-10-27Trex KPI are not collected due to rabbitmq userStepan Andrushko3-8/+40
Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com> (cherry picked from commit d06e6da19db545dfcc6fdfdc706b9cccdb75c498)
2018-10-26fix yardstick verify jobrexlee87761-2/+7
The regex is not compatible with pip version 18. JIRA: INFRA-310 Change-Id: I6eaf1e3fac183f85c277934929e9065efa88d877 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit a4084d27de22c64ecb690369c7bed49175703adf)
2018-10-05Update Ixia tg to use new API for traffic model creationSerhiy Pshyk1-1/+4
JIRA: YARDSTICK-1464 Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> (cherry picked from commit 81ed5cdea4c36d45c6463523c6a0bc38495e544a)
2018-10-04Merge "Fix influxdb "field type conflict" error" into stable/gambiaAbhijit Sinha1-3/+3
2018-10-04Merge "Fix NSB PROX L3FWD dropping packets" into stable/gambiaEmma Foley2-2/+14
2018-10-04Merge "NSB PROX NFVi Test does not stop after reaching expected precision" ↵Emma Foley12-19/+36
into stable/gambia
2018-10-04Fix NSB PROX L3FWD dropping packetsPatrice Buriez2-2/+14
JIRA: YARDSTICK-1037 Adjusted number of RX/TX descriptors to 2048, instead of default 256, in order to cope with interrupts during which no packets are received by the core, which results in the NIC dropping packets when it gets out of available descriptors to buffer them. Also adjusted mempool size, because more descriptors need more mbufs. This change aligns L3FWD test case with other test cases, for which number of RX/TX descriptors is already set to 2048. Change-Id: I11378c078398aca799295b619bb3d14dbee04ca3 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 3adfba6bac0133bdbaa3db62e16f662e11d84fb8)
2018-10-04Merge "Modify IxNextgen API for traffic model configuration" into stable/gambiaEmma Foley2-31/+97
2018-10-03Fix influxdb "field type conflict" errorPatrice Buriez1-3/+3
JIRA: YARDSTICK-1457 Field types must be consistent across points in a measurement, otherwise influxdb rejects newer points with "field type conflict" error. This error was faced when "theor_max_throughput" field, meant to be assigned as a float from "TxThroughput" sample, was instead assigned as an int from initial value of theor_max_thruput variable. This especially occured for subsequent packet sizes, when theor_max_thruput variable was reset to its default int value. This fix changes the default value of theor_max_thruput variable to 0.0, and also makes sure that the default value for "Actual_throughput" field is consistently a float. Change-Id: If8d4f1297094709fe9657ab3e2b8adaad09815b2 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 2f4418798a3cf245f863a617410403f226062ac8)
2018-10-03NSB PROX NFVi Test does not stop after reaching expected precisionDanielMartinBuckley12-19/+36
JIRA: YARDSTICK-1419 When using prox_binsearch algorithm, a binary search is performed, increasing lower bound when step was successful and decreasing upper bound when the step was a failure. This runs until the test_precision (as specified in the traffic profile) is reached. When the test precision is reached, the test is not completed until the runner duration is reached. As runner duration is usually high (e.g. 1800sec), the tests take much too long to execute. This makes it difficult to create test suites. Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 7d5ff45a3b793f5e50b4a32b2438ab11fed6c899)
2018-10-03Modify IxNextgen API for traffic model configurationSerhiy Pshyk2-31/+97
Changes to IxNextgen API: - modify API for traffic model configuration so that it can be used to create/configure different models - add methods to start and stop protocols on IxNetwork - add method for getting assigned ports JIRA: YARDSTICK-1455 Change-Id: I43c10fea9ba83994caf373ceff8b0252a45439b3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> (cherry picked from commit 7237241a396871d637f9906c1fc93a8587a7b726)
2018-09-25Update the pinned sampleVNF versionPatrice Buriez1-1/+13
JIRA: YARDSTICK-1414 Updated the sampleVNF version to the most recent validated commit. Provided comments on accepted version types and values, and on where users can find alternative values, in case they want to try something different than the version recommended and validated for Yardstick/NSB. Change-Id: I336f96237fcfa8b580c91c787d722d368cc6c015 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit ee5d6413dbcbab40234e47ed3e74b85b704d6493)
2018-09-21Merge "SA: Fix private key file name generation issue"Abhijit Sinha1-1/+1
2018-09-21Merge "[NSB] Adds support for running "black box" test cases for VNFs"Abhijit Sinha7-0/+348
2018-09-21[NSB] Adds support for running "black box" test cases for VNFsChornyi, TarasX7-0/+348
Using AgnosticVNF is now possible to create a "black box" testcase for any VNF. Example rfc2544 test with TRex as trafficgen samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml and Ixia samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml NOTE: Yardstick will not interact with VNF. No KPIs from VNF will be collected JIRA: YARDSTICK-1438 Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>