aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-11-09Merge "Cleanup of ixia_profile attribute for IxNetwork TG" into stable/gambiaRex Lee61-108/+53
2018-11-09Merge "Adding new test case for prox Standalone L3FWD." into stable/gambiaRex Lee2-0/+189
2018-11-08Cleanup of ixia_profile attribute for IxNetwork TGOrest Voznyy61-108/+53
Remove obsolete attribute "ixia_profile" from - test cases using IxNetwork as a TG - from unit tests related to IxNetwork Remove ixncfg files from repo. Remove mention of ixncfg files from test case files JIRA: YARDSTICK-1506 Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit fff1e25f3a882739b94458c741a5f86645f1210c)
2018-11-08Bugfix: Gambia ci job failed on apex and compassrexlee87762-2/+2
update according to [1] [1] https://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt Change-Id: If21e39470a33b9e7591cebe7f24b8f689edf4898 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit c6469463d18afa4833483e99f2fa61087874bbac)
2018-11-08Adding new test case for prox Standalone L3FWD.Carey, Alan2-0/+189
This contains two files: 2 & 4 port test cases. JIRA: YARDSTICK-1515 Change-Id: I9b6b5fd47a854571bc4e9f67c570b183e65245db Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 6d68fedcff4f4cc3ff9d1a44ae2f57fe0ad10eab)
2018-11-08Merge "Make OvS max_idle & queues configuration optional" into stable/gambiaRex Lee4-7/+16
2018-11-07Merge "Allow to see steady state status in the yardstick logs" into ↵Abhijit Sinha1-3/+12
stable/gambia
2018-11-07Merge "Add Testcase for Prox Standalone SRIOV." into stable/gambiaAbhijit Sinha2-0/+123
2018-11-07Make OvS max_idle & queues configuration optionalMytnyk, Volodymyr4-7/+16
Remove hardcoded rx queue value JIRA: YARDSTICK-1493 Change-Id: Ia4944db21d94399c724bcabf4e0eae809518e7e9 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 68c127e17028e9961abcbd1c9a72fe2b878c427b)
2018-11-06Merge "Update Multi Port Stats reading for PROX" into stable/gambiaAbhijit Sinha6-116/+395
2018-11-06Merge "Test case override of traffic profile settings." into stable/gambiaAbhijit Sinha3-8/+49
2018-11-06Merge "Add Testcase for Prox Standalone OvS-DPDK." into stable/gambiaAbhijit Sinha1-0/+97
2018-11-06Merge "[docs] Add vEPC test case preparation steps" into stable/gambiaAbhijit Sinha2-3/+157
2018-11-06Add Testcase for Prox Standalone SRIOV.Carey, Alan2-0/+123
No sample testcase for prox SRIOV standalone. Renamed pod file so that other prox testcases can use this file JIRA: YARDSTICK-1471 Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 0eaa53d46f1f2ced9a1d40ebf820580bf314b4a1)
2018-11-06Test case override of traffic profile settings.DanielMartinBuckley3-8/+49
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 383c438cda94a1004bc9552a5993fe3ff3e6da8f)
2018-11-06Update Multi Port Stats reading for PROXDanielMartinBuckley6-116/+395
JIRA: YARDSTICK-1458 Removed excessive jitter by removing extra sleeps in start/stop/reset ssh Removed extra retries when bad data returned Added a slep at end of test to give runner a chance to empty the queue on shutdown Added a timeout on port retry attempts Change-Id: Ica60b11c7af242817a83c154157827581f60d16a Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit b2fd601c33e3322ccc9e675242f091dba2eeb644)
2018-11-06Merge "[docs] Test case documentation for vEPC testing" into stable/gambiaRex Lee6-0/+810
2018-11-06Merge changes I526c328f,I7bb14112,Idfe77900 into stable/gambiaRex Lee3-0/+253
* changes: [docs] Update on Yardstick installation [docs] Add conventions for writing unit tests. [docs] Add developer guidelines for contribution
2018-11-05[docs] Add vEPC test case preparation stepsOrest Voznyy2-3/+157
Add documentation to review the changes to original vEPC infrastructure files to configure NSB test run in a specific test setup. Add initial steps to prepare NSB to use Spirent Landslide for vEPC tests. JIRA: YARDSTICK-1459 Change-Id: I3b937b1a21d6ec6851a92946e46c679385fdff9c Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit dc55a775f7aa62be7ed17cc33aa1b0bac54c081f)
2018-11-01[docs] Test case documentation for vEPC testingAbhijit Sinha6-0/+810
JIRA: YARDSTICK-1349 The test case document will cover the following: - test purpose - test configuration - pre-test conditions - test sequence - test verdict Change-Id: I2841a7ff3d248bb3e4739579fad722dc02b5504f Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit c8bde3b59031b352bf09302ae7644436860602d7)
2018-11-01Make OvS to listen on TCP by defaultMytnyk, Volodymyr1-2/+2
JIRA: YARDSTICK-1492 Change-Id: I81c682d473ffe3d70ecbb42cce40c2d16e608b41 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-01Merge changes Ia8783de8,I61421095 into stable/gambiaEmma Foley3-8/+40
* changes: Update: Trex KPI not collected no rabbitmq user Trex KPI are not collected due to rabbitmq user
2018-11-01Merge "Fix default IPv4 mask for IxNetwork traffic config" into stable/gambiaAbhijit Sinha1-5/+4
2018-10-31Update: Trex KPI not collected no rabbitmq userStepan Andrushko1-1/+1
Update of review #63707: missed yardstick password hash. This must be set on top of changes on review. JIRA: YARDSTICK-1479 Change-Id: Ia8783de81ad91ea7421c6bbff87a30c59db2d44c Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-31Trex KPI are not collected due to rabbitmq userStepan Andrushko3-8/+40
Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I6142109563fcdb27e0ec554dd08567a1a43237e7 (cherry picked from commit d06e6da19db545dfcc6fdfdc706b9cccdb75c498) formerly: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-31Merge "Adding Grafana dashboard for visualizing the vEPC default bearer ↵Abhijit Sinha1-0/+1354
metrics." into stable/gambia
2018-10-31Merge "Revert "Trex KPI are not collected due to rabbitmq user"" into ↵Abhijit Sinha3-40/+8
stable/gambia
2018-10-31Revert "Trex KPI are not collected due to rabbitmq user"Emma Foley3-40/+8
This causes the docker-build jobs to fail in the CI. This reverts commit ce809669d3051524508edf5a3d69e83dde8a9080. Change-Id: Iea66bc92eaee39c5b7427ea55c190f8c0dbf5ad4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-31Adding Grafana dashboard for visualizing the vEPC default bearer metrics.Carey, Alan1-0/+1354
The dashboard will highlight the Network metrics captured from Spirent landslide traffic generator. JIRA: YARDSTICK-1350 Change-Id: I47920446181355a97e875fd82afd633b336c8da6 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 5bf76a7a2ead6e8c3a0d8bc05c7ec89d9faaa5a5)
2018-10-31Merge "[docs] Update the glossary" into stable/gambiaEmma Foley1-13/+62
2018-10-31Fix default IPv4 mask for IxNetwork traffic configSerhiy Pshyk1-5/+4
IP mask is set depending on the IP range provided by the user in the traffic profile. In case of single IP in range, IPV4LENGTH value is used as mask should cover all address bits. JIRA: YARDSTICK-1478 Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-31Merge "Adds option parameters to TC074" into stable/gambiaRex Lee3-1/+24
2018-10-31Merge "Dashboard with Network and Platform NFVi metrics" into stable/gambiaEmma Foley1-0/+13889
2018-10-31Merge "Add RFC2544 iteration status field" into stable/gambiaAbhijit Sinha5-10/+36
2018-10-30Merge "Add test library name update in DMF and mainflows" into stable/gambiaEmma Foley2-10/+54
2018-10-30Add RFC2544 iteration status fieldMytnyk, Volodymyr5-10/+36
Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 0ff5b131fa3f93f8d47b46c2f13661c5b88d37a1)
2018-10-30Dashboard with Network and Platform NFVi metricsAbhijit Sinha1-0/+13889
Added the PROX L3FWD Grafana dashboard with NFVi metrics collected from barometer collectd container. The dashboard has template field for HOST/SUT name to get the collectd metrics from that SUT. JIRA: YARDSTICK-1412 Update: - Added table and graphs for TG NFVi metrics - Added TG and SUT templates as IP address - Added IPC(instruction per cycles) metric Change-Id: I1f8971f551df27ad6a16241693527285610fc82d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit e63084495f47a9f5b5b61b23529792d6898841bb)
2018-10-30Merge "Pod file fix for Prox 2 port" into stable/gambiaAbhijit Sinha1-2/+0
2018-10-30Add Testcase for Prox Standalone OvS-DPDK.Carey, Alan1-0/+97
No sample testcase for prox OvS-DPDK standalone. JIRA: YARDSTICK-1475 Change-Id: Ide65444d08d6c90e7e98d59b7d1f4cba8ca7397f Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit b0e92a357658f4ece21e356653e8eb52d7ab8d98)
2018-10-30Merge "Fix latency for ACL test cases" into stable/gambiaAbhijit Sinha2-8/+18
2018-10-30Merge "Add traffic duration support in test case" into stable/gambiaAbhijit Sinha3-3/+26
2018-10-30Merge "Trex KPI are not collected due to rabbitmq user" into stable/gambiaAbhijit Sinha3-8/+40
2018-10-30Pod file fix for Prox 2 portAbhijit Sinha1-2/+0
Removing the "keyfile" from the pod file to align with other pod files for 1 and 4 port. The file when used as such currently gives an error. This change will fix that. JIRA:YARDSTICK-1477 Change-Id: Ibfa9387d068a0098ea0eb0b31ad96108d0602abc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 31eac948bba5cf442981fdc7b1392992aaef1f15)
2018-10-30Fix latency for ACL test casesPatrice Buriez2-8/+18
JIRA: YARDSTICK-1460 Cores running "mode=lat" must be properly configured with a correct "lat pos" parameter. When this parameter is missing, PROX exits with an error message. When the "lat pos" parameter is missing for cores running "mode=gen", latency values are not written into the packets. Also fixed some typos, packet inline format, IP len and UDP len. Change-Id: Ice06c5d74686c80f09bc60f568993dbf3165b338 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 7bc7bfb1b43e6329bbfc0ed7a7c5554ebcf10c2b)
2018-10-30Allow to see steady state status in the yardstick logsAmeed Ashour1-3/+12
Change-Id: Ic2281b300ed1de6ecd3daf14b5273db22688de8d JIRA: YARDSTICK-1454 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit ad08f101fa3a23e9a35fa9ba3e28dd22a054ef52)
2018-10-30[docs] Update the glossaryEmma Foley1-13/+62
Add some new terms (OpenStack, Docker, PROX). JIRA: YARDSTICK-1335 Change-Id: I948957cf7b1540f7a027ab9da2d829e5e05c87c8 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 78b5a19e3071cbc080eeae0bdf22f5ab80c03180)
2018-10-30Merge "Add OvS 2.8.1 support into SA context" into stable/gambiaEmma Foley1-1/+2
2018-10-30[docs] Update on Yardstick installationStepan Andrushko2-0/+113
Added details how to install Yardstick using install.yaml. Updated: - 04-installation.rst - 13-nsb-installation.rst JIRA: YARDSTICK-1335 Change-Id: I526c328f1b197833a2cf496cfef15ba89c11fab1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-30[docs] Add conventions for writing unit tests.Emma Foley1-0/+51
Added details of conventions used when writing unit tests. JIRA: YARDSTICK-1335 Change-Id: I7bb141126968c88c8a2d7e0dce4f33ed6f79cee4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-30[docs] Add developer guidelines for contributionEmma Foley1-0/+89
A new section was added to the devguide, stating expectations for code contributions. * What to include in a change * Code style guidelines * How to run tests JIRA: YARDSTICK-1335 Change-Id: Idfe7790042a3a3fe6cd8763374b10f2268bd63cd Signed-off-by: Emma Foley <emma.l.foley@intel.com>