summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-11-09[docs] Fix docs {un,}indent warnings in Testcase definitionsEmma Foley17-110/+152
Mostly, the issues were with un/indentation. This has been fixed, and `tox -e docs` now issues less warnings. JIRA: YARDSTICK-1416 Change-Id: Ie58a8dba42e9868357e1dce414cb1a01af8ad1f4 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 28e64c520fc2a52c1d3eb736f88ad4608b87c142)
2018-11-09Merge "[docs] Remove vtc results chapter and references" into stable/gambiaRex Lee4-261/+0
2018-11-09[docs] Update header levelsEmma Foley8-53/+115
JIRA: YARDSTICK-1335 Change-Id: I202634a7427a409f0e2ca786c8bb5e05a5b4351d Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 5456b070a8e05cd49d5626b002f6eeee71bcd67d)
2018-11-09[docs] Remove vtc results chapter and referencesEmma Foley4-261/+0
The vTC chapter in the userguide was previously removed [1] Some references and results still remained and needed to be removed. [1] https://gerrit.opnfv.org/gerrit/gitweb?p=yardstick.git;a=commit;h=114a486558c96152fffb5050840460a54de64d15 JIRA: YARDSTICK-1335 Change-Id: I17806d90ae8bc4dbf813ef89bbc22dc012b4a686 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 766d498f9f4abcb79710d077c6a1886ae11a4c0a)
2018-11-09[docs] Fix unresolved reference warningEmma Foley1-2/+2
JIRA: YARDSTICK-1416 Change-Id: Ibdc9b48e31aff171c59278f9ca19767392f4eeba Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit e9db0b0e22ddfaa879aa08128d17ea6308355455)
2018-11-09[docs] Update broken and redirected linksEmma Foley12-35/+35
A number of links were broken, or permenently redirected. Some literal include directives pointed to the wrong location. These have been updated, so the links are valid. JIRA: YARDSTICK-1416 Change-Id: Icd20113e0ab099850fa58fa41bb27a00670f57ca Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 44a507c5aa92d4f4a518983bd4b6ecc244e7a66c)
2018-11-09[docs] Fix links to remove references to submodulesAric Gardner2-6/+6
All references to submodules must be removed for docs to work going forward. Can be tested once your project has a local tox file Change-Id: Id74581cc584f70ae0b31e31c9dd91593c7be6615 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org> (cherry picked from commit 2ba5ef8eeac9f92436fcaed807fdd4ecaa79d2c0)
2018-11-09[docs] Transition to local docs build job.Emma Foley6-0/+39
Docs builds have transitioned to using local build jobs. This allows Yardstick docs to be built and verified locally. The time taken to build and verify docs in the gate for new changes should be reduced, as the docs for each project will be built separately. This change also allow contributers to test their docs builds locally, using tox:: tox -e docs tox -e docs-linkcheck TODO: Update the dev guide to include new tox environment Related: DOCS-191 JIRA: YARDSTICK-1415 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ib8bab85475dcd5127a2c41a2d55dce8f8d9da574 (cherry picked from commit 7203ff5925b805d07a5df53b6cdcf7d44cc4e4d1)
2018-11-09Merge "[docs] Update mailing list to use #yardstick" into stable/gambiaRex Lee2-4/+4
2018-11-09Merge "add error logs to storperf" into stable/gambiaRex Lee1-16/+21
2018-11-09Merge "Fix python lib path for ixload control subprocess" into stable/gambiaRex Lee1-1/+9
2018-11-09Merge "Cleanup of ixia_profile attribute for IxNetwork TG" into stable/gambiaRex Lee61-108/+53
2018-11-09Merge "Adding new test case for prox Standalone L3FWD." into stable/gambiaRex Lee2-0/+189
2018-11-08Cleanup of ixia_profile attribute for IxNetwork TGOrest Voznyy61-108/+53
Remove obsolete attribute "ixia_profile" from - test cases using IxNetwork as a TG - from unit tests related to IxNetwork Remove ixncfg files from repo. Remove mention of ixncfg files from test case files JIRA: YARDSTICK-1506 Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit fff1e25f3a882739b94458c741a5f86645f1210c)
2018-11-08Bugfix: Gambia ci job failed on apex and compassrexlee87762-2/+2
update according to [1] [1] https://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt Change-Id: If21e39470a33b9e7591cebe7f24b8f689edf4898 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit c6469463d18afa4833483e99f2fa61087874bbac)
2018-11-08Adding new test case for prox Standalone L3FWD.Carey, Alan2-0/+189
This contains two files: 2 & 4 port test cases. JIRA: YARDSTICK-1515 Change-Id: I9b6b5fd47a854571bc4e9f67c570b183e65245db Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 6d68fedcff4f4cc3ff9d1a44ae2f57fe0ad10eab)
2018-11-08Merge "Make OvS max_idle & queues configuration optional" into stable/gambiaRex Lee4-7/+16
2018-11-08add error logs to storperfAmeed Ashour1-16/+21
add error logs to storperf.py in order to show the errors in task log API JIRA: YARDSTICK-1407 Change-Id: I7cefd09cbd7bdefca98c9220f886675b6a5b02a4 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-11-07Merge "Allow to see steady state status in the yardstick logs" into ↵Abhijit Sinha1-3/+12
stable/gambia
2018-11-07Merge "Add Testcase for Prox Standalone SRIOV." into stable/gambiaAbhijit Sinha2-0/+123
2018-11-07Make OvS max_idle & queues configuration optionalMytnyk, Volodymyr4-7/+16
Remove hardcoded rx queue value JIRA: YARDSTICK-1493 Change-Id: Ia4944db21d94399c724bcabf4e0eae809518e7e9 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 68c127e17028e9961abcbd1c9a72fe2b878c427b)
2018-11-06Merge "Update Multi Port Stats reading for PROX" into stable/gambiaAbhijit Sinha6-116/+395
2018-11-06Merge "Test case override of traffic profile settings." into stable/gambiaAbhijit Sinha3-8/+49
2018-11-06Merge "Add Testcase for Prox Standalone OvS-DPDK." into stable/gambiaAbhijit Sinha1-0/+97
2018-11-06Merge "[docs] Add vEPC test case preparation steps" into stable/gambiaAbhijit Sinha2-3/+157
2018-11-06Add Testcase for Prox Standalone SRIOV.Carey, Alan2-0/+123
No sample testcase for prox SRIOV standalone. Renamed pod file so that other prox testcases can use this file JIRA: YARDSTICK-1471 Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 0eaa53d46f1f2ced9a1d40ebf820580bf314b4a1)
2018-11-06Test case override of traffic profile settings.DanielMartinBuckley3-8/+49
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 383c438cda94a1004bc9552a5993fe3ff3e6da8f)
2018-11-06Update Multi Port Stats reading for PROXDanielMartinBuckley6-116/+395
JIRA: YARDSTICK-1458 Removed excessive jitter by removing extra sleeps in start/stop/reset ssh Removed extra retries when bad data returned Added a slep at end of test to give runner a chance to empty the queue on shutdown Added a timeout on port retry attempts Change-Id: Ica60b11c7af242817a83c154157827581f60d16a Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit b2fd601c33e3322ccc9e675242f091dba2eeb644)
2018-11-06[docs] Update mailing list to use #yardstickEmma Foley2-4/+4
The mailing list is on a new system that lets you use #topics instead of [topics]. The contact information has been updated to reflect this. JIRA: YARDSTICK-1335 Change-Id: Ida9af98f00761a3bff8903165fd2806163787ccd Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 3fec49e7a3926ddf4f9303ee47a33d109421a573)
2018-11-06Merge "[docs] Test case documentation for vEPC testing" into stable/gambiaRex Lee6-0/+810
2018-11-06Merge changes I526c328f,I7bb14112,Idfe77900 into stable/gambiaRex Lee3-0/+253
* changes: [docs] Update on Yardstick installation [docs] Add conventions for writing unit tests. [docs] Add developer guidelines for contribution
2018-11-05[docs] Add vEPC test case preparation stepsOrest Voznyy2-3/+157
Add documentation to review the changes to original vEPC infrastructure files to configure NSB test run in a specific test setup. Add initial steps to prepare NSB to use Spirent Landslide for vEPC tests. JIRA: YARDSTICK-1459 Change-Id: I3b937b1a21d6ec6851a92946e46c679385fdff9c Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit dc55a775f7aa62be7ed17cc33aa1b0bac54c081f)
2018-11-05Fix python lib path for ixload control subprocessChornyi, TarasX1-1/+9
JIRA: YARDSTICK-1390 Change-Id: I3ef5242862c98d3b389ba127f909f47e26c0711d Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit 376720a9ff56a9e71b6bc63b1d621f0c600088e1)
2018-11-01[docs] Test case documentation for vEPC testingAbhijit Sinha6-0/+810
JIRA: YARDSTICK-1349 The test case document will cover the following: - test purpose - test configuration - pre-test conditions - test sequence - test verdict Change-Id: I2841a7ff3d248bb3e4739579fad722dc02b5504f Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit c8bde3b59031b352bf09302ae7644436860602d7)
2018-11-01Make OvS to listen on TCP by defaultMytnyk, Volodymyr1-2/+2
JIRA: YARDSTICK-1492 Change-Id: I81c682d473ffe3d70ecbb42cce40c2d16e608b41 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-01Merge changes Ia8783de8,I61421095 into stable/gambiaEmma Foley3-8/+40
* changes: Update: Trex KPI not collected no rabbitmq user Trex KPI are not collected due to rabbitmq user
2018-11-01Merge "Fix default IPv4 mask for IxNetwork traffic config" into stable/gambiaAbhijit Sinha1-5/+4
2018-10-31Update: Trex KPI not collected no rabbitmq userStepan Andrushko1-1/+1
Update of review #63707: missed yardstick password hash. This must be set on top of changes on review. JIRA: YARDSTICK-1479 Change-Id: Ia8783de81ad91ea7421c6bbff87a30c59db2d44c Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-31Trex KPI are not collected due to rabbitmq userStepan Andrushko3-8/+40
Changed the way rabbitmq-server user is created. Fix is needed to collect KPIs from Trex. JIRA: YARDSTICK-1479 Change-Id: I6142109563fcdb27e0ec554dd08567a1a43237e7 (cherry picked from commit d06e6da19db545dfcc6fdfdc706b9cccdb75c498) formerly: I54369535fdb7af6af76de30f758227736f83db78 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-10-31Merge "Adding Grafana dashboard for visualizing the vEPC default bearer ↵Abhijit Sinha1-0/+1354
metrics." into stable/gambia
2018-10-31Merge "Revert "Trex KPI are not collected due to rabbitmq user"" into ↵Abhijit Sinha3-40/+8
stable/gambia
2018-10-31Revert "Trex KPI are not collected due to rabbitmq user"Emma Foley3-40/+8
This causes the docker-build jobs to fail in the CI. This reverts commit ce809669d3051524508edf5a3d69e83dde8a9080. Change-Id: Iea66bc92eaee39c5b7427ea55c190f8c0dbf5ad4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-10-31Adding Grafana dashboard for visualizing the vEPC default bearer metrics.Carey, Alan1-0/+1354
The dashboard will highlight the Network metrics captured from Spirent landslide traffic generator. JIRA: YARDSTICK-1350 Change-Id: I47920446181355a97e875fd82afd633b336c8da6 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 5bf76a7a2ead6e8c3a0d8bc05c7ec89d9faaa5a5)
2018-10-31Merge "[docs] Update the glossary" into stable/gambiaEmma Foley1-13/+62
2018-10-31Fix default IPv4 mask for IxNetwork traffic configSerhiy Pshyk1-5/+4
IP mask is set depending on the IP range provided by the user in the traffic profile. In case of single IP in range, IPV4LENGTH value is used as mask should cover all address bits. JIRA: YARDSTICK-1478 Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-31Merge "Adds option parameters to TC074" into stable/gambiaRex Lee3-1/+24
2018-10-31Merge "Dashboard with Network and Platform NFVi metrics" into stable/gambiaEmma Foley1-0/+13889
2018-10-31Merge "Add RFC2544 iteration status field" into stable/gambiaAbhijit Sinha5-10/+36
2018-10-30Merge "Add test library name update in DMF and mainflows" into stable/gambiaEmma Foley2-10/+54
2018-10-30Add RFC2544 iteration status fieldMytnyk, Volodymyr5-10/+36
Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 0ff5b131fa3f93f8d47b46c2f13661c5b88d37a1)