summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-12-07L3FWD Gradana Dashboards Out-of-date and incorrectDanielMartinBuckley3-1007/+12137
JIRA: Yardstick-1561 L3FWD-2 Port Grafana Dashboard does not work, and is missing NFVI stats and Live data. L3FWD-4 Port Grafana Dashbaord missing "Load Generated" and "Load Received" metrics Change-Id: I6802c993be6f6c93750fa5aa8e5c1652ca78dfce Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 3e16bc78e6ee82f55315bd25f684476a39ee9bc0)
2018-12-06Fix pip environmentJohn O Loughlin1-1/+2
oslo.log==3.41.0 needs to be fixed for tox to pass JIRA: YARDSTICK-1560 Change-Id: I01d257e892aa835775456d8334f2c4358b120c08 Signed-off-by: John O Loughlin <john.oloughlin@intel.com> (cherry picked from commit 470029d121ad332b5b7aa388bdb211eb4b47cfb9)
2018-11-30Merge "Run testcase 074 result overridden by job status" into stable/gambiaRex Lee1-2/+2
2018-11-29Merge "Prox L2FWD multiflow test fix" into stable/gambiaAbhijit Sinha2-23/+70
2018-11-28Prox L2FWD multiflow test fixAbhijit Sinha2-23/+70
Corrected the generator config file by adding the latency position validated the test case with it. JIRA: YARDSTICK-1530 Change-Id: I18dd1c7add8fc77bb59354fa96540ba8690057a4 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 10ea31ed7973e3e8893345e972f5bdef75657cf3)
2018-11-28NSB NFVi PROX Should report realtime port activity notDanielMartinBuckley6-105/+1004
historical data JIRA: YARDSTICK-1458 The TG is only sampled at the end of every test interval. This is incorrect. It should be sampled every interval. Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit bf507da25ad1e6adc6a5c162a4d0de325baef888)
2018-11-18Run testcase 074 result overridden by job statusAmeed Ashour1-2/+2
Change-Id: Icb24727fd7ca8a340ea424284b510b007055ec9c JIRA: YARDSTICK-1526 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-11-09Merge "[docs] Resolve "document isn't included in any toctree" warning" into ↵Rex Lee3-1/+12
stable/gambia
2018-11-09[docs] Resolve "nested numbering in toctree?" warningEmma Foley2-2/+0
Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Id31c0484db2dc28c2237455b863d2eac9fcbc66a (cherry picked from commit 7d977af3acd029bcf7e7e28df118d185c6123230)
2018-11-09[docs] Resolve "document isn't included in any toctree" warningopnfv-7.0.0Emma Foley3-1/+12
Some test cases and test results weren't included in the test case lists. This change updates the lists of TC to included the previously omitted TCs and add test results to index. JIRA: YARDSTICK-1335 Change-Id: I5ca3b679b308889e60b7db2679629dc9144a3226 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit f2a27e64dc6a1375af23b0b99e6cfdddeceb19f8)
2018-11-09[docs] Add release notes for GambiaEmma Foley1-300/+124
Change-Id: If3e209ac3d2e80baadef0f4b76494028f8594f8b Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit eb5fa557a803d151cdcac41ce8b738435a0ad653)
2018-11-09[docs][userguide] Update formatting for Influx instructions in ch04Emma Foley1-15/+15
JIRA: YARDSTICK-1335 Change-Id: I2422d12a8c34fe2afaab349cbbb4dfe579057cb1 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit a0811c8c5f57038c567c15974c9128591bc1d283)
2018-11-09[docs][devguide] Fix line lengths in devguide_nsb_prox.rstEmma Foley1-132/+201
JIRA: YARDSTICK-1335 Change-Id: I863da3318a71dbcf2dc3f2b43fda6a92feed2089 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 3914b4028025fee9f5037ba29453201f99720f24)
2018-11-09[userguide] Update the directory structure listingEmma Foley1-12/+13
Change-Id: I4ff6f94a6d309e1604672a41c581d0768c91a5d2 JIRA: YARDSTICK-1335 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit b7c2a088b375bb6895c52383c4348b1cb1d4edb9)
2018-11-09[docs] Rename image tc014_pod_frase{e,}r.pngEmma Foley1-0/+0
docs/release/results/tc014-cpu-processing-speed.rst includes the image tc014_pod_fraser.png. This image was incorrectly named tc014_pod_fraseer.png. This patch fixes the image name so that the link is valid. JIRA: YARDSTICK-1416 Change-Id: I37d8ee687f4dbd1a8b906e2934a4119f9fdd8041 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 53f1e72aa5919b2df1e2d354d8523210af5c563f)
2018-11-09[docs] Fix "Error in xxx directive" warningEmma Foley3-5/+2
JIRA: YARDSTICK-1416 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: I58c511454e052496e0b72ea28142b331514475c5 (cherry picked from commit d5ff53dbdbcb1d97343a3122aabf312d81649eaa)
2018-11-09[docs] Fix docs {un,}indent warnings in Testcase definitionsEmma Foley17-110/+152
Mostly, the issues were with un/indentation. This has been fixed, and `tox -e docs` now issues less warnings. JIRA: YARDSTICK-1416 Change-Id: Ie58a8dba42e9868357e1dce414cb1a01af8ad1f4 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 28e64c520fc2a52c1d3eb736f88ad4608b87c142)
2018-11-09Merge "[docs] Remove vtc results chapter and references" into stable/gambiaRex Lee4-261/+0
2018-11-09[docs] Update header levelsEmma Foley8-53/+115
JIRA: YARDSTICK-1335 Change-Id: I202634a7427a409f0e2ca786c8bb5e05a5b4351d Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 5456b070a8e05cd49d5626b002f6eeee71bcd67d)
2018-11-09[docs] Remove vtc results chapter and referencesEmma Foley4-261/+0
The vTC chapter in the userguide was previously removed [1] Some references and results still remained and needed to be removed. [1] https://gerrit.opnfv.org/gerrit/gitweb?p=yardstick.git;a=commit;h=114a486558c96152fffb5050840460a54de64d15 JIRA: YARDSTICK-1335 Change-Id: I17806d90ae8bc4dbf813ef89bbc22dc012b4a686 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 766d498f9f4abcb79710d077c6a1886ae11a4c0a)
2018-11-09[docs] Fix unresolved reference warningEmma Foley1-2/+2
JIRA: YARDSTICK-1416 Change-Id: Ibdc9b48e31aff171c59278f9ca19767392f4eeba Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit e9db0b0e22ddfaa879aa08128d17ea6308355455)
2018-11-09[docs] Update broken and redirected linksEmma Foley12-35/+35
A number of links were broken, or permenently redirected. Some literal include directives pointed to the wrong location. These have been updated, so the links are valid. JIRA: YARDSTICK-1416 Change-Id: Icd20113e0ab099850fa58fa41bb27a00670f57ca Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 44a507c5aa92d4f4a518983bd4b6ecc244e7a66c)
2018-11-09[docs] Fix links to remove references to submodulesAric Gardner2-6/+6
All references to submodules must be removed for docs to work going forward. Can be tested once your project has a local tox file Change-Id: Id74581cc584f70ae0b31e31c9dd91593c7be6615 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org> (cherry picked from commit 2ba5ef8eeac9f92436fcaed807fdd4ecaa79d2c0)
2018-11-09[docs] Transition to local docs build job.Emma Foley6-0/+39
Docs builds have transitioned to using local build jobs. This allows Yardstick docs to be built and verified locally. The time taken to build and verify docs in the gate for new changes should be reduced, as the docs for each project will be built separately. This change also allow contributers to test their docs builds locally, using tox:: tox -e docs tox -e docs-linkcheck TODO: Update the dev guide to include new tox environment Related: DOCS-191 JIRA: YARDSTICK-1415 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ib8bab85475dcd5127a2c41a2d55dce8f8d9da574 (cherry picked from commit 7203ff5925b805d07a5df53b6cdcf7d44cc4e4d1)
2018-11-09Merge "[docs] Update mailing list to use #yardstick" into stable/gambiaRex Lee2-4/+4
2018-11-09Merge "add error logs to storperf" into stable/gambiaRex Lee1-16/+21
2018-11-09Merge "Fix python lib path for ixload control subprocess" into stable/gambiaRex Lee1-1/+9
2018-11-09Merge "Cleanup of ixia_profile attribute for IxNetwork TG" into stable/gambiaRex Lee61-108/+53
2018-11-09Merge "Adding new test case for prox Standalone L3FWD." into stable/gambiaRex Lee2-0/+189
2018-11-08Cleanup of ixia_profile attribute for IxNetwork TGOrest Voznyy61-108/+53
Remove obsolete attribute "ixia_profile" from - test cases using IxNetwork as a TG - from unit tests related to IxNetwork Remove ixncfg files from repo. Remove mention of ixncfg files from test case files JIRA: YARDSTICK-1506 Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit fff1e25f3a882739b94458c741a5f86645f1210c)
2018-11-08Bugfix: Gambia ci job failed on apex and compassrexlee87762-2/+2
update according to [1] [1] https://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt Change-Id: If21e39470a33b9e7591cebe7f24b8f689edf4898 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit c6469463d18afa4833483e99f2fa61087874bbac)
2018-11-08Adding new test case for prox Standalone L3FWD.Carey, Alan2-0/+189
This contains two files: 2 & 4 port test cases. JIRA: YARDSTICK-1515 Change-Id: I9b6b5fd47a854571bc4e9f67c570b183e65245db Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 6d68fedcff4f4cc3ff9d1a44ae2f57fe0ad10eab)
2018-11-08Merge "Make OvS max_idle & queues configuration optional" into stable/gambiaRex Lee4-7/+16
2018-11-08add error logs to storperfAmeed Ashour1-16/+21
add error logs to storperf.py in order to show the errors in task log API JIRA: YARDSTICK-1407 Change-Id: I7cefd09cbd7bdefca98c9220f886675b6a5b02a4 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-11-07Merge "Allow to see steady state status in the yardstick logs" into ↵Abhijit Sinha1-3/+12
stable/gambia
2018-11-07Merge "Add Testcase for Prox Standalone SRIOV." into stable/gambiaAbhijit Sinha2-0/+123
2018-11-07Make OvS max_idle & queues configuration optionalMytnyk, Volodymyr4-7/+16
Remove hardcoded rx queue value JIRA: YARDSTICK-1493 Change-Id: Ia4944db21d94399c724bcabf4e0eae809518e7e9 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 68c127e17028e9961abcbd1c9a72fe2b878c427b)
2018-11-06Merge "Update Multi Port Stats reading for PROX" into stable/gambiaAbhijit Sinha6-116/+395
2018-11-06Merge "Test case override of traffic profile settings." into stable/gambiaAbhijit Sinha3-8/+49
2018-11-06Merge "Add Testcase for Prox Standalone OvS-DPDK." into stable/gambiaAbhijit Sinha1-0/+97
2018-11-06Merge "[docs] Add vEPC test case preparation steps" into stable/gambiaAbhijit Sinha2-3/+157
2018-11-06Add Testcase for Prox Standalone SRIOV.Carey, Alan2-0/+123
No sample testcase for prox SRIOV standalone. Renamed pod file so that other prox testcases can use this file JIRA: YARDSTICK-1471 Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 0eaa53d46f1f2ced9a1d40ebf820580bf314b4a1)
2018-11-06Test case override of traffic profile settings.DanielMartinBuckley3-8/+49
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 383c438cda94a1004bc9552a5993fe3ff3e6da8f)
2018-11-06Update Multi Port Stats reading for PROXDanielMartinBuckley6-116/+395
JIRA: YARDSTICK-1458 Removed excessive jitter by removing extra sleeps in start/stop/reset ssh Removed extra retries when bad data returned Added a slep at end of test to give runner a chance to empty the queue on shutdown Added a timeout on port retry attempts Change-Id: Ica60b11c7af242817a83c154157827581f60d16a Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit b2fd601c33e3322ccc9e675242f091dba2eeb644)
2018-11-06[docs] Update mailing list to use #yardstickEmma Foley2-4/+4
The mailing list is on a new system that lets you use #topics instead of [topics]. The contact information has been updated to reflect this. JIRA: YARDSTICK-1335 Change-Id: Ida9af98f00761a3bff8903165fd2806163787ccd Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 3fec49e7a3926ddf4f9303ee47a33d109421a573)
2018-11-06Merge "[docs] Test case documentation for vEPC testing" into stable/gambiaRex Lee6-0/+810
2018-11-06Merge changes I526c328f,I7bb14112,Idfe77900 into stable/gambiaRex Lee3-0/+253
* changes: [docs] Update on Yardstick installation [docs] Add conventions for writing unit tests. [docs] Add developer guidelines for contribution
2018-11-05[docs] Add vEPC test case preparation stepsOrest Voznyy2-3/+157
Add documentation to review the changes to original vEPC infrastructure files to configure NSB test run in a specific test setup. Add initial steps to prepare NSB to use Spirent Landslide for vEPC tests. JIRA: YARDSTICK-1459 Change-Id: I3b937b1a21d6ec6851a92946e46c679385fdff9c Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit dc55a775f7aa62be7ed17cc33aa1b0bac54c081f)
2018-11-05Fix python lib path for ixload control subprocessChornyi, TarasX1-1/+9
JIRA: YARDSTICK-1390 Change-Id: I3ef5242862c98d3b389ba127f909f47e26c0711d Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit 376720a9ff56a9e71b6bc63b1d621f0c600088e1)
2018-11-01[docs] Test case documentation for vEPC testingAbhijit Sinha6-0/+810
JIRA: YARDSTICK-1349 The test case document will cover the following: - test purpose - test configuration - pre-test conditions - test sequence - test verdict Change-Id: I2841a7ff3d248bb3e4739579fad722dc02b5504f Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit c8bde3b59031b352bf09302ae7644436860602d7)