aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-02-05Fix QnQ issueJohn O Loughlin4-15/+135
Currently if multiple tests are run with a QnQ section defined the QnQ segment gets appended to the frame. This leads to invalid frames when the test is run for more than 1 iteration. With this patch the QnQ is updated if the QnQ segment has already been created. JIRA: YARDSTICK-1513 Change-Id: I4ba6ef89380ccf1cb8a132ff5bf048935a87f0c9 Signed-off-by: John O Loughlin <john.oloughlin@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-05Merge "Add vBNG test cases stats processing functionality"Volodymyr Mytnyk12-251/+1116
2019-02-05Update Sequence runner to use ScenarioOutput classSerhiy Pshyk2-19/+61
List of changes: - update Sequence runner to use new mechanism for reporting data (kpi) - add new rfc2544 example test case that executes the same test with different framesizes sequentially JIRA: YARDSTICK-1592 Change-Id: I731cf1ca40f7232b26ea68f81d22248ebc53eb62 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-02-04Trex client not starting in 4 port baremetalDanielMartinBuckley1-3/+19
JIRA: YARDSTICK-1589 After calling STLclient.connect() there is no check if connection was sucessfull or not. Added a check for success on connect, retry if failure and disconnect and connect on timeout. If still connect failed then do not resume .. end with LOG.critial and exit. Change-Id: Ifd306b7920d9acbc16681cf79bf952d5af31eb64 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-04Support NSB NFVi buffering and Load Balance on 2 and 4 portsDanielMartinBuckley22-35/+1505
JIRA: YARDSTICK-1582 Most use cases support 4 ports. Buffering support only 1 core. Request is about supporting buffering & Load balance for 2 and 4 ports Change-Id: I734f9d6702825b31253a21092c86fc72e367586b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-04Merge "Replace script to install.yaml in nsb_setup.sh"Volodymyr Mytnyk4-20/+48
2019-02-01[docs] Update on Yardstick NSB installationStepan Andrushko2-90/+148
Updated how to install Yardstick and NSB components. Updated: - 04-installation.rst - 13-nsb-installation.rst JIRA: YARDSTICK-1335 Change-Id: If3f88a316f0581b82bfe31abd5fbe5b54a559f6e Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-02-01Add vBNG test cases stats processing functionalityOleksandr Naumets12-251/+1116
JIRA: YARDSTICK-1546 Change-Id: I3575223ef8231fb4d574e961360b0f2d90a71749 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-01Refactor SampleVNF wait methodMytnyk, Volodymyr5-1/+94
JIRA: YARDSTICK-1439 Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-31Add rate 'resolution' option for IXIA rfc2544 testSerhiy Pshyk4-20/+83
Rate resolution value is compared with the difference between the rates in two consecutive iterations. If the difference is smaller than the resolution, the test stops. JIRA: YYARDSTICK-1592 Change-Id: I3f203d33d1688734a59a8f62f31e3ad238bc63b0 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-31Merge "Fix exception handling ixload"Volodymyr Mytnyk3-28/+27
2019-01-31Merge "Refactor: add _get_timestamps()"Volodymyr Mytnyk2-11/+30
2019-01-31Merge "Add new scenario NSPerf-RFC2544"Volodymyr Mytnyk8-52/+473
2019-01-31Mock time.sleep in slow testsEmma Foley4-4/+14
time.sleep was called in a number of classes which wasn't mocked in the tests. This accounted for 2.5 minutes of UT execution time. The calls to time.sleep() have been mocked, and the test execution time has been reduced. JIRA: YARDSTICK-1595 Change-Id: I0a4f4962513cf8845471b074347601e33b35ef25 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-31Fix exception handling ixloadJohn O Loughlin3-28/+27
Ixload uses its own version of python By default it will fail to import yardstick.common exceptions. For this reason for this reason ixload exceptions should be kept in http_ixload.py JIRA: YARDSTICK-1587 Change-Id: I5673fb5b89bbcdf4d3c60c283231d44d770999ec Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-31Add new scenario NSPerf-RFC2544Serhiy Pshyk8-52/+473
List of changes: - Added new scenario NSPerf-RFC2544 that runs complete test per runner's iteration - NSPerf is still present for backward compatibility - Added ScenarioOutput class which allows scenario to report data (kpi,...) at any moment of time (not only once per run) - New output mechanism is used only by new NSPerf-RFC2544 scenario JIRA: YARDSTICK-1592 Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-30[docs][nsb][install] Update source for sample pod filesEmma Foley1-15/+15
The command for copying the sample pod files was incorrect in one instance (baremetal config) and inconsistent in other instances (using ./etc vs <yardstick>/etc vs <repo>/etc) This updates 13-nsb-installation.rst for consistency. Paths within the yardstick repo are preface with ``./``, as initially, the user was instructed to ``cd yardstick``. JIRA: YARDSTICK-1335 Change-Id: Ia5d5fae29373a177f775ea433c56f38bdeca536e Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-30Add cli option framesize for routerJohn O Loughlin58-5583/+40
Remove any duplicated testcases Default framesize to 64B: 100 JIRA: YARDSTICK-1554 Change-Id: I793cead17bc98c2487ca010a6639850bea5d7991 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-30Add cli option framesize for cgnaptJohn O Loughlin18-72/+72
Remove any duplicated testcases Default framesize to 64B: 100 JIRA: YARDSTICK-1554 Change-Id: I2fd7caba9565ba16b2d6494f71ad9b9d476e398b Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-30Add cli option framesize for acl vnfJohn O Loughlin20-80/+80
Remove any duplicated testcases Default framesize to 64B: 100 JIRA: YARDSTICK-1554 Change-Id: I61bbf2e7f0c4bd8c1b8e55769cae092e50140f6a Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-30Add cli option framesize for vfw vnfJohn O Loughlin38-609/+219
Remove any duplicated testcases Default framesize to 64B: 100 Remove _64B_ from name JIRA: YARDSTICK-1554 Change-Id: Ic759971d09102fdbd459d920c441bfd9e794e7e0 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-30Refactor: add _get_timestamps()Emma Foley2-11/+30
JIRA: YARDSTICK-1593 Change-Id: I3ec352dd577c6030fa86a2817e264ba7c80773f1 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-30Merge "NSB sync: clean-up draft IPC implementation (part 1)"Volodymyr Mytnyk55-1220/+256
2019-01-30Merge "Concurrency testcases to be configured over cli"Volodymyr Mytnyk1-2/+2
2019-01-29Concurrency testcases to be configured over cliJohn O Loughlin1-3/+3
This patch will allow the request size to be passed through cli rather than having a seperate file for option. yardstick -d task start --task-args='{page_size: "1b"}' <path to config> JIRA: YARDSTICK-1554 Change-Id: I085d6d908533fb9a7a7566c7c669cb45cf1021e5 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-29Update Intel CopyrightJohn O Loughlin9-9/+9
JIRA: YARDSTICK-1591 Change-Id: I5130602e767009d83f7b39801006d68bcc126ba6 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-29NSB sync: clean-up draft IPC implementation (part 1)Mytnyk, Volodymyr55-1220/+256
The existing implementation of IPC is not finished and isn't used by any of the VNFs/TG implementation. It is used in the code but does nothing from functionality perspective. New syncronization mechanism is going to be implemented by using different approach than it was designed before. Thus, the current IPC mechanism is not going to be re-used. So, removing it. The IPC consumer/producer implementation is left as it may be required for other purposes. - Remove SampleVNF MQ consumer class - Remove IterationIPC MQ producer for VNF control messages - Remove MQ producer from SampleVNFTrafficGen class - Remove TrafficGeneratorProducer class - Remove IterationIPC runner - Remove unused task_id form VNF Generic initialization as it is not required for synchronization of VNFs/TGs anymore. - Fix UT JIRA: YARDSTICK-1592 Change-Id: I65fe51bcbd1bfeea0c43eb79ca6fb2aab5b65ae7 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-29Merge "Remove redundant comment"Emma Foley1-8/+0
2019-01-28Suppress log outputs in test_task.pyEmma Foley1-0/+8
Change-Id: Ic7b4ebe5fff9a0a31e395e67b8a3ea52d99442a9 JIRA: YARDSTICK-1541 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-25Merge "Yardsitck Gambia Release 7.2.0 release notes."Rex Lee1-28/+14
2019-01-24Merge changes from topic 'report/html_table'Volodymyr Mytnyk6-153/+292
* changes: Additional rework of NSB report Only show metrics for selected nodes in data table Fix conversion to JS for HTML reports
2019-01-24Merge "Add functional tests for HTML report"Volodymyr Mytnyk2-0/+100
2019-01-24Yardsitck Gambia Release 7.2.0 release notes.rexlee87761-28/+14
release notes for Gambia 7.2.0 Change-Id: Ib7bd231ee61c73f593d99ab3b13a64c70e758e8a Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-01-24Merge "[dovetail] split the sla check results into process recovery and ↵Rex Lee16-44/+52
service recovery for HA tcs"
2019-01-22Merge "Concurrency testcases to be configured over cli"Volodymyr Mytnyk11-340/+1
2019-01-22Merge "[docs][userguide] Add content and comments to ch12"Volodymyr Mytnyk1-1/+40
2019-01-22[docs][userguide] Add content and comments to ch12Emma Foley1-1/+40
JIRA: YARDSTICK-1335 Change-Id: Ibab629b44a8daeebab95fe7eee056b6403cd98c1 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-22Concurrency testcases to be configured over cliJohn O Loughlin11-340/+1
Remove old Concurrency test cases These test cases are no longer working. page_object: uplink: ["/1b.html"] should be used to specify request size JIRA: YARDSTICK-1588 Change-Id: I446b3179ee090ca7a83fdaab57a96ac0f780dd93 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-22[dovetail] split the sla check results into process recovery and servicerexlee877616-44/+52
recovery for HA tcs make sla check for process recovery optional: only check when sla is set. JIRA: YARDSTICK-1512 Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-01-21Merge "Adding scale up feature to prox ACL SRIOV OvS-DPDK."Volodymyr Mytnyk2-0/+212
2019-01-21Merge "Pass the path of ssh public key to scenario method"Emma Foley1-1/+3
2019-01-21Adding scale up feature to prox ACL SRIOV OvS-DPDK.Carey, Alan2-0/+212
Files to be added: tc_prox_sriov_acl-scale-up.yaml tc_prox_ovs-dpdk_acl-scale-up.yaml JIRA: YARDSTICK-1553 Change-Id: Ib3a05aff2e6b9c0b3bced5b2b775e849a4e33ebf Signed-off-by: Carey, Alan <alan.carey@intel.com>
2019-01-21Merge "Updating yaml file to match other standalone test cases"Volodymyr Mytnyk1-18/+18
2019-01-18Remove redundant commentEmma Foley1-8/+0
Change-Id: I6f301b0a3d77a692aa06d570eaa6ef3e820973d7 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-17Add NSB test descriptors for vIPSEC testcasetreyad5-0/+361
JIRA: YARDSTICK-1452 Change-Id: Id9731ab52da76efb553a89629ca4639ff3c09650 Signed-off-by: treyad <treyad@viosoft.com>
2019-01-17Merge "[docs][userguide] Update NSB intro in ch12"Volodymyr Mytnyk2-21/+28
2019-01-17Merge "[docs] Make heading levels consistent"Volodymyr Mytnyk12-118/+226
2019-01-16[docs][userguide] Update NSB intro in ch12Emma Foley2-21/+28
This change removes the duplicated NSB entry in ch13 of the userguide, and updates the intro in ch12. This gives a better overview of NSB, and removes the duplicated intro. JIRA: YARDSTICK-1335 Change-Id: Id40f998e4ae2c5256643b683c2e4d19ef472bbcf Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-16[docs] Make heading levels consistentEmma Foley12-118/+226
Update the symbols used to denote different headings to make them consistent across the userguide. JIRA: YARDSTICK-1335 Change-Id: Ib5ab1f14bbaa819cf882dc00d68bc27da3f1eadb Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-16Merge "Suppress log outputs in test_ixnet_api"Volodymyr Mytnyk1-0/+6