aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2019-02-11Merge "Add IXIA Tx/Rx Bytes stats into results"Volodymyr Mytnyk8-0/+98
2019-02-11benchmark.core.report: Add _combine_timesEmma Foley2-0/+173
_combine_times() combines and interleves separate lists of timestamps. This will allow the Yardstick and Barometer timestamps to be combined for the dynamic HTML report created with ``yardstick report generate-nsb`` command. JIRA: YARDSTICK-1593 Change-Id: I0f5ea4d001775495fb9b9b4de2d2360c9c61cc51 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11benchmark.core.report: Add _get_baro_metricsEmma Foley2-1/+191
Retrieve and parse Barometer metrics relevant to a Yardstick testcase. _get_barometer_metrics() retrieves NFVi metrics from collectd for metrics collected during a Yardstick test case. JIRA: YARDSTICK-1593 Change-Id: I1ef1ccd999e1cbee546db39fb8ad6de0d97e6576 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11Add ability to get data from different DBs in influxEmma Foley1-2/+3
In order to get data from Barometer, the influx helper need to be updated to recognise different DBs. This patch adds an optional arg to specify which database to use. By default, the configured dispatcher for Yardstick is used. Limitation: The new change hard codes barometer DB name to be used, and assumes that it is in the same instance of Influx as the Yardstick dispatcher. This can be extended later to make it configurable, however, a new config option would have to be introduced. JIRA: YARDSTICK-1593 Change-Id: Idee9c3491d6bf7b549e014edd9ff031312cf0ec2 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11Refactor: add _format_datasetsEmma Foley2-35/+97
JIRA: YARDSTICK-1593 Change-Id: I8d2c8665d767c92da20db8f97690f20da4a68908 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11Merge "Debugging information when dpdk bind fails should be improved"Abhijit Sinha3-0/+6
2019-02-08Merge "Fix QnQ issue"Volodymyr Mytnyk4-15/+135
2019-02-08Add IXIA Tx/Rx Bytes stats into resultsOleksandr Naumets8-0/+98
Add IXIA "Bytes Rx" and "Bytes Tx" ports stats into collected results. This stats allows to calculate the throughput when running IMIX traffic. JIRA: YARDSTICK-1592 Change-Id: I1db678d410b37e7a0f64dc743e6e620e495115ed Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-08Migrate Trex TG to use new NSPerf-RFC2544 scenarioMytnyk, Volodymyr7-51/+106
JIRA: YARDSTICK-1592 Change-Id: Ic51a52385ac53df9b5f56387af4f1b661bb0d86f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-02-07Rework TestScenarioHelperEmma Foley1-22/+18
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I1bbf2bc139f3302d9882b28f9883e64fa595eb46 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Rework TestSampleVNFDeployHelperEmma Foley1-44/+41
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: Ib15e37987ec336f611b27ea71cbc3005311e5d27 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Rework TestResourceHelperEmma Foley1-181/+121
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I56e14a2557554e1c461447f0567b5e028198b553 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Rework TestDpdkVnfSetupEnvHelperEmma Foley1-220/+114
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I5b3ef90909949882cec1c32b1f86c3aedbc950d8 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Update Intel Copyright for files edited in 2019John O Loughlin46-46/+46
JIRA: YARDSTICK-1591 Change-Id: I3ea9039d25bfce578681adb9e27e1598e84a1f56 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-07Merge "Add Warning for key issue ixload"Volodymyr Mytnyk1-1/+6
2019-02-07Add Warning for key issue ixloadJohn O Loughlin1-1/+6
Currently there is a section of code that assigns a gateway links[name]["ip"]["gateway"] = gateway If the ip field has not already been defined a key error is thrown and not handled. This error is then suppressed so the program fails silently and thus causes the test case to hang. JIRA: YARDSTICK-1586 Change-Id: I94a1081a2038fb58989b3033444ea5f3a6e178f0 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-07Merge "Extend IXIA RFC2544 test case collected stats"Volodymyr Mytnyk4-3/+79
2019-02-06Debugging information when dpdk bind fails should be improvedDanielMartinBuckley3-0/+6
JIRA: YARDSTICK-1585 When dpdk-devbind.py is failing, the information provided is poor, making it difficult to debug. At least the exact command used should be printed, ideally with the returned error. As of today, the more interesting line is DpdkBindHelperException: /opt/nsb_bin/dpdk-devbind.py command failed with rc=1 Change-Id: I7831c81ffa9e1f4695480eb140fa97a58ff88f8c Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-06Merge "Mock time.sleep in slow tests"Volodymyr Mytnyk4-4/+14
2019-02-06Extend IXIA RFC2544 test case collected statsOleksandr Naumets4-3/+79
Added new fields into Yardstick NSB IXIA RFC2544 test case results: - Iteration (only for NSPerf-RFC2544 scenario) - Rate (for NSPerf and NSPerf-RFC2544 scenarios) - PktSize (for NSPerf and NSPerf-RFC2544 scenarios) JIRA: YARDSTICK-1596 Change-Id: I3bbf4aabf8b57580ebe644e967a5dab69e3a7c8d Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-06Merge "Improve SSH to Open/Close interactive terminal"Volodymyr Mytnyk2-0/+122
2019-02-06Merge "Update Sequence runner to use ScenarioOutput class"Volodymyr Mytnyk1-19/+14
2019-02-05Fix QnQ issueJohn O Loughlin4-15/+135
Currently if multiple tests are run with a QnQ section defined the QnQ segment gets appended to the frame. This leads to invalid frames when the test is run for more than 1 iteration. With this patch the QnQ is updated if the QnQ segment has already been created. JIRA: YARDSTICK-1513 Change-Id: I4ba6ef89380ccf1cb8a132ff5bf048935a87f0c9 Signed-off-by: John O Loughlin <john.oloughlin@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-05Merge "Add vBNG test cases stats processing functionality"Volodymyr Mytnyk8-107/+959
2019-02-05Update Sequence runner to use ScenarioOutput classSerhiy Pshyk1-19/+14
List of changes: - update Sequence runner to use new mechanism for reporting data (kpi) - add new rfc2544 example test case that executes the same test with different framesizes sequentially JIRA: YARDSTICK-1592 Change-Id: I731cf1ca40f7232b26ea68f81d22248ebc53eb62 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-02-04Trex client not starting in 4 port baremetalDanielMartinBuckley1-3/+19
JIRA: YARDSTICK-1589 After calling STLclient.connect() there is no check if connection was sucessfull or not. Added a check for success on connect, retry if failure and disconnect and connect on timeout. If still connect failed then do not resume .. end with LOG.critial and exit. Change-Id: Ifd306b7920d9acbc16681cf79bf952d5af31eb64 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-01Add vBNG test cases stats processing functionalityOleksandr Naumets8-107/+959
JIRA: YARDSTICK-1546 Change-Id: I3575223ef8231fb4d574e961360b0f2d90a71749 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-01Refactor SampleVNF wait methodMytnyk, Volodymyr5-1/+94
JIRA: YARDSTICK-1439 Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-31Add rate 'resolution' option for IXIA rfc2544 testSerhiy Pshyk4-20/+83
Rate resolution value is compared with the difference between the rates in two consecutive iterations. If the difference is smaller than the resolution, the test stops. JIRA: YYARDSTICK-1592 Change-Id: I3f203d33d1688734a59a8f62f31e3ad238bc63b0 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-31Merge "Fix exception handling ixload"Volodymyr Mytnyk3-28/+27
2019-01-31Merge "Refactor: add _get_timestamps()"Volodymyr Mytnyk2-11/+30
2019-01-31Mock time.sleep in slow testsEmma Foley4-4/+14
time.sleep was called in a number of classes which wasn't mocked in the tests. This accounted for 2.5 minutes of UT execution time. The calls to time.sleep() have been mocked, and the test execution time has been reduced. JIRA: YARDSTICK-1595 Change-Id: I0a4f4962513cf8845471b074347601e33b35ef25 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-31Fix exception handling ixloadJohn O Loughlin3-28/+27
Ixload uses its own version of python By default it will fail to import yardstick.common exceptions. For this reason for this reason ixload exceptions should be kept in http_ixload.py JIRA: YARDSTICK-1587 Change-Id: I5673fb5b89bbcdf4d3c60c283231d44d770999ec Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-31Add new scenario NSPerf-RFC2544Serhiy Pshyk7-52/+428
List of changes: - Added new scenario NSPerf-RFC2544 that runs complete test per runner's iteration - NSPerf is still present for backward compatibility - Added ScenarioOutput class which allows scenario to report data (kpi,...) at any moment of time (not only once per run) - New output mechanism is used only by new NSPerf-RFC2544 scenario JIRA: YARDSTICK-1592 Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-30Refactor: add _get_timestamps()Emma Foley2-11/+30
JIRA: YARDSTICK-1593 Change-Id: I3ec352dd577c6030fa86a2817e264ba7c80773f1 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-30Merge "NSB sync: clean-up draft IPC implementation (part 1)"Volodymyr Mytnyk54-1124/+256
2019-01-29Update Intel CopyrightJohn O Loughlin2-2/+2
JIRA: YARDSTICK-1591 Change-Id: I5130602e767009d83f7b39801006d68bcc126ba6 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-29NSB sync: clean-up draft IPC implementation (part 1)Mytnyk, Volodymyr54-1124/+256
The existing implementation of IPC is not finished and isn't used by any of the VNFs/TG implementation. It is used in the code but does nothing from functionality perspective. New syncronization mechanism is going to be implemented by using different approach than it was designed before. Thus, the current IPC mechanism is not going to be re-used. So, removing it. The IPC consumer/producer implementation is left as it may be required for other purposes. - Remove SampleVNF MQ consumer class - Remove IterationIPC MQ producer for VNF control messages - Remove MQ producer from SampleVNFTrafficGen class - Remove TrafficGeneratorProducer class - Remove IterationIPC runner - Remove unused task_id form VNF Generic initialization as it is not required for synchronization of VNFs/TGs anymore. - Fix UT JIRA: YARDSTICK-1592 Change-Id: I65fe51bcbd1bfeea0c43eb79ca6fb2aab5b65ae7 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-29Merge "Remove redundant comment"Emma Foley1-8/+0
2019-01-28Suppress log outputs in test_task.pyEmma Foley1-0/+8
Change-Id: Ic7b4ebe5fff9a0a31e395e67b8a3ea52d99442a9 JIRA: YARDSTICK-1541 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-24Merge changes from topic 'report/html_table'Volodymyr Mytnyk6-153/+292
* changes: Additional rework of NSB report Only show metrics for selected nodes in data table Fix conversion to JS for HTML reports
2019-01-24Merge "Add functional tests for HTML report"Volodymyr Mytnyk2-0/+100
2019-01-24Merge "[dovetail] split the sla check results into process recovery and ↵Rex Lee4-20/+52
service recovery for HA tcs"
2019-01-22[dovetail] split the sla check results into process recovery and servicerexlee87764-20/+52
recovery for HA tcs make sla check for process recovery optional: only check when sla is set. JIRA: YARDSTICK-1512 Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-01-21Merge "Pass the path of ssh public key to scenario method"Emma Foley1-1/+3
2019-01-18Remove redundant commentEmma Foley1-8/+0
Change-Id: I6f301b0a3d77a692aa06d570eaa6ef3e820973d7 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-16Merge "Suppress log outputs in test_ixnet_api"Volodymyr Mytnyk1-0/+6
2019-01-15Fix minor issues with IxNet L3 rfc2544Chornyi, TarasX2-4/+4
Changed default rate from 100pps to 100%. Set Ip mask to 32 JIRA: YARDSTICK-1566 Change-Id: I4c0245297b2d6b254c06155047c3499f6572e9c5 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2019-01-14Improve SSH to Open/Close interactive terminaltreyad2-0/+122
Support Open/Close interactive terminal on a SSH channel. Support Execute command on interactive terminal. JIRA: YARDSTICK-1482 Change-Id: I0d1588707c3fb3e5e65fb72115f27e713d4b4828 Signed-off-by: treyad <treyad@viosoft.com>
2019-01-11Merge "Rework ↵Volodymyr Mytnyk1-51/+54
network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper"