aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2019-02-01Refactor SampleVNF wait methodMytnyk, Volodymyr5-1/+94
JIRA: YARDSTICK-1439 Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-31Add rate 'resolution' option for IXIA rfc2544 testSerhiy Pshyk4-20/+83
Rate resolution value is compared with the difference between the rates in two consecutive iterations. If the difference is smaller than the resolution, the test stops. JIRA: YYARDSTICK-1592 Change-Id: I3f203d33d1688734a59a8f62f31e3ad238bc63b0 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-31Merge "Fix exception handling ixload"Volodymyr Mytnyk3-28/+27
2019-01-31Merge "Refactor: add _get_timestamps()"Volodymyr Mytnyk2-11/+30
2019-01-31Fix exception handling ixloadJohn O Loughlin3-28/+27
Ixload uses its own version of python By default it will fail to import yardstick.common exceptions. For this reason for this reason ixload exceptions should be kept in http_ixload.py JIRA: YARDSTICK-1587 Change-Id: I5673fb5b89bbcdf4d3c60c283231d44d770999ec Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-31Add new scenario NSPerf-RFC2544Serhiy Pshyk7-52/+428
List of changes: - Added new scenario NSPerf-RFC2544 that runs complete test per runner's iteration - NSPerf is still present for backward compatibility - Added ScenarioOutput class which allows scenario to report data (kpi,...) at any moment of time (not only once per run) - New output mechanism is used only by new NSPerf-RFC2544 scenario JIRA: YARDSTICK-1592 Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-30Refactor: add _get_timestamps()Emma Foley2-11/+30
JIRA: YARDSTICK-1593 Change-Id: I3ec352dd577c6030fa86a2817e264ba7c80773f1 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-30Merge "NSB sync: clean-up draft IPC implementation (part 1)"Volodymyr Mytnyk54-1124/+256
2019-01-29Update Intel CopyrightJohn O Loughlin2-2/+2
JIRA: YARDSTICK-1591 Change-Id: I5130602e767009d83f7b39801006d68bcc126ba6 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-29NSB sync: clean-up draft IPC implementation (part 1)Mytnyk, Volodymyr54-1124/+256
The existing implementation of IPC is not finished and isn't used by any of the VNFs/TG implementation. It is used in the code but does nothing from functionality perspective. New syncronization mechanism is going to be implemented by using different approach than it was designed before. Thus, the current IPC mechanism is not going to be re-used. So, removing it. The IPC consumer/producer implementation is left as it may be required for other purposes. - Remove SampleVNF MQ consumer class - Remove IterationIPC MQ producer for VNF control messages - Remove MQ producer from SampleVNFTrafficGen class - Remove TrafficGeneratorProducer class - Remove IterationIPC runner - Remove unused task_id form VNF Generic initialization as it is not required for synchronization of VNFs/TGs anymore. - Fix UT JIRA: YARDSTICK-1592 Change-Id: I65fe51bcbd1bfeea0c43eb79ca6fb2aab5b65ae7 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-29Merge "Remove redundant comment"Emma Foley1-8/+0
2019-01-24Merge changes from topic 'report/html_table'Volodymyr Mytnyk6-153/+292
* changes: Additional rework of NSB report Only show metrics for selected nodes in data table Fix conversion to JS for HTML reports
2019-01-24Merge "Add functional tests for HTML report"Volodymyr Mytnyk2-0/+100
2019-01-24Merge "[dovetail] split the sla check results into process recovery and ↵Rex Lee4-20/+52
service recovery for HA tcs"
2019-01-22[dovetail] split the sla check results into process recovery and servicerexlee87764-20/+52
recovery for HA tcs make sla check for process recovery optional: only check when sla is set. JIRA: YARDSTICK-1512 Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-01-21Merge "Pass the path of ssh public key to scenario method"Emma Foley1-1/+3
2019-01-18Remove redundant commentEmma Foley1-8/+0
Change-Id: I6f301b0a3d77a692aa06d570eaa6ef3e820973d7 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-16Merge "Suppress log outputs in test_ixnet_api"Volodymyr Mytnyk1-0/+6
2019-01-15Fix minor issues with IxNet L3 rfc2544Chornyi, TarasX2-4/+4
Changed default rate from 100pps to 100%. Set Ip mask to 32 JIRA: YARDSTICK-1566 Change-Id: I4c0245297b2d6b254c06155047c3499f6572e9c5 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2019-01-11Merge "Rework ↵Volodymyr Mytnyk1-51/+54
network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper"
2019-01-10Merge "Add IxNetwork L3 scenario implementation"Volodymyr Mytnyk6-9/+206
2019-01-04Merge "Add static ip mask support"Volodymyr Mytnyk2-3/+5
2018-12-31Add static ip mask supportChornyi, TarasX2-3/+5
JIRA: YARDSTICK-1566 Change-Id: I6a826d5662a1dfc818c9f1ddf94b3f01c3d37d3b Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-27Add IxNetwork L3 scenario implementationMyron Sosyak6-9/+206
Protocol interfaces are creating with config from pod file Static IP configuration are creating from testcase flow options JIRA: YARDSTICK-1570 Change-Id: I74cde67b5084d5b65d09934fe8fce7760b5ea461 Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-12-27NSB support for [core x-y] NSB PROX NFVI configurationDanielMartinBuckley2-0/+114
JIRA: YARDSTICK-1571 Cores in PROX support multiple configurations NSB supports today the more basic one, i.e. [core x] When one wants to use multiple cores sharing the same configuration, instead of copying the whole [core] section, PROX support the following syntax [core x-y] where x is the 1st core and y the last one or (for instance) [core x,y,z] NSB Now supports [core a,b,c,d] [core a-d] [core a,c-d] Change-Id: I34cd107143c89e16d58e7a99e1887ffbf720a5d1 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-12-24Merge "Compatible with python2 and 3 string check"Jing Lu1-1/+2
2018-12-21Additional rework of NSB reportPatrice Buriez6-145/+129
- Make format_for_jstree expect a list of metric names - Avoid displaying timestamps twice in initial data table - Sort metrics in initial data table - Display testcase name - Fix styling - Make better use of JS and jQuery features - Move event handler to JS file - Avoid adding multiple tbody elements into data table - Adjust unit tests and functional tests accordingly JIRA: YARDSTICK-1367 Topic: report/html_table (12 of 12) Change-Id: I85d853f8e392953cace67e94fa0af2e2492a2b86 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Only show metrics for selected nodes in data tablePatrice Buriez3-4/+47
Together with timestamps, separately added into the table. Optimize the showcasing of graphs and table. JIRA: YARDSTICK-1367 Topic: report/html_table (11 of 12) Change-Id: I263960b059fd27409b36f825664da8c2804e0425 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Fix conversion to JS for HTML reportsPatrice Buriez2-47/+159
Some new fields in InfluxDB have plain text contents that AST cannot parse as valid expressions, resulting in exceptions being raised by yardstick CLI commands "report generate" and "report generate-nsb". Reworked _generate_common() to properly handle and convert: - unicode, str and missing keys - None, unicode, str, float, long and int values - float, long and int stored as unicode or str values Added test__generate_common() unit test, to verify all possible conversion flavors. Also renamed incorrect "tasks" to "metrics". Also fixed warning in Python3 for some unit tests, caused by deprecation of unittest.TestCase.assertRaisesRegexp(). JIRA: YARDSTICK-1367 Topic: report/html_table (10 of 12) Change-Id: Iff75bfd2c1dcaf3806f67f52f0ea594f10aceb5b Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Add functional tests for HTML reportPatrice Buriez2-0/+100
JIRA: YARDSTICK-1367 Topic: report/html_table (9 of 12) Change-Id: I987203c4b3f49fb0f205e9b4c71bcbf4618041a0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-20Merge "Addition of IRQ Mode to NSB NFVI (PROX)"Abhijit Sinha7-1/+1212
2018-12-19Add report generate-nsb commandPatrice Buriez3-43/+95
JIRA: YARDSTICK-1367 Topic: report/html_table (8 of 12) Change-Id: I8a2f96224a745334b67dd71875bebb3b69b9adc3 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-19Merge "Extend ixnet api"Volodymyr Mytnyk2-0/+65
2018-12-19Extend ixnet apiChornyi, TarasX2-0/+65
Add protocol interface creation. Add static protocols ipv4 configuration. JIRA: YARDSTICK-1566 Change-Id: I484d212873ce7e638626053baaf6a972a6ef9f69 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-19Add JS file to NSB report templatePatrice Buriez2-120/+159
Moved function definitions into separate nsb_report.js file for ease of editing, while keeping generated HTML reports self-contained, for storage and publishing purposes. JIRA: YARDSTICK-1367 Topic: report/html_table (7 of 12) Change-Id: I3b3cf8aae8425b486a711a76f4bb2bf8d7fe5ab5 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-19Use Chart.js for graphs in HTML reportsPatrice Buriez4-105/+194
This JavaScript library is available under MIT license. Also adjusted version for jQuery and jsTree, and added fallback font-family names. JIRA: YARDSTICK-1367 Topic: report/html_table (6 of 12) Change-Id: Ibe8b7e3d1f1365d2cbc019bfc22762aaa365a4e1 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-17Merge "Cleanup unittests for test_attacker_baremetal"Abhijit Sinha1-33/+40
2018-12-17Merge "Extend vBNG PPPoE test cases functionality"Volodymyr Mytnyk5-20/+341
2018-12-17Merge "Add support for configuring frame rate per traffic flow for IXIA"Volodymyr Mytnyk3-10/+16
2018-12-13Add support for configuring frame rate per traffic flow for IXIASerhiy Pshyk3-10/+16
Frame rate can be configured per traffic profile and per traffic flow. By default traffic profile is applied to all traffic flows. If per flow rate is specified it overrides default value from profile. JIRA: YARDSTICK-1568 Change-Id: I388ed78869358de17d6485be0cd0d058983390e2 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-13Add raise for iteration exception in IterationRunnercope.li2-0/+46
When we run the testcase, if there was a exception in iteration _work_process, the process will still run on ,and the test result will not affected by the exception. JIRA: YARDSTICK-1555 Change-Id: I03803c0473015379bb0eb20ed7d474a2d923a4e3 Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-13Rework network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelperEmma Foley1-51/+54
JIRA: YARDSTICK-1434 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ieabcdf401d608a3a5f0a0bd9fbbe754591878bd5
2018-12-11Extend vBNG PPPoE test cases functionalityOleksandr Naumets5-20/+341
Extended Ixia traffic generator with functionality to create traffic flows between device groups. JIRA: YARDSTICK-1521 Change-Id: Iaaa822f2f3da876629576d4101be29c9a65296d0 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-11Pass the path of ssh public key to scenario methodcope.li1-1/+3
In our testcase, we need the key_file for our VM login. JIRA:YARDSTICK-1558 Change-Id: If99704c4f91c87d79e156f2dd73795a059b7ce6c Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-11Merge "Add option to allow user to pass vpe_script"Volodymyr Mytnyk2-6/+14
2018-12-07Cleanup unittests for test_attacker_baremetalEmma Foley1-33/+40
unused-arg check was re-enabled after being disabled at a file level. Changes were made so that the file conforms to our testing conventions. JIRA: YARDSTICK-1384 Change-Id: I27b41e79fd6e4e9fbefccf8b72c4a43926e25312 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-12-07Compatible with python2 and 3 string checkcope.li1-1/+2
JIRA:YARDSTICK-1557 Change-Id: I54ee4d6ef835e8e6ecd55cfa305151e842f88b03 Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-07Add vBNG PPPoE test cases functionalitySerhiy Pshyk5-26/+642
Added vBNG PPPoE test cases functionality which allows to: - create and configure access network connections (PPPoE subscribers); - create and configure core network connections; - configure and run traffic between access and core network topologies. JIRA: YARDSTICK-1508 Change-Id: I90975505fe7318227a837d97e8db4a06712de7eb Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-06Suppress log outputs in test_ixnet_apiEmma Foley1-0/+6
JIRA: YARDSTICK-1541 Change-Id: Icee1ec0fb9e8eea6c89c6c513fe87ff49a3cb3d4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-11-30Handle HTTP traffic profile parameters as optionalSerhiy Pshyk1-2/+6
JIRA: YARDSTICK-1548 Change-Id: I1130b33a1ab441a7a9ebf24beb954c9dab0ebc29 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>