aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2019-01-30Merge "NSB sync: clean-up draft IPC implementation (part 1)"Volodymyr Mytnyk54-1124/+256
2019-01-29Update Intel CopyrightJohn O Loughlin2-2/+2
JIRA: YARDSTICK-1591 Change-Id: I5130602e767009d83f7b39801006d68bcc126ba6 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-29NSB sync: clean-up draft IPC implementation (part 1)Mytnyk, Volodymyr54-1124/+256
The existing implementation of IPC is not finished and isn't used by any of the VNFs/TG implementation. It is used in the code but does nothing from functionality perspective. New syncronization mechanism is going to be implemented by using different approach than it was designed before. Thus, the current IPC mechanism is not going to be re-used. So, removing it. The IPC consumer/producer implementation is left as it may be required for other purposes. - Remove SampleVNF MQ consumer class - Remove IterationIPC MQ producer for VNF control messages - Remove MQ producer from SampleVNFTrafficGen class - Remove TrafficGeneratorProducer class - Remove IterationIPC runner - Remove unused task_id form VNF Generic initialization as it is not required for synchronization of VNFs/TGs anymore. - Fix UT JIRA: YARDSTICK-1592 Change-Id: I65fe51bcbd1bfeea0c43eb79ca6fb2aab5b65ae7 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-29Merge "Remove redundant comment"Emma Foley1-8/+0
2019-01-24Merge changes from topic 'report/html_table'Volodymyr Mytnyk6-153/+292
* changes: Additional rework of NSB report Only show metrics for selected nodes in data table Fix conversion to JS for HTML reports
2019-01-24Merge "Add functional tests for HTML report"Volodymyr Mytnyk2-0/+100
2019-01-24Merge "[dovetail] split the sla check results into process recovery and ↵Rex Lee4-20/+52
service recovery for HA tcs"
2019-01-22[dovetail] split the sla check results into process recovery and servicerexlee87764-20/+52
recovery for HA tcs make sla check for process recovery optional: only check when sla is set. JIRA: YARDSTICK-1512 Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-01-21Merge "Pass the path of ssh public key to scenario method"Emma Foley1-1/+3
2019-01-18Remove redundant commentEmma Foley1-8/+0
Change-Id: I6f301b0a3d77a692aa06d570eaa6ef3e820973d7 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-16Merge "Suppress log outputs in test_ixnet_api"Volodymyr Mytnyk1-0/+6
2019-01-15Fix minor issues with IxNet L3 rfc2544Chornyi, TarasX2-4/+4
Changed default rate from 100pps to 100%. Set Ip mask to 32 JIRA: YARDSTICK-1566 Change-Id: I4c0245297b2d6b254c06155047c3499f6572e9c5 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2019-01-11Merge "Rework ↵Volodymyr Mytnyk1-51/+54
network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper"
2019-01-10Merge "Add IxNetwork L3 scenario implementation"Volodymyr Mytnyk6-9/+206
2019-01-04Merge "Add static ip mask support"Volodymyr Mytnyk2-3/+5
2018-12-31Add static ip mask supportChornyi, TarasX2-3/+5
JIRA: YARDSTICK-1566 Change-Id: I6a826d5662a1dfc818c9f1ddf94b3f01c3d37d3b Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-27Add IxNetwork L3 scenario implementationMyron Sosyak6-9/+206
Protocol interfaces are creating with config from pod file Static IP configuration are creating from testcase flow options JIRA: YARDSTICK-1570 Change-Id: I74cde67b5084d5b65d09934fe8fce7760b5ea461 Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-12-27NSB support for [core x-y] NSB PROX NFVI configurationDanielMartinBuckley2-0/+114
JIRA: YARDSTICK-1571 Cores in PROX support multiple configurations NSB supports today the more basic one, i.e. [core x] When one wants to use multiple cores sharing the same configuration, instead of copying the whole [core] section, PROX support the following syntax [core x-y] where x is the 1st core and y the last one or (for instance) [core x,y,z] NSB Now supports [core a,b,c,d] [core a-d] [core a,c-d] Change-Id: I34cd107143c89e16d58e7a99e1887ffbf720a5d1 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-12-24Merge "Compatible with python2 and 3 string check"Jing Lu1-1/+2
2018-12-21Additional rework of NSB reportPatrice Buriez6-145/+129
- Make format_for_jstree expect a list of metric names - Avoid displaying timestamps twice in initial data table - Sort metrics in initial data table - Display testcase name - Fix styling - Make better use of JS and jQuery features - Move event handler to JS file - Avoid adding multiple tbody elements into data table - Adjust unit tests and functional tests accordingly JIRA: YARDSTICK-1367 Topic: report/html_table (12 of 12) Change-Id: I85d853f8e392953cace67e94fa0af2e2492a2b86 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Only show metrics for selected nodes in data tablePatrice Buriez3-4/+47
Together with timestamps, separately added into the table. Optimize the showcasing of graphs and table. JIRA: YARDSTICK-1367 Topic: report/html_table (11 of 12) Change-Id: I263960b059fd27409b36f825664da8c2804e0425 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Fix conversion to JS for HTML reportsPatrice Buriez2-47/+159
Some new fields in InfluxDB have plain text contents that AST cannot parse as valid expressions, resulting in exceptions being raised by yardstick CLI commands "report generate" and "report generate-nsb". Reworked _generate_common() to properly handle and convert: - unicode, str and missing keys - None, unicode, str, float, long and int values - float, long and int stored as unicode or str values Added test__generate_common() unit test, to verify all possible conversion flavors. Also renamed incorrect "tasks" to "metrics". Also fixed warning in Python3 for some unit tests, caused by deprecation of unittest.TestCase.assertRaisesRegexp(). JIRA: YARDSTICK-1367 Topic: report/html_table (10 of 12) Change-Id: Iff75bfd2c1dcaf3806f67f52f0ea594f10aceb5b Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Add functional tests for HTML reportPatrice Buriez2-0/+100
JIRA: YARDSTICK-1367 Topic: report/html_table (9 of 12) Change-Id: I987203c4b3f49fb0f205e9b4c71bcbf4618041a0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-20Merge "Addition of IRQ Mode to NSB NFVI (PROX)"Abhijit Sinha7-1/+1212
2018-12-19Add report generate-nsb commandPatrice Buriez3-43/+95
JIRA: YARDSTICK-1367 Topic: report/html_table (8 of 12) Change-Id: I8a2f96224a745334b67dd71875bebb3b69b9adc3 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-19Merge "Extend ixnet api"Volodymyr Mytnyk2-0/+65
2018-12-19Extend ixnet apiChornyi, TarasX2-0/+65
Add protocol interface creation. Add static protocols ipv4 configuration. JIRA: YARDSTICK-1566 Change-Id: I484d212873ce7e638626053baaf6a972a6ef9f69 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-19Add JS file to NSB report templatePatrice Buriez2-120/+159
Moved function definitions into separate nsb_report.js file for ease of editing, while keeping generated HTML reports self-contained, for storage and publishing purposes. JIRA: YARDSTICK-1367 Topic: report/html_table (7 of 12) Change-Id: I3b3cf8aae8425b486a711a76f4bb2bf8d7fe5ab5 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-19Use Chart.js for graphs in HTML reportsPatrice Buriez4-105/+194
This JavaScript library is available under MIT license. Also adjusted version for jQuery and jsTree, and added fallback font-family names. JIRA: YARDSTICK-1367 Topic: report/html_table (6 of 12) Change-Id: Ibe8b7e3d1f1365d2cbc019bfc22762aaa365a4e1 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-17Merge "Cleanup unittests for test_attacker_baremetal"Abhijit Sinha1-33/+40
2018-12-17Merge "Extend vBNG PPPoE test cases functionality"Volodymyr Mytnyk5-20/+341
2018-12-17Merge "Add support for configuring frame rate per traffic flow for IXIA"Volodymyr Mytnyk3-10/+16
2018-12-13Add support for configuring frame rate per traffic flow for IXIASerhiy Pshyk3-10/+16
Frame rate can be configured per traffic profile and per traffic flow. By default traffic profile is applied to all traffic flows. If per flow rate is specified it overrides default value from profile. JIRA: YARDSTICK-1568 Change-Id: I388ed78869358de17d6485be0cd0d058983390e2 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-13Add raise for iteration exception in IterationRunnercope.li2-0/+46
When we run the testcase, if there was a exception in iteration _work_process, the process will still run on ,and the test result will not affected by the exception. JIRA: YARDSTICK-1555 Change-Id: I03803c0473015379bb0eb20ed7d474a2d923a4e3 Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-13Rework network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelperEmma Foley1-51/+54
JIRA: YARDSTICK-1434 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ieabcdf401d608a3a5f0a0bd9fbbe754591878bd5
2018-12-11Extend vBNG PPPoE test cases functionalityOleksandr Naumets5-20/+341
Extended Ixia traffic generator with functionality to create traffic flows between device groups. JIRA: YARDSTICK-1521 Change-Id: Iaaa822f2f3da876629576d4101be29c9a65296d0 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-11Pass the path of ssh public key to scenario methodcope.li1-1/+3
In our testcase, we need the key_file for our VM login. JIRA:YARDSTICK-1558 Change-Id: If99704c4f91c87d79e156f2dd73795a059b7ce6c Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-11Merge "Add option to allow user to pass vpe_script"Volodymyr Mytnyk2-6/+14
2018-12-07Cleanup unittests for test_attacker_baremetalEmma Foley1-33/+40
unused-arg check was re-enabled after being disabled at a file level. Changes were made so that the file conforms to our testing conventions. JIRA: YARDSTICK-1384 Change-Id: I27b41e79fd6e4e9fbefccf8b72c4a43926e25312 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-12-07Compatible with python2 and 3 string checkcope.li1-1/+2
JIRA:YARDSTICK-1557 Change-Id: I54ee4d6ef835e8e6ecd55cfa305151e842f88b03 Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-07Add vBNG PPPoE test cases functionalitySerhiy Pshyk5-26/+642
Added vBNG PPPoE test cases functionality which allows to: - create and configure access network connections (PPPoE subscribers); - create and configure core network connections; - configure and run traffic between access and core network topologies. JIRA: YARDSTICK-1508 Change-Id: I90975505fe7318227a837d97e8db4a06712de7eb Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-06Suppress log outputs in test_ixnet_apiEmma Foley1-0/+6
JIRA: YARDSTICK-1541 Change-Id: Icee1ec0fb9e8eea6c89c6c513fe87ff49a3cb3d4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-11-30Handle HTTP traffic profile parameters as optionalSerhiy Pshyk1-2/+6
JIRA: YARDSTICK-1548 Change-Id: I1130b33a1ab441a7a9ebf24beb954c9dab0ebc29 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-11-29Merge "Distribute dpdk/vhostuser between CPUs for SA OVS"Volodymyr Mytnyk2-10/+32
2018-11-28Addition of IRQ Mode to NSB NFVI (PROX)DanielMartinBuckley7-1/+1212
JIRA: YARDSTICK-1524 Add dashboard, Traffic Profile support, PROX IRQ support, topology Change-Id: I0c0cde66f4f4d3d25aa77c502bd4349cc1b3eca2 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-28Merge "NSB NFVi PROX Should report realtime port activity not historical data"Abhijit Sinha5-10/+303
2018-11-27NSB NFVi PROX Should report realtime port activity notDanielMartinBuckley5-10/+303
historical data JIRA: YARDSTICK-1458 The TG is only sampled at the end of every test interval. This is incorrect. It should be sampled every interval. Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-27Add option to allow user to pass vpe_scriptJohn O Loughlin2-6/+14
Add option to allow user to pass their own vpe_script vpe_script will be auto-generated by default. To use your own config file use the 'script' parameter in the config file vnf_config: { file: './vpe_config/vpe_config_2_ports', action_bulk_file: './vpe_config/action_bulk_512.txt', full_tm_profile_file: './vpe_config/full_tm_profile_10G.cfg', script_file: './vpe_config/vpe_script_sample } JIRA: YARDSTICK-1525 Change-Id: Ie23e5705f4c0475e858be73b8a504a7df8898828 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-23Add template and css for nsb reportPatrice Buriez2-0/+189
JIRA: YARDSTICK-1367 Topic: report/html_table (5 of 11) Change-Id: I7b8f2fa2aff3d5ee20ec23189acefe41452ad496 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-11-22Add parser to support jsTree in reportPatrice Buriez2-3/+133
Allow the user to select what data to show in the report using jsTree to navigate a hierarchical metrics list. JIRA: YARDSTICK-1367 Topic: report/html_table (4 of 11) Change-Id: I86d782a0a70b80a1cdfaab2f41afb7668066cbf7 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>