aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2019-01-10Merge "Add IxNetwork L3 scenario implementation"Volodymyr Mytnyk6-9/+206
2019-01-04Merge "Add static ip mask support"Volodymyr Mytnyk2-3/+5
2019-01-04Upload config files for barometer collectd containerChornyi, TarasX1-0/+3
JIRA: YARDSTICK-1257 Change-Id: I7e46823cb068b59b4bfb7d86e2cd4c842f74a1bd Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-31Add static ip mask supportChornyi, TarasX2-3/+5
JIRA: YARDSTICK-1566 Change-Id: I6a826d5662a1dfc818c9f1ddf94b3f01c3d37d3b Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-27Add IxNetwork L3 scenario implementationMyron Sosyak6-9/+206
Protocol interfaces are creating with config from pod file Static IP configuration are creating from testcase flow options JIRA: YARDSTICK-1570 Change-Id: I74cde67b5084d5b65d09934fe8fce7760b5ea461 Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-12-27NSB support for [core x-y] NSB PROX NFVI configurationDanielMartinBuckley2-0/+114
JIRA: YARDSTICK-1571 Cores in PROX support multiple configurations NSB supports today the more basic one, i.e. [core x] When one wants to use multiple cores sharing the same configuration, instead of copying the whole [core] section, PROX support the following syntax [core x-y] where x is the 1st core and y the last one or (for instance) [core x,y,z] NSB Now supports [core a,b,c,d] [core a-d] [core a,c-d] Change-Id: I34cd107143c89e16d58e7a99e1887ffbf720a5d1 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-12-24Merge "Compatible with python2 and 3 string check"Jing Lu1-1/+2
2018-12-21Additional rework of NSB reportPatrice Buriez6-145/+129
- Make format_for_jstree expect a list of metric names - Avoid displaying timestamps twice in initial data table - Sort metrics in initial data table - Display testcase name - Fix styling - Make better use of JS and jQuery features - Move event handler to JS file - Avoid adding multiple tbody elements into data table - Adjust unit tests and functional tests accordingly JIRA: YARDSTICK-1367 Topic: report/html_table (12 of 12) Change-Id: I85d853f8e392953cace67e94fa0af2e2492a2b86 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Only show metrics for selected nodes in data tablePatrice Buriez3-4/+47
Together with timestamps, separately added into the table. Optimize the showcasing of graphs and table. JIRA: YARDSTICK-1367 Topic: report/html_table (11 of 12) Change-Id: I263960b059fd27409b36f825664da8c2804e0425 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Fix conversion to JS for HTML reportsPatrice Buriez2-47/+159
Some new fields in InfluxDB have plain text contents that AST cannot parse as valid expressions, resulting in exceptions being raised by yardstick CLI commands "report generate" and "report generate-nsb". Reworked _generate_common() to properly handle and convert: - unicode, str and missing keys - None, unicode, str, float, long and int values - float, long and int stored as unicode or str values Added test__generate_common() unit test, to verify all possible conversion flavors. Also renamed incorrect "tasks" to "metrics". Also fixed warning in Python3 for some unit tests, caused by deprecation of unittest.TestCase.assertRaisesRegexp(). JIRA: YARDSTICK-1367 Topic: report/html_table (10 of 12) Change-Id: Iff75bfd2c1dcaf3806f67f52f0ea594f10aceb5b Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-21Add functional tests for HTML reportPatrice Buriez2-0/+100
JIRA: YARDSTICK-1367 Topic: report/html_table (9 of 12) Change-Id: I987203c4b3f49fb0f205e9b4c71bcbf4618041a0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-20Merge "Addition of IRQ Mode to NSB NFVI (PROX)"Abhijit Sinha7-1/+1212
2018-12-19Add report generate-nsb commandPatrice Buriez3-43/+95
JIRA: YARDSTICK-1367 Topic: report/html_table (8 of 12) Change-Id: I8a2f96224a745334b67dd71875bebb3b69b9adc3 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-19Merge "Extend ixnet api"Volodymyr Mytnyk2-0/+65
2018-12-19Extend ixnet apiChornyi, TarasX2-0/+65
Add protocol interface creation. Add static protocols ipv4 configuration. JIRA: YARDSTICK-1566 Change-Id: I484d212873ce7e638626053baaf6a972a6ef9f69 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-12-19Add JS file to NSB report templatePatrice Buriez2-120/+159
Moved function definitions into separate nsb_report.js file for ease of editing, while keeping generated HTML reports self-contained, for storage and publishing purposes. JIRA: YARDSTICK-1367 Topic: report/html_table (7 of 12) Change-Id: I3b3cf8aae8425b486a711a76f4bb2bf8d7fe5ab5 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-19Use Chart.js for graphs in HTML reportsPatrice Buriez4-105/+194
This JavaScript library is available under MIT license. Also adjusted version for jQuery and jsTree, and added fallback font-family names. JIRA: YARDSTICK-1367 Topic: report/html_table (6 of 12) Change-Id: Ibe8b7e3d1f1365d2cbc019bfc22762aaa365a4e1 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-12-17Merge "Cleanup unittests for test_attacker_baremetal"Abhijit Sinha1-33/+40
2018-12-17Merge "Extend vBNG PPPoE test cases functionality"Volodymyr Mytnyk5-20/+341
2018-12-17Merge "Add support for configuring frame rate per traffic flow for IXIA"Volodymyr Mytnyk3-10/+16
2018-12-13Add support for configuring frame rate per traffic flow for IXIASerhiy Pshyk3-10/+16
Frame rate can be configured per traffic profile and per traffic flow. By default traffic profile is applied to all traffic flows. If per flow rate is specified it overrides default value from profile. JIRA: YARDSTICK-1568 Change-Id: I388ed78869358de17d6485be0cd0d058983390e2 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-13Add raise for iteration exception in IterationRunnercope.li2-0/+46
When we run the testcase, if there was a exception in iteration _work_process, the process will still run on ,and the test result will not affected by the exception. JIRA: YARDSTICK-1555 Change-Id: I03803c0473015379bb0eb20ed7d474a2d923a4e3 Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-13Rework network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelperEmma Foley1-51/+54
JIRA: YARDSTICK-1434 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Ieabcdf401d608a3a5f0a0bd9fbbe754591878bd5
2018-12-11Extend vBNG PPPoE test cases functionalityOleksandr Naumets5-20/+341
Extended Ixia traffic generator with functionality to create traffic flows between device groups. JIRA: YARDSTICK-1521 Change-Id: Iaaa822f2f3da876629576d4101be29c9a65296d0 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-11Pass the path of ssh public key to scenario methodcope.li1-1/+3
In our testcase, we need the key_file for our VM login. JIRA:YARDSTICK-1558 Change-Id: If99704c4f91c87d79e156f2dd73795a059b7ce6c Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-11Merge "Add option to allow user to pass vpe_script"Volodymyr Mytnyk2-6/+14
2018-12-07Cleanup unittests for test_attacker_baremetalEmma Foley1-33/+40
unused-arg check was re-enabled after being disabled at a file level. Changes were made so that the file conforms to our testing conventions. JIRA: YARDSTICK-1384 Change-Id: I27b41e79fd6e4e9fbefccf8b72c4a43926e25312 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-12-07Compatible with python2 and 3 string checkcope.li1-1/+2
JIRA:YARDSTICK-1557 Change-Id: I54ee4d6ef835e8e6ecd55cfa305151e842f88b03 Signed-off-by: cope.li <cope.li@huawei.com>
2018-12-07Add vBNG PPPoE test cases functionalitySerhiy Pshyk5-26/+642
Added vBNG PPPoE test cases functionality which allows to: - create and configure access network connections (PPPoE subscribers); - create and configure core network connections; - configure and run traffic between access and core network topologies. JIRA: YARDSTICK-1508 Change-Id: I90975505fe7318227a837d97e8db4a06712de7eb Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-06Suppress log outputs in test_ixnet_apiEmma Foley1-0/+6
JIRA: YARDSTICK-1541 Change-Id: Icee1ec0fb9e8eea6c89c6c513fe87ff49a3cb3d4 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-11-30Handle HTTP traffic profile parameters as optionalSerhiy Pshyk1-2/+6
JIRA: YARDSTICK-1548 Change-Id: I1130b33a1ab441a7a9ebf24beb954c9dab0ebc29 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-11-29Merge "Distribute dpdk/vhostuser between CPUs for SA OVS"Volodymyr Mytnyk2-10/+32
2018-11-28Addition of IRQ Mode to NSB NFVI (PROX)DanielMartinBuckley7-1/+1212
JIRA: YARDSTICK-1524 Add dashboard, Traffic Profile support, PROX IRQ support, topology Change-Id: I0c0cde66f4f4d3d25aa77c502bd4349cc1b3eca2 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-28Merge "NSB NFVi PROX Should report realtime port activity not historical data"Abhijit Sinha5-10/+303
2018-11-27NSB NFVi PROX Should report realtime port activity notDanielMartinBuckley5-10/+303
historical data JIRA: YARDSTICK-1458 The TG is only sampled at the end of every test interval. This is incorrect. It should be sampled every interval. Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-27Add option to allow user to pass vpe_scriptJohn O Loughlin2-6/+14
Add option to allow user to pass their own vpe_script vpe_script will be auto-generated by default. To use your own config file use the 'script' parameter in the config file vnf_config: { file: './vpe_config/vpe_config_2_ports', action_bulk_file: './vpe_config/action_bulk_512.txt', full_tm_profile_file: './vpe_config/full_tm_profile_10G.cfg', script_file: './vpe_config/vpe_script_sample } JIRA: YARDSTICK-1525 Change-Id: Ie23e5705f4c0475e858be73b8a504a7df8898828 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-23Add template and css for nsb reportPatrice Buriez2-0/+189
JIRA: YARDSTICK-1367 Topic: report/html_table (5 of 11) Change-Id: I7b8f2fa2aff3d5ee20ec23189acefe41452ad496 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-11-22Add parser to support jsTree in reportPatrice Buriez2-3/+133
Allow the user to select what data to show in the report using jsTree to navigate a hierarchical metrics list. JIRA: YARDSTICK-1367 Topic: report/html_table (4 of 11) Change-Id: I86d782a0a70b80a1cdfaab2f41afb7668066cbf7 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-11-22Generate report from a file instead of stringPatrice Buriez3-138/+138
``$ yardstick report generate ...`` now renders a template stored in a file instead of from an imported string Instead of using Django, templating is done by jinja2, as this is used in other parts of Yardstick. JIRA: YARDSTICK-1367 Topic: report/html_table (2 of 11) Change-Id: Iaff53e7e28903e46164ce0977f6b8adbe04d23d7 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-11-22Merge "Fix OvS-DPDK context mem allocation problem"Volodymyr Mytnyk2-6/+13
2018-11-22Merge "Fix hugepages calculation"Volodymyr Mytnyk1-1/+2
2018-11-22Fix OvS-DPDK context mem allocation problemMytnyk, Volodymyr2-6/+13
The hugepages allocated for OvS-DPDK context is not correct, thus it is causing an issue to allocate the required amount of memory for VM. JIRA: YARDSTICK-1538 Change-Id: I1a34199d4f78c999476603fa86d79ffc1fbf27c8 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-22Fix hugepages calculationMytnyk, Volodymyr1-1/+2
JIRA: YARDSTICK-1537 Change-Id: If4e78fe49c8b248c180d5a8db3932d822b9e5f95 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-21Update unit tests for yardstick/benchmark/core/report.pyPatrice Buriez2-50/+72
* Remove redundant imports * Rename some constants * Add additional unit tests * Reword KeyError message JIRA: YARDSTICK-1367 Topic: report/html_table (1 of 11) Change-Id: I3d89c1ed9acaeb7421a0734e33075ebae252c035 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2018-11-20Merge "Make VM machine type as a user configuration"Volodymyr Mytnyk2-4/+7
2018-11-20Make VM machine type as a user configurationMytnyk, Volodymyr2-4/+7
For backward compatibility, the default value of this option has been left unchanged. JIRA: YARDSTICK-1528 Change-Id: I42ceca96501f1136cba27d85c2d82240bd45c10c Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-11-18Run testcase 074 result overridden by job statusAmeed Ashour1-2/+2
Change-Id: Icb24727fd7ca8a340ea424284b510b007055ec9c JIRA: YARDSTICK-1526 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-11-14Remove unused functions vpeJohn O Loughlin2-224/+0
JIRA: YARDSTICK-1473 Change-Id: Ib9d3eb01f3fd900cbb08d55fc21fb95beceec941 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-14Add option to pass config file to vPEJohn O Loughlin3-17/+27
Yardstick should not generate config files for vPE. The current autogenerated configfile is incorrect. Therefore this patch is removing the auto-generation functionality. JIRA: YARDSTICK-1473 Change-Id: I9d909fcd0ac517d5ccdefb024c89b6bf979ef9c0 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-13Distribute dpdk/vhostuser between CPUs for SA OVSStepan Andrushko2-10/+32
Update Yardstick with ability to distribute DPDK/vhost-user ports/queues between CPU cores. Extended OVS add vhost-user interface command with option "n_rxq", provided in the test case. Ordered ports added to OVS. JIRA: YARDSTICK-1490 Change-Id: I71f5d878a9ee3a11f636762fc16b04ee6bc79e14 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>