aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-02-25Merge "Add VPP traffic profiles for TRex traffic generator"Volodymyr Mytnyk4-0/+1212
2019-02-25Merge "Add vIPSEC testcases"Volodymyr Mytnyk8-7/+682
2019-02-25Add vIPSEC testcasestreyad8-7/+682
Test description files for Baremetal JIRA: YARDSTICK-1487 Change-Id: Ifcbf022bd0625282fc0256316909bcef840929b3 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-22Merge "Change default vports type to int"Volodymyr Mytnyk1-2/+2
2019-02-22Add new scenario NSPerf-RFC3511Chornyi, TarasX4-6/+112
New scenarion executes complete run per runner's iteration and designed to work with IxLoad TG. JIRA: YARDSTICK-1592 Change-Id: I43f37ae4ab211a29d75a9c9edd93141767a4c57d Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
2019-02-22Add Trex traffic generator to initate Traffic for VPP IPSECtreyad2-0/+1308
Send the traffic Measure NDR or PDR throughputs Measure packet loss and latency of VNFs JIRA: YARDSTICK-1483 Change-Id: Ie844c0b786bfe1ca3efafdb56d8e473e6ad59cc9 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-21Add vIPSEC VNF for running Crypto performance test casetreyad7-6/+2002
VNF life cycle - instantiate - collect_kpi - terminate JIRA: YARDSTICK-1484 Change-Id: I39fd24fdadbce6cee161c906fc95c16a36cb7cd8 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-21Unify TG and VNF names in infrastructure filesOrest Voznyy27-149/+147
Update naming in related files, i.e. pod, docs, docstrings. Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: I7596b915939f242349a99721b6088ae738dd277f Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-20Added NSB descriptors for vCMTS testcasetreyad2-0/+154
JIRA: YARDSTICK-1542 Change-Id: I24851069a240f1549e7c5618d65cb52ab390e2d8 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-20Yardstick container rabbitmq supervisor RUN stateStepan Andrushko4-26/+46
Rabbitmq process exited supervisor and couldn't respawn it afterwards. Updated the way rabbitmq service and node are spawned to have them RUNNING after a service stop or node down. JIRA: YARDSTICK-1600 Change-Id: Idd6812db7a1985e8c727efd7ea45572199c1a4a9 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-02-19Unify IXIA/Trex test cases resultsSerhiy Pshyk7-328/+301
List of changes: - Unified naming of all counters reported by IXIA/Trex - Removed not valid counters reported by IXIA - Added per interface stats reported by Trex - Fixed latency calculation for Trex tg JIRA: YARDSTICK-1592 Change-Id: Ia3d450058f884579f4d331772a8cf6de22146ac3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-02-18Change default vports type to intChornyi, TarasX1-2/+2
JIRA: YARDSTICK-1592 Change-Id: Ie64cadcfc9077aed3b4bfeed6055118dc7008eb8 Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
2019-02-15Quick and ugly fix for "division by zero"Patrice Buriez1-1/+1
Workaround for "ZeroDivisionError: float division by zero" and "RuntimeError: Unable to retrieve TSC" issues. The actual clean fix requires reworking get_data() to accumulate bytes received from PROX TCP port until EOL is received. Since the other functions calling get_data() expect a synchronous answer from PROX, timeout should be considered a fatal error, and the current default at 10ms was just calling for problems! Even if this change does not get merged, at least this workaround will be available to end-users for cherry-picking from gerrit, while the actual clean fix is being implemented. JIRA: YARDSTICK-1381 Change-Id: I6af226ca31aaebeb50302e24b1eb209de70f6526 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2019-02-14Merge "Extend TRex RFC2544 test case collected stats"Volodymyr Mytnyk9-63/+91
2019-02-13Merge "[docs] Update on Yardstick NSB installation"Volodymyr Mytnyk2-90/+148
2019-02-13Merge "Added RFC2544 Trex template"Volodymyr Mytnyk5-14/+158
2019-02-12Add VPP traffic profiles for TRex traffic generatortreyad4-0/+1212
Create traffic streams dynamically for VPP test, based on traffic profiles JIRA: YARDSTICK-1485 Change-Id: I9fe8575ef6527823b86214c3d7752486c79dee73 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-12Generate correct IMIX distribution for STL profiletreyad2-13/+13
JIRA: YARDSTICK-1599 Change-Id: I654644d7944d0af41d8da12cc002f31fcfecf62e Signed-off-by: treyad <treyad@viosoft.com>
2019-02-12Extend TRex RFC2544 test case collected statsOleksandr Naumets9-63/+91
Added new fields into Yardstick NSB TRex RFC2544 test case results: - Iteration - PktSize - Status JIRA: YARDSTICK-1592 Change-Id: Id746b537a0ef55a891653719cc1db29ef7e994fc Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-12Added RFC2544 Trex templateChornyi, TarasX5-14/+158
JIRA: YARDSTICK-1592 Change-Id: I36d96c932bff399be05e44dcd86096ee50614ad8 Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
2019-02-12Merge changes from topic 'YARDSTICK-1116'Volodymyr Mytnyk1-465/+292
* changes: Rework TestScenarioHelper Rework TestSampleVNFDeployHelper Rework TestResourceHelper Rework TestDpdkVnfSetupEnvHelper
2019-02-12Merge "[docs] Documentation for BNG PPPoE RFC2544 test cases"Volodymyr Mytnyk2-0/+356
2019-02-12Yardstick verify job could base on the filetype to run the testrexlee87761-8/+13
run the unit test, coverage test, functional test when the change includes postfix py change. could add yaml/yml to run yamlint JIRA: YARDSTICK-1598 Change-Id: I7d9199ec20575fc91cf0f38d84a05b02d63e316c Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-02-11Merge "Add IXIA Tx/Rx Bytes stats into results"Volodymyr Mytnyk8-0/+98
2019-02-11benchmark.core.report: Add _combine_timesEmma Foley2-0/+173
_combine_times() combines and interleves separate lists of timestamps. This will allow the Yardstick and Barometer timestamps to be combined for the dynamic HTML report created with ``yardstick report generate-nsb`` command. JIRA: YARDSTICK-1593 Change-Id: I0f5ea4d001775495fb9b9b4de2d2360c9c61cc51 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11benchmark.core.report: Add _get_baro_metricsEmma Foley2-1/+191
Retrieve and parse Barometer metrics relevant to a Yardstick testcase. _get_barometer_metrics() retrieves NFVi metrics from collectd for metrics collected during a Yardstick test case. JIRA: YARDSTICK-1593 Change-Id: I1ef1ccd999e1cbee546db39fb8ad6de0d97e6576 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11Add ability to get data from different DBs in influxEmma Foley2-10/+14
In order to get data from Barometer, the influx helper need to be updated to recognise different DBs. This patch adds an optional arg to specify which database to use. By default, the configured dispatcher for Yardstick is used. Limitation: The new change hard codes barometer DB name to be used, and assumes that it is in the same instance of Influx as the Yardstick dispatcher. This can be extended later to make it configurable, however, a new config option would have to be introduced. JIRA: YARDSTICK-1593 Change-Id: Idee9c3491d6bf7b549e014edd9ff031312cf0ec2 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11Refactor: add _format_datasetsEmma Foley2-35/+97
JIRA: YARDSTICK-1593 Change-Id: I8d2c8665d767c92da20db8f97690f20da4a68908 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-11Add Grafana Dashboard for vIPSec testcasetreyad2-0/+4838
JIRA: YARDSTICK-1451 Change-Id: I712a5268d7126d9df970c02a7c717457e3f0e556 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-11Merge "Add Standalone Scale Up Test Case For Packet Flow Buffering."Volodymyr Mytnyk2-0/+200
2019-02-11Merge "Add Standalone Scale Up Test Case For Load Balancing."Volodymyr Mytnyk2-0/+217
2019-02-11Merge "Debugging information when dpdk bind fails should be improved"Abhijit Sinha3-0/+6
2019-02-08Add Standalone Scale Up Test Case For Load Balancing.Carey, Alan2-0/+217
Files to be added: tc_prox_sriov_lb-scale-up.yaml tc_prox_ovs-dpdk_lb-scale-up.yam JIRA: YARDSTICK-1584 Change-Id: I8f782451ff5ed1682f77be0c1a599ebaedf86b61 Signed-off-by: Carey, Alan <alan.carey@intel.com>
2019-02-08[docs] Documentation for BNG PPPoE RFC2544 test casesOleksandr Naumets2-0/+356
JIRA: YARDSTICK-1565 Change-Id: I233878228091f9ce542baa6e0f42037b9fad7a73 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-08Add Standalone Scale Up Test Case For Packet Flow Buffering.Carey, Alan2-0/+200
Files to be added: tc_prox_sriov_buffering-scale-up.yaml tc_prox_ovs-dpdk_buffering-scale-up.yaml JIRA: YARDSTICK-1581 Change-Id: I1339398a71607331f5b044be4c581acef1d49fbe Signed-off-by: Carey, Alan <alan.carey@intel.com>
2019-02-08Merge "Fix QnQ issue"Volodymyr Mytnyk4-15/+135
2019-02-08Add IXIA Tx/Rx Bytes stats into resultsOleksandr Naumets8-0/+98
Add IXIA "Bytes Rx" and "Bytes Tx" ports stats into collected results. This stats allows to calculate the throughput when running IMIX traffic. JIRA: YARDSTICK-1592 Change-Id: I1db678d410b37e7a0f64dc743e6e620e495115ed Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-08Migrate Trex TG to use new NSPerf-RFC2544 scenarioMytnyk, Volodymyr10-51/+278
JIRA: YARDSTICK-1592 Change-Id: Ic51a52385ac53df9b5f56387af4f1b661bb0d86f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-02-07Rework TestScenarioHelperEmma Foley1-22/+18
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I1bbf2bc139f3302d9882b28f9883e64fa595eb46 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Rework TestSampleVNFDeployHelperEmma Foley1-44/+41
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: Ib15e37987ec336f611b27ea71cbc3005311e5d27 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Rework TestResourceHelperEmma Foley1-181/+121
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I56e14a2557554e1c461447f0567b5e028198b553 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Rework TestDpdkVnfSetupEnvHelperEmma Foley1-220/+114
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I5b3ef90909949882cec1c32b1f86c3aedbc950d8 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-02-07Update Intel Copyright for files edited in 2019John O Loughlin59-59/+59
JIRA: YARDSTICK-1591 Change-Id: I3ea9039d25bfce578681adb9e27e1598e84a1f56 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-07Merge "Add Warning for key issue ixload"Volodymyr Mytnyk1-1/+6
2019-02-07Add Warning for key issue ixloadJohn O Loughlin1-1/+6
Currently there is a section of code that assigns a gateway links[name]["ip"]["gateway"] = gateway If the ip field has not already been defined a key error is thrown and not handled. This error is then suppressed so the program fails silently and thus causes the test case to hang. JIRA: YARDSTICK-1586 Change-Id: I94a1081a2038fb58989b3033444ea5f3a6e178f0 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-07Merge "Extend IXIA RFC2544 test case collected stats"Volodymyr Mytnyk4-3/+79
2019-02-07Merge "Add CPU isolation support for Yardstick NSB setup"Volodymyr Mytnyk5-1/+88
2019-02-07Merge "Add NSB test descriptors for vIPSEC testcase"Volodymyr Mytnyk5-0/+361
2019-02-06Debugging information when dpdk bind fails should be improvedDanielMartinBuckley3-0/+6
JIRA: YARDSTICK-1585 When dpdk-devbind.py is failing, the information provided is poor, making it difficult to debug. At least the exact command used should be printed, ideally with the returned error. As of today, the more interesting line is DpdkBindHelperException: /opt/nsb_bin/dpdk-devbind.py command failed with rc=1 Change-Id: I7831c81ffa9e1f4695480eb140fa97a58ff88f8c Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-06Add CPU isolation support for Yardstick NSB setupStepan Andrushko5-1/+88
Add support to define CPU isolation in grub by using NSB setup script. List of CPU's to be isolated is not used by default and is defined in install-inventory.ini. Warning: reboot is required to apply CPU isolation to grub. JIRA: YARDSTICK-1467 Change-Id: I54ffa925a8f3059180d17ff4f1c41ff6e0f12066 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>