aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2019-12-10Add energy base scenario and test filessungn6-0/+635
Folder of energy contains scripts of energy measurement. File __init__.py make it a module that can be imported. File energy.py contains the main function of energy measurement through redfish API. File test_energy.py test function of energy.py File energy_sample_chassis_output.txt provide a sample output of chassis query. File energy_sample_power_metrics.txt provide sample metrics of power query. This will allow users to collect data of energy consumption of baremetal machines. JIRA: YARDSTICK-1624 Co-authored by: Roland Picard <roland.picard@orange.com> Signed-off-by: sungn <sungn2@lenovo.com> Change-Id: Ied86894f3dcc2536f0cb1a044f4591351e5b3270
2019-12-04[bugfix] functional_py3 failed in ci gatingrexlee87761-2/+2
import pip._internal.main and use correctly JIRA: YARDSTICK-1627 Change-Id: I3613c651e474474329f55adda5b54ce5bf4fd9ca Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-10-08Fix output parsing of UnixbenchDeepanshu Bhatia1-2/+2
Pick the last word in the awk as score for handling partial index score and index score Change-Id: Ida56b704b14c7c27156f57590bb1ea8532650f90 JIRA: YARDSTICK-1622 Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
2019-07-17Leverage on PBRCédric Ollivier3-10/+11
It fixes requirements and constraints by switching to PBR [1]. It synchronizes requirements with OpenStack stable/stein and then adds constraints to pip calls. It also updates flask-restful-swagger to conform with OpenStack upper-constraints [2] and the pip API calls. It updates the unit tests verifying a few package versions. It stops checking unicodecsv in py3 env which is against the requirements defined in OpenStack. It also skips one test indirectly highlighting that the pip usage is incorrect [3] [1] http://testresults.opnfv.org/functest/dockerslicing/ [2] https://github.com/rantav/flask-restful-swagger/commit/fd418b50723fe1e79f495aa400a8e9f055a5be27 [3] https://github.com/pypa/pip/issues/3889 Change-Id: I635bdb9d7411e619cee911b633fa8ad591a393a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-05-13Ping: Fix TypeError without SLA in timeout scenarioDeepanshu Bhatia2-6/+22
In case of no SLA association with scenario, when the commands timeout, stdout is empty and it gives TypeError. Reverted the condition to the old one which was used before introduction of verifySLA() JIRA: YARDSTICK-1618 Change-Id: Ibd86ba7168f26ae5b15c21fd6129cc737a7038db Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
2019-04-26Merge changes from topic 'feat/baro_nfvi_metrics'Volodymyr Mytnyk6-63/+712
* changes: Use baro and yardstick metrics in dynamic HTML report benchmark.core.report: Add _combine_times benchmark.core.report: Add _get_baro_metrics Add ability to get data from different DBs in influx Refactor: add _format_datasets
2019-04-26Merge "Log VM OS version, Sample VNF branch/commit ID"Volodymyr Mytnyk3-0/+84
2019-04-19Log VM OS version, Sample VNF branch/commit IDStepan Andrushko3-0/+84
Added debug logs to track VM, Sample VNF details during testing: - Virtual machine OS, kernel version; - Sample VNF branch, commit ID. JIRA: YARDSTICK-1499 Change-Id: I243c435809d4541dfdb8c7c3466f50c5d524ac00 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-15Rework TestSampleVNFTrafficGenEmma Foley1-255/+35
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: Iead085c2642a6960fdbff6905e55974fd8bd4fb2 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-10Rework TestSampleVnfEmma Foley1-142/+112
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I193068893664e7ed1a2487b51750d34d5c256e6c Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-09Merge "Suppress log outputs in test_task.py"Volodymyr Mytnyk1-0/+8
2019-04-08Merge "Upload config files for barometer collectd container"Volodymyr Mytnyk1-0/+3
2019-04-08Merge "Update to support using external heat template"Volodymyr Mytnyk4-1/+109
2019-04-08Merge "Fix UDPReplay VNF statistic parsing"Volodymyr Mytnyk2-5/+5
2019-04-08Merge "Add sipp trafficgen based SampleVNFTrafficGen"Volodymyr Mytnyk5-0/+708
2019-04-05Fix UDPReplay VNF statistic parsingMytnyk, Volodymyr2-5/+5
Fixed UDPReplay statistic parsing according to changes made in UDPReplay sample VNF. JIRA: YARDSTICK-1609 Change-Id: I093f6612cc736695fa96f15dce374c949d8c3459 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-05Add sipp trafficgen based SampleVNFTrafficGentreyad5-0/+708
This patch defines: - Generic VNF APIs to test Network service: --> instantiate: prepare the arguments for run sipp --> run_traffic: run sipp test and handle the result file --> collect_kpi: collect results and push to queue --> terminate JIRA: YARDSTICK-1446 Change-Id: I7f6b7dd253164bb5c359ac866cb8cae81f504d65 Signed-off-by: treyad <treyad@viosoft.com>
2019-04-04Update to support using external heat templatetreyad4-1/+109
Modify the _get_server() function when using external heat template. The server attrs should be read from stack.outputs. JIRA: YARDSTICK-1453 Change-Id: I00eda7476e77fc0a5c15ef8db7d057fa1cf267e6 Signed-off-by: treyad <treyad@viosoft.com>
2019-04-03Use baro and yardstick metrics in dynamic HTML reportEmma Foley5-26/+249
_combine_metrics combines metrics from different sources. This is for use with the ``yardstick report generate-nsb`` command, which will combine yardstick and barometer metrics in the dynamic HTML report. JIRA: YARDSTICK-1593 Change-Id: I87002948ebb4cc88fb0932380bcb9920eb53db58 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-01Merge "Support bind driver for QAT HW cards"Volodymyr Mytnyk5-7/+238
2019-03-29Support bind driver for QAT HW cardstreyad5-7/+238
Load QAT driver Initialize QAT VFs JIRA: YARDSTICK-1504 Change-Id: I1f3768d5436bfaccac5f6226ba19131c4662a08d Signed-off-by: treyad <treyad@viosoft.com>
2019-03-29Merge "Support FD.io Multiple Loss Ratio search (MLRsearch)"Volodymyr Mytnyk13-11/+3454
2019-03-29Merge "Setup IPSEC tunnel mode for VPP Crypto testing"Volodymyr Mytnyk4-41/+1992
2019-03-29Merge "Build VPP startup configuration file"Volodymyr Mytnyk14-22/+1166
2019-03-29Merge "Add Pktgen traffic generator for vCMTS"Volodymyr Mytnyk2-0/+867
2019-03-27Setup IPSEC tunnel mode for VPP Crypto testingtreyad4-41/+1992
Update startup config file Enable logging Create IPSEC in tunnel mode JIRA: YARDSTICK-1503 Change-Id: Ifd2b05c063870b31c7f30decb1611a93322bf1e8 Signed-off-by: treyad <treyad@viosoft.com>
2019-03-27Build VPP startup configuration filetreyad14-22/+1166
Provided configuration parameters into /etc/vpp/startup.conf JIRA: YARDSTICK-1502 Change-Id: Ib64908a2975a13a1cecd2e6bd7232071628ad431 Signed-off-by: treyad <treyad@viosoft.com>
2019-03-27Support FD.io Multiple Loss Ratio search (MLRsearch)treyad13-11/+3454
Optimized binary search algorithm for finding NDR and PDR bounds JIRA: YARDSTICK-1486 Change-Id: Iba0e6c7065b61f7b7f3f65cceca509d1aaff8366 Signed-off-by: treyad <treyad@viosoft.com>
2019-03-22Add vCMTS VNF for running vCMTSd containerstreyad2-0/+924
Add a SampleVNF derived class to start vcmtsd JIRA: YARDSTICK-1544 Change-Id: Ifafa43216a6bdd076ef1cbe5b722f4a39a97980b Signed-off-by: treyad <treyad@viosoft.com>
2019-03-22Add Pktgen traffic generator for vCMTStreyad2-0/+867
Add a class for Pktgen configuring and starting JIRA: YARDSTICK-1543 Change-Id: Icf9a4e656ff340158bf5605016f75ed393753f89 Signed-off-by: treyad <treyad@viosoft.com>
2019-03-15Merge "Add PCSCF, HSS classes for NSB-vIMS"Volodymyr Mytnyk2-0/+818
2019-03-15Add PCSCF, HSS classes for NSB-vIMStreyad2-0/+818
Currently, these VNF life cycles are: - instantiate - terminate Pass through function: collect_kpi JIRA: YARDSTICK-1444 JIRA: YARDSTICK-1445 Change-Id: I418877f79b6578ad4d78d7de4885c8aa20246beb Signed-off-by: treyad <treyad@viosoft.com>
2019-03-13Merge "Add vIPSEC VNF for running Crypto performance test case"Volodymyr Mytnyk7-6/+2002
2019-03-07Merge "Support using existing private key when using external heat template ↵Volodymyr Mytnyk2-16/+80
file"
2019-03-07Merge "Add Trex traffic generator to initate Traffic for VPP IPSEC"Volodymyr Mytnyk2-0/+1308
2019-02-28Support using existing private key when using external heat template filetreyad2-16/+80
Currently, the private key is auto-generated from Yardstick. This patch will allow user use their existing private key when they use external heat template file. JIRA: YARDSTICK-1447 Change-Id: I45a0ab4ac08e7ccedd770867ed43de92040b6a10 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-28Merge "Quick and ugly fix for "division by zero""Volodymyr Mytnyk1-1/+1
2019-02-25Merge "Add new scenario NSPerf-RFC3511"Volodymyr Mytnyk2-0/+106
2019-02-25Merge "Add VPP traffic profiles for TRex traffic generator"Volodymyr Mytnyk3-0/+1141
2019-02-22Add new scenario NSPerf-RFC3511Chornyi, TarasX2-0/+106
New scenarion executes complete run per runner's iteration and designed to work with IxLoad TG. JIRA: YARDSTICK-1592 Change-Id: I43f37ae4ab211a29d75a9c9edd93141767a4c57d Signed-off-by: Chornyi Taras <tarasx.chornyi@intel.com>
2019-02-22Add Trex traffic generator to initate Traffic for VPP IPSECtreyad2-0/+1308
Send the traffic Measure NDR or PDR throughputs Measure packet loss and latency of VNFs JIRA: YARDSTICK-1483 Change-Id: Ie844c0b786bfe1ca3efafdb56d8e473e6ad59cc9 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-21Add vIPSEC VNF for running Crypto performance test casetreyad7-6/+2002
VNF life cycle - instantiate - collect_kpi - terminate JIRA: YARDSTICK-1484 Change-Id: I39fd24fdadbce6cee161c906fc95c16a36cb7cd8 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-21Unify TG and VNF names in infrastructure filesOrest Voznyy5-40/+40
Update naming in related files, i.e. pod, docs, docstrings. Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: I7596b915939f242349a99721b6088ae738dd277f Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-19Unify IXIA/Trex test cases resultsSerhiy Pshyk7-328/+301
List of changes: - Unified naming of all counters reported by IXIA/Trex - Removed not valid counters reported by IXIA - Added per interface stats reported by Trex - Fixed latency calculation for Trex tg JIRA: YARDSTICK-1592 Change-Id: Ia3d450058f884579f4d331772a8cf6de22146ac3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-02-15Quick and ugly fix for "division by zero"Patrice Buriez1-1/+1
Workaround for "ZeroDivisionError: float division by zero" and "RuntimeError: Unable to retrieve TSC" issues. The actual clean fix requires reworking get_data() to accumulate bytes received from PROX TCP port until EOL is received. Since the other functions calling get_data() expect a synchronous answer from PROX, timeout should be considered a fatal error, and the current default at 10ms was just calling for problems! Even if this change does not get merged, at least this workaround will be available to end-users for cherry-picking from gerrit, while the actual clean fix is being implemented. JIRA: YARDSTICK-1381 Change-Id: I6af226ca31aaebeb50302e24b1eb209de70f6526 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com>
2019-02-14Merge "Extend TRex RFC2544 test case collected stats"Volodymyr Mytnyk9-63/+91
2019-02-12Add VPP traffic profiles for TRex traffic generatortreyad3-0/+1141
Create traffic streams dynamically for VPP test, based on traffic profiles JIRA: YARDSTICK-1485 Change-Id: I9fe8575ef6527823b86214c3d7752486c79dee73 Signed-off-by: treyad <treyad@viosoft.com>
2019-02-12Generate correct IMIX distribution for STL profiletreyad2-13/+13
JIRA: YARDSTICK-1599 Change-Id: I654644d7944d0af41d8da12cc002f31fcfecf62e Signed-off-by: treyad <treyad@viosoft.com>
2019-02-12Extend TRex RFC2544 test case collected statsOleksandr Naumets9-63/+91
Added new fields into Yardstick NSB TRex RFC2544 test case results: - Iteration - PktSize - Status JIRA: YARDSTICK-1592 Change-Id: Id746b537a0ef55a891653719cc1db29ef7e994fc Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-12Merge changes from topic 'YARDSTICK-1116'Volodymyr Mytnyk1-465/+292
* changes: Rework TestScenarioHelper Rework TestSampleVNFDeployHelper Rework TestResourceHelper Rework TestDpdkVnfSetupEnvHelper