aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-11-26Add test case related to measure compute score and its energy consumption impactRoland Picard4-135/+390
Test case opnfv_yardstick_tc015.yaml is added that runs a CPU test and monitor energy consumtion impact synchronized with cpu load. opnfv_yardstick_tc015.rst is added to provide documentation of the test case. energy.yaml sample is added to show how to add energy testing in any test case. JIRA: YARDSTICK-1624 Co-authored by: Sun Guannan <sungn2@lenovo.com> Signed-off-by: Roland Picard <roland.picard@orange.com> Change-Id: I2403c38bbf320f96d2ed1d9e262560388efc44c9
2019-11-18remove python2.7 test for python3 migraterexlee87761-1/+1
JIRA: YARDSTICK-1625 Change-Id: I0961bb5ef4d163aadc0bd0fdb9cdfda391e2fb17 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-10-08Fix output parsing of UnixbenchDeepanshu Bhatia1-2/+2
Pick the last word in the awk as score for handling partial index score and index score Change-Id: Ida56b704b14c7c27156f57590bb1ea8532650f90 JIRA: YARDSTICK-1622 Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
2019-07-17Leverage on PBRCédric Ollivier10-146/+183
It fixes requirements and constraints by switching to PBR [1]. It synchronizes requirements with OpenStack stable/stein and then adds constraints to pip calls. It also updates flask-restful-swagger to conform with OpenStack upper-constraints [2] and the pip API calls. It updates the unit tests verifying a few package versions. It stops checking unicodecsv in py3 env which is against the requirements defined in OpenStack. It also skips one test indirectly highlighting that the pip usage is incorrect [3] [1] http://testresults.opnfv.org/functest/dockerslicing/ [2] https://github.com/rantav/flask-restful-swagger/commit/fd418b50723fe1e79f495aa400a8e9f055a5be27 [3] https://github.com/pypa/pip/issues/3889 Change-Id: I635bdb9d7411e619cee911b633fa8ad591a393a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-04Merge "TC 088 and TC 089 gives error openstack command not found"Rex Lee1-0/+1
2019-05-30TC 088 and TC 089 gives error openstack command not foundManik Sidana1-0/+1
Adding python-openstackclient in requirements.txt JIRA: YARDSTICK-1615 Change-Id: If0adf4b3674c4321c1fa42fb47307e97f0509fbc Co-Authored by: deep23bhatia <deepanshu@voereir.com> Signed-off-by: msidana <manik@voereir.com>
2019-05-13Ping: Fix TypeError without SLA in timeout scenarioDeepanshu Bhatia2-6/+22
In case of no SLA association with scenario, when the commands timeout, stdout is empty and it gives TypeError. Reverted the condition to the old one which was used before introduction of verifySLA() JIRA: YARDSTICK-1618 Change-Id: Ibd86ba7168f26ae5b15c21fd6129cc737a7038db Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
2019-05-08Yardstick Hunter 8.0.0 release notesrexlee87761-82/+34
Yardstick Hunter 8.0.0 release notes Change-Id: I168047b81db828342164e0bf76c5baea04e0d2a6 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-04-26Merge changes from topic 'feat/baro_nfvi_metrics'Volodymyr Mytnyk7-71/+723
* changes: Use baro and yardstick metrics in dynamic HTML report benchmark.core.report: Add _combine_times benchmark.core.report: Add _get_baro_metrics Add ability to get data from different DBs in influx Refactor: add _format_datasets
2019-04-26Merge "Log VM OS version, Sample VNF branch/commit ID"Volodymyr Mytnyk8-14/+126
2019-04-26Merge "[docs] Document SRIOV configuration options"Volodymyr Mytnyk1-53/+97
2019-04-26Merge "Corrected MAC in trex_bm.yaml.sample"Volodymyr Mytnyk1-1/+1
2019-04-25Corrected MAC in trex_bm.yaml.sampleStepan Andrushko1-1/+1
Corrected MAC in trex_bm.yaml.sample. JIRA: YARDSTICK-1613 Change-Id: Icafe787dbdc8aa31b077b14dac94d7461b11c725 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-25[docs] Document SRIOV configuration optionsStepan Andrushko1-53/+97
Update Yardstick documentation with SRIOV options. JIRA: YARDSTICK-1611 Change-Id: I823a0a40f23dc53fb5316d4cef456eaf97f94b15 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-25[docs] Update NSB documentation, fix warningsStepan Andrushko5-67/+72
Updated NSB documentation, fixed some warnings. JIRA: YARDSTICK-1612 Change-Id: I8fdb92734b63bf3b6ad23160ebfb4c17a8e6dad1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-25Merge "Rework TestSampleVNFTrafficGen"Rex Lee1-255/+35
2019-04-25Merge "Rework TestSampleVnf"Rex Lee1-142/+112
2019-04-19Log VM OS version, Sample VNF branch/commit IDStepan Andrushko8-14/+126
Added debug logs to track VM, Sample VNF details during testing: - Virtual machine OS, kernel version; - Sample VNF branch, commit ID. JIRA: YARDSTICK-1499 Change-Id: I243c435809d4541dfdb8c7c3466f50c5d524ac00 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-18Merge "[bugfix] docker build failed in hunter due to storperf version"Rex Lee2-2/+2
2019-04-17Add ansible scripts to deploy KubernetesMytnyk, Volodymyr24-1/+757
For know, only one node is supported. - build/configure CNI drivers - Init Kubernetes Change-Id: I1a0eb44fcbba20870a6b7611d4ffaf0bc3be92f3 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-15Rework TestSampleVNFTrafficGenEmma Foley1-255/+35
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: Iead085c2642a6960fdbff6905e55974fd8bd4fb2 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-15[bugfix] docker build failed in hunter due to storperf versionrexlee87762-2/+2
storperf do not have hunter branch, so it need to be set as stable/gambia JIRA: YARDSTICK-1610 Change-Id: I818396c46ce165019159b9852abb02f176507ac0 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-04-10Rework TestSampleVnfEmma Foley1-142/+112
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I193068893664e7ed1a2487b51750d34d5c256e6c Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-10Merge "Revert "Add ansible scripts to deploy Kubernetes""Volodymyr Mytnyk24-690/+1
2019-04-10Revert "Add ansible scripts to deploy Kubernetes"Volodymyr Mytnyk24-690/+1
This reverts commit c66efd482c9c4aabf8a82d1f554ef5fca91b3bcb. Change-Id: I87ec6e2ed6d2ef8ad202833f134e758762345b02 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-10Merge "[docs][nsb][install] Update source for sample pod files"Volodymyr Mytnyk1-15/+15
2019-04-10Merge "Add ansible scripts to deploy Kubernetes"Volodymyr Mytnyk24-1/+690
2019-04-10Add ansible scripts to deploy KubernetesMytnyk, Volodymyr24-1/+690
For know, only one node is supported. - build/configure CNI drivers - Init Kubernetes Change-Id: I6dd9dff7a4c7dfe2d7148812d2656966115c5ce9 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-09Add a document descibing vCMTS testcasetreyad3-0/+134
JIRA: YARDSTICK-1601 Change-Id: Icfca620beb191fa935d820a23f8ce086498b130e Signed-off-by: treyad <treyad@viosoft.com>
2019-04-09Merge "Suppress log outputs in test_task.py"Volodymyr Mytnyk1-0/+8
2019-04-08Merge "Upload config files for barometer collectd container"Volodymyr Mytnyk1-0/+3
2019-04-08Merge "Update to support using external heat template"Volodymyr Mytnyk4-1/+109
2019-04-08Merge "Fix UDPReplay VNF statistic parsing"Volodymyr Mytnyk2-5/+5
2019-04-08Merge "Add sipp trafficgen based SampleVNFTrafficGen"Volodymyr Mytnyk6-0/+733
2019-04-08Merge "Allow testcases to be configured over cli"Volodymyr Mytnyk11-75/+45
2019-04-05Fix UDPReplay VNF statistic parsingMytnyk, Volodymyr2-5/+5
Fixed UDPReplay statistic parsing according to changes made in UDPReplay sample VNF. JIRA: YARDSTICK-1609 Change-Id: I093f6612cc736695fa96f15dce374c949d8c3459 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-05Add sipp trafficgen based SampleVNFTrafficGentreyad6-0/+733
This patch defines: - Generic VNF APIs to test Network service: --> instantiate: prepare the arguments for run sipp --> run_traffic: run sipp test and handle the result file --> collect_kpi: collect results and push to queue --> terminate JIRA: YARDSTICK-1446 Change-Id: I7f6b7dd253164bb5c359ac866cb8cae81f504d65 Signed-off-by: treyad <treyad@viosoft.com>
2019-04-04Merge "Add a document describing vIMS testcase"Volodymyr Mytnyk2-0/+97
2019-04-04Update to support using external heat templatetreyad4-1/+109
Modify the _get_server() function when using external heat template. The server attrs should be read from stack.outputs. JIRA: YARDSTICK-1453 Change-Id: I00eda7476e77fc0a5c15ef8db7d057fa1cf267e6 Signed-off-by: treyad <treyad@viosoft.com>
2019-04-03Allow testcases to be configured over cliJohn O Loughlin11-75/+45
Add options for droprate and frame_rate for agnostic vnf JIRA: YARDSTICK-1554 Change-Id: I0e9eb844a96b9d8af85fc3af750c56e43fea52b8 Signed-off-by: John O Loughlin <john.oloughlin@intel.com> Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2019-04-03Merge changes from topic 'manual_ci_test_cases'Volodymyr Mytnyk25-41/+1957
* changes: Add IXIA Baremetal scale up testcases Add OpenStack test cases Add TRex Baremetal/SA scale up test cases
2019-04-03Use baro and yardstick metrics in dynamic HTML reportEmma Foley5-26/+249
_combine_metrics combines metrics from different sources. This is for use with the ``yardstick report generate-nsb`` command, which will combine yardstick and barometer metrics in the dynamic HTML report. JIRA: YARDSTICK-1593 Change-Id: I87002948ebb4cc88fb0932380bcb9920eb53db58 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-01Merge "Support bind driver for QAT HW cards"Volodymyr Mytnyk5-7/+238
2019-03-30Merge "Yardstick verify job could base on the filetype to run the test"Rex Lee1-8/+13
2019-03-29Add a document describing vIMS testcasetreyad2-0/+97
Create a test case description file for NSB vIMS JIRA: YARDSTICK-1441 Change-Id: Ib51839093dd90e0b70eac4030948985c2145f35e Signed-off-by: treyad <treyad@viosoft.com>
2019-03-29Support bind driver for QAT HW cardstreyad5-7/+238
Load QAT driver Initialize QAT VFs JIRA: YARDSTICK-1504 Change-Id: I1f3768d5436bfaccac5f6226ba19131c4662a08d Signed-off-by: treyad <treyad@viosoft.com>
2019-03-29Merge "Add VNF descriptor for vIMS testcase"Volodymyr Mytnyk8-0/+450
2019-03-29Merge "Support FD.io Multiple Loss Ratio search (MLRsearch)"Volodymyr Mytnyk14-11/+3455
2019-03-29Merge "Setup IPSEC tunnel mode for VPP Crypto testing"Volodymyr Mytnyk4-41/+1992
2019-03-29Merge "Build VPP startup configuration file"Volodymyr Mytnyk15-23/+1168