aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-01-06[bugfix] gui build faied in yardstick docker buildrexlee87761-1/+2
JIRA: YARDSTICK-1626 it's due to the version of nodejs and npm too old in ubuntu 16.04 default repo Change-Id: I8c969530f7e538104bf5fb39223f720e53642d05 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 0cdf063469d85c3dd7c6d14907e80800f2b14ff3)
2019-12-13Add json file for opnfv_yardstick_tc015.yamlsungn1-0/+355
File opnfv_yardstick_tc015.json show sample data of test case opnfv_yardstick_tc015.yaml. Power for energy scenario, single_score and parallel_score for Unixbench scenario, mpstat_average.cpu.%usr for cpu_load scenario. You may also select other parameters to see the data trends during test case running. JIRA: YARDSTICK-1624 Co-authored by: Roland Picard <roland.picard@orange.com> Signed-off-by: sungn <sungn2@lenovo.com> Change-Id: I2b9993ad1d330c5f90ca8b5afda4e1dc73e8b150
2019-12-13Merge "Add test case related to measure compute score and its energy ↵Rex Lee4-135/+390
consumption impact"
2019-12-13Merge "Add energy to yardstick bench category"Rex Lee1-0/+5
2019-12-10Add energy base scenario and test filessungn6-0/+635
Folder of energy contains scripts of energy measurement. File __init__.py make it a module that can be imported. File energy.py contains the main function of energy measurement through redfish API. File test_energy.py test function of energy.py File energy_sample_chassis_output.txt provide a sample output of chassis query. File energy_sample_power_metrics.txt provide sample metrics of power query. This will allow users to collect data of energy consumption of baremetal machines. JIRA: YARDSTICK-1624 Co-authored by: Roland Picard <roland.picard@orange.com> Signed-off-by: sungn <sungn2@lenovo.com> Change-Id: Ied86894f3dcc2536f0cb1a044f4591351e5b3270
2019-12-04[bugfix] functional_py3 failed in ci gatingrexlee87761-2/+2
import pip._internal.main and use correctly JIRA: YARDSTICK-1627 Change-Id: I3613c651e474474329f55adda5b54ce5bf4fd9ca Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-12-02Add energy to yardstick bench categoryRoland Picard1-0/+5
Update 02-methodology.rst file into user guide of yardstick to add energy as a new category which is transverse to the others as to be used inside exitsing test cases to consider energy metric when running a test case JIRA: YARDSTICK-1624 Co-authored by: Sun Guannan <sungn2@lenovo.com> Signed-off-by: Roland Picard <roland.picard@orange.com> Change-Id: Id08a4e68ce45374b52c79b5bf7ebd6cb7106cb7e
2019-12-02Merge "[bugfix] no ansible requirements when build docker image"Rex Lee1-1/+1
2019-12-02[bugfix] no ansible requirements when build docker imagerexlee87761-1/+1
ansible is needed when build docker image JIRA: YARDSTICK-1626 Change-Id: Iecc8603e4c0cea9e0b3826aea32bea95be4cd87b Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-11-26Add test case related to measure compute score and its energy consumption impactRoland Picard4-135/+390
Test case opnfv_yardstick_tc015.yaml is added that runs a CPU test and monitor energy consumtion impact synchronized with cpu load. opnfv_yardstick_tc015.rst is added to provide documentation of the test case. energy.yaml sample is added to show how to add energy testing in any test case. JIRA: YARDSTICK-1624 Co-authored by: Sun Guannan <sungn2@lenovo.com> Signed-off-by: Roland Picard <roland.picard@orange.com> Change-Id: I2403c38bbf320f96d2ed1d9e262560388efc44c9
2019-11-18remove python2.7 test for python3 migraterexlee87761-1/+1
JIRA: YARDSTICK-1625 Change-Id: I0961bb5ef4d163aadc0bd0fdb9cdfda391e2fb17 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-10-08Fix output parsing of UnixbenchDeepanshu Bhatia1-2/+2
Pick the last word in the awk as score for handling partial index score and index score Change-Id: Ida56b704b14c7c27156f57590bb1ea8532650f90 JIRA: YARDSTICK-1622 Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
2019-07-17Leverage on PBRCédric Ollivier10-146/+183
It fixes requirements and constraints by switching to PBR [1]. It synchronizes requirements with OpenStack stable/stein and then adds constraints to pip calls. It also updates flask-restful-swagger to conform with OpenStack upper-constraints [2] and the pip API calls. It updates the unit tests verifying a few package versions. It stops checking unicodecsv in py3 env which is against the requirements defined in OpenStack. It also skips one test indirectly highlighting that the pip usage is incorrect [3] [1] http://testresults.opnfv.org/functest/dockerslicing/ [2] https://github.com/rantav/flask-restful-swagger/commit/fd418b50723fe1e79f495aa400a8e9f055a5be27 [3] https://github.com/pypa/pip/issues/3889 Change-Id: I635bdb9d7411e619cee911b633fa8ad591a393a0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2019-07-04Merge "TC 088 and TC 089 gives error openstack command not found"Rex Lee1-0/+1
2019-05-30TC 088 and TC 089 gives error openstack command not foundManik Sidana1-0/+1
Adding python-openstackclient in requirements.txt JIRA: YARDSTICK-1615 Change-Id: If0adf4b3674c4321c1fa42fb47307e97f0509fbc Co-Authored by: deep23bhatia <deepanshu@voereir.com> Signed-off-by: msidana <manik@voereir.com>
2019-05-13Ping: Fix TypeError without SLA in timeout scenarioDeepanshu Bhatia2-6/+22
In case of no SLA association with scenario, when the commands timeout, stdout is empty and it gives TypeError. Reverted the condition to the old one which was used before introduction of verifySLA() JIRA: YARDSTICK-1618 Change-Id: Ibd86ba7168f26ae5b15c21fd6129cc737a7038db Signed-off-by: Deepanshu Bhatia <deepanshu@voereir.com>
2019-05-08Yardstick Hunter 8.0.0 release notesrexlee87761-82/+34
Yardstick Hunter 8.0.0 release notes Change-Id: I168047b81db828342164e0bf76c5baea04e0d2a6 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-04-26Merge changes from topic 'feat/baro_nfvi_metrics'Volodymyr Mytnyk7-71/+723
* changes: Use baro and yardstick metrics in dynamic HTML report benchmark.core.report: Add _combine_times benchmark.core.report: Add _get_baro_metrics Add ability to get data from different DBs in influx Refactor: add _format_datasets
2019-04-26Merge "Log VM OS version, Sample VNF branch/commit ID"Volodymyr Mytnyk8-14/+126
2019-04-26Merge "[docs] Document SRIOV configuration options"Volodymyr Mytnyk1-53/+97
2019-04-26Merge "Corrected MAC in trex_bm.yaml.sample"Volodymyr Mytnyk1-1/+1
2019-04-25Corrected MAC in trex_bm.yaml.sampleStepan Andrushko1-1/+1
Corrected MAC in trex_bm.yaml.sample. JIRA: YARDSTICK-1613 Change-Id: Icafe787dbdc8aa31b077b14dac94d7461b11c725 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-25[docs] Document SRIOV configuration optionsStepan Andrushko1-53/+97
Update Yardstick documentation with SRIOV options. JIRA: YARDSTICK-1611 Change-Id: I823a0a40f23dc53fb5316d4cef456eaf97f94b15 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-25[docs] Update NSB documentation, fix warningsStepan Andrushko5-67/+72
Updated NSB documentation, fixed some warnings. JIRA: YARDSTICK-1612 Change-Id: I8fdb92734b63bf3b6ad23160ebfb4c17a8e6dad1 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-25Merge "Rework TestSampleVNFTrafficGen"Rex Lee1-255/+35
2019-04-25Merge "Rework TestSampleVnf"Rex Lee1-142/+112
2019-04-19Log VM OS version, Sample VNF branch/commit IDStepan Andrushko8-14/+126
Added debug logs to track VM, Sample VNF details during testing: - Virtual machine OS, kernel version; - Sample VNF branch, commit ID. JIRA: YARDSTICK-1499 Change-Id: I243c435809d4541dfdb8c7c3466f50c5d524ac00 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-04-18Merge "[bugfix] docker build failed in hunter due to storperf version"Rex Lee2-2/+2
2019-04-17Add ansible scripts to deploy KubernetesMytnyk, Volodymyr24-1/+757
For know, only one node is supported. - build/configure CNI drivers - Init Kubernetes Change-Id: I1a0eb44fcbba20870a6b7611d4ffaf0bc3be92f3 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-15Rework TestSampleVNFTrafficGenEmma Foley1-255/+35
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: Iead085c2642a6960fdbff6905e55974fd8bd4fb2 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-15[bugfix] docker build failed in hunter due to storperf versionrexlee87762-2/+2
storperf do not have hunter branch, so it need to be set as stable/gambia JIRA: YARDSTICK-1610 Change-Id: I818396c46ce165019159b9852abb02f176507ac0 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-04-10Rework TestSampleVnfEmma Foley1-142/+112
Update network_services/vnf_generic/vnf/test_sample_vnf.py JIRA: YARDSTICK-1434 Change-Id: I193068893664e7ed1a2487b51750d34d5c256e6c Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-04-10Merge "Revert "Add ansible scripts to deploy Kubernetes""Volodymyr Mytnyk24-690/+1
2019-04-10Revert "Add ansible scripts to deploy Kubernetes"Volodymyr Mytnyk24-690/+1
This reverts commit c66efd482c9c4aabf8a82d1f554ef5fca91b3bcb. Change-Id: I87ec6e2ed6d2ef8ad202833f134e758762345b02 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-10Merge "[docs][nsb][install] Update source for sample pod files"Volodymyr Mytnyk1-15/+15
2019-04-10Merge "Add ansible scripts to deploy Kubernetes"Volodymyr Mytnyk24-1/+690
2019-04-10Add ansible scripts to deploy KubernetesMytnyk, Volodymyr24-1/+690
For know, only one node is supported. - build/configure CNI drivers - Init Kubernetes Change-Id: I6dd9dff7a4c7dfe2d7148812d2656966115c5ce9 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-09Add a document descibing vCMTS testcasetreyad3-0/+134
JIRA: YARDSTICK-1601 Change-Id: Icfca620beb191fa935d820a23f8ce086498b130e Signed-off-by: treyad <treyad@viosoft.com>
2019-04-09Merge "Suppress log outputs in test_task.py"Volodymyr Mytnyk1-0/+8
2019-04-08Merge "Upload config files for barometer collectd container"Volodymyr Mytnyk1-0/+3
2019-04-08Merge "Update to support using external heat template"Volodymyr Mytnyk4-1/+109
2019-04-08Merge "Fix UDPReplay VNF statistic parsing"Volodymyr Mytnyk2-5/+5
2019-04-08Merge "Add sipp trafficgen based SampleVNFTrafficGen"Volodymyr Mytnyk6-0/+733
2019-04-08Merge "Allow testcases to be configured over cli"Volodymyr Mytnyk11-75/+45
2019-04-05Fix UDPReplay VNF statistic parsingMytnyk, Volodymyr2-5/+5
Fixed UDPReplay statistic parsing according to changes made in UDPReplay sample VNF. JIRA: YARDSTICK-1609 Change-Id: I093f6612cc736695fa96f15dce374c949d8c3459 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-04-05Add sipp trafficgen based SampleVNFTrafficGentreyad6-0/+733
This patch defines: - Generic VNF APIs to test Network service: --> instantiate: prepare the arguments for run sipp --> run_traffic: run sipp test and handle the result file --> collect_kpi: collect results and push to queue --> terminate JIRA: YARDSTICK-1446 Change-Id: I7f6b7dd253164bb5c359ac866cb8cae81f504d65 Signed-off-by: treyad <treyad@viosoft.com>
2019-04-04Merge "Add a document describing vIMS testcase"Volodymyr Mytnyk2-0/+97
2019-04-04Update to support using external heat templatetreyad4-1/+109
Modify the _get_server() function when using external heat template. The server attrs should be read from stack.outputs. JIRA: YARDSTICK-1453 Change-Id: I00eda7476e77fc0a5c15ef8db7d057fa1cf267e6 Signed-off-by: treyad <treyad@viosoft.com>
2019-04-03Allow testcases to be configured over cliJohn O Loughlin11-75/+45
Add options for droprate and frame_rate for agnostic vnf JIRA: YARDSTICK-1554 Change-Id: I0e9eb844a96b9d8af85fc3af750c56e43fea52b8 Signed-off-by: John O Loughlin <john.oloughlin@intel.com> Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2019-04-03Merge changes from topic 'manual_ci_test_cases'Volodymyr Mytnyk25-41/+1957
* changes: Add IXIA Baremetal scale up testcases Add OpenStack test cases Add TRex Baremetal/SA scale up test cases