From 82a17a3d7c59a49105d6f3b2e4044ab19f77b0a0 Mon Sep 17 00:00:00 2001
From: Richard Elias <richardx.elias@intel.com>
Date: Wed, 28 Feb 2018 15:48:00 +0000
Subject: vsperf: Performance Matrix functionality support

The patch expands the vsperf --test-params argument with list
functionality, which enables running multiple tests with different
parameters. If more tests are run then parameters provided, the
last parameters will be reused. Example:
./vsperf --test-params "['','TRAFFICGEN_PKTSIZE = (64,)']"
phy2phy_cont phy2phy_cont
CUMULATIVE_PARAMS if true, instead of using the default settings,
each test will take the parameters of the previous test before
applying it's own.
The patch also adds the vsperf --matrix argument which analyzes and
compares the results of all the tests run, printing it as a table,
as well as saving it into a file in the results directory.
MATRIX_METRIC metric used by Performance Matrix to compare tests.

JIRA: VSPERF-554

Change-Id: I71530ddf110890612236a7e57039f249609c835b
Signed-off-by: Richard Elias <richardx.elias@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
---
 tools/report/report_foot.rst | 4 ++++
 1 file changed, 4 insertions(+)

(limited to 'tools')

diff --git a/tools/report/report_foot.rst b/tools/report/report_foot.rst
index 5045e186..a49e3452 100644
--- a/tools/report/report_foot.rst
+++ b/tools/report/report_foot.rst
@@ -5,6 +5,7 @@
 
 Rationale for decisions
 =======================
+
 The tests conducted do not have pass/fail/conditional-pass criteria. The test
 is simply conducted and the results are reported.
 
@@ -12,6 +13,7 @@ is simply conducted and the results are reported.
 
 Conclusions and recommendations
 ===============================
+
 The test results are stable. The vsperf CI jobs that were used to obtain the
 results can be found at https://wiki.opnfv.org/wiki/vsperf_results.
 
@@ -20,11 +22,13 @@ General
 
 Glossary
 --------
+
 - NFV - Network Function Virtualization
 - Mbps - 1,000,000bps
 
 Document change procedures and history
 --------------------------------------
+
 =============================================== ================= =============
              Document ID                            Author        Date Modified
 =============================================== ================= =============
-- 
cgit