Document for Fraser test case results

JIRA: YARDSTICK-1132

In B and C releases, Yardstick provides an overview of the results of test cases developed by Yardstick, executed on OPNFV community labs.

This work has not been done for the D and E releases, although result analysis for Euphrates is available at (https://wiki.opnfv.org/display/yardstick/Euphrates+release+test+results+analysis). We plan to restart to provide a basic test case results analysis for Fraser and compare performance data with Euphrates.

This JIRA ticket will be resolved into 3 commits: 1. Document for E release test case data; 2. Document for F release test case data; 3. Document for results analysis.

Change-Id: I3c59851c8878ba37145e6ad6958272a62bad3f52
Signed-off-by: JingLu5 <lvjing5@huawei.com>

1 files changed, 208 insertions, 0 deletions

diff --git a/docs/release/results/tc002-network-latency.rst b/docs/release/results/tc002-network-latency.rst
index 722423473..064983bec 100644
--- a/docs/release/results/tc002-network-latency.rst
+++ b/docs/release/results/tc002-network-latency.rst
@@ -315,3 +315,211 @@ The influence of the POD
 
 Fraser release
 --------------
+
+Test results per scenario and pod (lower is better):
+
+{
+
+    "os-odl_l3-nofeature-ha:huawei-pod2:compass": [0.42],
+
+    "os-odl-sfc-ha:huawei-pod2:compass": [0.557],
+
+    "os-nosdn-ovs-ha:ericsson-pod1:fuel": [0.5765],
+
+    "os-nosdn-kvm-ha:huawei-pod2:compass": [0.582],
+
+    "os-odl-bgpvpn-ha:lf-pod1:apex": [0.678],
+
+    "os-nosdn-nofeature-ha:lf-pod1:apex": [0.7075],
+
+    "os-nosdn-calipso-noha:lf-pod1:apex": [0.713],
+
+    "os-nosdn-nofeature-noha:lf-pod1:apex": [0.7155],
+
+    "os-nosdn-bar-ha:lf-pod1:apex": [0.732],
+
+    "os-nosdn-bar-noha:lf-pod1:apex": [0.7415],
+
+    "os-odl-nofeature-noha:lf-pod1:apex": [0.7565],
+
+    "os-nosdn-ovs-ha:arm-pod6:fuel": [0.8015],
+
+    "os-nosdn-nofeature-ha:huawei-pod2:compass": [0.908],
+
+    "os-odl-nofeature-ha:ericsson-pod1:fuel": [0.9165],
+
+    "os-nosdn-bar-ha:huawei-pod2:compass": [0.969],
+
+    "os-nosdn-ovs-noha:ericsson-virtual2:fuel": [0.9765],
+
+    "os-nosdn-nofeature-noha:huawei-pod12:joid": [1.0245],
+
+    "os-nosdn-nofeature-ha:huawei-pod12:joid": [1.0495],
+
+    "os-odl-sfc-noha:huawei-virtual4:compass": [1.1645],
+
+    "os-nosdn-nofeature-ha:lf-pod2:fuel": [1.206],
+
+    "os-odl-sfc-noha:huawei-virtual3:compass": [1.236],
+
+    "os-nosdn-ovs-noha:ericsson-virtual4:fuel": [1.241],
+
+    "os-nosdn-nofeature-ha:zte-pod2:daisy": [1.2805],
+
+    "os-odl-nofeature-ha:lf-pod2:fuel": [1.286],
+
+    "os-odl_l3-nofeature-noha:huawei-virtual3:compass": [1.299],
+
+    "os-odl-sfc-ha:huawei-virtual4:compass": [1.305],
+
+    "os-odl_l3-nofeature-noha:huawei-virtual4:compass": [1.309],
+
+    "os-nosdn-kvm-noha:huawei-virtual4:compass": [1.314],
+
+    "os-nosdn-nofeature-noha:huawei-virtual4:compass": [1.431],
+
+    "os-nosdn-nofeature-ha:ericsson-pod1:fuel": [1.457],
+
+    "os-odl-nofeature-ha:zte-pod2:daisy": [1.517],
+
+    "os-nosdn-kvm-noha:huawei-virtual3:compass": [1.576],
+
+    "os-nosdn-nofeature-noha:huawei-virtual3:compass": [1.592],
+
+    "os-odl-nofeature-ha:arm-pod5:fuel": [1.714],
+
+    "os-nosdn-nofeature-noha:intel-pod18:joid": [1.809],
+
+    "os-nosdn-bar-noha:huawei-virtual4:compass": [1.81],
+
+    "os-nosdn-nofeature-ha:intel-pod18:joid": [1.8505],
+
+    "os-nosdn-nofeature-ha:huawei-virtual4:compass": [1.8895],
+
+    "os-nosdn-nofeature-ha:huawei-virtual3:compass": [1.909],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual4:compass": [1.925],
+
+    "os-nosdn-nofeature-noha:huawei-virtual2:compass": [1.964],
+
+    "os-nosdn-openbaton-ha:intel-pod18:joid": [1.9755],
+
+    "os-nosdn-nofeature-ha:huawei-virtual1:compass": [1.9765],
+
+    "os-nosdn-bar-noha:huawei-virtual3:compass": [1.9915],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual3:compass": [1.9925],
+
+    "os-nosdn-kvm-ha:huawei-virtual4:compass": [2.0265],
+
+    "os-odl-nofeature-ha:arm-pod6:fuel": [2.106],
+
+    "os-odl-sfc-ha:huawei-virtual3:compass": [2.124],
+
+    "os-nosdn-kvm-ha:huawei-virtual3:compass": [2.185],
+
+    "os-nosdn-nofeature-ha:arm-pod6:fuel": [2.281],
+
+    "os-nosdn-bar-ha:huawei-virtual4:compass": [2.432],
+
+    "os-odl-nofeature-noha:ericsson-virtual4:fuel": [2.483],
+
+    "os-nosdn-bar-ha:huawei-virtual3:compass": [2.524],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual3:fuel": [3.9175],
+
+    "os-odl-nofeature-noha:ericsson-virtual2:fuel": [4.338],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual2:fuel": [4.641]
+
+}
+
+
+The influence of the scenario
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+.. image:: images/tc002_scenario_fraser.png
+   :width: 800px
+   :alt: TC002 influence of scenario
+
+{
+
+    "os-odl-bgpvpn-ha": [0.678],
+
+    "os-nosdn-calipso-noha": [0.713],
+
+    "os-nosdn-ovs-ha": [0.7245],
+
+    "os-odl_l3-nofeature-ha": [0.7435],
+
+    "os-odl-sfc-ha": [0.796],
+
+    "os-nosdn-kvm-ha": [1.059],
+
+    "os-nosdn-bar-ha": [1.083],
+
+    "os-nosdn-ovs-noha": [1.09],
+
+    "os-odl-sfc-noha": [1.196],
+
+    "os-nosdn-nofeature-noha": [1.26],
+
+    "os-nosdn-nofeature-ha": [1.291],
+
+    "os-odl_l3-nofeature-noha": [1.308],
+
+    "os-nosdn-bar-noha": [1.4125],
+
+    "os-nosdn-kvm-noha": [1.4475],
+
+    "os-odl-nofeature-ha": [1.508],
+
+    "os-odl-nofeature-noha": [1.914],
+
+    "os-nosdn-openbaton-ha": [1.9755]
+
+}
+
+
+The influence of the POD
+^^^^^^^^^^^^^^^^^^^^^^^^
+
+.. image:: images/tc002_pod_fraser.png
+   :width: 800px
+   :alt: TC002 influence of the POD
+
+{
+
+    "huawei-pod2": [0.677],
+
+    "lf-pod1": [0.725],
+
+    "ericsson-pod1": [0.9165],
+
+    "huawei-pod12": [1.0465],
+
+    "lf-pod2": [1.2325],
+
+    "zte-pod2": [1.395],
+
+    "ericsson-virtual4": [1.582],
+
+    "huawei-virtual4": [1.697],
+
+    "arm-pod5": [1.714],
+
+    "huawei-virtual3": [1.716],
+
+    "intel-pod18": [1.856],
+
+    "huawei-virtual2": [1.964],
+
+    "huawei-virtual1": [1.9765],
+
+    "arm-pod6": [2.209],
+
+    "ericsson-virtual3": [3.9175],
+
+    "ericsson-virtual2": [4.004]
+
+}