Document for Euphrates test case results

JIRA: YARDSTICK-1132

In B and C releases, Yardstick provides an overview of the results of test cases
developed by Yardstick, executed on OPNFV community labs.

This work has not been done for the D and E releases, although result analysis
for Euphrates is available at (https://wiki.opnfv.org/display/yardstick/Euphrates+release+test+results+analysis).
We plan to restart to provide a basic test case results analysis for Fraser and compare performance data with Euphrates.

This JIRA ticket will be resolved into 3 commits: 1. Document for E release test case data; 2. Document for F release test case data;
3. Document for results analysis.

Change-Id: I372a60807ac3dfaab87e70cdb956c1059b019f7a
Signed-off-by: JingLu5 <lvjing5@huawei.com>

1 files changed, 262 insertions, 0 deletions

diff --git a/docs/release/results/tc011-packet-delay-variation.rst b/docs/release/results/tc011-packet-delay-variation.rst
new file mode 100644
index 000000000..b07ea8980
--- /dev/null
+++ b/docs/release/results/tc011-packet-delay-variation.rst
@@ -0,0 +1,262 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International
+.. License.
+.. http://creativecommons.org/licenses/by/4.0
+
+
+=============================================
+Test results for TC011 packet delay variation
+=============================================
+
+.. toctree::
+   :maxdepth: 2
+
+
+Overview of test case
+=====================
+
+TC011 measures the packet delay variation sending the packets from one VM to the other.
+
+Metric: packet delay variation (jitter)
+Unit: ms
+
+
+Euphrates release
+-----------------
+
+Test results per scenario and pod (lower is better):
+
+{
+
+    "os-nosdn-kvm-noha:huawei-virtual3:compass": [2996],
+
+    "os-nosdn-nofeature-noha:huawei-virtual2:compass": [2996],
+
+    "os-nosdn-ovs_dpdk-noha:huawei-virtual4:compass": [2996],
+
+    "os-odl_l3-nofeature-noha:huawei-virtual4:compass": [2996],
+
+    "os-nosdn-kvm-ha:huawei-virtual3:compass": [2997],
+
+    "os-nosdn-nofeature-ha:huawei-virtual2:compass": [2997],
+
+    "os-nosdn-ovs_dpdk-ha:huawei-virtual3:compass": [2997],
+
+    "os-nosdn-ovs_dpdk-ha:huawei-virtual4:compass": [2997],
+
+    "os-odl-sfc-ha:huawei-virtual4:compass": [2997],
+
+    "os-nosdn-nofeature-ha:flex-pod2:apex": [2997.5],
+
+    "os-nosdn-bar-ha:huawei-virtual3:compass": [2998],
+
+    "os-odl-sfc-ha:huawei-virtual8:compass": [2998],
+
+    "os-nosdn-nofeature-ha:intel-pod18:joid": [2999],
+
+    "os-odl_l2-moon-ha:huawei-virtual4:compass": [2999.5],
+
+    "os-nosdn-nofeature-ha:huawei-virtual9:compass": [3000],
+
+    "os-nosdn-nofeature-noha:huawei-virtual1:compass": [3001],
+
+    "os-nosdn-bar-ha:huawei-virtual4:compass": [3002],
+
+    "os-nosdn-nofeature-ha:huawei-virtual4:compass": [3002],
+
+    "os-nosdn-ovs_dpdk-noha:huawei-virtual3:compass": [3002],
+
+    "os-odl-sfc-ha:huawei-virtual3:compass": [3002],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual4:compass": [3003],
+
+    "os-nosdn-openbaton-ha:intel-pod18:joid": [3003.5],
+
+    "os-nosdn-kvm-noha:huawei-virtual4:compass": [3004],
+
+    "os-nosdn-kvm-noha:huawei-virtual8:compass": [3004],
+
+    "os-nosdn-nofeature-ha:huawei-virtual3:compass": [3004.5],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual3:compass": [3005],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual3:fuel": [3006],
+
+    "os-nosdn-kvm-ha:huawei-virtual4:compass": [3006.5],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual2:fuel": [3009],
+
+    "os-nosdn-nofeature-noha:huawei-virtual3:compass": [3010],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual2:compass": [3010],
+
+    "os-odl_l3-nofeature-noha:huawei-virtual3:compass": [3012],
+
+    "os-nosdn-nofeature-ha:huawei-virtual1:compass": [3017],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual4:fuel": [3017],
+
+    "os-odl-sfc-noha:huawei-virtual4:compass": [3017],
+
+    "os-nosdn-nofeature-noha:intel-pod18:joid": [3018],
+
+    "os-nosdn-nofeature-ha:intel-pod5:joid": [3020],
+
+    "os-nosdn-nofeature-ha:lf-pod2:fuel": [3021],
+
+    "os-nosdn-bar-ha:huawei-pod2:compass": [3022],
+
+    "os-nosdn-bar-ha:lf-pod1:apex": [3022],
+
+    "os-nosdn-bar-noha:lf-pod1:apex": [3022],
+
+    "os-nosdn-kvm-ha:huawei-pod2:compass": [3022],
+
+    "os-nosdn-nofeature-ha:arm-pod5:fuel": [3022],
+
+    "os-nosdn-nofeature-ha:arm-pod6:fuel": [3022],
+
+    "os-nosdn-nofeature-ha:ericsson-pod1:fuel": [3022],
+
+    "os-nosdn-nofeature-ha:huawei-pod12:joid": [3022],
+
+    "os-nosdn-nofeature-ha:huawei-pod2:compass": [3022],
+
+    "os-nosdn-nofeature-ha:lf-pod1:apex": [3022],
+
+    "os-nosdn-nofeature-noha:huawei-pod12:joid": [3022],
+
+    "os-nosdn-nofeature-noha:intel-pod5:joid": [3022],
+
+    "os-nosdn-nofeature-noha:lf-pod1:apex": [3022],
+
+    "os-nosdn-openbaton-ha:huawei-pod12:joid": [3022],
+
+    "os-nosdn-ovs_dpdk-ha:huawei-pod2:compass": [3022],
+
+    "os-odl-nofeature-ha:arm-pod5:fuel": [3022],
+
+    "os-odl-sfc-ha:huawei-pod2:compass": [3022],
+
+    "os-odl-sfc-ha:lf-pod1:apex": [3022],
+
+    "os-odl-sfc-noha:huawei-virtual3:compass": [3022],
+
+    "os-odl-sfc-noha:lf-pod1:apex": [3022],
+
+    "os-odl_l2-moon-ha:huawei-pod2:compass": [3022],
+
+    "os-odl_l2-moon-ha:huawei-virtual3:compass": [3022],
+
+    "os-odl_l2-moon-noha:huawei-virtual3:compass": [3022],
+
+    "os-odl_l3-nofeature-ha:huawei-pod2:compass": [3022],
+
+    "os-ovn-nofeature-noha:lf-pod1:apex": [3022],
+
+    "os-nosdn-nofeature-noha:huawei-virtual4:compass": [3023],
+
+    "os-odl_l2-moon-noha:huawei-virtual4:compass": [3023],
+
+    "os-nosdn-nofeature-noha:huawei-virtual8:compass": [3024]
+
+}
+
+
+The influence of the scenario
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+.. image:: images/tc011_scenario.png
+   :width: 800px
+   :alt: TC011 influence of scenario
+
+{
+
+    "os-nosdn-ovs_dpdk-noha": [2996],
+
+    "os-odl_l3-nofeature-noha": [2997],
+
+    "os-nosdn-kvm-noha": [2999],
+
+    "os-nosdn-ovs_dpdk-ha": [3002],
+
+    "os-nosdn-kvm-ha": [3014.5],
+
+    "os-odl-sfc-noha": [3018],
+
+    "os-nosdn-nofeature-noha": [3020],
+
+    "os-nosdn-openbaton-ha": [3020],
+
+    "os-nosdn-bar-ha": [3022],
+
+    "os-nosdn-bar-noha": [3022],
+
+    "os-nosdn-nofeature-ha": [3022],
+
+    "os-odl-nofeature-ha": [3022],
+
+    "os-odl-sfc-ha": [3022],
+
+    "os-odl_l2-moon-ha": [3022],
+
+    "os-odl_l2-moon-noha": [3022],
+
+    "os-odl_l3-nofeature-ha": [3022],
+
+    "os-ovn-nofeature-noha": [3022]
+
+}
+
+
+The influence of the POD
+^^^^^^^^^^^^^^^^^^^^^^^^
+
+.. image:: images/tc011_pod.png
+   :width: 800px
+   :alt: TC011 influence of the POD
+
+{
+
+    "huawei-virtual2": [2997],
+
+    "flex-pod2": [2997.5],
+
+    "huawei-virtual3": [2998],
+
+    "huawei-virtual9": [3000],
+
+    "huawei-virtual8": [3001],
+
+    "huawei-virtual4": [3002],
+
+    "ericsson-virtual3": [3006],
+
+    "huawei-virtual1": [3007],
+
+    "ericsson-virtual2": [3009],
+
+    "intel-pod18": [3010],
+
+    "ericsson-virtual4": [3017],
+
+    "lf-pod2": [3021],
+
+    "arm-pod5": [3022],
+
+    "arm-pod6": [3022],
+
+    "ericsson-pod1": [3022],
+
+    "huawei-pod12": [3022],
+
+    "huawei-pod2": [3022],
+
+    "intel-pod5": [3022],
+
+    "lf-pod1": [3022]
+
+}
+
+
+Fraser release
+--------------