Document for Euphrates test case results

JIRA: YARDSTICK-1132

In B and C releases, Yardstick provides an overview of the results of test cases
developed by Yardstick, executed on OPNFV community labs.

This work has not been done for the D and E releases, although result analysis
for Euphrates is available at (https://wiki.opnfv.org/display/yardstick/Euphrates+release+test+results+analysis).
We plan to restart to provide a basic test case results analysis for Fraser and compare performance data with Euphrates.

This JIRA ticket will be resolved into 3 commits: 1. Document for E release test case data; 2. Document for F release test case data;
3. Document for results analysis.

Change-Id: I372a60807ac3dfaab87e70cdb956c1059b019f7a
Signed-off-by: JingLu5 <lvjing5@huawei.com>

1 files changed, 317 insertions, 0 deletions

diff --git a/docs/release/results/tc002-network-latency.rst b/docs/release/results/tc002-network-latency.rst
new file mode 100644
index 000000000..722423473
--- /dev/null
+++ b/docs/release/results/tc002-network-latency.rst
@@ -0,0 +1,317 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International
+.. License.
+.. http://creativecommons.org/licenses/by/4.0
+
+
+======================================
+Test results for TC002 network latency
+======================================
+
+.. toctree::
+   :maxdepth: 2
+
+
+Overview of test case
+=====================
+
+TC002 verifies that network latency is within acceptable boundaries when packets travel between hosts located on same or different compute blades.
+Ping packets (ICMP protocol's mandatory ECHO_REQUEST datagram) are sent from host VM to target VM(s) to elicit ICMP ECHO_RESPONSE.
+
+Metric: RTT (Round Trip Time)
+Unit: ms
+
+
+Euphrates release
+-----------------
+
+Test results per scenario and pod (lower is better):
+
+{
+
+    "os-nosdn-ovs_dpdk-ha:huawei-pod2:compass": [0.214],
+
+    "os-odl_l2-moon-ha:huawei-pod2:compass": [0.309],
+
+    "os-nosdn-ovs_dpdk-noha:huawei-virtual3:compass": [0.3145],
+
+    "os-nosdn-ovs-ha:lf-pod2:fuel": [0.3585],
+
+    "os-odl_l3-nofeature-ha:huawei-pod2:compass": [0.3765],
+
+    "os-nosdn-ovs_dpdk-noha:huawei-virtual4:compass": [0.403],
+
+    "os-odl-sfc-ha:huawei-pod2:compass": [0.413],
+
+    "os-nosdn-ovs-ha:ericsson-pod1:fuel": [0.494],
+
+    "os-nosdn-nofeature-ha:lf-pod1:apex": [0.5715],
+
+    "os-nosdn-nofeature-noha:lf-pod1:apex": [0.5785],
+
+    "os-odl-sfc-ha:lf-pod1:apex": [0.617],
+
+    "os-odl-nofeature-ha:lf-pod1:apex": [0.62],
+
+    "os-nosdn-bar-noha:lf-pod1:apex": [0.632],
+
+    "os-odl-nofeature-noha:lf-pod1:apex": [0.635],
+
+    "os-odl-bgpvpn-ha:lf-pod1:apex": [0.658],
+
+    "os-odl-sfc-noha:lf-pod1:apex": [0.663],
+
+    "os-nosdn-bar-ha:lf-pod1:apex": [0.668],
+
+    "os-ovn-nofeature-noha:lf-pod1:apex": [0.668],
+
+    "os-nosdn-nofeature-ha:huawei-pod2:compass": [0.6815],
+
+    "os-nosdn-kvm-ha:huawei-pod2:compass": [0.7005],
+
+    "os-nosdn-bar-ha:huawei-pod2:compass": [0.778],
+
+    "os-nosdn-ovs-noha:ericsson-virtual4:fuel": [0.7825],
+
+    "os-nosdn-ovs-noha:ericsson-virtual2:fuel": [0.7885],
+
+    "os-nosdn-nofeature-ha:flex-pod2:apex": [0.795],
+
+    "os-nosdn-ovs-noha:ericsson-virtual1:fuel": [0.8045],
+
+    "os-nosdn-nofeature-noha:huawei-pod12:joid": [0.8335],
+
+    "os-nosdn-ovs-noha:ericsson-virtual3:fuel": [0.8755],
+
+    "os-nosdn-nofeature-ha:huawei-pod12:joid": [0.8855],
+
+    "os-nosdn-ovs_dpdk-ha:huawei-virtual3:compass": [0.8895],
+
+    "os-nosdn-openbaton-ha:huawei-pod12:joid": [0.901],
+
+    "os-nosdn-ovs_dpdk-ha:huawei-virtual4:compass": [0.956],
+
+    "os-nosdn-lxd-noha:intel-pod5:joid": [1.131],
+
+    "os-odl_l2-moon-noha:huawei-virtual4:compass": [1.173],
+
+    "os-odl-sfc-ha:huawei-virtual8:compass": [1.2015],
+
+    "os-odl_l2-moon-noha:huawei-virtual3:compass": [1.204],
+
+    "os-nosdn-lxd-ha:intel-pod5:joid": [1.2245],
+
+    "os-odl-nofeature-ha:lf-pod2:fuel": [1.2285],
+
+    "os-odl-sfc-noha:huawei-virtual4:compass": [1.3055],
+
+    "os-nosdn-nofeature-noha:huawei-virtual4:compass": [1.309],
+
+    "os-odl_l3-nofeature-noha:huawei-virtual4:compass": [1.313],
+
+    "os-nosdn-nofeature-noha:huawei-virtual8:compass": [1.319],
+
+    "os-odl-nofeature-ha:ericsson-pod1:fuel": [1.3425],
+
+    "os-odl_l3-nofeature-noha:huawei-virtual3:compass": [1.3475],
+
+    "os-nosdn-nofeature-ha:lf-pod2:fuel": [1.348],
+
+    "os-nosdn-kvm-noha:huawei-virtual4:compass": [1.432],
+
+    "os-odl_l3-nofeature-noha:huawei-virtual9:compass": [1.442],
+
+    "os-nosdn-nofeature-ha:ericsson-pod1:fuel": [1.4505],
+
+    "os-nosdn-nofeature-ha:arm-pod5:fuel": [1.497],
+
+    "os-odl-sfc-noha:huawei-virtual3:compass": [1.504],
+
+    "os-odl-nofeature-ha:arm-pod5:fuel": [1.519],
+
+    "os-nosdn-nofeature-noha:intel-pod5:joid": [1.5415],
+
+    "os-nosdn-nofeature-noha:huawei-virtual3:compass": [1.5785],
+
+    "os-nosdn-nofeature-ha:intel-pod5:joid": [1.604],
+
+    "os-nosdn-kvm-noha:huawei-virtual3:compass": [1.61],
+
+    "os-nosdn-nofeature-noha:intel-pod18:joid": [1.633],
+
+    "os-nosdn-openbaton-ha:intel-pod18:joid": [1.6485],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual2:compass": [1.7085],
+
+    "os-nosdn-nofeature-ha:intel-pod18:joid": [1.71],
+
+    "os-nosdn-nofeature-ha:huawei-virtual2:compass": [1.7955],
+
+    "os-odl-nofeature-ha:arm-pod6:fuel": [1.838],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual4:compass": [1.88],
+
+    "os-odl_l2-moon-ha:huawei-virtual3:compass": [1.8975],
+
+    "os-nosdn-kvm-noha:huawei-virtual8:compass": [1.923],
+
+    "os-odl_l2-moon-ha:huawei-virtual4:compass": [1.944],
+
+    "os-odl-sfc-ha:huawei-virtual3:compass": [1.968],
+
+    "os-odl_l3-nofeature-ha:huawei-virtual3:compass": [1.986],
+
+    "os-nosdn-bar-ha:huawei-virtual4:compass": [2.0415],
+
+    "os-nosdn-nofeature-ha:huawei-virtual4:compass": [2.071],
+
+    "os-nosdn-nofeature-ha:arm-pod6:fuel": [2.0855],
+
+    "os-odl-sfc-ha:huawei-virtual4:compass": [2.1085],
+
+    "os-nosdn-nofeature-ha:huawei-virtual3:compass": [2.1135],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual3:fuel": [2.234],
+
+    "os-nosdn-nofeature-ha:huawei-virtual9:compass": [2.294],
+
+    "os-nosdn-kvm-ha:huawei-virtual3:compass": [2.304],
+
+    "os-nosdn-bar-ha:huawei-virtual3:compass": [2.378],
+
+    "os-nosdn-kvm-ha:huawei-virtual4:compass": [2.397],
+
+    "os-nosdn-nofeature-ha:huawei-virtual1:compass": [2.472],
+
+    "os-nosdn-nofeature-noha:huawei-virtual1:compass": [2.603],
+
+    "os-nosdn-nofeature-noha:huawei-virtual2:compass": [2.635],
+
+    "os-odl-nofeature-noha:ericsson-virtual3:fuel": [2.9055],
+
+    "os-odl-nofeature-noha:ericsson-virtual2:fuel": [3.1295],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual2:fuel": [3.337],
+
+    "os-odl-nofeature-noha:ericsson-virtual4:fuel": [3.634],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual1:fuel": [3.875],
+
+    "os-odl-nofeature-noha:ericsson-virtual1:fuel": [3.9655],
+
+    "os-nosdn-nofeature-noha:ericsson-virtual4:fuel": [3.9795]
+
+}
+
+
+The influence of the scenario
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+.. image:: images/tc002_scenario.png
+   :width: 800px
+   :alt: TC002 influence of scenario
+
+{
+
+    "os-odl_l2-moon-ha": [0.3415],
+
+    "os-nosdn-ovs-ha": [0.3625],
+
+    "os-nosdn-ovs_dpdk-noha": [0.378],
+
+    "os-nosdn-ovs_dpdk-ha": [0.5265],
+
+    "os-nosdn-bar-noha": [0.632],
+
+    "os-odl-bgpvpn-ha": [0.658],
+
+    "os-ovn-nofeature-noha": [0.668],
+
+    "os-odl_l3-nofeature-ha": [0.8545],
+
+    "os-nosdn-ovs-noha": [0.8575],
+
+    "os-nosdn-bar-ha": [0.903],
+
+    "os-odl-sfc-ha": [1.127],
+
+    "os-nosdn-lxd-noha": [1.131],
+
+    "os-nosdn-nofeature-ha": [1.152],
+
+    "os-odl_l2-moon-noha": [1.1825],
+
+    "os-nosdn-lxd-ha": [1.2245],
+
+    "os-odl_l3-nofeature-noha": [1.337],
+
+    "os-odl-nofeature-ha": [1.352],
+
+    "os-odl-sfc-noha": [1.4255],
+
+    "os-nosdn-kvm-noha": [1.5045],
+
+    "os-nosdn-openbaton-ha": [1.5665],
+
+    "os-nosdn-nofeature-noha": [1.729],
+
+    "os-nosdn-kvm-ha": [1.7745],
+
+    "os-odl-nofeature-noha": [3.106]
+
+}
+
+
+The influence of the POD
+^^^^^^^^^^^^^^^^^^^^^^^^
+
+.. image:: images/tc002_pod.png
+   :width: 800px
+   :alt: TC002 influence of the POD
+
+{
+
+    "huawei-pod2": [0.3925],
+
+    "lf-pod2": [0.5315],
+
+    "lf-pod1": [0.62],
+
+    "flex-pod2": [0.795],
+
+    "huawei-pod12": [0.87],
+
+    "intel-pod5": [1.25],
+
+    "ericsson-virtual3": [1.2655],
+
+    "ericsson-pod1": [1.372],
+
+    "arm-pod5": [1.518],
+
+    "huawei-virtual4": [1.5355],
+
+    "huawei-virtual3": [1.606],
+
+    "intel-pod18": [1.6575],
+
+    "huawei-virtual8": [1.709],
+
+    "huawei-virtual2": [1.872],
+
+    "arm-pod6": [1.895],
+
+    "huawei-virtual9": [2.0745],
+
+    "huawei-virtual1": [2.495],
+
+    "ericsson-virtual2": [2.7895],
+
+    "ericsson-virtual4": [3.768],
+
+    "ericsson-virtual1": [3.8035]
+
+}
+
+
+Fraser release
+--------------