summaryrefslogtreecommitdiffstats
path: root/docs/release/results/tc002-network-latency.rst
blob: 722423473da92698d9debd88a0e66399120b4e61 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
<
########################################################################
.. This work is licensed under a Creative Commons Attribution 4.0 International
.. License.
.. http://creativecommons.org/licenses/by/4.0


======================================
Test results for TC002 network latency
======================================

.. toctree::
   :maxdepth: 2


Overview of test case
=====================

TC002 verifies that network latency is within acceptable boundaries when packets travel between hosts located on same or different compute blades.
Ping packets (ICMP protocol's mandatory ECHO_REQUEST datagram) are sent from host VM to target VM(s) to elicit ICMP ECHO_RESPONSE.

Metric: RTT (Round Trip Time)
Unit: ms


Euphrates release
-----------------

Test results per scenario and pod (lower is better):

{

    "os-nosdn-ovs_dpdk-ha:huawei-pod2:compass": [0.214],

    "os-odl_l2-moon-ha:huawei-pod2:compass": [0.309],

    "os-nosdn-ovs_dpdk-noha:huawei-virtual3:compass": [0.3145],

    "os-nosdn-ovs-ha:lf-pod2:fuel": [0.3585],

    "os-odl_l3-nofeature-ha:huawei-pod2:compass": [0.3765],

    "os-nosdn-ovs_dpdk-noha:huawei-virtual4:compass": [0.403],

    "os-odl-sfc-ha:huawei-pod2:compass": [0.413],

    "os-nosdn-ovs-ha:ericsson-pod1:fuel": [0.494],

    "os-nosdn-nofeature-ha:lf-pod1:apex": [0.5715],

    "os-nosdn-nofeature-noha:lf-pod1:apex": [0.5785],

    "os-odl-sfc-ha:lf-pod1:apex": [0.617],

    "os-odl-nofeature-ha:lf-pod1:apex": [0.62],

    "os-nosdn-bar-noha:lf-pod1:apex": [0.632],

    "os-odl-nofeature-noha:lf-pod1:apex": [0.635],

    "os-odl-bgpvpn-ha:lf-pod1:apex": [0.658],

    "os-odl-sfc-noha:lf-pod1:apex": [0.663],

    "os-nosdn-bar-ha:lf-pod1:apex": [0.668],

    "os-ovn-nofeature-noha:lf-pod1:apex": [0.668],

    "os-nosdn-nofeature-ha:huawei-pod2:compass": [0.6815],

    "os-nosdn-kvm-ha:huawei-pod2:compass": [0.7005],

    "os-nosdn-bar-ha:huawei-pod2:compass": [0.778],

    "os-nosdn-ovs-noha:ericsson-virtual4:fuel": [0.7825],

    "os-nosdn-ovs-noha:ericsson-virtual2:fuel": [0.7885],

    "os-nosdn-nofeature-ha:flex-pod2:apex": [0.795],

    "os-nosdn-ovs-noha:ericsson-virtual1:fuel": [0.8045],

    "os-nosdn-nofeature-noha:huawei-pod12:joid": [0.8335],

    "os-nosdn-ovs-noha:ericsson-virtual3:fuel": [0.8755],

    "os-nosdn-nofeature-ha:huawei-pod12:joid": [0.8855],

    "os-nosdn-ovs_dpdk-ha:huawei-virtual3:compass": [0.8895],

    "os-nosdn-openbaton-ha:huawei-pod12:joid": [0.901],

    "os-nosdn-ovs_dpdk-ha:huawei-virtual4:compass": [0.956],

    "os-nosdn-lxd-noha:intel-pod5:joid": [1.131],

    "os-odl_l2-moon-noha:huawei-virtual4:compass": [1.173],

    "os-odl-sfc-ha:huawei-virtual8:compass": [1.2015],

    "os-odl_l2-moon-noha:huawei-virtual3:compass": [1.204],

    "os-nosdn-lxd-ha:intel-pod5:joid": [1.2245],

    "os-odl-nofeature-ha:lf-pod2:fuel": [1.2285],

    "os-odl-sfc-noha:huawei-virtual4:compass": [1.3055],

    "os-nosdn-nofeature-noha:huawei-virtual4:compass": [1.309],

    "os-odl_l3-nofeature-noha:huawei-virtual4:compass": [1.313],

    "os-nosdn-nofeature-noha:huawei-virtual8:compass": [1.319],

    "os-odl-nofeature-ha:ericsson-pod1:fuel": [1.3425],

    "os-odl_l3-nofeature-noha:huawei-virtual3:compass": [1.3475],

    "os-nosdn-nofeature-ha:lf-pod2:fuel": [1.348],

    "os-nosdn-kvm-noha:huawei-virtual4:compass": [1.432],

    "os-odl_l3-nofeature-noha:huawei-virtual9:compass": [1.442],

    "os-nosdn-nofeature-ha:ericsson-pod1:fuel": [1.4505],

    "os-nosdn-nofeature-ha:arm-pod5:fuel": [1.497],

    "os-odl-sfc-noha:huawei-virtual3:compass": [1.504],

    "os-odl-nofeature-ha:arm-pod5:fuel": [1.519],

    "os-nosdn-nofeature-noha:intel-pod5:joid": [1.5415],

    "os-nosdn-nofeature-noha:huawei-virtual3:compass": [1.5785],

    "os-nosdn-nofeature-ha:intel-pod5:joid": [1.604],

    "os-nosdn-kvm-noha:huawei-virtual3:compass": [1.61],

    "os-nosdn-nofeature-noha:intel-pod18:joid": [1.633],

    "os-nosdn-openbaton-ha:intel-pod18:joid": [1.6485],

    "os-odl_l3-nofeature-ha:huawei-virtual2:compass": [1.7085],

    "os-nosdn-nofeature-ha:intel-pod18:joid": [1.71],

    "os-nosdn-nofeature-ha:huawei-virtual2:compass": [1.7955],

    "os-odl-nofeature-ha:arm-pod6:fuel": [1.838],

    "os-odl_l3-nofeature-ha:huawei-virtual4:compass": [1.88],

    "os-odl_l2-moon-ha:huawei-virtual3:compass": [1.8975],

    "os-nosdn-kvm-noha:huawei-virtual8:compass": [1.923],

    "os-odl_l2-moon-ha:huawei-virtual4:compass": [1.944],

    "os-odl-sfc-ha:huawei-virtual3:compass": [1.968],

    "os-odl_l3-nofeature-ha:huawei-virtual3:compass": [1.986],

    "os-nosdn-bar-ha:huawei-virtual4:compass": [2.0415],

    "os-nosdn-nofeature-ha:huawei-virtual4:compass": [2.071],

    "os-nosdn-nofeature-ha:arm-pod6:fuel": [2.0855],

    "os-odl-sfc-ha:huawei-virtual4:compass": [2.1085],

    "os-nosdn-nofeature-ha:huawei-virtual3:compass": [2.1135],

    "os-nosdn-nofeature-noha:ericsson-virtual3:fuel": [2.234],

    "os-nosdn-nofeature-ha:huawei-virtual9:compass": [2.294],

    "os-nosdn-kvm-ha:huawei-virtual3:compass": [2.304],

    "os-nosdn-bar-ha:huawei-virtual3:compass": [2.378],

    "os-nosdn-kvm-ha:huawei-virtual4:compass": [2.397],

    "os-nosdn-nofeature-ha:huawei-virtual1:compass": [2.472],

    "os-nosdn-nofeature-noha:huawei-virtual1:compass": [2.603],

    "os-nosdn-nofeature-noha:huawei-virtual2:compass": [2.635],

    "os-odl-nofeature-noha:ericsson-virtual3:fuel": [2.9055],

    "os-odl-nofeature-noha:ericsson-virtual2:fuel": [3.1295],

    "os-nosdn-nofeature-noha:ericsson-virtual2:fuel": [3.337],

    "os-odl-nofeature-noha:ericsson-virtual4:fuel": [3.634],

    "os-nosdn-nofeature-noha:ericsson-virtual1:fuel": [3.875],

    "os-odl-nofeature-noha:ericsson-virtual1:fuel": [3.9655],

    "os-nosdn-nofeature-noha:ericsson-virtual4:fuel": [3.9795]

}


The influence of the scenario
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

.. image:: images/tc002_scenario.png
   :width: 800px
   :alt: TC002 influence of scenario

{

    "os-odl_l2-moon-ha": [0.3415],

    "os-nosdn-ovs-ha": [0.3625],

    "os-nosdn-ovs_dpdk-noha": [0.378],

    "os-nosdn-ovs_dpdk-ha": [0.5265],

    "os-nosdn-bar-noha": [0.632],

    "os-odl-bgpvpn-ha": [0.658],

    "os-ovn-nofeature-noha": [0.668],

    "os-odl_l3-nofeature-ha": [0.8545],

    "os-nosdn-ovs-noha": [0.8575],

    "os-nosdn-bar-ha": [0.903],

    "os-odl-sfc-ha": [1.127],

    "os-nosdn-lxd-noha": [1.131],

    "os-nosdn-nofeature-ha": [1.152],

    "os-odl_l2-moon-noha": [1.1825],

    "os-nosdn-lxd-ha": [1.2245],

    "os-odl_l3-nofeature-noha": [1.337],

    "os-odl-nofeature-ha": [1.352],

    "os-odl-sfc-noha": [1.4255],

    "os-nosdn-kvm-noha": [1.5045],

    "os-nosdn-openbaton-ha": [1.5665],

    "os-nosdn-nofeature-noha": [1.729],

    "os-nosdn-kvm-ha": [1.7745],

    "os-odl-nofeature-noha": [3.106]

}


The influence of the POD
^^^^^^^^^^^^^^^^^^^^^^^^

.. image:: images/tc002_pod.png
   :width: 800px
   :alt: TC002 influence of the POD

{

    "huawei-pod2": [0.3925],

    "lf-pod2": [0.5315],

    "lf-pod1": [0.62],

    "flex-pod2": [0.795],

    "huawei-pod12": [0.87],

    "intel-pod5": [1.25],

    "ericsson-virtual3": [1.2655],

    "ericsson-pod1": [1.372],

    "arm-pod5": [1.518],

    "huawei-virtual4": [1.5355],

    "huawei-virtual3": [1.606],

    "intel-pod18": [1.6575],

    "huawei-virtual8": [1.709],

    "huawei-virtual2": [1.872],

    "arm-pod6": [1.895],

    "huawei-virtual9": [2.0745],

    "huawei-virtual1": [2.495],

    "ericsson-virtual2": [2.7895],

    "ericsson-virtual4": [3.768],

    "ericsson-virtual1": [3.8035]

}


Fraser release
--------------