summaryrefslogtreecommitdiffstats
path: root/docs/testing/user/userguide/testlist.rst
diff options
context:
space:
mode:
authorMartin Klozik <martinx.klozik@intel.com>2017-10-24 09:03:54 +0100
committerMartin Klozik <martinx.klozik@intel.com>2017-11-20 15:55:19 +0000
commitb3a7561eca19e19243f71cf74c1b3eaeda740794 (patch)
tree04e2adf7c5f807a8e19b002bf8baeeae48283c1f /docs/testing/user/userguide/testlist.rst
parent4bca2eeb7fabe20112d0b9c5a4c166615124bcd0 (diff)
regression: OVS/DPDK regression tests
A set of regression tests for verification of OVS/DPDK features was introduced. Following features are tested: * DPDK NIC Support * DPDK Hotplug Support * RX Checksum Support * Flow Control Support * Multiqueue Support * Vhost User * Virtual Devices Support * NUMA Support * Jumbo Frame Support * Rate Limiting * Quality of Service JIRA: VSPERF-539 Change-Id: I6c83e9c38e29f197a5236ac68c88d7045fef775b Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Signed-off-by: Martin Goldammer <martinx.goldammer@intel.com> Signed-off-by: Richard Elias <richardx.elias@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
Diffstat (limited to 'docs/testing/user/userguide/testlist.rst')
-rw-r--r--docs/testing/user/userguide/testlist.rst281
1 files changed, 281 insertions, 0 deletions
diff --git a/docs/testing/user/userguide/testlist.rst b/docs/testing/user/userguide/testlist.rst
index 4b535494..2b0e9d7f 100644
--- a/docs/testing/user/userguide/testlist.rst
+++ b/docs/testing/user/userguide/testlist.rst
@@ -107,3 +107,284 @@ List of integration testcases above can be obtained by execution of:
.. code-block:: bash
$ ./vsperf --integration --list
+
+OVS/DPDK Regression TestCases
+^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
+
+These regression tests verify several DPDK features used internally by Open vSwitch. Tests
+can be used for verification of performance and correct functionality of upcoming DPDK
+and OVS releases and release candidates.
+
+These tests are part of integration testcases and they must be executed with
+``--integration`` CLI parameter.
+
+Example of execution of all OVS/DPDK regression tests:
+
+.. code-block:: bash
+
+ $ ./vsperf --integration --tests ovsdpdk_
+
+Testcases are defined in the file ``conf/integration/01b_dpdk_regression_tests.conf``. This file
+contains a set of configuration options with prefix ``OVSDPDK_``. These parameters can be used
+for customization of regression tests and they will override some of standard VSPERF configuration
+options. It is recommended to check OVSDPDK configuration parameters and modify them in accordance
+with VSPERF configuration.
+
+At least following parameters should be examined. Their values shall ensure, that DPDK and
+QEMU threads are pinned to cpu cores of the same NUMA slot, where tested NICs are connected.
+
+.. code-block:: python
+
+ _OVSDPDK_1st_PMD_CORE
+ _OVSDPDK_2nd_PMD_CORE
+ _OVSDPDK_GUEST_5_CORES
+
+DPDK NIC Support
+++++++++++++++++
+
+A set of performance tests to verify support of DPDK accelerated network interface cards.
+Testcases use standard physical to physical network scenario with several vSwitch and
+traffic configurations, which includes one and two PMD threads, uni and bidirectional traffic
+and RFC2544 Continuous or RFC2544 Throughput with 0% packet loss traffic types.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_nic_p2p_single_pmd_unidir_cont P2P with single PMD in OVS and unidirectional traffic.
+ovsdpdk_nic_p2p_single_pmd_bidir_cont P2P with single PMD in OVS and bidirectional traffic.
+ovsdpdk_nic_p2p_two_pmd_bidir_cont P2P with two PMDs in OVS and bidirectional traffic.
+ovsdpdk_nic_p2p_single_pmd_unidir_tput P2P with single PMD in OVS and unidirectional traffic.
+ovsdpdk_nic_p2p_single_pmd_bidir_tput P2P with single PMD in OVS and bidirectional traffic.
+ovsdpdk_nic_p2p_two_pmd_bidir_tput P2P with two PMDs in OVS and bidirectional traffic.
+======================================== ======================================================================================
+
+DPDK Hotplug Support
+++++++++++++++++++++
+
+A set of functional tests to verify DPDK hotplug support. Tests verify, that it is possible
+to use port, which was not bound to DPDK driver during vSwitch startup. There is also
+a test which verifies a possibility to detach port from DPDK driver. However support
+for manual detachment of a port from DPDK has been removed from recent OVS versions and
+thus this testcase is expected to fail.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_hotplug_attach Ensure successful port-add after binding a device to igb_uio after
+ ovs-vswitchd is launched.
+ovsdpdk_hotplug_detach Same as ovsdpdk_hotplug_attach, but delete and detach the device
+ after the hotplug. Note Support of netdev-dpdk/detach has been
+ removed from OVS, so testcase will fail with recent OVS/DPDK
+ versions.
+======================================== ======================================================================================
+
+RX Checksum Support
++++++++++++++++++++
+
+A set of functional tests for verification of RX checksum calculation for tunneled traffic.
+Open vSwitch enables RX checksum offloading by default if NIC supports it. It is to note,
+that it is not possible to disable or enable RX checksum offloading. In order to verify
+correct RX checksum calculation in software, user has to execute these testcases
+at NIC without HW offloading capabilities.
+
+Testcases utilize existing overlay physical to physical (op2p) network deployment
+implemented in vsperf. This deployment expects, that traffic generator sends unidirectional
+tunneled traffic (e.g. vxlan) and Open vSwitch performs data decapsulation and sends them
+back to the traffic generator via second port.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_checksum_l3 Test verifies RX IP header checksum (offloading) validation for
+ tunneling protocols.
+ovsdpdk_checksum_l4 Test verifies RX UDP header checksum (offloading) validation for
+ tunneling protocols.
+======================================== ======================================================================================
+
+Flow Control Support
+++++++++++++++++++++
+
+A set of functional testcases for the validation of flow control support in Open vSwitch
+with DPDK support. If flow control is enabled in both OVS and Traffic Generator,
+the network endpoint (OVS or TGEN) is not able to process incoming data and
+thus it detects a RX buffer overflow. It then sends an ethernet pause frame (as defined at 802.3x)
+to the TX side. This mechanism will ensure, that the TX side will slow down traffic transmission
+and thus no data is lost at RX side.
+
+Introduced testcases use physical to physical scenario to forward data between
+traffic generator ports. It is expected that the processing of small frames in OVS is slower
+than line rate. It means that with flow control disabled, traffic generator will
+report a frame loss. On the other hand with flow control enabled, there should be 0%
+frame loss reported by traffic generator.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_flow_ctrl_rx Test the rx flow control functionality of DPDK PHY ports.
+ovsdpdk_flow_ctrl_rx_dynamic Change the rx flow control support at run time and ensure the system
+ honored the changes.
+======================================== ======================================================================================
+
+Multiqueue Support
+++++++++++++++++++
+
+A set of functional testcases for validation of multiqueue support for both physical
+and vHost User DPDK ports. Testcases utilize P2P and PVP network deployments and
+native support of multiqueue configuration available in VSPERF.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_mq_p2p_rxqs Setup rxqs on NIC port.
+ovsdpdk_mq_p2p_rxqs_same_core_affinity Affinitize rxqs to the same core.
+ovsdpdk_mq_p2p_rxqs_multi_core_affinity Affinitize rxqs to separate cores.
+ovsdpdk_mq_pvp_rxqs Setup rxqs on vhost user port.
+ovsdpdk_mq_pvp_rxqs_linux_bridge Confirm traffic received over vhost RXQs with Linux virtio device in
+ guest.
+ovsdpdk_mq_pvp_rxqs_testpmd Confirm traffic received over vhost RXQs with DPDK device in guest.
+======================================== ======================================================================================
+
+Vhost User
+++++++++++
+
+A set of functional testcases for validation of vHost User Client and vHost User
+Server modes in OVS.
+
+**NOTE:** Vhost User Server mode is deprecated and it will be removed from OVS
+in the future.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_vhostuser_client Test vhost-user client mode
+ovsdpdk_vhostuser_client_reconnect Test vhost-user client mode reconnect feature
+ovsdpdk_vhostuser_server Test vhost-user server mode
+ovsdpdk_vhostuser_sock_dir Verify functionality of vhost-sock-dir flag
+======================================== ======================================================================================
+
+Virtual Devices Support
++++++++++++++++++++++++
+
+A set of functional testcases for verification of correct functionality of virtual
+device PMD drivers.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_vdev_add_null_pmd Test addition of port using the null DPDK PMD driver.
+ovsdpdk_vdev_del_null_pmd Test deletion of port using the null DPDK PMD driver.
+ovsdpdk_vdev_add_af_packet_pmd Test addition of port using the af_packet DPDK PMD driver.
+ovsdpdk_vdev_del_af_packet_pmd Test deletion of port using the af_packet DPDK PMD driver.
+======================================== ======================================================================================
+
+NUMA Support
+++++++++++++
+
+A functional testcase for validation of NUMA awareness feature in OVS.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_numa Test vhost-user NUMA support. Vhostuser PMD threads should migrate to
+ the same numa slot, where QEMU is executed.
+======================================== ======================================================================================
+
+Jumbo Frame Support
++++++++++++++++++++
+
+A set of functional testcases for verification of jumbo frame support in OVS.
+Testcases utilize P2P and PVP network deployments and native support of jumbo
+frames available in VSPERF.
+
+============================================ ==================================================================================
+Testcase Name Description
+============================================ ==================================================================================
+ovsdpdk_jumbo_increase_mtu_phy_port_ovsdb Ensure that the increased MTU for a DPDK physical port is updated in
+ OVSDB.
+ovsdpdk_jumbo_increase_mtu_vport_ovsdb Ensure that the increased MTU for a DPDK vhost-user port is updated in
+ OVSDB.
+ovsdpdk_jumbo_reduce_mtu_phy_port_ovsdb Ensure that the reduced MTU for a DPDK physical port is updated in
+ OVSDB.
+ovsdpdk_jumbo_reduce_mtu_vport_ovsdb Ensure that the reduced MTU for a DPDK vhost-user port is updated in
+ OVSDB.
+ovsdpdk_jumbo_increase_mtu_phy_port_datapath Ensure that the MTU for a DPDK physical port is updated in the
+ datapath itself when increased to a valid value.
+ovsdpdk_jumbo_increase_mtu_vport_datapath Ensure that the MTU for a DPDK vhost-user port is updated in the
+ datapath itself when increased to a valid value.
+ovsdpdk_jumbo_reduce_mtu_phy_port_datapath
+ Ensure that the MTU for a DPDK physical port is updated in the
+ datapath itself when decreased to a valid value.
+ovsdpdk_jumbo_reduce_mtu_vport_datapath Ensure that the MTU for a DPDK vhost-user port is updated in the
+ datapath itself when decreased to a valid value.
+ovsdpdk_jumbo_mtu_upper_bound_phy_port Verify that the upper bound limit is enforced for OvS DPDK Phy ports.
+ovsdpdk_jumbo_mtu_upper_bound_vport Verify that the upper bound limit is enforced for OvS DPDK vhost-user
+ ports.
+ovsdpdk_jumbo_mtu_lower_bound_phy_port Verify that the lower bound limit is enforced for OvS DPDK Phy ports.
+ovsdpdk_jumbo_mtu_lower_bound_vport Verify that the lower bound limit is enforced for OvS DPDK vhost-user
+ ports.
+ovsdpdk_jumbo_p2p Ensure that jumbo frames are received, processed and forwarded
+ correctly by DPDK physical ports.
+ovsdpdk_jumbo_pvp Ensure that jumbo frames are received, processed and forwarded
+ correctly by DPDK vhost-user ports.
+ovsdpdk_jumbo_p2p_upper_bound Ensure that jumbo frames above the configured Rx port's MTU are not
+ accepted
+============================================ ==================================================================================
+
+Rate Limiting
++++++++++++++
+
+A set of functional testcases for validation of rate limiting support. This feature
+allows to configure an ingress policing for both physical and vHost User DPDK
+ports.
+
+**NOTE:** Desired maximum rate is specified in kilo bits per second and it defines
+the rate of payload only.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_rate_create_phy_port Ensure a rate limiting interface can be created on a physical DPDK
+ port.
+ovsdpdk_rate_delete_phy_port Ensure a rate limiting interface can be destroyed on a physical DPDK
+ port.
+ovsdpdk_rate_create_vport Ensure a rate limiting interface can be created on a vhost-user port.
+ovsdpdk_rate_delete_vport Ensure a rate limiting interface can be destroyed on a vhost-user
+ port.
+ovsdpdk_rate_no_policing Ensure when a user attempts to create a rate limiting interface but
+ is missing policing rate argument, no rate limitiner is created.
+ovsdpdk_rate_no_burst Ensure when a user attempts to create a rate limiting interface but
+ is missing policing burst argument, rate limitiner is created.
+ovsdpdk_rate_p2p Ensure when a user creates a rate limiting physical interface that
+ the traffic is limited to the specified policer rate in a p2p setup.
+ovsdpdk_rate_pvp Ensure when a user creates a rate limiting vHost User interface that
+ the traffic is limited to the specified policer rate in a pvp setup.
+ovsdpdk_rate_p2p_multi_pkt_sizes Ensure that rate limiting works for various frame sizes.
+======================================== ======================================================================================
+
+Quality of Service
+++++++++++++++++++
+
+A set of functional testcases for validation of QoS support. This feature
+allows to configure an egress policing for both physical and vHost User DPDK
+ports.
+
+**NOTE:** Desired maximum rate is specified in bytes per second and it defines
+the rate of payload only.
+
+======================================== ======================================================================================
+Testcase Name Description
+======================================== ======================================================================================
+ovsdpdk_qos_create_phy_port Ensure a QoS policy can be created on a physical DPDK port
+ovsdpdk_qos_delete_phy_port Ensure an existing QoS policy can be destroyed on a physical DPDK
+ port.
+ovsdpdk_qos_create_vport Ensure a QoS policy can be created on a virtual vhost user port.
+ovsdpdk_qos_delete_vport Ensure an existing QoS policy can be destroyed on a vhost user port.
+ovsdpdk_qos_create_no_cir Ensure that a QoS policy cannot be created if the egress policer cir
+ argument is missing.
+ovsdpdk_qos_create_no_cbs Ensure that a QoS policy cannot be created if the egress policer cbs
+ argument is missing.
+ovsdpdk_qos_p2p In a p2p setup, ensure when a QoS egress policer is created that the
+ traffic is limited to the specified rate.
+ovsdpdk_qos_pvp In a pvp setup, ensure when a QoS egress policer is created that the
+ traffic is limited to the specified rate.
+======================================== ======================================================================================