From d455f3b56c866b0e61394a01f0a07e05831f3044 Mon Sep 17 00:00:00 2001
From: Ross Brattain <ross.b.brattain@intel.com>
Date: Mon, 31 Jul 2017 20:10:20 -0700
Subject: DRAFT: remove apexlake

apexlake is unmaintained, so remove it

From some reason orchestrator/heat.py started failing
so fixup those unittests

Change-Id: Ie06508b5ab7c9dcf9fdfca83e173a188a894d564
Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
---
 docs/testing/user/userguide/01-introduction.rst    |   8 -
 .../user/userguide/11-apexlake_installation.rst    | 302 ---------------------
 docs/testing/user/userguide/12-apexlake_api.rst    |  89 ------
 docs/testing/user/userguide/comp-intro.rst         |   3 -
 docs/testing/user/userguide/index.rst              |   2 -
 .../user/userguide/opnfv_yardstick_tc006.rst       | 144 ----------
 .../user/userguide/opnfv_yardstick_tc007.rst       | 162 -----------
 .../user/userguide/opnfv_yardstick_tc020.rst       | 141 ----------
 .../user/userguide/opnfv_yardstick_tc021.rst       | 157 -----------
 9 files changed, 1008 deletions(-)
 delete mode 100644 docs/testing/user/userguide/11-apexlake_installation.rst
 delete mode 100644 docs/testing/user/userguide/12-apexlake_api.rst
 delete mode 100644 docs/testing/user/userguide/opnfv_yardstick_tc006.rst
 delete mode 100644 docs/testing/user/userguide/opnfv_yardstick_tc007.rst
 delete mode 100644 docs/testing/user/userguide/opnfv_yardstick_tc020.rst
 delete mode 100644 docs/testing/user/userguide/opnfv_yardstick_tc021.rst

(limited to 'docs/testing')

diff --git a/docs/testing/user/userguide/01-introduction.rst b/docs/testing/user/userguide/01-introduction.rst
index 63d0d9883..c1d5def98 100755
--- a/docs/testing/user/userguide/01-introduction.rst
+++ b/docs/testing/user/userguide/01-introduction.rst
@@ -21,8 +21,6 @@ of a Virtual Network Function (:term:`VNF`).
 The Project's scope is the development of a test framework, *Yardstick*, test
 cases and test stimuli to enable Network Function Virtualization Infrastructure
 (:term:`NFVI`) verification.
-The Project also includes a sample :term:`VNF`, the Virtual Traffic Classifier
-(:term:`VTC`)  and its experimental framework, *ApexLake* !
 
 *Yardstick* is used in OPNFV for verifying the OPNFV infrastructure and some of
 the OPNFV features. The *Yardstick* framework is deployed in several OPNFV
@@ -67,12 +65,6 @@ This document consists of the following chapters:
 
 * Chapter :doc:`10-vtc-overview` provides information on the :term:`VTC`.
 
-* Chapter :doc:`11-apexlake_installation` provides instructions to install the
-  experimental framework *ApexLake*
-
-* Chapter :doc:`12-apexlake_api` explains how this framework is integrated in
-  *Yardstick*.
-
 * Chapter :doc:`13-nsb-overview` describes the methodology implemented by the
   Yardstick - Network service benchmarking to test real world usecase for a
   given VNF.
diff --git a/docs/testing/user/userguide/11-apexlake_installation.rst b/docs/testing/user/userguide/11-apexlake_installation.rst
deleted file mode 100644
index 0d8ef143f..000000000
--- a/docs/testing/user/userguide/11-apexlake_installation.rst
+++ /dev/null
@@ -1,302 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Intel Corporation and others.
-
-
-.. _DPDK: http://dpdk.org/doc/nics
-.. _DPDK-pktgen: https://github.com/Pktgen/Pktgen-DPDK/
-.. _SRIOV: https://wiki.openstack.org/wiki/SR-IOV-Passthrough-For-Networking
-.. _PORTSEC: https://wiki.openstack.org/wiki/Neutron/ML2PortSecurityExtensionDriver
-.. _here: https://wiki.opnfv.org/vtc
-
-
-============================
-Apexlake Installation Guide
-============================
-
-Abstract
---------
-
-ApexLake is a framework that provides automatic execution of experiments and
-related data collection to enable a user validate infrastructure from the
-perspective of a Virtual Network Function (:term:`VNF`).
-
-In the context of Yardstick, a virtual Traffic Classifier (:term:`VTC`) network
-function is utilized.
-
-
-Framework Hardware Dependencies
-===============================
-
-In order to run the framework there are some hardware related dependencies for
-ApexLake.
-
-The framework needs to be installed on the same physical node where DPDK-pktgen_
-is installed.
-
-The installation requires the physical node hosting the packet generator must
-have 2 NICs which are DPDK_ compatible.
-
-The 2 NICs will be connected to the switch where the OpenStack VM
-network is managed.
-
-The switch used must support multicast traffic and :term:`IGMP` snooping.
-Further details about the configuration are provided at the following here_.
-
-The corresponding ports to which the cables are connected need to be configured
-as VLAN trunks using two of the VLAN IDs available for Neutron.
-Note the VLAN IDs used as they will be required in later configuration steps.
-
-
-Framework Software Dependencies
-===============================
-Before starting the framework, a number of dependencies must first be installed.
-The following describes the set of instructions to be executed via the Linux
-shell in order to install and configure the required dependencies.
-
-1. Install Dependencies.
-
-To support the framework dependencies the following packages must be installed.
-The example provided is based on Ubuntu and needs to be executed in root mode.
-
-::
-
-    apt-get install python-dev
-    apt-get install python-pip
-    apt-get install python-mock
-    apt-get install tcpreplay
-    apt-get install libpcap-dev
-
-2. Source OpenStack openrc file.
-
-::
-
-    source openrc
-
-3. Configure Openstack Neutron
-
-In order to support traffic generation and management by the virtual
-Traffic Classifier, the configuration of the port security driver
-extension is required for Neutron.
-
-For further details please follow the following link: PORTSEC_
-This step can be skipped in case the target OpenStack is Juno or Kilo release,
-but it is required to support Liberty.
-It is therefore required to indicate the release version in the configuration
-file located in ./yardstick/vTC/apexlake/apexlake.conf
-
-
-4. Create Two Networks based on VLANs in Neutron.
-
-To enable network communications between the packet generator and the compute
-node, two networks must be created via Neutron and mapped to the VLAN IDs
-that were previously used in the configuration of the physical switch.
-The following shows the typical set of commands required to configure Neutron
-correctly.
-The physical switches need to be configured accordingly.
-
-::
-
-    VLAN_1=2032
-    VLAN_2=2033
-    PHYSNET=physnet2
-    neutron net-create apexlake_inbound_network \
-            --provider:network_type vlan \
-            --provider:segmentation_id $VLAN_1 \
-            --provider:physical_network $PHYSNET
-
-    neutron subnet-create apexlake_inbound_network \
-            192.168.0.0/24 --name apexlake_inbound_subnet
-
-    neutron net-create apexlake_outbound_network \
-            --provider:network_type vlan \
-            --provider:segmentation_id $VLAN_2 \
-            --provider:physical_network $PHYSNET
-
-    neutron subnet-create apexlake_outbound_network 192.168.1.0/24 \
-            --name apexlake_outbound_subnet
-
-
-5. Download Ubuntu Cloud Image and load it on Glance
-
-The virtual Traffic Classifier is supported on top of Ubuntu 14.04 cloud image.
-The image can be downloaded on the local machine and loaded on Glance
-using the following commands:
-
-::
-
-    wget cloud-images.ubuntu.com/trusty/current/trusty-server-cloudimg-amd64-disk1.img
-    glance image-create \
-            --name ubuntu1404 \
-            --is-public true \
-            --disk-format qcow \
-            --container-format bare \
-            --file trusty-server-cloudimg-amd64-disk1.img
-
-
-
-6. Configure the Test Cases
-
-The VLAN tags must also be included in the test case Yardstick yaml file
-as parameters for the following test cases:
-
-    * :doc:`opnfv_yardstick_tc006`
-
-    * :doc:`opnfv_yardstick_tc007`
-
-    * :doc:`opnfv_yardstick_tc020`
-
-    * :doc:`opnfv_yardstick_tc021`
-
-
-Install and Configure DPDK Pktgen
-+++++++++++++++++++++++++++++++++
-
-Execution of the framework is based on DPDK Pktgen.
-If DPDK Pktgen has not installed, it is necessary to download, install, compile
-and configure it.
-The user can create a directory and download the dpdk packet generator source
-code:
-
-::
-
-    cd experimental_framework/libraries
-    mkdir dpdk_pktgen
-    git clone https://github.com/pktgen/Pktgen-DPDK.git
-
-For instructions on the installation and configuration of DPDK and DPDK Pktgen
-please follow the official DPDK Pktgen README file.
-Once the installation is completed, it is necessary to load the DPDK kernel
-driver, as follow:
-
-::
-
-    insmod uio
-    insmod DPDK_DIR/x86_64-native-linuxapp-gcc/kmod/igb_uio.ko
-
-It is necessary to set the configuration file  to support the desired Pktgen
-configuration.
-A description of the required configuration parameters and supporting examples
-is provided in the following:
-
-::
-
-    [PacketGen]
-    packet_generator = dpdk_pktgen
-
-    # This is the directory where the packet generator is installed
-    # (if the user previously installed dpdk-pktgen,
-    # it is required to provide the director where it is installed).
-    pktgen_directory = /home/user/software/dpdk_pktgen/dpdk/examples/pktgen/
-
-    # This is the directory where DPDK is installed
-    dpdk_directory = /home/user/apexlake/experimental_framework/libraries/Pktgen-DPDK/dpdk/
-
-    # Name of the dpdk-pktgen program that starts the packet generator
-    program_name = app/app/x86_64-native-linuxapp-gcc/pktgen
-
-    # DPDK coremask (see DPDK-Pktgen readme)
-    coremask = 1f
-
-    # DPDK memory channels (see DPDK-Pktgen readme)
-    memory_channels = 3
-
-    # Name of the interface of the pktgen to be used to send traffic (vlan_sender)
-    name_if_1 = p1p1
-
-    # Name of the interface of the pktgen to be used to receive traffic (vlan_receiver)
-    name_if_2 = p1p2
-
-    # PCI bus address correspondent to if_1
-    bus_slot_nic_1 = 01:00.0
-
-    # PCI bus address correspondent to if_2
-    bus_slot_nic_2 = 01:00.1
-
-
-To find the parameters related to names of the NICs and the addresses of the PCI buses
-the user may find it useful to run the :term:`DPDK` tool nic_bind as follows:
-
-::
-
-    DPDK_DIR/tools/dpdk_nic_bind.py --status
-
-Lists the NICs available on the system, and shows the available drivers and bus addresses for each interface.
-Please make sure to select NICs which are :term:`DPDK` compatible.
-
-Installation and Configuration of smcroute
-++++++++++++++++++++++++++++++++++++++++++
-
-The user is required to install smcroute which is used by the framework to
-support multicast communications.
-
-The following is the list of commands required to download and install smroute.
-
-::
-
-    cd ~
-    git clone https://github.com/troglobit/smcroute.git
-    cd smcroute
-    git reset --hard c3f5c56
-    sed -i 's/aclocal-1.11/aclocal/g' ./autogen.sh
-    sed -i 's/automake-1.11/automake/g' ./autogen.sh
-    ./autogen.sh
-    ./configure
-    make
-    sudo make install
-    cd ..
-
-It is required to do the reset to the specified commit ID.
-It is also requires the creation a configuration file using the following
-command:
-
-::
-
-    SMCROUTE_NIC=(name of the nic)
-
-where name of the nic is the name used previously for the variable "name_if_2".
-For example:
-
-::
-
-    SMCROUTE_NIC=p1p2
-
-Then create the smcroute configuration file /etc/smcroute.conf
-
-::
-
-    echo mgroup from $SMCROUTE_NIC group 224.192.16.1 > /etc/smcroute.conf
-
-
-At the end of this procedure it will be necessary to perform the following
-actions to add the user to the sudoers:
-
-::
-
-    adduser USERNAME sudo
-    echo "user ALL=(ALL) NOPASSWD: ALL" >> /etc/sudoers
-
-
-Experiment using SR-IOV Configuration on the Compute Node
-+++++++++++++++++++++++++++++++++++++++++++++++++++++++++
-
-To enable :term:`SR-IOV` interfaces on the physical NIC of the compute node, a
-compatible NIC is required.
-NIC configuration depends on model and vendor. After proper configuration to
-support :term:`SR-IOV`, a proper configuration of OpenStack is required.
-For further information, please refer to the SRIOV_ configuration guide
-
-Finalize installation the framework on the system
-=================================================
-
-The installation of the framework on the system requires the setup of the project.
-After entering into the apexlake directory, it is sufficient to run the following
-command.
-
-::
-
-    python setup.py install
-
-Since some elements are copied into the /tmp directory (see configuration file)
-it could be necessary to repeat this step after a reboot of the host.
diff --git a/docs/testing/user/userguide/12-apexlake_api.rst b/docs/testing/user/userguide/12-apexlake_api.rst
deleted file mode 100644
index 35a1dbe3e..000000000
--- a/docs/testing/user/userguide/12-apexlake_api.rst
+++ /dev/null
@@ -1,89 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Intel Corporation and others.
-
-
-=================================
-Apexlake API Interface Definition
-=================================
-
-Abstract
---------
-
-The API interface provided by the framework to enable the execution of test
-cases is defined as follows.
-
-
-init
-----
-
-**static init()**
-
-    Initializes the Framework
-
-    **Returns** None
-
-
-execute_framework
------------------
-
-**static execute_framework** (test_cases,
-
-                                iterations,
-
-                                heat_template,
-
-                                heat_template_parameters,
-
-                                deployment_configuration,
-
-                                openstack_credentials)
-
-    Executes the framework according the specified inputs
-
-    **Parameters**
-
-        - **test_cases**
-
-            Test cases to be run with the workload (dict() of dict())
-
-            Example:
-                test_case = dict()
-
-                test_case[’name’] = ‘module.Class’
-
-                test_case[’params’] = dict()
-
-                test_case[’params’][’throughput’] = ‘1’
-
-                test_case[’params’][’vlan_sender’] = ‘1000’
-
-                test_case[’params’][’vlan_receiver’] = ‘1001’
-
-                test_cases = [test_case]
-
-        - **iterations**
-            Number of test cycles to be executed (int)
-
-        - **heat_template**
-            (string) File name of the heat template corresponding to the workload to be deployed.
-            It contains the parameters to be evaluated in the form of #parameter_name.
-            (See heat_templates/vTC.yaml as example).
-
-        - **heat_template_parameters**
-            (dict) Parameters to be provided as input to the
-            heat template. See http://docs.openstack.org/developer/heat/ template_guide/hot_guide.html
-            section “Template input parameters” for further info.
-
-        - **deployment_configuration**
-            ( dict[string] = list(strings) ) ) Dictionary of parameters
-            representing the deployment configuration of the workload.
-
-            The key is a string corresponding to the name of the parameter,
-            the value is a list of strings representing the value to be
-            assumed by a specific param. The parameters are user defined:
-            they have to correspond to the place holders (#parameter_name)
-            specified in the heat template.
-
-        **Returns** dict() containing results
diff --git a/docs/testing/user/userguide/comp-intro.rst b/docs/testing/user/userguide/comp-intro.rst
index ee68226ad..ad354b66d 100644
--- a/docs/testing/user/userguide/comp-intro.rst
+++ b/docs/testing/user/userguide/comp-intro.rst
@@ -24,9 +24,6 @@ metrics in the document ETSI GS NFV-TST001_, "Pre-deployment Testing; Report on
 Validation of NFV Environments and Services" are available; further OPNFV
 releases will provide extended testing of these metrics.
 
-The Project also includes a sample VNF, the Virtual Traffic Classifier (VTC)
-and its experimental framework, *ApexLake*.
-
 *Yardstick* is used in OPNFV for verifying the OPNFV infrastructure and some of
 the OPNFV features. The *Yardstick* framework is deployed in several OPNFV
 community labs. It is *installer*, *infrastructure* and *application*
diff --git a/docs/testing/user/userguide/index.rst b/docs/testing/user/userguide/index.rst
index 8ac1c7bdb..3b55b7f9b 100644
--- a/docs/testing/user/userguide/index.rst
+++ b/docs/testing/user/userguide/index.rst
@@ -23,8 +23,6 @@ Performance Testing User Guide (Yardstick)
    08-api
    09-yardstick_user_interface
    10-vtc-overview
-   11-apexlake_installation
-   12-apexlake_api
    13-nsb-overview
    14-nsb_installation
    15-list-of-tcs
diff --git a/docs/testing/user/userguide/opnfv_yardstick_tc006.rst b/docs/testing/user/userguide/opnfv_yardstick_tc006.rst
deleted file mode 100644
index 2ccb417c1..000000000
--- a/docs/testing/user/userguide/opnfv_yardstick_tc006.rst
+++ /dev/null
@@ -1,144 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Intel Corporation and others.
-
-*************************************
-Yardstick Test Case Description TC006
-*************************************
-
-.. _DPDKpktgen: https://github.com/Pktgen/Pktgen-DPDK/
-.. _rfc2544: https://www.ietf.org/rfc/rfc2544.txt
-
-+-----------------------------------------------------------------------------+
-|Network Performance                                                          |
-|                                                                             |
-+--------------+--------------------------------------------------------------+
-|test case id  | OPNFV_YARDSTICK_TC006_Virtual Traffic Classifier Data Plane  |
-|              | Throughput Benchmarking Test.                                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|metric        | Throughput                                                   |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test purpose  | To measure the throughput supported by the virtual Traffic   |
-|              | Classifier according to the RFC2544 methodology for a        |
-|              | user-defined set of vTC deployment configurations.           |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|configuration | file: file: opnfv_yardstick_tc006.yaml                       |
-|              |                                                              |
-|              | packet_size: size of the packets to be used during the       |
-|              |      throughput calculation.                                 |
-|              |      Allowe values: [64, 128, 256, 512, 1024, 1280, 1518]    |
-|              |                                                              |
-|              | vnic_type: type of VNIC to be used.                          |
-|              |      Allowed values are:                                     |
-|              |           - normal: for default OvS port configuration       |
-|              |           - direct: for SR-IOV port configuration            |
-|              |      Default value: None                                     |
-|              |                                                              |
-|              | vtc_flavor: OpenStack flavor to be used for the vTC          |
-|              |      Default available values are: m1.small, m1.medium,      |
-|              |      and m1.large, but the user can create his/her own       |
-|              |      flavor and give it as input                             |
-|              |      Default value: None                                     |
-|              |                                                              |
-|              | vlan_sender: vlan tag of the network on which the vTC will   |
-|              |      receive traffic (VLAN Network 1).                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | vlan_receiver: vlan tag of the network on which the vTC      |
-|              |      will send traffic back to the packet generator          |
-|              |      (VLAN Network 2).                                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | default_net_name: neutron name of the defaul network that    |
-|              |      is used for access to the internet from the vTC         |
-|              |      (vNIC 1).                                               |
-|              |                                                              |
-|              | default_subnet_name: subnet name for vNIC1                   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_1_name: Neutron Name for VLAN Network 1             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_1_name: Subnet Neutron name for VLAN Network 1   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_2_name: Neutron Name for VLAN Network 2             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_2_name: Subnet Neutron name for VLAN Network 2   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test tool     | DPDK pktgen                                                  |
-|              |                                                              |
-|              | DPDK Pktgen is not part of a Linux distribution,             |
-|              | hence it needs to be installed by the user.                  |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|references    | DPDK Pktgen: DPDKpktgen_                                     |
-|              |                                                              |
-|              | ETSI-NFV-TST001                                              |
-|              |                                                              |
-|              | RFC 2544: rfc2544_                                           |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|applicability | Test can be configured with different flavors, vNIC type     |
-|              | and packet sizes. Default values exist as specified above.   |
-|              | The vNIC type and flavor MUST be specified by the user.      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|pre-test      | The vTC has been successfully instantiated and configured.   |
-|              | The user has correctly assigned the values to the deployment |
-|              |  configuration parameters.                                   |
-|              |                                                              |
-|              | - Multicast traffic MUST be enabled on the network.          |
-|              |      The Data network switches need to be configured in      |
-|              |      order to manage multicast traffic.                      |
-|              | - In the case of SR-IOV vNICs use, SR-IOV compatible NICs    |
-|              |      must be used on the compute node.                       |
-|              | - Yarsdtick needs to be installed on a host connected to the |
-|              |      data network and the host must have 2 DPDK-compatible   |
-|              |      NICs. Proper configuration of DPDK and DPDK pktgen is   |
-|              |      required before to run the test case.                   |
-|              |      (For further instructions please refer to the ApexLake  |
-|              |      documentation).                                         |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test sequence | Description and expected results                             |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step  1       | The vTC is deployed, according to the user-defined           |
-|              | configuration                                                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step  2       | The vTC is correctly deployed and configured as necessary    |
-|              | The initialization script has been correctly executed and    |
-|              | vTC is ready to receive and process the traffic.             |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step  3       | Test case is executed with the selected parameters:          |
-|              | - vTC flavor                                                 |
-|              | - vNIC type                                                  |
-|              | - packet size                                                |
-|              | The traffic is sent to the vTC using the maximum available   |
-|              | traffic rate for 60 seconds.                                 |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 4        | The vTC instance forwards all the packets back to the packet |
-|              | generator for 60 seconds, as specified by RFC 2544.          |
-|              |                                                              |
-|              | Steps 3 and 4 are executed different times, with different   |
-|              | rates in order to find the maximum supported traffic rate    |
-|              | according to the current definition of throughput in RFC     |
-|              | 2544.                                                        |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test verdict  |  The result of the test is a number between 0 and 100 which  |
-|              |  represents the throughput in terms of percentage of the     |
-|              |  available pktgen NIC bandwidth.                             |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
diff --git a/docs/testing/user/userguide/opnfv_yardstick_tc007.rst b/docs/testing/user/userguide/opnfv_yardstick_tc007.rst
deleted file mode 100644
index 87663f816..000000000
--- a/docs/testing/user/userguide/opnfv_yardstick_tc007.rst
+++ /dev/null
@@ -1,162 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Intel Corporation and others.
-
-*************************************
-Yardstick Test Case Description TC007
-*************************************
-
-.. _DPDKpktgen: https://github.com/Pktgen/Pktgen-DPDK/
-.. _rfc2544: https://www.ietf.org/rfc/rfc2544.txt
-
-+-----------------------------------------------------------------------------+
-|Network Performance                                                          |
-|                                                                             |
-+--------------+--------------------------------------------------------------+
-|test case id  | OPNFV_YARDSTICK_TC007_Virtual Traffic Classifier Data Plane  |
-|              |  Throughput Benchmarking Test in Presence of Noisy           |
-|              |  neighbours                                                  |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|metric        | Throughput                                                   |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test purpose  | To measure the throughput supported by the virtual Traffic   |
-|              | Classifier according to the RFC2544 methodology for a        |
-|              | user-defined set of vTC deployment configurations in the     |
-|              | presence of noisy neighbours.                                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|configuration | file: opnfv_yardstick_tc007.yaml                             |
-|              |                                                              |
-|              | packet_size: size of the packets to be used during the       |
-|              |      throughput calculation.                                 |
-|              |      Allowe values: [64, 128, 256, 512, 1024, 1280, 1518]    |
-|              |                                                              |
-|              | vnic_type: type of VNIC to be used.                          |
-|              |      Allowed values are:                                     |
-|              |           - normal: for default OvS port configuration       |
-|              |           - direct: for SR-IOV port configuration            |
-|              |                                                              |
-|              | vtc_flavor: OpenStack flavor to be used for the vTC          |
-|              |     Default available values are: m1.small, m1.medium,       |
-|              |     and m1.large, but the user can create his/her own        |
-|              |     flavor and give it as input                              |
-|              |                                                              |
-|              | num_of_neighbours: Number of noisy neighbours (VMs) to be    |
-|              |     instantiated during the experiment.                      |
-|              |     Allowed values: range (1, 10)                            |
-|              |                                                              |
-|              | amount_of_ram: RAM to be used by each neighbor.              |
-|              |     Allowed values: ['250M', '1G', '2G', '3G', '4G', '5G',   |
-|              |                      '6G', '7G', '8G', '9G', '10G']          |
-|              |     Deault value: 256M                                       |
-|              |                                                              |
-|              | number_of_cores: Number of noisy neighbours (VMs) to be      |
-|              |     instantiated during the experiment.                      |
-|              |     Allowed values: range (1, 10)                            |
-|              |     Default value: 1                                         |
-|              |                                                              |
-|              | vlan_sender: vlan tag of the network on which the vTC will   |
-|              |      receive traffic (VLAN Network 1).                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | vlan_receiver: vlan tag of the network on which the vTC      |
-|              |      will send traffic back to the packet generator          |
-|              |      (VLAN Network 2).                                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | default_net_name: neutron name of the defaul network that    |
-|              |      is used for access to the internet from the vTC         |
-|              |      (vNIC 1).                                               |
-|              |                                                              |
-|              | default_subnet_name: subnet name for vNIC1                   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_1_name: Neutron Name for VLAN Network 1             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_1_name: Subnet Neutron name for VLAN Network 1   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_2_name: Neutron Name for VLAN Network 2             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_2_name: Subnet Neutron name for VLAN Network 2   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test tool     | DPDK pktgen                                                  |
-|              |                                                              |
-|              | DPDK Pktgen is not part of a Linux distribution,             |
-|              | hence it needs to be installed by the user.                  |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|references    | DPDKpktgen_                                                  |
-|              |                                                              |
-|              | ETSI-NFV-TST001                                              |
-|              |                                                              |
-|              | rfc2544_                                                     |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|applicability | Test can be configured with different flavors, vNIC type     |
-|              | and packet sizes. Default values exist as specified above.   |
-|              | The vNIC type and flavor MUST be specified by the user.      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|pre-test      | The vTC has been successfully instantiated and configured.   |
-|              | The user has correctly assigned the values to the deployment |
-|              |  configuration parameters.                                   |
-|              |                                                              |
-|              | - Multicast traffic MUST be enabled on the network.          |
-|              |      The Data network switches need to be configured in      |
-|              |      order to manage multicast traffic.                      |
-|              | - In the case of SR-IOV vNICs use, SR-IOV compatible NICs    |
-|              |      must be used on the compute node.                       |
-|              | - Yarsdtick needs to be installed on a host connected to the |
-|              |      data network and the host must have 2 DPDK-compatible   |
-|              |      NICs. Proper configuration of DPDK and DPDK pktgen is   |
-|              |      required before to run the test case.                   |
-|              |      (For further instructions please refer to the ApexLake  |
-|              |      documentation).                                         |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test sequence | Description and expected results                             |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 1        | The noisy neighbours are deployed as required by the user.   |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 2        | The vTC is deployed, according to the configuration required |
-|              | by the user                                                  |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 3        | The vTC is correctly deployed and configured as necessary.   |
-|              | The initialization script has been correctly executed and    |
-|              | the vTC is ready to receive and process the traffic.         |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 4        | Test case is executed with the parameters specified by the   |
-|              | user:                                                        |
-|              |  - vTC flavor                                                |
-|              |  - vNIC type                                                 |
-|              |  - packet size                                               |
-|              | The traffic is sent to the vTC using the maximum available   |
-|              |  traffic rate                                                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 5        | The vTC instance forwards all the packets back to the        |
-|              | packet generator for 60 seconds, as specified by RFC 2544.   |
-|              |                                                              |
-|              | Steps 4 and 5 are executed different times with different    |
-|              | with different traffic rates, in order to find the maximum   |
-|              | supported traffic rate, accoring to the current definition   |
-|              | of throughput in RFC 2544.                                   |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test verdict  |  The result of the test is a number between 0 and 100 which  |
-|              |  represents the throughput in terms of percentage of the     |
-|              |  available pktgen NIC bandwidth.                             |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
diff --git a/docs/testing/user/userguide/opnfv_yardstick_tc020.rst b/docs/testing/user/userguide/opnfv_yardstick_tc020.rst
deleted file mode 100644
index f2f1d408b..000000000
--- a/docs/testing/user/userguide/opnfv_yardstick_tc020.rst
+++ /dev/null
@@ -1,141 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Intel Corporation and others.
-
-*************************************
-Yardstick Test Case Description TC020
-*************************************
-
-.. _DPDKpktgen: https://github.com/Pktgen/Pktgen-DPDK/
-.. _rfc2544: https://www.ietf.org/rfc/rfc2544.txt
-
-+-----------------------------------------------------------------------------+
-|Network Performance                                                          |
-|                                                                             |
-+--------------+--------------------------------------------------------------+
-|test case id  | OPNFV_YARDSTICK_TC0020_Virtual Traffic Classifier            |
-|              | Instantiation Test                                           |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|metric        | Failure                                                      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test purpose  | To verify that a newly instantiated vTC is 'alive' and       |
-|              | functional and its instantiation is correctly supported by   |
-|              | the infrastructure.                                          |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|configuration | file: opnfv_yardstick_tc020.yaml                             |
-|              |                                                              |
-|              | vnic_type: type of VNIC to be used.                          |
-|              |      Allowed values are:                                     |
-|              |           - normal: for default OvS port configuration       |
-|              |           - direct: for SR-IOV port configuration            |
-|              |      Default value: None                                     |
-|              |                                                              |
-|              | vtc_flavor: OpenStack flavor to be used for the vTC          |
-|              |      Default available values are: m1.small, m1.medium,      |
-|              |      and m1.large, but the user can create his/her own       |
-|              |      flavor and give it as input                             |
-|              |      Default value: None                                     |
-|              |                                                              |
-|              | vlan_sender: vlan tag of the network on which the vTC will   |
-|              |      receive traffic (VLAN Network 1).                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | vlan_receiver: vlan tag of the network on which the vTC      |
-|              |      will send traffic back to the packet generator          |
-|              |      (VLAN Network 2).                                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | default_net_name: neutron name of the defaul network that    |
-|              |      is used for access to the internet from the vTC         |
-|              |      (vNIC 1).                                               |
-|              |                                                              |
-|              | default_subnet_name: subnet name for vNIC1                   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_1_name: Neutron Name for VLAN Network 1             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_1_name: Subnet Neutron name for VLAN Network 1   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_2_name: Neutron Name for VLAN Network 2             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_2_name: Subnet Neutron name for VLAN Network 2   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test tool     | DPDK pktgen                                                  |
-|              |                                                              |
-|              | DPDK Pktgen is not part of a Linux distribution,             |
-|              | hence it needs to be installed by the user.                  |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|references    | DPDKpktgen_                                                  |
-|              |                                                              |
-|              | ETSI-NFV-TST001                                              |
-|              |                                                              |
-|              | rfc2544_                                                     |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|applicability | Test can be configured with different flavors, vNIC type     |
-|              | and packet sizes. Default values exist as specified above.   |
-|              | The vNIC type and flavor MUST be specified by the user.      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|pre-test      | The vTC has been successfully instantiated and configured.   |
-|              | The user has correctly assigned the values to the deployment |
-|              |  configuration parameters.                                   |
-|              |                                                              |
-|              | - Multicast traffic MUST be enabled on the network.          |
-|              |      The Data network switches need to be configured in      |
-|              |      order to manage multicast traffic.                      |
-|              |      Installation and configuration of smcroute is required  |
-|              |      before to run the test case.                            |
-|              |      (For further instructions please refer to the ApexLake  |
-|              |      documentation).                                         |
-|              | - In the case of SR-IOV vNICs use, SR-IOV compatible NICs    |
-|              |      must be used on the compute node.                       |
-|              | - Yarsdtick needs to be installed on a host connected to the |
-|              |      data network and the host must have 2 DPDK-compatible   |
-|              |      NICs. Proper configuration of DPDK and DPDK pktgen is   |
-|              |      required before to run the test case.                   |
-|              |      (For further instructions please refer to the ApexLake  |
-|              |      documentation).                                         |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test sequence | Description and expected results                             |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 1        | The vTC is deployed, according to the configuration provided |
-|              | by the user.                                                 |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 2        | The vTC is correctly deployed and configured as necessary.   |
-|              | The initialization script has been correctly executed and    |
-|              | the vTC is ready to receive and process the traffic.         |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 3        | Test case is executed with the parameters specified by the   |
-|              | the user:                                                    |
-|              | - vTC flavor                                                 |
-|              | - vNIC type                                                  |
-|              | A constant rate traffic is sent to the vTC for 10 seconds.   |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 4        | The vTC instance tags all the packets and sends them back to |
-|              | the packet generator for 10 seconds.                         |
-|              |                                                              |
-|              | The framework checks that the packet generator receives      |
-|              | back all the packets with the correct tag from the vTC.      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test verdict  |  The vTC is deemed to be successfully instantiated if all    |
-|              |  packets are sent back with the right tag as requested,      |
-|              |  else it is deemed DoA (Dead on arrival)                     |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
diff --git a/docs/testing/user/userguide/opnfv_yardstick_tc021.rst b/docs/testing/user/userguide/opnfv_yardstick_tc021.rst
deleted file mode 100644
index c7adc870a..000000000
--- a/docs/testing/user/userguide/opnfv_yardstick_tc021.rst
+++ /dev/null
@@ -1,157 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Intel Corporation and others.
-
-*************************************
-Yardstick Test Case Description TC021
-*************************************
-
-.. _DPDKpktgen: https://github.com/Pktgen/Pktgen-DPDK/
-.. _rfc2544: https://www.ietf.org/rfc/rfc2544.txt
-
-+-----------------------------------------------------------------------------+
-|Network Performance                                                          |
-|                                                                             |
-+--------------+--------------------------------------------------------------+
-|test case id  | OPNFV_YARDSTICK_TC0021_Virtual Traffic Classifier            |
-|              | Instantiation Test in Presence of Noisy Neighbours           |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|metric        | Failure                                                      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test purpose  | To verify that a newly instantiated vTC is 'alive' and       |
-|              | functional and its instantiation is correctly supported by   |
-|              | the infrastructure in the presence of noisy neighbours.      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|configuration | file: opnfv_yardstick_tc021.yaml                             |
-|              |                                                              |
-|              | vnic_type: type of VNIC to be used.                          |
-|              |      Allowed values are:                                     |
-|              |           - normal: for default OvS port configuration       |
-|              |           - direct: for SR-IOV port configuration            |
-|              |      Default value: None                                     |
-|              |                                                              |
-|              | vtc_flavor: OpenStack flavor to be used for the vTC          |
-|              |      Default available values are: m1.small, m1.medium,      |
-|              |      and m1.large, but the user can create his/her own       |
-|              |      flavor and give it as input                             |
-|              |      Default value: None                                     |
-|              |                                                              |
-|              | num_of_neighbours: Number of noisy neighbours (VMs) to be    |
-|              |     instantiated during the experiment.                      |
-|              |     Allowed values: range (1, 10)                            |
-|              |                                                              |
-|              | amount_of_ram: RAM to be used by each neighbor.              |
-|              |     Allowed values: ['250M', '1G', '2G', '3G', '4G', '5G',   |
-|              |                      '6G', '7G', '8G', '9G', '10G']          |
-|              |     Deault value: 256M                                       |
-|              |                                                              |
-|              | number_of_cores: Number of noisy neighbours (VMs) to be      |
-|              |     instantiated during the experiment.                      |
-|              |     Allowed values: range (1, 10)                            |
-|              |     Default value: 1                                         |
-|              |                                                              |
-|              | vlan_sender: vlan tag of the network on which the vTC will   |
-|              |      receive traffic (VLAN Network 1).                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | vlan_receiver: vlan tag of the network on which the vTC      |
-|              |      will send traffic back to the packet generator          |
-|              |      (VLAN Network 2).                                       |
-|              |      Allowed values: range (1, 4096)                         |
-|              |                                                              |
-|              | default_net_name: neutron name of the defaul network that    |
-|              |      is used for access to the internet from the vTC         |
-|              |      (vNIC 1).                                               |
-|              |                                                              |
-|              | default_subnet_name: subnet name for vNIC1                   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_1_name: Neutron Name for VLAN Network 1             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_1_name: Subnet Neutron name for VLAN Network 1   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_net_2_name: Neutron Name for VLAN Network 2             |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-|              | vlan_subnet_2_name: Subnet Neutron name for VLAN Network 2   |
-|              |      (information available through Neutron).                |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test tool     | DPDK pktgen                                                  |
-|              |                                                              |
-|              | DPDK Pktgen is not part of a Linux distribution,             |
-|              | hence it needs to be installed by the user.                  |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|references    | DPDK Pktgen: DPDK Pktgen: DPDKpktgen_                        |
-|              |                                                              |
-|              | ETSI-NFV-TST001                                              |
-|              |                                                              |
-|              | RFC 2544: rfc2544_                                           |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|applicability | Test can be configured with different flavors, vNIC type     |
-|              | and packet sizes. Default values exist as specified above.   |
-|              | The vNIC type and flavor MUST be specified by the user.      |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|pre-test      | The vTC has been successfully instantiated and configured.   |
-|              | The user has correctly assigned the values to the deployment |
-|              |  configuration parameters.                                   |
-|              |                                                              |
-|              | - Multicast traffic MUST be enabled on the network.          |
-|              |      The Data network switches need to be configured in      |
-|              |      order to manage multicast traffic.                      |
-|              |      Installation and configuration of smcroute is required  |
-|              |      before to run the test case.                            |
-|              |      (For further instructions please refer to the ApexLake  |
-|              |      documentation).                                         |
-|              | - In the case of SR-IOV vNICs use, SR-IOV compatible NICs    |
-|              |      must be used on the compute node.                       |
-|              | - Yarsdtick needs to be installed on a host connected to the |
-|              |      data network and the host must have 2 DPDK-compatible   |
-|              |      NICs. Proper configuration of DPDK and DPDK pktgen is   |
-|              |      required before to run the test case.                   |
-|              |      (For further instructions please refer to the ApexLake  |
-|              |      documentation).                                         |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test sequence | Description and expected results                             |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 1        | The noisy neighbours are deployed as required by the user.   |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 2        | The vTC is deployed, according to the configuration provided |
-|              | by the user.                                                 |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 3        | The vTC is correctly deployed and configured as necessary.   |
-|              | The initialization script has been correctly executed and    |
-|              | the vTC is ready to receive and process the traffic.         |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 4        | Test case is executed with the selected parameters:          |
-|              | - vTC flavor                                                 |
-|              | - vNIC type                                                  |
-|              | A constant rate traffic is sent to the vTC for 10 seconds.   |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|step 5        | The vTC instance tags all the packets and sends them back to |
-|              | the packet generator for 10 seconds.                         |
-|              |                                                              |
-|              | The framework checks if the packet generator receives back   |
-|              | all the packets with the correct tag from the vTC.           |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-|test verdict  |  The vTC is deemed to be successfully instantiated if all    |
-|              |  packets are sent back with the right tag as requested,      |
-|              |  else it is deemed DoA (Dead on arrival)                     |
-|              |                                                              |
-+--------------+--------------------------------------------------------------+
-- 
cgit