summaryrefslogtreecommitdiffstats
path: root/docs/testing/user
diff options
context:
space:
mode:
authoryuyang <Gabriel.yuyang@huawei.com>2017-07-03 17:59:12 +0800
committeryuyang <Gabriel.yuyang@huawei.com>2017-07-04 12:35:31 +0800
commitb39f17a60e91552ffe94c520a30e6b271077f294 (patch)
tree2365debfddf455ce9691f69775fee3a79bb65c2d /docs/testing/user
parentc6647e559cddfe8bdf064bf69edd970df4044ce5 (diff)
Initiate docs for Euphrates Release
JIRA: BOTTLENECK-170 Initiate docs for euphrates release by chaning the directory structure and contents framework Change-Id: Id051574a9d489c5b4f90b7e079ce8482413b1b53 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
Diffstat (limited to 'docs/testing/user')
-rw-r--r--docs/testing/user/userguide/dashboard_guide.rst21
-rw-r--r--docs/testing/user/userguide/deprecated.rst28
-rw-r--r--docs/testing/user/userguide/index.rst17
-rw-r--r--docs/testing/user/userguide/overview.rst76
-rw-r--r--docs/testing/user/userguide/posca/posca_factor_ping.rst (renamed from docs/testing/user/userguide/posca/posca_stress_ping.rst)0
-rw-r--r--docs/testing/user/userguide/posca/posca_factor_system_bandwidth.rst (renamed from docs/testing/user/userguide/posca/posca_stress_traffic.rst)0
-rw-r--r--docs/testing/user/userguide/posca_guide.rst175
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_basic.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1101.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1201.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1301.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1401.rst30
-rw-r--r--docs/testing/user/userguide/test_cases.rst13
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Ti1.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Ti2.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Ti3.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tn1.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tn2.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tu1.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tu2.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tu3.rst28
22 files changed, 293 insertions, 441 deletions
diff --git a/docs/testing/user/userguide/dashboard_guide.rst b/docs/testing/user/userguide/dashboard_guide.rst
new file mode 100644
index 00000000..5679e508
--- /dev/null
+++ b/docs/testing/user/userguide/dashboard_guide.rst
@@ -0,0 +1,21 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
+
+**************
+Dashbard guide
+**************
+
+Scope
+=====
+This document provides an overview of the results of test cases developed by
+the OPNFV Bottlenecks Project, executed on OPNFV community labs.
+
+OPNFV CI(Continous Integration) system provides automated build, deploy and testing for
+the software developed in OPNFV. Unless stated, the reported tests are
+automated via Jenkins Jobs.
+
+Test results are visible in the following dashboard:
+
+* *Testing dashboard*: uses Mongo DB to store test results and Bitergia for
+ visualization, which includes the rubbos test result, vstf test result.
diff --git a/docs/testing/user/userguide/deprecated.rst b/docs/testing/user/userguide/deprecated.rst
deleted file mode 100644
index 80fe44af..00000000
--- a/docs/testing/user/userguide/deprecated.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International License.
-.. http://creativecommons.org/licenses/by/4.0
-
-***********************************
-Bottlenecks - Deprecated Test Cases
-***********************************
-
-.. This index.rst file is used to structure and organise the content in these directories.
-.. The documentation toolchain will create web and pdf versions of the content of this file.
-
-.. toctree::
- :maxdepth: 1
-
- ./rubbos/rubbos_basic.rst
- ./rubbos/rubbos_tc1101.rst
- ./rubbos/rubbos_tc1201.rst
- ./rubbos/rubbos_tc1301.rst
- ./rubbos/rubbos_tc1401.rst
- ./rubbos/rubbos_heavy_tc1101.rst
- ./vstf/vstf_Ti1.rst
- ./vstf/vstf_Ti2.rst
- ./vstf/vstf_Ti3.rst
- ./vstf/vstf_Tn1.rst
- ./vstf/vstf_Tn2.rst
- ./vstf/vstf_Tu1.rst
- ./vstf/vstf_Tu2.rst
- ./vstf/vstf_Tu3.rst
-
diff --git a/docs/testing/user/userguide/index.rst b/docs/testing/user/userguide/index.rst
index 795530d6..8e959abc 100644
--- a/docs/testing/user/userguide/index.rst
+++ b/docs/testing/user/userguide/index.rst
@@ -1,17 +1,16 @@
.. This work is licensed under a Creative Commons Attribution 4.0 International License.
.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
-**************************
-Bottlenecks - User Guide
-**************************
-
-.. This index.rst file is used to structure and organise the content in these directories.
-.. The documentation toolchain will create web and pdf versions of the content of this file.
+***************************
+Bottlenecks - Testing Guide
+***************************
.. toctree::
:maxdepth: 1
- ./posca/posca_stress_ping.rst
- ./posca/posca_stress_traffic.rst
- ./deprecated.rst
+ ./overview.rst
+ ./posca_guide.rst
+ ./dashboard_guide.rst
+ ./test_cases.rst
diff --git a/docs/testing/user/userguide/overview.rst b/docs/testing/user/userguide/overview.rst
new file mode 100644
index 00000000..a9302297
--- /dev/null
+++ b/docs/testing/user/userguide/overview.rst
@@ -0,0 +1,76 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
+
+*********************
+Project Testing Guide
+*********************
+
+For each *testsuite*, you can either setup *teststory* or *testcase* to run
+certain test. *teststory* comprises several *testcases* as a set in one
+configuration file. You could call *teststory* or *testcase* by using
+Bottlencks user interfaces.
+Details will be shown in the following section.
+
+Brief Introdcution of the Test suites in Project Releases
+=============================================================
+
+Brahmaputra: rubbos is introduced, which is an end2end NFVI perforamnce tool.
+Virtual switch test framework(VSTF) is also introduced,
+which is an test framework used for vswitch performance test.
+
+Colorado: rubbos is refactored by using puppet, which makes it quite flexible
+to configure with different number of load generator (Client), worker (tomcat).
+vstf is refactored by extracting the test case's configuration information.
+
+Danube: posca testsuite is introduced to implementing stress (factor), scenario and
+tuning test in parametric manner. Two testcases are developed and integrated into
+community CI pipeline. Rubbos and VSTF are not supported any more.
+
+Integration Description
+=======================
++-------------+----------------------+----------------------+
+| Release | Integrated Installer | Supported Testsuite |
++-------------+----------------------+----------------------+
+| Brahmaputra | Fuel | Rubbos, VSTF |
++-------------+----------------------+----------------------+
+| Colorado | Compass | Rubbos, VSTF |
++-------------+----------------------+----------------------+
+| Danube | Compass | POSCA |
++-------------+----------------------+----------------------+
+
+Test suite & Test case Description
+==================================
++--------+-------------------------------+
+|POSCA | posca_factor_ping |
+| +-------------------------------+
+| | posca_factor_system_bandwidth |
++--------+-------------------------------+
+|Rubbos | rubbos_basic |
+| +-------------------------------+
+| | rubbos_TC1101 |
+| +-------------------------------+
+| | rubbos_TC1201 |
+| +-------------------------------+
+| | rubbos_TC1301 |
+| +-------------------------------+
+| | rubbos_TC1401 |
+| +-------------------------------+
+| | rubbos_heavy_TC1101 |
++--------+-------------------------------+
+|vstf | vstf_Ti1 |
+| +-------------------------------+
+| | vstf_Ti2 |
+| +-------------------------------+
+| | vstf_Ti3 |
+| +-------------------------------+
+| | vstf_Tn1 |
+| +-------------------------------+
+| | vstf_Tn2 |
+| +-------------------------------+
+| | vstf_Tu1 |
+| +-------------------------------+
+| | vstf_Tu2 |
+| +-------------------------------+
+| | vstf_Tu3 |
++--------+-------------------------------+
diff --git a/docs/testing/user/userguide/posca/posca_stress_ping.rst b/docs/testing/user/userguide/posca/posca_factor_ping.rst
index 953ff4b7..953ff4b7 100644
--- a/docs/testing/user/userguide/posca/posca_stress_ping.rst
+++ b/docs/testing/user/userguide/posca/posca_factor_ping.rst
diff --git a/docs/testing/user/userguide/posca/posca_stress_traffic.rst b/docs/testing/user/userguide/posca/posca_factor_system_bandwidth.rst
index d0e702f3..d0e702f3 100644
--- a/docs/testing/user/userguide/posca/posca_stress_traffic.rst
+++ b/docs/testing/user/userguide/posca/posca_factor_system_bandwidth.rst
diff --git a/docs/testing/user/userguide/posca_guide.rst b/docs/testing/user/userguide/posca_guide.rst
new file mode 100644
index 00000000..ae6c2481
--- /dev/null
+++ b/docs/testing/user/userguide/posca_guide.rst
@@ -0,0 +1,175 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
+
+*********************
+POSCA Testsuite Guide
+*********************
+
+
+POSCA Introduction
+====================
+The POSCA (Parametric Bottlenecks Testing Catalogue) testsuite
+classifies the bottlenecks test cases and results into 5 categories.
+Then the results will be analyzed and bottlenecks will be searched
+among these categories.
+
+The POSCA testsuite aims to locate the bottlenecks in parmetric
+manner and to decouple the bottlenecks regarding the deployment
+requirements.
+The POSCA testsuite provides an user friendly way to profile and
+understand the E2E system behavior and deployment requirements.
+
+Goals of the POSCA testsuite:
+ a) Automatically locate the bottlenecks in a iterative manner.
+ b) Automatically generate the testing report for bottlenecks in different categories.
+ c) Implementing Automated Staging.
+
+Scopes of the POSCA testsuite:
+ a) Modeling, Testing and Test Result analysis.
+ b) Parameters choosing and Algorithms.
+
+Test stories of POSCA testsuite:
+ a) Factor test (Stress test): base test cases that Feature test and Optimization will be dependant on.
+ b) Feature test: test cases for features/scenarios.
+ c) Optimization test: test to tune the system parameter.
+
+Detailed workflow is illutrated below.
+
+* https://wiki.opnfv.org/display/bottlenecks
+
+
+Preinstall Packages
+====================
+
+* Docker: https://docs.docker.com/engine/installation/
+ * For Ubuntu, please refer to https://docs.docker.com/engine/installation/linux/ubuntu/
+
+* Docker-Compose: https://docs.docker.com/compose/
+
+.. code-block:: bash
+
+ if [ -d usr/local/bin/docker-compose ]; then
+ rm -rf usr/local/bin/docker-compose
+ fi
+ curl -L https://github.com/docker/compose/releases/download/1.11.0/docker-compose-`uname -s`-`uname -m` > /usr/local/bin/docker-compose
+ chmod +x /usr/local/bin/docker-compose
+
+
+Run POSCA Locally
+=================
+
+POSCA testsuite is highly automated regarding test environment preparation, installing testing tools, excuting tests and showing the report/analysis.
+A few steps are needed to run it locally.
+
+It is presumed that a user is using Compass4nfv to deploy OPNFV Danube and the user logins jumper server as root.
+
+
+Downloading Bottlenecks Software
+--------------------------------
+
+.. code-block:: bash
+
+ mkdir /home/opnfv
+ cd /home/opnfv
+ git clone https://gerrit.opnfv.org/gerrit/bottlenecks
+ cd bottlenecks
+
+
+Preparing Python Virtual Evnironment
+------------------------------------
+
+.. code-block:: bash
+
+ . pre_virt_env.sh
+
+
+Excuting Specified Testcase
+---------------------------
+
+Bottlencks provide a CLI interface to run the tests, which is one of the most convenient way since it is more close to our natural languge. An GUI interface with rest API will also be provided in later update.
+
+.. code-block:: bash
+
+ bottlenecks [testcase run <testcase>] [teststory run <teststory>]
+
+For the *testcase* command, testcase name should be as the same name of the test case configuration file located in testsuites/posca/testcase_cfg.
+For stress tests in Danube, *testcase* should be replaced by either *posca_factor_ping* or *posca_factor_system_bandwidth*.
+For the *teststory* command, a user could specified the test cases to be excuted by defined it in a teststory configuration file located in testsuites/posca/testsuite_story. There is also an example there named *posca_factor_test*.
+
+There are also other 2 ways to run test cases and test stories.
+The first one is using shell script.
+
+.. code-block:: bash
+
+ bash run_tests.sh [-h|--help] [-s <testsuite>] [-c <testcase>]
+
+The second is using python interpreter.
+
+.. code-block:: bash
+
+ docker-compose -f docker/bottleneck-compose/docker-compose.yml up -d
+ docker pull tutum/influxdb:0.13
+ sleep 5
+ POSCA_SCRIPT="/home/opnfv/bottlenecks/testsuites/posca"
+ docker exec bottleneckcompose_bottlenecks_1 python ${POSCA_SCRIPT}/run_posca.py [testcase <testcase>] [teststory <teststory>]
+
+
+Showing Report
+--------------
+
+Bottlenecks uses ELK to illustrate the testing results.
+Asumming IP of the SUT (System Under Test) is denoted as ipaddr,
+then the address of Kibana is http://[ipaddr]:5601. One can visit this address to see the illustrations.
+Address for elasticsearch is http://[ipaddr]:9200. One can use any Rest Tool to visit the testing data stored in elasticsearch.
+
+Cleaning Up Environment
+-----------------------
+
+.. code-block:: bash
+
+ . rm_virt_env.sh
+
+
+If you want to clean the dockers that established during the test, you can excute the additional commands below.
+
+.. code-block:: bash
+
+ docker-compose -f docker/bottleneck-compose/docker-compose.yml down -d
+ docker ps -a | grep 'influxdb' | awk '{print $1}' | xargs docker rm -f >/dev/stdout
+
+Or you can just run the following command
+
+.. code-block:: bash
+
+ bash run_tests.sh --cleanup
+
+Note that you can also add cleanup parameter when you run a test case. Then environment will be automatically cleaned up when
+completing the test.
+
+Run POSCA through Community CI
+==============================
+POSCA test cases are runned by OPNFV CI now. See https://build.opnfv.org for details of the building jobs.
+Each building job is set up to execute a single test case. The test results/logs will be printed on the web page and
+reported automatically to community MongoDB. There are two ways to report the results.
+
+1. Report testing result by shell script
+
+.. code-block:: bash
+
+ bash run_tests.sh [-h|--help] [-s <testsuite>] [-c <testcase>] --report
+
+2. Report testing result by python interpreter
+
+.. code-block:: bash
+
+ docker-compose -f docker/bottleneck-compose/docker-compose.yml up -d
+ docker pull tutum/influxdb:0.13
+ sleep 5
+ REPORT="True"
+ POSCA_SCRIPT="/home/opnfv/bottlenecks/testsuites/posca"
+ docker exec bottleneckcompose_bottlenecks_1 python ${POSCA_SCRIPT}/run_posca.py [testcase <testcase>] [teststory <teststory>] REPORT
+
+Test Result Description
+=======================
+* Please refer to release notes and also https://wiki.opnfv.org/display/testing/Result+alignment+for+ELK+post-processing
diff --git a/docs/testing/user/userguide/rubbos/rubbos_basic.rst b/docs/testing/user/userguide/rubbos/rubbos_basic.rst
deleted file mode 100644
index ffef6c48..00000000
--- a/docs/testing/user/userguide/rubbos/rubbos_basic.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description Basic
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos Basic |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_Basic |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 tomcat, 1 Apache and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_basic.yaml |
-| | |
-| | client number: 1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst b/docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst
deleted file mode 100644
index 08251c7b..00000000
--- a/docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-******************************************************
-Bottlenecks Rubbos Test Case Description Heavy TC1101
-******************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC Heavy1101 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_heavy_tc1101 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 tomcat, 1 Apache and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos-heavy_1-1-0-1.yaml |
-| | |
-| | client number: 10 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1101.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1101.rst
deleted file mode 100644
index 2a261313..00000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1101.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1101
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1101 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1101 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 tomcat, 1 Apache and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-1-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1201.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1201.rst
deleted file mode 100644
index 9b6a5f99..00000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1201.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1201
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1201 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1201 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 Apache, 2 tomcat and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-2-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1301.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1301.rst
deleted file mode 100644
index db4e0b63..00000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1301.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1301
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1301 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1301 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 Apache, 3 tomcat and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-3-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1401.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1401.rst
deleted file mode 100644
index f195d237..00000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1401.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1401
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1401 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1401 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 Apache, 4 tomcat and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-4-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/test_cases.rst b/docs/testing/user/userguide/test_cases.rst
new file mode 100644
index 00000000..57e338e9
--- /dev/null
+++ b/docs/testing/user/userguide/test_cases.rst
@@ -0,0 +1,13 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
+
+************************
+Bottlenecks - Test Cases
+************************
+
+.. toctree::
+ :maxdepth: 1
+
+ ./posca/posca_factor_system_bandwidth.rst
+ ./posca/posca_factor_ping.rst
diff --git a/docs/testing/user/userguide/vstf/vstf_Ti1.rst b/docs/testing/user/userguide/vstf/vstf_Ti1.rst
deleted file mode 100644
index ce1690b4..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Ti1.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Ti1
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Ti1 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Ti1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Ti1. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Ti1.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Ti2.rst b/docs/testing/user/userguide/vstf/vstf_Ti2.rst
deleted file mode 100644
index 58cb40f7..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Ti2.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Ti2
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Ti2 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Ti2 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Ti2. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Ti2.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Ti3.rst b/docs/testing/user/userguide/vstf/vstf_Ti3.rst
deleted file mode 100644
index 3bb9dfce..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Ti3.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Ti3
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Ti3 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Ti3 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Ti3. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Ti3.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tn1.rst b/docs/testing/user/userguide/vstf/vstf_Tn1.rst
deleted file mode 100644
index 5c591a9b..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Tn1.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tn1
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tn1 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tn1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tn1. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tn1.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tn2.rst b/docs/testing/user/userguide/vstf/vstf_Tn2.rst
deleted file mode 100644
index 4b6d0c45..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Tn2.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tn2
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tn2 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tn2 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tn2. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tn2.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tu1.rst b/docs/testing/user/userguide/vstf/vstf_Tu1.rst
deleted file mode 100644
index cf27bb25..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Tu1.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tu1
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tu1 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tu1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tu1. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tu1.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tu2.rst b/docs/testing/user/userguide/vstf/vstf_Tu2.rst
deleted file mode 100644
index 2ae84467..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Tu2.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tu2
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tu2 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tu2 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tu2. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tu2.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tu3.rst b/docs/testing/user/userguide/vstf/vstf_Tu3.rst
deleted file mode 100644
index 4e090f17..00000000
--- a/docs/testing/user/userguide/vstf/vstf_Tu3.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tu3
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tu3 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tu3 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tu3. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tu3.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-