summaryrefslogtreecommitdiffstats
path: root/docs
diff options
context:
space:
mode:
authoryuyang <Gabriel.yuyang@huawei.com>2017-07-03 17:59:12 +0800
committeryuyang <Gabriel.yuyang@huawei.com>2017-07-04 12:35:31 +0800
commitb39f17a60e91552ffe94c520a30e6b271077f294 (patch)
tree2365debfddf455ce9691f69775fee3a79bb65c2d /docs
parentc6647e559cddfe8bdf064bf69edd970df4044ce5 (diff)
Initiate docs for Euphrates Release
JIRA: BOTTLENECK-170 Initiate docs for euphrates release by chaning the directory structure and contents framework Change-Id: Id051574a9d489c5b4f90b7e079ce8482413b1b53 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
Diffstat (limited to 'docs')
-rw-r--r--docs/release/release-notes/release_notes.rst3
-rw-r--r--docs/testing/developer/devguide/framework_guide.rst14
-rw-r--r--docs/testing/developer/devguide/index.rst14
-rw-r--r--docs/testing/developer/devguide/package_guide.rst14
-rw-r--r--docs/testing/developer/devguide/quick_start.rst14
-rw-r--r--docs/testing/developer/devguide/rubbos_guide.rst128
-rw-r--r--docs/testing/developer/devguide/vstf_guide.rst241
-rw-r--r--docs/testing/user/userguide/dashboard_guide.rst (renamed from docs/testing/developer/devguide/dashboard_guide.rst)0
-rw-r--r--docs/testing/user/userguide/deprecated.rst28
-rw-r--r--docs/testing/user/userguide/index.rst17
-rw-r--r--docs/testing/user/userguide/overview.rst (renamed from docs/testing/developer/devguide/overview.rst)8
-rw-r--r--docs/testing/user/userguide/posca/posca_factor_ping.rst (renamed from docs/testing/user/userguide/posca/posca_stress_ping.rst)0
-rw-r--r--docs/testing/user/userguide/posca/posca_factor_system_bandwidth.rst (renamed from docs/testing/user/userguide/posca/posca_stress_traffic.rst)0
-rw-r--r--docs/testing/user/userguide/posca_guide.rst (renamed from docs/testing/developer/devguide/posca_guide.rst)0
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_basic.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1101.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1201.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1301.rst30
-rw-r--r--docs/testing/user/userguide/rubbos/rubbos_tc1401.rst30
-rw-r--r--docs/testing/user/userguide/test_cases.rst (renamed from docs/testing/developer/devguide/deprecated.rst)12
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Ti1.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Ti2.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Ti3.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tn1.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tn2.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tu1.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tu2.rst28
-rw-r--r--docs/testing/user/userguide/vstf/vstf_Tu3.rst28
29 files changed, 66 insertions, 831 deletions
diff --git a/docs/release/release-notes/release_notes.rst b/docs/release/release-notes/release_notes.rst
index d529bf7..fae8760 100644
--- a/docs/release/release-notes/release_notes.rst
+++ b/docs/release/release-notes/release_notes.rst
@@ -194,8 +194,7 @@ Documentatiion Deliverables
Reason for Version
==================
-* In Danube, POSCA testsuite is introduced and two stress tests are implemented. Rubbos and vstf are
-not supported in this release. Their documentations for former releases will only be kept this release.
+* In Danube, POSCA testsuite is introduced and two stress tests are implemented. Rubbos and vstf are not supported in this release. Their documentations for former releases will only be kept this release.
* In Colorado, rubbos is refactored by using puppet, which makes it quite flexible to configure with different number of load generator(Client), worker(tomcat).
* In Colorado, vstf is refactored by extracting the test case's configuration information.
diff --git a/docs/testing/developer/devguide/framework_guide.rst b/docs/testing/developer/devguide/framework_guide.rst
new file mode 100644
index 0000000..79bd1f9
--- /dev/null
+++ b/docs/testing/developer/devguide/framework_guide.rst
@@ -0,0 +1,14 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
+
+*****************************
+Bottlenecks - Framework Guide
+*****************************
+
+
+Introduction
+============
+
+This document will provide a comprehensive guilde on Bottlenecks testing
+framework development.
diff --git a/docs/testing/developer/devguide/index.rst b/docs/testing/developer/devguide/index.rst
index 8d57ead..19f12ca 100644
--- a/docs/testing/developer/devguide/index.rst
+++ b/docs/testing/developer/devguide/index.rst
@@ -2,15 +2,13 @@
.. http://creativecommons.org/licenses/by/4.0
.. (c) Huawei Technologies Co.,Ltd and others.
-***************************
-Bottlenecks - Testing Guide
-***************************
+*****************************
+Bottlenecks - Developer Guide
+*****************************
.. toctree::
:maxdepth: 1
- ./overview.rst
- ./posca_guide.rst
- ./dashboard_guide.rst
- ./deprecated.rst
-
+ ./quick_start.rst
+ ./framework_guide.rst
+ ./package_guide.rst
diff --git a/docs/testing/developer/devguide/package_guide.rst b/docs/testing/developer/devguide/package_guide.rst
new file mode 100644
index 0000000..19bc6ed
--- /dev/null
+++ b/docs/testing/developer/devguide/package_guide.rst
@@ -0,0 +1,14 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
+
+****************************
+Bottlenecks - Package Guilde
+****************************
+
+
+Introduction
+============
+
+This document will provide a comprehensive guilde on packages library for
+developers.
diff --git a/docs/testing/developer/devguide/quick_start.rst b/docs/testing/developer/devguide/quick_start.rst
new file mode 100644
index 0000000..337c1ef
--- /dev/null
+++ b/docs/testing/developer/devguide/quick_start.rst
@@ -0,0 +1,14 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
+
+*************************************
+Bottlenecks - A Developer Quick Start
+*************************************
+
+
+Introduction
+============
+
+This document will provide general view of the project for developers as a
+quick guide.
diff --git a/docs/testing/developer/devguide/rubbos_guide.rst b/docs/testing/developer/devguide/rubbos_guide.rst
deleted file mode 100644
index 4d92d2e..0000000
--- a/docs/testing/developer/devguide/rubbos_guide.rst
+++ /dev/null
@@ -1,128 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) Huawei Technologies Co.,Ltd and others.
-
-**********************
-Rubbos Testsuite Guide
-**********************
-
-
-Rubbos Introduction
-====================
-Rubbos is a bulletin board benchmark modeled after an online news forum like Slashdot.
-It is an open source Middleware and an n-tier system model which
-is used to be deployed on multiple physical node and
-to measure the whole performacne of OPNFV platform.
-Rubbos can deploy the Apache, tomcat, and DB.
-Based on the deployment, rubbos gives the pressure to the whole system.
-When the system reaches to the peak, the throughput will not grow more.
-This testcase can help to understand the bottlenecks of OPNFV plantform
-and improve the performance of OPNFV platform.
-
-Detailed workflow is illutrated below.
-
-.. image:: ../images/Framework_Setup.png
- :width: 770px
- :alt: Bottlenecks Framework Setup
-
-Preinstall Packages
-====================
-There is a need to install some packages before running the rubbos,
-gcc, gettext, g++, libaio1, libaio-dev, make and git are necessary.
-When the rubbos runs on the OPNFV community continuous integration(CI)
-system, the required packages are installed automately as shown in the
-code repository, which is /utils/infra_setup/vm_dev_setup/packages.conf,
-besides, the packages can be encapsulated in the images initially.
-If someone wants to use rubbos locally, he/she has to install them by
-hand, such as in ubuntu 14.04,
-
-.. code-block:: bash
-
- apt-get update
- apt-get install gettext
-
-How does Rubbos Integrate into Installers
-=========================================
-1.Community CI System
-
-Rubbos has been successfully integrated into fuel and compass with NOSDN scenario
-in OPNFV community CI system.
-
-Heat is used to create 9 instances, which is shown in
-/utils/infra_setup/heat_template/HOT_create_instance.sh, the 9 instances are used
-for installing Apache, Tomcat, Mysql, Control, Benchmark and 4 Clients. The tools,
-such as rubbos, sysstat, oprofile, etc, are installed in these instances to perform
-the test, the test results are stored in the Benchmark instance initially, then they
-are copied to the Rubbos_result instance, finally, the test results are transferred to
-the community dashboard.
-
-There's a need to store our pakages as large as M bytes or G bytes size, such as
-the images, jdk, apache-ant, apache-tomcat, etc, the OPNFV community storage system,
-Google Cloud Storage, is used, the pakages can be downloaded from
-https://artifacts.opnfv.org/bottlenecks/rubbos.
-
-2.Local Deployment
-
-If someone wants to run the rubbos in his own environment, he/she can keep to the following steps,
-
-2.1 Start up instances by using heat, nova or libvert. In Openstack Environemnt,
-the heat script can refer /utils/infra_setup/heat_template/HOT_create_instance.sh,
-if the openstack doesn't support heat module,
-the script /utils/infra_setup/create_instance.sh can be used.
-Without Openstack, there's a way to set up instances by using libvert, the scripts are shown under
-the directory /utils/rubbos_dev_env_setup.
-
-The image can be downloaded from the community cloud storage
-
-.. code-block:: bash
-
- curl --connect-timeout 10 -o bottlenecks-trusty-server.img
- http://artifacts.opnfv.org/bottlenecks/rubbos/bottlenecks-trusty-server.img
-
-2.2 Ssh into the control node and clone the bottlenecks codes to the root directory.
-
-.. code-block:: bash
-
- git clone https://git.opnfv.org/bottlenecks /bottlenecks
-
-2.3 Download the packages and decompress them into the proper directory.
-
-.. code-block:: bash
-
- curl --connect-timeout 10 -o app_tools.tar.gz
- http://artifacts.opnfv.org/bottlenecks/rubbos/app_tools.tar.gz
- curl --connect-timeout 10 -o rubbosMulini6.tar.gz
- http://artifacts.opnfv.org/bottlenecks/rubbos/rubbosMulini6.tar.gz
-
-.. code-block:: bash
-
- tar zxf app_tools.tar.gz -C /bottlenecks/rubbos
- tar zxf rubbosMulini6.tar.gz -C /bottlenecks/rubbos/rubbos_scripts
-
-2.4 Ssh into the Control node and run the script
-
-.. code-block:: bash
-
- source /bottlenecks/rubbos/rubbos_scripts/1-1-1/scripts/run.sh
-
-2.5 Check the test results under the directory /bottlenecks/rubbos/rubbos_results in
-Control node. The results are stored in the format of xml,
-move them to the brower chrome, then you can see the results.
-
-Test Result Description
-=======================
-In OPNFV community, the result is shown in the following format
-
-::
-
- [{'client': 200, 'throughput': 27},
- {'client': 700, 'throughput': 102},
- {'client': 1200, 'throughput': 177},
- {'client': 1700, 'throughput': 252},
- {'client': 2200, 'throughput': 323},
- {'client': 2700, 'throughput': 399},
- {'client': 3200, 'throughput': 473}]
-
-The results are transferred to the community database and a map is drawed on the dashboard.
-Along with the growth of the number of the client, the throughput grows at first, then meets
-up with a point of inflexion, which is caused by the bottlenecks of the measured system.
diff --git a/docs/testing/developer/devguide/vstf_guide.rst b/docs/testing/developer/devguide/vstf_guide.rst
deleted file mode 100644
index e1ad5f2..0000000
--- a/docs/testing/developer/devguide/vstf_guide.rst
+++ /dev/null
@@ -1,241 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) Huawei Technologies Co.,Ltd and others.
-
-********************
-VSTF Testsuite Guide
-********************
-
-VSTF Introduction
-====================
-VSTF(Virtual Switch Test Framework) is a system-level testing framework in the
-area of network virtualization, and it could help you estimate the system switch
-ability and find out the network bottlenecks by main KPIs(bandwidth, latency,
-resource usage and so on), VSTF owns a methodology to define the test scenario and
-testcases, Now we could support Tu testcases in the Openstack environment, More
-scenarios and cases will be added.
-
-VSTF TestScenario
------------------
-1. Tu - VM to VM
-2. Tn - Physical Nic loopback
-3. TnV - VNF loopback
-4. Ti - VM to Physical Nic
-
-Pre-install Packages on the ubuntu 14.04 VM
-===========================================
-VSTF VM Preparation Steps
--------------------------
-1. Create a ubuntu 14.04 VM
-2. Install dependency inside VM
-3. Install vstf python package inside VM
-
-VM preparation
---------------
-Install python2.7 version and git
-
-::
-
- sudo apt-get install python2.7
- sudo apt-get install git
-
-Download Bottlenecks package
-
-::
-
- sudo cd /home/
- sudo git clone https://gerrit.opnfv.org/gerrit/bottlenecks
-
-Install the dependency
-
-::
-
- sudo apt-get install python-pip
- sudo pip install --upgrade pip
- sudo dpkg-reconfigure dash
- sudo apt-get install libjpeg-dev
- sudo apt-get install libpng-dev
- sudo apt-get install python-dev
- sudo apt-get install python-testrepository
- sudo apt-get install git
- sudo apt-get install python-pika
- sudo apt-get install python-oslo.config
- sudo pip install -r /home/bottlenecks/vstf/requirements.txt
-
-Install vstf package
-
-::
-
- sudo mkdir -p /var/log/vstf/
- sudo cp -r /home/bottlenecks/vstf/etc/vstf/ /etc/
- sudo mkdir -p /opt/vstf/
- sudo cd /home/bottlenecks;sudo rm -rf build/
- sudo python setup.py install
-
-Image on the Cloud
-------------------
-+-----------+-------------------------------------------------------------+
-| Name | vstf-image |
-+===========+=============================================================+
-| URL | http://artifacts.opnfv.org/bottlenecks/vstf-manager-new.img |
-+-----------+-------------------------------------------------------------+
-| Format | QCOW2 |
-+-----------+-------------------------------------------------------------+
-| Size | 5G |
-+-----------+-------------------------------------------------------------+
-| User | root |
-+-----------+-------------------------------------------------------------+
-| Passwd | root |
-+-----------+-------------------------------------------------------------+
-There is a complete vstf image on the cloud ,you could download it and use it to
-deploy and run cases ,but do not need VM preparation steps.
-
-
-How is VSTF Integrated into Installers
-========================================
-VM requirements
----------------
-+------------------+----------+--------------------+-----------------------------------------------------+
-| Name | FLAVOR | IMAGE_NAME | NETWORK |
-+==================+==========+====================+=====================================================+
-| vstf-manager | m1.large | vstf-image | control-plane=XX.XX.XX.XX |
-+------------------+----------+--------------------+-----------------------------------------------------+
-| vstf-tester | m1.large | vstf-image | control-plane(eth0)=XX.XX.XX.XX |
-| | | | test-plane(eth1)=XX.XX.XX.XX |
-+------------------+----------+--------------------+-----------------------------------------------------+
-| vstf-target | m1.large | vstf-image | control-plane(eth0)=XX.XX.XX.XX |
-| | | | test-plane(eth1)=XX.XX.XX.XX |
-+------------------+----------+--------------------+-----------------------------------------------------+
-m1.large means 4U4G for the target image Size 5GB
-For the network used by VMs,network need two plane ,one plane is control plane and the other plane is test plane.
-
-OPNFV community Usage in the CI system
---------------------------------------
-+---------------------------------------+---------------------------------------+
-| Project Name | Project Categoty |
-+=======================================+=======================================+
-| bottlenecks-daily-fuel-vstf-lf-master | bottlenecks |
-+---------------------------------------+---------------------------------------+
-OPNFV community jenkins Project info
-
-Main Entrance for the ci test:
-
-::
-
- cd /home/bottlenecks/ci;
- bash -x vstf_run.sh
-
-Test on local(Openstack Environment)
-------------------------------------
-download the image file
-
-::
-
- curl --connect-timeout 10 -o /tmp/vstf-manager.img \
- http://artifacts.opnfv.org/bottlenecks/vstf-manager-new.img -v
-
-create the image file by the glance
-
-::
-
- glance image-create --name $MANAGER_IMAGE_NAME \
- --disk-format qcow2 \
- --container-format bare \
- --file /tmp/vstf-manager.img
-
-create the keypair for the image(anyone will be ok)
-
-::
-
- cd /home/bottlenecks/utils/infra_setup/bottlenecks_key
- nova keypair-add --pub_key $KEY_PATH/bottlenecks_key.pub $KEY_NAME
-
-create the vstf three VMs in the openstack by heat
-
-::
-
- cd /home/bottlenecks/utils/infra_setup/heat_template/vstf_heat_template
- heat stack-create vstf -f bottleneck_vstf.yaml
-
-launch the vstf process inside the vstf-manager vstf-tester vstf-target VMs
-
-::
-
- cd /home/bottlenecks/utils/infra_setup/heat_template/vstf_heat_template
- bash -x launch_vstf.sh
-
-edit the test scenario and test packet list in the vstf_test.sh, now support the Tu-1/2/3
-
-::
-
- function fn_testing_scenario(){
- ...
- local test_length_list="64 128 256 512 1024"
- local test_scenario_list="Tu-1 Tu-3"
- ...
- }
-
-launch the vstf script
-
-::
-
- cd /home/bottlenecks/utils/infra_setup/heat_template/vstf_heat_template
- bash -x vstf_test.sh
-
-Test Result Description
-=======================
-Result Format
--------------
-For example after the test, The result will display as the following format
-
-::
-
- { u'64': { u'AverageLatency': 0.063,
- u'Bandwidth': 0.239,
- u'CPU': 0.0,
- u'Duration': 20,
- u'MaximumLatency': 0.063,
- u'MinimumLatency': 0.063,
- u'MppspGhz': 0,
- u'OfferedLoad': 100.0,
- u'PercentLoss': 22.42,
- u'RxFrameCount': 4309750.0,
- u'RxMbps': 198.28,
- u'TxFrameCount': 5555436.0,
- u'TxMbps': 230.03}}
-
-Option Description
-------------------
-+---------------------+---------------------------------------------------+
-| Option Name | Description |
-+=====================+===================================================+
-| AverageLatency | The average latency data during the packet |
-| | transmission (Unit:microsecond) |
-+---------------------+---------------------------------------------------+
-| Bandwidth | Network bandwidth(Unit:Million packets per second)|
-+---------------------+---------------------------------------------------+
-| CPU | Total Resource Cpu usage(Unit: Ghz) |
-+---------------------+---------------------------------------------------+
-| Duration | Test time(Unit: second) |
-+---------------------+---------------------------------------------------+
-| MaximumLatency | The maximum packet latency during the packet |
-| | transmission (Unit:microsecond) |
-+---------------------+---------------------------------------------------+
-| MinimumLatency | The maximum packet latency during the packet |
-| | transmission (Unit:microsecond) |
-+---------------------+---------------------------------------------------+
-| MppspGhz | Million Packets per second with per CPU |
-| | resource Ghz(Unit: Mpps/Ghz) |
-+---------------------+---------------------------------------------------+
-| OfferedLoad | The load of network offered |
-+---------------------+---------------------------------------------------+
-| PercentLoss | The percent of frame loss rate |
-+---------------------+---------------------------------------------------+
-| RxFrameCount | The total frame on Nic rx |
-+---------------------+---------------------------------------------------+
-| RxMbps | The received bandwidth per second |
-+---------------------+---------------------------------------------------+
-| TxFrameCount | The total frame on Nic rx |
-+---------------------+---------------------------------------------------+
-| TxMbps | The send bandwidth per second |
-+---------------------+---------------------------------------------------+
diff --git a/docs/testing/developer/devguide/dashboard_guide.rst b/docs/testing/user/userguide/dashboard_guide.rst
index 5679e50..5679e50 100644
--- a/docs/testing/developer/devguide/dashboard_guide.rst
+++ b/docs/testing/user/userguide/dashboard_guide.rst
diff --git a/docs/testing/user/userguide/deprecated.rst b/docs/testing/user/userguide/deprecated.rst
deleted file mode 100644
index 80fe44a..0000000
--- a/docs/testing/user/userguide/deprecated.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International License.
-.. http://creativecommons.org/licenses/by/4.0
-
-***********************************
-Bottlenecks - Deprecated Test Cases
-***********************************
-
-.. This index.rst file is used to structure and organise the content in these directories.
-.. The documentation toolchain will create web and pdf versions of the content of this file.
-
-.. toctree::
- :maxdepth: 1
-
- ./rubbos/rubbos_basic.rst
- ./rubbos/rubbos_tc1101.rst
- ./rubbos/rubbos_tc1201.rst
- ./rubbos/rubbos_tc1301.rst
- ./rubbos/rubbos_tc1401.rst
- ./rubbos/rubbos_heavy_tc1101.rst
- ./vstf/vstf_Ti1.rst
- ./vstf/vstf_Ti2.rst
- ./vstf/vstf_Ti3.rst
- ./vstf/vstf_Tn1.rst
- ./vstf/vstf_Tn2.rst
- ./vstf/vstf_Tu1.rst
- ./vstf/vstf_Tu2.rst
- ./vstf/vstf_Tu3.rst
-
diff --git a/docs/testing/user/userguide/index.rst b/docs/testing/user/userguide/index.rst
index 795530d..8e959ab 100644
--- a/docs/testing/user/userguide/index.rst
+++ b/docs/testing/user/userguide/index.rst
@@ -1,17 +1,16 @@
.. This work is licensed under a Creative Commons Attribution 4.0 International License.
.. http://creativecommons.org/licenses/by/4.0
+.. (c) Huawei Technologies Co.,Ltd and others.
-**************************
-Bottlenecks - User Guide
-**************************
-
-.. This index.rst file is used to structure and organise the content in these directories.
-.. The documentation toolchain will create web and pdf versions of the content of this file.
+***************************
+Bottlenecks - Testing Guide
+***************************
.. toctree::
:maxdepth: 1
- ./posca/posca_stress_ping.rst
- ./posca/posca_stress_traffic.rst
- ./deprecated.rst
+ ./overview.rst
+ ./posca_guide.rst
+ ./dashboard_guide.rst
+ ./test_cases.rst
diff --git a/docs/testing/developer/devguide/overview.rst b/docs/testing/user/userguide/overview.rst
index f2e8bff..a930229 100644
--- a/docs/testing/developer/devguide/overview.rst
+++ b/docs/testing/user/userguide/overview.rst
@@ -6,10 +6,10 @@
Project Testing Guide
*********************
-For each *test suite*, you can either setup *test story* or *test case* to run
-certain test. *test story* could include several *test cases* as a set in one
-configuration file. You could then call the *test story* or *test case* by using
-Bottlencks CLI or Python build process.
+For each *testsuite*, you can either setup *teststory* or *testcase* to run
+certain test. *teststory* comprises several *testcases* as a set in one
+configuration file. You could call *teststory* or *testcase* by using
+Bottlencks user interfaces.
Details will be shown in the following section.
Brief Introdcution of the Test suites in Project Releases
diff --git a/docs/testing/user/userguide/posca/posca_stress_ping.rst b/docs/testing/user/userguide/posca/posca_factor_ping.rst
index 953ff4b..953ff4b 100644
--- a/docs/testing/user/userguide/posca/posca_stress_ping.rst
+++ b/docs/testing/user/userguide/posca/posca_factor_ping.rst
diff --git a/docs/testing/user/userguide/posca/posca_stress_traffic.rst b/docs/testing/user/userguide/posca/posca_factor_system_bandwidth.rst
index d0e702f..d0e702f 100644
--- a/docs/testing/user/userguide/posca/posca_stress_traffic.rst
+++ b/docs/testing/user/userguide/posca/posca_factor_system_bandwidth.rst
diff --git a/docs/testing/developer/devguide/posca_guide.rst b/docs/testing/user/userguide/posca_guide.rst
index ae6c248..ae6c248 100644
--- a/docs/testing/developer/devguide/posca_guide.rst
+++ b/docs/testing/user/userguide/posca_guide.rst
diff --git a/docs/testing/user/userguide/rubbos/rubbos_basic.rst b/docs/testing/user/userguide/rubbos/rubbos_basic.rst
deleted file mode 100644
index ffef6c4..0000000
--- a/docs/testing/user/userguide/rubbos/rubbos_basic.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description Basic
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos Basic |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_Basic |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 tomcat, 1 Apache and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_basic.yaml |
-| | |
-| | client number: 1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst b/docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst
deleted file mode 100644
index 08251c7..0000000
--- a/docs/testing/user/userguide/rubbos/rubbos_heavy_tc1101.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-******************************************************
-Bottlenecks Rubbos Test Case Description Heavy TC1101
-******************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC Heavy1101 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_heavy_tc1101 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 tomcat, 1 Apache and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos-heavy_1-1-0-1.yaml |
-| | |
-| | client number: 10 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1101.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1101.rst
deleted file mode 100644
index 2a26131..0000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1101.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1101
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1101 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1101 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 tomcat, 1 Apache and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-1-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1201.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1201.rst
deleted file mode 100644
index 9b6a5f9..0000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1201.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1201
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1201 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1201 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 Apache, 2 tomcat and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-2-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1301.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1301.rst
deleted file mode 100644
index db4e0b6..0000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1301.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1301
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1301 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1301 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 Apache, 3 tomcat and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-3-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/rubbos/rubbos_tc1401.rst b/docs/testing/user/userguide/rubbos/rubbos_tc1401.rst
deleted file mode 100644
index f195d23..0000000
--- a/docs/testing/user/userguide/rubbos/rubbos_tc1401.rst
+++ /dev/null
@@ -1,30 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-************************************************
-Bottlenecks Rubbos Test Case Description TC1401
-************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks Rubbos TC1401 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_rubbos_tc1401 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | Rubbos platform for 1 Apache, 4 tomcat and 1 mysql. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/rubbos/testcase_cfg/rubbos_1-4-0-1.yaml |
-| | |
-| | client number: 5 |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/developer/devguide/deprecated.rst b/docs/testing/user/userguide/test_cases.rst
index 1566f38..57e338e 100644
--- a/docs/testing/developer/devguide/deprecated.rst
+++ b/docs/testing/user/userguide/test_cases.rst
@@ -2,14 +2,12 @@
.. http://creativecommons.org/licenses/by/4.0
.. (c) Huawei Technologies Co.,Ltd and others.
-**************************************
-Bottlenecks - Deprecated Testing Guide
-**************************************
-
+************************
+Bottlenecks - Test Cases
+************************
.. toctree::
:maxdepth: 1
- ./rubbos_guide.rst
- ./vstf_guide.rst
-
+ ./posca/posca_factor_system_bandwidth.rst
+ ./posca/posca_factor_ping.rst
diff --git a/docs/testing/user/userguide/vstf/vstf_Ti1.rst b/docs/testing/user/userguide/vstf/vstf_Ti1.rst
deleted file mode 100644
index ce1690b..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Ti1.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Ti1
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Ti1 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Ti1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Ti1. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Ti1.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Ti2.rst b/docs/testing/user/userguide/vstf/vstf_Ti2.rst
deleted file mode 100644
index 58cb40f..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Ti2.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Ti2
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Ti2 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Ti2 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Ti2. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Ti2.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Ti3.rst b/docs/testing/user/userguide/vstf/vstf_Ti3.rst
deleted file mode 100644
index 3bb9dfc..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Ti3.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Ti3
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Ti3 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Ti3 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Ti3. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Ti3.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tn1.rst b/docs/testing/user/userguide/vstf/vstf_Tn1.rst
deleted file mode 100644
index 5c591a9..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Tn1.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tn1
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tn1 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tn1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tn1. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tn1.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tn2.rst b/docs/testing/user/userguide/vstf/vstf_Tn2.rst
deleted file mode 100644
index 4b6d0c4..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Tn2.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tn2
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tn2 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tn2 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tn2. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tn2.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tu1.rst b/docs/testing/user/userguide/vstf/vstf_Tu1.rst
deleted file mode 100644
index cf27bb2..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Tu1.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tu1
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tu1 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tu1 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tu1. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tu1.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tu2.rst b/docs/testing/user/userguide/vstf/vstf_Tu2.rst
deleted file mode 100644
index 2ae8446..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Tu2.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tu2
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tu2 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tu2 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tu2. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tu2.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-
diff --git a/docs/testing/user/userguide/vstf/vstf_Tu3.rst b/docs/testing/user/userguide/vstf/vstf_Tu3.rst
deleted file mode 100644
index 4e090f1..0000000
--- a/docs/testing/user/userguide/vstf/vstf_Tu3.rst
+++ /dev/null
@@ -1,28 +0,0 @@
-.. This work is licensed under a Creative Commons Attribution 4.0 International
-.. License.
-.. http://creativecommons.org/licenses/by/4.0
-.. (c) OPNFV, Huawei Tech and others.
-
-*******************************************************************
-Bottlenecks vSwitch Test Framework(VSTF) Test Case Description Tu3
-*******************************************************************
-
-
-+-----------------------------------------------------------------------------+
-|Bottlenecks VSTF Tu3 |
-| |
-+--------------+--------------------------------------------------------------+
-|test case name| opnfv_bottlenecks_vstf_Tu3 |
-| | |
-+--------------+--------------------------------------------------------------+
-|description | vSwitch test Tu3. |
-| | |
-+--------------+--------------------------------------------------------------+
-|configuration | config file: |
-| | /testsuite/vstf/testcase_cfg/vstf_Tu3.yaml |
-| | |
-+--------------+--------------------------------------------------------------+
-|test result | throughput & latency |
-| | |
-+--------------+--------------------------------------------------------------+
-