diff options
| -rw-r--r-- | docs/release/release-notes.rst | 82 | ||||
| -rw-r--r-- | docs/results/overview.rst | 10 | ||||
| -rw-r--r-- | docs/results/results.rst | 5 | ||||
| -rw-r--r-- | docs/results/yardstick-opnfv-vtc.rst | 40 |
4 files changed, 111 insertions, 26 deletions
diff --git a/docs/release/release-notes.rst b/docs/release/release-notes.rst index 23f2f012e..b8171a135 100644 --- a/docs/release/release-notes.rst +++ b/docs/release/release-notes.rst @@ -39,6 +39,9 @@ Version History | *Date* | *Version* | *Comment* | | | | | +---------------+--------------------+---------------------------------+ +| Mar 30th,2016 | 2.0 | Brahmaputra release | +| | | | ++---------------+--------------------+---------------------------------+ | Feb 25th,2016 | 1.0 | Brahmaputra release | | | | | +---------------+--------------------+---------------------------------+ @@ -106,8 +109,13 @@ testing: * Parser +* Test cases added in Brahmaputra2.0: + + * virtual Traffic Classifier + The *Yardstick framework* is developed in the OPNFV community, by the -Yardstick_ team. +Yardstick_ team. The *virtual Traffic Classifier* is a part of the Yardstick +Project. .. note:: The test case description template used for the Yardstick test cases is based on the document ETSI-ISG NFV-TST001_; the results report template @@ -121,16 +129,16 @@ Release Data | **Project** | Yardstick | | | | +--------------------------------------+--------------------------------------+ -| **Repo/tag** | yardstick/brahmaputra.1.0 | +| **Repo/tag** | yardstick/brahmaputra.2.0 | | | | +--------------------------------------+--------------------------------------+ -| **Yardstick Docker image tag** | brahmaputra.1.0 | +| **Yardstick Docker image tag** | brahmaputra.2.0 | | | | +--------------------------------------+--------------------------------------+ | **Release designation** | Brahmaputra | | | | +--------------------------------------+--------------------------------------+ -| **Release date** | Feb 25th, 2016 | +| **Release date** | Mar 30th, 2016 | | | | +--------------------------------------+--------------------------------------+ | **Purpose of the delivery** | OPNFV Brahmaputra release | @@ -144,7 +152,7 @@ Version Change Module Version Changes ~~~~~~~~~~~~~~~~~~~~~~ -This is the first tracked release of Yardstick. It is based on following +This is the second tracked release of Yardstick. It is based on following upstream versions: - OpenStack Liberty @@ -155,16 +163,17 @@ upstream versions: Document Version Changes ~~~~~~~~~~~~~~~~~~~~~~~~ -This is the first tracked version of the Yardstick framework in OPNFV. -It includes the following documentation: +This is the second tracked version of the Yardstick framework in OPNFV. +It includes the following documentation updates: -- Yardstick User Guide +- Yardstick User Guide: added software architecture chapter -- Yardstick Code Documentation +- Yardstick Code Documentation: no changes -- Yardstick Release Notes for Yardstick +- Yardstick Release Notes for Yardstick: this document -- Test Results report for Brahmaputra testing with Yardstick +- Test Results report for Brahmaputra testing with Yardstick: added test cases +and results for virtual Traffic Classifier Reason for Version @@ -173,14 +182,35 @@ Reason for Version Feature additions ~~~~~~~~~~~~~~~~~ -This is the first tracked version of OPNFV Yardstick. ++----------------------------+------------------------------------------------+ +| **JIRA REFERENCE** | **SLOGAN** | +| | | ++----------------------------+------------------------------------------------+ +| JIRA: YARDSTICK-227 | Heat HTTPS SSL support. | +| | | ++----------------------------+------------------------------------------------+ Corrected Faults ~~~~~~~~~~~~~~~~ -This is the first tracked version of OPNFV Yardstick. - ++----------------------------+------------------------------------------------+ +| **JIRA REFERENCE** | **SLOGAN** | +| | | ++----------------------------+------------------------------------------------+ +| JIRA: - | Change copyrights for base scenario, runners, | +| | dispatchers, cover. | +| | | ++----------------------------+------------------------------------------------+ +| JIRA: - | Update setup.py and dependencies | +| | | ++----------------------------+------------------------------------------------+ +| JIRA: - | Add missing dependencies to docker file | +| | | ++----------------------------+------------------------------------------------+ +| JIRA: - | Fix Heat template for noisy neighbors deploy | +| | | ++----------------------------+------------------------------------------------+ Known Faults ~~~~~~~~~~~~ @@ -202,6 +232,9 @@ Known Faults | | parsed: cannot register CLI option. | | | | +----------------------------+------------------------------------------------+ +| JIRA: YARDSTICK-231 | Installation instructions on Wiki not accurate | +| | | ++----------------------------+------------------------------------------------+ .. note:: The faults not related to *Yardstick* framework, addressing scenarios which were not fully verified, are listed in the OPNFV installer's release @@ -214,22 +247,22 @@ Deliverables Software Deliverables ~~~~~~~~~~~~~~~~~~~~~ -**Yardstick framework source code <brahmaputra.1.0>** +**Yardstick framework source code <brahmaputra.2.0>** +--------------------------------------+--------------------------------------+ | **Project** | Yardstick | | | | +--------------------------------------+--------------------------------------+ -| **Repo/tag** | yardstick/brahmaputra.1.0 | +| **Repo/tag** | yardstick/brahmaputra.2.0 | | | | +--------------------------------------+--------------------------------------+ -| **Yardstick Docker image tag** | brahmaputra.1.0 | +| **Yardstick Docker image tag** | brahmaputra.2.0 | | | | +--------------------------------------+--------------------------------------+ | **Release designation** | Brahmaputra | | | | +--------------------------------------+--------------------------------------+ -| **Release date** | Feb 25th, 2016 | +| **Release date** | Mar 30th, 2016 | | | | +--------------------------------------+--------------------------------------+ | **Purpose of the delivery** | OPNFV Brahmaputra release | @@ -411,3 +444,16 @@ Delivered Test cases * Test Case for OPNFV Parser Project: * OPNFV_YARDSTICK_TCO40 - Verify Parser Yang-to-Tosca + +* Test Cases for Virtual Traffic Classifier: + + * OPNFV_YARDSTICK_TC006 - Virtual Traffic Classifier Data Plane Throughput +Benchmarking Test + + * OPNFV_YARDSTICK_TC007 - Virtual Traffic Classifier Data Plane Throughput +Benchmarking in presence of noisy neighbors Test + + * OPNFV_YARDSTICK_TC020 - Virtual Traffic Classifier Instantiation Test + + * OPNFV_YARDSTICK_TC021 - Virtual Traffic Classifier Instantiation in +presence of noisy neighbors Test diff --git a/docs/results/overview.rst b/docs/results/overview.rst index 2515703bf..cb1eebb2b 100644 --- a/docs/results/overview.rst +++ b/docs/results/overview.rst @@ -16,14 +16,14 @@ Introduction Document Identifier ------------------- -This document is part of deliverables of the OPNFV release brahmaputra.1.0 +This document is part of deliverables of the OPNFV release brahmaputra.2.0 Scope ----- -.. _Dashboard: http://130.211.154.108/grafana/dashboard/db/yardstick-main +.. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main .. _Jenkins: https://build.opnfv.org/ci/view/yardstick/ -.. _Scenarios: http://130.211.154.108/grafana/dashboard/db/yardstick-scenarios +.. _Scenarios: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-scenarios This document provides an overview of the results of test cases developed by the OPNFV Yardstick Project, executed on OPNFV community labs. @@ -82,13 +82,13 @@ Document change procedures and history | **Project** | Yardstick | | | | +--------------------------------------+--------------------------------------+ -| **Repo/tag** | yardstick/brahmaputra.1.0 | +| **Repo/tag** | yardstick/brahmaputra.2.0 | | | | +--------------------------------------+--------------------------------------+ | **Release designation** | Brahmaputra | | | | +--------------------------------------+--------------------------------------+ -| **Release date** | Feb 25th, 2016 | +| **Release date** | Mar 30th, 2016 | | | | +--------------------------------------+--------------------------------------+ | **Purpose of the delivery** | OPNFV Brahmaputra release test | diff --git a/docs/results/results.rst b/docs/results/results.rst index f046e626b..d3c23f6d6 100644 --- a/docs/results/results.rst +++ b/docs/results/results.rst @@ -14,7 +14,7 @@ Yardstick Test Results Scenario Results ================ -.. _Dashboard: http://130.211.154.108/grafana/dashboard/db/yardstick-main +.. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main .. _Jenkins: https://build.opnfv.org/ci/view/yardstick/ The following documents contain results of Yardstick test cases executed on @@ -38,7 +38,6 @@ cases suite: fuel-os-odl_l2-nofeature-ha.rst fuel-os-onos-nofeature-ha.rst joid-os-odl_l2-nofeature-ha.rst - yardstick-opnfv-vtc.rst Limitations @@ -95,5 +94,7 @@ The following features were verified by Yardstick test cases: * Parser + * Virtual Traffic Classifier (see :doc:`yardstick-opnfv-vtc`) + .. note:: The test cases for IPv6 and Parser Projects are included in the compass scenario. diff --git a/docs/results/yardstick-opnfv-vtc.rst b/docs/results/yardstick-opnfv-vtc.rst index 768cb69df..059b5491f 100644 --- a/docs/results/yardstick-opnfv-vtc.rst +++ b/docs/results/yardstick-opnfv-vtc.rst @@ -6,7 +6,7 @@ .. _Dashboard007: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-tc007 .. _Dashboard020: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-tc020 .. _Dashboard021: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-tc021 - +.. _DashboardVTC: http://testresults.opnfv.org/grafana/dashboard/db/vtc-dashboard ==================================== Test Results for yardstick-opnfv-vtc ==================================== @@ -69,6 +69,12 @@ It verifies that a newly instantiated vTC is alive and functional and its instan is correctly supported by the underlying infrastructure when noisy neighbors are present. Results of the test are shown in the Dashboard021_ +* Generic + +In the Generic scenario the Virtual Traffic Classifier is running on a standard Openstack +setup and traffic is being replayed from a neighbor VM. The traffic sent contains +various protocols and applications, and the VTC identifies them and exports the data. +Results of the test are shown in the DashboardVTC. Detailed test results --------------------- @@ -128,6 +134,12 @@ test case configuration: For all the test cases, the user can specify different values for the parameters. +* Generic + +The results listed in the previous section have been obtained, using a +standard Openstack setup. +The user can replay his/her own traffic and see the corresponding results. + Rationale for decisions ----------------------- @@ -170,6 +182,16 @@ correctly by the vTC The test is declared as PASSED if all the packets are correcly received by the packet generator and they have been modified by the virtual Traffic Classifier as required. +* Generic + +The execution of the test consists of the following actions: + +- The vTC is deployed on the OpenStack testbed; +- The traffic generator VM is deployed on the Openstack Testbed; +- Traffic data are relevant to the network setup; +- Traffic is sent to the vTC; + + Conclusions and recommendations ------------------------------- @@ -208,3 +230,19 @@ Using the configuration with SR-IOV and large flavor, the expected result is tha correctly instantiated, it is able to receive and send packets using SR-IOV technology and to forward packets back to the packet generator changing the TCP/IP header as required, also in presence of noisy neighbors. + +* Generic + +The obtained results correspond to the expected behaviour of the virtual Traffic Classifier. +Using the aforementioned configuration the expected application protocols are identified +and their traffic statistics are demonstrated in the DashboardVTC, a group of popular +applications is selected to demonstrate the sound operation of the vTC. +The demonstrated application protocols are: +- HTTP +- Skype +- Bittorrent +- Youtube +- Dropbox +- Twitter +- Viber +- iCloud |