From 3095139280fb62843efbea93c5eded3e7737eab6 Mon Sep 17 00:00:00 2001 From: Maryam Tahhan Date: Fri, 23 Jan 2015 11:12:32 +0000 Subject: test_spec: Add Introduction to test spec Added an initial test spec with the introduction to kick off the review process. Change-Id: I0ab8fd8724fe114aec502882fccb8a72450b67df JIRA: VSPERF-3 Signed-off-by: Maryam Tahhan Reviewed-by: Tim Irnich Reviewed-by: Aihua Li --- test_spec/vswitchperf_ltd.md | 61 ++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 61 insertions(+) create mode 100644 test_spec/vswitchperf_ltd.md diff --git a/test_spec/vswitchperf_ltd.md b/test_spec/vswitchperf_ltd.md new file mode 100644 index 00000000..a3062513 --- /dev/null +++ b/test_spec/vswitchperf_ltd.md @@ -0,0 +1,61 @@ +#CHARACTERIZE VSWITCH PERFORMANCE FOR TELCO NFV USE CASES LEVEL TEST DESIGN + +##Table of Contents + +- [1. Introduction](#Introduction) + - [1.1. Document identifier](#DocId) + - [1.2. Scope](#Scope) + - [1.3. References](#References) + +- [2. Details of the Level Test Design](#DetailsOfTheLevelTestDesign) + - [2.1. Features to be tested](#FeaturesToBeTested) + - [2.2. Approach](#Approach) + - [2.3. Test identification](#TestIdentification) + - [2.3.1 Throughput tests](#ThroughputTests) + - [2.3.2 Packet Delay Tests](#PacketDelayTests) + - [2.3.3 Scalability Tests](#ScalabilityTests) + - [2.3.4 CPU and Memory Consumption Tests](#CPUTests) + - [2.3.5 Coupling Between the Control Path and The Datapath Tests](#CPDPTests) + - [2.3.6 Time to Establish Flows Tests](#FlowLatencyTests) + - [2.3.7 Noisy Neighbour Tests](#NoisyNeighbourTests) + - [2.3.8 Overlay Tests](#OverlayTests) + - [2.3.9 Summary Test List](#SummaryList) + - [2.4. Feature pass/fail criteria](#PassFail) + - [2.5. Test deliverables](#TestDeliverables) + +- [3. General](#General) + - [3.1. Glossary](#Glossary) + - [3.2. Document change procedures and history](#History) + - [3.3. Contributors](#Contributors) + +
+ +--- + +##1. Introduction ## + The objective of the OPNFV project titled **“Characterize vSwitch Performance for Telco NFV Use Cases”**, is to evaluate a virtual switch to identify its suitability for a Telco Network Function Virtualization (NFV) environment. The intention of this Level Test Design (LTD) document is to specify the set of tests to carry out in order to objectively measure the current characteristics of a virtual switch in the Network Function Virtualization Infrastructure (NFVI) as well as the test pass criteria. The detailed test cases will be defined in [Section 2](#DetailsOfTheLevelTestDesign), preceded by the [Document identifier](#DocId) and the [Scope](#Scope). + + This document is currently in draft form. + + + ###1.1. Document identifier + The document id will be used to uniquely identify versions of the LTD. The format for the document id will be: OPNFV\_vswitchperf\_LTD\_ver\_NUM\_MONTH\_YEAR\_STATUS, where by the status is one of: draft, reviewed, corrected or final. The document id for this version of the LTD is: OPNFV\_vswitchperf\_LTD\_ver\_1.6\_Jan\_15\_DRAFT. + + + ###1.2. Scope + The main purpose of this project is to specify a suite of performance tests in order to objectively measure the current packet transfer characteristics of a virtual switch in the NFVI. The intent of the project is to facilitate testing of any virtual switch. Thus, a generic suite of tests shall be developed, with no hard dependencies to a single implementation. In addition, the test case suite shall be architecture independent. + + The test cases developed in this project shall not form part of a separate test framework, all of these tests may be inserted into the Continuous Integration Test Framework and/or the Platform Functionality Test Framework - if a vSwitch becomes a standard component of an OPNFV release. + + + ###1.3. References + + - [RFC 2544 Benchmarking Methodology for Network Interconnect Devices](https://www.ietf.org/rfc/rfc2544.txt) + - [RFC 2885 Benchmarking Terminology for LAN Switching Devices](https://www.ietf.org/rfc/rfc2885.txt) + - [RFC 2889 Benchmarking Methodology for LAN Switching Devices](https://www.ietf.org/rfc/rfc2889.txt) + - [RFC 3918 Methodology for IP Multicast Benchmarking](https://www.ietf.org/rfc/rfc3918.txt) + - [RFC 4737 Packet Reordering Metrics](https://www.ietf.org/rfc/rfc4737.txt) + - [RFC 5481 Packet Delay Variation Applicability Statement](https://www.ietf.org/rfc/rfc5481.txt) + +
+ -- cgit 1.2.3-korg