summaryrefslogtreecommitdiffstats
path: root/test_spec
AgeCommit message (Collapse)AuthorFilesLines
2015-08-24docs: Migrate Docs to RST format and new dir docs/Maryam Tahhan2-2277/+0
Migrate all existing VSPERF documentation to a new directory called docs/ and convert to ReStructuredText format. It's recommended that any doc changes in the future are tested with: http://rst.ninjs.org/. Change-Id: I18aa574b1259986502bde4ceef1fae7c6a5c1f33 JIRA: VSPERF-60 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com
2015-08-18TestSpec: LTD.Scalability.RFC2544.0PacketLossMaryam Tahhan1-3/+3
Clarify that the test intends to test the fastpath and thus the flows need to be installed on the vSwitch before passing traffic Change-Id: I7d72ca66d7b854463c3b809c16fd8c8088353b99 JIRA: VSPERF-19 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-08-18TestSpec: Address IETF-93 comments with 2889 Soak testsAl Morton1-6/+6
This patch makes it clear that the Soak tests use a method consistent with RFC 2889 to simplify test system interactions. JIRA: VSPERF-49 Change-Id: I82ca1e6ae6e066f72b343ece72ba98fab2aab97a Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-08-12TestSpec: Add actions to flow ClassificationMaryam Tahhan1-1/+1
Clarify that a flow has an associated action and isn't simply packets with matching header fields. Change-Id: Iffa7ae121049d8ec798f937082a733ef520e9d05 JIRA: VSPERF-49 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-08-12TestSpec: Add compiler details to test report infoMaryam Tahhan1-0/+1
Change-Id: I19d574607c29cbb8401047ab7d1255ba7282ef63 JIRA: VSPERF-47 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com
2015-08-12test_spec: Clarify LTD.CPU.RFC2544.0PacketLossBilly O'Mahony1-0/+36
Make changes based on comments from review at VSPERF weekly call 2015-08-05. JIRA: VSPERF-2 Change-Id: I141c2b35c5469270ba8e3ecfdf88b93ec8e3d35a Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-08-07test_spec: Add LTD.CPDPCouplingFlowAdditionBilly O'Mahony1-1/+51
JIRA: VSPERF-2 Change-Id: Iab66730606d9137e0f2cac195f7c98bec71fa072 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-08-05test_spec: Clarify LTD.PacketLatency.InitialPacketProcessingLatencyBilly O'Mahony1-2/+8
Make changes based on comments from review at VSPERF weekly call 2015-22-27. JIRA: VSPERF-2 Change-Id: Ic11a021fee58876d0a402a07195c0f1746fc1705 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-08-05test_spec: Clarify LTD.Throughput.RFC2889.BroadcastFrameForwardingBilly O'Mahony1-1/+12
Make changes based on comments from review at VSPERF weekly call 2015-07-15. JIRA: VSPERF-2 Change-Id: I3742518edaea09c9a32a71c9cccc3c4c09fd4598 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-29test_spec: Adding vm2vm on separate hosts use caseT V Rao1-0/+34
The deployment scenario covers the use case of traffic passing between two physical machines where VMs are hosted on each physical machine. JIRA: VSPERF-44 Change-Id: I74a507537587fea4eaa887a8d9fd27a40a8ce0e7 Signed-off-by: T V Rao <tv.rao@freescale.com>
2015-07-29test_spec: Add LTD.PacketDelayVariation.RFC3393.SoakBilly O'Mahony1-0/+23
JIRA: VSPERF-2 Change-Id: I2aa2e929d67a0674c07c975c4d91cdcff50f2c40 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-27test_spec: Add LTD.MemoryBandwidth.RFC2544.0PacketLoss.ScalabilityBilly O'Mahony1-3/+42
* Also fixing typo on RFC2885 -> RFC2285 JIRA: VSPERF-22 Change-Id: I99c97b6850c0340db0f68e10e21436d6898842dd Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-16test_spec: Clarify LTD.Throughput.RFC2544.SoakFrameModificationBilly O'Mahony1-11/+6
Based on comments from weekly VSPERF call 2015-06-24. JIRA: VSPERF-2 Change-Id: I204ea21b5ecb634e0bec249ed826ff2402d67d9e Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
2015-07-16test_spec: Clarify LTD.Throughput.RFC2889.ErrorFramesFilteringBilly O'Mahony1-3/+4
Make changes based on comments from review at VSPERF weekly call 2015-07-15. JIRA: VSPERF-2 Change-Id: I96e9a0c518e7d857d6e58d7bcc96e4691957aac0 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-10test_spec: Add new test definition LTD.Throughput.RFC2544.ProfileBilly O'Mahony1-0/+33
This test was proposed at VSPERF weekly call 2015-06-17. JIRA: VSPERF-2 Change-Id: I1ca0749637473ab2df68b9cd6725eaae78cafa46 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-09TestSpec: Add flow Classification sectionMaryam Tahhan1-0/+3
Add a section that specifies the fields we should match on as part of a flow. JIRA: VSPERF-49 Change-Id: Ice5496076ac77bceca8ddadd13bea396177f2901 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-07-09IETF Summary: Editorial changes prior to submissionAl Morton1-7/+7
Final and Submitted version 00 of IETF Summary Change-Id: Ibfdb2d2edcd29107d887e67887f15935c7d3ffd7 JIRA: VSPERF-43 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-07-09TestSpec: Add test report information detailsMaryam Tahhan1-0/+39
Add a section that specifies the test parameters that should be recorded to minimize the variation in test results for test runs. JIRA: VSPERF-47 Change-Id: Ifce7ca1174ef83a999c6ddfe1ddd026309ef214b Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-09TestSpec: Add a section on system validationMaryam Tahhan1-0/+85
Add an LTD section on system validation and isolation. JIRA: VSPERF-48 Change-Id: Ib686d22753d364da1197290886ec37a12724df32 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-07-08test_spec: Clarify RFC2889.MaxForwardingRateBilly O'Mahony1-5/+5
Changes based on review from VSPERF weekly call 2015-07-01. * Change name from ForwardingRate to MaxForwardingRate * Add section number to reference to RFC2889. JIRA: VSPERF-33 Change-Id: Ic4ff9be5cf6a3d61fb5aa7c3216d3ff7c348677b Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-07IETFSummary: Expand IETF summary of LTD Sec 3Al Morton1-138/+491
Added a section on new concfiguration parameters and a another section on flow classification/matching. Fixed diagrams to match starting offset. JIRA: VSPERF-43 Change-Id: Iad8742810c37ffe33de4005e3b2150593fe2defe Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Signed-off-by: Al Morton <acmorton@att.com>
2015-06-30TestSpec: Add Test Summary ListMaryam Tahhan1-0/+19
Add a summary list of the tests defined so far. Change-Id: I60011bf79515d7b95563b6f3132d01a32ae5e394 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-25test_spec: update spec with MAC learning testsMaryam Tahhan1-2/+2
Update LTD.Throughput.RFC2889.AddressCachingCapacity and LTD.Throughput.RFC2889.AddressLearningRate to indicate they are only applicable to vswitches that are capable of MAC learning. JIRA: VSPERF-35 Change-Id: I7b0f5c98347ba7d8f0a774982bd574a7d306b540 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-24Merge "test_spec: Clarify ↵Maryam Tahhan1-2/+2
LTD.Throughput.RFC2544.PacketLossRatioFrameModification"
2015-06-24Merge "TestSpec: Add LTD.Scalability.RFC2544.0PacketLoss"Maryam Tahhan1-0/+42
2015-06-24Merge "test_spec: Clarify LTD.Throughput.RFC2544.Soak"Maryam Tahhan1-3/+2
2015-06-24test_spec: Clarify LTD.Throughput.RFC2544.SoakBilly O'Mahony1-3/+2
Based on comments from weekly VSPERF call 2015-05-20. JIRA: VSPERF-2 Change-Id: Ic36b6c1260168a7bb0b003585b3abe64a2841820 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-06-24test_spec: Clarify RFC6201.ResetTimeBilly O'Mahony1-5/+12
Make changes based on comments from review at VSPERF weekly call 2015-05-27. JIRA: VSPERF-2 Change-Id: I7e4f0e1137d9dd96953f5b96c5179b40906c23b9 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-06-24TestSpec: Add LTD.Scalability.RFC2544.0PacketLossBilly O'Mahony1-0/+42
JIRA: VSPERF-19 Change-Id: I4b85ed0291d785b46222ab1a965bc377c05130ed Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-17IETFSummary: Add initial IETF summary of LTDMaryam Tahhan2-32/+588
JIRA: VSPERF-43 Change-Id: I1020b2845a644d3002c08ede3a6dfa8fc068781a Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Signed-off-by: Al Morton <acmorton@att.com>
2015-06-17TestSpec: Modify soak tests to measure PDVMaryam Tahhan1-0/+2
Add PDV as defined by RFC 5841 as one of the metrics collected by the defined soak tests. JIRA: VSPERF-14 Change-Id: Ida110347ec3a60e0d8fba03ab20407e11e40b96a Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-17Merge "test_spec: Clarify LTD.Throughput.RFC2544.SystemRecoveryTime"Maryam Tahhan1-5/+5
2015-06-10TestSpec: Add LTD.Latency.SlowpathMaryam Tahhan1-0/+34
Add a definition for Slowpath packet delay test. JIRA: VSPERF-40 Change-Id: I43727ad966c706bd3d4fad3a463798af3ccd72f8 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Aihua Li <aihua.li@huawei.com>
2015-06-10TestSpec: Modify LTD access permissionsMaryam Tahhan1-0/+0
Modify the LTD access permissions so it's not executable. Change-Id: I234f84da5901934cb3f55830225a326ba03c1193 JIRA: VSPERF-2 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Aihua Li <aihua.li@huawei.com>
2015-06-04test_spec: Clarify LTD.Throughput.RFC2544.SystemRecoveryTimeBilly O'Mahony1-5/+5
Make changes based on review from VSPERF weekly call 2015-05-27. JIRA: VSPERF-2 Change-Id: I4e2caec3f0ad52a7ef3773372aee4f06791631de Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-05-29test_spec: Clarify LTD.Throughput.RFC2544.PacketLossRatioFrameModificationBilly O'Mahony1-2/+2
Based on comments from weekly VSPERF call 2015-05-20. JIRA: VSPERF-2 Change-Id: I7707ca62a870509baaff557715da31bb7a254b70 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-05-20testspec: cleanup + update tests with new metricsMaryam Tahhan1-20/+28
Cleanup and update the test specification with CPU and memory utilization metrics that can be collected in conjunction with the other metrics for the test. JIRA: VSPERF-2 Change-Id: Ia70d83a9cba724e2d6f503984a8db537d4a1f395 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-04-07TestSpec: Add LTD.Throughput.RFC2889.BroadcastFrameForwardingMaryam Tahhan1-0/+20
Add a definition for RFC2889 Broadcast Frame Forwarding Test. JIRA: VSPERF-37 Change-Id: I7d6e11d5c911fe372c5dcc0475d6a7f2c48ecd71 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-04-07TestSpec: Add LTD.Throughput.RFC2889.ErrorFramesFilteringMaryam Tahhan1-0/+32
Add a definition for RFC2889 Error Frames Filtering Test. JIRA: VSPERF-36 Change-Id: I366108424a1188256e5977952e9a7fbbf09377ba Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-04-07TestSpec: Add LTD.Throughput.RFC2889.AddressLearningRateMaryam Tahhan1-0/+25
Add a definition for RFC2889 Address Learning Rate Test JIRA: VSPERF-35 Change-Id: I646383d09cf0cfb14712879f11217319cf2ce715 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-04-07TestSpec: Add LTD.Throughput.RFC2889.AddressCachingCapacityMaryam Tahhan1-0/+29
Add a definition for RFC2889 Address Caching Capacity Test. JIRA: VSPERF-34 Change-Id: I6557d3bf865f38c3eb02cfe2133749b135501685 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-04-07TestSpec: Add LTD.Throughput.RFC2889.ForwardPressureMaryam Tahhan1-0/+24
Add a definition for RFC2889 Forward Pressure Test JIRA: VSPERF-33 Change-Id: Ia036c9b52aba49ca68d0a2712d606fc14f5cb22a Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-04-07TestSpec: LTD.Throughput.RFC2889.ForwardingRateMaryam Tahhan1-0/+30
Add a definition for RFC2889 Forwarding Rate Test. JIRA: VSPERF-32 Change-Id: If756ff84ad4b42ed5aa8ded2b7c7df12b76eaca1 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-03-27TestSpec: Add LTD.Throughput.RFC6201.ResetTimeMaryam Tahhan1-0/+53
Add a definition for RFC 6201 Reset Time Test Change-Id: I31cd5befb1e662697fe4d8ff81caa229ae6bfb64 JIRA: VSPERF-13 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-03-27TestSpec: Add LTD.Throughput.RFC2544.SoakFrameModificationMaryam Tahhan1-0/+44
Add a definition for RFC 2544 X% packet loss Throughput Soak Test with packet modification. Change-Id: I60f8f8726d0b01f73990566a1ce286917c3be940 JIRA: VSPERF-16 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-03-27TestSpec: Add LTD.Throughput.RFC2544.SoakMaryam Tahhan1-0/+26
Add a definition for RFC 2544 X% packet loss Throughput Soak Test Change-Id: I6cd457106548d01c3edd911b46f33e17aecd533b JIRA: VSPERF-14 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-03-25TestSpec: Add LTD.Throughput.RFC2544.BackToBackFramesMaryam Tahhan1-0/+25
Add a definition for RFC 2544 Back To Back Frames Test. Change-Id: I15499eb6874227e189fa9828b8488f9c06c0b1a1 JIRA: VSPERF-12 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-03-22TestSpec: Add LTD.Throughput.RFC2544.SystemRecoveryTimeMaryam Tahhan1-0/+30
Add a definition for RFC 2544 System Recovery Time Test. Change-Id: I2fa10e749616bdc1118f17a6024d30bedb1ede07 JIRA: VSPERF-11 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-03-11TestSpec: Add Throughput.RFC2544.PacketLossRatioFrameModificationMaryam Tahhan1-0/+41
Add a definition for RFC 2544 X% packet loss Throughput and Latency Test with packet modification. Change-Id: I0ca2e98b814d9b9eebd47293d6222ae8872c72a1 JIRA: VSPERF-7 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Tim Irnich <tim.irnich@ericsson.com> Reviewed-by: Aihua Li <aihua.li@huawei.com>
2015-03-11TestSpec: Add Throughput.RFC2544.PacketLossRatioMaryam Tahhan1-65/+105
Add a definition for RFC 2544 X% packet loss Throughput and Latency Test. This patch also addresses some indentation issues and fixes a typo. Change-Id: I58c50353df5f2e575bbd69fa2b41fa9fabf67ff2 JIRA: VSPERF-8 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Aihua Li <aihua.li@huawei.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>