summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2015-07-27test_spec: Add LTD.MemoryBandwidth.RFC2544.0PacketLoss.ScalabilityBilly O'Mahony1-3/+42
* Also fixing typo on RFC2885 -> RFC2285 JIRA: VSPERF-22 Change-Id: I99c97b6850c0340db0f68e10e21436d6898842dd Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-27testcase: Add frame modification configBilly O'Mahony5-5/+58
* Added a new standard set of flow table that defaults to routing phy1 to phy2 and vice-versa and allows frame modification and tuple matches to be added independently of routing. * Add a FrameMod testcase attribute - implement this for value 'vlan' * With FrameMod == 'vlan' the reported tx_fps and rx_fps figures do not match even for RFC2544 throughtput 0% packet loss - this is a pre-existing bug and a fix will be done as a separate patch. The rx_fps figure is the reliable figure. JIRA: VSPERF-27 Change-Id: Idd137b7a101305e7aebb6fabdfb6a7a4dcf8661b Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-27BUILD: Fix Build to allow us to verify patchesMaryam Tahhan2-4/+7
Fix build so as we no longer use the HEAD of OVS master, but a specific commit and modify the DPDK build to edit the configuration file. Change-Id: I0067b53e5c5295d87b9daf49a9d1ff9e4081558e Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-07-17Fix stability issues at the end of testcase run.Martin Klozik2-2/+5
Cleanup procedure is performed at the end of each testcase run. Procedure consists of termination of vswitch processes, removal of unneeded kernel drivers, unmount of hugepages, etc. There must be enough time for vswitch processes to terminate properly before OS resources are freed. Otherwise OS stability issues can be observed (e.g. server reboot). Process termination is implemented by sending signal SIGTERM to the process instead of previously used signal SIGINT. Change-Id: I7e8c7a86ae2a75f2a18db0d9340726fb649a685b JIRA: VSPERF-27 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-17Add new biDirectional parameter for particular testcaseRadek Zetik5-14/+28
This change introduces new parameter which sets the communication between ports either uni-directional or bi-directional. JIRA: VSPERF-27 Change-Id: I4eb06f5c91ef42147878cb68cbad24e69eb002c1 Signed-off-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Meghan Halton <meghan.halton@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
2015-07-16test_spec: Clarify LTD.Throughput.RFC2544.SoakFrameModificationBilly O'Mahony1-11/+6
Based on comments from weekly VSPERF call 2015-06-24. JIRA: VSPERF-2 Change-Id: I204ea21b5ecb634e0bec249ed826ff2402d67d9e Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com>
2015-07-16test_spec: Clarify LTD.Throughput.RFC2889.ErrorFramesFilteringBilly O'Mahony1-3/+4
Make changes based on comments from review at VSPERF weekly call 2015-07-15. JIRA: VSPERF-2 Change-Id: I96e9a0c518e7d857d6e58d7bcc96e4691957aac0 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-14Support of windows drive letter in path to result dir.Martin Klozik1-1/+1
Parsing of path with IxNetwork test results has been fixed to accept also windows drive letter. Change affects parsing of TRAFFICGEN_IXNET_TESTER_RESULT_DIR configuration parameter. Modified file: * tools/pkt_gen/ixnet/ixnet.py JIRA: VSPERF-27 Change-Id: I3dd6123e051952e6fd3f83cd9691341472d2960e Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com> Reviewed-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-10test_spec: Add new test definition LTD.Throughput.RFC2544.ProfileBilly O'Mahony1-0/+33
This test was proposed at VSPERF weekly call 2015-06-17. JIRA: VSPERF-2 Change-Id: I1ca0749637473ab2df68b9cd6725eaae78cafa46 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-09TestSpec: Add flow Classification sectionMaryam Tahhan1-0/+3
Add a section that specifies the fields we should match on as part of a flow. JIRA: VSPERF-49 Change-Id: Ice5496076ac77bceca8ddadd13bea396177f2901 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-07-09IETF Summary: Editorial changes prior to submissionAl Morton1-7/+7
Final and Submitted version 00 of IETF Summary Change-Id: Ibfdb2d2edcd29107d887e67887f15935c7d3ffd7 JIRA: VSPERF-43 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-07-09TestSpec: Add test report information detailsMaryam Tahhan1-0/+39
Add a section that specifies the test parameters that should be recorded to minimize the variation in test results for test runs. JIRA: VSPERF-47 Change-Id: Ifce7ca1174ef83a999c6ddfe1ddd026309ef214b Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-09TestSpec: Add a section on system validationMaryam Tahhan1-0/+85
Add an LTD section on system validation and isolation. JIRA: VSPERF-48 Change-Id: Ib686d22753d364da1197290886ec37a12724df32 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-07-09vsperf: Add --xunit supportBilly O'Mahony2-1/+45
Generate xmlrunner output for use by Jenkins, but without actually using xmlrunner to discover & run tests. JIRA: VSPERF-27 Change-Id: I000099c841f3755043104f251837e3d4c214c6bb Signed-off-by: Billy O'mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-08test_spec: Clarify RFC2889.MaxForwardingRateBilly O'Mahony1-5/+5
Changes based on review from VSPERF weekly call 2015-07-01. * Change name from ForwardingRate to MaxForwardingRate * Add section number to reference to RFC2889. JIRA: VSPERF-33 Change-Id: Ic4ff9be5cf6a3d61fb5aa7c3216d3ff7c348677b Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-07Port RFC2544.BackToBackFrames test to vsperfDino Simeon Madarang4-24/+27
Add RFC2544.BackToBackFrames test and fix pylint errors. Remove irrelevant values of back to back test results. JIRA: VSPERF-46 Change-Id: I7a0dfd9494b509c3be7bffc0678228838d3059a1 Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Meghan Halton <meghan.halton@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Martin Klozik<martinx.klozik@intel.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-07-07IETFSummary: Expand IETF summary of LTD Sec 3Al Morton1-138/+491
Added a section on new concfiguration parameters and a another section on flow classification/matching. Fixed diagrams to match starting offset. JIRA: VSPERF-43 Change-Id: Iad8742810c37ffe33de4005e3b2150593fe2defe Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Signed-off-by: Al Morton <acmorton@att.com>
2015-06-30src: update DPDK and OVS build to DPDK2.0.0Maryam Tahhan4-15/+10
Update DPDK to build DPDK v2.0.0 and update OVS to link to that version of DPDK. Change-Id: Icc8f9fbcc7a4804a3648f0027b4ea2140888d5d1 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Mark B Kavanagh <mark.b.kavanagh@intel.com> Reviewed-by: TV Rao <tv.rao@freescale.com>
2015-06-30doc: add IXIA client setup informationMaryam Tahhan2-1/+15
Add information on how to install the IXIA client software that works with vsperf. Change-Id: Ia9923617e713c56ba5ecedd0d3cdf0388221dcac Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Mark B Kavanagh <mark.b.kavanagh@intel.com> Reviewed-by: TV Rao <tv.rao@freescale.com>
2015-06-30docs: update quickstart.md with src build infoMaryam Tahhan1-2/+18
Update quickstart.md to add information on how one can clone and build OVS and DPDK. Change-Id: I02365c4cdbdde6426008672a7ed7c6402be3c046 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Mark B Kavanagh <mark.b.kavanagh@intel.com> Reviewed-by: TV Rao <tv.rao@freescale.com>
2015-06-30Merge "doc: quickstart.md fixup"Maryam Tahhan1-11/+4
2015-06-30doc: quickstart.md fixupMaryam Tahhan1-11/+4
Fix line wrapping in quickstart.md so lines aren't deliberately cut off at particular points. Change-Id: Ie166c679b7036c850412be645fcc1fee65400b1b Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: TV Rao <tv.rao@freescale.com>
2015-06-30TestSpec: Add Test Summary ListMaryam Tahhan1-0/+19
Add a summary list of the tests defined so far. Change-Id: I60011bf79515d7b95563b6f3132d01a32ae5e394 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-29docs: fix-up typos in installation.mdMaryam Tahhan1-3/+2
Fix-up a typo and line ending in installation.md. Change-Id: Ie0a682f20ca63df853600a585d65d2ee844bacc4 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-25test_spec: update spec with MAC learning testsMaryam Tahhan1-2/+2
Update LTD.Throughput.RFC2889.AddressCachingCapacity and LTD.Throughput.RFC2889.AddressLearningRate to indicate they are only applicable to vswitches that are capable of MAC learning. JIRA: VSPERF-35 Change-Id: I7b0f5c98347ba7d8f0a774982bd574a7d306b540 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-24Merge "test_spec: Clarify ↵Maryam Tahhan1-2/+2
LTD.Throughput.RFC2544.PacketLossRatioFrameModification"
2015-06-24Merge "TestSpec: Add LTD.Scalability.RFC2544.0PacketLoss"Maryam Tahhan1-0/+42
2015-06-24Merge "test_spec: Clarify LTD.Throughput.RFC2544.Soak"Maryam Tahhan1-3/+2
2015-06-24test_spec: Clarify LTD.Throughput.RFC2544.SoakBilly O'Mahony1-3/+2
Based on comments from weekly VSPERF call 2015-05-20. JIRA: VSPERF-2 Change-Id: Ic36b6c1260168a7bb0b003585b3abe64a2841820 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-06-24test_spec: Clarify RFC6201.ResetTimeBilly O'Mahony1-5/+12
Make changes based on comments from review at VSPERF weekly call 2015-05-27. JIRA: VSPERF-2 Change-Id: I7e4f0e1137d9dd96953f5b96c5179b40906c23b9 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-06-24TestSpec: Add LTD.Scalability.RFC2544.0PacketLossBilly O'Mahony1-0/+42
JIRA: VSPERF-19 Change-Id: I4b85ed0291d785b46222ab1a965bc377c05130ed Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-23Merge "Update targets for l2fwd build"Maryam Tahhan1-1/+8
2015-06-17IETFSummary: Add initial IETF summary of LTDMaryam Tahhan2-32/+588
JIRA: VSPERF-43 Change-Id: I1020b2845a644d3002c08ede3a6dfa8fc068781a Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Signed-off-by: Al Morton <acmorton@att.com>
2015-06-17TestSpec: Modify soak tests to measure PDVMaryam Tahhan1-0/+2
Add PDV as defined by RFC 5841 as one of the metrics collected by the defined soak tests. JIRA: VSPERF-14 Change-Id: Ida110347ec3a60e0d8fba03ab20407e11e40b96a Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-06-17Merge "test_spec: Clarify LTD.Throughput.RFC2544.SystemRecoveryTime"Maryam Tahhan1-5/+5
2015-06-15Update targets for l2fwd buildEugene Snider1-1/+8
Added cleanse, clobber and force_make targets for top level Makefile compliance Change-Id: I510ed174e3ae01b35e9df975e5aaa1c989b34ce9 Signed-off-by: Eugene Snider <eugene.snider@huawei.com>
2015-06-10TestSpec: Add LTD.Latency.SlowpathMaryam Tahhan1-0/+34
Add a definition for Slowpath packet delay test. JIRA: VSPERF-40 Change-Id: I43727ad966c706bd3d4fad3a463798af3ccd72f8 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Aihua Li <aihua.li@huawei.com>
2015-06-10TestSpec: Modify LTD access permissionsMaryam Tahhan1-0/+0
Modify the LTD access permissions so it's not executable. Change-Id: I234f84da5901934cb3f55830225a326ba03c1193 JIRA: VSPERF-2 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Aihua Li <aihua.li@huawei.com>
2015-06-08Merge "framework: Add reworked framework to repo"Maryam Tahhan69-36/+14874
2015-06-08framework: Add reworked framework to repoBilly O'Mahony69-36/+14874
This commit adds the vSwitch Integration Test Framework whose design, based off TOIT, is outlined in the HLD previously made availiable to the community for review. The design of this framework allows developers to add different implementations of components, specifically vSwitches, Traffic Generators, Metrics Collectors and VNFs, easily. The goal of this design is that all testcases should run regardless of what is "under the hood". This commit adds support for running the framework for a phy to phy RFC2544 testcase only. More testcases will be added by the community. vSwitches supported at this time: * Intel DPDK (r) accelerated OpenvSwitch Traffic Generators supported at this time: * IxNet - IxNetwork Implementation * Ixia - IxExplorer Implementation * Dummy - Manual Implementation Metrics Collectors supported at this time: * Linux Metrics No VNFs are supported at this time but the framework outlines how they should be integrated and provides APIs for them to adhere to. JIRA: VSPERF-27 Change-Id: I312e1a1199487ffee8f824be06cd97d4f793eee0 Signed-off-by: Stephen Finucane <Stephen.Finucane@intel.com> Signed-off-by: Meghan Halton <Meghan.Halton@intel.com> Signed-off-by: Christopher Nolan <Christopher.Nolan@intel.com> Signed-off-by: Maryam Tahhan <Maryam.Tahhan@intel.com> Signed-off-by: Ciara Loftus <Ciara.Loftus@intel.com> Signed-off-by: Mark Kavanagh <Mark.B.Kavanagh@intel.com> Signed-off-by: Cian Ferriter <Cian.Ferriter@intel.com> Signed-off-by: Timo Puha <TimoX.Puha@intel.com> Signed-off-by: Billy O'Mahony <billy.o.mahony@intel.com> Signed-off-by: Michal Weglicki <MichalX.Weglicki@intel.com> Signed-off-by: Rory Sexton <Rory.Sexton@intel.com> Signed-off-by: Ian Stokes <Ian.Stokes@intel.com> Signed-off-by: Kevin Traynor <Kevin.Traynor@intel.com> Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Aihua Li <aihua.li@huawei.com>
2015-06-04test_spec: Clarify LTD.Throughput.RFC2544.SystemRecoveryTimeBilly O'Mahony1-5/+5
Make changes based on review from VSPERF weekly call 2015-05-27. JIRA: VSPERF-2 Change-Id: I4e2caec3f0ad52a7ef3773372aee4f06791631de Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-05-29test_spec: Clarify LTD.Throughput.RFC2544.PacketLossRatioFrameModificationBilly O'Mahony1-2/+2
Based on comments from weekly VSPERF call 2015-05-20. JIRA: VSPERF-2 Change-Id: I7707ca62a870509baaff557715da31bb7a254b70 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-05-27Update license to Apache 2.0Aihua Li4-20/+56
Change-Id: I87027ac8ac34340ee3629a536bf3467241f8abd9 JIRA: VSPERF-15 Signed-off-by: Aihua Li <aihua.li@huawei.com> Reviewed-by: Eugene Snider <eugene.snider@huawei.com>
2015-05-20testspec: cleanup + update tests with new metricsMaryam Tahhan1-20/+28
Cleanup and update the test specification with CPU and memory utilization metrics that can be collected in conjunction with the other metrics for the test. JIRA: VSPERF-2 Change-Id: Ia70d83a9cba724e2d6f503984a8db537d4a1f395 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-05-06Add l2 fwd kernel moduleEugene Snider6-0/+623
This commit adds a simple kernel module for l2 forwarding or termination This module provides only level 2 forwarding between two ports, it does not do any NAT or Masquerade. Arguments are: net1=ethXXXX # set forwarding port 1 net2=ethXXX # set forwarding port 2 terminate=1 # terminate the connection and free the skb Changed to GPL licensing to avoid compilation issues Added sanity build target Fix whitespace issues JIRA: VSPERF-39 Change-Id: I0fa3e0135af06b7cba665a357dccfb9459edb9f6 Signed-off-by: Eugene Snider <eugene.snider@huawei.com>
2015-04-08Merge "TestSpec: Add LTD.Throughput.RFC2889.BroadcastFrameForwarding"Maryam Tahhan1-0/+20
2015-04-08Merge "TestSpec: Add LTD.Throughput.RFC2889.ErrorFramesFiltering"Maryam Tahhan1-0/+32
2015-04-08Merge "TestSpec: Add LTD.Throughput.RFC2889.AddressLearningRate"Maryam Tahhan1-0/+25
2015-04-08Merge "TestSpec: Add LTD.Throughput.RFC2889.AddressCachingCapacity"Maryam Tahhan1-0/+29
2015-04-08Merge "TestSpec: Add LTD.Throughput.RFC2889.ForwardPressure"Maryam Tahhan1-0/+24