aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-06-09Merge "tests: Improvement of step driven testcases"Martin Klozik18-105/+271
2017-06-07Merge "ci: Fix VPP back2back TCs"Martin Klozik1-3/+8
2017-06-06ci: Plot graphs from CI resultsMartin Klozik2-3/+165
CI scripts were enhanced to plot graphs from last results and push them into artifactory. Graphs will be updated by every CI run and can be included e.g. in VSPERF results WIKI page. Change-Id: Iada4acd7cc2c3dc73b9f30a429fe2b53020c4d3b Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
2017-06-05ci: Fix VPP back2back TCsMartin Klozik1-3/+8
There was a generic issue with restoration of original environment after execution of testcase. Thus in case that multiple tests were executed, their settings could be corrupted. This issue was detected after VPP testcases were added into VSPERF DAILY CI job. There were two issues: * setttings.load_from_dict() method was used to restore original configuration values; However this method updates dict content with supplied values. If TC has introduced new dict item, then it was not removed from settings after TC execution and modified settings was applied also for next test(s). * test configuration passed to testcase constructor is used for initialization of TC members, which are later updated; As python does shallow copy on dict members by default, modification of such testcase members led to corruption of configuration of other testcases. Thus deepcopy of testcase configuration was introduced into vsperf constructor to avoid TC configuration corruption. JIRA: VSPERF-511 Change-Id: I45fb49d48743015353652de12db4692333043733 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-06-02ixia: Fix IXIA in trafficgen modeMartin Klozik1-3/+6
There are two IXIA wrappers in VSPERF - IxNET and Ixia. It has been found that legacy Ixia implementation is no longer working in trafficgen mode. This issues has been fixed. JIRA: VSPERF-513 Change-Id: Ief1db71f688a19c5b41508617ccbc73024a02c48 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-06-02tests: Improvement of step driven testcasesMartin Klozik18-105/+271
A set of improvements was introduced to enhance step driven testcases capabilities. Details: * delay among test steps is configurable by TEST_STEP_DELAY parameter * step driven tool function exec was renamed to exec_shell * new step driven tool function exec_python was introduced to execute a python code * new step driven object sleep was introduced to pause test execution for defined number of seconds. * fixed bug in settings.validate_getValue() to correctly validate access of parameters modified by TEST_PARAMS * new #PARAM() macro was introduced to allow references among configuration parameters * multistream support has been added into ixnetrfc2544v2.tcl, which is used for tunneling protocols test (op2p deployment) * fixed bug in op2p deployment to list interfaces and flows from both bridges involved in the test * test report updated to state exact rfcxxxx type of traffic type, e.g. rfc2544_continuous * test report of step driven testcases was updated to contain measured values from traffic generator in CSV report * method for ovs flow comparison was modified to normalize IPv4 CIDR network addr (e.g. 10.0.0.5/8 => 10.0.0.0/8) JIRA: VSPERF-512 Change-Id: Ib4f38dcdfbf3820dd766b25520da0ad0c81f3293 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com> Reviewed-by: Ciara Loftus <ciara.loftus@intel.com>
2017-05-31Merge "Qemu: Mechanism to pass extra qemu cpu features and pin vCPU threads"Martin Klozik3-4/+54
2017-05-31Qemu: Mechanism to pass extra qemu cpu features and pin vCPU threadskalyanreddy3-4/+54
JIRA: VSPERF-510 This patch is used to implement the mechanism to pass extra qemu cpu options required to achieve better results/performance. Also used to implement a mechanism to pin the vCPU threads to another pCPU core which helps in reducing the noise from housekeeping thread and packet loss. Change-Id: Ic40fd47d7c4f5556f7e240c6ca671a0535d06ece Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
2017-05-25xena_cont_bug_fix: Fix duration issueChristian Trautman1-1/+1
Port duration is in microseconds. I broke this with a previous commit. Change-Id: Id2770149355f40107ab8ee0523482b5867e0e72a Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-05-18vpp_doc_fix: Modify VPP documentation to be currentChristian Trautman1-8/+8
Update VPP installation documentation and add note for issue seen with some installs. Change-Id: Ib1a2bb5f7b6bb07ddff2ea5c7d2ca9f9100250dd Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-05-16Merge "xena_pairs: Add pairs topology for 2544 testing"Martin Klozik7-253/+335
2017-05-15xena_pairs: Add pairs topology for 2544 testingChristian Trautman7-253/+335
Add xena pairs topology and port removal options for JSON files with RFC2544 testing. Refactored JSON code for better expansion later. Resolved pathing issues related to previous patch allowing for execution of VSPerf from any directory. JIRA: VSPERF-502 Change-Id: Ida60c1223ae0f45f8879351770ab7fdce859b59b Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-05-12ci: Update list of VPP TCs in daily jobMartin Klozik1-1/+1
JIRA: VSPERF-509 Change-Id: I03bfc5a2c8ff69e226464d307563e117b7f3318e Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
2017-05-12ci: Add VPP test execution into CI daily jobMartin Klozik1-3/+15
Basic set of VPP performance tests was added into OPNFV CI daily job. JIRA: VSPERF-509 Change-Id: I9cd6086a958d67dd0e395f962111e6d2b44bf86c Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-05-03build: Automated VPP buildMartin Klozik8-12/+183
VSPERF makefiles were updated to automatically download and compile VPP. VPP will not be installed into the OS, but it will be executed from VSPERF's src subdirectory. Thus underlying OS is not affected by VPP build required by VSPERF. It also allows quick switch among different versions of various tools used by VSPERF. As part of this patch, VERIFY and MERGE CI jobs were updated to build VPP and test it with basic set of integration tests. JIRA: VSPERF-493 Change-Id: I958b9031c4fefc87c4c63a471d2ba1a0db1eaaa4 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-05-02pylint_error_report: Report errors generated from pylint failuresChristian Trautman1-1/+3
Change the output of the pylint check script to report the errors generated from a non 10 pylint score. JIRA: VSPerf-508 Change-Id: I6d764f4040a662385c83125322bec7e887942bc5 Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-04-20xena_duration_fix: Revert xena continuous to port time limitsChristian Trautman1-8/+1
Revert xena continuous traffic to port based time limits as packet limits have an uppers bounds which could be reached with small packet sizes and longer durations. JIRA: VSPERF-507 Change-Id: I56986159643344f7872e311590f7d05ac02b038b Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-04-20Merge "ixia: Support of 1 NIC connection to trafficgen"Martin Klozik4-2111/+471
2017-04-19docs: Remove whitespaces from indexesMartin Klozik2-3/+3
Whitespaces were removed from RST indexes to correctly pass rst validation. Change-Id: I5f277d5f8846653c6e7ea3fbb29881e2dd3f610b Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-04-19Merge "xena_verify: Add final verification option to Xena"Martin Klozik4-3/+125
2017-04-19ixia: Support of 1 NIC connection to trafficgenMartin Klozik4-2111/+471
For some testcases it is useful to have only one connection between traffic generator and DUT. Thus IxNet class was extended to support such connection. Feature is enabled if both IXIA ports are set to the same value. New integration testcase ixnet_pvp_tput_1nic was created to demonstrate this feature. Unused code was removed from 3rd_party/ixia/ixnetrfc2544.tcl to simplify introduction of new features and to speed up IXIA configuration. JIRA: VSPERF-503 Change-Id: I92ab24fa58eeb1ccb7f00ac7f3530ffca7b99241 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-04-18xena_verify: Add final verification option to XenaChristian Trautman4-3/+125
Adds final verification option to Xena traffic generator inside VSPerf. Works by running the Xena2544.exe again after the initial run is complete with modified values inside the json file. If the final verify fails it will revert the settings and continue the in a pattern based on if the smart search is enabled. JIRA: VSPERF-506 Change-Id: Ic272628c489b88989f67549bd020af7354dc9b91 Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-04-13Fix for multi-stream configurationMarco Varlese1-0/+3
The multistream configuration is not passed to the remote host where the traffic generator (MoonGen) runs. Change-Id: I3e9862553b5b064272f3bfffb788c06ebd3740ca Signed-off-by: Marco Varlese <marco.varlese@suse.com>
2017-04-12Merge "ixia: VLAN support without l3/l4 headers"Martin Klozik1-4/+0
2017-04-12Merge "jumbo_frame: Add jumbo frame support"Martin Klozik8-2/+125
2017-03-31Changes index depthTrevor Cooper2-16/+8
Change-Id: I9f83b22eebb61de7ab98040bd67f7dd7f3caf129 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-30ixia: VLAN support without l3/l4 headersMartin Klozik1-4/+0
Remove dependency of VLAN headers on L3 and L4 protocols. JIRA: VSPERF-499 Change-Id: Ic16dbbf2b503be7dd48a7bf55e45795bbb9f7e67 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-30jumbo_frame: Add jumbo frame supportChristian Trautman8-2/+125
Add jumbo frame support for all packet forwarding applications inside guest for pxp testing. Enable jumbo frame support for OvsVanilla, OvsDpdkVhostUser, and Packet forwarding. Add minor fix for missing method issue when running packet forwarding tests. The get_version method was missing in the packet_forwaring core module. JIRA: VSPERF-501 Change-Id: Ia99975f47c64259ed2566bde3c85b2779c309e80 Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-03-29Removed white spaceTrevor Cooper1-1/+1
Change-Id: I4455ce38ca81ad1d5a028c626e3ac53d6d87db43 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-28Fixed indexes in user and developer documentationTrevor Cooper3-20/+13
Change-Id: Iad5c130936a815c41265b29053d2978808ff14bb Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-27Merge "ixia: Make L3 and L4 headers optional"Martin Klozik6-2777/+2835
2017-03-27Merge "ixia: Fix VLAN support by IxNet class"Martin Klozik1-8/+198
2017-03-27Merge "vpp: Reporting update related to VPP"Martin Klozik13-51/+159
2017-03-24ixia: Make L3 and L4 headers optionalMartin Klozik6-2777/+2835
During testing it is sometimes useful to generate pure L2 traffic without L3 or L4 related headers. IxNetwork TCL script was updated to support this option. Generic TRAFFIC array was enhanced by on/off switch for L3 and L4 headers. Thus it can be implemented by other traffic generators in the future, if this feature will prove itself useful. JIRA: VSPERF-500 Change-Id: I723c703e5d6ef609fd5b7db366871278a4730203 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-24ixia: Fix VLAN support by IxNet classMartin Klozik1-8/+198
IxNet class, which controls IXIA via IxNetwork TCL server, did not support VLAN configuration. Main TCL script 3rd_party/ixia/ixnetrfc2544.tcl was updated to support VLAN configuration. JIRA: VSPERF-499 Change-Id: I89b33dfc653fd59c2983e78a6532812a4c29bddf Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-24multistream: Support huge number of streamsMartin Klozik9-18/+32
Restriction of 64K streams was limited only to L4 stream type. In case of L3 and L2 stream type, it is possible to define unlimited number of streams to be simulated by traffic generator. JIRA: VSPERF-498 Change-Id: I4ce3253299473127d135c01543999a8593b9556f Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Bill Michalowski <bmichalo@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-23Removed reference to POD 3 since VSPERF POD was moved to POD 12Trevor Cooper2-11/+7
Change-Id: Ic278ba90c3174b9f83766861981aeb66320c8963 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-23Added index files for user and dev doc dirsTrevor Cooper3-24/+68
Change-Id: I0ac84324be97de91c8d4730cd3cb73e994cf28a7 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-23Updates release note numberingTrevor Cooper2-13/+0
Change-Id: Id0510b96375033540fa80fe22b301fb1d0d20e40 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-22New doc structure changes for stable/danubeTrevor Cooper1-0/+1
Change-Id: I2e9b432a74ee22690fdb366de619dc3a5d2ad725 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-21Updated doc locations for new structureTrevor Cooper32-52/+60
Change-Id: I8d948bad350ec90618edac5fc451167c06e8baa5 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-22Merge "Revert "Moved doc files to testing document structure"Trevor Cooper32-65/+76
2017-03-22Revert "Moved doc files to testing document structureTrevor Cooper32-65/+76
This reverts commit 32a5263216d79ad34041dca55357278f092bb931. Change-Id: I641b967badffd52ffd9e249b75e67bb7c82a8150 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-22Revert "Corrected doc dir errors"Trevor Cooper1-15/+15
This reverts commit 255f58a8c64fcb2875f7616dfcbbfeef2173efcb. Change-Id: Iccaaf205da26a49744b06e019b000e824e4c45cd Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-21Corrected doc dir errorsTrevor Cooper1-15/+15
Change-Id: Iab221ca0ea22156830c2a106695e305f965d5226 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-21Moved doc files to testing document structure testing/user ... ↵Trevor Cooper32-76/+65
testing/developer and modified doc index to match dir structure Change-Id: I4b1a535808a48773505fa7874c61707cd349fced Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-20Renamed release notes file and added index file to release-notes dirTrevor Cooper2-0/+12
Change-Id: I448fd909a89103b2c11cb16f91b8c646fb5adee8 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-20vpp: Reporting update related to VPPMartin Klozik13-51/+159
VSPERF reports were updated to contain vSwitch name. In case of VPP, it is not possible to read its version if VPP is not running. Thus VSPERF was enhanced to support tool version check during its runtime. This mechanism can be enhanced to support e.g. VNF in the future. JIRA: VSPERF-496 Change-Id: I74b47505e35340eead165d9b588e9cc15c058bbf Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-03-20Merge "IXIA setup: Fix to create packets with the specified values."Martin Klozik2-24/+24
2017-03-16Merge "vpp: Initial support of VPP vSwitch"Martin Klozik17-65/+837