aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-09-08Merge "doc: Include list of TCs in doc"Martin Klozik5-4/+129
2017-09-06Merge "openSUSE support"Martin Klozik5-2/+125
2017-09-06openSUSE supportMarco Varlese5-2/+125
Modified support for Leap 42.2 so not to be prompted for y/n on update and installation of required packages. Added Leap 42.3 as supported OS. Upgraded documentation accordingly. Change-Id: I33f3046a5b33bc842534a16911423a2febaa9417 Signed-off-by: Marco Varlese <marco.varlese@suse.com>
2017-09-05trex: fix Trex makefileMartin Goldammer2-1/+3
Trex makefile was fix to checkout correct commit ID. Add trex repo folder to .gitignore file. JIRA: VSPERF-528 Change-Id: Icd0406eaf088b88c28d90cf8a7dd9e1fa53a6f3b Signed-off-by: Martin Goldammer <martin.goldammer6@gmail.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-09-01opnfvresultdb: Report failed TCs into result DBMartin Klozik2-27/+60
In following cases, TC will be reported as FAIL in result DB: * CSV file with VSPERF results is missing (e.g. execution of vSwitch, VNF or trafficgen has failed) * 0 RX FPS is detected for at least one packet size during RFC2544 Throughput test (e.g. vSwitch is not properly configured due insufficient hugepages size) JIRA: VSPERF-488 Change-Id: I453bbe32db87497644e1464e74ef597f0f0f323c Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Mars Toktonaliev <mars.toktonaliev@nokia.com> Reviewed-by: Morgan Richomme <morgan.richomme@orange.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-09-01Merge "trex: Add support Trex traffic generator"Martin Klozik10-1/+569
2017-08-31trex: Add support Trex traffic generatorMartin Goldammer10-1/+569
Topology are two physical servers, on first is trex and second is VSPERF. Trex is running in stateless mode this means that on server where is located trex repo is running trex binary file and VSPERF working with server via python API. JIRA: VSPERF-528 Change-Id: Id8819495325ebc13fdce365f4af0e040ce68cd0e Signed-off-by: Martin Goldammer <martin.goldammer6@gmail.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-31Merge "docs: Update E release notes"Martin Klozik1-0/+34
2017-08-30docs: Update E release notesMartin Klozik1-0/+34
Release notes were updated with VSPERF additions during Euphrates release timeframe. Change-Id: I87154036676450065906c6fd8bc6db4604c84260 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-30doc: Include list of TCs in docMartin Klozik5-4/+129
List of vsperf "inbox" testcases was added into documentation. This patch also fixes: * a few SPHINX warnings and errors * empty userguide index JIRA: VSPERF-519 Change-Id: I417ed40130f0c7de4f76551f3f1cac0cb1e6da89 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-30Merge "opnfvresultdb: Add mapping for VPP TCs"Martin Klozik3-72/+33
2017-08-25report: Update paths after doc reorganizationMartin Klozik1-2/+2
Directory with report files was moved to different location. Thus CI build script must be updated too. Change-Id: Id5b4c8b2740c01c821c25f8bfdaeb25352410e76 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-25Merge "build: Rename cloned repositories and remove cuse"Martin Klozik5-40/+4
2017-08-25opnfvresultdb: Add mapping for VPP TCsMartin Klozik3-72/+33
Patch adds testcase mapping among native VSPERF VPP TCs and appropriate TC names defined in results DB. JIRA: VSPERF-488 Change-Id: I5c4a50587a354a741c738d255105726943a701f5 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Mars Toktonaliev <mars.toktonaliev@nokia.com> Reviewed-by: Morgan Richomme <morgan.richomme@orange.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-25build: Rename cloned repositories and remove cuseCian Ferriter5-40/+4
VSPERF expects folders to be named a certain way, but this may not be the case if another repository is specified via the package-list.mk file. One example of this is the DPDK stable repo which gets cloned to the "dpdk-stable" directory unless otherwise specified. Thus Makefiles were updated to enforce expected folder names. Unused configuration related to vHostCuse support was removed. Change-Id: Ifa48898d51e96c72e7d740f43cb635d729b2a796 Signed-off-by: Cian Ferriter <cian.ferriter@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-25gitignore: Ignore non vsperf filesCian Ferriter1-0/+10
.gitignore was updated to ignore following files: * VPP project directory * l2fwd binary files * tags JIRA: VSPERF-529 Change-Id: Idc10eae7b14c72a863f3473e02cbdc7c47d31b41 Signed-off-by: Cian Ferriter <cian.ferriter@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-24Merge "opnfvresultdb: Update data reported to result DB"Martin Klozik5-3/+39
2017-08-23opnfvresultdb: Update data reported to result DBMartin Klozik5-3/+39
Data reported to result DB were updated to comply with recent API version and requirements. JIRA: VSPERF-488 Change-Id: I6ab02ea54d99099e88b0d5ab6e9745ee8297f544 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Signed-off-by: Mars Toktonaliev <mars.toktonaliev@nokia.com> Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-22Moved devguide for consitency with docs dir structure for all testing projectsTrevor Cooper24-22/+44
Updated RFC description based on IETF approval of Internet Draft Change-Id: Ifd37da946866f350b8968bbbe8c5a3f5ce762cfa Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-18Merge "driverctl: Add driverctl binding tool"Martin Klozik2-17/+49
2017-08-18driverctl: Add driverctl binding toolChristian Trautman2-17/+49
Adds driverctl as a binding tool option for dpdk devices. JIRA ticket contains test results to verify it works when using dpdk-devbind or driverctl. JIRA: VSPERF-525 Change-Id: Ia7a6e43a4b6fb3ba21f5d87d601f4ea4b95b7dab Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-08-14Merge "xena2544_verify_fix: Fix Xena verify options"Martin Klozik1-3/+22
2017-08-14Merge "tests: L3, L4 and VxLAN tests for OVS & VPP"Martin Klozik6-30/+1089
2017-08-08xena2544_verify_fix: Fix Xena verify optionsChristian Trautman1-3/+22
Fixes issue when running multiple packets sizes and using the Xena verify option. Original values are restored to settings for each new packet size or test case. Also fixes a minor issue where if the test failed, the verify would run regardless. JIRA: VSPERF-515 Change-Id: I6b6ce5160b66e7ed4a3847711c4f05529ae8ca54 Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-08-04tests: L3, L4 and VxLAN tests for OVS & VPPMartin Klozik6-30/+1089
A set of tests was introduced with focus on L3, L4 and VxLAN performance of OVS and VPP. New testcases were created for phy2phy network scenario. In case of PVP and PVVP, only OVS testcases are available. Notes: * two sets of OVS P2P testcases were created, one creates unique flow for each IP address involved in the test (performance sensitive); Second set inserts just one flow with large network mask (tests with _mask suffix). * three different types of VPP P2P L3 testcases were created to demonstrate performance impact of multi ARP entries or IP routes. * VPP multi ARP record based testcases use a set of "workarounds" to load a large number of ARP entries. It is not possible to use "set ip arp count" syntax, as it doesn't work well for large count values (e.g. 60K) * OVS VxLAN testcases utilize existing OP2P deployment scenario and thus it can be used also with GRE and GENEVE tunnel types. Tunnel type to be used is defined by test configuration option "Tunnel Type". JIRA: VSPERF-518 Change-Id: I65adad976f12d8625d918a1996eb42693c511ee1 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Signed-off-by: Ciara Loftus <ciara.loftus@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com> Reviewed-by: Cian Ferriter <cian.ferriter@intel.com>
2017-07-27Merge "ci: Fix path to CI report"Martin Klozik2-2/+16
2017-07-21dpdk: Support dpdk vhost-user client modeMartin Klozik6-6/+31
Support of vhost-user client mode has been added for both OVS and VPP. VSPERF configures vhost-user server mode in vswitches by default for backward compatibility. Support of vhost-user server mode is deprecated in OVS and it can be removed in future releases. Once it will happen, we have to change vsperf default behavior to usage of vhost-user client ports at vswitch side. This patch also fixes processing of boolean configuration parameters passed via --test-params option. In the past it was not possible to set boolean value to False through --test-params option. JIRA: VSPERF-517 Change-Id: I65e341f820edd6c720043a4acc74c5140b05db18 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-07-19ci: Fix path to CI reportMartin Klozik2-2/+16
Index file of CI report was restored and paths to it updated to reflect new documentation structure. JIRA: VSPERF-514 Change-Id: Id92eb2003a9e6737652313f7ecd03d48a0bfd2ce Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-07-04ci: Use log scale for B2B graphsMartin Klozik1-3/+14
Graph configuration for B2B was modified to show correct y axis tittle and to use log scale. Change-Id: I7ac75ca803f93be28d89a4504e046b1119d341e1 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-07-03Merge "ovs: Update OVS to use DPDK 17.02"Martin Klozik4-10/+11
2017-06-23ovs: Update OVS to use DPDK 17.02Martin Klozik4-10/+11
Versions of VSPERF tools were updated to use OVS with DPDK 17.02 support by default. Currently used VPP version uses DPDK 17.02 already. VSPERF was updated to support new path to the dpdk devbind tool. JIRA: VSPERF-516 Change-Id: I004d0531553c974d604635d50f601cd4326f2f7d Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-06-22cleanup: remove fuel plugin since fuel@opnfv uses mcpGuo Ruijing15-221/+0
Change-Id: Ibe2028b01c38fa545e72a00a7ef47103d1112b82 Signed-off-by: Guo Ruijing <ruijing.guo@intel.com>
2017-06-14ci: Fix of SRIOV graphs generationMartin Klozik1-1/+1
Wrong test name was used for SRIOV. Change-Id: Ie07a3bcd162b228d9d6843205a9abf237026f428 Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
2017-06-13ci: Fix of CI graphs generationMartin Klozik1-1/+1
Parameters must be quoted, otherwise list of testcases is split among many parameters. Change-Id: I16ca4feb7e8d30bbbed60fd259e3bd3155f382b3 Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
2017-06-12ci: Configure graphical outputMartin Klozik2-5/+10
Modify configuration of graphs generated from CI results. Change-Id: Id1a30e0c61419ff131fb4f41138af2e62f822b9c Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
2017-06-09Merge "tests: Improvement of step driven testcases"Martin Klozik18-105/+271
2017-06-07Merge "ci: Fix VPP back2back TCs"Martin Klozik1-3/+8
2017-06-06ci: Plot graphs from CI resultsMartin Klozik2-3/+165
CI scripts were enhanced to plot graphs from last results and push them into artifactory. Graphs will be updated by every CI run and can be included e.g. in VSPERF results WIKI page. Change-Id: Iada4acd7cc2c3dc73b9f30a429fe2b53020c4d3b Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
2017-06-05ci: Fix VPP back2back TCsMartin Klozik1-3/+8
There was a generic issue with restoration of original environment after execution of testcase. Thus in case that multiple tests were executed, their settings could be corrupted. This issue was detected after VPP testcases were added into VSPERF DAILY CI job. There were two issues: * setttings.load_from_dict() method was used to restore original configuration values; However this method updates dict content with supplied values. If TC has introduced new dict item, then it was not removed from settings after TC execution and modified settings was applied also for next test(s). * test configuration passed to testcase constructor is used for initialization of TC members, which are later updated; As python does shallow copy on dict members by default, modification of such testcase members led to corruption of configuration of other testcases. Thus deepcopy of testcase configuration was introduced into vsperf constructor to avoid TC configuration corruption. JIRA: VSPERF-511 Change-Id: I45fb49d48743015353652de12db4692333043733 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-06-02ixia: Fix IXIA in trafficgen modeMartin Klozik1-3/+6
There are two IXIA wrappers in VSPERF - IxNET and Ixia. It has been found that legacy Ixia implementation is no longer working in trafficgen mode. This issues has been fixed. JIRA: VSPERF-513 Change-Id: Ief1db71f688a19c5b41508617ccbc73024a02c48 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-06-02tests: Improvement of step driven testcasesMartin Klozik18-105/+271
A set of improvements was introduced to enhance step driven testcases capabilities. Details: * delay among test steps is configurable by TEST_STEP_DELAY parameter * step driven tool function exec was renamed to exec_shell * new step driven tool function exec_python was introduced to execute a python code * new step driven object sleep was introduced to pause test execution for defined number of seconds. * fixed bug in settings.validate_getValue() to correctly validate access of parameters modified by TEST_PARAMS * new #PARAM() macro was introduced to allow references among configuration parameters * multistream support has been added into ixnetrfc2544v2.tcl, which is used for tunneling protocols test (op2p deployment) * fixed bug in op2p deployment to list interfaces and flows from both bridges involved in the test * test report updated to state exact rfcxxxx type of traffic type, e.g. rfc2544_continuous * test report of step driven testcases was updated to contain measured values from traffic generator in CSV report * method for ovs flow comparison was modified to normalize IPv4 CIDR network addr (e.g. 10.0.0.5/8 => 10.0.0.0/8) JIRA: VSPERF-512 Change-Id: Ib4f38dcdfbf3820dd766b25520da0ad0c81f3293 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com> Reviewed-by: Ciara Loftus <ciara.loftus@intel.com>
2017-05-31Merge "Qemu: Mechanism to pass extra qemu cpu features and pin vCPU threads"Martin Klozik3-4/+54
2017-05-31Qemu: Mechanism to pass extra qemu cpu features and pin vCPU threadskalyanreddy3-4/+54
JIRA: VSPERF-510 This patch is used to implement the mechanism to pass extra qemu cpu options required to achieve better results/performance. Also used to implement a mechanism to pin the vCPU threads to another pCPU core which helps in reducing the noise from housekeeping thread and packet loss. Change-Id: Ic40fd47d7c4f5556f7e240c6ca671a0535d06ece Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
2017-05-25xena_cont_bug_fix: Fix duration issueChristian Trautman1-1/+1
Port duration is in microseconds. I broke this with a previous commit. Change-Id: Id2770149355f40107ab8ee0523482b5867e0e72a Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-05-18vpp_doc_fix: Modify VPP documentation to be currentChristian Trautman1-8/+8
Update VPP installation documentation and add note for issue seen with some installs. Change-Id: Ib1a2bb5f7b6bb07ddff2ea5c7d2ca9f9100250dd Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-05-16Merge "xena_pairs: Add pairs topology for 2544 testing"Martin Klozik7-253/+335
2017-05-15xena_pairs: Add pairs topology for 2544 testingChristian Trautman7-253/+335
Add xena pairs topology and port removal options for JSON files with RFC2544 testing. Refactored JSON code for better expansion later. Resolved pathing issues related to previous patch allowing for execution of VSPerf from any directory. JIRA: VSPERF-502 Change-Id: Ida60c1223ae0f45f8879351770ab7fdce859b59b Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2017-05-12ci: Update list of VPP TCs in daily jobMartin Klozik1-1/+1
JIRA: VSPERF-509 Change-Id: I03bfc5a2c8ff69e226464d307563e117b7f3318e Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
2017-05-12ci: Add VPP test execution into CI daily jobMartin Klozik1-3/+15
Basic set of VPP performance tests was added into OPNFV CI daily job. JIRA: VSPERF-509 Change-Id: I9cd6086a958d67dd0e395f962111e6d2b44bf86c Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
2017-05-03build: Automated VPP buildMartin Klozik8-12/+183
VSPERF makefiles were updated to automatically download and compile VPP. VPP will not be installed into the OS, but it will be executed from VSPERF's src subdirectory. Thus underlying OS is not affected by VPP build required by VSPERF. It also allows quick switch among different versions of various tools used by VSPERF. As part of this patch, VERIFY and MERGE CI jobs were updated to build VPP and test it with basic set of integration tests. JIRA: VSPERF-493 Change-Id: I958b9031c4fefc87c4c63a471d2ba1a0db1eaaa4 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>