summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2015-12-14bugfix: Fix failure caused by unset localeMartin Klozik7-14/+40
In case, that VSPERF detects missing locale settings, it will set language and encodding settings to default values specified by configuration parameter DEFAULT_LOCALE. Localized external commands with output parsed by VSPERF are executed with modified locale to ensure correct VSPERF function. Locale settings for such commands is specified by configuration parameter DEFAULT_CMD_LOCALE. Change-Id: If5c15115b778ce90046e390f10438b780f82695b JIRA: VSPERF-132 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-12-14bugfix: Support paths with user's home shortcutMartin Klozik3-5/+6
VSPERF will explicitly expand any '~' to the absolute path to the user's home directory before call of subsystem.Popen method. Only calls, which process configuration values are modified. Change-Id: Ibd9399ae84bf4698c86bf8eff97ca6ce785fb3fb JIRA: VSPERF-45 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-12-14Fix: OS name detection error by build scriptsAbdul Halim1-3/+6
There is a problem detecting OS specific scripts dir if NAME variable in /etc/os-release contains a multi-word string (e.g NAME="CentOS Linux"). To fix this we get first part of the NAME string (i.e "CentOS") for simplicity and look for version specific scripts dir within that. Change-Id: Ic840788875e9b486b20608a9b9e523cbd4530e31 Signed-off-by: Abdul Halim <abdul.halim@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Brian Castelli <Brian.Castelli@spirent.com>
2015-12-11test_spec: LTD: new topologyMiroslav Miklus1-1/+47
- Physical port → VNF → vSwitch → VNF → physical port updated topology with pNIC-VF this provides us ability to fill up the box with multiple VNFs JIRA: VSPERF-123 Change-Id: Iea991b2cd2973c07ecbc300bb6d413a182cae992 Signed-off-by: Miroslav Miklus <mmiklus@cisco.com> Signed-off-by: Maciek Konstantynowicz <mkonstan@cisco.com>
2015-12-11updates to use new doc toolchainRyota MIBU3-27/+5
Change-Id: I5009a996b2e581638f159ed37a1c56ac53c0c71f Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2015-12-09testcase: scalability testcase enhancementsMartin Klozik6-36/+83
Streams used by scalability testcases can be simulated at different network layers by modification of destination MAC address (L2), destination IP address (L3) or destination UDP port (L4). It is possible to define number and type of the streams by testcase definition by options "MultiStream" and "Stream Type" or by CLI parameters "multistream" and "stream_type". CLI options override testcase definition. Number of streams, their types, used transport protocol and indication of pre-installed flows are written to both result CSV file and MD file with test report. Default transport protocol was changed to UDP because IxNetwork configuration script doesn't support TCP yet. Change-Id: I1ff9ab7756d38f65b1a7730397507c5a5ff5a3d1 JIRA: VSPERF-81 JIRA: VSPERF-82 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-12-08pkt_gen: rename throughput_tx_* to tx_rate_*Maryam Tahhan5-21/+21
Change throughput_tx_* references to tx_rate_* so the results won't be confusing as part of the opnfv test dashboard when they become publicly available. Change-Id: Ie8cfae99a75497f15eb09d097c72c8a35df3b5f9 JIRA: VSPERF-135 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Ian Stokes <ian.stokes@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-12-08Results: Integrate with opnfv_test_dashboardRadek Zetik5-0/+148
All the test projects generate results in different format. The goal of a testing dashboard is to provide a consistent view of the different tests from the different projects. We need to enable the data collection for VSPERF, in other words VSPERF pushes data using a REST API. The feature is enabled by --opnfvpod parameter on vsperf command line. The value of the parameter sets POD name. Example: --opnfvpod <pod_name> or --opnfvpod=<pod_name> You need to specify installer name. It can be set in conf-file default value: OPNFV_INSTALLER = "Fuel" JIRA: VSPERF-112 Change-Id: I37255414eebcc2ff0c12109c508dcd984663a830 Signed-off-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-12-02Add some error checking to F21 installBilly O'Mahony3-9/+11
Make the install fail fast and obviously on error rather than continuing on. This can be used as a template for adding error checking on the other systems. JIRA: VSPERF-141 Change-Id: I1892db661a56ab2012e26c6720e0851fabbb51d9 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-12-02vnfs: configurable loopback application support inside VMMartin Klozik11-204/+269
For PVP and PVVP deployments, traffic inside virtual machines must be forwarded between its interfaces. There are several forwarding options supported by VSPERF, including DPDK testpmd, Huawei l2fwd kernel module and linux bridge. Another option is, that VM image has built in forwarding functionality and vsperf doesn't configure it itself. User can select VM loopback application by configuration option GUEST_LOOPBACK (per VM) or by SCALAR cli option guest_loopback (global settings). Selected guest loopback application(s) will be written into test results CSV file and test report MD file. Default wildcarded guest login prompt was added. Guest startup guarding timer can be configured. Path to OVS kernel module has been fixed. Change-Id: If738da1ea09112f9cf2267afcbc99a6797f3a03a JIRA: VSPERF-130 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-12-02pkt_gen: add duration to all send functionsMaryam Tahhan8-42/+41
Allow a configurable duration for all send functions. JIRA: VSPERF-125 Change-Id: I7c6f5d136a7d7100e3990f7fdc00121b07081a80 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com> Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
2015-11-26docs: update installation guide and gsg.Maryam Tahhan2-11/+73
Update installation guide and gsg to include latest updates to vsperf build and installation. JIRA: VSPERF-127 Change-Id: I773ea240eb90e191f4f53ed977651056817413f1 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony <billy.o.mahony@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
2015-11-26Adding install scripts for Ubuntu14.04Abdul Halim4-2/+133
System build scripts for Ubuntu14.04 are added. DPDK mkdir hugepage fails to create /dev/hugepages with permission error. Workaround for that is added so that /dev/hugepages dir is created when OS specific scripts is run with sudo privilege. Also adding missing packages kernel-modules-extra, pixman-devel and openssl-devel for Fedora systems. JIRA: VSPERF-128 Signed-off-by: Abdul Halim <abdul.halim@intel.com> Change-Id: Ie805c094df4a3f9446b09ea2d7e4dfb2f5324544 Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-11-26doc: update template and conf filesRyota MIBU6-103/+26
JIRA: RELENG-16 Change-Id: I0aaac15c1d1a1031cbc113db594a342c60b7eb1d Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2015-11-12Adding system build scripts for Fedora 21 and Fedora 22Abdul Halim5-13/+200
Scripts are added for Fedora 21 and 22 to install system requirements and python packages on these systems. Also modified root build_base_machine.sh so that it can handle directory structures for version specific scripts if available. JIRA: VSPERF-93 Change-Id: If6a311bc7bb1116979faabff5e9097e39f2f5495 Signed-off-by: Abdul Halim <abdul.halim@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
2015-11-11pkt_gen: update testcenter implementationMaryam Tahhan4-473/+530
Update testcenter implementation to move settings to generic settings file and change windows line endings. JIRA: VSPERF-126 Change-Id: I156005f261bc0df6c3d8009db72ba2d5991c6166 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-11-10Enable OVS master and DPDK 2.1Martin Klozik1-2/+2
VSPERF used old version of OVS, which has supported DPDK 2.0. With switch to DPDK 2.1, VSPERF can use recent OVS code again. JIRA: VSPERF-124 Change-Id: I81f6b8887d795df08a2eb8959606f2a9a277f9e6 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-11-10conf: change default RTE_TARGETMaryam Tahhan1-1/+1
Change RTE_TARGET to build native instead of ivshmem. Change-Id: I3707d1f4bf545c4a2a35e85816f26dbd214a72de Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony <billy.o.mahony@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-11-04docs: reorganize docs for the sphinx buildRamprasad Velavarthipati14-19/+129
Reorganize docs into the appropriate folders for the new sphinx build. JIRA: VSPERF-80 Change-Id: I9dcd74e092ce52546a0986b92a1ebb2b5b7419bf Signed-off-by: Ramprasad Velavarthipati <ram.v@freescale.com> Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Trinath Somanchi <trinath.somanchi@gmail.com>
2015-11-03bugfix of Vanilla OVS testing scenariosMartin Klozik10-71/+84
Automatic selection of OVS and DPDK directories must be performed before initialization of modules is called. Otherwise modules will use wrong values with unpredictable results. Default directory values have been changed to point to sources build by make. Clean&sweep of directory usage was performed. Configuration file for pylint has been renamed to follow pylint naming convention. Change-Id: I42c89f8890c021f0062b478a856ae0113f1245fb JIRA: VSPERF-121 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-10-29First phase of Spirent Traffic Gen integrationspirentbrian7-11/+732
Change-Id: Ib852c81fc8e09593411984bfb6f9bc5d5629f0c4
2015-10-29docs: fixup documentation errors and locationsMaryam Tahhan2-13/+13
Fixup the location of all rst documentation and any errors in the ltd. JIRA:VSPERF-60 Change-Id: I1472d540b1b4eca4ab038d079bfb0ef2f0c5ebcd Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-10-29Fix Make, Make clean and when the src directories are clonedRadek Zetik8-13/+19
Update the rules for Make clean and distclean. Update make not to clone the repositories if they are already cloned, simply pull, checkout the tags and build. Changes in this patch: 1. QEMU is built just once in .../src directory. .../src_vanilla and .../src_cuse don't contain qemu anymore 2. 'make clean' deletes all built *.o files 3. 'make distclean' deletes all built and generated files (distclean is used instead of cleanse now) 4. 'make' calls 'git pull' when repository is cloned already JIRA: VSPERF-94 Change-Id: I80f9a135580b450fb4606cf947661049ff509548 Signed-off-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-10-28Stop OVS from generating misleading add-br errorsDino Simeon Madarang4-11/+23
Create bridge and set datapath_type in 1 transaction to prevent OVS from generating misleading error messages which jenkins considers as build errors. Update vswitch interface to include optional parameters. Change-Id: I668f474ea909b284f3726807aab42d52ae2fb504 JIRA: VSPERF-122 Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Radek Zetik <radekx.zetik@intel.com>
2015-10-23systems directory scripts for Centos7Martin Klozik5-68/+132
Installation scripts for Centos7 have been updated with new packages. Script will install also python3 packages and create python virtual environment. As a last step DPDK, OVS and QEMU will be compiled. So after script execution VSPERF should be ready for use. It is recommended to execute installation script from user account with password less sudo access. Otherwise python environment must be copied over from root home directory. After VSPERF generic Makefile will be created by VSPERF-114, it can be enhanced to call build script too. Change-Id: I6ff5d2660af29cf8be134a4cae3b1d7b559892fa JIRA: VSPERF-93 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Signed-off-by: Abdul Halim <abdul.halim@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-23Simple performance Test for the PVP and PVVPMartin Klozik6-27/+48
Two sample contionous stream testcaes were introduced for PVP and PVVP scenarios. Required frame rate percentage can be specified either by tetcase configuration option "iLoad" or by command line option "iload". Command line option take precendece to testcase option. By default 100% linerate is used if not specified otherwise. Change-Id: I95f7ae6081377a4c99ce70fc7504b6b542f9260b JIRA: VSPERF-95 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com>
2015-10-21Add Pylint to VSPERF commit gateMartin Klozik10-21/+412
Initial pylint config file has been created to follow current code structure and design. A few issues have been fixed, so currently 56 of 67 files have rating 10/10. There are still issues to be fixed, mainly TODOs/FIXMEs and missing impelentation of abstract class members. Change-Id: Icf5b12c2150258f8ac657f8d50b47a697d1660a0 JIRA: VSPERF-91 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-21Flow Classification extensionMartin Klozik6-51/+78
Flow definition can be changed by testcase setup. By default only ingress ports are used to route traffic, but flow can be extended by src and dst IP addresses used by the traffic generator. Change-Id: I694714537ad2d818192a39f3235d8e6bf0f59a49 JIRA: VSPERF-90 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-20exclude files from the search in the LoaderMartin Klozik2-0/+15
New configuration parameter EXCLUDE_MODULES defines module names, which won't be automatically loaded by LoaderServant. It can be used to exclude obsolete or abstract modules. Change-Id: If98b50b1505465bcedcf28fe63421c73a4fe160a JIRA: VSPERF-118 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-20Implement support of 'insmod' and 'modprobe' commands into ModuleManagerMartin Klozik3-29/+21
Module manager has been enhanced to support both 'insmod' and 'modprobe' commands for kernel module insertion. In case, that .ko suffix is detected then insmod will be used otherwise modprobe will be called. This allows user to specify full path to each module. For example vanilla ovs module can be defined as "OVS_DIR_VANILLA + 'datapath/linux/openvswitch.ko'" to load kernel module matching OVS vanilla source tree version. Change-Id: Ib8d16eca84449ad34d6b307ab836f58d2f0d341b JIRA: VSPERF-116 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-16test_spec: Need deployment scenario in RFC2889 Forwarding Rate testAl Morton1-0/+8
The RFC 2889 Forwarding Rate test requires a Deployment Scenario Section - was missing. JIRA: VSPERF-102 Change-Id: Iaf661a6bbb9ad52f23147f9444f23d96a82ceb2d Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-16test_spec: LTD: Add Caution for Scaleability Address Time-out.Al Morton1-1/+11
LTD.Scalability.RFC2544.0PacketLoss needs to add the caution that all flows must be learned before running Throughput testing, and no flows can be allowed to time-out during the test. JIRA: VSPERF-108 Change-Id: I95ae20a978b7af660b358450e67ce60939b0b7c1 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-16test_spec: IETF Draft: Update to reflect dev since July and IETF-93 commentsAl Morton3-26/+2279
Among the Updates needed are: - Several New tests created since July, add to Matrix section. - Re-named tests: fix in Matrix section. - Link to Summaries on Wiki. - Link to Test Setup Figures on Wiki. - Add some general points on New Test Equipment Challenges/Metrics. - Mention future test specs, and IFA003 as one source. JIRA: VSPERF-120 Change-Id: I981b0b6301a208d20220f67784b4591aa3f51338 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-16test_spec: LTD: Some "Throughput" Tests belong in another categoryAl Morton1-97/+107
In the LTD, some of the tests with "Throughput" in the title are not actually testing throughput in the data path. Since the test names are used by TOIT/VSPERF to group similar tests for batch execution, it's important that the names accurately represent the test methods and metrics measured. JIRA: VSPERF-98 Change-Id: I620ddc0779232f2dd325379005faba8692fea18c Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-16test_spec: LTD: Missing Pre-requisites in some of the "new" tests.Al Morton1-2/+6
A few of the tests should call out a prerequisite. LTD.MemoryBandwidth.RFC2544.0PacketLoss.Scalability and LTD.Scalability.RFC2544.0PacketLoss are examples. JIRA: VSPERF-107 Change-Id: I1ca653ac765f9494b48759764103dfc9d42a42f1 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-15Default config picks up OVS variantsRadek Zetik2-2/+32
Running a test with vanilla-ovs, vhost-user-ovs, vhost-cuse-ovs,... does not require any building or configuration changes - the vswitch needs only to specified on the command line. The config file contains new variables for particular ovs build. OvsVanilla: OVS_DIR_VANILLA, QEMU_DIR_VANILLA VhostCuse: RTE_SDK_CUSE, OVS_DIR_CUSE, QEMU_DIR_CUSE VhostUser: RTE_SDK_USER, OVS_DIR_USER, QEMU_DIR_USER The vspef chooses right paths according to command line switches '--vswitch' (or 'VSWITCH') and '--vnf' (or 'VNF') JIRA: VSPERF-86 Change-Id: I22e3a7f9e21d6ceb13830e444716b4274314560c Signed-off-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-10-15test_spec: LTD:Throughput.RFC2544.Profile Metric ClarificationsAl Morton1-4/+4
LTD.Throughput.RFC2544.Profile refers to the metric "maximum forwarding rate" but implies that this is the zero% loss rate, which would be the Throughput level (MFR is usually higher than Throughput, because MFR allows losses). It may be that MFR and Throughput are just interchanged in the last two paragraphs of the description. JIRA: VSPERF-110 Change-Id: I4f36fd4ce66f2f4ebee4f60a11ad03adfb2b3b7c Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-15test_spec: LTD: Memory BW Test - probable issue caused by md to rst conversionAl Morton1-11/+14
The following text in the Description needs to be formatted as a list in .RST: Furthermore: - the ratio of reads to writes should be recorded. JIRA: VSPERF-109 Change-Id: I3b6c819d1ac07cc466c747d3552cbcc4de5f34bf Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-14test_spec: Expand deployment scenario in RFC2889 Broadcast Rate testAl Morton1-1/+3
In the RFC 2889 Broadcast rate testing, four test ports are required. One of the ports is connected to the test device, so it can send broadcast frames and listen for miss-routed frames. JIRA: VSPERF-103 Change-Id: I5ee3d20c71d7debf6c7b09fc094f72b2d4c10684 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com>
2015-10-12Enable PVP and PVVP deployments for Vanilla OVSMartin Klozik18-35/+331
Support for PVP and PVVP scenerios using Vanilla OVS was added. VMs are configured to forward traffic between virtual interfaces by standard linux capabilities. Traffic generator script was updated to accept MAC and IP address configuration to allow VM forwarding configuration. VSPERF-66, VSPERF-70 Change-Id: Ia70ab6be547b39928a1eae319faba779d4e29284 Signed-off-by: Martin Klozik <martinx.klozik@intel.com> Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Reviewed-by: Gene Snider <eugene.snider@huawei.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>
2015-10-12docs: Add overview of the structure of vsperf codeBilly O'Mahony7-0/+298
Text & sequence diagrams as both source and png. JIRA: VSPERF-106 Signed-off-by: Billy O'Mahony<billy.o.mahony@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Eugene Snider <Eugene.Snider@huawei.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com> Change-Id: I33f57fba85710ab4cfc72d0a5d06db6f653545d6
2015-10-08test_spec: Note need for 3 test ports in RFC2889 address/cacheAl Morton1-3/+8
The RFC 2889 Address Learning and Cache Capacity tests require a listening port to check for flooded frames. JIRA: VSPERF-74 Change-Id: I7b4d2461e819d01d642c9c4d95b938dfbe056f2c Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-10-07src: add appropriate build flags for OVS dpdkMaryam Tahhan1-0/+1
Technical Debt - Add appropriate build flags to the OVS makefiles to build OVS for performance. JIRA:VSPERF-92 Change-Id: I63d45ebe8ba41799158f97db892a94e16c7b3df5 Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-07Enable PVVP deployment for DPDK Vhost User and Vhost CuseMartin Klozik24-1005/+728
Generic PVVP deployment support has been added. Two new testcase scenarios for throughput and back2back tests with PVVP deployment were added. Original implementation of PVP has been refactored Following files were affected: modified: conf/01_testcases.conf modified: conf/02_vswitch.conf modified: conf/04_vnf.conf modified: core/__init__.py modified: core/component_factory.py modified: core/loader/loader_servant.py modified: core/vnf_controller.py deleted: core/vnf_controller_p2p.py deleted: core/vnf_controller_pvp.py modified: core/vswitch_controller_p2p.py modified: core/vswitch_controller_pvp.py new file: core/vswitch_controller_pvvp.py modified: docs/to-be-reorganized/NEWS.rst modified: docs/to-be-reorganized/quickstart.rst modified: src/dpdk/dpdk.py modified: src/ovs/ofctl.py modified: testcases/testcase.py modified: tools/tasks.py new file: vnfs/qemu/qemu.py new file: vnfs/qemu/qemu_dpdk.py modified: vnfs/qemu/qemu_dpdk_vhost_cuse.py modified: vnfs/qemu/qemu_dpdk_vhost_user.py modified: vnfs/vnf/vnf.py modified: vswitches/ovs_dpdk_vhost.py Change-Id: Ib6869a29337a184cb58c57fd96bba1183aba00ab JIRA: VSPERF-68, VSPERF-69 Signed-off-by: Martin Klozik (martinx.klozik@intel.com) Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-07The 'make' creates all required variants of vSwitchRadek Zetik6-11/+109
Currently the VSPERF makefiles make just one variant of vSwitch - OVS with DPDK-vhost-user. To make the other variants the makefile has to be edited. And the make re-run. The fix builds all required versions: DPDK-vhost-user OVS (in src/) Vanilla OVS (in src_vanilla/) DPDK-vhost-cuse OVS (in src_cuse/) HowTo: - git clone vsperf - cd .../src - make JIRA: VSPERF-85 Change-Id: I469baf8432f0b127cde785f35a6c57a2c778f23f Signed-off-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
2015-10-07pkt_gen: change duration to int for Dummy pkt_genRobert Wojciechowicz1-5/+5
In case there is specified concrete value for "duration" in the configuration there is raised TypeError exception in the send_rfc2544_throughput function of dummy traffic generator. Conversion to integer solved this issue. Change-Id: Ib37ecabc1000369d807a997c88d7a3d7aca425d5 Signed-off-by: Robert Wojciechowicz <robertx.wojciechowicz@intel.com> Reviewed-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com> Reviewed-by: Martin Klozik <martinx.klozik@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-10-07test_spec: Add Traffic Profiles (IMIX) maintained by FunctestAl Morton1-1/+2
The Current list of fixed frame sizes need to be augmented with IMIX Traffic Profiles in the test framework. JIRA: VSPERF-100 Change-Id: I97425c09c1d692bae56f2518d479b83a282eb7d1 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-10-06test_spec: Fix WIDE Fig and Note need for full-mesh ports in RFC2889 testsAl Morton1-31/+41
The RFC 2889 tests require Full Mesh on multiple ports. Modify the bunny-ears fig to show this (and address -99 in the process) JIRA: VSPERF-99 JIRA: VSPERF-101 Change-Id: Id67cb5ef6748c83858a90033534f960874614c06 Signed-off-by: Al Morton <acmorton@att.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-10-06Remove reported derived performance figuresRadek Zetik1-4/+5
Since vsperf (ixnet trafficgen) started using AggResults.csv to pull out traffic results after bi-dir support was added. Some of the derived results are wrong (derived meaning these are figures vsperf calculates from the info available in the raw ixnet results). JIRA: VSPERF-88 Change-Id: I79d88bfc7718bda675d2ba7e5148053405a94211 Signed-off-by: Radek Zetik <radekx.zetik@intel.com> Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
2015-09-29Sysmetrics implementation updateMartin Klozik17-242/+253
New sysmetrics implementation is based on pidstat command line tool from sysstat package. Old non-functional implementation was removed. Reporting was refactored to generate report after each TC from values already available in memory. Following files were affected: modified: conf/01_testcases.conf modified: conf/02_vswitch.conf modified: conf/05_collector.conf deleted: core/collector_controller.py modified: core/component_factory.py modified: docs/NEWS.rst modified: packages.txt modified: requirements.txt modified: testcases/testcase.py modified: tools/collectors/collector/collector.py modified: tools/collectors/sysmetrics/__init__.py deleted: tools/collectors/sysmetrics/linuxmetrics.py new file: tools/collectors/sysmetrics/pidstat.py modified: tools/report/report.jinja modified: tools/report/report.py modified: tools/systeminfo.py modified: vsperf JIRA: VSPERF-67 Change-Id: I25a79f2afef405b9ac46ae85c18044af167a62a4 Signed-off-by: Martin Klozik (martinx.klozik@intel.com) Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com> Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Gurpreet Singh <gurpreet.singh@spirent.com> Reviewed-by: Tv Rao <tv.rao@freescale.com>