| Age | Commit message (Collapse) | Author | Files | Lines |
|---|
|
|
|
For MoonGen, the final results parameters: throughput_rx_percent,
throughput_tx_percent were incorrectly calculated when converting
MoonGen to VSPERF format. In particular, this would occur when more
than one data stream (single channel unidirectional traffic) was used in
the test. When calculating these percentages, only aggregate throughput
values equaling unidirectional traffic were used (for example, for 64
byte frames bidirectional traffic should use 29.76 Mpps, not 14.88 Mpps)
JIRA: VSPERF-341
Change-Id: Ie62bded7aea023c287697f18c4172b58c320e050
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
|
|
|
|
VSPERF framework was updated to follow RFC2544 definition
of 'test' and 'trial' terms. Test parameter 'rfc2544_trials'
was replaced by new parameter 'rfc2544_tests'.
Both code and documentation were updated to reflect
these changes.
JIRA: VSPERF-300
Change-Id: I144a28359fd06394f1f87ef324458bafd5aad45f
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>
|
|
Xena exception when no stats collected on receive on one port
during bi-directional traffic. Modify aggregate_stats in the
XenaDriver.py, add judge whether the two port both has stats,
if one port has no stats, the result use the port's value which
has stats.
JIRA: VSPERF-327
Change-Id: I18c349d609a2834907f0383dbfbebd5cd281f541
Signed-off-by: liting <tli@redhat.com>
|
|
The VSPERF traffic profile for starting rate is in a
percentage of line rate. MoonGen programs its
starting rate as Mpps. Therefore the traffic profile
for VSPERF needs to be converted to a MoonGen format.
There was a hardcoding of 14.88 that was used for the
starting frame rate for all frame sizes. This needs
to be corrected to take into account all frame sizes.
JIRA: VSPERF-350
Change-Id: Ied71668a560d7d2b03483f9a1192dd2fb4965996
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
|
|
|
|
|
|
Results from other traffic generators are reported as
pure numbers, i.e. 2477356.0000. These values are
consumed and processed by other scripts (e.g. CI or
OPNFV results visualization), so we should keep it
consistent among various traffic generators.
JIRA: VSPERF-342
Change-Id: I305421287eb632707038f2c8bc594fcb255ec939
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Configuration guide has been updated with description of
IxNetwork specific configuration options. New section was added
with description of test results sharing between IxNetwork and
VSPERF.
Additional changes:
* wrong formatting inside installation.rst was fixed
* description of IxNetwork configuration was updated inside ixnet.py
JIRA: VSPERF-302
Change-Id: Ida0e086e69b82fd1f9821d16ea750b2dec1d5aa2
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>
|
|
MoonGen needs to take into account the VLAN tag 'enable'
control knob defined within the VSPERF traffic profile
and therefore only insert the VLAN tag when its 'True'.
JIRA: VSPERF-329
Change-Id: Idbeed2f7e6411f0c28aa56a2d3e71bd7a79d975a
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Fix Xena2544.exe execution with mono where sometimes the
Xena process says complete, but the mono process doesn't exit.
Changes call of Xena2544.exe from communicate thread lock to a
wait try/catch block and checks the log periodically to see
if a deadlock has occured and if so, the mono pid is terminated
to prevent deadlock.
* Fix one small issue with typecasting to int, changed to float
JIRA: VSPERF-319
Change-Id: Ie7a86a2b9ff9cdfacba5a912ad17df6cc0581702
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Need to change naming to 'Moongen' for consistent naming
between conf files and class
JIRA: VSPERF-323
Change-Id: Ic580b68323a759b3c2ef7ca3c07006243a3acf7d
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Removal of redunant code in testcenter.py.
No logic Changes.
Cosmetic changes - removing redundant code of 150+ lines.
JIRA: VSPERF-308
Change-Id: I4766890cdc9f3d23103b2d2090285361ac4a5197
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
|
|
|
|
Modify the _create_throughput_result method typecasts int to
typecasts to float
JIRA: VSPERF-312
Change-Id: I45722251f3ca200373aa7b6958e62ea511c304f8
Signed-off-by: tli <tli@redhat.com>
|
|
|
|
Adds support for the MoonGen packet generator.
The following traffic types are included:
* RFC 2544 Throughput: Synchronous Interface
* RFC 2544 Back 2 Back: Synchronous Interface
* Continous Flow: Synchronous Interface
JIRA: VSPERF-168
Sample log of execution can be found as an
attachment within JIRA VSPERF-168
Change-Id: I5bb84290945f4ba41bc962370e643bbbeff0e486
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
|
|
Fix baseconfig to work with new Xena2544.exe versions. Reporting
option for latency/jitter collection has changed.
Added note to trafficgen document reflecting recommended version
to use for Xena2544.exe.
JIRA: VSPERF-311
Change-Id: I1974ea3c9f9e4c0935fc8adead6ddd5a92a16a04
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Add method set_test_options_back2back in code to modify duration,
iterations, and flowrate for back2back options in the json file.
JIRA: VSPERF-305
Change-Id: I1337318e7519fbd7b5a71bb26a1c62fcd8c2b66c
Signed-off-by: tli <tli@redhat.com>
|
|
Add Xena burst traffic functionality.
JIRA: VSPERF-263
Change-Id: I6336e5fcb33c0f66ee87f0f14f1b795937e3d00d
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
|
|
Adding changes for supporting continuous traffic for Spirent Testcenter
The changes are as follows:
1. From send_cont_traffic invoke function in testcenter-rfc2544-rest.py
2. In testcenter-rfc2544-rest.py check for the traffic_custom
3. If the traffic_custom is 'cont' do additional configuration on
traffic.
JIRA: VSPERF-146
Change-Id: Ic963f9f0c2bd013f6e676c9d18b151ae67ff77af
Signed-off-by: Sridhar Rao <sridhar.rao@spirent.com>
|
|
* Adds XenaDriver.py module to allow direct communication to
Xena chassis through socket API and collect stats.
* Adds implementation into xena.py for continuous traffic
flow.
JIRA: VSPERF-262
Change-Id: I6f975bc205e3c954215eb16466f11298e3fcdfaf
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Fix xena throughput stats for bi directional traffic by
taking the receive numbers from both ports instead of
a single port.
JIRA: VSPERF-303
Change-Id: I3898afe00f8c80f54e5b4c210831e1fc6cef3c20
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Fix xena_json module to correctly assign hwmodifier for
multistream. Append was incorrect application and
list needs to be assigned directly.
JIRA: VSPERF-293
Change-Id: I88d1930b88711af7c920b507a4db6c29cca83d8d
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Support for reporting FPS and MBPS (TX and RX) is added.
JIRA: VSPERF-285
Change-Id: Ic4b6ca02368b1808f0f985e90099cdb0b41c2afa
Signed-off-by: sridharkn <sridhar.rao@spirent.com>
|
|
Fixes bi-directional param and enforces string type in
testcase configuration. Modifies all instance where bi
directional value is used to string.
* Changes documentation to specify value type as needed
* Changes traffic defaults to use string for bidir value
* Fixes testcases configuration files to use bidir as str
* Change testcase conf documentation to note enforcement
of string type
* Sets bidir to title format to keep consitency in traffic
profile when passed to traffic generators
* Fix pvp/pvvp check for bidir value
* Raise exception if testcase configuration is not set
as str for bidir value
* Change Xena bi-dir check to string compare instead of
typecasting to boolean to compare.
JIRA: VSPERF-282
Change-Id: I7c91fcd7333a1d1e1371bfd31700c01d7da268b5
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Adds port ip set options as part of conf files. Allows for IPv4
address assignment. Adds ipv6 options for later implementation
when available in framework.
* Adds Xena to documentation area where available traffic gens
are listed.
JIRA: VSPERF-273
Change-Id: Ia4129222ea95f1d399d5cc0c589c9a99d7b1b81a
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Adds Xena version info to report files. Works by pulling the
version info from the result file and adding it to the
settings dictionary.
JIRA: VSPERF-274
Change-Id: I2b7db30e5a621f32a7eaacfe48ab1bca498e4287
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Allows for execution of back 2 back tests by enabling back to back
test scenario in json file when executing Xena2544.exe. Return
results are the number of frames. Results for test execution can
be found in the coresponding JIRA ticket.
- Disabled throughput by default in json file.
- Modified test params in baseconfig file for b2b test
- Modified create_result method to use data in resulting xml file
over using inspect strategy to detect test type
- Added line to Xena installation guide for issue that was found
locally after installation
JIRA: VSPERF-264
Change-Id: I0ecd6e1ce750613c53fe308aea3f5a55cca69c20
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
The import of stcrestclient in moved down to avoid execution errors.
Change-Id: Ib9b64f62400c20a031f0ffcd3410582741cf1644
JIRA: VSPERF-237
|
|
Add files for Xena Networks 2544 throughput
implementation. This allows for Xena to execute
tput tests from VSPerf. For information on how
this works please see the JIRA ticket.
Modify traffic gen guide on install instructions
for Xena. Add in scapy to requirements file. Modify
conf file for Xena chassis connection information.
* Added license info to __init__.py / baseconfig.x2544
* Set initial rate to 10% line rate for tput testing
* Modified default mac address xena_json->set_header_layer2
from aa:aa:aa:aa:aa:aa to cc:cc:cc:cc:cc:cc
* Removed obsolete multistream params
* Added traffic params to 03_traffic.conf
* Comments to explain try/catch for latency values
* Removed unused import
* Rebased to fix merge conflict
* Added Xena to available traffic gen list in conf files
JIRA: VSPERF-261
Change-Id: I3c4b4a332fd532e10b6096e9ed97a4a39d410839
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Stcrestclient package based script is added. Support for RFC22544
backtoback, latency, frameloss are also added, along with the throughput.
Comments Addressed:
1. Parameter name consistency. Ex: use duration (refer dummy.py).
2. Moved 'only the necessary contents of README to
configguide/trafficgen.rst.
3. Removed README file
4. Commit message format (pkt_gen: and linewrap)
5. Merged 4 scripts (throughput/backtoback/latency/frameloss)
that were rest-based into one single script.
Name: testcenter-rfc2544-test.py
6. Changed year to 2016
7. Moved imports to the top (testcenter-rfc2544-rest.py)
8. Changed prints to Log (testcenter-rfc2544-rest.py)
9. Reporting the frame loss percentage.
10. Calls to frameloss and latency are not added as the 'caller'
class TrafficControllerRFC2544 is only calling backtoback and
throughput.
11. Changed Exception, e to Exception as e for python 3
compatibility
12. Remaining prints to debug and logger.error for errors.
13. Moved Session creation under try block.
14. Removed deadcode
15. Fixed missing docstring
16. Generic to specific Exception.
17. if-if to if-elif
18. Debug level logging only under verbose flag.
19. Fixed Arguments mismatch.
20. Ordering of the imports
Note: The testcenter-rfc2544-rest.py is spawned as a separate process,
and need not be wrapped in a class.
JIRA: VSPERF-237
Change-Id: I05d2b24fca1da4ba67bc4d79206c5d755ebf8f20
Signed-off-by: sridharkn <sridhar.rao@spirent.com>
|
|
Several issues have been fixed to decrease a number of warning
and error messages written to the standard output. Error and
warning messages causes false build failure report by Jenkins,
in case that internal parsing of job output is enabled.
Fixed issues:
* qemu makefile updated
* shared directories between host and guests are forcibly deleted
before vsperf execution
* nonstop_tsc cpu flag is exported from host to the guest
* vloop-vnf help has been updated and changelog added
* TCL scripts updated to print info instead of warning
* vloop-vnf image updated to avoid snmpd related warnings
Change-Id: Id9ca014bae8fa34772b67d1ebab3431682682931
JIRA: VSPERF-206
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
|
|
Both documentation and traffic generator API are updated
to match current code logic. Additional default values
are added into TRAFFIC_DEFAULTS dictionary. Constructor
of TestCase class uses default values from TRAFFIC_DEFAULTS
instead of magic numbers.
Change-Id: Id2f4983945e4b123adddbc9a2a832f4a735b27f6
JIRA: VSPERF-253
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
|
|
This patch adds the frameloss % result reporting to the dummy traffic
gen and fixes incorrect calculations in the past for mbps that don't
convert packet sizes to bits.
JIRA: VSPERF-201
Change-Id: Ic4fc64a981ecbed0ab956f1cb94c7d76e7868def
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
|
|
Fixed docstring to correctly reflect python output from using
merge_spec function.
JIRA: VSPERF-210
Change-Id: Ie3bf2a3d148aa9823bafafe8c61c4c94f00ccc87
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
|
|
The patch introduces frame_loss_percent result value.
The implementation is done for Ixia and IxNet
traffic generators. The value is visible in list
of result values at the end of the test, in csv,
rst and md files.
JIRA: VSPERF-201
Change-Id: I9b6795d427b199cb62ed66b7a137e412e36dc757
Signed-off-by: Radek Zetik <radekx.zetik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Tv Rao <tv.rao@freescale.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
|
|
Add option to generate GENEVE frames for decapsulation
tests.
IxNet 7.3X does not have a native support of GENEVE protocol. The
template, GeneveIxNetTemplate.xml_ClearText.xml, should be imported
into IxNET for this testcase to work.
Recent changes:
* Updated dependency
* Updated userguide
* Move inner frame variables & srcport/dstport to L4
Change-Id: I90f5fb256b51ae44bc1bc7983c599c9dbbffea08
JIRA: VSPERF-192
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Mark D. Gray <mark.d.gray@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
|
|
Add option to generate GRE frames for testing GRE decapsulation
tests.
Recent changes:
* Fix merge conflict
* Updated userguides
* Complete set of fields and working decap
* Move GRE ixnet calls to if statement to reuse inner frame settings
Change-Id: I0cf9243953a72a464ae4701a858e76aecbdb8528
JIRA: VSPERF-191
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
|
|
Measure OVS DPDK VXLAN decapsulation performance.
The DUT is configured as a VTEP (VXLAN Tunnel Endpoint)
which performs decapsulation of frames and sends traffic to
the 2nd traffic generator port.
This test is unidirectional.
Recent changes:
* Userguide update
* Move src/dstport from L2 to L4 (conf, TCL)
* Fix 'TestCase' object has no attribute '_tunnel_operation' error when
running non overlay tests
* Fix merge conflict
* Move doc to docs/userguide/integration.rst
* Add setting of DUT_NIC1_MAC and setting of other
variables to docs/userguide/integration.rst
Change-Id: Ia44f8888ef727831543c80f5c98c866686c5c92c
JIRA: VSPERF-190
Signed-off-by: Dino Simeon Madarang <dino.simeonx.madarang@intel.com>
Signed-off-by: Robert Wojciechowicz <robertx.wojciechowicz@intel.com>
Signed-off-by: Timo Puha <timox.puha@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com
|
|
Update the default duration of a back to back test to be 2 seconds which
is the minimum recommended by RFC2544, and update the Trials to be 50,
which is also the default value specified by the RFC. This patch also
fixes the tcl script to allow for the minimum framesize to be sent from
the traffic gen.
JIRA:
Change-Id: I801196c1998ec2bffbeab69a3a290d6ef6feb1c3
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Billy O Mahony <billy.o.mahony@intel.com>
|
|
VSPERF will explicitly expand any '~' to the absolute path to the user's
home directory before call of subsystem.Popen method. Only calls,
which process configuration values are modified.
Change-Id: Ibd9399ae84bf4698c86bf8eff97ca6ce785fb3fb
JIRA: VSPERF-45
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Brian Castelli <brian.castelli@spirent.com>
Reviewed-by: Al Morton <acmorton@att.com>
|
|
Streams used by scalability testcases can be simulated
at different network layers by modification of destination
MAC address (L2), destination IP address (L3) or destination
UDP port (L4). It is possible to define number and type
of the streams by testcase definition by options "MultiStream"
and "Stream Type" or by CLI parameters "multistream" and
"stream_type". CLI options override testcase definition.
Number of streams, their types, used transport protocol
and indication of pre-installed flows are written to both
result CSV file and MD file with test report.
Default transport protocol was changed to UDP because
IxNetwork configuration script doesn't support TCP yet.
Change-Id: I1ff9ab7756d38f65b1a7730397507c5a5ff5a3d1
JIRA: VSPERF-81
JIRA: VSPERF-82
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
|
|
Change throughput_tx_* references to tx_rate_* so the results won't be
confusing as part of the opnfv test dashboard when they become
publicly available.
Change-Id: Ie8cfae99a75497f15eb09d097c72c8a35df3b5f9
JIRA: VSPERF-135
Signed-off-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Ian Stokes <ian.stokes@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
|
Maryam Tahhan
bmichalo
Martin Klozik
liting
Christian Trautman
sridharkn
sridharkn
Radek Zetik
Dino Simeon Madarang