Age | Commit message (Collapse) | Author | Files | Lines |
|
In the past, only a few configuration parameters could be
modified via --test-params CLI argument and it was not easy
to find out their complete list.
This patch adds support for generic modification of any
configuration parameter via CLI argument --test-params
or by "Parameters" section of testcase definition.
Thus it is possible to customize a vsperf configuration
environment per testcase or for each vsperf execution.
Old CLI parameters duration, pkt_sizes, rfc2544_tests
and rfc2889_trials were renamed to TRAFFICGEN_DURATION,
TRAFFICGEN_PKT_SIZES, TRAFFICGEN_RFC2544_TESTS and
TRAFFICGEN_RFC2889_TRIALS to be consistent with
other configuration parameters.
JIRA: VSPERF-375
Change-Id: I50a1f4ff7250d754aa8af0295a9c7c1be8151175
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Antonio Fischetti <antonio.fischetti@intel.com>
Reviewed-by: <sridhar.rao@spirent.com>
|
|
IXIA traffic generator can be controlled by two different
VSPERF's wrappers IxNet (preferred) and Ixia (legacy and
outdated). It has been found, that Ixia wrapper can't be used
because of missing "packetsize" traffic item. Also only
IXIA OS 6.60 was supported and never IXIA OS versions
were not working. Both limitations were fixed.
Also reported results were fixed to show correct values
for MBPS items.
JIRA: VSPERF-417
Change-Id: I191aa9fee2683877ce373b6aa7cd1c72e9847568
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
Reviewed-by: Christo Kleu <christo.kleu@netronome.com>
|
|
All files, which do not comply to Apache 2.0 license,
are moved into dedicated 3rd_party directory. This will
simplify license checks performed on vsperf code.
It is not required to move l2fwd module from its
current location.
JIRA: VSPERF-413
Change-Id: I6b4bd6bb5542e6db9a7ef91ee3f5f2907f93e9b8
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Bill Michalowski <bmichalo@redhat.com>
|
|
JIRA: VSPERF-392
Change-Id: I44866b7d3298617003b87b015eb08bf32c4014f7
Signed-off-by: Otto Sabart <osabart@redhat.com>
|
|
The changes/additions, apart from spirent testcenter-specific, also
includes
to some files in conf (01_testcase and 03_traffic) and core (result-
constants, traffic_controller and component_factory) folders.
Currently, only RFC2889 Forwarding testcase is supported.
Incorporated following review suggestions:
1. Log level fixes
2. Removing unused function in results_constants.py
3. Added documentation to docs/configguide/trafficgen.rst. Userguide
will be updated once other RFC2889 tests are implemented.
4. string matching in component_factory.
5. Remove Trailing Whitespaces
JIRA: VSPERF-286
Change-Id: I0195720ab2f8cf2c3a5aa490d66166bdca0afcb0
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
MoonGen code optimizations and general clean up. No
functionality changes.
JIRA: VSPERF-351
Change-Id: Ida16f16eb218eb6f0a1c90594c38511bfbb2cf97
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Misplaced parenthesis regarding THROUGHPUT_RX_MBPS
JIRA: VSPERF-381
Change-Id: Ie33cf6ca88164f0686a819715b5f9f7409072063
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Added changes to make use of the tests parameter.
The change is minor.
Prior to this the value was taken from configuration file.
With this change, the tests value is used as passed.
JIRA: VSPERF-367
Change-Id: I9d1553d3b53dd19a79428ddaaacadb55fc27324f
Signed-off-by: Sridhar Rao <sridhar.rao@spirent.com>
|
|
Adds options to Xena for testing options when running RFC 2544
throughput testing.
JIRA: VSPERF-369
Change-Id: I3145bd1a4d697d7b06cafda4f9d77cce859d1839
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
|
|
Instead of hard coding line speed numbers for rate calcuation,
MoonGen should use its class object initialized at start time.
JIRA: VSPERF-368
Change-Id: I68c688f8c244df16d98cfd15efabf491a317256b
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
|
|
For MoonGen, the final results parameters: throughput_rx_percent,
throughput_tx_percent were incorrectly calculated when converting
MoonGen to VSPERF format. In particular, this would occur when more
than one data stream (single channel unidirectional traffic) was used in
the test. When calculating these percentages, only aggregate throughput
values equaling unidirectional traffic were used (for example, for 64
byte frames bidirectional traffic should use 29.76 Mpps, not 14.88 Mpps)
JIRA: VSPERF-341
Change-Id: Ie62bded7aea023c287697f18c4172b58c320e050
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
|
|
|
|
VSPERF framework was updated to follow RFC2544 definition
of 'test' and 'trial' terms. Test parameter 'rfc2544_trials'
was replaced by new parameter 'rfc2544_tests'.
Both code and documentation were updated to reflect
these changes.
JIRA: VSPERF-300
Change-Id: I144a28359fd06394f1f87ef324458bafd5aad45f
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>
|
|
Xena exception when no stats collected on receive on one port
during bi-directional traffic. Modify aggregate_stats in the
XenaDriver.py, add judge whether the two port both has stats,
if one port has no stats, the result use the port's value which
has stats.
JIRA: VSPERF-327
Change-Id: I18c349d609a2834907f0383dbfbebd5cd281f541
Signed-off-by: liting <tli@redhat.com>
|
|
The VSPERF traffic profile for starting rate is in a
percentage of line rate. MoonGen programs its
starting rate as Mpps. Therefore the traffic profile
for VSPERF needs to be converted to a MoonGen format.
There was a hardcoding of 14.88 that was used for the
starting frame rate for all frame sizes. This needs
to be corrected to take into account all frame sizes.
JIRA: VSPERF-350
Change-Id: Ied71668a560d7d2b03483f9a1192dd2fb4965996
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
|
|
|
|
|
|
Results from other traffic generators are reported as
pure numbers, i.e. 2477356.0000. These values are
consumed and processed by other scripts (e.g. CI or
OPNFV results visualization), so we should keep it
consistent among various traffic generators.
JIRA: VSPERF-342
Change-Id: I305421287eb632707038f2c8bc594fcb255ec939
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Configuration guide has been updated with description of
IxNetwork specific configuration options. New section was added
with description of test results sharing between IxNetwork and
VSPERF.
Additional changes:
* wrong formatting inside installation.rst was fixed
* description of IxNetwork configuration was updated inside ixnet.py
JIRA: VSPERF-302
Change-Id: Ida0e086e69b82fd1f9821d16ea750b2dec1d5aa2
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: <bmichalo@redhat.com>
|
|
MoonGen needs to take into account the VLAN tag 'enable'
control knob defined within the VSPERF traffic profile
and therefore only insert the VLAN tag when its 'True'.
JIRA: VSPERF-329
Change-Id: Idbeed2f7e6411f0c28aa56a2d3e71bd7a79d975a
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Fix Xena2544.exe execution with mono where sometimes the
Xena process says complete, but the mono process doesn't exit.
Changes call of Xena2544.exe from communicate thread lock to a
wait try/catch block and checks the log periodically to see
if a deadlock has occured and if so, the mono pid is terminated
to prevent deadlock.
* Fix one small issue with typecasting to int, changed to float
JIRA: VSPERF-319
Change-Id: Ie7a86a2b9ff9cdfacba5a912ad17df6cc0581702
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Need to change naming to 'Moongen' for consistent naming
between conf files and class
JIRA: VSPERF-323
Change-Id: Ic580b68323a759b3c2ef7ca3c07006243a3acf7d
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
Removal of redunant code in testcenter.py.
No logic Changes.
Cosmetic changes - removing redundant code of 150+ lines.
JIRA: VSPERF-308
Change-Id: I4766890cdc9f3d23103b2d2090285361ac4a5197
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
|
|
|
|
Modify the _create_throughput_result method typecasts int to
typecasts to float
JIRA: VSPERF-312
Change-Id: I45722251f3ca200373aa7b6958e62ea511c304f8
Signed-off-by: tli <tli@redhat.com>
|
|
|
|
Adds support for the MoonGen packet generator.
The following traffic types are included:
* RFC 2544 Throughput: Synchronous Interface
* RFC 2544 Back 2 Back: Synchronous Interface
* Continous Flow: Synchronous Interface
JIRA: VSPERF-168
Sample log of execution can be found as an
attachment within JIRA VSPERF-168
Change-Id: I5bb84290945f4ba41bc962370e643bbbeff0e486
Signed-off-by: bmichalo <bmichalo@redhat.com>
|
|
|
|
Fix baseconfig to work with new Xena2544.exe versions. Reporting
option for latency/jitter collection has changed.
Added note to trafficgen document reflecting recommended version
to use for Xena2544.exe.
JIRA: VSPERF-311
Change-Id: I1974ea3c9f9e4c0935fc8adead6ddd5a92a16a04
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Add method set_test_options_back2back in code to modify duration,
iterations, and flowrate for back2back options in the json file.
JIRA: VSPERF-305
Change-Id: I1337318e7519fbd7b5a71bb26a1c62fcd8c2b66c
Signed-off-by: tli <tli@redhat.com>
|
|
Add Xena burst traffic functionality.
JIRA: VSPERF-263
Change-Id: I6336e5fcb33c0f66ee87f0f14f1b795937e3d00d
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
|
|
Adding changes for supporting continuous traffic for Spirent Testcenter
The changes are as follows:
1. From send_cont_traffic invoke function in testcenter-rfc2544-rest.py
2. In testcenter-rfc2544-rest.py check for the traffic_custom
3. If the traffic_custom is 'cont' do additional configuration on
traffic.
JIRA: VSPERF-146
Change-Id: Ic963f9f0c2bd013f6e676c9d18b151ae67ff77af
Signed-off-by: Sridhar Rao <sridhar.rao@spirent.com>
|
|
* Adds XenaDriver.py module to allow direct communication to
Xena chassis through socket API and collect stats.
* Adds implementation into xena.py for continuous traffic
flow.
JIRA: VSPERF-262
Change-Id: I6f975bc205e3c954215eb16466f11298e3fcdfaf
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Fix xena throughput stats for bi directional traffic by
taking the receive numbers from both ports instead of
a single port.
JIRA: VSPERF-303
Change-Id: I3898afe00f8c80f54e5b4c210831e1fc6cef3c20
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Fix xena_json module to correctly assign hwmodifier for
multistream. Append was incorrect application and
list needs to be assigned directly.
JIRA: VSPERF-293
Change-Id: I88d1930b88711af7c920b507a4db6c29cca83d8d
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Support for reporting FPS and MBPS (TX and RX) is added.
JIRA: VSPERF-285
Change-Id: Ic4b6ca02368b1808f0f985e90099cdb0b41c2afa
Signed-off-by: sridharkn <sridhar.rao@spirent.com>
|
|
Fixes bi-directional param and enforces string type in
testcase configuration. Modifies all instance where bi
directional value is used to string.
* Changes documentation to specify value type as needed
* Changes traffic defaults to use string for bidir value
* Fixes testcases configuration files to use bidir as str
* Change testcase conf documentation to note enforcement
of string type
* Sets bidir to title format to keep consitency in traffic
profile when passed to traffic generators
* Fix pvp/pvvp check for bidir value
* Raise exception if testcase configuration is not set
as str for bidir value
* Change Xena bi-dir check to string compare instead of
typecasting to boolean to compare.
JIRA: VSPERF-282
Change-Id: I7c91fcd7333a1d1e1371bfd31700c01d7da268b5
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Adds port ip set options as part of conf files. Allows for IPv4
address assignment. Adds ipv6 options for later implementation
when available in framework.
* Adds Xena to documentation area where available traffic gens
are listed.
JIRA: VSPERF-273
Change-Id: Ia4129222ea95f1d399d5cc0c589c9a99d7b1b81a
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Adds Xena version info to report files. Works by pulling the
version info from the result file and adding it to the
settings dictionary.
JIRA: VSPERF-274
Change-Id: I2b7db30e5a621f32a7eaacfe48ab1bca498e4287
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Allows for execution of back 2 back tests by enabling back to back
test scenario in json file when executing Xena2544.exe. Return
results are the number of frames. Results for test execution can
be found in the coresponding JIRA ticket.
- Disabled throughput by default in json file.
- Modified test params in baseconfig file for b2b test
- Modified create_result method to use data in resulting xml file
over using inspect strategy to detect test type
- Added line to Xena installation guide for issue that was found
locally after installation
JIRA: VSPERF-264
Change-Id: I0ecd6e1ce750613c53fe308aea3f5a55cca69c20
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
The import of stcrestclient in moved down to avoid execution errors.
Change-Id: Ib9b64f62400c20a031f0ffcd3410582741cf1644
JIRA: VSPERF-237
|
|
Add files for Xena Networks 2544 throughput
implementation. This allows for Xena to execute
tput tests from VSPerf. For information on how
this works please see the JIRA ticket.
Modify traffic gen guide on install instructions
for Xena. Add in scapy to requirements file. Modify
conf file for Xena chassis connection information.
* Added license info to __init__.py / baseconfig.x2544
* Set initial rate to 10% line rate for tput testing
* Modified default mac address xena_json->set_header_layer2
from aa:aa:aa:aa:aa:aa to cc:cc:cc:cc:cc:cc
* Removed obsolete multistream params
* Added traffic params to 03_traffic.conf
* Comments to explain try/catch for latency values
* Removed unused import
* Rebased to fix merge conflict
* Added Xena to available traffic gen list in conf files
JIRA: VSPERF-261
Change-Id: I3c4b4a332fd532e10b6096e9ed97a4a39d410839
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
Stcrestclient package based script is added. Support for RFC22544
backtoback, latency, frameloss are also added, along with the throughput.
Comments Addressed:
1. Parameter name consistency. Ex: use duration (refer dummy.py).
2. Moved 'only the necessary contents of README to
configguide/trafficgen.rst.
3. Removed README file
4. Commit message format (pkt_gen: and linewrap)
5. Merged 4 scripts (throughput/backtoback/latency/frameloss)
that were rest-based into one single script.
Name: testcenter-rfc2544-test.py
6. Changed year to 2016
7. Moved imports to the top (testcenter-rfc2544-rest.py)
8. Changed prints to Log (testcenter-rfc2544-rest.py)
9. Reporting the frame loss percentage.
10. Calls to frameloss and latency are not added as the 'caller'
class TrafficControllerRFC2544 is only calling backtoback and
throughput.
11. Changed Exception, e to Exception as e for python 3
compatibility
12. Remaining prints to debug and logger.error for errors.
13. Moved Session creation under try block.
14. Removed deadcode
15. Fixed missing docstring
16. Generic to specific Exception.
17. if-if to if-elif
18. Debug level logging only under verbose flag.
19. Fixed Arguments mismatch.
20. Ordering of the imports
Note: The testcenter-rfc2544-rest.py is spawned as a separate process,
and need not be wrapped in a class.
JIRA: VSPERF-237
Change-Id: I05d2b24fca1da4ba67bc4d79206c5d755ebf8f20
Signed-off-by: sridharkn <sridhar.rao@spirent.com>
|
|
Several issues have been fixed to decrease a number of warning
and error messages written to the standard output. Error and
warning messages causes false build failure report by Jenkins,
in case that internal parsing of job output is enabled.
Fixed issues:
* qemu makefile updated
* shared directories between host and guests are forcibly deleted
before vsperf execution
* nonstop_tsc cpu flag is exported from host to the guest
* vloop-vnf help has been updated and changelog added
* TCL scripts updated to print info instead of warning
* vloop-vnf image updated to avoid snmpd related warnings
Change-Id: Id9ca014bae8fa34772b67d1ebab3431682682931
JIRA: VSPERF-206
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Maryam Tahhan <maryam.tahhan@intel.com>
|