| Age | Commit message (Collapse) | Author | Files | Lines |
|---|
|
|
|
This patch will support running VSPERF Tests with Openstack.
This patch adds the following:
1. Provide --openstack parameter.
2. New Configuration file for openstack
3. Deploy Trafficgenerator based on configuration provided
4. Run Tests after Trafficgenerator are deployed on openstack
Update-1: Minor bug-fixes and Documentation Added.
Update-2: Add user-config to heat.
Update-3: Update Python Requirements
Update-4: Add dogpile
Update-5: Update decription of the Hot files.
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
Change-Id: Iebec356eb893e0e6726cac6a10537b99e41f67f4
|
|
|
|
This patch upgrades the version of T-Rex to the latest one.
V2.86.
This patch is tested on Node-4 and Node-5, Intel Pod12.
Scapy all.py modification is not required for new version.
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
Change-Id: I928cd3a92e59a90797ae8510a57f96487811f618
|
|
Signed-off-by: Shubham Mishra <shivam828787@gmail.com>
Change-Id: I76b25903bdd328c9dbaeaa6041f114f8e2b8dccf
|
|
|
|
* changes:
Docs: Add monitoring cluster related documentation
Tools: Add K8s monitoring cluster
|
|
This patch adds k8s monitoring cluster deployment using ansible for
both client and server side. Also adds scripts (ansible roles) to clean
(remove) the K8S cluster completely.
Signed-off-by: Aditya Srivastava <adityasrivastava301199@gmail.com>
Change-Id: I1115869c0a3e72a20047b31994f3d27e5fdae6c6
|
|
Ansible playbooks for LMA deployment
Signed-off-by: Adarsh Yadav <adiyadav0509@gmail.com>
Change-Id: I3ab71e139bc1668577506fb996105a834a9c3c65
|
|
This patch adds 2 monitoring jupyter notebooks and 1 notebook combining
both logs and metrics causation analysis.
Causation analysis: Finds anomalies in logs and fetchs and analyses
metrics in a delta time range of that timestamp.
Analysis-Monitoring-K8S: Fetches metrics from prometheus to analyse them
Analysis-Monitoring-Local: Data folder containing csv files of metrics is given,
analysis is performed on that data.
Signed-off-by: Aditya Srivastava <adityasrivastava301199@gmail.com>
Change-Id: I8833f5155b3184f697fac5270c69e0df02d2986b
|
|
|
|
This patch adds ansible playbooks for cluster deployment.
Change-Id: Icf58b0ad0dec7098bff14c3f3c6666c35c242081
Signed-off-by: Emanuele Urselli <urselliemanuele@icloud.com>
Signed-off-by: Parth Yadav<parthyadav3105@gmail.com>
|
|
This patch adds binary-search loss verification to t-rex.
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
Change-Id: Ie9b66f3149d4363840455ec1530885b23c3fc183
|
|
This patch adds a dockerfile to run VSPERF in a container.
This version can run VSPERF in Trafficgen mode ONLY.
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
Change-Id: Ie5300b52c7358854c3facf65185ec03f2a5e0dc7
|
|
This patch collects Ixia live results and copy the results file from
generator machine to local server
1. Traffic Item Statistics are collected during traffic running
2. Results file is copied from traffic generator machine to local server
3. Fixed pylint errors and made b2b test running working
4. Replacing sleeping times with traffic state verifications
JIRA: VSPERF-609
Signed-off-by: Ancuta Enache <ancuta.enache@keysight.com>
Change-Id: I351c3a5435a71acfd1b6bc85bc6c0731d2529cd8
|
|
|
|
A. Collector: Add cAdvisor Collector
This patch adds supports for Container Metrics
collection using cAdvisor. The collector:
1. Pushes metrics to InfluxDB storage
2. Stores metrics locally in Result Dir
3. Implements print_results() for metric summary
4. Is configurable from 05_collector.conf
B. Docker: Grafana Dashboard
This patch also adds JSON file for Grafana Dashboard for
Container Metrics
Signed-off-by: Parth Yadav <parth.yadav@ramanujan.du.ac.in>
Change-Id: I7c39d4e1a7a46d3a499a241e618bd0da7eed53a8
|
|
Separate volume for Jupyter Data is created.
Results will be stored in that volume.
Notebook is updated to use the volume.
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
Change-Id: I2a359d64cf3d4281686d4d3c3d6f3ee6587c1e13
|
|
This patch add containerization of VSPERF support.
The patch facilitates creation of 4 containers:
1. Interactive Deployment
2. Auto Deployment
3. Interactive TestControl
4. Auto TestControl.
The patch also includes a minimal client to work with interactive
containers.
The docs folder provides detailed documentation.
Fixed pylint errors in libs folder.
Removed proto built python files, and added the build process in
prepare.sh.
Stability improvements for Auto versions of deployment and testcontrol.
Enhance client with 'mode' feature, where client can run either to do
only deploy/only test or both.
Add sample configuration file for client
Fixed few typos - as suggested by AL.
JIRA: VSPERF-594
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
Change-Id: Id40b02960f71a7f9183d9a53955e2483117fb9e2
|
|
|
|
This patch adds docker-compose.yml and related config files
for creating a results container. The container hosts following
services:
1. Barometer Grafana.
2. Barometer Influxdb.
2. ELK Stack.
3. OPNFV TestAPI.
4. Jupyter Notebook with VSPERF testresults-analysis.
Removed dashboard files, which can be obtained from barometer-grafana.
Added comment in tools.rst under pre-deployment
Retained only vpserf-cases and vsperf in cases.json and projects.json
Changed barometer-influxdb to influxdb:latest.
Added README.md file.
Added environment variable setting to disable token for jupyter
JIRA: VSPERF-602
Change-Id: I37a1391a1f34f834ce0d46def75a9f3454e09772
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
|
|
This patch adds a tool create config file.
When run, the wizard asks user a set of questions.
A config file, named vsperf.conf, will be created.
Fix some pylint Issues.
JIRA: VSPERF-603
Change-Id: I1b800d8384cb3c0883b7f3859a9df77bb874b7b8
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
This patch provides a fix to parameter ordering for imix and live
results. 2 line changes.
JIRA: VSPERF-598
Change-Id: I329b67114d780e0bcc73b128aeafe6e0f25b0621
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
This patch adds support to run following commands as 'collector'
1. collectd
2. PROX IRQ Latency
3. CROND (currently to collect ovs-port's CPU-mapping information)
4. Filebeat (send logs to elasticsearch)
Fixed pylint issues
Added description to control prox-runrapid. The use of 'stop' file.
Added a print in print_results.
JIRA: VSPERF-599
Change-Id: I583325ef14ddb0b292e8abddef1518d24b5e52d8
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
|
|
This patch adds live-results reporting from STC traffic generator.
STC reports per-port stream results every second. The results are
written to two different files in results folder.
Added configuration filename for stc-liveresults
JIRA: VSPERF-598
Change-Id: I37de6b5f544355e9e0dd42936328551b59afe065
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
This patch add live-results from T-Rex TGen.
T-Rex, when live-results enabled, will dump per-second flow-stats
into the results-folder.
Fixed few pylint issues.
JIRA: VSPERF-524
Change-Id: I0caee49c5b34582bbcefbe217028e9e50d40da71
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
|
|
This patch adds Imix-Genome support to STC.
1. Imix, of type genome, is included in traffic configuration.
2. The genome is converted to appropriated weights and pkt-sizes.
3. Throughput test is run with imix-configuration.
4. genome configuration is added to results.
5. Added Reporting of Average-Frame-Size - if IMIX is configured.
6. Updated genome comments
7. Clarified the reference to RFC 6985.
JIRA: VSPERF-521
Change-Id: I813efb66338ee1d1320a01ce5e0834180461120c
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
This patch affinitizes stressor-vm threads.
The code is reused from vnfs/qemu/qemu.py
Change-Id: I4a525b133bf0799a06d0961379961cfcc89c357a
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
The patch adds support to provide Latency histogram from Spirent traffic
generator.
1. 03_traffic.conf: Enable histogram, and set type (default)
2. testcenter.py: If histogram enabled, call the script with right flag.
3. testcenter-rfc2544-rest.py: configure and write histogram to a
separte file in the default results folder.
4. Fix PyLint Errors
5. Adding a patch to test the 'build-error-fix'. Increased the
MAX_MEMSEG of in DPDK-config to 1024
6. Adding MAX_MEMSEG configuration at common_base didn't work.
7. Included packet sizes in the output.
8. Included description under spirent TGen
9. Removed MAX_MEMSEG configuration.
Change-Id: I7787c1768d7ac650f0ce581f17ec78df7a964e31
JIRA: VSPERF-522
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
In this patch, following options are added for collectd-metrics storing
1. Collect all the metrics written by collectd into csv file - a tar.gz
file is created. The timestamp is retained in the tar.gz file.
2. Selected metrics are written into a log file.
3. Fix Pylint errors
4. Terminate collectd by PID.
JIRA: VSPERF-588
Change-Id: Ib4d89d3dd6c622066fa0296b4415515fdca12252
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
|
Adds calculations to deal with values greater than 64k by doing
a square root of the multistream value and using two mods
to create the closet possible value that will work within the
current implementation of multistream in VSPerf.
JIRA: VSPERF-575
Change-Id: I9dab4bbac094a394a11ed74fe2cd88fbe7079fc7
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
|
|
A support for proper reporting of "Burst" traffic type was added.
Several bugs were fixed:
* RFC2544 Throughput - end of search condition was moved to avoid
situation, that another iteration is executed but its results
dropped
* RFC2544 Throughput - pause after each iteration was added to ensure
that all frames are cleared from buffers; It improves stability
of results. Also "received" values are no longer higher then
"sent" values.
* VSPERF will report also the number of sent and received frames
* VSPERF will correctly process send and received values - they
were switched on several places
JIRA: VSPERF-149
JIRA: VSPERF-562
Change-Id: I8a5caa6385a1ef86aa4bf4511d2753100ed0ab14
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Richard Elias <richardx.elias@intel.com>
|
|
|
|
|
|
Since sysstat commit 52977c479d3d ("Introduce new SP_VALUE_100() macro
and use it in pidstat"), pidstat can return a wrong CPU usage for all
monitored PIDs.
For example, if a process like ovs-vswitchd uses 2 threads, the CPU
usage of each thread (TID) is equal to 100%, so the CPU usage of the
main process (PID) must be equal at least to 200%. However, with this
sysstat commit, the CPU usage is restricted to 100%. It is not possible
to change this behavior.
Now, pidstat is started in order to monitor all threads created by a
process. As the output header has changed, readapt the existing code.
In order to fix this issue, only the CPU usage is accumulated with all
threads. For all other measures, main process should report correct
values.
JIRA: VSPERF-569
Change-Id: I98aa94f545d04f4de1b994c420fb5756c6f2a387
Signed-off-by: Julien Meunier <julien.meunier@6wind.com>
|
|
Remove unnecessary scapy import, which is causing pylint error
with recent pylint version.
JIRA: VSPERF-566
Change-Id: I082de0e93242486248beaed6822a8d0f30fff7e5
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
|
|
|
|
T-Rex requires a modified version of SCAPY library for python3
to function properly. It doesn't work with vanilla version of
scapy-python3 module, which is installed within vsperf environment by
pip for Xena. Currently vanilla scapy is imported by Xena and
enforced to T-Rex too, which causes following issues:
* missing implementation of Dot1AD causes failures
* broken multistream feature in T-Rex
VSPERF loads all Traffic Generator classes and thus all
imports performed at module level are performed. The solution
would be to import SCAPY module by Xena only in case, that Xena
traffic generator is really used. Please see JIRA for additional
information.
JIRA: VSPERF-566
Change-Id: I8018bc0126e752cc9f966252d17dadb6a5554b37
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
|
|
Updated master Python scripts to conform to the newer pylint
1.8.2 standard.
JIRA: VSPERF-563
Change-Id: I19305a008a2e22c2f4841aa83fed85fbdc2d549c
Signed-off-by: Richard Elias <richardx.elias@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
|
|
T-Rex implementation in vsperf was improved to support:
* SCAPY frame definition, so additional network protocols
can be generated by T-Rex and sent towards DUT
* VLAN configuration defined by TRAFFIC['vlan']
* enable or disable L2, L3, L4 and VLAN protocols
as configured by TRAFFIC dictionary
VSPERF documentation was updated with examples of SCAPY
frame definition usage.
JIRA: VSPERF-565
Change-Id: Iff9baba47a1e83d321f6ba3c1c482965b9882241
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Trevor Cooper <trevor.cooper@intel.com>
Reviewed-by: Richard Elias <richardx.elias@intel.com>
|
|
Support for burst traffic type was added into T-Rex. This
traffic type is useful for tests, where a limited number
of frames should be sent through DUT.
JIRA: VSPERF-562
Change-Id: I03b7150e66a0210cce91b20c751b8624c16f951b
Signed-off-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
Reviewed-by: Richard Elias <richardx.elias@intel.com>
|
|
The patch expands the vsperf --test-params argument with list
functionality, which enables running multiple tests with different
parameters. If more tests are run then parameters provided, the
last parameters will be reused. Example:
./vsperf --test-params "['','TRAFFICGEN_PKTSIZE = (64,)']"
phy2phy_cont phy2phy_cont
CUMULATIVE_PARAMS if true, instead of using the default settings,
each test will take the parameters of the previous test before
applying it's own.
The patch also adds the vsperf --matrix argument which analyzes and
compares the results of all the tests run, printing it as a table,
as well as saving it into a file in the results directory.
MATRIX_METRIC metric used by Performance Matrix to compare tests.
JIRA: VSPERF-554
Change-Id: I71530ddf110890612236a7e57039f249609c835b
Signed-off-by: Richard Elias <richardx.elias@intel.com>
Reviewed-by: Martin Klozik <martinx.klozik@intel.com>
Reviewed-by: Al Morton <acmorton@att.com>
Reviewed-by: Christian Trautman <ctrautma@redhat.com>
Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
|
|
|
|
Adds configuration options and logic to detect maximum supported
speed of T-Rex server side cards.
1. Adds logic to pull maximum supported speed from port info
2. Adds forcable option to have user specify maximum speed
3. If logic cannot detect speed from port_info because it is
not available or the forcable option is not set it will
assume 10G speeds.
4. Tested on Intel XXV25G and Mellanox ConnectX-5 cards
5. Added packet structure logging to show packet info for
better debugging capabilities
6. Adds core mask to take advantage of multiple cores if
server is started with more than default number of cores
7. Adds packets lost logging to RFC2544 Throughput testing
JIRA: VSPERF-559
Change-Id: I7fcfda7ccc408c30830950ee3668e01b8624c20a
Signed-off-by: Christian Trautman <ctrautma@redhat.com>
|
|
|
|
The changes include:
1. Configuration in 05_collector.conf. User can specify the
metrics that are of their interest and also fine tune the same.
2. collectd_bucky.py: This is derived from python_bucky library.
Formal approval for reuse is obtained.
3. collectd.py: This is the main file that receives the samples,
stores the required ones, plots the values and saves the values in
a data-file in results folder.
4. Fixed some pylint errors
5. Added required libraries to requirements.txt. hashlib is supported by
default. However, matplotlib and numpy required
6. added __init__.py to overcome import errors.
7. Crypto needs pycrypto module
8. Builtin filter function usage return bad-builtin pylint warning.
Rewrite to remove filter function.
9. Added support for reporting the ovs processes statistics.
10. Import order corrected according to pylint
11. Fixed copyright issues, removed python-3 checking, enhance to
include VPP and qemu processes.
12. Removed pylint disables.
13. Added documentaion to describe sample information
14. Added @staticmethod to remove disable-no-self-use.
15. Fixed year in Copyright.
16. Updated print_results function to print the process values.
17. Removed example values form INTELRDT_XKEYS in conf file
18. Removed use of len(SEQUENCE) in loop and renamed data to pdata to
avoid name clashes
19. Fixed issue with requirements.txt
Note: A separate documentation covering all external tools will be
provided.
JIRA: VSPERF-505
Change-Id: Ieedcbe7b92e8933263d34df12b1e24be8447b524
Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
|
Sridhar Rao
Shubham Mishra
Aditya Srivastava
adi0509
EmanueleUrselli
Ancuta Enache
Parth Yadav
Christian Trautman
Martin Klozik
Julien Meunier
Richard Elias