summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-12-01Tools: Deployment and TestControl ContainersSridhar K. N. Rao36-1/+4086
This patch add containerization of VSPERF support. The patch facilitates creation of 4 containers: 1. Interactive Deployment 2. Auto Deployment 3. Interactive TestControl 4. Auto TestControl. The patch also includes a minimal client to work with interactive containers. The docs folder provides detailed documentation. Fixed pylint errors in libs folder. Removed proto built python files, and added the build process in prepare.sh. Stability improvements for Auto versions of deployment and testcontrol. Enhance client with 'mode' feature, where client can run either to do only deploy/only test or both. Add sample configuration file for client Fixed few typos - as suggested by AL. JIRA: VSPERF-594 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Id40b02960f71a7f9183d9a53955e2483117fb9e2
2019-09-17Merge "Python: Upgrade Python version from 3.4 to 3.6"Sridhar Rao9-26/+26
2019-08-30Python: Upgrade Python version from 3.4 to 3.6Sridhar K. N. Rao9-26/+26
This patch upgrade python version from 3.4 to 3.6 for the following systems. Centos rhel - 7.2, 7.3 and 7.5 ubuntu For fedora and opensuse - no specific option available. SLES is already using 3.6 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ib1a1cb04441c8fe53339f7f9a66e0266d6ceefe0
2019-08-28VSPERF: Enable results publishing through config-file.Sridhar K. N. Rao2-2/+6
This patch enables the publising of results to TestAPI via config-file. Initial OPNFVPOD to empty string in 00_common.conf Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: I5ca03d094b075c6b5ab5d656421aff506ce4b273
2019-08-07Merge "Docker: VSPERF Results Container."Sridhar Rao12-0/+1492
2019-07-30Docker: VSPERF Results Container.Sridhar K. N. Rao12-0/+1492
This patch adds docker-compose.yml and related config files for creating a results container. The container hosts following services: 1. Barometer Grafana. 2. Barometer Influxdb. 2. ELK Stack. 3. OPNFV TestAPI. 4. Jupyter Notebook with VSPERF testresults-analysis. Removed dashboard files, which can be obtained from barometer-grafana. Added comment in tools.rst under pre-deployment Retained only vpserf-cases and vsperf in cases.json and projects.json Changed barometer-influxdb to influxdb:latest. Added README.md file. Added environment variable setting to disable token for jupyter JIRA: VSPERF-602 Change-Id: I37a1391a1f34f834ce0d46def75a9f3454e09772 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-07-29Merge "CONFIG: VSPERF Config-file Generation Wizard."Sridhar Rao4-0/+974
2019-06-12CONFIG: VSPERF Config-file Generation Wizard.Sridhar K. N. Rao4-0/+974
This patch adds a tool create config file. When run, the wizard asks user a set of questions. A config file, named vsperf.conf, will be created. Fix some pylint Issues. JIRA: VSPERF-603 Change-Id: I1b800d8384cb3c0883b7f3859a9df77bb874b7b8 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-05-27pkt_gen: Bug-fix in Spirent testcenter parameter ordering.Sridhar K. N. Rao1-2/+4
This patch provides a fix to parameter ordering for imix and live results. 2 line changes. JIRA: VSPERF-598 Change-Id: I329b67114d780e0bcc73b128aeafe6e0f25b0621 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-29Merge "Collector: Add Multi-command collector."opnfv-8.0.0stable/hunterSridhar Rao4-0/+176
2019-03-29Collector: Add Multi-command collector.Sridhar K. N. Rao4-0/+176
This patch adds support to run following commands as 'collector' 1. collectd 2. PROX IRQ Latency 3. CROND (currently to collect ovs-port's CPU-mapping information) 4. Filebeat (send logs to elasticsearch) Fixed pylint issues Added description to control prox-runrapid. The use of 'stop' file. Added a print in print_results. JIRA: VSPERF-599 Change-Id: I583325ef14ddb0b292e8abddef1518d24b5e52d8 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-20Logs: Move test-specific logs to test-specific results folderSridhar K. N. Rao4-15/+18
This patch moves the following logs to results-folder. 1. qemu.log 2. vswitchd.log 3. host.log 4. vsperf-overall 5. vpp 6. trafficgen Move the logging of creating results directory after configure-logging JIRA: VSPERF-600 Change-Id: I5b0a827ea2dfaf869d2495b5f4a7b5dd2bd054ac Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-19Merge "pkt_gen: STC- Live Results Support"Sridhar Rao3-4/+138
2019-02-20pkt_gen: STC- Live Results SupportSridhar K. N. Rao3-4/+138
This patch adds live-results reporting from STC traffic generator. STC reports per-port stream results every second. The results are written to two different files in results folder. Added configuration filename for stc-liveresults JIRA: VSPERF-598 Change-Id: I37de6b5f544355e9e0dd42936328551b59afe065 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-02-20pkt_gen: T-Rex Live ResultsSridhar K. N. Rao2-1/+70
This patch add live-results from T-Rex TGen. T-Rex, when live-results enabled, will dump per-second flow-stats into the results-folder. Fixed few pylint issues. JIRA: VSPERF-524 Change-Id: I0caee49c5b34582bbcefbe217028e9e50d40da71 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-02-16Merge "VSPERF: Add Timestamps to Logfiles"Sridhar Rao5-21/+53
2019-02-15Merge "pkt_gen: STC - Imix Genome Support"Sridhar Rao6-6/+103
2019-01-27Merge "loadgen: Affinitize Stressor-VM Threads."Sridhar Rao1-1/+40
2019-01-21VSPERF: Add Timestamps to LogfilesSridhar K. N. Rao5-21/+53
This patch adds timestamps to all the logfiles created by VSPERF. The logfiles covered are: 1. LOG_FILE_VSWITCHD 2. LOG_FILE_OVS 3. LOG_FILE_VPP 4. LOG_FILE_QEMU 5. LOG_FILE_GUEST_CMDS 6. LOG_FILE_TRAFFIC_GEN 7. LOG_FILE_HOST_CMDS Added fix for pylint errors This patch also ensures the extension is only .log always. JIRA: VSPERF-586 Change-Id: I319c075e7d3af06539266f4c759a41f877d4cff2 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-01-21pkt_gen: STC - Imix Genome SupportSridhar K. N. Rao6-6/+103
This patch adds Imix-Genome support to STC. 1. Imix, of type genome, is included in traffic configuration. 2. The genome is converted to appropriated weights and pkt-sizes. 3. Throughput test is run with imix-configuration. 4. genome configuration is added to results. 5. Added Reporting of Average-Frame-Size - if IMIX is configured. 6. Updated genome comments 7. Clarified the reference to RFC 6985. JIRA: VSPERF-521 Change-Id: I813efb66338ee1d1320a01ce5e0834180461120c Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-12-05VSPERF: Timestamp Variable.Sridhar K. N. Rao1-1/+1
LOG_TIMESTAMP name was misspelled. This patch fixes it. This variable is only used by collectd-collector Change-Id: I172dd96b717168cf3da76be6e631cc1d01af8663 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-12-05loadgen: Affinitize Stressor-VM Threads.Sridhar K. N. Rao1-1/+40
This patch affinitizes stressor-vm threads. The code is reused from vnfs/qemu/qemu.py Change-Id: I4a525b133bf0799a06d0961379961cfcc89c357a Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-11-12Release: Release notes for Gambia.Sridhar K. N. Rao1-0/+39
Release notes added for Gambia. Fixed some typos Change-Id: I05c7f70341bdc8e0beda67185d0df968104bf547 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-11-11Merge "Results: Default latency-histrogram with Spirent TestCenter"Sridhar Rao5-7/+137
2018-11-09Local Documentation BuildsAric Gardner6-2/+50
When this is merged docs will be avaliable at https://opnfv-vswitchperf.readthedocs.io/en/latest/ This adds configuration for performing local documentation builds with the following simple command: tox -e docs Also added index.rst Change-Id: Ie5deaec6c94fc39d3a086df1a2ddec7c2829efd5 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-11-03Results: Default latency-histrogram with Spirent TestCenterSridhar K. N. Rao5-7/+137
The patch adds support to provide Latency histogram from Spirent traffic generator. 1. 03_traffic.conf: Enable histogram, and set type (default) 2. testcenter.py: If histogram enabled, call the script with right flag. 3. testcenter-rfc2544-rest.py: configure and write histogram to a separte file in the default results folder. 4. Fix PyLint Errors 5. Adding a patch to test the 'build-error-fix'. Increased the MAX_MEMSEG of in DPDK-config to 1024 6. Adding MAX_MEMSEG configuration at common_base didn't work. 7. Included packet sizes in the output. 8. Included description under spirent TGen 9. Removed MAX_MEMSEG configuration. Change-Id: I7787c1768d7ac650f0ce581f17ec78df7a964e31 JIRA: VSPERF-522 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-10-26CI: Reduce Daily-build tests.Sridhar K. N. Rao1-8/+10
Only throughput tests for all packet sizes for ovs-with-dpdk and vpp. JIRA: VSPERF-593 Change-Id: I03c39421ee572bf75b10f237d283c55e8bef7f76 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-10-09qemu_regex_fix: Regex change for future qemu versions info cpuChristian Trautman1-1/+1
When running info cpus command on qemu newer versions of 2.12 the output has changed. This is causing the regex lookup for the thread match to affinitize the PID to the correct CPU. JIRA: VSPERF-592 Change-Id: Ie3a4490f3f8da1e4df00c7095cf1f05fdd939e07 Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2018-09-28set version of matplotlib to 2.2.2 in requirments.txt.Bob Fubel1-1/+1
JIRA issues assoicated with the https://jira.opnfv.org/browse/VSPERF-591?filter=-1# VSPERF-591 Extended description: Latest version of matplotlib 3.0.0 dosn't support python 3.4. Creating error during build. Change-Id: I05f14fb486a5b0090bf27c66de0d6e4c85652330 Signed-off-by: Bob Fubel <bfubel@redhat.com>
2018-09-19Merge "RHEL_75_INSTALL: Add install build script for RHEL 7.5 version"Sridhar Rao3-0/+145
2018-09-19Merge "docs: Fix typo in SRIOV docs"Martin Klozik1-4/+4
2018-09-19Merge "Auto Generated INFO.yaml file"Martin Klozik1-0/+67
2018-09-19Auto Generated INFO.yaml fileagardner1-0/+67
INFO.yaml meant to be machine readable. This file was auto generated from an ldap lookup and your projects INFO file. Meeting times are not currently filled out. please ammend this patchset to complete Going forward comitter promotions should be done against this file. PTLs: Must be merged for you to gain delete access on testresults.opnfv.org If project_lead: is missing (my script could not parse) please amend with same from commiters section eg: project_lead: &opnfv_$project_ptl name: 'Lead Name' email: 'lead email' id: 'lead lfid' company: 'lead company' Change-Id: I8c482b04045b0909d94ff69ac9951c61c4b26344 Signed-off-by: agardner <agardner@linuxfoundation.org>
2018-09-18docs: Fix typo in SRIOV docsMartin Klozik1-4/+4
Details about SRIOV kernel settings were accidentally interrupted by VPP related note. JIRA: VSPERF-198 Change-Id: Id9d5ed39d62fbe16cf2e4f4aa730f5d15845b727 Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
2018-09-04RHEL_75_INSTALL: Add install build script for RHEL 7.5 versionChristian Trautman3-0/+145
Adds build scripts that prevent compiling of incompatible packages due to kernel. Those packages can be installed from channel subscripts or binaries can be built from upstream sources. JIRA: VSPERF-589 Change-Id: I92821c64e43fb2e80b9c2978c0870a2c1d84409f Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2018-08-22Merge "Logging: Enhance logging with separate files and timestamps"Sridhar Rao2-2/+27
2018-07-27Collectd: Additional metrics storing optionsSridhar K. N. Rao1-3/+32
In this patch, following options are added for collectd-metrics storing 1. Collect all the metrics written by collectd into csv file - a tar.gz file is created. The timestamp is retained in the tar.gz file. 2. Selected metrics are written into a log file. 3. Fix Pylint errors 4. Terminate collectd by PID. JIRA: VSPERF-588 Change-Id: Ib4d89d3dd6c622066fa0296b4415515fdca12252 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-07-27Logging: Enhance logging with separate files and timestampsSridhar K. N. Rao2-2/+27
This patch adds following: 1. overall.log file is change to vsperf-overall-timestamp.log files 2. The overall.log files will include timestamps too. 3. Separate log files for infrastructure metrics. 4. All timestamps of the logfiles for a given test will be same. 5. Store the timestamp in 'LOG_TIMESTAMP' 6. Create metrics-log only if 'COLLECTOR' is set to 'Collectd' JIRA: VSPERF-586 Change-Id: I35d373a66b1074f6ee1a440ffc82bc3db03f36e7 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-06-28ci: Support for negative pylint ratingMartin Klozik1-2/+2
Script ./check was updated to correctly parse and process negative pylint ratings. Also awk expression was fixed to get rid of error messages during parsing of pylint output. JIRA: VSPERF-587 Change-Id: I72c5bd85f38274f308fce881517e5b6fa4a123dc Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Richard Elias <richard.elias@tieto.com>
2018-06-18Merge "Xena_Flow_Fix: Fixes multistream of greater than 64k values"Christian Trautman4-71/+211
2018-06-18Merge "connections: Introduction of generic API"Martin Klozik26-695/+541
2018-06-18Xena_Flow_Fix: Fixes multistream of greater than 64k valuesChristian Trautman4-71/+211
Adds calculations to deal with values greater than 64k by doing a square root of the multistream value and using two mods to create the closet possible value that will work within the current implementation of multistream in VSPerf. JIRA: VSPERF-575 Change-Id: I9dab4bbac094a394a11ed74fe2cd88fbe7079fc7 Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2018-06-05ovs: Change default bridge namesMartin Klozik8-51/+53
Default names of OVS bridges used by vsperf were changed to avoid accidental collision with 3rd party bridges (e.g. linux bridges) already configured at DUT. Step driven testcases, which extend existing deployment scenarios, were updated to use appropriate configuration options instead of hardcoded bridge names. JIRA: VSPERF-580 Change-Id: I8c7eee6d8f6532485ec3a2cc06f26515e665fb7e Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Richard Elias <richard.elias@tieto.com>
2018-06-04vswitches/ovs: integration TCs refactoringElias Richard5-346/+47
Refactorization of the tests in for the new teardown functionality, that automatically deletes flows, ports and bridges when OVS stops. JIRA: VSPERF-578 Change-Id: Ibe18f89c59ca5474a638808ed072cccd811ee75d Signed-off-by: Richard Elias <richard.elias@tieto.com> Reviewed-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
2018-05-28connections: Introduction of generic APIMartin Klozik26-695/+541
Redesign of vSwitch and vSwitch controller classes, to use generic connection methods for configuration of vSwitch. This API is more generic and vSwitch agnostic, thus deployment scenarios like P2P, PVP, PVVP (i.e. PVVPx) can be used for all (currently) supported vSwitches. Usage of new API will simplify an introduction of new vSwitches in the future. This patchset introduces following changes: * OVS: implementation of add_, del_, dump_ connection(s) and their validation methods * VPP: bidir parameter removed - it is up to the deployment scenario implementation to take care about bidirectional connections * P2P and PXP controllers were updated to use connection methods instead of flow related methods. Thus standard TCs will support both OVS and VPP. NOTE, PVPV is not supported for VPP (yet?). * refactoring of vSwitch interfaces and inherited classes * VPP step driven TCs were replaced by standard TCs with appropriate deployment scenarios. This is for backward compatibility with TC reporting. Once reporting of VPP TC results into results DB will be modified, this TCs can be removed. * OVS routing tables support was generalized to support P2P and PXP deployments and step driven TCs. Usage of OVS routing tables is now configurable (turned off by default) for better comparison of results among various vSwitches. * Multistream pre_installed_flows feature was generalized to support P2P and PXP deployments and step driven TCs. * IxNet: TRAFFIC['l4']['dstport'] will be used as a start value for port iteration if L4 multistream feature is enabled. * OVS: default flow template is now configurable via OVS_FLOW_TEMPLATE * OVS: support of TRAFFIC['flow_type']='ip' was generalized to work with connection methods (i.e. with P2P and PXP deployments and step driven TCs) * integration TCs: modification of integration TCs and their macros to utilize new generic connection based API * CI: list of TCs for VERIFY & MERGE jobs was changed to run the same generic tests for both OVS & VPP * documentation update * small fixes and improvements JIRA: VSPERF-579 Change-Id: If4e6e6037929eab9f16c2bbcb8a0fb30e5d6f9b0 Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Richard Elias <richard.elias@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
2018-05-28Merge "vswitches/ovs: delete flows on stop"Martin Klozik1-1/+2
2018-05-24vswitches/ovs: delete flows on stopElias Richard1-1/+2
While removing bridges, also remove any flows created on them. JIRA: VSPERF-577 Change-Id: Ie0cbe65c823e690c9b3e5149ff2af0b56809fccd Signed-off-by: Richard Elias <richard.elias@tieto.com> Reviewed-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
2018-05-24vpp: Implement missing dump and del functionsMartin Klozik1-5/+7
Implementaiton of VPP methods dump_xconnect(), del_xconnect() and del_bridge(). JIRA: VSPERF-576 Change-Id: Ifb3094d11d1b135e9a33effb1bf6d502db319a30 Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Richard Elias <richard.elias@tieto.com>
2018-05-10bugfix: Fix evaluation order of parametersMartin Klozik2-5/+21
This patch ensures, that testcase definition keywords vSwitch, Trafficgen, VNF and Tunnel Type will have the highest priority to override any values specified via ``Parameters`` section, CLI arguments or configuration files. JIRA: VSPERF-574 Change-Id: Ied799187d489325a32cc4854145fdf9901e7e3e2 Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Richard Elias <richard.elias@tieto.com>
2018-05-10Merge "docs: Update step driven test documentation"Martin Klozik1-2/+19