summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-12-04Merge "Tools: Deployment and TestControl Containers"opnfv-9.0.0stable/iruyaSridhar Rao36-1/+4086
2019-12-01Tools: Deployment and TestControl ContainersSridhar K. N. Rao36-1/+4086
This patch add containerization of VSPERF support. The patch facilitates creation of 4 containers: 1. Interactive Deployment 2. Auto Deployment 3. Interactive TestControl 4. Auto TestControl. The patch also includes a minimal client to work with interactive containers. The docs folder provides detailed documentation. Fixed pylint errors in libs folder. Removed proto built python files, and added the build process in prepare.sh. Stability improvements for Auto versions of deployment and testcontrol. Enhance client with 'mode' feature, where client can run either to do only deploy/only test or both. Add sample configuration file for client Fixed few typos - as suggested by AL. JIRA: VSPERF-594 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Id40b02960f71a7f9183d9a53955e2483117fb9e2
2019-11-13Upgrade: Upgrade Upstream Software packages in VSPERF.Sridhar K. N. Rao4-13/+17
This patch upgrades following upstream software packages: 1. DPDK: from 17.08 to 18.11-rc2 2. OVS: from 2.8.1 to 2.12.0 3. VPP: from 17.07 to 19.08.1 4. QEMU: from 2.9.1 to 3.1.1 Changed the vpp_plugins path in 02_vswitch.conf: from lib64/vpp_plugins to lib/vpp_plugins JIRA: VSPERF-606 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ib3018a7254e61337141773787cb5d3ea1cff18f4
2019-10-29integration: fix null_pmd testsLukasz Pawlik1-2/+2
In OVS >= 2.12 output from ovs-vsctl got changed. Whitespace matching is no longer required when searching for devargs. This patch fix regular expression. Change-Id: Ic2e6965552a7200647410cd73cd2c60817d31a81 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration: remove ovsdpdk_hotplug_detachLukasz Pawlik1-53/+0
Support of netdev-dpdk/detach has been removed from OVS, so testcase will fail with OVS 2.11 and DPDK 18.11 versions. This patch removes this test. Change-Id: I7c3005ff2bef2dcfd1f4bc849490c5e61cba8485 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration fix ovsdpdk_mq_pvp_rxqs_linux_bridgeLukasz Pawlik1-3/+4
Fix flow setup by adding action that do something with packet. Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com> Change-Id: Ia219d46238be9373ed02349fbd15d89f22670c4e
2019-10-29integration: fix ovsdpdk_mq_pvp_rxqs_testpmdLukasz Pawlik4-3/+24
Parameters passed to testpmd are changed in DPDK 18.11. Setting stat-qmap does not work from command line it can be set only from testpmd application before port forwarding is started. Decrease frame rate on traffic generator to receive traffic on two queues. Change-Id: I82b8e478226d59b091154d325afed07327908250 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29Fix policer related integration testsLukasz Pawlik1-11/+2
From DPDK >=18.02.0 when setting policer information about CIR is no longer available in the logs. Returned error when creating policer with invalid parameters was also changed. This patch removes checking information about CIR setting in OVS log and fix error string checking. Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com> Change-Id: I1753bf8ebc66e12ce3bf9dc38f07b61f6500095f
2019-10-29integration: fix MTU checking for OVS>=2.9Lukasz Pawlik1-17/+22
In DPKD>=17.11.0 and OVS>=2.9 behaviour of MTU has changed. Previously ovsdpdk_jumbo_p2p_upper_bound checked that two different MTU could be set for a port in OVS DPDK. However due to changes in OVS a larger MTU value is now required to create different mempools. Fix this by increasing the MTU value requested so that a new mempool will be created. Also output for calls to ovs-appctl has changed. This commit fixes the expected regex to account for new spaces and reformat of the queue listings in open vSwtich. List of fixed tests: ovsdpdk_mq_p2p_rxqs ovsdpdk_mq_p2p_rxqs_same_core_affinity ovsdpdk_mq_p2p_rxqs_multi_core_affinity ovsdpdk_mq_pvp_rxqs ovsdpdk_mq_pvp_rxqs_testpmd ovsdpdk_jumbo_mtu_upper_bound_phy_port ovsdpdk_jumbo_mtu_upper_bound_vport ovsdpdk_jumbo_p2p_upper_bound Co-authored-by: Ian Stokes <ian.stokes@intel.com> Change-Id: I22e208004e5b732b4b21904809606055fbb9c0c4 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration: fix ovs/dpdk with DPDK >= 18.02Lukasz Pawlik3-8/+12
In DPDK >= 18.02 disable-hw-vlan testpmd command line was changed. Parameter disable-hw-vlan is default and user has to explicitly enable it. This patch fix testpmd command line parameters. Also in DPDK >= 18.05 igb_uio kernel module was moved to different directory. Compilation of kernel module only is broken. This patch fix this. Now whole DPDK project is build. Change-Id: I6c8c44979192201c42e6a71b55c37a50fa64fd96 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration: Fix OVSDPDK testsLukasz Pawlik4-18/+25
Commit c5a075eafc322d9ae62322e90ab4e232df176743 break integration tests because logs location was changed. This patch fix this by ensuring that RESULTS_PATH is set before integration tests conf file is processed and set correct path in integration conf. Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com> Change-Id: I7ca104cfb31c7bc0f6052b58a370a1d65157efe1
2019-09-17Merge "Python: Upgrade Python version from 3.4 to 3.6"Sridhar Rao9-26/+26
2019-08-30Python: Upgrade Python version from 3.4 to 3.6Sridhar K. N. Rao9-26/+26
This patch upgrade python version from 3.4 to 3.6 for the following systems. Centos rhel - 7.2, 7.3 and 7.5 ubuntu For fedora and opensuse - no specific option available. SLES is already using 3.6 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ib1a1cb04441c8fe53339f7f9a66e0266d6ceefe0
2019-08-28VSPERF: Enable results publishing through config-file.Sridhar K. N. Rao2-2/+6
This patch enables the publising of results to TestAPI via config-file. Initial OPNFVPOD to empty string in 00_common.conf Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: I5ca03d094b075c6b5ab5d656421aff506ce4b273
2019-08-07Merge "Docker: VSPERF Results Container."Sridhar Rao12-0/+1492
2019-07-30Docker: VSPERF Results Container.Sridhar K. N. Rao12-0/+1492
This patch adds docker-compose.yml and related config files for creating a results container. The container hosts following services: 1. Barometer Grafana. 2. Barometer Influxdb. 2. ELK Stack. 3. OPNFV TestAPI. 4. Jupyter Notebook with VSPERF testresults-analysis. Removed dashboard files, which can be obtained from barometer-grafana. Added comment in tools.rst under pre-deployment Retained only vpserf-cases and vsperf in cases.json and projects.json Changed barometer-influxdb to influxdb:latest. Added README.md file. Added environment variable setting to disable token for jupyter JIRA: VSPERF-602 Change-Id: I37a1391a1f34f834ce0d46def75a9f3454e09772 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-07-29Merge "CONFIG: VSPERF Config-file Generation Wizard."Sridhar Rao4-0/+974
2019-06-12CONFIG: VSPERF Config-file Generation Wizard.Sridhar K. N. Rao4-0/+974
This patch adds a tool create config file. When run, the wizard asks user a set of questions. A config file, named vsperf.conf, will be created. Fix some pylint Issues. JIRA: VSPERF-603 Change-Id: I1b800d8384cb3c0883b7f3859a9df77bb874b7b8 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-05-27pkt_gen: Bug-fix in Spirent testcenter parameter ordering.Sridhar K. N. Rao1-2/+4
This patch provides a fix to parameter ordering for imix and live results. 2 line changes. JIRA: VSPERF-598 Change-Id: I329b67114d780e0bcc73b128aeafe6e0f25b0621 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-29Merge "Collector: Add Multi-command collector."opnfv-8.0.0stable/hunterSridhar Rao4-0/+176
2019-03-29Collector: Add Multi-command collector.Sridhar K. N. Rao4-0/+176
This patch adds support to run following commands as 'collector' 1. collectd 2. PROX IRQ Latency 3. CROND (currently to collect ovs-port's CPU-mapping information) 4. Filebeat (send logs to elasticsearch) Fixed pylint issues Added description to control prox-runrapid. The use of 'stop' file. Added a print in print_results. JIRA: VSPERF-599 Change-Id: I583325ef14ddb0b292e8abddef1518d24b5e52d8 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-20Logs: Move test-specific logs to test-specific results folderSridhar K. N. Rao4-15/+18
This patch moves the following logs to results-folder. 1. qemu.log 2. vswitchd.log 3. host.log 4. vsperf-overall 5. vpp 6. trafficgen Move the logging of creating results directory after configure-logging JIRA: VSPERF-600 Change-Id: I5b0a827ea2dfaf869d2495b5f4a7b5dd2bd054ac Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-19Merge "pkt_gen: STC- Live Results Support"Sridhar Rao3-4/+138
2019-02-20pkt_gen: STC- Live Results SupportSridhar K. N. Rao3-4/+138
This patch adds live-results reporting from STC traffic generator. STC reports per-port stream results every second. The results are written to two different files in results folder. Added configuration filename for stc-liveresults JIRA: VSPERF-598 Change-Id: I37de6b5f544355e9e0dd42936328551b59afe065 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-02-20pkt_gen: T-Rex Live ResultsSridhar K. N. Rao2-1/+70
This patch add live-results from T-Rex TGen. T-Rex, when live-results enabled, will dump per-second flow-stats into the results-folder. Fixed few pylint issues. JIRA: VSPERF-524 Change-Id: I0caee49c5b34582bbcefbe217028e9e50d40da71 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-02-16Merge "VSPERF: Add Timestamps to Logfiles"Sridhar Rao5-21/+53
2019-02-15Merge "pkt_gen: STC - Imix Genome Support"Sridhar Rao6-6/+103
2019-01-27Merge "loadgen: Affinitize Stressor-VM Threads."Sridhar Rao1-1/+40
2019-01-21VSPERF: Add Timestamps to LogfilesSridhar K. N. Rao5-21/+53
This patch adds timestamps to all the logfiles created by VSPERF. The logfiles covered are: 1. LOG_FILE_VSWITCHD 2. LOG_FILE_OVS 3. LOG_FILE_VPP 4. LOG_FILE_QEMU 5. LOG_FILE_GUEST_CMDS 6. LOG_FILE_TRAFFIC_GEN 7. LOG_FILE_HOST_CMDS Added fix for pylint errors This patch also ensures the extension is only .log always. JIRA: VSPERF-586 Change-Id: I319c075e7d3af06539266f4c759a41f877d4cff2 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-01-21pkt_gen: STC - Imix Genome SupportSridhar K. N. Rao6-6/+103
This patch adds Imix-Genome support to STC. 1. Imix, of type genome, is included in traffic configuration. 2. The genome is converted to appropriated weights and pkt-sizes. 3. Throughput test is run with imix-configuration. 4. genome configuration is added to results. 5. Added Reporting of Average-Frame-Size - if IMIX is configured. 6. Updated genome comments 7. Clarified the reference to RFC 6985. JIRA: VSPERF-521 Change-Id: I813efb66338ee1d1320a01ce5e0834180461120c Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-12-05VSPERF: Timestamp Variable.Sridhar K. N. Rao1-1/+1
LOG_TIMESTAMP name was misspelled. This patch fixes it. This variable is only used by collectd-collector Change-Id: I172dd96b717168cf3da76be6e631cc1d01af8663 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-12-05loadgen: Affinitize Stressor-VM Threads.Sridhar K. N. Rao1-1/+40
This patch affinitizes stressor-vm threads. The code is reused from vnfs/qemu/qemu.py Change-Id: I4a525b133bf0799a06d0961379961cfcc89c357a Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-11-12Release: Release notes for Gambia.Sridhar K. N. Rao1-0/+39
Release notes added for Gambia. Fixed some typos Change-Id: I05c7f70341bdc8e0beda67185d0df968104bf547 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-11-11Merge "Results: Default latency-histrogram with Spirent TestCenter"Sridhar Rao5-7/+137
2018-11-09Local Documentation BuildsAric Gardner6-2/+50
When this is merged docs will be avaliable at https://opnfv-vswitchperf.readthedocs.io/en/latest/ This adds configuration for performing local documentation builds with the following simple command: tox -e docs Also added index.rst Change-Id: Ie5deaec6c94fc39d3a086df1a2ddec7c2829efd5 Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
2018-11-03Results: Default latency-histrogram with Spirent TestCenterSridhar K. N. Rao5-7/+137
The patch adds support to provide Latency histogram from Spirent traffic generator. 1. 03_traffic.conf: Enable histogram, and set type (default) 2. testcenter.py: If histogram enabled, call the script with right flag. 3. testcenter-rfc2544-rest.py: configure and write histogram to a separte file in the default results folder. 4. Fix PyLint Errors 5. Adding a patch to test the 'build-error-fix'. Increased the MAX_MEMSEG of in DPDK-config to 1024 6. Adding MAX_MEMSEG configuration at common_base didn't work. 7. Included packet sizes in the output. 8. Included description under spirent TGen 9. Removed MAX_MEMSEG configuration. Change-Id: I7787c1768d7ac650f0ce581f17ec78df7a964e31 JIRA: VSPERF-522 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-10-26CI: Reduce Daily-build tests.Sridhar K. N. Rao1-8/+10
Only throughput tests for all packet sizes for ovs-with-dpdk and vpp. JIRA: VSPERF-593 Change-Id: I03c39421ee572bf75b10f237d283c55e8bef7f76 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-10-09qemu_regex_fix: Regex change for future qemu versions info cpuChristian Trautman1-1/+1
When running info cpus command on qemu newer versions of 2.12 the output has changed. This is causing the regex lookup for the thread match to affinitize the PID to the correct CPU. JIRA: VSPERF-592 Change-Id: Ie3a4490f3f8da1e4df00c7095cf1f05fdd939e07 Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2018-09-28set version of matplotlib to 2.2.2 in requirments.txt.Bob Fubel1-1/+1
JIRA issues assoicated with the https://jira.opnfv.org/browse/VSPERF-591?filter=-1# VSPERF-591 Extended description: Latest version of matplotlib 3.0.0 dosn't support python 3.4. Creating error during build. Change-Id: I05f14fb486a5b0090bf27c66de0d6e4c85652330 Signed-off-by: Bob Fubel <bfubel@redhat.com>
2018-09-19Merge "RHEL_75_INSTALL: Add install build script for RHEL 7.5 version"Sridhar Rao3-0/+145
2018-09-19Merge "docs: Fix typo in SRIOV docs"Martin Klozik1-4/+4
2018-09-19Merge "Auto Generated INFO.yaml file"Martin Klozik1-0/+67
2018-09-19Auto Generated INFO.yaml fileagardner1-0/+67
INFO.yaml meant to be machine readable. This file was auto generated from an ldap lookup and your projects INFO file. Meeting times are not currently filled out. please ammend this patchset to complete Going forward comitter promotions should be done against this file. PTLs: Must be merged for you to gain delete access on testresults.opnfv.org If project_lead: is missing (my script could not parse) please amend with same from commiters section eg: project_lead: &opnfv_$project_ptl name: 'Lead Name' email: 'lead email' id: 'lead lfid' company: 'lead company' Change-Id: I8c482b04045b0909d94ff69ac9951c61c4b26344 Signed-off-by: agardner <agardner@linuxfoundation.org>
2018-09-18docs: Fix typo in SRIOV docsMartin Klozik1-4/+4
Details about SRIOV kernel settings were accidentally interrupted by VPP related note. JIRA: VSPERF-198 Change-Id: Id9d5ed39d62fbe16cf2e4f4aa730f5d15845b727 Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com>
2018-09-04RHEL_75_INSTALL: Add install build script for RHEL 7.5 versionChristian Trautman3-0/+145
Adds build scripts that prevent compiling of incompatible packages due to kernel. Those packages can be installed from channel subscripts or binaries can be built from upstream sources. JIRA: VSPERF-589 Change-Id: I92821c64e43fb2e80b9c2978c0870a2c1d84409f Signed-off-by: Christian Trautman <ctrautma@redhat.com>
2018-08-22Merge "Logging: Enhance logging with separate files and timestamps"Sridhar Rao2-2/+27
2018-07-27Collectd: Additional metrics storing optionsSridhar K. N. Rao1-3/+32
In this patch, following options are added for collectd-metrics storing 1. Collect all the metrics written by collectd into csv file - a tar.gz file is created. The timestamp is retained in the tar.gz file. 2. Selected metrics are written into a log file. 3. Fix Pylint errors 4. Terminate collectd by PID. JIRA: VSPERF-588 Change-Id: Ib4d89d3dd6c622066fa0296b4415515fdca12252 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-07-27Logging: Enhance logging with separate files and timestampsSridhar K. N. Rao2-2/+27
This patch adds following: 1. overall.log file is change to vsperf-overall-timestamp.log files 2. The overall.log files will include timestamps too. 3. Separate log files for infrastructure metrics. 4. All timestamps of the logfiles for a given test will be same. 5. Store the timestamp in 'LOG_TIMESTAMP' 6. Create metrics-log only if 'COLLECTOR' is set to 'Collectd' JIRA: VSPERF-586 Change-Id: I35d373a66b1074f6ee1a440ffc82bc3db03f36e7 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2018-06-28ci: Support for negative pylint ratingMartin Klozik1-2/+2
Script ./check was updated to correctly parse and process negative pylint ratings. Also awk expression was fixed to get rid of error messages during parsing of pylint output. JIRA: VSPERF-587 Change-Id: I72c5bd85f38274f308fce881517e5b6fa4a123dc Signed-off-by: Martin Klozik <martin.klozik@tieto.com> Reviewed-by: Al Morton <acmorton@att.com> Reviewed-by: Christian Trautman <ctrautma@redhat.com> Reviewed-by: Sridhar Rao <sridhar.rao@spirent.com> Reviewed-by: Richard Elias <richard.elias@tieto.com>
2018-06-18Merge "Xena_Flow_Fix: Fixes multistream of greater than 64k values"Christian Trautman4-71/+211