aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2020-10-20DOCS: Cleanup for Jerma Release.opensource-tnbt21-145/+263
This patch cleans up documentation folder. 1. Broken links are fixed. 2. LMA docs reorganized. 3. Placeholder for K8S and Openstack Support. Remove tls_verify = False line JIRA: VSPERF-627 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: I5ef93919755d351b79fa0bd0416d7d6baeb134a9
2020-10-15Merge "Tools: Add monitoring analysis jupyter notebook"Sridhar Rao3-0/+2341
2020-10-14Merge changes from topic "tools-patch1"Sridhar Rao46-0/+5950
* changes: Docs: Add monitoring cluster related documentation Tools: Add K8s monitoring cluster
2020-10-14Merge "LMA: Deployment of LMA solution.(ansible)"Sridhar Rao37-0/+2802
2020-09-17Docs: Add monitoring cluster related documentationAditya Srivastava4-0/+704
This patch adds documentation related to deployment, configuration and usage of K8s monitoring cluster. Also adds the devguide explaining mapping of each yaml file with its associated task. Signed-off-by: Aditya Srivastava <adityasrivastava301199@gmail.com> Change-Id: Ib6252f7c853a643eb5cb9f562a55ee366f9c71ea
2020-09-17Tools: Add K8s monitoring clusterAditya Srivastava47-0/+5321
This patch adds k8s monitoring cluster deployment using ansible for both client and server side. Also adds scripts (ansible roles) to clean (remove) the K8S cluster completely. Signed-off-by: Aditya Srivastava <adityasrivastava301199@gmail.com> Change-Id: I1115869c0a3e72a20047b31994f3d27e5fdae6c6
2020-09-04LMA: Deployment of LMA solution.(ansible)adi050937-0/+2802
Ansible playbooks for LMA deployment Signed-off-by: Adarsh Yadav <adiyadav0509@gmail.com> Change-Id: I3ab71e139bc1668577506fb996105a834a9c3c65
2020-09-04LMA: Deployment of LMA solution.adi05097-0/+495
Docs for LMA deployment Signed-off-by: Adarsh Yadav <adiyadav0509@gmail.com> Change-Id: Ib58bec806ce80c6927b40ddd490d612195bd6d70
2020-08-24Tools: Add monitoring analysis jupyter notebookAditya Srivastava3-0/+2341
This patch adds 2 monitoring jupyter notebooks and 1 notebook combining both logs and metrics causation analysis. Causation analysis: Finds anomalies in logs and fetchs and analyses metrics in a delta time range of that timestamp. Analysis-Monitoring-K8S: Fetches metrics from prometheus to analyse them Analysis-Monitoring-Local: Data folder containing csv files of metrics is given, analysis is performed on that data. Signed-off-by: Aditya Srivastava <adityasrivastava301199@gmail.com> Change-Id: I8833f5155b3184f697fac5270c69e0df02d2986b
2020-07-22Merge "VSWITCH: Changes to support New VPP version."Sridhar Rao1-2/+10
2020-07-22Merge "TOOLS: Ansible Playbook for Deployed Kubernetes Cluster."Sridhar Rao31-0/+1621
2020-07-21TOOLS: Ansible Playbook for Deployed Kubernetes Cluster.EmanueleUrselli31-0/+1621
This patch adds ansible playbooks for cluster deployment. Change-Id: Icf58b0ad0dec7098bff14c3f3c6666c35c242081 Signed-off-by: Emanuele Urselli <urselliemanuele@icloud.com> Signed-off-by: Parth Yadav<parthyadav3105@gmail.com>
2020-07-16VSWITCH: Changes to support New VPP version.opensource-tnbt1-2/+10
With new VPP version, and changes to it command output, VSPERF needs changes to complete the setup. These changes are only in handling 'show hardware' command output. Fixed Pylint error Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ie89c4d406f6b0f16baaada2eefe9558fbc4b846f
2020-07-15PKT_GEN: Trex with Loss-Verificationopensource-tnbt2-0/+17
This patch adds binary-search loss verification to t-rex. Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ie9b66f3149d4363840455ec1530885b23c3fc183
2020-05-24Tools: Dockerfile to run VSPERF in a Container.opensource-tnbt1-0/+37
This patch adds a dockerfile to run VSPERF in a container. This version can run VSPERF in Trafficgen mode ONLY. Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ie5300b52c7358854c3facf65185ec03f2a5e0dc7
2020-05-17Systems: Add support for Debian for VSPERF-Container.opensource-tnbt3-10/+77
This patch adds support for Debian for running vsperf in container. Perform library check only if not running in container. It is ok to run build_base_machine for vsperf in container. Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Id1a4a8e49c15cdcf99f09b05fb94dd5b55c2642e
2020-04-27Build: Minimal Build for Trafficgen Mode Only Use.opensource-tnbt1-11/+26
This patch adds minimal build, for user to use vsperf in trafficgen mode (only). The normal build process is unaffected Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: I65815d9d0b8d7328df023bfc92a5beedf3235be1
2020-04-03Ixia Live ResultsAncuta Enache2-51/+156
This patch collects Ixia live results and copy the results file from generator machine to local server 1. Traffic Item Statistics are collected during traffic running 2. Results file is copied from traffic generator machine to local server 3. Fixed pylint errors and made b2b test running working 4. Replacing sleeping times with traffic state verifications JIRA: VSPERF-609 Signed-off-by: Ancuta Enache <ancuta.enache@keysight.com> Change-Id: I351c3a5435a71acfd1b6bc85bc6c0731d2529cd8
2020-02-26Merge "Support: Container Metrics collection and Visualization"Sridhar Rao4-0/+1540
2020-02-19Support: Container Metrics collection and VisualizationParth Yadav4-0/+1540
A. Collector: Add cAdvisor Collector This patch adds supports for Container Metrics collection using cAdvisor. The collector: 1. Pushes metrics to InfluxDB storage 2. Stores metrics locally in Result Dir 3. Implements print_results() for metric summary 4. Is configurable from 05_collector.conf B. Docker: Grafana Dashboard This patch also adds JSON file for Grafana Dashboard for Container Metrics Signed-off-by: Parth Yadav <parth.yadav@ramanujan.du.ac.in> Change-Id: I7c39d4e1a7a46d3a499a241e618bd0da7eed53a8
2020-01-15Tools: Jupyter Notebook Bug-fixes and Update.opensource-tnbt3-19/+23
Separate volume for Jupyter Data is created. Results will be stored in that volume. Notebook is updated to use the volume. Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: I2a359d64cf3d4281686d4d3c3d6f3ee6587c1e13
2019-12-04Merge "Tools: Deployment and TestControl Containers"opnfv-9.0.0stable/iruyaSridhar Rao36-1/+4086
2019-12-01Tools: Deployment and TestControl ContainersSridhar K. N. Rao36-1/+4086
This patch add containerization of VSPERF support. The patch facilitates creation of 4 containers: 1. Interactive Deployment 2. Auto Deployment 3. Interactive TestControl 4. Auto TestControl. The patch also includes a minimal client to work with interactive containers. The docs folder provides detailed documentation. Fixed pylint errors in libs folder. Removed proto built python files, and added the build process in prepare.sh. Stability improvements for Auto versions of deployment and testcontrol. Enhance client with 'mode' feature, where client can run either to do only deploy/only test or both. Add sample configuration file for client Fixed few typos - as suggested by AL. JIRA: VSPERF-594 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Id40b02960f71a7f9183d9a53955e2483117fb9e2
2019-11-13Upgrade: Upgrade Upstream Software packages in VSPERF.Sridhar K. N. Rao4-13/+17
This patch upgrades following upstream software packages: 1. DPDK: from 17.08 to 18.11-rc2 2. OVS: from 2.8.1 to 2.12.0 3. VPP: from 17.07 to 19.08.1 4. QEMU: from 2.9.1 to 3.1.1 Changed the vpp_plugins path in 02_vswitch.conf: from lib64/vpp_plugins to lib/vpp_plugins JIRA: VSPERF-606 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ib3018a7254e61337141773787cb5d3ea1cff18f4
2019-10-29integration: fix null_pmd testsLukasz Pawlik1-2/+2
In OVS >= 2.12 output from ovs-vsctl got changed. Whitespace matching is no longer required when searching for devargs. This patch fix regular expression. Change-Id: Ic2e6965552a7200647410cd73cd2c60817d31a81 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration: remove ovsdpdk_hotplug_detachLukasz Pawlik1-53/+0
Support of netdev-dpdk/detach has been removed from OVS, so testcase will fail with OVS 2.11 and DPDK 18.11 versions. This patch removes this test. Change-Id: I7c3005ff2bef2dcfd1f4bc849490c5e61cba8485 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration fix ovsdpdk_mq_pvp_rxqs_linux_bridgeLukasz Pawlik1-3/+4
Fix flow setup by adding action that do something with packet. Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com> Change-Id: Ia219d46238be9373ed02349fbd15d89f22670c4e
2019-10-29integration: fix ovsdpdk_mq_pvp_rxqs_testpmdLukasz Pawlik4-3/+24
Parameters passed to testpmd are changed in DPDK 18.11. Setting stat-qmap does not work from command line it can be set only from testpmd application before port forwarding is started. Decrease frame rate on traffic generator to receive traffic on two queues. Change-Id: I82b8e478226d59b091154d325afed07327908250 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29Fix policer related integration testsLukasz Pawlik1-11/+2
From DPDK >=18.02.0 when setting policer information about CIR is no longer available in the logs. Returned error when creating policer with invalid parameters was also changed. This patch removes checking information about CIR setting in OVS log and fix error string checking. Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com> Change-Id: I1753bf8ebc66e12ce3bf9dc38f07b61f6500095f
2019-10-29integration: fix MTU checking for OVS>=2.9Lukasz Pawlik1-17/+22
In DPKD>=17.11.0 and OVS>=2.9 behaviour of MTU has changed. Previously ovsdpdk_jumbo_p2p_upper_bound checked that two different MTU could be set for a port in OVS DPDK. However due to changes in OVS a larger MTU value is now required to create different mempools. Fix this by increasing the MTU value requested so that a new mempool will be created. Also output for calls to ovs-appctl has changed. This commit fixes the expected regex to account for new spaces and reformat of the queue listings in open vSwtich. List of fixed tests: ovsdpdk_mq_p2p_rxqs ovsdpdk_mq_p2p_rxqs_same_core_affinity ovsdpdk_mq_p2p_rxqs_multi_core_affinity ovsdpdk_mq_pvp_rxqs ovsdpdk_mq_pvp_rxqs_testpmd ovsdpdk_jumbo_mtu_upper_bound_phy_port ovsdpdk_jumbo_mtu_upper_bound_vport ovsdpdk_jumbo_p2p_upper_bound Co-authored-by: Ian Stokes <ian.stokes@intel.com> Change-Id: I22e208004e5b732b4b21904809606055fbb9c0c4 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration: fix ovs/dpdk with DPDK >= 18.02Lukasz Pawlik3-8/+12
In DPDK >= 18.02 disable-hw-vlan testpmd command line was changed. Parameter disable-hw-vlan is default and user has to explicitly enable it. This patch fix testpmd command line parameters. Also in DPDK >= 18.05 igb_uio kernel module was moved to different directory. Compilation of kernel module only is broken. This patch fix this. Now whole DPDK project is build. Change-Id: I6c8c44979192201c42e6a71b55c37a50fa64fd96 Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com>
2019-10-29integration: Fix OVSDPDK testsLukasz Pawlik4-18/+25
Commit c5a075eafc322d9ae62322e90ab4e232df176743 break integration tests because logs location was changed. This patch fix this by ensuring that RESULTS_PATH is set before integration tests conf file is processed and set correct path in integration conf. Signed-off-by: Lukasz Pawlik <lukaszx.pawlik@intel.com> Change-Id: I7ca104cfb31c7bc0f6052b58a370a1d65157efe1
2019-09-17Merge "Python: Upgrade Python version from 3.4 to 3.6"Sridhar Rao9-26/+26
2019-08-30Python: Upgrade Python version from 3.4 to 3.6Sridhar K. N. Rao9-26/+26
This patch upgrade python version from 3.4 to 3.6 for the following systems. Centos rhel - 7.2, 7.3 and 7.5 ubuntu For fedora and opensuse - no specific option available. SLES is already using 3.6 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: Ib1a1cb04441c8fe53339f7f9a66e0266d6ceefe0
2019-08-28VSPERF: Enable results publishing through config-file.Sridhar K. N. Rao2-2/+6
This patch enables the publising of results to TestAPI via config-file. Initial OPNFVPOD to empty string in 00_common.conf Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com> Change-Id: I5ca03d094b075c6b5ab5d656421aff506ce4b273
2019-08-07Merge "Docker: VSPERF Results Container."Sridhar Rao12-0/+1492
2019-07-30Docker: VSPERF Results Container.Sridhar K. N. Rao12-0/+1492
This patch adds docker-compose.yml and related config files for creating a results container. The container hosts following services: 1. Barometer Grafana. 2. Barometer Influxdb. 2. ELK Stack. 3. OPNFV TestAPI. 4. Jupyter Notebook with VSPERF testresults-analysis. Removed dashboard files, which can be obtained from barometer-grafana. Added comment in tools.rst under pre-deployment Retained only vpserf-cases and vsperf in cases.json and projects.json Changed barometer-influxdb to influxdb:latest. Added README.md file. Added environment variable setting to disable token for jupyter JIRA: VSPERF-602 Change-Id: I37a1391a1f34f834ce0d46def75a9f3454e09772 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-07-29Merge "CONFIG: VSPERF Config-file Generation Wizard."Sridhar Rao4-0/+974
2019-06-12CONFIG: VSPERF Config-file Generation Wizard.Sridhar K. N. Rao4-0/+974
This patch adds a tool create config file. When run, the wizard asks user a set of questions. A config file, named vsperf.conf, will be created. Fix some pylint Issues. JIRA: VSPERF-603 Change-Id: I1b800d8384cb3c0883b7f3859a9df77bb874b7b8 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-05-27pkt_gen: Bug-fix in Spirent testcenter parameter ordering.Sridhar K. N. Rao1-2/+4
This patch provides a fix to parameter ordering for imix and live results. 2 line changes. JIRA: VSPERF-598 Change-Id: I329b67114d780e0bcc73b128aeafe6e0f25b0621 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-29Merge "Collector: Add Multi-command collector."opnfv-8.0.0stable/hunterSridhar Rao4-0/+176
2019-03-29Collector: Add Multi-command collector.Sridhar K. N. Rao4-0/+176
This patch adds support to run following commands as 'collector' 1. collectd 2. PROX IRQ Latency 3. CROND (currently to collect ovs-port's CPU-mapping information) 4. Filebeat (send logs to elasticsearch) Fixed pylint issues Added description to control prox-runrapid. The use of 'stop' file. Added a print in print_results. JIRA: VSPERF-599 Change-Id: I583325ef14ddb0b292e8abddef1518d24b5e52d8 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-20Logs: Move test-specific logs to test-specific results folderSridhar K. N. Rao4-15/+18
This patch moves the following logs to results-folder. 1. qemu.log 2. vswitchd.log 3. host.log 4. vsperf-overall 5. vpp 6. trafficgen Move the logging of creating results directory after configure-logging JIRA: VSPERF-600 Change-Id: I5b0a827ea2dfaf869d2495b5f4a7b5dd2bd054ac Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-03-19Merge "pkt_gen: STC- Live Results Support"Sridhar Rao3-4/+138
2019-02-20pkt_gen: STC- Live Results SupportSridhar K. N. Rao3-4/+138
This patch adds live-results reporting from STC traffic generator. STC reports per-port stream results every second. The results are written to two different files in results folder. Added configuration filename for stc-liveresults JIRA: VSPERF-598 Change-Id: I37de6b5f544355e9e0dd42936328551b59afe065 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-02-20pkt_gen: T-Rex Live ResultsSridhar K. N. Rao2-1/+70
This patch add live-results from T-Rex TGen. T-Rex, when live-results enabled, will dump per-second flow-stats into the results-folder. Fixed few pylint issues. JIRA: VSPERF-524 Change-Id: I0caee49c5b34582bbcefbe217028e9e50d40da71 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>
2019-02-16Merge "VSPERF: Add Timestamps to Logfiles"Sridhar Rao5-21/+53
2019-02-15Merge "pkt_gen: STC - Imix Genome Support"Sridhar Rao6-6/+103
2019-01-27Merge "loadgen: Affinitize Stressor-VM Threads."Sridhar Rao1-1/+40
2019-01-21VSPERF: Add Timestamps to LogfilesSridhar K. N. Rao5-21/+53
This patch adds timestamps to all the logfiles created by VSPERF. The logfiles covered are: 1. LOG_FILE_VSWITCHD 2. LOG_FILE_OVS 3. LOG_FILE_VPP 4. LOG_FILE_QEMU 5. LOG_FILE_GUEST_CMDS 6. LOG_FILE_TRAFFIC_GEN 7. LOG_FILE_HOST_CMDS Added fix for pylint errors This patch also ensures the extension is only .log always. JIRA: VSPERF-586 Change-Id: I319c075e7d3af06539266f4c759a41f877d4cff2 Signed-off-by: Sridhar K. N. Rao <sridhar.rao@spirent.com>