aboutsummaryrefslogtreecommitdiffstats
path: root/dashboard
AgeCommit message (Collapse)AuthorFilesLines
2018-07-19Bugfix: yardstick env grafana return http errorrexlee87761-1/+1
It returns "HTTPError: 404 Client Error: Not Found for url" when creating Grafana dashboard. The log shows it failed when create "tc058" dashboard. JIRA: YARDSTICK-1333 Change-Id: I14a275a31f019a7dc66a531a85314cc098e0f4c9 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-06-27Update to Grafana Dashboard for NSB PROX NFVIDanielMartinBuckley2-9973/+12735
JIRA: YARDSTICK-1252 CPU grouping in grafana for better representation Throughput table is difficult to read as the tests run longer the values can overlap Default time in dashboard should be always last 1hour in dashboard (auto refresh can be also checked) Add one column in table with Gbps throughput (Rx Throughput) plus code change in yardstick Boxes are not aligned and big and small, need to be fixed boxes are now aligned, Added Seperate graphe for LINE Rate Change-Id: Ief31777c2e7a18aab4bf21fb6ccc0e93a3bb9178 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-27NSB NFVi PROX VPE losing many packetsDanielMartinBuckley2-1163/+10152
JIRA: YARDSTICK-1105 Running a vPE test ends up with up to 25% drooped packets. This is due to tolerated loss being incorrectly configured, test duration was too short and test interval was too short. Note This is due to the fact that vPE use case have by default a tolerated loss of 100%, Now changed to 0.001, same as L2FWD Also: Grafan dashboard has been updated to show all SUT CPUS Utilization in 1 panel. And LINE rate MIN, MAX & TEST Rate have been added Change-Id: I7adae2199b3f656fe460705b6aeb3aa69c767d50 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-01Add NSB PROX Baremetal dashboard for L3Xavier Simonart2-1151/+9973
JIRA: YARDSTICK-1213 Change-Id: Id96edc5d23d3530110466e1cf69327c3e267e4c0 Signed-off-by: Xavier Simonart <xavier.simonart@intel.com>
2018-03-28Add dashboard for TC058Miikka Koistinen1-0/+265
This dashboard is for Yardstick test case TC058. JIRA: YARDSTICK-1091 Change-Id: Ib76d917f52cd0fc7d968ac300f8e7e01de3dfd0f Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-03-28Merge "Dashboard for TC056"Rex Lee1-0/+301
2018-03-20Fix for datasource field valueMika Rautakumpu9-35/+35
This is fix for grafana dashboard templates where variable "${DS_YARDSTICK}" is replaced by "yardstick". JIRA: YARDSTICK-1089 Change-Id: I0647d5bfd772a2d9ffa18bac59cdbbb39c8ec0ab Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-03-20Dashboard for TC056Mika Rautakumpu1-0/+301
This is dashboard for Yardstick test case TC056. JIRA: YARDSTICK-1085 Change-Id: I8bf2149f8dd9081022deb280101815cb1dd417ec Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-02-28Addition of storage of extra counters for GrafanaDanielMartinBuckley1-0/+5817
JIRA: YARDSTICK-1036 This stores a number of extra counters in influxdb for Prox test cases. It also stores existing counters with a "succcess_" tag. Previously throughput where stored without success or failure indication. Also "Result_" counters are also stored. These can now be used by Grafana to graph output. Change-Id: Ie5636c14ecbab1b53a988bdfbd47ddd1fcdbd695 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-11-17bugfix: tc006, tc079, tc082 miss grafana dashboard in local deploymentrexlee87763-0/+1097
JIRA: YARDSTICK-847 Change-Id: I0750f2d17bac9e0214caf640e4ea1141ea3b4a03 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-11-07NSB Prox LW_AFTR TestDanielMartinBuckley2-0/+2308
JIRA: YARDSTICK-802 Addition of PROX LW_AFTR basked on PROX/DATS v037 test_104_lw_aftr.py - This support BM and Openstack Heat - This supports 4 Ports ONLY - Grafana Dashboards included - Code Coverage / Unit testing Change-Id: If2170ab458bf687256d5f1a1e840a3b9d2788ef7 Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-10-12ping: always save rtt data, influxdb ignore empty dataRoss Brattain5-5/+5
If the SLA was failing we were raising AssertionError and not storing the rtt in the data dict. This caused influxdb parse errors because the data was empty. Fixup influxdb to ignore records with no data, so we don't try to parse no data. Change the ping logic to always record the rtt result even if the SLA was not met. Also fixup ping logic in cases where ping does not return results. If SLA is defined use SLA * 10 otherwise use large float that doesn't break the grafana scale too much, maybe 999999 JIRA: YARDSTICK-809 Change-Id: Id2d51216581644a80e8c7b9aa98919a766008adf Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-10-12NSB Prox Grafana dashboard updatesAbhijit Sinha34-3742/+6514
JIRA: YARDSTICK-802 Updating the Grafana dashboards with common data format for all BM and Opensatck Prox tests and adding minor improvements - Correct the test description - Re-run the tests and verify that all the fields are graph correct - Label the axes correctly. eg: For Throughput added label "MPPS" Change-Id: I62b471926fe3c4c8876b70053a92d06f4373e296 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-10-06NSB Prox vPE TestAbhijit Sinha2-0/+2326
JIRA: YARDSTICK-802 Addition of Prox vPE test case - The tests supports BM, Openstack Heat - Supports 4 ports - Grafana dashboards included - Added support for parameters.lua for prox additional files - Unit tests for code coverage Change-Id: I5cccb351dacba88a293ae4b8aba1f0a803d62e6d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Daniel MArtin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-09-29Grafana Dashboard update for Prox TestsAbhijit Sinha32-402/+402
JIRA: YARDSTICK-802 Updated the Grafana dashboards to collect KPI's correctly & incorporate scale up changes in topology Influx-db stores the KPI’s fields as: <TG><Port><kpi> TG has changed from : tg__1 to tg__0 VNF has changed from : vnf__1 to vnf__0 Change-Id: I3bd8be61210906bc4de95c9b1986033572d93277 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-09-28Addition of Prox NSB BNG and BNG-QoS testAbhijit Sinha4-0/+4192
JIRA: YARDSTICK-802 Added Prox BNG and BNG-QoS Test - The tests supports BM, Openstack Heat - Supports 4 ports - Test added for BNG traffic profile - Fixed the Prox heat test cases with proper upstream and downstream links - Grafana Dashboard for BNG & BNG-QoS added - Increased the test Duration to 300 TODO: - Test does not Terminate correctly Update: Added new helper class for run_test: Genric, MPLS and BNG tests. Change-Id: Ib40811bedb45a3c3030643943f32679a4044e076 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-09-20Addition of PROX NSB tests to yardstickDanielMartinBuckley10-0/+10136
JIRA: YARDSTICK-802 Addition of PROX L2FWD_Multiflow, ACL, Load Balancing plus grafana dashboards Supports 2 and 4 port Baremetal & Heat Change-Id: I1f3990d5451de265ee3901302569c355ece3b146 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2017-09-15Merge "add tc083 rst and tc073/tc083 netperf local dashboard"Rex Lee2-0/+632
2017-09-15add tc083 rst and tc073/tc083 netperf local dashboardrexlee87762-0/+632
Change-Id: I382b2a711d6659f94982c4386c2f25c144705831 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-09-14KVMFORNFV: Update Grafana config for Packet Forwarding test cases.kalyanreddy1-51/+2811
JIRA: YARDSTICK-783 This patch is used for updating the configuration file of opnfv grafana dashboard for kvmfornfv packet forwarding to publish the throughput results of test cases added as part of kvmfornfv daily job. Change-Id: I913bbc5172eefbbfeee86f7ca74b2b99c521c248 Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
2017-09-07Merge "update yardstick ha test cases dashboard"Kubi7-31/+2430
2017-09-06Addition of Prox NSB tests in yardstickAbhijit Sinha6-0/+5768
JIRA: YARDSTICK-802 Added Prox L3FWD and Packet buffering tests - The tests supports BM and Openstack Heat - L3FWD tests suports 2 and 4 ports - Packet flow buffering test is a 1 port test - Grafana Dashboards are added TODO: Latency stats are missing in KPI collection Need to invetigate that Coverage if needed! Change-Id: I216a170488d5578622cf8c3748a6277b380f016a Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2017-09-04Addition of Prox NSB changes in yardstickabhijitsinha12-0/+11669
JIRA: YARDSTICK-802 Addition of Prox L2Fwd, MPLS test cases for BM and Heat. updates: Most of tg_prox and prox_vnf were absorbed into the base classes. delete most of ProxDpdkVnfSetupEnvHelper, it is handled by DpdkVnfSetupEnvHelper baseclass use standard _build_pipeline_kwargs methods don't use terminate() use baseclass version add new method kill_vnf that runs pkill -x replace resource_helper.execute() with vnf_execture for dumping stats In order to share code between tg_prox and vnf_prox refactor to have tg_prox hold and wrap a ProxApproxVnf instance and call methods on that class. Do this instead of multiple-inheritance. Implement ProxApproxVnf.terminate() using prox socket command based exit, (stop_all, quit, force_quit). vnf_execute calls resource_helper.execute() which calls socket methods on the sut object. Since tg_prox wraps the VNF object, we can call terminate on the VNF object and it should work correctly. move prox config generation to parent process we need to get core number info from config file inside the TG processes, so we need to generate the config in the parent process so the data is copied to the child during the fork. moved more config file methods to the setup_helper class. we run force_quit after quit, so the socket should already be closed this will trigger socket error, so add _ignore_errors option for vnf_execute to ignore socket errors Fixed the terminate issue. Added MPLS tests. Added TG Stats in_packet/out_packet Fixed compile (pep8) issues Fixed MPLS TG port stats, in/out packets Added Grafana dashboards for L2FWD and MPLS Traffic profiles modified for tolerated loss and precision as per DATS tests. Added unit test case for Mpls Single port test stats collection support. Change-Id: Idd9493f597c668a3bb7d90e167e6a418546106e8 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-09-01update yardstick ha test cases dashboardrexlee87767-31/+2430
Change-Id: I169e3dc7eb94efa7fe27fc4e82444f53452ccaba Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-22DRAFT: update yardstick generic test cases dashboardrexlee877623-5536/+11415
current dashboard is obselete and hard to understand add local grafana dashboard automatically import by "yardstick env grafana" update grafana version to latest steady Change-Id: Iffae9170231d3e0867a52a1f6b5e99c4650b7326 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-08-11KVMFORNFV: Update Grafana config for Packet Forwarding test cases.kalyanreddy2-68/+713
JIRA: YARDSTICK-783 This patch is used for updating the configuration file of opnfv grafana dashboard for kvmfornfv packet forwarding to publish the results of new test cases added as part of kvmfornfv daily job. Also used for updating the config file of opnfv grafana dashboard for kvmfornfv cyclictest test cases to correct the alias colours. Change-Id: I34aa155e2782e58147e55f974134673a892eb93b Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
2017-04-11KVMFORNFV: Grafana config for Packet Forwarding test cases.kalyanreddy1-0/+2636
This patch is used for adding configuration file to opnfv grafana dashboard for kvmfornfv packet forwarding test cases as a part of daily job. Change-Id: If2f06d2c01a7f6863ae1aa25942c3197856d895b Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
2017-02-21add grafana dashboard for os-nosdn-nofeature-harexlee87761-0/+5535
JIRA: YARDSTICK-401 Change-Id: Ibe8eaaf6bf9d283e51ee3fb2a3062344179a11c6 Signed-off-by: rexlee8776 <limingjiang@huawei.com> Signed-off-by: root <limingjiang@huawei.com>
2017-02-14This Patch is used to add grafana config to opnfv dashboard forShravani1-517/+573
kvmfornfv_cyclictest_cpustress_idle,kvmfornfv_cyclictest_memorystress_idle and kvmfornfv_cyclictest_iostress_idle testcases Change-Id: Ia49c33a658f342e96cb9cb3fbc499e56bb08ebd6 Co-Authored by:Rajitha <y.rajitha@tcs.com> Signed-off-by:Shravani <shravani.p@tcs.com>
2016-12-06update grafana dashboard opnfv_yardstick_tc002rexlee87761-1/+1
JIRA: YARDSTICK-447 Change-Id: Iba97948eb9db2d8f22b31fdfc6e09570ed6b11b9 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-12-05Change grafana default dashboard from ping to opnfv_yardstick_tc002chenjiankun1-1/+1
JIRA: YARDSTICK-447 Now the grafana default dashboard use the sample/ping.yaml test case. I will change it to opnfv_yardstick_tc002 because it is the release test case. Change-Id: If20ca123d0407ad92b49f7d2dac98faa2a01e195 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-12-02Add API to create Grafana containerchenjiankun1-0/+1
JIRA: YARDSTICK-441 Change-Id: Ia848c4af072915ef252e8e03100dd7a4e4a6c3c2 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-11-02This patch is used to update the time range in dashboard configshravani1-4/+4
from "now-2d" to "now-7d" so that dashboard will display the data from past 7 days.Updated the refresh time to "1d" Change-Id: I4987eaa5e84de058841d34beb2124f7503f2f01b Signed-off-by: Shravani <shravani.p@tcs.com>
2016-10-24This patch is used to add grafana config to opnfv dashboard forshravani1-0/+517
kvmfornfv_cyclictest_idle_idle Change-Id: I67648c467ac01794ca9b47cb17e2b6d3c404c095 Signed-off-by: Shravani <shravani.p@tcs.com>
2016-08-22Add grafana config for TC074_StorperfJingLu51-0/+975
Change-Id: If415a6e6170c52f3586a1521f6f239daad3d527c Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-08-21Merge "add grafan config for ha test cases tc045~tc049"liang gao5-0/+3564
2016-08-21Merge "Add grafana config for TC069_memory_bandwidth(RAMspeed)"liang gao1-0/+2316
2016-08-21Merge "Add grafana config for TC071_Network Latency, Throughput, Packet Loss ↵liang gao1-0/+1377
and Cache Utilization"
2016-08-21add grafan config for ha test cases tc045~tc049rexlee87765-0/+3564
Change-Id: I1adc9ab36a71195e7c03fe4f3b7322ea40aa2a40 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-08-15Add grafana config for TC063_StorageCapacityJingLu51-0/+2776
Change-Id: Ib960e249770902b57d65fe9fe811c1565a5dc867 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-08-12Merge "Add grafana config for TC070_Network Latency, Throughput, Packet Loss ↵liang gao1-0/+1378
and Memory Utilization"
2016-08-12Merge "Add grafana config for TC055_ComputeCapacity"liang gao1-0/+2867
2016-08-04Merge "Modify grafana config for TC002_Ping as ping output format has been ↵liang gao1-212/+107
changed"
2016-08-02Merge "Modify grafana config for TC037_Network Latency, Throughput, Packet ↵liang gao1-88/+91
Loss and CPU Load"
2016-08-01Modify grafana config for TC002_Ping as ping output format has been changedJingLu51-212/+107
Change-Id: I758d3efd909011c0c197519d33dca7d579cc5cce Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-07-29Add grafana config for TC072_Network Latency, Throughput, Packet Loss and ↵JingLu51-0/+1378
Network Utilization Change-Id: Ib174401066f3a776f049f06d5d2502b034f4d984 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-07-29Add grafana config for TC055_ComputeCapacityJingLu51-0/+2867
Change-Id: Idb7946528a01f51dcca437c64a3b035d25b1e83d Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-07-28Add grafana config for TC071_Network Latency, Throughput, Packet Loss and ↵JingLu51-0/+1377
Cache Utilization Change-Id: Ica0431df75628f08eb2ba558681c5740a038ab1d Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-07-28Add grafana config for TC070_Network Latency, Throughput, Packet Loss and ↵JingLu51-0/+1378
Memory Utilization Change-Id: I06e5c07e63e57d6568ca92478aec041f339209d6 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-07-28Modify grafana config for TC037_Network Latency, Throughput, Packet Loss and ↵JingLu51-88/+91
CPU Load Change-Id: I898c80328751c81a644ad824f2dd83a56021afd6 Signed-off-by: JingLu5 <lvjing5@huawei.com>