summaryrefslogtreecommitdiffstats
path: root/utils/test/reporting
AgeCommit message (Collapse)AuthorFilesLines
2017-03-07Merge "bug fix: last 4 run reporting for storperf"Morgan Richomme3-13/+34
2017-03-07bug fix: last 4 run reporting for storperfMorgan Richomme3-13/+34
- bug fix: copy/paste of yardstick code but list of results is not sorted by default, taking the last 4 array items lead to random results on the 4 last run sort results before taking the last 4 results to establish last 4 run criteria - enhancement: add link to last CI run in the reporting page - fix trend line bug Change-Id: Ice16832a81cb65503a63b16321a2be92a427d279 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-03Create Test Reporting landing pagechenjiankun22-726/+805
JIRA: RELENG-165 In this patch, I upload the backend code usage: docker run -itd -p 8000:8000 -e SERVER_URL=server_ip:8000 opnfv/reporting:<tag> note: must point SERVER_URL, it is the api server. visit landing page: http://server_ip:8000/reporting/index.html Change-Id: I10121574e0c4b2733a8084c986d7a2746e7ce2a4 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-02-28Move from snaps_healthcheck to connection_checkMorgan Richomme1-4/+4
to retireve scenario lxd based scenarios are not running snaps_healthcheck Change-Id: I34a86b5b8d0e1dffda40e6173196eb9409c448a0 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-28Move case base from tempest_smoke_serial to snaps_healthcheckMorgan Richomme3-9/+11
It will allow to show additional scenarios in the reporting page the scenarios that fail on healthcheck or smoke tests before running tempest_smoke_serial Change-Id: I0d9ba84296bfc867ab80caa7873bb5bcb8469fc2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-27[Functest] Add Tempest Defcore test to the dashboardjose.lausuch1-0/+2
Change-Id: Id2292198d1e34a2de1d2b9ccdda83f565f771df1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Add storperf reportign status pageMorgan Richomme9-4/+277
Create associated static storperf page Prepare vsperf, qtip, bottlenecks Put Yardstick scenario class into utils directory Change-Id: I874d1733fe3f37dc5dd557559478e7e0b25371d7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-22Add Netready and Barometer tests to the reporting dashboardjose.lausuch1-3/+6
Change-Id: Idc09d3461ee5af09625aba3cf2219b64318145c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-14Bug Fix: tranlate build tag into jenkins urlMorgan Richomme4-7/+18
Include HEALTHCHECK Tier in the reporting Change-Id: I4a5a8aeb7564ca35c9199c7925ac344b43270d87 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-14Fix flake8 violations in relengjose.lausuch4-37/+36
Change-Id: I45769ff9c9db2de9fbba69117a92de414dd7f651 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-06Update on Functest reporting processingMorgan Richomme3-11/+27
- new param to exclude or not results from virtual PODs - new param to exclude or not noha results - fix path - add rally_sanity in black list until we fixed the format issue Change-Id: Ie952f7d6968a322edbcf2effffbc1a75beddc52f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-10Add Daisy for reportingMorgan Richomme4-0/+4
Change-Id: Ie9d6d5e351e5d673252f08ed304d4fef96a1e00b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-30Create Test Reporting landing pagechenjiankun47-1/+20488
JIRA: RELENG-165 In this patch, I do the follow things: 1.deploy tornado server(currently I haven't write any backend code, since the backend code depend on the testapi and I need to communicate with Serena). 2.landing page code(almostly finished. But I haven't the data, so for now, the data this page shows is a mock json. When the testapi and my backend code ready, this page will finally finished) 3.deployment: supervisor + nginx + tornado + angular usage: docker run -itd -p 8000:8000 opnfv/reporting:<tag> visit landing page: http://server_ip:8000/reporting/index.html test api: http://server_ip:8000/landing-page/filters visit old reporting page: http://server_ip:8000/display/master/yardstick/status-apex.html Change-Id: I527ab2661ce9e84b2942ebe673afbf5f2bc7878f Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-12-18Add SNAPS for reportingMorgan Richomme1-15/+21
Change-Id: If61bbd435cd9858924e850bcc959f9596579c205 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-16Bugfix: reporting docker image build failedchenjiankun4-12/+13
JIRA: RELENG-181 Since we just decide to use dynamic server, we need to deploy a dynamic server such as tornado . But when I use the Dockerfile to build image, it failed due to some reasons. So I need fix it first and then deploy the dynamic server. Then we can use this command: docker run -it -d -p 8080:80 opnfv/releng:latest And visit reporting page by http://server_ip:8080/display/... Change-Id: Id04575c7b38e4c07625ce217d23ebca1c5bf0191 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-11-28bug Fix: adapt reporting to merge of smoke+sdn tiersMorgan Richomme1-4/+4
Change-Id: I74d9834b609797f85d52e97ccdfeab614c1c07bf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-17Merge "Correct SFC testcase match in the reporting Dashboard"Morgan Richomme1-1/+1
2016-11-17Correct SFC testcase match in the reporting Dashboardjose.lausuch1-3/+3
The test is specified as odl-sfc, but in the DB we have functest-odl-sfc. http://testresults.opnfv.org/test/api/v1/results?case_name=functest-odl-sfc Change-Id: Ie8c0ed60df3b11fc4d74c26796ae7a19d63c22b7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-11-17Refactor reporting dirMorgan Richomme112-611/+897
- dockerization - create util function for all the test projects - create a common config files - add unit tests - pep8 JIRA: RELENG-162 Change-Id: Ib209be4233084100ff238a7aeb2843ccc24a6f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18bug fix: pdf generationMorgan Richomme2-39/+50
Change-Id: Ic101411a991b4baac8e1683bc5cad924f85f05c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-12Add d3 graph presentation to yardstick reportingchenjiankum4-30/+111
JIRA: YARDSTICK-367 Change-Id: Ifa2cca1bdfc7d94a84758019d0b1693e09b46e47 Signed-off-by: chenjiankum <chenjiankun1@huawei.com>
2016-10-11Merge "Add export functions to reporting"Morgan Richomme3-8/+123
2016-10-10Add export functions to reportingMorgan Richomme3-8/+123
JIRA: FUNCTEST-486 Change-Id: I84ad52f12097bbc5976c754d28ebc76d49b1eff2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-06create nice reporting landing pagesMorgan Richomme69-0/+8811
Change-Id: I91f897f7be9112e8abc71069bff2882a75bc40cf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-03Add dots in trend lineMorgan Richomme2-0/+13
JIRA: FUNCTEST-483 Change-Id: I014faccf9358fff5c47d4be6f4d8f55fd7133691 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-29bug fix add forgotten folderMorgan Richomme1-0/+104
Change-Id: I04f663e5c375d4555bcfc2fa2e70c00f7da5fd91 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-29Add a trend line to Functest reportingMorgan Richomme6-115/+299
And use d3js lib rather than static images JIRA: FUNCTEST-483 Change-Id: I3c372a8e18fc366dfe510ab551596640fb6d9242 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-23Add hyperlink on scenariosMorgan Richomme5-16/+61
JIRA: FUNCTEST-482 Change-Id: Ibe19f153dc79ae1a9b78ec9eb52bb48898d63d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-20Make a black list for yardstick reportingchenjiankun3-0/+26
JIRA: YARDSTICK-353 Change-Id: Ic4821ff279401cc4eb26d172c0b649e9eeb2da48 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-19Change display way of reporting status, add last ten days scorechenjiankun18-32/+78
JIRA: YARDSTICK-350 Change-Id: Iea1d8a30cf3464c8b9a0b8b6ac2e0ce41adea00d Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-14Add gauge metrics for Functest reporting dashboardjose.lausuch16-11/+42
JIRA: FUNCTEST-476 Change-Id: Ia39ffa8b39a1085a081d6128871cee20436e051c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-13Bugfix: reporting shows more than 4 days resultchenjiankun1-0/+2
JIRA: YARDSTICK-346 Change-Id: Ife5334f9c7d6a1546eee6995ce4b1b36d0f2c008 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-13Merge "Implements use of yaml.safe_load as per sec audit"Morgan Richomme1-1/+1
2016-09-13Bugfix:[yardstick reporting] reporting status is not true due to select a ↵chenjiankun1-2/+8
wrong keyword JIRA: RELENG-146 Change-Id: I9bea896c3be02b7533ab170b3e91117499eef06f Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-12Implements use of yaml.safe_load as per sec auditLuke Hinds1-1/+1
Change-Id: I9b8d9746e8a3beebc1aff9f883dcec39928831d7 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-09-12Merge "bugfix: yardstick reporing in stable branch omit stable/"Morgan Richomme1-1/+1
2016-09-12bugfix: yardstick reporing in stable branch omit stable/rexlee87761-1/+1
JIRA: YARDSTICK-343 Change-Id: I926d1fcb308feb118663ba4db7adf3bc9eab7cbe Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-09-08Fix security issues reported by the security auditMorgan Richomme6-9/+9
JIRA: RELENG-143 Change-Id: Ia20c6ce86e72924ab8ab5f93bdc956d7f6a40a93 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-07Add stable/colorado to versionschenjiankun1-1/+1
Change-Id: Ieccb04d20ca23265af30e6a671cd999b6d1cd349 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-01Fix test results dashboard homepage navbar linksDaniel Farrell2-7/+11
The previous versions were the wrong paths, 404'd. Change-Id: I9368db672a18b5bb0394cfacf016cd7f5821d886 Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-08-30Merge "Add the function of yardstick testcase reporter"Morgan Richomme12-0/+304
2016-08-27Add the function of yardstick testcase reporterrexlee877612-0/+304
JIRA: YARDSTICK-324 Change-Id: I58969265f88d5c20f46f0b1097f5b0ccb1d9a40d Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-08-25Add colorado reporting for tempest and vimsMorgan Richomme6-180/+190
Change-Id: I978799cd1cd777b5033e55a0146c41865e9c2bf5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-22adapt reportingMorgan Richomme5-2/+2
- no odl-SFC test reported to DB - add link to scenario scoring wiki page - add +x on executable python files Change-Id: I6724408e3ed5d6a2ba78aff40d80d692c1e0780b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-17Add parser in automatic reportingMorgan Richomme1-2/+4
Change-Id: I3d9c09b0da471e03647c09e96ca8b7ec89afb300 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-12Add copper in reportingMorgan Richomme2-3/+3
JIRA: FUNCTEST-67 Change-Id: I4881b2ba0c20a65567a59fb9fc7645c438a341ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-10Fix unknown projects in reportingMorgan Richomme3-10/+20
Change-Id: Ia3d21694b8bf5e7131110124a520ecc0b9234509 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07minor bug fixesMorgan Richomme2-21/+18
Change-Id: I8ea8b03559a27374cb387ed9a4f3b0b08364f7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07flake 8 fix + add loggerMorgan Richomme7-124/+208
Change-Id: Ib8fbf0e784b57ea9be824e95fafe68e991b80aab Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-05fix bug + introduction of blacklist for scenario scoringMorgan Richomme3-42/+71
Change-Id: Ib1a99cbeeb66d4c51eedb56d25d317b92602d51d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>