summaryrefslogtreecommitdiffstats
path: root/utils/test/reporting
AgeCommit message (Collapse)AuthorFilesLines
2016-11-28bug Fix: adapt reporting to merge of smoke+sdn tiersMorgan Richomme1-4/+4
Change-Id: I74d9834b609797f85d52e97ccdfeab614c1c07bf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-17Merge "Correct SFC testcase match in the reporting Dashboard"Morgan Richomme1-1/+1
2016-11-17Correct SFC testcase match in the reporting Dashboardjose.lausuch1-3/+3
The test is specified as odl-sfc, but in the DB we have functest-odl-sfc. http://testresults.opnfv.org/test/api/v1/results?case_name=functest-odl-sfc Change-Id: Ie8c0ed60df3b11fc4d74c26796ae7a19d63c22b7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-11-17Refactor reporting dirMorgan Richomme112-611/+897
- dockerization - create util function for all the test projects - create a common config files - add unit tests - pep8 JIRA: RELENG-162 Change-Id: Ib209be4233084100ff238a7aeb2843ccc24a6f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18bug fix: pdf generationMorgan Richomme2-39/+50
Change-Id: Ic101411a991b4baac8e1683bc5cad924f85f05c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-12Add d3 graph presentation to yardstick reportingchenjiankum4-30/+111
JIRA: YARDSTICK-367 Change-Id: Ifa2cca1bdfc7d94a84758019d0b1693e09b46e47 Signed-off-by: chenjiankum <chenjiankun1@huawei.com>
2016-10-11Merge "Add export functions to reporting"Morgan Richomme3-8/+123
2016-10-10Add export functions to reportingMorgan Richomme3-8/+123
JIRA: FUNCTEST-486 Change-Id: I84ad52f12097bbc5976c754d28ebc76d49b1eff2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-06create nice reporting landing pagesMorgan Richomme69-0/+8811
Change-Id: I91f897f7be9112e8abc71069bff2882a75bc40cf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-03Add dots in trend lineMorgan Richomme2-0/+13
JIRA: FUNCTEST-483 Change-Id: I014faccf9358fff5c47d4be6f4d8f55fd7133691 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-29bug fix add forgotten folderMorgan Richomme1-0/+104
Change-Id: I04f663e5c375d4555bcfc2fa2e70c00f7da5fd91 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-29Add a trend line to Functest reportingMorgan Richomme6-115/+299
And use d3js lib rather than static images JIRA: FUNCTEST-483 Change-Id: I3c372a8e18fc366dfe510ab551596640fb6d9242 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-23Add hyperlink on scenariosMorgan Richomme5-16/+61
JIRA: FUNCTEST-482 Change-Id: Ibe19f153dc79ae1a9b78ec9eb52bb48898d63d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-20Make a black list for yardstick reportingchenjiankun3-0/+26
JIRA: YARDSTICK-353 Change-Id: Ic4821ff279401cc4eb26d172c0b649e9eeb2da48 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-19Change display way of reporting status, add last ten days scorechenjiankun18-32/+78
JIRA: YARDSTICK-350 Change-Id: Iea1d8a30cf3464c8b9a0b8b6ac2e0ce41adea00d Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-14Add gauge metrics for Functest reporting dashboardjose.lausuch16-11/+42
JIRA: FUNCTEST-476 Change-Id: Ia39ffa8b39a1085a081d6128871cee20436e051c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-13Bugfix: reporting shows more than 4 days resultchenjiankun1-0/+2
JIRA: YARDSTICK-346 Change-Id: Ife5334f9c7d6a1546eee6995ce4b1b36d0f2c008 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-13Merge "Implements use of yaml.safe_load as per sec audit"Morgan Richomme1-1/+1
2016-09-13Bugfix:[yardstick reporting] reporting status is not true due to select a ↵chenjiankun1-2/+8
wrong keyword JIRA: RELENG-146 Change-Id: I9bea896c3be02b7533ab170b3e91117499eef06f Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-12Implements use of yaml.safe_load as per sec auditLuke Hinds1-1/+1
Change-Id: I9b8d9746e8a3beebc1aff9f883dcec39928831d7 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-09-12Merge "bugfix: yardstick reporing in stable branch omit stable/"Morgan Richomme1-1/+1
2016-09-12bugfix: yardstick reporing in stable branch omit stable/rexlee87761-1/+1
JIRA: YARDSTICK-343 Change-Id: I926d1fcb308feb118663ba4db7adf3bc9eab7cbe Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-09-08Fix security issues reported by the security auditMorgan Richomme6-9/+9
JIRA: RELENG-143 Change-Id: Ia20c6ce86e72924ab8ab5f93bdc956d7f6a40a93 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-07Add stable/colorado to versionschenjiankun1-1/+1
Change-Id: Ieccb04d20ca23265af30e6a671cd999b6d1cd349 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-09-01Fix test results dashboard homepage navbar linksDaniel Farrell2-7/+11
The previous versions were the wrong paths, 404'd. Change-Id: I9368db672a18b5bb0394cfacf016cd7f5821d886 Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-08-30Merge "Add the function of yardstick testcase reporter"Morgan Richomme12-0/+304
2016-08-27Add the function of yardstick testcase reporterrexlee877612-0/+304
JIRA: YARDSTICK-324 Change-Id: I58969265f88d5c20f46f0b1097f5b0ccb1d9a40d Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-08-25Add colorado reporting for tempest and vimsMorgan Richomme6-180/+190
Change-Id: I978799cd1cd777b5033e55a0146c41865e9c2bf5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-22adapt reportingMorgan Richomme5-2/+2
- no odl-SFC test reported to DB - add link to scenario scoring wiki page - add +x on executable python files Change-Id: I6724408e3ed5d6a2ba78aff40d80d692c1e0780b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-17Add parser in automatic reportingMorgan Richomme1-2/+4
Change-Id: I3d9c09b0da471e03647c09e96ca8b7ec89afb300 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-12Add copper in reportingMorgan Richomme2-3/+3
JIRA: FUNCTEST-67 Change-Id: I4881b2ba0c20a65567a59fb9fc7645c438a341ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-10Fix unknown projects in reportingMorgan Richomme3-10/+20
Change-Id: Ia3d21694b8bf5e7131110124a520ecc0b9234509 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07minor bug fixesMorgan Richomme2-21/+18
Change-Id: I8ea8b03559a27374cb387ed9a4f3b0b08364f7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07flake 8 fix + add loggerMorgan Richomme7-124/+208
Change-Id: Ib8fbf0e784b57ea9be824e95fafe68e991b80aab Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-05fix bug + introduction of blacklist for scenario scoringMorgan Richomme3-42/+71
Change-Id: Ib1a99cbeeb66d4c51eedb56d25d317b92602d51d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-24change version to scenarioboucherv1-3/+4
Change-Id: I0942e9c8f23e886d6a6e344fa1fd1c24c1cd3f4b Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-06-17Bug fix on test name after name alignementMorgan Richomme2-3/+2
JIRA: FUNCTEST-304 Change-Id: Ie854b677003350a65e90279222ceb281d2f5b18c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-17fiw bug: DB and config test name alignmentMorgan Richomme1-1/+1
JIRA: FUNCTEST-304 Change-Id: I84f16d1d9be5f4cfd603ce0a27a46c4450a273e8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-17bugfix: start test timeboucherv2-3/+3
Change-Id: Ie916cc77373cbfae6e189ffeb1153400b2cc6f67 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-06-16Align test names in BD and testcase.yaml declarationMorgan Richomme3-10/+33
JIRA: FUNCTEST-304 Change-Id: I642101d88716ac634e07b66136cfdcac0c482500 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-10Adapt automatic reporting to new Test APIMorgan Richomme4-18/+20
JIRA: FUNCTEST-303 Change-Id: Ie9cb7151301ab2c26a72746683c35305ba560bbc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-31Add Tempest error in Tempest reportingMorgan Richomme2-27/+32
JIRA: FUNCTEST-150 Change-Id: I0b2a3a38bbbb11a80c761c23c71c2f45a959e477 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Forget conf file...Morgan Richomme1-0/+17
Change-Id: I85261ec5fcbe59db2e67f8347d2babb082454e14 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Adapt reporting after Functest refactoringMorgan Richomme7-285/+405
Get test cases from cases declares in Tiers Consider only Tier 0-3 to validate scenario Display results for Tier > 3 Change-Id: I581702bd7f2cc323d38b82a2404b301fb8fd7840 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04fix config path after refactoringMorgan Richomme1-1/+1
Change-Id: Idb4d9d978c89ae8bc590ca9f938b756118c5e26a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04Add global scenario reportingMorgan Richomme4-9/+68
Save date when a scenario is validated Change-Id: I0895ae56812c7059972a60bf017fdb76d40de25c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Improve code quality (flake8)Morgan Richomme1-7/+11
Change-Id: Id58236ab080bc7dd5d9d7b98c4a0fce27ee1b7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Functest reporting refactoringMorgan Richomme12-83/+84
integrate the notion of version (brahmaputra, master, ..) change dir structure Change-Id: Ieb8aed811ed4e1ab8738fb02e4db411da3d07ca2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-25Complete reporting status, process the scenario and get success criteriaMorgan Richomme2-68/+198
Change-Id: Iaf5292293aec877f94e9cdec80519a680fef6718 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-03-17Add automatic status reportingMorgan Richomme9-7/+329
Show last scenario run + sun/cloud/storm dynamically JIRA:FUNCTEST-151 Change-Id: I86eeb64f0dea842a71b0cba9dd1058d7fa876269 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>