summaryrefslogtreecommitdiffstats
path: root/utils/test/reporting/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-02-28Move case base from tempest_smoke_serial to snaps_healthcheckMorgan Richomme2-8/+10
It will allow to show additional scenarios in the reporting page the scenarios that fail on healthcheck or smoke tests before running tempest_smoke_serial Change-Id: I0d9ba84296bfc867ab80caa7873bb5bcb8469fc2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-27[Functest] Add Tempest Defcore test to the dashboardjose.lausuch1-0/+2
Change-Id: Id2292198d1e34a2de1d2b9ccdda83f565f771df1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-22Add Netready and Barometer tests to the reporting dashboardjose.lausuch1-3/+6
Change-Id: Idc09d3461ee5af09625aba3cf2219b64318145c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-14Bug Fix: tranlate build tag into jenkins urlMorgan Richomme2-5/+7
Include HEALTHCHECK Tier in the reporting Change-Id: I4a5a8aeb7564ca35c9199c7925ac344b43270d87 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-14Fix flake8 violations in relengjose.lausuch3-23/+22
Change-Id: I45769ff9c9db2de9fbba69117a92de414dd7f651 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-06Update on Functest reporting processingMorgan Richomme1-2/+7
- new param to exclude or not results from virtual PODs - new param to exclude or not noha results - fix path - add rally_sanity in black list until we fixed the format issue Change-Id: Ie952f7d6968a322edbcf2effffbc1a75beddc52f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-10Add Daisy for reportingMorgan Richomme3-0/+3
Change-Id: Ie9d6d5e351e5d673252f08ed304d4fef96a1e00b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-18Add SNAPS for reportingMorgan Richomme1-15/+21
Change-Id: If61bbd435cd9858924e850bcc959f9596579c205 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-28bug Fix: adapt reporting to merge of smoke+sdn tiersMorgan Richomme1-4/+4
Change-Id: I74d9834b609797f85d52e97ccdfeab614c1c07bf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-17Merge "Correct SFC testcase match in the reporting Dashboard"Morgan Richomme1-1/+1
2016-11-17Correct SFC testcase match in the reporting Dashboardjose.lausuch1-3/+3
The test is specified as odl-sfc, but in the DB we have functest-odl-sfc. http://testresults.opnfv.org/test/api/v1/results?case_name=functest-odl-sfc Change-Id: Ie8c0ed60df3b11fc4d74c26796ae7a19d63c22b7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-11-17Refactor reporting dirMorgan Richomme9-328/+128
- dockerization - create util function for all the test projects - create a common config files - add unit tests - pep8 JIRA: RELENG-162 Change-Id: Ib209be4233084100ff238a7aeb2843ccc24a6f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18bug fix: pdf generationMorgan Richomme2-39/+50
Change-Id: Ic101411a991b4baac8e1683bc5cad924f85f05c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-10Add export functions to reportingMorgan Richomme2-8/+39
JIRA: FUNCTEST-486 Change-Id: I84ad52f12097bbc5976c754d28ebc76d49b1eff2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-29Add a trend line to Functest reportingMorgan Richomme4-115/+66
And use d3js lib rather than static images JIRA: FUNCTEST-483 Change-Id: I3c372a8e18fc366dfe510ab551596640fb6d9242 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-23Add hyperlink on scenariosMorgan Richomme5-16/+61
JIRA: FUNCTEST-482 Change-Id: Ibe19f153dc79ae1a9b78ec9eb52bb48898d63d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-14Add gauge metrics for Functest reporting dashboardjose.lausuch16-11/+42
JIRA: FUNCTEST-476 Change-Id: Ia39ffa8b39a1085a081d6128871cee20436e051c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-12Implements use of yaml.safe_load as per sec auditLuke Hinds1-1/+1
Change-Id: I9b8d9746e8a3beebc1aff9f883dcec39928831d7 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-09-08Fix security issues reported by the security auditMorgan Richomme5-8/+8
JIRA: RELENG-143 Change-Id: Ia20c6ce86e72924ab8ab5f93bdc956d7f6a40a93 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-01Fix test results dashboard homepage navbar linksDaniel Farrell1-4/+5
The previous versions were the wrong paths, 404'd. Change-Id: I9368db672a18b5bb0394cfacf016cd7f5821d886 Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-08-25Add colorado reporting for tempest and vimsMorgan Richomme6-180/+190
Change-Id: I978799cd1cd777b5033e55a0146c41865e9c2bf5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-22adapt reportingMorgan Richomme5-2/+2
- no odl-SFC test reported to DB - add link to scenario scoring wiki page - add +x on executable python files Change-Id: I6724408e3ed5d6a2ba78aff40d80d692c1e0780b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-17Add parser in automatic reportingMorgan Richomme1-2/+4
Change-Id: I3d9c09b0da471e03647c09e96ca8b7ec89afb300 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-12Add copper in reportingMorgan Richomme2-3/+3
JIRA: FUNCTEST-67 Change-Id: I4881b2ba0c20a65567a59fb9fc7645c438a341ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-10Fix unknown projects in reportingMorgan Richomme3-10/+20
Change-Id: Ia3d21694b8bf5e7131110124a520ecc0b9234509 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07minor bug fixesMorgan Richomme2-21/+18
Change-Id: I8ea8b03559a27374cb387ed9a4f3b0b08364f7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07flake 8 fix + add loggerMorgan Richomme7-124/+208
Change-Id: Ib8fbf0e784b57ea9be824e95fafe68e991b80aab Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-05fix bug + introduction of blacklist for scenario scoringMorgan Richomme3-42/+71
Change-Id: Ib1a99cbeeb66d4c51eedb56d25d317b92602d51d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-24change version to scenarioboucherv1-3/+4
Change-Id: I0942e9c8f23e886d6a6e344fa1fd1c24c1cd3f4b Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-06-17Bug fix on test name after name alignementMorgan Richomme2-3/+2
JIRA: FUNCTEST-304 Change-Id: Ie854b677003350a65e90279222ceb281d2f5b18c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-17fiw bug: DB and config test name alignmentMorgan Richomme1-1/+1
JIRA: FUNCTEST-304 Change-Id: I84f16d1d9be5f4cfd603ce0a27a46c4450a273e8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-17bugfix: start test timeboucherv2-3/+3
Change-Id: Ie916cc77373cbfae6e189ffeb1153400b2cc6f67 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-06-16Align test names in BD and testcase.yaml declarationMorgan Richomme3-10/+33
JIRA: FUNCTEST-304 Change-Id: I642101d88716ac634e07b66136cfdcac0c482500 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-10Adapt automatic reporting to new Test APIMorgan Richomme4-18/+20
JIRA: FUNCTEST-303 Change-Id: Ie9cb7151301ab2c26a72746683c35305ba560bbc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-31Add Tempest error in Tempest reportingMorgan Richomme2-27/+32
JIRA: FUNCTEST-150 Change-Id: I0b2a3a38bbbb11a80c761c23c71c2f45a959e477 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Forget conf file...Morgan Richomme1-0/+17
Change-Id: I85261ec5fcbe59db2e67f8347d2babb082454e14 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Adapt reporting after Functest refactoringMorgan Richomme7-285/+405
Get test cases from cases declares in Tiers Consider only Tier 0-3 to validate scenario Display results for Tier > 3 Change-Id: I581702bd7f2cc323d38b82a2404b301fb8fd7840 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04fix config path after refactoringMorgan Richomme1-1/+1
Change-Id: Idb4d9d978c89ae8bc590ca9f938b756118c5e26a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04Add global scenario reportingMorgan Richomme4-9/+68
Save date when a scenario is validated Change-Id: I0895ae56812c7059972a60bf017fdb76d40de25c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Improve code quality (flake8)Morgan Richomme1-7/+11
Change-Id: Id58236ab080bc7dd5d9d7b98c4a0fce27ee1b7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Functest reporting refactoringMorgan Richomme12-0/+872
integrate the notion of version (brahmaputra, master, ..) change dir structure Change-Id: Ieb8aed811ed4e1ab8738fb02e4db411da3d07ca2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>