summaryrefslogtreecommitdiffstats
path: root/utils/test/reporting/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-06-26bug fix: consider pagination when retrieveing results for reportingMorgan Richomme1-1/+0
Due to pagination feature introduced in test API, reporting pages only considered the first page of results retrieved by the API the number of pages is now detected to aggregate the results JIRA: RELENG-259 Change-Id: I0ac90b125baf8c16341c8db22f5602fedd4cdf1b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-21bug fix: bad format for start/time in Tempest reportingMorgan Richomme1-1/+18
Change-Id: Ic9792023b9041dbe8081ff9840caa2cf2901b189 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-10Bug Fixes: remove Db name + pathMorgan Richomme3-59/+14
as case have been renamed in testcases.yaml no more need or translation name/Db name Change-Id: I0656ec478369224d44d9c3cdf0c6426f140e4029 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-09Add arm support in functest reporting pagesMorgan Richomme2-204/+225
Create different pages for installer@architectures - x86 - aarch64 JIRA: FUNCTEST-821 Change-Id: I3c4ebba3f7969f6c1a5d04c4d5b5a63db5a3e7c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-16Add new testcases in reporting pageMorgan Richomme1-0/+12
- FDS - Refstack - opera_ims - vyos-vrouter Change-Id: I42a323a1f466b0ba11e61bb287b8b283e4759c09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-13Update reporting page for DanubeMorgan Richomme1-3/+11
- add danube in config to generate results - create new web pages for Euphrates (master) Change-Id: I11b3f37a0f6040a3d0c18820a08a9d6fb7ebe036 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-28Move from snaps_healthcheck to connection_checkMorgan Richomme1-4/+4
to retireve scenario lxd based scenarios are not running snaps_healthcheck Change-Id: I34a86b5b8d0e1dffda40e6173196eb9409c448a0 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-28Move case base from tempest_smoke_serial to snaps_healthcheckMorgan Richomme2-8/+10
It will allow to show additional scenarios in the reporting page the scenarios that fail on healthcheck or smoke tests before running tempest_smoke_serial Change-Id: I0d9ba84296bfc867ab80caa7873bb5bcb8469fc2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-27[Functest] Add Tempest Defcore test to the dashboardjose.lausuch1-0/+2
Change-Id: Id2292198d1e34a2de1d2b9ccdda83f565f771df1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-22Add Netready and Barometer tests to the reporting dashboardjose.lausuch1-3/+6
Change-Id: Idc09d3461ee5af09625aba3cf2219b64318145c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-14Bug Fix: tranlate build tag into jenkins urlMorgan Richomme2-5/+7
Include HEALTHCHECK Tier in the reporting Change-Id: I4a5a8aeb7564ca35c9199c7925ac344b43270d87 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-14Fix flake8 violations in relengjose.lausuch3-23/+22
Change-Id: I45769ff9c9db2de9fbba69117a92de414dd7f651 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-06Update on Functest reporting processingMorgan Richomme1-2/+7
- new param to exclude or not results from virtual PODs - new param to exclude or not noha results - fix path - add rally_sanity in black list until we fixed the format issue Change-Id: Ie952f7d6968a322edbcf2effffbc1a75beddc52f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-10Add Daisy for reportingMorgan Richomme3-0/+3
Change-Id: Ie9d6d5e351e5d673252f08ed304d4fef96a1e00b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-18Add SNAPS for reportingMorgan Richomme1-15/+21
Change-Id: If61bbd435cd9858924e850bcc959f9596579c205 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-28bug Fix: adapt reporting to merge of smoke+sdn tiersMorgan Richomme1-4/+4
Change-Id: I74d9834b609797f85d52e97ccdfeab614c1c07bf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-17Merge "Correct SFC testcase match in the reporting Dashboard"Morgan Richomme1-1/+1
2016-11-17Correct SFC testcase match in the reporting Dashboardjose.lausuch1-3/+3
The test is specified as odl-sfc, but in the DB we have functest-odl-sfc. http://testresults.opnfv.org/test/api/v1/results?case_name=functest-odl-sfc Change-Id: Ie8c0ed60df3b11fc4d74c26796ae7a19d63c22b7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-11-17Refactor reporting dirMorgan Richomme9-328/+128
- dockerization - create util function for all the test projects - create a common config files - add unit tests - pep8 JIRA: RELENG-162 Change-Id: Ib209be4233084100ff238a7aeb2843ccc24a6f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18bug fix: pdf generationMorgan Richomme2-39/+50
Change-Id: Ic101411a991b4baac8e1683bc5cad924f85f05c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-10Add export functions to reportingMorgan Richomme2-8/+39
JIRA: FUNCTEST-486 Change-Id: I84ad52f12097bbc5976c754d28ebc76d49b1eff2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-29Add a trend line to Functest reportingMorgan Richomme4-115/+66
And use d3js lib rather than static images JIRA: FUNCTEST-483 Change-Id: I3c372a8e18fc366dfe510ab551596640fb6d9242 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-23Add hyperlink on scenariosMorgan Richomme5-16/+61
JIRA: FUNCTEST-482 Change-Id: Ibe19f153dc79ae1a9b78ec9eb52bb48898d63d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-14Add gauge metrics for Functest reporting dashboardjose.lausuch16-11/+42
JIRA: FUNCTEST-476 Change-Id: Ia39ffa8b39a1085a081d6128871cee20436e051c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-12Implements use of yaml.safe_load as per sec auditLuke Hinds1-1/+1
Change-Id: I9b8d9746e8a3beebc1aff9f883dcec39928831d7 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-09-08Fix security issues reported by the security auditMorgan Richomme5-8/+8
JIRA: RELENG-143 Change-Id: Ia20c6ce86e72924ab8ab5f93bdc956d7f6a40a93 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-01Fix test results dashboard homepage navbar linksDaniel Farrell1-4/+5
The previous versions were the wrong paths, 404'd. Change-Id: I9368db672a18b5bb0394cfacf016cd7f5821d886 Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
2016-08-25Add colorado reporting for tempest and vimsMorgan Richomme6-180/+190
Change-Id: I978799cd1cd777b5033e55a0146c41865e9c2bf5 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-22adapt reportingMorgan Richomme5-2/+2
- no odl-SFC test reported to DB - add link to scenario scoring wiki page - add +x on executable python files Change-Id: I6724408e3ed5d6a2ba78aff40d80d692c1e0780b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-17Add parser in automatic reportingMorgan Richomme1-2/+4
Change-Id: I3d9c09b0da471e03647c09e96ca8b7ec89afb300 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-12Add copper in reportingMorgan Richomme2-3/+3
JIRA: FUNCTEST-67 Change-Id: I4881b2ba0c20a65567a59fb9fc7645c438a341ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-10Fix unknown projects in reportingMorgan Richomme3-10/+20
Change-Id: Ia3d21694b8bf5e7131110124a520ecc0b9234509 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07minor bug fixesMorgan Richomme2-21/+18
Change-Id: I8ea8b03559a27374cb387ed9a4f3b0b08364f7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07flake 8 fix + add loggerMorgan Richomme7-124/+208
Change-Id: Ib8fbf0e784b57ea9be824e95fafe68e991b80aab Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-05fix bug + introduction of blacklist for scenario scoringMorgan Richomme3-42/+71
Change-Id: Ib1a99cbeeb66d4c51eedb56d25d317b92602d51d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-24change version to scenarioboucherv1-3/+4
Change-Id: I0942e9c8f23e886d6a6e344fa1fd1c24c1cd3f4b Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-06-17Bug fix on test name after name alignementMorgan Richomme2-3/+2
JIRA: FUNCTEST-304 Change-Id: Ie854b677003350a65e90279222ceb281d2f5b18c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-17fiw bug: DB and config test name alignmentMorgan Richomme1-1/+1
JIRA: FUNCTEST-304 Change-Id: I84f16d1d9be5f4cfd603ce0a27a46c4450a273e8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-17bugfix: start test timeboucherv2-3/+3
Change-Id: Ie916cc77373cbfae6e189ffeb1153400b2cc6f67 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-06-16Align test names in BD and testcase.yaml declarationMorgan Richomme3-10/+33
JIRA: FUNCTEST-304 Change-Id: I642101d88716ac634e07b66136cfdcac0c482500 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-10Adapt automatic reporting to new Test APIMorgan Richomme4-18/+20
JIRA: FUNCTEST-303 Change-Id: Ie9cb7151301ab2c26a72746683c35305ba560bbc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-31Add Tempest error in Tempest reportingMorgan Richomme2-27/+32
JIRA: FUNCTEST-150 Change-Id: I0b2a3a38bbbb11a80c761c23c71c2f45a959e477 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Forget conf file...Morgan Richomme1-0/+17
Change-Id: I85261ec5fcbe59db2e67f8347d2babb082454e14 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Adapt reporting after Functest refactoringMorgan Richomme7-285/+405
Get test cases from cases declares in Tiers Consider only Tier 0-3 to validate scenario Display results for Tier > 3 Change-Id: I581702bd7f2cc323d38b82a2404b301fb8fd7840 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04fix config path after refactoringMorgan Richomme1-1/+1
Change-Id: Idb4d9d978c89ae8bc590ca9f938b756118c5e26a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04Add global scenario reportingMorgan Richomme4-9/+68
Save date when a scenario is validated Change-Id: I0895ae56812c7059972a60bf017fdb76d40de25c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Improve code quality (flake8)Morgan Richomme1-7/+11
Change-Id: Id58236ab080bc7dd5d9d7b98c4a0fce27ee1b7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Functest reporting refactoringMorgan Richomme12-0/+872
integrate the notion of version (brahmaputra, master, ..) change dir structure Change-Id: Ieb8aed811ed4e1ab8738fb02e4db411da3d07ca2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>