summaryrefslogtreecommitdiffstats
path: root/utils/test/reporting/functest/reporting-status.py
AgeCommit message (Collapse)AuthorFilesLines
2017-08-09Initiate packetization of Testing reportingMorgan Richomme1-306/+0
Testing reporting provides - static reporting pages [1] (jinja2) - landing pages including test case catalogue [2] (angular) It consumes the Test API to build web pages providing status for the testing projects (so far functest, yardstick, storperf and qtip). Dockerization has been initiated [3]. The goal is to replace the static page hosted on testresults.opnfv.org by a docker regenerated and redeployed when reporting code is changed But the docker and more generally the testing reporting directory must be refactored to - manage dependencies properly - leverage tox (py27, docs, pylint, pep8) This patch - setups tox (py27, pep8, pylint, docs) - integrate the requirement management - fix pep8 errors - introduce 1 dummy unit test This patch does not - fix pylint errors - create any doc [1]: http://testresults.opnfv.org/reporting2/display/index.html [2]: http://testresults.opnfv.org/reporting2/reporting/index.html [3]: https://gerrit.opnfv.org/gerrit/#/c/36735/ Change-Id: I4613de7ca7036d6c6bbb8f58ade492b1d673599b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-26bug fix: consider pagination when retrieveing results for reportingMorgan Richomme1-1/+0
Due to pagination feature introduced in test API, reporting pages only considered the first page of results retrieved by the API the number of pages is now detected to aggregate the results JIRA: RELENG-259 Change-Id: I0ac90b125baf8c16341c8db22f5602fedd4cdf1b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-10Bug Fixes: remove Db name + pathMorgan Richomme1-4/+2
as case have been renamed in testcases.yaml no more need or translation name/Db name Change-Id: I0656ec478369224d44d9c3cdf0c6426f140e4029 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-09Add arm support in functest reporting pagesMorgan Richomme1-193/+214
Create different pages for installer@architectures - x86 - aarch64 JIRA: FUNCTEST-821 Change-Id: I3c4ebba3f7969f6c1a5d04c4d5b5a63db5a3e7c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-13Update reporting page for DanubeMorgan Richomme1-3/+11
- add danube in config to generate results - create new web pages for Euphrates (master) Change-Id: I11b3f37a0f6040a3d0c18820a08a9d6fb7ebe036 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-28Move from snaps_healthcheck to connection_checkMorgan Richomme1-4/+4
to retireve scenario lxd based scenarios are not running snaps_healthcheck Change-Id: I34a86b5b8d0e1dffda40e6173196eb9409c448a0 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-28Move case base from tempest_smoke_serial to snaps_healthcheckMorgan Richomme1-4/+6
It will allow to show additional scenarios in the reporting page the scenarios that fail on healthcheck or smoke tests before running tempest_smoke_serial Change-Id: I0d9ba84296bfc867ab80caa7873bb5bcb8469fc2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-14Bug Fix: tranlate build tag into jenkins urlMorgan Richomme1-3/+3
Include HEALTHCHECK Tier in the reporting Change-Id: I4a5a8aeb7564ca35c9199c7925ac344b43270d87 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-06Update on Functest reporting processingMorgan Richomme1-2/+7
- new param to exclude or not results from virtual PODs - new param to exclude or not noha results - fix path - add rally_sanity in black list until we fixed the format issue Change-Id: Ie952f7d6968a322edbcf2effffbc1a75beddc52f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-28bug Fix: adapt reporting to merge of smoke+sdn tiersMorgan Richomme1-4/+4
Change-Id: I74d9834b609797f85d52e97ccdfeab614c1c07bf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-17Refactor reporting dirMorgan Richomme1-60/+58
- dockerization - create util function for all the test projects - create a common config files - add unit tests - pep8 JIRA: RELENG-162 Change-Id: Ib209be4233084100ff238a7aeb2843ccc24a6f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18bug fix: pdf generationMorgan Richomme1-39/+42
Change-Id: Ic101411a991b4baac8e1683bc5cad924f85f05c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-10Add export functions to reportingMorgan Richomme1-8/+36
JIRA: FUNCTEST-486 Change-Id: I84ad52f12097bbc5976c754d28ebc76d49b1eff2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-29Add a trend line to Functest reportingMorgan Richomme1-1/+6
And use d3js lib rather than static images JIRA: FUNCTEST-483 Change-Id: I3c372a8e18fc366dfe510ab551596640fb6d9242 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-23Add hyperlink on scenariosMorgan Richomme1-9/+32
JIRA: FUNCTEST-482 Change-Id: Ibe19f153dc79ae1a9b78ec9eb52bb48898d63d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-09-14Add gauge metrics for Functest reporting dashboardjose.lausuch1-2/+6
JIRA: FUNCTEST-476 Change-Id: Ia39ffa8b39a1085a081d6128871cee20436e051c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-12Implements use of yaml.safe_load as per sec auditLuke Hinds1-1/+1
Change-Id: I9b8d9746e8a3beebc1aff9f883dcec39928831d7 Signed-off-by: Luke Hinds <lukehinds@gmail.com>
2016-09-08Fix security issues reported by the security auditMorgan Richomme1-1/+1
JIRA: RELENG-143 Change-Id: Ia20c6ce86e72924ab8ab5f93bdc956d7f6a40a93 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-22adapt reportingMorgan Richomme1-0/+0
- no odl-SFC test reported to DB - add link to scenario scoring wiki page - add +x on executable python files Change-Id: I6724408e3ed5d6a2ba78aff40d80d692c1e0780b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-10Fix unknown projects in reportingMorgan Richomme1-3/+6
Change-Id: Ia3d21694b8bf5e7131110124a520ecc0b9234509 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07minor bug fixesMorgan Richomme1-15/+14
Change-Id: I8ea8b03559a27374cb387ed9a4f3b0b08364f7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-07flake 8 fix + add loggerMorgan Richomme1-45/+42
Change-Id: Ib8fbf0e784b57ea9be824e95fafe68e991b80aab Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-05fix bug + introduction of blacklist for scenario scoringMorgan Richomme1-37/+55
Change-Id: Ib1a99cbeeb66d4c51eedb56d25d317b92602d51d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-17fiw bug: DB and config test name alignmentMorgan Richomme1-1/+1
JIRA: FUNCTEST-304 Change-Id: I84f16d1d9be5f4cfd603ce0a27a46c4450a273e8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-19Adapt reporting after Functest refactoringMorgan Richomme1-278/+110
Get test cases from cases declares in Tiers Consider only Tier 0-3 to validate scenario Display results for Tier > 3 Change-Id: I581702bd7f2cc323d38b82a2404b301fb8fd7840 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04fix config path after refactoringMorgan Richomme1-1/+1
Change-Id: Idb4d9d978c89ae8bc590ca9f938b756118c5e26a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-04Add global scenario reportingMorgan Richomme1-6/+58
Save date when a scenario is validated Change-Id: I0895ae56812c7059972a60bf017fdb76d40de25c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Improve code quality (flake8)Morgan Richomme1-7/+11
Change-Id: Id58236ab080bc7dd5d9d7b98c4a0fce27ee1b7ad Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-04-26Functest reporting refactoringMorgan Richomme1-0/+307
integrate the notion of version (brahmaputra, master, ..) change dir structure Change-Id: Ieb8aed811ed4e1ab8738fb02e4db411da3d07ca2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>