summaryrefslogtreecommitdiffstats
path: root/utils/test/reporting
AgeCommit message (Collapse)AuthorFilesLines
2017-08-09Initiate packetization of Testing reportingMorgan Richomme96-201/+524
Testing reporting provides - static reporting pages [1] (jinja2) - landing pages including test case catalogue [2] (angular) It consumes the Test API to build web pages providing status for the testing projects (so far functest, yardstick, storperf and qtip). Dockerization has been initiated [3]. The goal is to replace the static page hosted on testresults.opnfv.org by a docker regenerated and redeployed when reporting code is changed But the docker and more generally the testing reporting directory must be refactored to - manage dependencies properly - leverage tox (py27, docs, pylint, pep8) This patch - setups tox (py27, pep8, pylint, docs) - integrate the requirement management - fix pep8 errors - introduce 1 dummy unit test This patch does not - fix pylint errors - create any doc [1]: http://testresults.opnfv.org/reporting2/display/index.html [2]: http://testresults.opnfv.org/reporting2/reporting/index.html [3]: https://gerrit.opnfv.org/gerrit/#/c/36735/ Change-Id: I4613de7ca7036d6c6bbb8f58ade492b1d673599b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-07-06Reporting docker deployment improvementchenjiankun9-333/+365
In the patch, I make build pages(landing page ...), when docker build, when run a container, we can set the api url(default:testresults.opnfv.org/reporting2) by -e; For example: 1. In testresults.opnfv.org: docker run -itd -p 8888:8000 -p 80:80 opnfv/reporting:tag visit: http://testresults.opnfv.org/reporting2/reporting/index.html 2. Personal use: docker run -itd -p 8888:8000 -p 80:80 -e SERVER_URL=192.168.131.2:8888 opnfv/reporting:tag visit: http://192.168.131.2:8888/reporting/index.html Change-Id: Ib838c12e785151acf9852f25eab254aedc520a1d Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-07-04Merge "Add jenkins jobs for automatic reporting dashboard deployment"Jose Lausuch3-43/+45
2017-07-02Add jenkins jobs for automatic reporting dashboard deploymentrohitsakala3-43/+45
Jenkins Jobs have been added for automating the deployment of the reporting dashboard. Also multijob has been added for automating the update of docker in the docker hub and generating docs which is empty for now. Modified unit tests of reporting to make it run from any directory. Modified the testapi jenkins jobs yaml file to generic so that many other modules which may have the same usecases can be integrated easily just like the reporting one that is done now. Change-Id: Id13a55416e17199dae1dd6ce64f7c167d117ba37 Signed-off-by: Sakala Venkata Krishna Rohit <rohitsakala@gmail.com>
2017-06-27bug fix: typo in bottlenecks naming (reporting page)Morgan Richomme2-3/+3
Change-Id: Ifb2047e688117c7c9af33031467f2025d530f187 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-26bug fix: consider pagination when retrieveing results for reportingMorgan Richomme2-10/+18
Due to pagination feature introduced in test API, reporting pages only considered the first page of results retrieved by the API the number of pages is now detected to aggregate the results JIRA: RELENG-259 Change-Id: I0ac90b125baf8c16341c8db22f5602fedd4cdf1b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-21bug fix: bad format for start/time in Tempest reportingMorgan Richomme1-1/+18
Change-Id: Ic9792023b9041dbe8081ff9840caa2cf2901b189 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-06Merge "Change to 'catalog_description' in Catalogue page"Morgan Richomme6-18/+41
2017-06-02Change to 'catalog_description' in Catalogue pagechenjiankun6-18/+41
JIRA: RELENG-231 Change-Id: Id0b770575c0d91a58b3503f8580bd658337b2cd0 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-05-25Updating the license with Creative Commons Attribution 4.0 with SPDX shorthandRay Paik2-4/+4
Change-Id: Iff8ada7637648a320fc7ef4a0fb3e187186964e5 Signed-off-by: Ray Paik <rpaik@linuxfoundation.org>
2017-05-11big fixes: wrong pathMorgan Richomme2-5/+4
- remove link to daisy for storperf results - fix yardstick installer page links Change-Id: Idae2163862c681db05cfc24c5c29eaea793d3c88 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-10Merge "Bug Fixes: remove Db name + path"Morgan Richomme4-60/+15
2017-05-10Bug Fixes: remove Db name + pathMorgan Richomme4-60/+15
as case have been renamed in testcases.yaml no more need or translation name/Db name Change-Id: I0656ec478369224d44d9c3cdf0c6426f140e4029 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-10Merge "add qtip reporting"Morgan Richomme8-0/+380
2017-05-09Add arm support in functest reporting pagesMorgan Richomme4-209/+266
Create different pages for installer@architectures - x86 - aarch64 JIRA: FUNCTEST-821 Change-Id: I3c4ebba3f7969f6c1a5d04c4d5b5a63db5a3e7c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-08add qtip reportingSerenaFeng8-0/+380
Change-Id: Ie573486080fbd36857ff0709d53f6bdcdd43363e Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-04-03Change Danube image for reportingMorgan Richomme1-0/+0
to be sync with communication Change-Id: I7747416ab73f85d979d405afd9b87d57faac2bf0 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-28Merge "Create Catalogue page"Morgan Richomme46-18329/+901
2017-03-27Add and insert new project iconsMorgan Richomme27-8/+53
Change-Id: I4334bca1ab02a5d26b84b934cb718b3753ce0a13 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-25Create Catalogue pagechenjiankun46-18329/+901
JIRA: RELENG-193 1.create a page to list all project. 2.This page can get test case list of certain project. 3.This page can show information of certain test case. Change-Id: I79e0d3aafa99c054865a0d2948b99918802f32a7 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-20Merge "Add new testcases in reporting page"Morgan Richomme1-0/+12
2017-03-17Merge "utils: fix yamllint issues"Jun Li1-9/+10
2017-03-16Add new testcases in reporting pageMorgan Richomme1-0/+12
- FDS - Refstack - opera_ims - vyos-vrouter Change-Id: I42a323a1f466b0ba11e61bb287b8b283e4759c09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-15Merge "Update reporting page for Danube"Morgan Richomme9-364/+635
2017-03-14utils: fix yamllint issuesJessica Wagantall1-9/+10
Linting utils/test yaml files Change-Id: Id239cb2e2b2c4658dedfc187b7784b0302701700 Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
2017-03-13Update reporting page for DanubeMorgan Richomme9-364/+635
- add danube in config to generate results - create new web pages for Euphrates (master) Change-Id: I11b3f37a0f6040a3d0c18820a08a9d6fb7ebe036 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-07Merge "bug fix: last 4 run reporting for storperf"Morgan Richomme3-13/+34
2017-03-07bug fix: last 4 run reporting for storperfMorgan Richomme3-13/+34
- bug fix: copy/paste of yardstick code but list of results is not sorted by default, taking the last 4 array items lead to random results on the 4 last run sort results before taking the last 4 results to establish last 4 run criteria - enhancement: add link to last CI run in the reporting page - fix trend line bug Change-Id: Ice16832a81cb65503a63b16321a2be92a427d279 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-03Create Test Reporting landing pagechenjiankun22-726/+805
JIRA: RELENG-165 In this patch, I upload the backend code usage: docker run -itd -p 8000:8000 -e SERVER_URL=server_ip:8000 opnfv/reporting:<tag> note: must point SERVER_URL, it is the api server. visit landing page: http://server_ip:8000/reporting/index.html Change-Id: I10121574e0c4b2733a8084c986d7a2746e7ce2a4 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-02-28Move from snaps_healthcheck to connection_checkMorgan Richomme1-4/+4
to retireve scenario lxd based scenarios are not running snaps_healthcheck Change-Id: I34a86b5b8d0e1dffda40e6173196eb9409c448a0 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-28Move case base from tempest_smoke_serial to snaps_healthcheckMorgan Richomme3-9/+11
It will allow to show additional scenarios in the reporting page the scenarios that fail on healthcheck or smoke tests before running tempest_smoke_serial Change-Id: I0d9ba84296bfc867ab80caa7873bb5bcb8469fc2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-27[Functest] Add Tempest Defcore test to the dashboardjose.lausuch1-0/+2
Change-Id: Id2292198d1e34a2de1d2b9ccdda83f565f771df1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Add storperf reportign status pageMorgan Richomme9-4/+277
Create associated static storperf page Prepare vsperf, qtip, bottlenecks Put Yardstick scenario class into utils directory Change-Id: I874d1733fe3f37dc5dd557559478e7e0b25371d7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-22Add Netready and Barometer tests to the reporting dashboardjose.lausuch1-3/+6
Change-Id: Idc09d3461ee5af09625aba3cf2219b64318145c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-14Bug Fix: tranlate build tag into jenkins urlMorgan Richomme4-7/+18
Include HEALTHCHECK Tier in the reporting Change-Id: I4a5a8aeb7564ca35c9199c7925ac344b43270d87 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-14Fix flake8 violations in relengjose.lausuch4-37/+36
Change-Id: I45769ff9c9db2de9fbba69117a92de414dd7f651 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-06Update on Functest reporting processingMorgan Richomme3-11/+27
- new param to exclude or not results from virtual PODs - new param to exclude or not noha results - fix path - add rally_sanity in black list until we fixed the format issue Change-Id: Ie952f7d6968a322edbcf2effffbc1a75beddc52f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-10Add Daisy for reportingMorgan Richomme4-0/+4
Change-Id: Ie9d6d5e351e5d673252f08ed304d4fef96a1e00b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-30Create Test Reporting landing pagechenjiankun47-1/+20488
JIRA: RELENG-165 In this patch, I do the follow things: 1.deploy tornado server(currently I haven't write any backend code, since the backend code depend on the testapi and I need to communicate with Serena). 2.landing page code(almostly finished. But I haven't the data, so for now, the data this page shows is a mock json. When the testapi and my backend code ready, this page will finally finished) 3.deployment: supervisor + nginx + tornado + angular usage: docker run -itd -p 8000:8000 opnfv/reporting:<tag> visit landing page: http://server_ip:8000/reporting/index.html test api: http://server_ip:8000/landing-page/filters visit old reporting page: http://server_ip:8000/display/master/yardstick/status-apex.html Change-Id: I527ab2661ce9e84b2942ebe673afbf5f2bc7878f Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-12-18Add SNAPS for reportingMorgan Richomme1-15/+21
Change-Id: If61bbd435cd9858924e850bcc959f9596579c205 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-16Bugfix: reporting docker image build failedchenjiankun4-12/+13
JIRA: RELENG-181 Since we just decide to use dynamic server, we need to deploy a dynamic server such as tornado . But when I use the Dockerfile to build image, it failed due to some reasons. So I need fix it first and then deploy the dynamic server. Then we can use this command: docker run -it -d -p 8080:80 opnfv/releng:latest And visit reporting page by http://server_ip:8080/display/... Change-Id: Id04575c7b38e4c07625ce217d23ebca1c5bf0191 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-11-28bug Fix: adapt reporting to merge of smoke+sdn tiersMorgan Richomme1-4/+4
Change-Id: I74d9834b609797f85d52e97ccdfeab614c1c07bf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-17Merge "Correct SFC testcase match in the reporting Dashboard"Morgan Richomme1-1/+1
2016-11-17Correct SFC testcase match in the reporting Dashboardjose.lausuch1-3/+3
The test is specified as odl-sfc, but in the DB we have functest-odl-sfc. http://testresults.opnfv.org/test/api/v1/results?case_name=functest-odl-sfc Change-Id: Ie8c0ed60df3b11fc4d74c26796ae7a19d63c22b7 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-11-17Refactor reporting dirMorgan Richomme112-611/+897
- dockerization - create util function for all the test projects - create a common config files - add unit tests - pep8 JIRA: RELENG-162 Change-Id: Ib209be4233084100ff238a7aeb2843ccc24a6f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-18bug fix: pdf generationMorgan Richomme2-39/+50
Change-Id: Ic101411a991b4baac8e1683bc5cad924f85f05c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-12Add d3 graph presentation to yardstick reportingchenjiankum4-30/+111
JIRA: YARDSTICK-367 Change-Id: Ifa2cca1bdfc7d94a84758019d0b1693e09b46e47 Signed-off-by: chenjiankum <chenjiankun1@huawei.com>
2016-10-11Merge "Add export functions to reporting"Morgan Richomme3-8/+123
2016-10-10Add export functions to reportingMorgan Richomme3-8/+123
JIRA: FUNCTEST-486 Change-Id: I84ad52f12097bbc5976c754d28ebc76d49b1eff2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-06create nice reporting landing pagesMorgan Richomme69-0/+8811
Change-Id: I91f897f7be9112e8abc71069bff2882a75bc40cf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>