summaryrefslogtreecommitdiffstats
path: root/utils/test/reporting
AgeCommit message (Collapse)AuthorFilesLines
2017-10-11Merge "Add fuel@x86 and fuel@arm support"Morgan Richomme3-118/+166
2017-10-11Add fuel@x86 and fuel@arm supportchenjiankun3-118/+166
Since scenario data do not have a field named architecture, So I choose pod_name for now. For example: pod_name: arm-pod5 I assume that it is based arm architecture Change-Id: I92159a5e08b1ed80701494483fd9922dbd459193 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-10-07Change score calculation for functest reportingMorgan Richomme1-5/+19
the goal is not to penalize scenario with few iteration due to CI pipeline constraints until now the top score was calculated on the base on 4 iterations, it means whatever the number of iterations, we always consider the possible top score based on at least 4 iterations each case can get - 3 points (last 4 iterations PASS) - 2 points (more than 1 PASS over the last 10 days but 1 FAIL of the last 4) - 1 point (at least 1 PASS over the last 10 days) - no point (never work) so if we consider a scenario with 10 cases, the top score is 30 = 10*3 (max points) the coefficient to calculate the top score is not the number of iterations - 1 iteration => possible top score 10 - 2 iterations => top score 20 - 3 iterations => top score 20 - 4 or more iterations => top score 30 previously top score was systematically 30 https://wiki.opnfv.org/plugins/servlet/mobile#content/view/6828617 Change-Id: I01102bc00766b7f5b58e73befa7d5328fcc895cc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-30Fix status reporting pageYujun Zhang4-19/+12
- use data in last 10 days instead of 1 day - hide installers without any data - remove redundant qtip reporting Change-Id: If73a439572b6a1cf09c7d34f643fb14be82196ca Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-09-29Merge "Fix Bottlenecks status page cann't be shown."Morgan Richomme1-1/+5
2017-09-29Change Euphrates imageMorgan Richomme2-3/+3
minor pylint fix in functest/reporting-status Change-Id: Ibfd4f0da1475c34c40a3d9e00530f8f15eb3c7dc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-29Fix Bottlenecks status page cann't be shown.liyin1-1/+5
Change-Id: Ia1ad4c0654ad2dea7fdb61b81725af9aaafc4750 Signed-off-by: liyin <liyin11@huawei.com>
2017-09-26reporting adoption for Euphrateschenjiankun4-4/+4
Danube -> Euphrates in euphrates.html add euphrates dir fix CONFIG_REPORTING_YAML value fix import error in scenario.py Change-Id: Ic0457bf8d1c67bd21ef6a31564792eb98cfca9ad Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-09-25Merge "cloudify_ims reporting fixes"Morgan Richomme4-164/+182
2017-09-22cloudify_ims reporting fixesMorgan Richomme4-164/+182
+ minor fixes * unknown => real test case names * pylint corrections Change-Id: I75446e4006d41fe1bb25106420910025afa01489 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-20Bugfix: Change http_pass to proxy_passchenjiankun1-1/+1
http_pass is wrong for nginx, we need to change it to proxy_pass Change-Id: Ib679b36a4a139c02647564719e1cfc49a9f376a2 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-09-18Add Euphrates pages for reportingMorgan Richomme6-23/+267
Change-Id: Iee4c54801d839be949495360141d4ae9353e5ecc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-11Change nginx configurationchenjiankun2-4/+4
Since landing page have changed from reporting2 to testing, the nginx configuration need some adoption. If the pre url change again, we need to config the base_url when start our docker container. For example: docker run -itd -p 8084:8000 -e SERVER_URL testresults.opnfv.org/xxx/api opnfv/reporting:latest Change-Id: If3c9f9af76fcfc8047b5b9559fcc8bd45740d4d2 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-09-07Add bottlenecks to reportingMorgan Richomme5-2/+265
very basic approach based on 1 case posca_factor_ping Give a feedback on the CI activity of bottlenecks Change-Id: Iaa84abac6b00ba48a771250433a9f9a068de453f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-04Add 2 files forgotten in previous commit for vsperf integrationMorgan Richomme2-0/+138
Change-Id: Ibfd36814ac09d16ba4b3d365e04bf3b39a1ef7db Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-04Add vsperf in reportingMorgan Richomme6-110/+282
fix some pep8 errors in other projects Change-Id: Iea68b0d495f7fbe892ec866fb70b8354ad9ff3c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-31bug fix: reporting TempestMorgan Richomme1-42/+50
not updated since Colorado and data model changed - minor fixes to match data model - pep8/pylint correction Change-Id: I3a0a9ea689d25b3cfff35cb1ec39329981627bc6 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-28bug fix for qtip reportingMorgan Richomme2-6/+6
- fix right path (version duplicated in path) - fix template for nav links in qtip reporting page Change-Id: I7e14bea3feb5e6fad694e2837b3048b9cd8d5825 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-25Split HA and NOHA scenarios into 2 tables in reportingMorgan Richomme1-2/+27
the goal is to vizualize more quickly the HA and NOHA scenario Note that if no scenario is available, the table title is displayed Change-Id: Ibdade30aadf40fe4f7b9bfe547d23c186cb3e1df Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-24bug fix: installation of node, bower and grunt for reporting dockerMorgan Richomme3-7/+13
- change node installation process - clean setup (no need of pbr) Change-Id: I9015486e3892e7c949bad5140cc4180ec9f07aa7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-21Landing page adoptionchenjiankun4-370/+244
Since testapi have done some changes on scenarios api, so landing page should do some adoption. Change-Id: Ib5d1df03e2c50c7d6c038200d97f2057b90e48af Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-08-16Merge "Bug fix: generate fuel reporting page when no aarch64 available"Morgan Richomme1-1/+1
2017-08-11Bug fix: generate fuel reporting page when no aarch64 availableMorgan Richomme1-1/+1
In fuel we may deal with x86 or aarch64 architecture We generate dedicated reporting page - fuel@x86 - fuel@aarch64 However when there is no results for one of the architecture the test on the number of architecture lead to a bug Change-Id: I9906bd6078c8493587dc667eb23399a1e8311e77 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-11Add daisy to reportingMorgan Richomme2-0/+2
Change-Id: I5fd940b8c1be1c327cfcd481c27049f94ae2f175 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-09Initiate packetization of Testing reportingMorgan Richomme96-201/+524
Testing reporting provides - static reporting pages [1] (jinja2) - landing pages including test case catalogue [2] (angular) It consumes the Test API to build web pages providing status for the testing projects (so far functest, yardstick, storperf and qtip). Dockerization has been initiated [3]. The goal is to replace the static page hosted on testresults.opnfv.org by a docker regenerated and redeployed when reporting code is changed But the docker and more generally the testing reporting directory must be refactored to - manage dependencies properly - leverage tox (py27, docs, pylint, pep8) This patch - setups tox (py27, pep8, pylint, docs) - integrate the requirement management - fix pep8 errors - introduce 1 dummy unit test This patch does not - fix pylint errors - create any doc [1]: http://testresults.opnfv.org/reporting2/display/index.html [2]: http://testresults.opnfv.org/reporting2/reporting/index.html [3]: https://gerrit.opnfv.org/gerrit/#/c/36735/ Change-Id: I4613de7ca7036d6c6bbb8f58ade492b1d673599b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-07-06Reporting docker deployment improvementchenjiankun9-333/+365
In the patch, I make build pages(landing page ...), when docker build, when run a container, we can set the api url(default:testresults.opnfv.org/reporting2) by -e; For example: 1. In testresults.opnfv.org: docker run -itd -p 8888:8000 -p 80:80 opnfv/reporting:tag visit: http://testresults.opnfv.org/reporting2/reporting/index.html 2. Personal use: docker run -itd -p 8888:8000 -p 80:80 -e SERVER_URL=192.168.131.2:8888 opnfv/reporting:tag visit: http://192.168.131.2:8888/reporting/index.html Change-Id: Ib838c12e785151acf9852f25eab254aedc520a1d Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-07-04Merge "Add jenkins jobs for automatic reporting dashboard deployment"Jose Lausuch3-43/+45
2017-07-02Add jenkins jobs for automatic reporting dashboard deploymentrohitsakala3-43/+45
Jenkins Jobs have been added for automating the deployment of the reporting dashboard. Also multijob has been added for automating the update of docker in the docker hub and generating docs which is empty for now. Modified unit tests of reporting to make it run from any directory. Modified the testapi jenkins jobs yaml file to generic so that many other modules which may have the same usecases can be integrated easily just like the reporting one that is done now. Change-Id: Id13a55416e17199dae1dd6ce64f7c167d117ba37 Signed-off-by: Sakala Venkata Krishna Rohit <rohitsakala@gmail.com>
2017-06-27bug fix: typo in bottlenecks naming (reporting page)Morgan Richomme2-3/+3
Change-Id: Ifb2047e688117c7c9af33031467f2025d530f187 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-26bug fix: consider pagination when retrieveing results for reportingMorgan Richomme2-10/+18
Due to pagination feature introduced in test API, reporting pages only considered the first page of results retrieved by the API the number of pages is now detected to aggregate the results JIRA: RELENG-259 Change-Id: I0ac90b125baf8c16341c8db22f5602fedd4cdf1b Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-21bug fix: bad format for start/time in Tempest reportingMorgan Richomme1-1/+18
Change-Id: Ic9792023b9041dbe8081ff9840caa2cf2901b189 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-06Merge "Change to 'catalog_description' in Catalogue page"Morgan Richomme6-18/+41
2017-06-02Change to 'catalog_description' in Catalogue pagechenjiankun6-18/+41
JIRA: RELENG-231 Change-Id: Id0b770575c0d91a58b3503f8580bd658337b2cd0 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-05-25Updating the license with Creative Commons Attribution 4.0 with SPDX shorthandRay Paik2-4/+4
Change-Id: Iff8ada7637648a320fc7ef4a0fb3e187186964e5 Signed-off-by: Ray Paik <rpaik@linuxfoundation.org>
2017-05-11big fixes: wrong pathMorgan Richomme2-5/+4
- remove link to daisy for storperf results - fix yardstick installer page links Change-Id: Idae2163862c681db05cfc24c5c29eaea793d3c88 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-10Merge "Bug Fixes: remove Db name + path"Morgan Richomme4-60/+15
2017-05-10Bug Fixes: remove Db name + pathMorgan Richomme4-60/+15
as case have been renamed in testcases.yaml no more need or translation name/Db name Change-Id: I0656ec478369224d44d9c3cdf0c6426f140e4029 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-10Merge "add qtip reporting"Morgan Richomme8-0/+380
2017-05-09Add arm support in functest reporting pagesMorgan Richomme4-209/+266
Create different pages for installer@architectures - x86 - aarch64 JIRA: FUNCTEST-821 Change-Id: I3c4ebba3f7969f6c1a5d04c4d5b5a63db5a3e7c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-08add qtip reportingSerenaFeng8-0/+380
Change-Id: Ie573486080fbd36857ff0709d53f6bdcdd43363e Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-04-03Change Danube image for reportingMorgan Richomme1-0/+0
to be sync with communication Change-Id: I7747416ab73f85d979d405afd9b87d57faac2bf0 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-28Merge "Create Catalogue page"Morgan Richomme46-18329/+901
2017-03-27Add and insert new project iconsMorgan Richomme27-8/+53
Change-Id: I4334bca1ab02a5d26b84b934cb718b3753ce0a13 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-25Create Catalogue pagechenjiankun46-18329/+901
JIRA: RELENG-193 1.create a page to list all project. 2.This page can get test case list of certain project. 3.This page can show information of certain test case. Change-Id: I79e0d3aafa99c054865a0d2948b99918802f32a7 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-03-20Merge "Add new testcases in reporting page"Morgan Richomme1-0/+12
2017-03-17Merge "utils: fix yamllint issues"Jun Li1-9/+10
2017-03-16Add new testcases in reporting pageMorgan Richomme1-0/+12
- FDS - Refstack - opera_ims - vyos-vrouter Change-Id: I42a323a1f466b0ba11e61bb287b8b283e4759c09 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-15Merge "Update reporting page for Danube"Morgan Richomme9-364/+635
2017-03-14utils: fix yamllint issuesJessica Wagantall1-9/+10
Linting utils/test yaml files Change-Id: Id239cb2e2b2c4658dedfc187b7784b0302701700 Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
2017-03-13Update reporting page for DanubeMorgan Richomme9-364/+635
- add danube in config to generate results - create new web pages for Euphrates (master) Change-Id: I11b3f37a0f6040a3d0c18820a08a9d6fb7ebe036 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>