summaryrefslogtreecommitdiffstats
path: root/reporting
AgeCommit message (Collapse)AuthorFilesLines
2018-10-18Create Gambia Testresults PagesTrevor Bramwell8-13/+154
This change add the Gambia page to the testresults dashboard. JIRA: RELENG-412 Change-Id: Id1ee651b9f3658adeff342c39e030dc248bf6747 Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
2018-09-19Merge "Add testing gating reporting page"Morgan Richomme14-8/+495
2018-09-12Merge "Fix reporting pages for functest"Morgan Richomme6-110/+88
2018-08-29Fix reporting pages for functestmrichomme6-110/+88
- adapt existing framework to new testcases.yaml format (dependencies) - simplify Tier management - unblacklist juju_epc - add new testcases Change-Id: I085bff327f9eca856879616215dc6bae83435e7c Signed-off-by: mrichomme <morgan.richomme@orange.com>
2018-08-23bugfix-reporing: vsperf master page is not renderedSerenaFeng1-1/+1
Change-Id: I7433aa4ccd55c167ce5b3d1bb396a6bd4df2fdda Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2018-07-10Adjust testcases for reporting pagemrichomme1-0/+4
include * tempest_smoke * rally_smoke * vmtp * cloudify Change-Id: I691cda65367ee7115bdea0d0b31a64cd176755ce Signed-off-by: mrichomme <morgan.richomme@orange.com>
2018-06-26reporting page updatemrichomme2-34/+46
* Add new testcases in Master (possible to black list for reporting if needed) * use the version to get the list of testcases according to the version Change-Id: I7999e66c18ebd73db896d0e27bde9a4a3d67f297 Signed-off-by: mrichomme <morgan.richomme@orange.com>
2018-04-26Bottlenecks reproting fraser release adaptionchenjiankun1-5/+1
In E release, bottlenecks upload results with version like 'stable/euphrates', but in F release, the version change to 'fraser', so need some adaption. Change-Id: I7c58ef026202a53193906eca0b62a50f643abd52 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-04-25Merge "bugfix: testcase weather show incorrect"Serena Feng1-1/+1
2018-04-24fix CC-BY-3.0 licenseSerenaFeng10-1/+1
Change-Id: I154e53b115b3eae84a99f3348ed9a8146425d1c2 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2018-04-24bugfix: testcase weather show incorrectSerenaFeng1-1/+1
if no order >= 2 tier exist, test case weather is not generated if order >= 2 tier not the last one, test case weather will lose the test cases which come after order >= 2 tier Change-Id: Idb78926db773b161df1ba74f26429f5f6b764afb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2018-04-21Add testing gating reporting pagechenjiankun14-8/+495
Change-Id: I9f46d684a11b7999defffe983fc3224ef1a50412 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-04-16change gauge colormrichomme1-1/+3
Change-Id: I2bbd2b1113d7fea8773e93c49260a9e5fda2c09c Signed-off-by: mrichomme <morgan.richomme@orange.com>
2018-04-12Add 3 test cases descriptions for reportingmrichomme1-1/+4
* Patrole * Juju EPC * Neutron Trunk without description they are displayed as unknown Change-Id: Ic4db1325fdcfc661f67c49cdd9498e242a213b8a Signed-off-by: mrichomme <morgan.richomme@orange.com>
2018-04-10Generate yardstick reporting page even if there are no datachenjiankun1-2/+1
For now, if there no data for fraser, then it will not generate the reporting page. We need to generate it even if there are no data. Change-Id: I292a1118a578ceb5e809528c68d1d88252a85c1f Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2018-04-09Minor fix for Fraser reportingmrichomme14-534/+45
* put functest pages under functest directory (nomore at root) * fix tempest reporting (change of data model for the results) * remove colorado and danube Change-Id: I9fdb3a8cf6f0d12668467bb8bccea4bd57436e50 Signed-off-by: mrichomme <morgan.richomme@orange.com>
2018-03-27Adding fraser version in reportingValentin Boucher7-3/+264
Change-Id: Id7c95cd27332ff6c9f7d2e44738887d4ee794c70 Signed-off-by: Valentin Boucher <valentin.boucher@kontron.com>
2018-02-26add reporting page for qtip's fuel installerSerenaFeng1-1/+1
Change-Id: I33ad2bcb19e5dac01e6f1197924318aa49da5db2 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2018-01-19Merge "Add new reporting page for Vsperf"Serena Feng7-157/+144
2018-01-10integrate daisy with yardstickSerenaFeng1-0/+1
Change-Id: I2553afdcc6515494c0a198cfa4091f1b214fe3f1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2018-01-10reporting leveraging the new repo releng-testresultsSerenaFeng5-9/+9
Change-Id: I8dd00f3ef996c8847d803b690423bf381676e49d Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-12-15Add new reporting page for Vsperfchenjiankun7-157/+144
Vsperf do not follow OPNFV version/installer/scenario. So we need develop a specific version. In this patch, we do the follow change: 1. Get version from build_tag. 2. Remove installer for page. 3. Use case_name as primary key 4. Show the last 50 days for Vsperf job does not run frequently. Change-Id: I6af50b5fcceadfcc0b66a0d9b45b3639f6a88421 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-10-20bug fix: score calculation based on build_tagMorgan Richomme1-3/+4
we were used to count the number of PASS of the last 4 runs it works 80% of the cases 4 runs 4 OK => 3 points 3 OK => 3 points 2 OK => 2 points 1 OK => 1 point 0 => 0 it is different from the normal score calculation 4 OK => 3 points 3 OK => 2 points 2 OK => 2 points 1 OK => 1 point 0 => 0 Change-Id: Ib8df2c294e0036246176c181b7a7ac290ebea07e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-19Extend the Functest reporting black listMorgan Richomme1-0/+2
remove * tempest_full_parallel * rally_full Change-Id: Ibb944e7d32dc3cf0fc0b87a269c9e2f0327410e4 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-18Add new function to get indivial test score for aarch64Morgan Richomme3-7/+54
as architecture is not considered as a constraints (unlike scenario or installer) we need to work on the build tag to retrieve the data but it is not possible to use regex directly in the API so retrieveing the accurate results require extra processing * based on build_tag, filter the results properly per scenario * build a table build_tag time for a given scenario * keep only the last 4 results * evaluation criteria field It would simplified if architecture could be declared as a constraint then querying the resuls will not change and not require intermediate steps JIRA: FUNCTEST-880 Change-Id: Id4fe4f56babf0964d41e299905c804e0d837c3d7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-16fix yamllint verify failSerenaFeng1-0/+2
fail record: https://build.opnfv.org/ci/job/opnfv-yamllint-verify-master/1050/console Change-Id: Ic709b9a3d1d3642a3deebd930714a2ba2de22da6 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-10-16Merge "Update table headers in the reporting page"Serena Feng1-3/+3
2017-10-12Change criteria 'SUCCESS' to 'PASS' in yardstick reportingchenjiankun1-2/+1
To keep consistent with other testing project, yardstick should change criteria value from 'SUCCESS' to 'PASS' Change-Id: I8d8779927a74749e7c43df4e55e1888c49cbbbaf Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-10-12bugfix: trend graph not show in fuel x86 and aarch64chenjiankun1-2/+14
The trend tool will read installer field in scenario_history.txt But now this field is fuel not fuel@x86 or fuel@aarch64. So I change fuel -> fuel@x86 & fuel@aarch64. Change-Id: I8e97e57febd559f65be559b16bceee5cf8268926 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-10-11Merge "Add fuel@x86 and fuel@arm support"Morgan Richomme3-118/+166
2017-10-11Add fuel@x86 and fuel@arm supportchenjiankun3-118/+166
Since scenario data do not have a field named architecture, So I choose pod_name for now. For example: pod_name: arm-pod5 I assume that it is based arm architecture Change-Id: I92159a5e08b1ed80701494483fd9922dbd459193 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-10-07Change score calculation for functest reportingMorgan Richomme1-5/+19
the goal is not to penalize scenario with few iteration due to CI pipeline constraints until now the top score was calculated on the base on 4 iterations, it means whatever the number of iterations, we always consider the possible top score based on at least 4 iterations each case can get - 3 points (last 4 iterations PASS) - 2 points (more than 1 PASS over the last 10 days but 1 FAIL of the last 4) - 1 point (at least 1 PASS over the last 10 days) - no point (never work) so if we consider a scenario with 10 cases, the top score is 30 = 10*3 (max points) the coefficient to calculate the top score is not the number of iterations - 1 iteration => possible top score 10 - 2 iterations => top score 20 - 3 iterations => top score 20 - 4 or more iterations => top score 30 previously top score was systematically 30 https://wiki.opnfv.org/plugins/servlet/mobile#content/view/6828617 Change-Id: I01102bc00766b7f5b58e73befa7d5328fcc895cc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-10-03Update table headers in the reporting pageYujun Zhang1-3/+3
Change-Id: I19916f1e4dd04297cc7d73e93a12767d335c0d99 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-09-30Fix status reporting pageYujun Zhang4-19/+12
- use data in last 10 days instead of 1 day - hide installers without any data - remove redundant qtip reporting Change-Id: If73a439572b6a1cf09c7d34f643fb14be82196ca Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-09-29Merge "Fix Bottlenecks status page cann't be shown."Morgan Richomme1-1/+5
2017-09-29Change Euphrates imageMorgan Richomme2-3/+3
minor pylint fix in functest/reporting-status Change-Id: Ibfd4f0da1475c34c40a3d9e00530f8f15eb3c7dc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-29Fix Bottlenecks status page cann't be shown.liyin1-1/+5
Change-Id: Ia1ad4c0654ad2dea7fdb61b81725af9aaafc4750 Signed-off-by: liyin <liyin11@huawei.com>
2017-09-26reporting adoption for Euphrateschenjiankun4-4/+4
Danube -> Euphrates in euphrates.html add euphrates dir fix CONFIG_REPORTING_YAML value fix import error in scenario.py Change-Id: Ic0457bf8d1c67bd21ef6a31564792eb98cfca9ad Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-09-25Merge "cloudify_ims reporting fixes"Morgan Richomme4-164/+182
2017-09-22cloudify_ims reporting fixesMorgan Richomme4-164/+182
+ minor fixes * unknown => real test case names * pylint corrections Change-Id: I75446e4006d41fe1bb25106420910025afa01489 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-20Bugfix: Change http_pass to proxy_passchenjiankun1-1/+1
http_pass is wrong for nginx, we need to change it to proxy_pass Change-Id: Ib679b36a4a139c02647564719e1cfc49a9f376a2 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-09-18Add Euphrates pages for reportingMorgan Richomme6-23/+267
Change-Id: Iee4c54801d839be949495360141d4ae9353e5ecc Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-11Change nginx configurationchenjiankun2-4/+4
Since landing page have changed from reporting2 to testing, the nginx configuration need some adoption. If the pre url change again, we need to config the base_url when start our docker container. For example: docker run -itd -p 8084:8000 -e SERVER_URL testresults.opnfv.org/xxx/api opnfv/reporting:latest Change-Id: If3c9f9af76fcfc8047b5b9559fcc8bd45740d4d2 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-09-07Add bottlenecks to reportingMorgan Richomme5-2/+265
very basic approach based on 1 case posca_factor_ping Give a feedback on the CI activity of bottlenecks Change-Id: Iaa84abac6b00ba48a771250433a9f9a068de453f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-04Add 2 files forgotten in previous commit for vsperf integrationMorgan Richomme2-0/+138
Change-Id: Ibfd36814ac09d16ba4b3d365e04bf3b39a1ef7db Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-09-04Add vsperf in reportingMorgan Richomme6-110/+282
fix some pep8 errors in other projects Change-Id: Iea68b0d495f7fbe892ec866fb70b8354ad9ff3c2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-31bug fix: reporting TempestMorgan Richomme1-42/+50
not updated since Colorado and data model changed - minor fixes to match data model - pep8/pylint correction Change-Id: I3a0a9ea689d25b3cfff35cb1ec39329981627bc6 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-28bug fix for qtip reportingMorgan Richomme2-6/+6
- fix right path (version duplicated in path) - fix template for nav links in qtip reporting page Change-Id: I7e14bea3feb5e6fad694e2837b3048b9cd8d5825 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-25Split HA and NOHA scenarios into 2 tables in reportingMorgan Richomme1-2/+27
the goal is to vizualize more quickly the HA and NOHA scenario Note that if no scenario is available, the table title is displayed Change-Id: Ibdade30aadf40fe4f7b9bfe547d23c186cb3e1df Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-24bug fix: installation of node, bower and grunt for reporting dockerMorgan Richomme3-7/+13
- change node installation process - clean setup (no need of pbr) Change-Id: I9015486e3892e7c949bad5140cc4180ec9f07aa7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>