aboutsummaryrefslogtreecommitdiffstats
path: root/docs/testing/user/userguide/test_results.rst
diff options
context:
space:
mode:
authorMorgan Richomme <morgan.richomme@orange.com>2017-08-24 14:26:51 +0000
committerGerrit Code Review <gerrit@opnfv.org>2017-08-24 14:26:51 +0000
commit7760894ab39c6bc592cd5813c709427fa0157dc1 (patch)
tree32abb1c9247987edc058f3fca5ce1daa9a998017 /docs/testing/user/userguide/test_results.rst
parent1da439765b20bbc9a1f63d736f4c6284b654d50d (diff)
parentea4e3656a812508809294b667b97b7b0b07736c9 (diff)
Merge "Functest Doc: first update for Euphrates - move part of the dev group to the testing document - move reporting into user guide - update logs - introduce alpine - introduce functest API - split documents per chapter"
Diffstat (limited to 'docs/testing/user/userguide/test_results.rst')
-rw-r--r--docs/testing/user/userguide/test_results.rst50
1 files changed, 50 insertions, 0 deletions
diff --git a/docs/testing/user/userguide/test_results.rst b/docs/testing/user/userguide/test_results.rst
new file mode 100644
index 000000000..53e4d3a86
--- /dev/null
+++ b/docs/testing/user/userguide/test_results.rst
@@ -0,0 +1,50 @@
+Test results
+============
+
+Manual testing
+--------------
+
+In manual mode test results are displayed in the console and result files
+are put in /home/opnfv/functest/results.
+
+If you want additionnal logs, you may configure the logging.ini under <repo>/functest:functest/ci
+
+Automated testing
+--------------
+
+In automated mode, test results are displayed in jenkins logs, a summary is provided
+at the end of the job and can be described as follow::
+
+ +-------------------------+----------------------------------------------------------+
+ | ENV VAR | VALUE |
+ +-------------------------+----------------------------------------------------------+
+ | INSTALLER_TYPE | daisy |
+ | DEPLOY_SCENARIO | os-nosdn-nofeature-ha |
+ | BUILD_TAG | jenkins-functest-daisy-baremetal-daily-master-67 |
+ | CI_LOOP | daily |
+ +-------------------------+----------------------------------------------------------+
+
+ +------------------------------+------------------+---------------------+------------------+----------------+
+ | TEST CASE | PROJECT | TIER | DURATION | RESULT |
+ +------------------------------+------------------+---------------------+------------------+----------------+
+ | connection_check | functest | healthcheck | 00:08 | PASS |
+ | api_check | functest | healthcheck | 04:22 | PASS |
+ | snaps_health_check | functest | healthcheck | 00:35 | PASS |
+ | vping_ssh | functest | smoke | 00:54 | PASS |
+ | vping_userdata | functest | smoke | 00:27 | PASS |
+ | tempest_smoke_serial | functest | smoke | 19:39 | FAIL |
+ | rally_sanity | functest | smoke | 15:16 | PASS |
+ | refstack_defcore | functest | smoke | 15:55 | PASS |
+ | snaps_smoke | functest | smoke | 26:45 | FAIL |
+ | cloudify_ims | functest | vnf | 83:33 | FAIL |
+ | orchestra_ims | functest | vnf | 11:32 | FAIL |
+ +------------------------------+------------------+---------------------+------------------+----------------+
+
+Results are automatically pushed to the test results database, some additional
+result files are pushed to OPNFV artifact web sites.
+
+Based on the results stored in the result database, a `Functest reporting`_
+portal is also automatically updated. This portal provides information on the
+overall status per scenario and per installer
+
+.. _`Functest reporting`: http://testresults.opnfv.org/reporting/functest/release/danube/index-status-fuel.html