summaryrefslogtreecommitdiffstats
path: root/docs/testing/user/reviewerguide
diff options
context:
space:
mode:
authordimitris.tsiolakis <dmts@intracom-telecom.com>2018-09-18 16:37:01 +0300
committerDan Xu <xudan16@huawei.com>2018-09-20 09:08:31 +0000
commit83375bd73319c64ff8bfc6206753123b80f07b6a (patch)
tree19b3752983c219e3917f2de893725e9ec1cac849 /docs/testing/user/reviewerguide
parent16e36edaec487300f1dd154110077d499bf7726e (diff)
Reviewers Guide document for fraser release.
Images have been updated to depict the latest changes in Dovetail Web portal. Change-Id: I4dc928141856fab34670272fcc465bea3f6156db Signed-off-by: dimitris.tsiolakis <dmts@intracom-telecom.com> (cherry picked from commit cfa402bae022e7e288f9d9eaa3582f22fd39c42e)
Diffstat (limited to 'docs/testing/user/reviewerguide')
-rw-r--r--docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.pngbin27349 -> 39227 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/ovp_log_setup.pngbin36523 -> 72844 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/ovp_pass_fraction.pngbin41825 -> 83821 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/ovp_pass_percentage.pngbin10321 -> 22057 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/ovp_result_overview.pngbin35827 -> 71800 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/ovp_result_review.pngbin44980 -> 14835 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.pngbin36148 -> 0 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/sut_endpoints.pngbin119897 -> 74700 bytes
-rw-r--r--docs/testing/user/reviewerguide/images/sut_info.pngbin29227 -> 17061 bytes
-rw-r--r--docs/testing/user/reviewerguide/index.rst8
10 files changed, 4 insertions, 4 deletions
diff --git a/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png b/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png
index 51a672af..66d3fd73 100644
--- a/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png
+++ b/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/ovp_log_setup.png b/docs/testing/user/reviewerguide/images/ovp_log_setup.png
index de529a05..4a68d9b6 100644
--- a/docs/testing/user/reviewerguide/images/ovp_log_setup.png
+++ b/docs/testing/user/reviewerguide/images/ovp_log_setup.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png b/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png
index 7c3299f4..94dcd45a 100644
--- a/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png
+++ b/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png b/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png
index adfe96e5..0d477a78 100644
--- a/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png
+++ b/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/ovp_result_overview.png b/docs/testing/user/reviewerguide/images/ovp_result_overview.png
index 1097f0af..1f66a69c 100644
--- a/docs/testing/user/reviewerguide/images/ovp_result_overview.png
+++ b/docs/testing/user/reviewerguide/images/ovp_result_overview.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/ovp_result_review.png b/docs/testing/user/reviewerguide/images/ovp_result_review.png
index a8f988fc..427127e0 100644
--- a/docs/testing/user/reviewerguide/images/ovp_result_review.png
+++ b/docs/testing/user/reviewerguide/images/ovp_result_review.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png b/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png
deleted file mode 100644
index 9e5d2b47..00000000
--- a/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png
+++ /dev/null
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/sut_endpoints.png b/docs/testing/user/reviewerguide/images/sut_endpoints.png
index f11d531f..d5ad6239 100644
--- a/docs/testing/user/reviewerguide/images/sut_endpoints.png
+++ b/docs/testing/user/reviewerguide/images/sut_endpoints.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/images/sut_info.png b/docs/testing/user/reviewerguide/images/sut_info.png
index 395f5f41..53c3d51a 100644
--- a/docs/testing/user/reviewerguide/images/sut_info.png
+++ b/docs/testing/user/reviewerguide/images/sut_info.png
Binary files differ
diff --git a/docs/testing/user/reviewerguide/index.rst b/docs/testing/user/reviewerguide/index.rst
index dd9456ce..99585581 100644
--- a/docs/testing/user/reviewerguide/index.rst
+++ b/docs/testing/user/reviewerguide/index.rst
@@ -92,11 +92,11 @@ eight characters even though the 'Test ID' is a longer UUID in the back-end.*
Figure 3
-3. Test-Case Pass Percentage
+2. Test-Case Pass Percentage
============================
All mandatory test-cases have to run successfully. The below diagram of the 'Test Run Results' is one method and
-shows that 94.39% of the mandatory test-cases have passed.
+shows that 98.15% of the mandatory test-cases have passed.
This value must not be lower than 100%.
.. image:: images/ovp_pass_percentage.png
@@ -117,7 +117,7 @@ Failed test cases can also be easy identified by the color of pass/total number.
Figure 5
-4. Log File Verification
+3. Log File Verification
========================
Each log file of the mandatory test cases have to be verified for content.
@@ -190,7 +190,7 @@ An example of a FAILED and a SUCCESS test case are listed below:
2018-08-28 10:23:41,907 [INFO] yardstick.benchmark.core.task task.py:127 Testcase: "opnfv_yardstick_tc052" **SUCCESS**!!!
-5. SUT Info Verification
+4. SUT Info Verification
========================
SUT information must be present in the results to validate that all required endpoint services