From cfa402bae022e7e288f9d9eaa3582f22fd39c42e Mon Sep 17 00:00:00 2001 From: "dimitris.tsiolakis" Date: Tue, 18 Sep 2018 16:37:01 +0300 Subject: Reviewers Guide document for fraser release. Images have been updated to depict the latest changes in Dovetail Web portal. Change-Id: I4dc928141856fab34670272fcc465bea3f6156db Signed-off-by: dimitris.tsiolakis --- .../images/ovp_log_files_functest_image.png | Bin 27349 -> 39227 bytes .../user/reviewerguide/images/ovp_log_setup.png | Bin 36523 -> 72844 bytes .../reviewerguide/images/ovp_pass_fraction.png | Bin 41825 -> 83821 bytes .../reviewerguide/images/ovp_pass_percentage.png | Bin 10321 -> 22057 bytes .../reviewerguide/images/ovp_result_overview.png | Bin 35827 -> 71800 bytes .../reviewerguide/images/ovp_result_review.png | Bin 44980 -> 14835 bytes .../reviewerguide/images/ovp_wrong_num_of_tc.png | Bin 36148 -> 0 bytes .../user/reviewerguide/images/sut_endpoints.png | Bin 119897 -> 74700 bytes .../testing/user/reviewerguide/images/sut_info.png | Bin 29227 -> 17061 bytes docs/testing/user/reviewerguide/index.rst | 8 ++++---- 10 files changed, 4 insertions(+), 4 deletions(-) delete mode 100644 docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png (limited to 'docs/testing/user') diff --git a/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png b/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png index 51a672af..66d3fd73 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png and b/docs/testing/user/reviewerguide/images/ovp_log_files_functest_image.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_log_setup.png b/docs/testing/user/reviewerguide/images/ovp_log_setup.png index de529a05..4a68d9b6 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_log_setup.png and b/docs/testing/user/reviewerguide/images/ovp_log_setup.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png b/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png index 7c3299f4..94dcd45a 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png and b/docs/testing/user/reviewerguide/images/ovp_pass_fraction.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png b/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png index adfe96e5..0d477a78 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png and b/docs/testing/user/reviewerguide/images/ovp_pass_percentage.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_result_overview.png b/docs/testing/user/reviewerguide/images/ovp_result_overview.png index 1097f0af..1f66a69c 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_result_overview.png and b/docs/testing/user/reviewerguide/images/ovp_result_overview.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_result_review.png b/docs/testing/user/reviewerguide/images/ovp_result_review.png index a8f988fc..427127e0 100644 Binary files a/docs/testing/user/reviewerguide/images/ovp_result_review.png and b/docs/testing/user/reviewerguide/images/ovp_result_review.png differ diff --git a/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png b/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png deleted file mode 100644 index 9e5d2b47..00000000 Binary files a/docs/testing/user/reviewerguide/images/ovp_wrong_num_of_tc.png and /dev/null differ diff --git a/docs/testing/user/reviewerguide/images/sut_endpoints.png b/docs/testing/user/reviewerguide/images/sut_endpoints.png index f11d531f..d5ad6239 100644 Binary files a/docs/testing/user/reviewerguide/images/sut_endpoints.png and b/docs/testing/user/reviewerguide/images/sut_endpoints.png differ diff --git a/docs/testing/user/reviewerguide/images/sut_info.png b/docs/testing/user/reviewerguide/images/sut_info.png index 395f5f41..53c3d51a 100644 Binary files a/docs/testing/user/reviewerguide/images/sut_info.png and b/docs/testing/user/reviewerguide/images/sut_info.png differ diff --git a/docs/testing/user/reviewerguide/index.rst b/docs/testing/user/reviewerguide/index.rst index dd9456ce..99585581 100644 --- a/docs/testing/user/reviewerguide/index.rst +++ b/docs/testing/user/reviewerguide/index.rst @@ -92,11 +92,11 @@ eight characters even though the 'Test ID' is a longer UUID in the back-end.* Figure 3 -3. Test-Case Pass Percentage +2. Test-Case Pass Percentage ============================ All mandatory test-cases have to run successfully. The below diagram of the 'Test Run Results' is one method and -shows that 94.39% of the mandatory test-cases have passed. +shows that 98.15% of the mandatory test-cases have passed. This value must not be lower than 100%. .. image:: images/ovp_pass_percentage.png @@ -117,7 +117,7 @@ Failed test cases can also be easy identified by the color of pass/total number. Figure 5 -4. Log File Verification +3. Log File Verification ======================== Each log file of the mandatory test cases have to be verified for content. @@ -190,7 +190,7 @@ An example of a FAILED and a SUCCESS test case are listed below: 2018-08-28 10:23:41,907 [INFO] yardstick.benchmark.core.task task.py:127 Testcase: "opnfv_yardstick_tc052" **SUCCESS**!!! -5. SUT Info Verification +4. SUT Info Verification ======================== SUT information must be present in the results to validate that all required endpoint services -- cgit 1.2.3-korg