summaryrefslogtreecommitdiffstats
path: root/docs
diff options
context:
space:
mode:
authorYujun Zhang <zhang.yujunz@zte.com.cn>2016-11-01 16:59:52 +0800
committerYujun Zhang <zhang.yujunz@zte.com.cn>2016-11-01 13:38:49 +0000
commit38fede733887c328ce6f457838dd712c9384a819 (patch)
tree437c30dd904605cce3e26fb677448db01635de98 /docs
parent82efecc12af0f0ebf108aac9bccb83936ecbd7cd (diff)
Outline of QPI dashboard design specification.
JIRA: QTIP-126 Change-Id: Id7f116fb479617d56edfb9b1513fd0fb508b6383 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
Diffstat (limited to 'docs')
-rw-r--r--docs/designspec/dashboard.rst70
-rw-r--r--docs/designspec/index.rst13
2 files changed, 83 insertions, 0 deletions
diff --git a/docs/designspec/dashboard.rst b/docs/designspec/dashboard.rst
new file mode 100644
index 00000000..ad5520b6
--- /dev/null
+++ b/docs/designspec/dashboard.rst
@@ -0,0 +1,70 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) 2016 ZTE Corp.
+
+
+*********
+Dashboard
+*********
+
+The dashboard gives user an intuitive view of benchmark result.
+
+Purpose
+=======
+
+The basic element to be displayed is QPI a.k.a. QTIP Performance Index. But it
+is also important to show user
+
+#. How is the final score calculated?
+#. Under what condition is the test plan executed?
+#. How many runs of a performance tests have been executed and is there any deviation?
+#. Comparison of benchmark result from different PODs or configuration
+
+Templates
+=========
+
+Different board templates are created to satisfy the above requirements.
+
+Composition
+-----------
+
+QTIP gives a simple score but there must be a complex formula behind it. This
+view explains the composition of the QPI.
+
+Condition
+---------
+
+The condition of a benchmark result includes
+
+* System Under Test
+
+ * Hardware environment
+ * Hypervisor version
+ * Operation System release version
+ * System Configuration
+
+* Test Tools
+
+ * Release version
+ * Configuration
+
+* Test Facility
+
+ * Laboratory
+ * Engineer
+ * Date
+
+Conditions that do NOT have an obvious affect on the test result may be ignored,
+e.g. temperature, power supply.
+
+Deviation
+---------
+
+Performance tests are usually repeated many times to reduce random disturbance.
+This view shall show an overview of deviation among different runs.
+
+Comparison
+----------
+
+Comparison can be done between different PODs or different configuration on the
+same PODs.
diff --git a/docs/designspec/index.rst b/docs/designspec/index.rst
new file mode 100644
index 00000000..e9b3f9fd
--- /dev/null
+++ b/docs/designspec/index.rst
@@ -0,0 +1,13 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International License.
+.. http://creativecommons.org/licenses/by/4.0
+.. (c) 2016 ZTE Corp.
+
+
+##########################
+QTIP Design Specifications
+##########################
+
+.. toctree::
+ :maxdepth: 2
+
+ dashboard.rst