aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorNauman_Ahad <Nauman_Ahad@dell.com>2016-01-20 14:08:27 +0500
committerNauman Ahad <nauman.ahad@xflowresearch.com>2016-02-01 22:25:50 +0000
commite6f6973014823b2525321f9a8cd0a42f09454cae (patch)
tree958b45683967b01c6f4b73fc480a7169bb138e6f
parent9bb0cf584c67ddd1be93a39e2ef4481a4a6e2d13 (diff)
Documents for QTIP Compute and Storage Testcases
Documents list storage and compute benchmarks and testcases included in B release for QTIP. Documents in .rst format Change-Id: Ifb6d09552ba4ff9272110062cda9e66fb6c32fe6 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com> (cherry picked from commit 1c5f0ba83b4cccf98df24d939768a74294cc7498)
-rwxr-xr-xdata/qtip_creds.sh2
-rw-r--r--docs/compute_testcases.rst71
-rw-r--r--docs/storage_testcases.rst18
3 files changed, 90 insertions, 1 deletions
diff --git a/data/qtip_creds.sh b/data/qtip_creds.sh
index 085e3a60..490de859 100755
--- a/data/qtip_creds.sh
+++ b/data/qtip_creds.sh
@@ -10,7 +10,7 @@ case "$INSTALLER_TYPE" in
fuel)
PSWD="r00tme";;
compass)
- PSWD="compass";;
+ PSWD="root";;
joid)
PSWD="joid";;
*)
diff --git a/docs/compute_testcases.rst b/docs/compute_testcases.rst
new file mode 100644
index 00000000..4463691b
--- /dev/null
+++ b/docs/compute_testcases.rst
@@ -0,0 +1,71 @@
+Qtip Compute testcases
+======================
+============
+Introduction
+============
+
+The QTIP testing suite aims to benchmark the compute components of an OPNFV platform.
+Such components include, the CPU performance, the memory performance.
+Additionally virtual computing performance provided by the Hypervisor (KVM) installed as part of OPNFV platforms would be benhmarked too.
+
+The test suite consists of both synthetic and application specific benchmarks to test compute components.
+
+All the compute benchmarks could be run in 2 scenarios:
+
+1. On Baremetal Machines provisioned by an OPNFV installer (Host machines)
+2. On Virtual Machines brought up through OpenStack on an OPNFV platform
+
+Note: The Compute benchmark suite constains relatively old benchmarks such as dhrystone and whetstone. The suite would be updated for better benchmarks such as Linbench for the OPNFV C release.
+
+============
+Benchmarks
+============
+
+
+The benchmarks include:
+
+1. Dhrystone 2.1
+
+Dhrystone is a synthetic benchmark for measuring CPU performance. It uses integer calculations to evaluate CPU capabilities.
+Both Single CPU performance is measured along multi-cpu performance.
+
+
+Dhrystone, however, is a dated benchmark and has some short comings.
+Written in C, it is a small program that doesn't test the CPU memory subsystem. Additionally, dhrystone results could be modified by optimizing the compiler and insome cases hardware configuration.
+
+References:
+
+2. Whetstone
+
+Whetstone is a synthetic benchmark to measure CPU floating point operation performance. Both Single CPU performance is measured along multi-cpu performance.
+
+Like Dhrystone, Whetstone is a dated benchmark and has short comings.
+
+References:
+
+3. OpenSSL Speed
+
+OpenSSL Speed can be used to benchmark compute performance of a machine. In QTIP, two OpenSSL Speed benchmarks are incorporated:
+1. RSA signatures/sec signed by a machine
+2. AES 128-bit encryption throught for a machine for cipher block sizes
+
+References
+
+4. RAMSpeed
+
+RAMSpeed is used to measure a machine's memory perfomace. The problem(array)size is large enough to ensure Cache Misses so that the main machine memory is used. INTmem and FLOATmem benchmarks are executed in 4 different scenarios:
+
+a. Copy: a(i)=b(i)
+b. Add: a(i)=b(i)+c(i)
+c. Scale: a(i)=b(i)*d
+d. Triad: a(i)=b(i)+c(i)*d
+
+INTmem uses integers in these four benchmarks whereas FLOATmem uses floating points for these benchmarks.
+
+
+5. DPI
+
+nDPI is a modified variant of OpenDPI, Open source Deep packet Inspection, that is maintained by ntop.
+An example application called *pcapreader* has been developed and is available for use along nDPI.
+
+A sample .pcap file is passed to the *pcapreader* application. nDPI classifies traffic in the pcap file into different categories based on string matching . The *pcapreader* application provides a throughput number for the rate at which traffic was classified, indicating a machine's computational performance. The results are run 10 times and an average is taken for the obtained number.
diff --git a/docs/storage_testcases.rst b/docs/storage_testcases.rst
new file mode 100644
index 00000000..50317adf
--- /dev/null
+++ b/docs/storage_testcases.rst
@@ -0,0 +1,18 @@
+QTIP Storage testcases
+===================
+
+The QTIP benchmark suite aims to evaluate storage components within an OPNFV platform. For Brahamaputra release, FIO would evaluate File System performance for the host machine. It will also test the I/O performance provided by the hypervisor(KVM) when Storage benchmarks are run inside VMs.
+
+**Note: For Brahmaputra release, only the Ephemeral Storage is being tested. For C release persistent block and object storage would be tested.**
+
+The FIO Job would consist of:
+
+1. A file size of 5GB
+2. Random Read 50%, Random Write 50%
+3. Direct I/O
+4. Asynch I/O Engine
+5. I/O Queue depth of 2
+6. Block size :4K
+
+
+For this Job, I/O per second would be measured along mean I/O latency to provide storage performance numbers.