Add module skeletons

- Remove `suite` and `case` which seems redundant at the moment
- Rename `qtip.spec` to `qtip.loader` since the class loads spec
- Add driver `sample` which will generate random performance data
- Add collector `logfile` which will collect result from log files
- Add reporter `console` which will print report to console
- Add exception classes

See updated class diagram in https://wiki.opnfv.org/display/qtip/Design

JIRA: QTIP-148
JIRA: QTIP-193
Change-Id: Idf751d33428176a26224e4443100a142feda6f32
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>

6 files changed, 34 insertions, 0 deletions

diff --git a/tests/data/benchmarks/metric/dhrystone.yaml b/tests/data/benchmarks/metric/dhrystone.yaml
new file mode 100644
index 00000000..b0d55ed2
--- /dev/null
+++ b/tests/data/benchmarks/metric/dhrystone.yaml
@@ -0,0 +1,7 @@
+name: dhrystone
+description: >
+  a synthetic computing benchmark program intended to be representative of
+  system (integer) programming
+workloads:
+  - single_cpu
+  - multi_cpu
diff --git a/tests/data/benchmarks/metric/dpi.yaml b/tests/data/benchmarks/metric/dpi.yaml
new file mode 100644
index 00000000..fc24c8d1
--- /dev/null
+++ b/tests/data/benchmarks/metric/dpi.yaml
@@ -0,0 +1,5 @@
+name: dpi
+description: deep packet inspection
+workloads:
+  - bps
+  - pps
diff --git a/tests/data/benchmarks/metric/fake-metric.yaml b/tests/data/benchmarks/metric/fake-metric.yaml
new file mode 100644
index 00000000..c5fcc5c2
--- /dev/null
+++ b/tests/data/benchmarks/metric/fake-metric.yaml
@@ -0,0 +1,7 @@
+name: fake compute
+description: >
+  a fake compute performance index which generate random result
+workloads:  # all supported workloads
+  - fake_workload_1
+  - fake_workload_2
+  - fake_workload_3
diff --git a/tests/data/benchmarks/metric/ramspeed.yaml b/tests/data/benchmarks/metric/ramspeed.yaml
new file mode 100644
index 00000000..bb7618b7
--- /dev/null
+++ b/tests/data/benchmarks/metric/ramspeed.yaml
@@ -0,0 +1,5 @@
+name: ramspeed
+description: a memory performance benchmarking
+workloads:
+    - int: [add, average, copy, scale, triad]
+    - float: [add, average, copy, scale, triad]
diff --git a/tests/data/benchmarks/metric/ssl.yaml b/tests/data/benchmarks/metric/ssl.yaml
new file mode 100644
index 00000000..21e8add7
--- /dev/null
+++ b/tests/data/benchmarks/metric/ssl.yaml
@@ -0,0 +1,5 @@
+name: ssl
+description: a Secure Sockets Layer performance benchmarking
+workloads:
+  - aes_128_cbc: [512, 1024, 2048, 4096]
+  - rsa_sig: [16, 64, 256, 1024, 8192]
diff --git a/tests/data/benchmarks/metric/whetstone.yaml b/tests/data/benchmarks/metric/whetstone.yaml
new file mode 100644
index 00000000..d83680c4
--- /dev/null
+++ b/tests/data/benchmarks/metric/whetstone.yaml
@@ -0,0 +1,5 @@
+name: dhrystone
+description: a synthetic benchmark for evaluating the performance of computers
+workloads:
+  - single_cpu
+  - multi_cpu