blob: a93022977ee833157a36799a7be88bd84b743a75 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
|
.. This work is licensed under a Creative Commons Attribution 4.0 International License.
.. http://creativecommons.org/licenses/by/4.0
.. (c) Huawei Technologies Co.,Ltd and others.
*********************
Project Testing Guide
*********************
For each *testsuite*, you can either setup *teststory* or *testcase* to run
certain test. *teststory* comprises several *testcases* as a set in one
configuration file. You could call *teststory* or *testcase* by using
Bottlencks user interfaces.
Details will be shown in the following section.
Brief Introdcution of the Test suites in Project Releases
=============================================================
Brahmaputra: rubbos is introduced, which is an end2end NFVI perforamnce tool.
Virtual switch test framework(VSTF) is also introduced,
which is an test framework used for vswitch performance test.
Colorado: rubbos is refactored by using puppet, which makes it quite flexible
to configure with different number of load generator (Client), worker (tomcat).
vstf is refactored by extracting the test case's configuration information.
Danube: posca testsuite is introduced to implementing stress (factor), scenario and
tuning test in parametric manner. Two testcases are developed and integrated into
community CI pipeline. Rubbos and VSTF are not supported any more.
Integration Description
=======================
+-------------+----------------------+----------------------+
| Release | Integrated Installer | Supported Testsuite |
+-------------+----------------------+----------------------+
| Brahmaputra | Fuel | Rubbos, VSTF |
+-------------+----------------------+----------------------+
| Colorado | Compass | Rubbos, VSTF |
+-------------+----------------------+----------------------+
| Danube | Compass | POSCA |
+-------------+----------------------+----------------------+
Test suite & Test case Description
==================================
+--------+-------------------------------+
|POSCA | posca_factor_ping |
| +-------------------------------+
| | posca_factor_system_bandwidth |
+--------+-------------------------------+
|Rubbos | rubbos_basic |
| +-------------------------------+
| | rubbos_TC1101 |
| +-------------------------------+
| | rubbos_TC1201 |
| +-------------------------------+
| | rubbos_TC1301 |
| +-------------------------------+
| | rubbos_TC1401 |
| +-------------------------------+
| | rubbos_heavy_TC1101 |
+--------+-------------------------------+
|vstf | vstf_Ti1 |
| +-------------------------------+
| | vstf_Ti2 |
| +-------------------------------+
| | vstf_Ti3 |
| +-------------------------------+
| | vstf_Tn1 |
| +-------------------------------+
| | vstf_Tn2 |
| +-------------------------------+
| | vstf_Tu1 |
| +-------------------------------+
| | vstf_Tu2 |
| +-------------------------------+
| | vstf_Tu3 |
+--------+-------------------------------+
|
