aboutsummaryrefslogtreecommitdiffstats
path: root/docs/testing/user/userguide
diff options
context:
space:
mode:
Diffstat (limited to 'docs/testing/user/userguide')
-rw-r--r--docs/testing/user/userguide/test_results.rst117
1 files changed, 60 insertions, 57 deletions
diff --git a/docs/testing/user/userguide/test_results.rst b/docs/testing/user/userguide/test_results.rst
index 2ac86f21f..7e13ef2b1 100644
--- a/docs/testing/user/userguide/test_results.rst
+++ b/docs/testing/user/userguide/test_results.rst
@@ -24,18 +24,18 @@ Healthcheck suite::
+--------------------------+------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+--------------------------+------------------+---------------------+------------------+----------------+
- | connection_check | functest | healthcheck | 00:03 | PASS |
- | tenantnetwork1 | functest | healthcheck | 00:05 | PASS |
+ | connection_check | functest | healthcheck | 00:02 | PASS |
+ | tenantnetwork1 | functest | healthcheck | 00:04 | PASS |
| tenantnetwork2 | functest | healthcheck | 00:06 | PASS |
- | vmready1 | functest | healthcheck | 00:06 | PASS |
- | vmready2 | functest | healthcheck | 00:08 | PASS |
- | singlevm1 | functest | healthcheck | 00:32 | PASS |
- | singlevm2 | functest | healthcheck | 00:37 | PASS |
- | vping_ssh | functest | healthcheck | 00:46 | PASS |
- | vping_userdata | functest | healthcheck | 00:39 | PASS |
- | cinder_test | functest | healthcheck | 01:05 | PASS |
- | tempest_smoke | functest | healthcheck | 05:39 | PASS |
- | tempest_horizon | functest | healthcheck | 01:05 | PASS |
+ | vmready1 | functest | healthcheck | 00:05 | PASS |
+ | vmready2 | functest | healthcheck | 00:06 | PASS |
+ | singlevm1 | functest | healthcheck | 00:31 | PASS |
+ | singlevm2 | functest | healthcheck | 00:35 | PASS |
+ | vping_ssh | functest | healthcheck | 00:47 | PASS |
+ | vping_userdata | functest | healthcheck | 00:42 | PASS |
+ | cinder_test | functest | healthcheck | 01:09 | PASS |
+ | tempest_smoke | functest | healthcheck | 04:50 | PASS |
+ | tempest_horizon | functest | healthcheck | 01:00 | PASS |
| odl | functest | healthcheck | 00:00 | SKIP |
+--------------------------+------------------+---------------------+------------------+----------------+
@@ -44,21 +44,24 @@ Smoke suite::
+---------------------------+------------------+---------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+---------------------------+------------------+---------------+------------------+----------------+
- | tempest_neutron | functest | smoke | 15:30 | PASS |
- | tempest_cinder | functest | smoke | 02:01 | PASS |
- | tempest_keystone | functest | smoke | 01:17 | PASS |
- | tempest_heat | functest | smoke | 22:14 | PASS |
- | tempest_telemetry | functest | smoke | 00:00 | SKIP |
- | rally_sanity | functest | smoke | 17:24 | PASS |
- | refstack_compute | functest | smoke | 07:03 | PASS |
- | refstack_object | functest | smoke | 02:09 | PASS |
- | refstack_platform | functest | smoke | 07:31 | PASS |
- | tempest_full | functest | smoke | 41:52 | PASS |
- | tempest_scenario | functest | smoke | 08:42 | PASS |
- | tempest_slow | functest | smoke | 43:42 | PASS |
- | patrole | functest | smoke | 02:42 | PASS |
- | tempest_barbican | functest | smoke | 02:30 | PASS |
+ | tempest_neutron | functest | smoke | 11:58 | PASS |
+ | tempest_cinder | functest | smoke | 02:13 | PASS |
+ | tempest_keystone | functest | smoke | 01:18 | PASS |
+ | tempest_heat | functest | smoke | 23:24 | PASS |
+ | tempest_telemetry | functest | smoke | 01:54 | PASS |
+ | rally_sanity | functest | smoke | 20:29 | PASS |
+ | refstack_compute | functest | smoke | 05:16 | PASS |
+ | refstack_object | functest | smoke | 01:59 | PASS |
+ | refstack_platform | functest | smoke | 06:42 | PASS |
+ | tempest_full | functest | smoke | 31:30 | PASS |
+ | tempest_scenario | functest | smoke | 09:57 | PASS |
+ | tempest_slow | functest | smoke | 57:15 | PASS |
+ | patrole_admin | functest | smoke | 22:15 | PASS |
+ | patrole_member | functest | smoke | 23:58 | PASS |
+ | patrole_reader | functest | smoke | 22:15 | PASS |
+ | tempest_barbican | functest | smoke | 03:37 | PASS |
| tempest_octavia | functest | smoke | 00:00 | SKIP |
+ | tempest_cyborg | functest | smoke | 00:00 | SKIP |
+---------------------------+------------------+---------------+------------------+----------------+
Smoke CNTT suite::
@@ -66,14 +69,14 @@ Smoke CNTT suite::
+-------------------------------+------------------+---------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+-------------------------------+------------------+---------------+------------------+----------------+
- | tempest_neutron_cntt | functest | smoke | 11:35 | PASS |
- | tempest_cinder_cntt | functest | smoke | 01:58 | PASS |
- | tempest_keystone_cntt | functest | smoke | 01:13 | PASS |
- | tempest_heat_cntt | functest | smoke | 22:32 | PASS |
- | rally_sanity_cntt | functest | smoke | 17:16 | PASS |
- | tempest_full_cntt | functest | smoke | 41:13 | PASS |
- | tempest_scenario_cntt | functest | smoke | 08:57 | PASS |
- | tempest_slow_cntt | functest | smoke | 35:58 | PASS |
+ | tempest_neutron_cntt | functest | smoke | 10:03 | PASS |
+ | tempest_cinder_cntt | functest | smoke | 02:10 | PASS |
+ | tempest_keystone_cntt | functest | smoke | 01:17 | PASS |
+ | tempest_heat_cntt | functest | smoke | 22:44 | PASS |
+ | rally_sanity_cntt | functest | smoke | 17:37 | PASS |
+ | tempest_full_cntt | functest | smoke | 29:48 | PASS |
+ | tempest_scenario_cntt | functest | smoke | 09:59 | PASS |
+ | tempest_slow_cntt | functest | smoke | 41:57 | PASS |
+-------------------------------+------------------+---------------+------------------+----------------+
Benchmarking suite::
@@ -81,10 +84,10 @@ Benchmarking suite::
+--------------------+------------------+----------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+--------------------+------------------+----------------------+------------------+----------------+
- | rally_full | functest | benchmarking | 93:03 | PASS |
- | rally_jobs | functest | benchmarking | 27:05 | PASS |
- | vmtp | functest | benchmarking | 17:56 | PASS |
- | shaker | functest | benchmarking | 24:02 | PASS |
+ | rally_full | functest | benchmarking | 104:28 | PASS |
+ | rally_jobs | functest | benchmarking | 30:00 | PASS |
+ | vmtp | functest | benchmarking | 23:43 | PASS |
+ | shaker | functest | benchmarking | 28:49 | PASS |
+--------------------+------------------+----------------------+------------------+----------------+
Benchmarking CNTT suite::
@@ -92,10 +95,10 @@ Benchmarking CNTT suite::
+-------------------------+------------------+----------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+-------------------------+------------------+----------------------+------------------+----------------+
- | rally_full_cntt | functest | benchmarking | 89:52 | PASS |
- | rally_jobs_cntt | functest | benchmarking | 19:39 | PASS |
- | vmtp | functest | benchmarking | 16:59 | PASS |
- | shaker | functest | benchmarking | 23:43 | PASS |
+ | rally_full_cntt | functest | benchmarking | 90:27 | PASS |
+ | rally_jobs_cntt | functest | benchmarking | 22:58 | PASS |
+ | vmtp | functest | benchmarking | 23:43 | PASS |
+ | shaker | functest | benchmarking | 28:49 | PASS |
+-------------------------+------------------+----------------------+------------------+----------------+
Vnf suite::
@@ -103,11 +106,11 @@ Vnf suite::
+----------------------+------------------+--------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+----------------------+------------------+--------------+------------------+----------------+
- | cloudify | functest | vnf | 05:08 | PASS |
- | cloudify_ims | functest | vnf | 24:46 | PASS |
- | heat_ims | functest | vnf | 33:12 | PASS |
- | vyos_vrouter | functest | vnf | 15:53 | PASS |
- | juju_epc | functest | vnf | 27:52 | PASS |
+ | cloudify | functest | vnf | 04:23 | PASS |
+ | cloudify_ims | functest | vnf | 24:42 | PASS |
+ | heat_ims | functest | vnf | 30:33 | PASS |
+ | vyos_vrouter | functest | vnf | 17:31 | PASS |
+ | juju_epc | functest | vnf | 37:21 | PASS |
+----------------------+------------------+--------------+------------------+----------------+
Kubernetes healthcheck suite::
@@ -115,8 +118,8 @@ Kubernetes healthcheck suite::
+-------------------+------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+-------------------+------------------+---------------------+------------------+----------------+
- | k8s_quick | functest | healthcheck | 00:18 | PASS |
- | k8s_smoke | functest | healthcheck | 01:14 | PASS |
+ | k8s_quick | functest | healthcheck | 00:13 | PASS |
+ | k8s_smoke | functest | healthcheck | 00:26 | PASS |
+-------------------+------------------+---------------------+------------------+----------------+
Kubernetes smoke suite::
@@ -124,8 +127,8 @@ Kubernetes smoke suite::
+---------------------------+------------------+---------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+---------------------------+------------------+---------------+------------------+----------------+
- | k8s_conformance | functest | smoke | 94:26 | PASS |
- | xrally_kubernetes | functest | smoke | 13:05 | PASS |
+ | k8s_conformance | functest | smoke | 103:05 | PASS |
+ | xrally_kubernetes | functest | smoke | 14:17 | PASS |
+---------------------------+------------------+---------------+------------------+----------------+
Kubernetes security suite::
@@ -133,9 +136,9 @@ Kubernetes security suite::
+---------------------------+------------------+------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+---------------------------+------------------+------------------+------------------+----------------+
- | kube_hunter | functest | security | 00:19 | PASS |
- | kube_bench_master | functest | security | 00:02 | PASS |
- | kube_bench_node | functest | security | 00:01 | PASS |
+ | kube_hunter | functest | security | 00:18 | PASS |
+ | kube_bench_master | functest | security | 00:07 | PASS |
+ | kube_bench_node | functest | security | 00:06 | PASS |
+---------------------------+------------------+------------------+------------------+----------------+
Kubernetes benchmarking suite::
@@ -143,7 +146,7 @@ Kubernetes benchmarking suite::
+--------------------------------+------------------+----------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+--------------------------------+------------------+----------------------+------------------+----------------+
- | xrally_kubernetes_full | functest | benchmarking | 34:16 | PASS |
+ | xrally_kubernetes_full | functest | benchmarking | 39:15 | PASS |
+--------------------------------+------------------+----------------------+------------------+----------------+
Kubernetes cnf suite::
@@ -151,9 +154,9 @@ Kubernetes cnf suite::
+-------------------------+------------------+--------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+-------------------------+------------------+--------------+------------------+----------------+
- | k8s_vims | functest | cnf | 09:06 | PASS |
- | helm_vims | functest | cnf | 08:54 | PASS |
- | cnf_conformance | functest | cnf | 02:00 | PASS |
+ | k8s_vims | functest | cnf | 09:27 | PASS |
+ | helm_vims | functest | cnf | 09:12 | PASS |
+ | cnf_conformance | functest | cnf | 02:55 | PASS |
+-------------------------+------------------+--------------+------------------+----------------+
Results are automatically pushed to the test results database, some additional