aboutsummaryrefslogtreecommitdiffstats
path: root/docs/testing/user/userguide/test_results.rst
diff options
context:
space:
mode:
Diffstat (limited to 'docs/testing/user/userguide/test_results.rst')
-rw-r--r--docs/testing/user/userguide/test_results.rst103
1 files changed, 65 insertions, 38 deletions
diff --git a/docs/testing/user/userguide/test_results.rst b/docs/testing/user/userguide/test_results.rst
index 8ee755371..4b1f20a55 100644
--- a/docs/testing/user/userguide/test_results.rst
+++ b/docs/testing/user/userguide/test_results.rst
@@ -24,62 +24,89 @@ Healthcheck suite::
+--------------------------+------------------+---------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+--------------------------+------------------+---------------------+------------------+----------------+
- | connection_check | functest | healthcheck | 00:03 | PASS |
- | tenantnetwork1 | functest | healthcheck | 00:06 | PASS |
- | tenantnetwork2 | functest | healthcheck | 00:08 | PASS |
- | vmready1 | functest | healthcheck | 00:08 | PASS |
- | vmready2 | functest | healthcheck | 00:10 | PASS |
- | singlevm1 | functest | healthcheck | 00:31 | PASS |
- | singlevm2 | functest | healthcheck | 00:29 | PASS |
- | vping_ssh | functest | healthcheck | 00:37 | PASS |
- | vping_userdata | functest | healthcheck | 00:36 | PASS |
- | cinder_test | functest | healthcheck | 01:05 | PASS |
- | tempest_smoke | functest | healthcheck | 04:58 | PASS |
+ | connection_check | functest | healthcheck | 00:02 | PASS |
+ | tenantnetwork1 | functest | healthcheck | 00:04 | PASS |
+ | tenantnetwork2 | functest | healthcheck | 00:05 | PASS |
+ | vmready1 | functest | healthcheck | 00:05 | PASS |
+ | vmready2 | functest | healthcheck | 00:08 | PASS |
+ | singlevm1 | functest | healthcheck | 00:35 | PASS |
+ | singlevm2 | functest | healthcheck | 00:34 | PASS |
+ | vping_ssh | functest | healthcheck | 00:44 | PASS |
+ | vping_userdata | functest | healthcheck | 00:30 | PASS |
+ | cinder_test | functest | healthcheck | 01:10 | PASS |
+ | tempest_smoke | functest | healthcheck | 11:18 | PASS |
+ | tempest_horizon | functest | healthcheck | 01:15 | PASS |
| odl | functest | healthcheck | 00:00 | SKIP |
+--------------------------+------------------+---------------------+------------------+----------------+
Smoke suite::
- +------------------------------------+------------------+---------------+------------------+----------------+
- | TEST CASE | PROJECT | TIER | DURATION | RESULT |
- +------------------------------------+------------------+---------------+------------------+----------------+
- | neutron-tempest-plugin-api | functest | smoke | 10:35 | PASS |
- | rally_sanity | functest | smoke | 17:11 | PASS |
- | refstack_compute | functest | smoke | 06:09 | PASS |
- | refstack_object | functest | smoke | 01:48 | PASS |
- | refstack_platform | functest | smoke | 05:53 | PASS |
- | tempest_full | functest | smoke | 30:02 | PASS |
- | tempest_scenario | functest | smoke | 09:26 | PASS |
- | tempest_slow | functest | smoke | 18:53 | PASS |
- | patrole | functest | smoke | 02:28 | PASS |
- | barbican | functest | smoke | 02:13 | PASS |
- | neutron_trunk | functest | smoke | 00:00 | SKIP |
- | networking-bgpvpn | functest | smoke | 00:00 | SKIP |
- | networking-sfc | functest | smoke | 00:00 | SKIP |
- | octavia | functest | smoke | 00:00 | SKIP |
- +------------------------------------+------------------+---------------+------------------+----------------+
+ +---------------------------+------------------+---------------+------------------+----------------+
+ | TEST CASE | PROJECT | TIER | DURATION | RESULT |
+ +---------------------------+------------------+---------------+------------------+----------------+
+ | tempest_neutron | functest | smoke | 14:49 | PASS |
+ | tempest_cinder | functest | smoke | 01:40 | PASS |
+ | tempest_keystone | functest | smoke | 01:12 | PASS |
+ | tempest_heat | functest | smoke | 21:53 | PASS |
+ | rally_sanity | functest | smoke | 17:10 | PASS |
+ | refstack_compute | functest | smoke | 07:53 | PASS |
+ | refstack_object | functest | smoke | 01:59 | PASS |
+ | refstack_platform | functest | smoke | 07:52 | PASS |
+ | tempest_full | functest | smoke | 34:39 | PASS |
+ | tempest_scenario | functest | smoke | 08:30 | PASS |
+ | tempest_slow | functest | smoke | 44:40 | PASS |
+ | patrole | functest | smoke | 02:43 | PASS |
+ | tempest_barbican | functest | smoke | 02:26 | PASS |
+ | tempest_octavia | functest | smoke | 00:00 | SKIP |
+ +---------------------------+------------------+---------------+------------------+----------------+
+
+Smoke CNTT suite::
+
+ +-------------------------------+------------------+---------------+------------------+----------------+
+ | TEST CASE | PROJECT | TIER | DURATION | RESULT |
+ +-------------------------------+------------------+---------------+------------------+----------------+
+ | tempest_neutron_cntt | functest | smoke | 12:21 | PASS |
+ | tempest_cinder_cntt | functest | smoke | 01:31 | PASS |
+ | tempest_keystone_cntt | functest | smoke | 01:08 | PASS |
+ | tempest_heat_cntt | functest | smoke | 21:47 | PASS |
+ | rally_sanity_cntt | functest | smoke | 16:09 | PASS |
+ | tempest_full_cntt | functest | smoke | 39:11 | PASS |
+ | tempest_scenario_cntt | functest | smoke | 08:32 | PASS |
+ | tempest_slow_cntt | functest | smoke | 32:22 | PASS |
+ +-------------------------------+------------------+---------------+------------------+----------------+
Benchmarking suite::
+--------------------+------------------+----------------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+--------------------+------------------+----------------------+------------------+----------------+
- | rally_full | functest | benchmarking | 92:42 | PASS |
- | rally_jobs | functest | benchmarking | 18:44 | PASS |
- | vmtp | functest | benchmarking | 15:20 | PASS |
- | shaker | functest | benchmarking | 23:54 | PASS |
+ | rally_full | functest | benchmarking | 91:42 | PASS |
+ | rally_jobs | functest | benchmarking | 25:24 | PASS |
+ | vmtp | functest | benchmarking | 16:47 | PASS |
+ | shaker | functest | benchmarking | 23:43 | PASS |
+--------------------+------------------+----------------------+------------------+----------------+
+Benchmarking CNTT suite::
+
+ +-------------------------+------------------+----------------------+------------------+----------------+
+ | TEST CASE | PROJECT | TIER | DURATION | RESULT |
+ +-------------------------+------------------+----------------------+------------------+----------------+
+ | rally_full_cntt | functest | benchmarking | 86:41 | PASS |
+ | rally_jobs_cntt | functest | benchmarking | 19:16 | PASS |
+ | vmtp | functest | benchmarking | 17:05 | PASS |
+ | shaker | functest | benchmarking | 23:33 | PASS |
+ +-------------------------+------------------+----------------------+------------------+----------------+
+
Vnf suite::
+----------------------+------------------+--------------+------------------+----------------+
| TEST CASE | PROJECT | TIER | DURATION | RESULT |
+----------------------+------------------+--------------+------------------+----------------+
- | cloudify | functest | vnf | 03:50 | PASS |
- | cloudify_ims | functest | vnf | 22:34 | PASS |
- | heat_ims | functest | vnf | 32:39 | PASS |
- | vyos_vrouter | functest | vnf | 15:10 | PASS |
- | juju_epc | functest | vnf | 37:03 | PASS |
+ | cloudify | functest | vnf | 04:41 | PASS |
+ | cloudify_ims | functest | vnf | 21:03 | PASS |
+ | heat_ims | functest | vnf | 30:04 | PASS |
+ | vyos_vrouter | functest | vnf | 16:21 | PASS |
+ | juju_epc | functest | vnf | 28:33 | PASS |
+----------------------+------------------+--------------+------------------+----------------+
Kubernetes healthcheck suite::