diff options
Diffstat (limited to 'docs/testing/user/userguide')
| -rw-r--r-- | docs/testing/user/userguide/test_results.rst | 117 |
1 files changed, 60 insertions, 57 deletions
diff --git a/docs/testing/user/userguide/test_results.rst b/docs/testing/user/userguide/test_results.rst index 2ac86f21f..7e13ef2b1 100644 --- a/docs/testing/user/userguide/test_results.rst +++ b/docs/testing/user/userguide/test_results.rst @@ -24,18 +24,18 @@ Healthcheck suite:: +--------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +--------------------------+------------------+---------------------+------------------+----------------+ - | connection_check | functest | healthcheck | 00:03 | PASS | - | tenantnetwork1 | functest | healthcheck | 00:05 | PASS | + | connection_check | functest | healthcheck | 00:02 | PASS | + | tenantnetwork1 | functest | healthcheck | 00:04 | PASS | | tenantnetwork2 | functest | healthcheck | 00:06 | PASS | - | vmready1 | functest | healthcheck | 00:06 | PASS | - | vmready2 | functest | healthcheck | 00:08 | PASS | - | singlevm1 | functest | healthcheck | 00:32 | PASS | - | singlevm2 | functest | healthcheck | 00:37 | PASS | - | vping_ssh | functest | healthcheck | 00:46 | PASS | - | vping_userdata | functest | healthcheck | 00:39 | PASS | - | cinder_test | functest | healthcheck | 01:05 | PASS | - | tempest_smoke | functest | healthcheck | 05:39 | PASS | - | tempest_horizon | functest | healthcheck | 01:05 | PASS | + | vmready1 | functest | healthcheck | 00:05 | PASS | + | vmready2 | functest | healthcheck | 00:06 | PASS | + | singlevm1 | functest | healthcheck | 00:31 | PASS | + | singlevm2 | functest | healthcheck | 00:35 | PASS | + | vping_ssh | functest | healthcheck | 00:47 | PASS | + | vping_userdata | functest | healthcheck | 00:42 | PASS | + | cinder_test | functest | healthcheck | 01:09 | PASS | + | tempest_smoke | functest | healthcheck | 04:50 | PASS | + | tempest_horizon | functest | healthcheck | 01:00 | PASS | | odl | functest | healthcheck | 00:00 | SKIP | +--------------------------+------------------+---------------------+------------------+----------------+ @@ -44,21 +44,24 @@ Smoke suite:: +---------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +---------------------------+------------------+---------------+------------------+----------------+ - | tempest_neutron | functest | smoke | 15:30 | PASS | - | tempest_cinder | functest | smoke | 02:01 | PASS | - | tempest_keystone | functest | smoke | 01:17 | PASS | - | tempest_heat | functest | smoke | 22:14 | PASS | - | tempest_telemetry | functest | smoke | 00:00 | SKIP | - | rally_sanity | functest | smoke | 17:24 | PASS | - | refstack_compute | functest | smoke | 07:03 | PASS | - | refstack_object | functest | smoke | 02:09 | PASS | - | refstack_platform | functest | smoke | 07:31 | PASS | - | tempest_full | functest | smoke | 41:52 | PASS | - | tempest_scenario | functest | smoke | 08:42 | PASS | - | tempest_slow | functest | smoke | 43:42 | PASS | - | patrole | functest | smoke | 02:42 | PASS | - | tempest_barbican | functest | smoke | 02:30 | PASS | + | tempest_neutron | functest | smoke | 11:58 | PASS | + | tempest_cinder | functest | smoke | 02:13 | PASS | + | tempest_keystone | functest | smoke | 01:18 | PASS | + | tempest_heat | functest | smoke | 23:24 | PASS | + | tempest_telemetry | functest | smoke | 01:54 | PASS | + | rally_sanity | functest | smoke | 20:29 | PASS | + | refstack_compute | functest | smoke | 05:16 | PASS | + | refstack_object | functest | smoke | 01:59 | PASS | + | refstack_platform | functest | smoke | 06:42 | PASS | + | tempest_full | functest | smoke | 31:30 | PASS | + | tempest_scenario | functest | smoke | 09:57 | PASS | + | tempest_slow | functest | smoke | 57:15 | PASS | + | patrole_admin | functest | smoke | 22:15 | PASS | + | patrole_member | functest | smoke | 23:58 | PASS | + | patrole_reader | functest | smoke | 22:15 | PASS | + | tempest_barbican | functest | smoke | 03:37 | PASS | | tempest_octavia | functest | smoke | 00:00 | SKIP | + | tempest_cyborg | functest | smoke | 00:00 | SKIP | +---------------------------+------------------+---------------+------------------+----------------+ Smoke CNTT suite:: @@ -66,14 +69,14 @@ Smoke CNTT suite:: +-------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-------------------------------+------------------+---------------+------------------+----------------+ - | tempest_neutron_cntt | functest | smoke | 11:35 | PASS | - | tempest_cinder_cntt | functest | smoke | 01:58 | PASS | - | tempest_keystone_cntt | functest | smoke | 01:13 | PASS | - | tempest_heat_cntt | functest | smoke | 22:32 | PASS | - | rally_sanity_cntt | functest | smoke | 17:16 | PASS | - | tempest_full_cntt | functest | smoke | 41:13 | PASS | - | tempest_scenario_cntt | functest | smoke | 08:57 | PASS | - | tempest_slow_cntt | functest | smoke | 35:58 | PASS | + | tempest_neutron_cntt | functest | smoke | 10:03 | PASS | + | tempest_cinder_cntt | functest | smoke | 02:10 | PASS | + | tempest_keystone_cntt | functest | smoke | 01:17 | PASS | + | tempest_heat_cntt | functest | smoke | 22:44 | PASS | + | rally_sanity_cntt | functest | smoke | 17:37 | PASS | + | tempest_full_cntt | functest | smoke | 29:48 | PASS | + | tempest_scenario_cntt | functest | smoke | 09:59 | PASS | + | tempest_slow_cntt | functest | smoke | 41:57 | PASS | +-------------------------------+------------------+---------------+------------------+----------------+ Benchmarking suite:: @@ -81,10 +84,10 @@ Benchmarking suite:: +--------------------+------------------+----------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +--------------------+------------------+----------------------+------------------+----------------+ - | rally_full | functest | benchmarking | 93:03 | PASS | - | rally_jobs | functest | benchmarking | 27:05 | PASS | - | vmtp | functest | benchmarking | 17:56 | PASS | - | shaker | functest | benchmarking | 24:02 | PASS | + | rally_full | functest | benchmarking | 104:28 | PASS | + | rally_jobs | functest | benchmarking | 30:00 | PASS | + | vmtp | functest | benchmarking | 23:43 | PASS | + | shaker | functest | benchmarking | 28:49 | PASS | +--------------------+------------------+----------------------+------------------+----------------+ Benchmarking CNTT suite:: @@ -92,10 +95,10 @@ Benchmarking CNTT suite:: +-------------------------+------------------+----------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-------------------------+------------------+----------------------+------------------+----------------+ - | rally_full_cntt | functest | benchmarking | 89:52 | PASS | - | rally_jobs_cntt | functest | benchmarking | 19:39 | PASS | - | vmtp | functest | benchmarking | 16:59 | PASS | - | shaker | functest | benchmarking | 23:43 | PASS | + | rally_full_cntt | functest | benchmarking | 90:27 | PASS | + | rally_jobs_cntt | functest | benchmarking | 22:58 | PASS | + | vmtp | functest | benchmarking | 23:43 | PASS | + | shaker | functest | benchmarking | 28:49 | PASS | +-------------------------+------------------+----------------------+------------------+----------------+ Vnf suite:: @@ -103,11 +106,11 @@ Vnf suite:: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ - | cloudify | functest | vnf | 05:08 | PASS | - | cloudify_ims | functest | vnf | 24:46 | PASS | - | heat_ims | functest | vnf | 33:12 | PASS | - | vyos_vrouter | functest | vnf | 15:53 | PASS | - | juju_epc | functest | vnf | 27:52 | PASS | + | cloudify | functest | vnf | 04:23 | PASS | + | cloudify_ims | functest | vnf | 24:42 | PASS | + | heat_ims | functest | vnf | 30:33 | PASS | + | vyos_vrouter | functest | vnf | 17:31 | PASS | + | juju_epc | functest | vnf | 37:21 | PASS | +----------------------+------------------+--------------+------------------+----------------+ Kubernetes healthcheck suite:: @@ -115,8 +118,8 @@ Kubernetes healthcheck suite:: +-------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-------------------+------------------+---------------------+------------------+----------------+ - | k8s_quick | functest | healthcheck | 00:18 | PASS | - | k8s_smoke | functest | healthcheck | 01:14 | PASS | + | k8s_quick | functest | healthcheck | 00:13 | PASS | + | k8s_smoke | functest | healthcheck | 00:26 | PASS | +-------------------+------------------+---------------------+------------------+----------------+ Kubernetes smoke suite:: @@ -124,8 +127,8 @@ Kubernetes smoke suite:: +---------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +---------------------------+------------------+---------------+------------------+----------------+ - | k8s_conformance | functest | smoke | 94:26 | PASS | - | xrally_kubernetes | functest | smoke | 13:05 | PASS | + | k8s_conformance | functest | smoke | 103:05 | PASS | + | xrally_kubernetes | functest | smoke | 14:17 | PASS | +---------------------------+------------------+---------------+------------------+----------------+ Kubernetes security suite:: @@ -133,9 +136,9 @@ Kubernetes security suite:: +---------------------------+------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +---------------------------+------------------+------------------+------------------+----------------+ - | kube_hunter | functest | security | 00:19 | PASS | - | kube_bench_master | functest | security | 00:02 | PASS | - | kube_bench_node | functest | security | 00:01 | PASS | + | kube_hunter | functest | security | 00:18 | PASS | + | kube_bench_master | functest | security | 00:07 | PASS | + | kube_bench_node | functest | security | 00:06 | PASS | +---------------------------+------------------+------------------+------------------+----------------+ Kubernetes benchmarking suite:: @@ -143,7 +146,7 @@ Kubernetes benchmarking suite:: +--------------------------------+------------------+----------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +--------------------------------+------------------+----------------------+------------------+----------------+ - | xrally_kubernetes_full | functest | benchmarking | 34:16 | PASS | + | xrally_kubernetes_full | functest | benchmarking | 39:15 | PASS | +--------------------------------+------------------+----------------------+------------------+----------------+ Kubernetes cnf suite:: @@ -151,9 +154,9 @@ Kubernetes cnf suite:: +-------------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-------------------------+------------------+--------------+------------------+----------------+ - | k8s_vims | functest | cnf | 09:06 | PASS | - | helm_vims | functest | cnf | 08:54 | PASS | - | cnf_conformance | functest | cnf | 02:00 | PASS | + | k8s_vims | functest | cnf | 09:27 | PASS | + | helm_vims | functest | cnf | 09:12 | PASS | + | cnf_conformance | functest | cnf | 02:55 | PASS | +-------------------------+------------------+--------------+------------------+----------------+ Results are automatically pushed to the test results database, some additional |