diff options
Diffstat (limited to 'docs/results')
| -rw-r--r-- | docs/results/fuel-os-nosdn-kvm-ha.rst | 10 | ||||
| -rw-r--r-- | docs/results/fuel-os-nosdn-nofeature-ha.rst | 2277 | ||||
| -rw-r--r-- | docs/results/fuel-os-nosdn-ovs-ha.rst | 2277 | ||||
| -rw-r--r-- | docs/results/fuel-os-odl_l2-bgpvpn-ha.rst | 10 | ||||
| -rw-r--r-- | docs/results/fuel-os-odl_l2-nofeature-ha.rst | 2385 | ||||
| -rw-r--r-- | docs/results/fuel-os-odl_l3-nofeature-ha.rst | 10 | ||||
| -rw-r--r-- | docs/results/fuel-os-onos-nofeature-ha.rst | 2608 |
7 files changed, 9531 insertions, 46 deletions
diff --git a/docs/results/fuel-os-nosdn-kvm-ha.rst b/docs/results/fuel-os-nosdn-kvm-ha.rst deleted file mode 100644 index a63aff27..00000000 --- a/docs/results/fuel-os-nosdn-kvm-ha.rst +++ /dev/null @@ -1,10 +0,0 @@ -.. This work is licensed under a Creative Commons Attribution 4.0 International Licence. -.. http://creativecommons.org/licenses/by/4.0 - -Test results for fuel-os-nosdn-kvm-ha -===================================== - -.. Add any text in here that could be useful for a reader. - -.. Add the test results in a consistent format. - diff --git a/docs/results/fuel-os-nosdn-nofeature-ha.rst b/docs/results/fuel-os-nosdn-nofeature-ha.rst index a856212c..88565a2d 100644 --- a/docs/results/fuel-os-nosdn-nofeature-ha.rst +++ b/docs/results/fuel-os-nosdn-nofeature-ha.rst @@ -1,10 +1,2279 @@ .. This work is licensed under a Creative Commons Attribution 4.0 International Licence. .. http://creativecommons.org/licenses/by/4.0 -Test results for fuel-os-nosdn-nofeature-ha -=========================================== +Detailed test results for fuel-os-nosdn-nofeature-ha +------------------------------------------------------- -.. Add any text in here that could be useful for a reader. +The following section outlines the detailed Functest results for the Brahmaputra scenario +deploying OpenStack in a Pharos environment by the Fuel installer. -.. Add the test results in a consistent format. +vPing_SSH +^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-SSH test... + vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_ssh- INFO - Creating neutron network vping-net... + vPing_ssh- INFO - Creating security group 'vPing-sg'... + vPing_ssh- INFO - Using existing Flavor 'm1.small'... + vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35' + vPing_ssh- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + + vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'... + vPing_ssh- INFO - Floating IP created: '10.118.101.200' + vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2' + vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200... + vPing_ssh- INFO - Waiting for ping... + vPing_ssh- INFO - vPing detected! + vPing_ssh- INFO - vPing duration:'42.1' s. + vPing_ssh- INFO - Cleaning up... + vPing_ssh- INFO - vPing OK +:: + + +vPing_userdata +^^^^^^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-userdata test... + vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_userdata- INFO - Creating neutron network vping-net... + vPing_userdata- INFO - Creating security group 'vPing-sg'... + vPing_userdata- INFO - Flavor found 'm1.small' + vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00' + vPing_userdata- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + + vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_userdata- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + userdata= + #!/bin/sh + + while true; do + ping -c 1 192.168.130.4 2>&1 >/dev/null + RES=$? + if [ "Z$RES" = "Z0" ] ; then + echo 'vPing OK' + break + else + echo 'vPing KO' + fi + sleep 1 + done + + vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_userdata- INFO - Waiting for ping... + vPing_userdata- INFO - vPing detected! + vPing_userdata- INFO - vPing duration:'28.6' + vPing_userdata- INFO - vPing OK + vPing_userdata- INFO - Cleaning up... + vPing_userdata- INFO - Deleting network 'vping-net'... +:: + + +Tempest +^^^^^^^ +:: + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | name | time | status | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.29312 | success | + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.12976 | success | + | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 23.95577 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 32.53650 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 22.68958 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.54691 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.30066 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.57103 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.97553 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.37256 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.33110 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.34175 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.35964 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.62128 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.88552 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.35258 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 1.14056 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.64330 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.59904 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.85262 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.89806 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.43298 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 2.74835 | success | + | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 7.51973 | success | + | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 17.31905 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.11526 | success | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 4.43153 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.49287 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.32071 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.24839 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.62886 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.45498 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.11221 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.07743 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.07866 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.08414 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.09610 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.87584 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00178 | skip | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.18671 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.07254 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.02355 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.09336 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08789 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.02832 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.01969 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.05608 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.09405 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.07124 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 1.09862 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.02806 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.10085 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.00074 | skip | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 7.05293 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 12.83974 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 75.96327 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.89960 | skip | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 86.10969 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 14.36274 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 25.20801 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 9.79668 | success | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.10422 | success | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.45171 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.71962 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.37393 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.39671 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.67878 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.96139 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.70247 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 5.01425 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 21.66147 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 29.15375 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 17.01011 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 15.12162 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 2.32047 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 2.43351 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 3.54755 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 3.49832 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 1.66971 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.67563 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.52468 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 2.11125 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.11519 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 1.59954 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 2.71532 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.67781 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.80861 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.12394 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.98070 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.95038 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.58962 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.76753 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.92874 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 1.98170 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.09696 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.23813 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02568 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.73035 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.03287 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.61622 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.10251 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.32244 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.05310 | success | + | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 46.35639 | success | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 1.19554 | success | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.13783 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.28038 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.02405 | success | + | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail | + | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.0 | fail | + | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.0 | fail | + | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.06799 | success | + | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.70652 | success | + | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.56777 | success | + | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.34317 | success | + | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.61946 | success | + | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.0 | fail | + | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.55157 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10777 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.09198 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.08536 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.12301 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.19557 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.11454 | success | + | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.58158 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.96230 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 3.11881 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 31.78599 | success | + | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 6.18197 | success | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.36573 | fail | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 4.19923 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 2.05001 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 2.85155 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 4.85758 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 2.47936 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 4.29082 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 4.14373 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 2.85702 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.63578 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.44139 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.31069 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.31575 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.34149 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 2.96967 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.61978 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.30406 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.29284 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.07605 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.28866 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 3.34364 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 2.65709 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.51327 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.34515 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.34468 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 3.78910 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 3.78827 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.58076 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.35346 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.38372 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 8.02302 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 5.55884 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 4.89503 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 3.13616 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 7.91220 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.35397 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 4.24212 | success | + | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 3.20634 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 2.00386 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.26379 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.29497 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.34355 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.27875 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.05434 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.63001 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 7.10424 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.06177 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.0 | fail | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.98140 | success | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.05857 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 19.61269 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 4.21790 | success | + | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.96832 | success | + | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.59962 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 14.77900 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 19.28760 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 14.36310 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 24.02107 | success | + | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.05931 | success | + | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.31742 | success | + | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 54.55460 | success | + | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 41.67013 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 109.37734 | success | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 61.05784 | fail | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + run_tempest - INFO - Results: {'timestart': '2016-02-1813:29:52.500975', 'duration': 416, 'tests': 210, 'failures': 25} +:: + + +vIMS +^^^^ +:: + FUNCTEST.info: Running vIMS test... + vIMS - INFO - Prepare OpenStack plateform (create tenant and user) + vIMS - INFO - Update OpenStack creds informations + vIMS - INFO - Upload some OS images if it doesn't exist + vIMS - INFO - centos_7 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - Update security group quota for this tenant + vIMS - INFO - Update cinder quota for this tenant + vIMS - INFO - Collect flavor id for cloudify manager server + vIMS - INFO - Prepare virtualenv for cloudify-cli + vIMS - INFO - Downloading the cloudify manager server blueprint + vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47' + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the cloudify-manager deployment + vIMS - INFO - Cloudify-manager server is UP ! + vIMS - INFO - Cloudify deployment duration:'1149.9' + vIMS - INFO - Collect flavor id for all clearwater vm + vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00' + vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the clearwater deployment + vIMS - INFO - The deployment of clearwater-opnfv is ended + vIMS - INFO - vIMS VNF deployment duration:'1133.8' + vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59' + vIMS - INFO - vIMS functional test duration:'2.9' + vIMS - INFO - Launching the clearwater-opnfv undeployment + vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; ' + vIMS - INFO - Launching the cloudify-manager undeployment + vIMS - INFO - Cloudify-manager server has been successfully removed! + vIMS - INFO - Removing vIMS tenant .. + vIMS - INFO - Removing vIMS user .. +:: + + +Promise +^^^^^^^ +:: + FUNCTEST.info: Running PROMISE test case... + Promise- INFO - Creating tenant 'promise'... + Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'... + Promise- INFO - Creating user 'promiser'... + Promise- INFO - Updating OpenStack credentials... + Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + Promise- INFO - Creating flavor 'promise-flavor'... + Promise- INFO - Exporting environment variables... + Promise- INFO - Running command: npm run -s test -- --reporter json + Promise- INFO - The test succeeded. + Promise- DEBUG - + { + "stats": { + "suites": 23, + "tests": 33, + "passes": 33, + "pending": 0, + "failures": 0, + "start": "2016-02-18T13:37:06.661Z", + "end": "2016-02-18T13:37:12.962Z", + "duration": 5524 + }, + "tests": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ], + "pending": [], + "failures": [], + "passes": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ] + } + Promise- INFO - + **************************************** + Promise test report + + **************************************** + Suites: 23 + Tests: 33 + Passes: 33 + Pending: 0 + Failures: 0 + Start: 2016-02-18T13:37:06.661Z + End: 2016-02-18T13:37:12.962Z + Duration: 6.301 + **************************************** +:: + + + +Rally +^^^^^ +:: + FUNCTEST.info: Running Rally benchmark suite... + run_rally - INFO - Starting test scenario "authenticate" ... + run_rally - INFO - + Preparing input task + Task 2ff4981a-75d9-4de4-a111-3194115c4a00: started + Task 2ff4981a-75d9-4de4-a111-3194115c4a00: finished + + test scenario Authenticate.validate_glance + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_glance | 0.534 | 0.569 | 0.722 | 0.818 | 0.914 | 0.618 | 100.0% | 10 | + | authenticate.validate_glance (2) | 0.512 | 0.609 | 0.713 | 0.766 | 0.818 | 0.631 | 100.0% | 10 | + | total | 1.257 | 1.358 | 1.703 | 1.715 | 1.726 | 1.418 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.01803302765 + Full duration: 11.7534348965 + + + + test scenario Authenticate.keystone + +-----------------------------------------------------------------------------+ + | Response Times (sec) | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | total | 0.132 | 0.154 | 0.172 | 0.172 | 0.173 | 0.155 | 100.0% | 10 | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.491301059723 + Full duration: 8.25924301147 + + + + test scenario Authenticate.validate_heat + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_heat | 0.297 | 0.32 | 0.355 | 0.359 | 0.363 | 0.324 | 100.0% | 10 | + | authenticate.validate_heat (2) | 0.043 | 0.056 | 0.302 | 0.304 | 0.307 | 0.127 | 100.0% | 10 | + | total | 0.499 | 0.607 | 0.769 | 0.82 | 0.87 | 0.629 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.91573691368 + Full duration: 10.0396120548 + + + + test scenario Authenticate.validate_nova + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_nova | 0.306 | 0.35 | 0.534 | 0.554 | 0.574 | 0.407 | 100.0% | 10 | + | authenticate.validate_nova (2) | 0.037 | 0.059 | 0.07 | 0.081 | 0.092 | 0.059 | 100.0% | 10 | + | total | 0.526 | 0.596 | 0.771 | 0.782 | 0.792 | 0.639 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.9150788784 + Full duration: 9.77701401711 + + + + test scenario Authenticate.validate_cinder + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_cinder | 0.268 | 0.315 | 0.353 | 0.475 | 0.596 | 0.334 | 100.0% | 10 | + | authenticate.validate_cinder (2) | 0.025 | 0.282 | 0.314 | 0.323 | 0.331 | 0.264 | 100.0% | 10 | + | total | 0.721 | 0.78 | 0.827 | 0.837 | 0.847 | 0.779 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.34766292572 + Full duration: 10.0672118664 + + + + test scenario Authenticate.validate_neutron + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_neutron | 0.266 | 0.305 | 0.386 | 0.399 | 0.411 | 0.319 | 100.0% | 10 | + | authenticate.validate_neutron (2) | 0.043 | 0.291 | 0.375 | 0.403 | 0.432 | 0.241 | 100.0% | 10 | + | total | 0.483 | 0.76 | 0.908 | 0.914 | 0.92 | 0.729 | 100.0% | 10 | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.25539779663 + Full duration: 9.62706780434 + + + + run_rally - INFO - Test scenario: "authenticate" OK. + + run_rally - INFO - Starting test scenario "glance" ... + run_rally - INFO - + Preparing input task + Task 9fb726cd-f20e-4f95-b32f-5928c72cf58d: started + Task 9fb726cd-f20e-4f95-b32f-5928c72cf58d: finished + + test scenario GlanceImages.list_images + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.list_images | 0.72 | 0.85 | 0.942 | 0.947 | 0.951 | 0.833 | 100.0% | 10 | + | total | 0.721 | 0.85 | 0.943 | 0.947 | 0.951 | 0.834 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.45959687233 + Full duration: 12.9740490913 + + + + test scenario GlanceImages.create_image_and_boot_instances + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | glance.create_image | 7.498 | 7.743 | 17.964 | 19.73 | 21.495 | 10.171 | 100.0% | 10 | + | nova.boot_servers | 13.174 | 14.424 | 15.318 | 15.539 | 15.76 | 14.34 | 100.0% | 10 | + | total | 20.863 | 22.368 | 32.383 | 33.741 | 35.099 | 24.511 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 68.7006659508 + Full duration: 127.436779022 + + + + test scenario GlanceImages.create_and_list_image + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.create_image | 7.303 | 7.684 | 7.837 | 7.911 | 7.984 | 7.63 | 100.0% | 10 | + | glance.list_images | 0.328 | 0.583 | 0.697 | 0.698 | 0.699 | 0.574 | 100.0% | 10 | + | total | 7.862 | 8.283 | 8.38 | 8.472 | 8.564 | 8.205 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 24.5710179806 + Full duration: 37.9533209801 + + + + test scenario GlanceImages.create_and_delete_image + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | glance.create_image | 7.448 | 7.605 | 7.805 | 7.817 | 7.829 | 7.617 | 100.0% | 10 | + | glance.delete_image | 2.01 | 2.372 | 2.628 | 2.686 | 2.743 | 2.393 | 100.0% | 10 | + | total | 9.506 | 9.976 | 10.387 | 10.466 | 10.545 | 10.01 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 30.0124220848 + Full duration: 40.2773120403 + + + + run_rally - INFO - Test scenario: "glance" OK. + + run_rally - INFO - Starting test scenario "cinder" ... + run_rally - INFO - + Preparing input task + Task a724f287-e014-40ef-8e87-173e5eb2b0a2: started + Task a724f287-e014-40ef-8e87-173e5eb2b0a2: finished + + test scenario CinderVolumes.create_and_attach_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 10.889 | 13.965 | 14.695 | 14.724 | 14.752 | 13.234 | 100.0% | 10 | + | cinder.create_volume | 3.218 | 3.812 | 4.128 | 4.214 | 4.3 | 3.776 | 100.0% | 10 | + | nova.attach_volume | 3.737 | 4.69 | 4.963 | 5.092 | 5.222 | 4.612 | 100.0% | 10 | + | nova.detach_volume | 3.18 | 3.917 | 4.273 | 4.325 | 4.377 | 3.867 | 100.0% | 10 | + | cinder.delete_volume | 0.489 | 2.54 | 2.801 | 2.886 | 2.972 | 2.261 | 100.0% | 10 | + | nova.delete_server | 2.527 | 2.94 | 3.218 | 3.228 | 3.239 | 2.926 | 100.0% | 10 | + | total | 26.351 | 30.9 | 32.731 | 33.273 | 33.815 | 30.677 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 91.1857719421 + Full duration: 133.454293013 + + + + test scenario CinderVolumes.create_and_list_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | cinder.create_volume | 7.415 | 9.652 | 10.383 | 10.548 | 10.713 | 9.48 | 100.0% | 10 | + | cinder.list_volumes | 0.072 | 0.328 | 0.4 | 0.407 | 0.415 | 0.295 | 100.0% | 10 | + | total | 7.76 | 10.022 | 10.706 | 10.88 | 11.054 | 9.775 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 28.0870580673 + Full duration: 51.2606179714 + + + + test scenario CinderVolumes.create_and_list_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.521 | 4.03 | 4.785 | 4.869 | 4.953 | 4.19 | 100.0% | 10 | + | cinder.list_volumes | 0.062 | 0.347 | 0.411 | 0.426 | 0.44 | 0.308 | 100.0% | 10 | + | total | 3.852 | 4.421 | 5.139 | 5.227 | 5.315 | 4.499 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 13.1967639923 + Full duration: 35.2137930393 + + + + test scenario CinderVolumes.create_and_list_snapshots + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 2.957 | 3.349 | 5.449 | 5.627 | 5.805 | 3.738 | 100.0% | 10 | + | cinder.list_snapshots | 0.028 | 0.304 | 0.348 | 0.382 | 0.416 | 0.213 | 100.0% | 10 | + | total | 3.259 | 3.42 | 5.776 | 5.945 | 6.113 | 3.952 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.5537779331 + Full duration: 49.7043690681 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.281 | 3.907 | 4.106 | 4.128 | 4.15 | 3.806 | 100.0% | 10 | + | cinder.delete_volume | 0.788 | 2.667 | 3.082 | 3.16 | 3.239 | 2.256 | 100.0% | 10 | + | total | 4.617 | 6.29 | 6.997 | 7.066 | 7.135 | 6.063 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.3220980167 + Full duration: 36.1331720352 + + + + test scenario CinderVolumes.create_and_delete_volume + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 8.901 | 9.932 | 10.338 | 10.395 | 10.452 | 9.781 | 100.0% | 10 | + | cinder.delete_volume | 0.579 | 1.672 | 2.856 | 2.952 | 3.049 | 1.773 | 100.0% | 10 | + | total | 9.725 | 11.645 | 12.996 | 13.017 | 13.039 | 11.554 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 35.517152071 + Full duration: 54.0071978569 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.596 | 3.887 | 4.71 | 4.712 | 4.715 | 4.08 | 100.0% | 10 | + | cinder.delete_volume | 0.512 | 0.923 | 1.297 | 2.319 | 3.341 | 1.114 | 100.0% | 10 | + | total | 4.381 | 4.91 | 5.923 | 6.573 | 7.223 | 5.195 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 15.0102190971 + Full duration: 33.4934709072 + + + + test scenario CinderVolumes.create_and_upload_volume_to_image + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.512 | 3.838 | 4.155 | 4.202 | 4.249 | 3.861 | 100.0% | 10 | + | cinder.upload_volume_to_image | 16.283 | 24.737 | 33.632 | 38.034 | 42.436 | 26.102 | 100.0% | 10 | + | cinder.delete_volume | 0.583 | 1.719 | 3.056 | 3.165 | 3.274 | 1.853 | 100.0% | 10 | + | nova.delete_image | 2.514 | 2.856 | 13.194 | 14.749 | 16.305 | 5.182 | 100.0% | 10 | + | total | 23.887 | 34.293 | 49.972 | 51.48 | 52.988 | 36.998 | 100.0% | 10 | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 107.503821135 + Full duration: 129.166619062 + + + + test scenario CinderVolumes.create_and_delete_snapshot + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 3.064 | 3.257 | 3.408 | 3.415 | 3.422 | 3.261 | 100.0% | 10 | + | cinder.delete_snapshot | 2.586 | 2.915 | 3.148 | 3.165 | 3.181 | 2.938 | 100.0% | 10 | + | total | 5.837 | 6.18 | 6.465 | 6.534 | 6.603 | 6.199 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.601981163 + Full duration: 53.3941659927 + + + + test scenario CinderVolumes.create_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.424 | 3.854 | 4.025 | 4.05 | 4.075 | 3.808 | 100.0% | 10 | + | total | 3.424 | 3.854 | 4.025 | 4.05 | 4.075 | 3.808 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.3824880123 + Full duration: 30.7913680077 + + + + test scenario CinderVolumes.create_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.391 | 3.979 | 4.585 | 4.6 | 4.616 | 3.999 | 100.0% | 10 | + | total | 3.391 | 3.979 | 4.585 | 4.601 | 4.616 | 3.999 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 12.107943058 + Full duration: 36.5596921444 + + + + test scenario CinderVolumes.list_volumes + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.list_volumes | 0.478 | 0.562 | 0.711 | 0.746 | 0.781 | 0.587 | 100.0% | 10 | + | total | 0.479 | 0.562 | 0.711 | 0.746 | 0.781 | 0.587 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.79518508911 + Full duration: 65.9313700199 + + + + test scenario CinderVolumes.create_nested_snapshots_and_attach_volume + +-----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.557 | 3.914 | 4.206 | 4.213 | 4.22 | 3.884 | 100.0% | 10 | + | cinder.create_snapshot | 2.701 | 3.063 | 3.248 | 3.251 | 3.254 | 3.06 | 100.0% | 10 | + | nova.attach_volume | 3.75 | 4.986 | 6.112 | 6.385 | 6.658 | 5.059 | 100.0% | 10 | + | nova.detach_volume | 3.149 | 3.81 | 4.11 | 4.168 | 4.225 | 3.762 | 100.0% | 10 | + | cinder.delete_snapshot | 2.241 | 2.766 | 3.077 | 3.102 | 3.128 | 2.725 | 100.0% | 10 | + | cinder.delete_volume | 0.748 | 2.428 | 2.712 | 2.772 | 2.831 | 1.912 | 100.0% | 10 | + | total | 19.22 | 21.354 | 24.347 | 24.725 | 25.102 | 21.684 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 64.028840065 + Full duration: 186.598311901 + + + + test scenario CinderVolumes.create_from_volume_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.539 | 4.149 | 4.62 | 4.622 | 4.623 | 4.106 | 100.0% | 10 | + | cinder.delete_volume | 2.844 | 3.223 | 3.604 | 3.609 | 3.614 | 3.235 | 100.0% | 10 | + | total | 6.383 | 7.559 | 7.85 | 7.868 | 7.886 | 7.341 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 21.6859838963 + Full duration: 55.5635709763 + + + + test scenario CinderVolumes.create_and_extend_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | cinder.create_volume | 3.434 | 3.852 | 3.99 | 4.004 | 4.018 | 3.842 | 100.0% | 10 | + | cinder.extend_volume | 0.955 | 2.236 | 3.552 | 3.564 | 3.576 | 2.281 | 100.0% | 10 | + | cinder.delete_volume | 0.868 | 3.015 | 3.332 | 3.398 | 3.465 | 2.861 | 100.0% | 10 | + | total | 5.962 | 9.186 | 10.497 | 10.52 | 10.544 | 8.984 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 28.1479110718 + Full duration: 47.0005409718 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.595 | 3.868 | 4.206 | 4.208 | 4.211 | 3.886 | 100.0% | 10 | + | cinder.create_snapshot | 2.595 | 3.131 | 3.249 | 3.258 | 3.267 | 3.037 | 100.0% | 10 | + | nova.attach_volume | 4.101 | 4.563 | 5.363 | 7.225 | 9.087 | 4.928 | 100.0% | 10 | + | nova.detach_volume | 3.299 | 3.896 | 4.226 | 4.274 | 4.323 | 3.816 | 100.0% | 10 | + | cinder.delete_snapshot | 2.27 | 2.573 | 2.884 | 3.105 | 3.325 | 2.635 | 100.0% | 10 | + | cinder.delete_volume | 0.611 | 2.479 | 2.742 | 2.863 | 2.983 | 2.239 | 100.0% | 10 | + | total | 19.728 | 21.533 | 22.719 | 24.643 | 26.568 | 21.737 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 62.6771988869 + Full duration: 187.817504883 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.255 | 3.476 | 4.793 | 4.86 | 4.926 | 3.766 | 100.0% | 10 | + | cinder.create_snapshot | 2.387 | 2.868 | 3.304 | 3.311 | 3.318 | 2.906 | 100.0% | 10 | + | nova.attach_volume | 3.864 | 4.167 | 4.94 | 5.864 | 6.787 | 4.392 | 100.0% | 10 | + | nova.detach_volume | 3.699 | 4.047 | 4.388 | 4.408 | 4.428 | 4.066 | 100.0% | 10 | + | cinder.delete_snapshot | 2.492 | 2.621 | 2.825 | 2.828 | 2.831 | 2.651 | 100.0% | 10 | + | cinder.delete_volume | 0.65 | 2.735 | 3.048 | 3.123 | 3.198 | 2.567 | 100.0% | 10 | + | total | 18.915 | 21.629 | 24.215 | 25.025 | 25.835 | 22.025 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 64.388502121 + Full duration: 192.928286076 + + + + run_rally - INFO - Test scenario: "cinder" OK. + + run_rally - INFO - Starting test scenario "heat" ... + run_rally - INFO - + Preparing input task + Task 44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: started + Task 44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: finished + + test scenario HeatStacks.create_suspend_resume_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 4.131 | 4.448 | 4.579 | 4.616 | 4.652 | 4.417 | 100.0% | 10 | + | heat.suspend_stack | 1.521 | 1.721 | 1.772 | 1.792 | 1.812 | 1.701 | 100.0% | 10 | + | heat.resume_stack | 1.454 | 1.625 | 1.703 | 1.708 | 1.713 | 1.63 | 100.0% | 10 | + | heat.delete_stack | 1.387 | 1.57 | 2.717 | 2.724 | 2.731 | 1.88 | 100.0% | 10 | + | total | 8.994 | 9.448 | 10.723 | 10.75 | 10.777 | 9.627 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 28.125330925 + Full duration: 37.9011991024 + + + + test scenario HeatStacks.create_and_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.098 | 4.267 | 4.383 | 4.452 | 4.52 | 4.266 | 100.0% | 10 | + | heat.delete_stack | 1.423 | 1.468 | 1.536 | 1.679 | 1.822 | 1.505 | 100.0% | 10 | + | total | 5.574 | 5.769 | 5.922 | 5.933 | 5.944 | 5.77 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 17.2579169273 + Full duration: 27.4368560314 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 25.037 | 28.231 | 29.801 | 29.828 | 29.856 | 27.99 | 100.0% | 10 | + | heat.delete_stack | 10.707 | 11.831 | 13.046 | 13.573 | 14.099 | 12.249 | 100.0% | 10 | + | total | 36.902 | 40.321 | 42.736 | 42.79 | 42.844 | 40.24 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 119.344232082 + Full duration: 129.710185051 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 21.352 | 24.853 | 26.526 | 26.562 | 26.598 | 24.433 | 100.0% | 10 | + | heat.delete_stack | 9.51 | 10.67 | 10.95 | 11.42 | 11.889 | 10.684 | 100.0% | 10 | + | total | 31.928 | 35.457 | 37.299 | 37.449 | 37.598 | 35.117 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 106.840685844 + Full duration: 117.40921998 + + + + test scenario HeatStacks.list_stacks_and_resources + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.list_stacks | 0.488 | 0.522 | 0.539 | 0.54 | 0.54 | 0.522 | 100.0% | 10 | + | heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | + | total | 0.488 | 0.522 | 0.539 | 0.54 | 0.541 | 0.522 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.59450078011 + Full duration: 9.86936807632 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 3.845 | 4.214 | 4.356 | 4.377 | 4.397 | 4.193 | 100.0% | 10 | + | heat.update_stack | 3.558 | 3.774 | 3.853 | 3.855 | 3.857 | 3.726 | 100.0% | 10 | + | heat.delete_stack | 1.56 | 2.57 | 2.756 | 2.776 | 2.797 | 2.512 | 100.0% | 10 | + | total | 9.445 | 10.455 | 10.866 | 10.915 | 10.963 | 10.431 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 31.3620579243 + Full duration: 42.2799968719 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 4.133 | 4.157 | 4.354 | 4.413 | 4.472 | 4.209 | 100.0% | 10 | + | heat.update_stack | 3.534 | 3.713 | 3.821 | 3.958 | 4.096 | 3.717 | 100.0% | 10 | + | heat.delete_stack | 1.383 | 1.402 | 1.736 | 2.156 | 2.575 | 1.556 | 100.0% | 10 | + | total | 9.126 | 9.41 | 9.772 | 10.018 | 10.263 | 9.482 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 29.0769648552 + Full duration: 39.4647920132 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 4.275 | 4.465 | 4.666 | 4.855 | 5.044 | 4.509 | 100.0% | 10 | + | heat.update_stack | 5.801 | 5.876 | 6.0 | 6.166 | 6.332 | 5.928 | 100.0% | 10 | + | heat.delete_stack | 2.525 | 2.564 | 3.649 | 3.683 | 3.717 | 2.793 | 100.0% | 10 | + | total | 12.743 | 13.005 | 13.996 | 14.01 | 14.023 | 13.23 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 39.5067877769 + Full duration: 50.3663468361 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 4.517 | 5.462 | 5.602 | 5.608 | 5.614 | 5.389 | 100.0% | 10 | + | heat.update_stack | 8.345 | 9.324 | 9.403 | 9.411 | 9.42 | 9.245 | 100.0% | 10 | + | heat.delete_stack | 3.69 | 3.723 | 3.746 | 3.755 | 3.763 | 3.725 | 100.0% | 10 | + | total | 17.515 | 18.525 | 18.645 | 18.683 | 18.722 | 18.36 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 54.7039349079 + Full duration: 65.6854679585 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.122 | 4.348 | 4.549 | 4.597 | 4.645 | 4.358 | 100.0% | 10 | + | heat.update_stack | 5.791 | 5.87 | 5.92 | 5.932 | 5.944 | 5.864 | 100.0% | 10 | + | heat.delete_stack | 2.506 | 2.55 | 3.704 | 3.778 | 3.853 | 2.791 | 100.0% | 10 | + | total | 12.485 | 12.814 | 13.98 | 14.075 | 14.169 | 13.013 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 38.5906641483 + Full duration: 49.8386061192 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 4.062 | 4.33 | 4.493 | 4.501 | 4.508 | 4.317 | 100.0% | 10 | + | heat.update_stack | 3.553 | 3.585 | 3.783 | 3.936 | 4.088 | 3.648 | 100.0% | 10 | + | heat.delete_stack | 1.376 | 1.418 | 2.552 | 2.555 | 2.558 | 1.856 | 100.0% | 10 | + | total | 9.179 | 9.535 | 10.607 | 10.678 | 10.749 | 9.822 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 29.5593960285 + Full duration: 40.873290062 + + + + test scenario HeatStacks.create_and_list_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.105 | 4.264 | 4.394 | 4.43 | 4.466 | 4.276 | 100.0% | 10 | + | heat.list_stacks | 0.062 | 0.103 | 0.113 | 0.116 | 0.119 | 0.096 | 100.0% | 10 | + | total | 4.18 | 4.373 | 4.501 | 4.531 | 4.561 | 4.371 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 13.1703698635 + Full duration: 29.690456152 + + + + test scenario HeatStacks.create_check_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.194 | 4.357 | 4.595 | 4.64 | 4.684 | 4.393 | 100.0% | 10 | + | heat.check_stack | 1.511 | 1.542 | 1.627 | 1.753 | 1.88 | 1.58 | 100.0% | 10 | + | heat.delete_stack | 1.402 | 2.55 | 2.707 | 2.749 | 2.791 | 2.257 | 100.0% | 10 | + | total | 7.411 | 8.429 | 8.66 | 8.745 | 8.829 | 8.23 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 24.4679090977 + Full duration: 35.6907479763 + + + + run_rally - INFO - Test scenario: "heat" OK. + + run_rally - INFO - Starting test scenario "keystone" ... + run_rally - INFO - + Preparing input task + Task 416065d0-3811-4bee-9b53-37743e1f179c: started + Task 416065d0-3811-4bee-9b53-37743e1f179c: finished + + test scenario KeystoneBasic.create_tenant_with_users + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.285 | 0.297 | 0.328 | 0.336 | 0.343 | 0.305 | 100.0% | 10 | + | keystone.create_users | 1.651 | 1.673 | 1.73 | 1.749 | 1.768 | 1.688 | 100.0% | 10 | + | total | 1.952 | 1.986 | 2.027 | 2.061 | 2.095 | 1.993 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 5.98874807358 + Full duration: 22.4405510426 + + + + test scenario KeystoneBasic.create_add_and_list_user_roles + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.287 | 0.308 | 0.404 | 0.428 | 0.452 | 0.331 | 100.0% | 10 | + | keystone.add_role | 0.276 | 0.31 | 0.371 | 0.379 | 0.388 | 0.319 | 100.0% | 10 | + | keystone.list_roles | 0.137 | 0.151 | 0.175 | 0.207 | 0.239 | 0.16 | 100.0% | 10 | + | total | 0.732 | 0.775 | 0.951 | 0.962 | 0.972 | 0.809 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.38230800629 + Full duration: 15.068157196 + + + + test scenario KeystoneBasic.add_and_remove_user_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.263 | 0.3 | 0.41 | 0.455 | 0.499 | 0.336 | 100.0% | 10 | + | keystone.add_role | 0.265 | 0.28 | 0.342 | 0.405 | 0.468 | 0.302 | 100.0% | 10 | + | keystone.remove_role | 0.151 | 0.182 | 0.347 | 0.35 | 0.354 | 0.226 | 100.0% | 10 | + | total | 0.713 | 0.844 | 1.002 | 1.019 | 1.036 | 0.864 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.52822303772 + Full duration: 15.38514781 + + + + test scenario KeystoneBasic.create_update_and_delete_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.267 | 0.354 | 0.411 | 0.421 | 0.432 | 0.346 | 100.0% | 10 | + | keystone.update_tenant | 0.139 | 0.15 | 0.185 | 0.223 | 0.262 | 0.164 | 100.0% | 10 | + | keystone.delete_tenant | 0.302 | 0.333 | 0.418 | 0.448 | 0.477 | 0.35 | 100.0% | 10 | + | total | 0.738 | 0.879 | 0.917 | 0.961 | 1.006 | 0.86 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.55070900917 + Full duration: 14.2816069126 + + + + test scenario KeystoneBasic.create_and_delete_service + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_service | 0.279 | 0.303 | 0.408 | 0.41 | 0.412 | 0.322 | 100.0% | 10 | + | keystone.delete_service | 0.15 | 0.168 | 0.188 | 0.192 | 0.196 | 0.169 | 100.0% | 10 | + | total | 0.443 | 0.471 | 0.584 | 0.594 | 0.604 | 0.491 | 100.0% | 10 | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.47291088104 + Full duration: 12.6235470772 + + + + test scenario KeystoneBasic.create_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.274 | 0.302 | 0.315 | 0.324 | 0.334 | 0.301 | 100.0% | 10 | + | total | 0.274 | 0.302 | 0.315 | 0.325 | 0.334 | 0.301 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.926929950714 + Full duration: 9.11541318893 + + + + test scenario KeystoneBasic.create_user + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.285 | 0.312 | 0.353 | 0.392 | 0.431 | 0.323 | 100.0% | 10 | + | total | 0.285 | 0.313 | 0.353 | 0.392 | 0.431 | 0.323 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.09427213669 + Full duration: 9.44248485565 + + + + test scenario KeystoneBasic.create_and_list_tenants + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.276 | 0.302 | 0.312 | 0.315 | 0.318 | 0.299 | 100.0% | 10 | + | keystone.list_tenants | 0.133 | 0.141 | 0.147 | 0.149 | 0.15 | 0.141 | 100.0% | 10 | + | total | 0.416 | 0.441 | 0.462 | 0.463 | 0.463 | 0.44 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.356580019 + Full duration: 14.5843369961 + + + + test scenario KeystoneBasic.create_and_delete_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.271 | 0.306 | 0.517 | 0.532 | 0.547 | 0.37 | 100.0% | 10 | + | keystone.delete_role | 0.295 | 0.305 | 0.621 | 0.655 | 0.689 | 0.401 | 100.0% | 10 | + | total | 0.572 | 0.743 | 0.991 | 1.076 | 1.16 | 0.771 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.24743795395 + Full duration: 14.336769104 + + + + test scenario KeystoneBasic.get_entities + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.284 | 0.313 | 0.395 | 0.4 | 0.405 | 0.328 | 100.0% | 10 | + | keystone.create_user | 0.141 | 0.155 | 0.176 | 0.176 | 0.177 | 0.159 | 100.0% | 10 | + | keystone.create_role | 0.136 | 0.155 | 0.173 | 0.209 | 0.245 | 0.16 | 100.0% | 10 | + | keystone.get_tenant | 0.124 | 0.132 | 0.143 | 0.144 | 0.144 | 0.133 | 100.0% | 10 | + | keystone.get_user | 0.124 | 0.141 | 0.232 | 0.234 | 0.237 | 0.158 | 100.0% | 10 | + | keystone.get_role | 0.122 | 0.125 | 0.142 | 0.144 | 0.147 | 0.129 | 100.0% | 10 | + | keystone.service_list | 0.121 | 0.13 | 0.138 | 0.139 | 0.139 | 0.13 | 100.0% | 10 | + | keystone.get_service | 0.118 | 0.132 | 0.158 | 0.16 | 0.161 | 0.136 | 100.0% | 10 | + | total | 1.253 | 1.315 | 1.403 | 1.449 | 1.495 | 1.334 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.18330001831 + Full duration: 21.2465929985 + + + + test scenario KeystoneBasic.create_and_list_users + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.27 | 0.324 | 0.381 | 0.409 | 0.436 | 0.33 | 100.0% | 10 | + | keystone.list_users | 0.125 | 0.142 | 0.183 | 0.233 | 0.283 | 0.157 | 100.0% | 10 | + | total | 0.409 | 0.47 | 0.53 | 0.625 | 0.719 | 0.487 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.41358304024 + Full duration: 9.46058607101 + + + + run_rally - INFO - Test scenario: "keystone" OK. + + run_rally - INFO - Starting test scenario "neutron" ... + run_rally - INFO - + Preparing input task + Task 66bee4c3-3b3f-4215-9910-63425b400d9a: started + Task 66bee4c3-3b3f-4215-9910-63425b400d9a: finished + + test scenario NeutronNetworks.create_and_delete_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.762 | 0.83 | 0.953 | 0.983 | 1.014 | 0.858 | 100.0% | 10 | + | neutron.delete_port | 0.224 | 0.62 | 0.763 | 0.78 | 0.797 | 0.582 | 100.0% | 10 | + | total | 1.011 | 1.549 | 1.599 | 1.603 | 1.607 | 1.441 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.14246201515 + Full duration: 53.9938690662 + + + + test scenario NeutronNetworks.create_and_list_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.718 | 0.792 | 0.884 | 0.89 | 0.895 | 0.801 | 100.0% | 10 | + | neutron.create_router | 0.435 | 0.451 | 0.555 | 0.56 | 0.565 | 0.474 | 100.0% | 10 | + | neutron.add_interface_router | 0.341 | 0.776 | 1.004 | 1.11 | 1.215 | 0.789 | 100.0% | 10 | + | neutron.list_routers | 0.066 | 0.42 | 0.477 | 0.491 | 0.505 | 0.367 | 100.0% | 10 | + | total | 1.661 | 2.48 | 2.738 | 2.797 | 2.855 | 2.431 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.12932991982 + Full duration: 59.6318800449 + + + + test scenario NeutronNetworks.create_and_delete_routers + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.739 | 0.812 | 0.936 | 0.949 | 0.963 | 0.833 | 100.0% | 10 | + | neutron.create_router | 0.073 | 0.467 | 0.548 | 0.564 | 0.58 | 0.447 | 100.0% | 10 | + | neutron.add_interface_router | 0.32 | 0.758 | 0.881 | 0.901 | 0.92 | 0.737 | 100.0% | 10 | + | neutron.remove_interface_router | 0.632 | 0.723 | 0.767 | 0.788 | 0.808 | 0.719 | 100.0% | 10 | + | neutron.delete_router | 0.575 | 0.622 | 0.72 | 0.74 | 0.759 | 0.639 | 100.0% | 10 | + | total | 2.939 | 3.398 | 3.635 | 3.725 | 3.814 | 3.375 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.4781250954 + Full duration: 61.2645328045 + + + + test scenario NeutronNetworks.create_and_list_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.728 | 0.859 | 0.909 | 0.944 | 0.978 | 0.857 | 100.0% | 10 | + | neutron.list_ports | 0.52 | 0.599 | 0.71 | 0.735 | 0.76 | 0.618 | 100.0% | 10 | + | total | 1.37 | 1.459 | 1.597 | 1.611 | 1.624 | 1.475 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.50073218346 + Full duration: 55.2021510601 + + + + test scenario NeutronNetworks.create_and_delete_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.749 | 0.788 | 0.939 | 0.956 | 0.972 | 0.824 | 100.0% | 10 | + | neutron.delete_subnet | 0.556 | 0.673 | 0.778 | 0.819 | 0.859 | 0.687 | 100.0% | 10 | + | total | 1.361 | 1.521 | 1.693 | 1.697 | 1.702 | 1.511 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.66956591606 + Full duration: 54.1284301281 + + + + test scenario NeutronNetworks.create_and_delete_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.62 | 0.643 | 0.756 | 0.784 | 0.812 | 0.672 | 100.0% | 10 | + | neutron.delete_network | 0.481 | 0.54 | 0.616 | 0.686 | 0.756 | 0.558 | 100.0% | 10 | + | total | 1.101 | 1.206 | 1.363 | 1.377 | 1.391 | 1.23 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.73822879791 + Full duration: 33.2811751366 + + + + test scenario NeutronNetworks.create_and_list_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.583 | 0.675 | 0.782 | 0.782 | 0.783 | 0.691 | 100.0% | 10 | + | neutron.list_networks | 0.058 | 0.395 | 0.517 | 0.522 | 0.528 | 0.364 | 100.0% | 10 | + | total | 0.834 | 1.066 | 1.187 | 1.242 | 1.298 | 1.055 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.09279990196 + Full duration: 33.633177042 + + + + test scenario NeutronNetworks.create_and_update_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.713 | 0.8 | 0.903 | 0.913 | 0.922 | 0.811 | 100.0% | 10 | + | neutron.create_router | 0.434 | 0.449 | 0.476 | 0.497 | 0.519 | 0.458 | 100.0% | 10 | + | neutron.add_interface_router | 0.666 | 0.749 | 0.912 | 0.954 | 0.996 | 0.791 | 100.0% | 10 | + | neutron.update_router | 0.222 | 0.579 | 0.659 | 0.678 | 0.697 | 0.556 | 100.0% | 10 | + | total | 2.156 | 2.643 | 2.768 | 2.799 | 2.83 | 2.617 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.76268601418 + Full duration: 57.6214001179 + + + + test scenario NeutronNetworks.create_and_update_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.606 | 0.672 | 0.761 | 0.785 | 0.81 | 0.681 | 100.0% | 10 | + | neutron.update_network | 0.137 | 0.518 | 0.538 | 0.542 | 0.547 | 0.482 | 100.0% | 10 | + | total | 0.893 | 1.183 | 1.261 | 1.288 | 1.315 | 1.164 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.59189605713 + Full duration: 34.8437690735 + + + + test scenario NeutronNetworks.create_and_update_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.738 | 0.792 | 0.889 | 0.921 | 0.952 | 0.815 | 100.0% | 10 | + | neutron.update_port | 0.161 | 0.551 | 0.596 | 0.6 | 0.605 | 0.516 | 100.0% | 10 | + | total | 1.044 | 1.339 | 1.429 | 1.482 | 1.536 | 1.331 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.11195087433 + Full duration: 53.0145220757 + + + + test scenario NeutronNetworks.create_and_list_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.703 | 0.748 | 0.832 | 0.861 | 0.89 | 0.764 | 100.0% | 10 | + | neutron.list_subnets | 0.054 | 0.396 | 0.445 | 0.479 | 0.513 | 0.374 | 100.0% | 10 | + | total | 0.757 | 1.159 | 1.256 | 1.272 | 1.287 | 1.138 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.5137629509 + Full duration: 52.7622568607 + + + + test scenario NeutronNetworks.create_and_update_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.742 | 0.813 | 0.947 | 0.948 | 0.949 | 0.838 | 100.0% | 10 | + | neutron.update_subnet | 0.234 | 0.583 | 0.695 | 0.696 | 0.696 | 0.58 | 100.0% | 10 | + | total | 1.043 | 1.427 | 1.587 | 1.596 | 1.604 | 1.418 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.36762094498 + Full duration: 54.1341950893 + + + + run_rally - INFO - Test scenario: "neutron" OK. + + run_rally - INFO - Starting test scenario "nova" ... + run_rally - INFO - + Preparing input task + Task c631be68-64eb-462f-af72-0946f649719e: started + Task c631be68-64eb-462f-af72-0946f649719e: finished + + test scenario NovaKeypair.create_and_delete_keypair + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.689 | 0.825 | 1.389 | 1.414 | 1.439 | 0.956 | 100.0% | 10 | + | nova.delete_keypair | 0.034 | 0.045 | 0.058 | 0.058 | 0.059 | 0.046 | 100.0% | 10 | + | total | 0.734 | 0.868 | 1.43 | 1.458 | 1.487 | 1.002 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.95623397827 + Full duration: 43.0288610458 + + + + test scenario NovaServers.snapshot_server + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 13.069 | 14.075 | 14.775 | 15.063 | 15.35 | 14.118 | 100.0% | 10 | + | nova.create_image | 10.992 | 11.363 | 11.948 | 12.03 | 12.112 | 11.402 | 100.0% | 10 | + | nova.delete_server | 2.878 | 3.026 | 3.413 | 3.454 | 3.495 | 3.121 | 100.0% | 10 | + | nova.boot_server (2) | 10.807 | 12.891 | 14.009 | 14.098 | 14.188 | 12.932 | 100.0% | 10 | + | nova.delete_server (2) | 2.914 | 3.356 | 4.738 | 4.974 | 5.21 | 3.557 | 100.0% | 10 | + | nova.delete_image | 2.769 | 3.227 | 3.659 | 3.685 | 3.711 | 3.238 | 100.0% | 10 | + | total | 44.842 | 48.482 | 49.94 | 50.257 | 50.573 | 48.369 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 145.116047144 + Full duration: 218.130707026 + + + + test scenario NovaKeypair.boot_and_delete_server_with_keypair + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_keypair | 0.67 | 0.815 | 1.452 | 1.483 | 1.515 | 0.945 | 100.0% | 10 | + | nova.boot_server | 11.229 | 12.914 | 14.714 | 15.148 | 15.581 | 13.075 | 100.0% | 10 | + | nova.delete_server | 2.87 | 3.313 | 3.4 | 3.451 | 3.502 | 3.214 | 100.0% | 10 | + | nova.delete_keypair | 0.034 | 0.048 | 0.056 | 0.056 | 0.057 | 0.046 | 100.0% | 10 | + | total | 15.3 | 17.062 | 18.916 | 19.109 | 19.302 | 17.281 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 51.5624389648 + Full duration: 121.866284132 + + + + test scenario NovaKeypair.create_and_list_keypairs + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.681 | 0.825 | 1.368 | 1.468 | 1.568 | 0.975 | 100.0% | 10 | + | nova.list_keypairs | 0.021 | 0.027 | 0.038 | 0.038 | 0.039 | 0.03 | 100.0% | 10 | + | total | 0.715 | 0.855 | 1.394 | 1.494 | 1.593 | 1.005 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.00225996971 + Full duration: 44.8396139145 + + + + test scenario NovaServers.list_servers + +---------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+------+---------+-------+ + | nova.list_servers | 1.385 | 1.648 | 1.794 | 1.8 | 1.806 | 1.64 | 100.0% | 10 | + | total | 1.386 | 1.648 | 1.794 | 1.8 | 1.807 | 1.64 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+------+---------+-------+ + Load duration: 4.86725592613 + Full duration: 144.563478947 + + + + test scenario NovaServers.resize_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 11.794 | 13.235 | 14.683 | 15.23 | 15.778 | 13.569 | 100.0% | 10 | + | nova.resize | 40.775 | 43.909 | 47.803 | 47.888 | 47.973 | 44.294 | 100.0% | 10 | + | nova.resize_confirm | 2.664 | 3.406 | 5.701 | 5.894 | 6.087 | 3.777 | 100.0% | 10 | + | nova.delete_server | 2.831 | 2.964 | 3.671 | 4.355 | 5.038 | 3.264 | 100.0% | 10 | + | total | 59.51 | 64.72 | 68.963 | 69.477 | 69.991 | 64.905 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 193.15106678 + Full duration: 234.439800978 + + + + test scenario NovaServers.boot_server_from_volume_and_delete + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.703 | 10.351 | 11.374 | 12.306 | 13.237 | 10.631 | 100.0% | 10 | + | nova.boot_server | 13.02 | 14.474 | 15.965 | 16.121 | 16.276 | 14.667 | 100.0% | 10 | + | nova.delete_server | 3.826 | 5.813 | 5.967 | 6.081 | 6.196 | 5.561 | 100.0% | 10 | + | total | 27.612 | 30.787 | 32.582 | 32.736 | 32.891 | 30.859 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 92.1244728565 + Full duration: 176.439888954 + + + + test scenario NovaServers.boot_and_migrate_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.068 | 13.808 | 14.866 | 14.966 | 15.067 | 13.788 | 100.0% | 10 | + | nova.stop_server | 4.417 | 6.774 | 7.032 | 7.224 | 7.416 | 6.512 | 100.0% | 10 | + | nova.migrate | 10.786 | 11.454 | 11.957 | 11.999 | 12.04 | 11.487 | 100.0% | 10 | + | nova.resize_confirm | 3.328 | 3.614 | 3.822 | 3.905 | 3.988 | 3.621 | 100.0% | 10 | + | nova.delete_server | 2.862 | 3.057 | 3.364 | 3.454 | 3.544 | 3.116 | 100.0% | 10 | + | total | 34.85 | 38.711 | 40.179 | 40.344 | 40.508 | 38.525 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 115.221567869 + Full duration: 156.790792227 + + + + test scenario NovaServers.boot_and_delete_server + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.492 | 13.618 | 14.995 | 15.0 | 15.004 | 13.701 | 100.0% | 10 | + | nova.delete_server | 2.88 | 3.033 | 3.371 | 3.49 | 3.61 | 3.125 | 100.0% | 10 | + | total | 15.773 | 16.838 | 17.914 | 18.089 | 18.264 | 16.827 | 100.0% | 10 | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 50.1218390465 + Full duration: 119.306482077 + + + + test scenario NovaServers.boot_and_rebuild_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.196 | 13.798 | 15.074 | 15.293 | 15.511 | 13.812 | 100.0% | 10 | + | nova.rebuild_server | 12.036 | 13.891 | 15.523 | 15.599 | 15.676 | 13.972 | 100.0% | 10 | + | nova.delete_server | 2.645 | 3.268 | 3.55 | 3.589 | 3.628 | 3.208 | 100.0% | 10 | + | total | 28.349 | 31.175 | 32.771 | 33.141 | 33.511 | 30.993 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 92.8703818321 + Full duration: 164.587569952 + + + + test scenario NovaSecGroup.create_and_list_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.388 | 5.032 | 5.224 | 5.25 | 5.277 | 4.975 | 100.0% | 10 | + | nova.create_100_rules | 42.993 | 44.613 | 45.762 | 45.785 | 45.808 | 44.39 | 100.0% | 10 | + | nova.list_security_groups | 0.153 | 0.195 | 0.36 | 0.486 | 0.613 | 0.251 | 100.0% | 10 | + | total | 48.225 | 50.01 | 50.441 | 50.635 | 50.83 | 49.616 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 149.417917013 + Full duration: 217.353839159 + + + + test scenario NovaSecGroup.create_and_delete_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.382 | 5.191 | 5.496 | 5.608 | 5.72 | 5.12 | 100.0% | 10 | + | nova.create_100_rules | 43.059 | 44.368 | 45.778 | 46.029 | 46.28 | 44.458 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.662 | 2.265 | 2.495 | 2.664 | 2.832 | 2.215 | 100.0% | 10 | + | total | 50.772 | 51.601 | 53.26 | 53.294 | 53.327 | 51.794 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 156.369856119 + Full duration: 199.137834787 + + + + test scenario NovaServers.boot_and_bounce_server + +-------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.013 | 14.52 | 15.332 | 15.8 | 16.267 | 14.249 | 100.0% | 10 | + | nova.reboot_server | 5.223 | 6.071 | 6.385 | 6.462 | 6.539 | 5.987 | 100.0% | 10 | + | nova.soft_reboot_server | 5.766 | 8.423 | 8.806 | 9.002 | 9.198 | 8.214 | 100.0% | 10 | + | nova.stop_server | 3.892 | 6.503 | 7.587 | 10.894 | 14.201 | 6.898 | 100.0% | 10 | + | nova.start_server | 3.432 | 4.687 | 5.177 | 5.424 | 5.672 | 4.587 | 100.0% | 10 | + | nova.rescue_server | 7.9 | 8.519 | 9.688 | 10.196 | 10.703 | 8.724 | 100.0% | 10 | + | nova.unrescue_server | 5.091 | 5.518 | 5.836 | 6.131 | 6.426 | 5.577 | 100.0% | 10 | + | nova.delete_server | 2.495 | 2.921 | 3.469 | 3.516 | 3.563 | 2.974 | 100.0% | 10 | + | total | 53.649 | 57.305 | 59.111 | 60.626 | 62.142 | 57.23 | 100.0% | 10 | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 174.621170044 + Full duration: 245.828352928 + + + + test scenario NovaServers.boot_server + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 13.233 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0% | 10 | + | total | 13.234 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0% | 10 | + +------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 42.6567699909 + Full duration: 99.771146059 + + + + test scenario NovaSecGroup.boot_and_delete_server_with_secgroups + +-----------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.306 | 4.999 | 5.282 | 5.289 | 5.296 | 4.937 | 100.0% | 10 | + | nova.create_100_rules | 41.795 | 43.955 | 45.983 | 46.201 | 46.418 | 44.135 | 100.0% | 10 | + | nova.boot_server | 10.075 | 11.651 | 12.302 | 13.061 | 13.82 | 11.534 | 100.0% | 10 | + | nova.get_attached_security_groups | 0.217 | 0.249 | 0.568 | 0.572 | 0.577 | 0.338 | 100.0% | 10 | + | nova.delete_server | 2.469 | 2.619 | 2.937 | 3.034 | 3.131 | 2.712 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.574 | 1.878 | 2.55 | 2.704 | 2.858 | 2.053 | 100.0% | 10 | + | total | 63.097 | 65.905 | 66.858 | 67.329 | 67.8 | 65.71 | 100.0% | 10 | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 195.037164927 + Full duration: 263.490648985 + + + + test scenario NovaServers.pause_and_unpause_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.325 | 13.238 | 14.398 | 14.542 | 14.687 | 13.373 | 100.0% | 10 | + | nova.pause_server | 2.412 | 2.986 | 3.177 | 3.205 | 3.233 | 2.946 | 100.0% | 10 | + | nova.unpause_server | 2.824 | 3.169 | 3.325 | 3.392 | 3.459 | 3.13 | 100.0% | 10 | + | nova.delete_server | 2.501 | 3.244 | 3.557 | 3.634 | 3.71 | 3.233 | 100.0% | 10 | + | total | 21.499 | 22.307 | 24.0 | 24.022 | 24.043 | 22.682 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 67.2968730927 + Full duration: 134.783083916 + + + + test scenario NovaServers.boot_server_from_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.885 | 10.866 | 11.617 | 11.636 | 11.655 | 10.841 | 100.0% | 10 | + | nova.boot_server | 13.236 | 14.774 | 15.766 | 16.126 | 16.486 | 14.693 | 100.0% | 10 | + | total | 23.437 | 25.64 | 27.197 | 27.213 | 27.23 | 25.534 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 78.3072631359 + Full duration: 145.979751825 + + + + test scenario NovaServers.boot_and_list_server + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.745 | 14.15 | 15.755 | 15.872 | 15.99 | 14.143 | 100.0% | 10 | + | nova.list_servers | 0.579 | 0.977 | 1.114 | 1.158 | 1.203 | 0.926 | 100.0% | 10 | + | total | 13.49 | 14.979 | 16.933 | 16.94 | 16.947 | 15.07 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 46.7471969128 + Full duration: 130.989289045 + + + + run_rally - INFO - Test scenario: "nova" OK. + + run_rally - INFO - Starting test scenario "quotas" ... + run_rally - INFO - + Preparing input task + Task 09c70711-40eb-4c85-8b87-c0c081222b0d: started + Task 09c70711-40eb-4c85-8b87-c0c081222b0d: finished + + test scenario Quotas.cinder_update + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+------+---------+-------+ + | quotas.update_quotas | 1.123 | 1.192 | 1.297 | 1.331 | 1.365 | 1.21 | 100.0% | 10 | + | total | 1.123 | 1.192 | 1.297 | 1.331 | 1.365 | 1.21 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+------+---------+-------+ + Load duration: 3.62791609764 + Full duration: 16.2237439156 + + + + test scenario Quotas.neutron_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.396 | 0.426 | 0.572 | 0.581 | 0.591 | 0.464 | 100.0% | 10 | + | total | 0.553 | 0.575 | 0.773 | 0.834 | 0.896 | 0.64 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.80940699577 + Full duration: 13.0895729065 + + + + test scenario Quotas.cinder_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.145 | 1.182 | 1.365 | 1.407 | 1.449 | 1.234 | 100.0% | 10 | + | quotas.delete_quotas | 0.543 | 0.933 | 1.011 | 1.032 | 1.053 | 0.873 | 100.0% | 10 | + | total | 1.723 | 2.095 | 2.413 | 2.435 | 2.456 | 2.107 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 6.34634900093 + Full duration: 18.2702391148 + + + + test scenario Quotas.nova_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.544 | 0.621 | 0.695 | 0.705 | 0.716 | 0.619 | 100.0% | 10 | + | quotas.delete_quotas | 0.017 | 0.023 | 0.028 | 0.028 | 0.029 | 0.024 | 100.0% | 10 | + | total | 0.569 | 0.642 | 0.713 | 0.726 | 0.739 | 0.643 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.95026016235 + Full duration: 13.2278659344 + + + + test scenario Quotas.nova_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.571 | 0.647 | 0.664 | 0.692 | 0.719 | 0.643 | 100.0% | 10 | + | total | 0.571 | 0.647 | 0.664 | 0.692 | 0.719 | 0.644 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.94177007675 + Full duration: 13.6731410027 + + + + run_rally - INFO - Test scenario: "quotas" OK. + + run_rally - INFO - Starting test scenario "requests" ... + run_rally - INFO - + Preparing input task + Task ee8c572e-1240-4996-a06f-801592da0277: started + Task ee8c572e-1240-4996-a06f-801592da0277: finished + + test scenario HttpRequests.check_random_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 0.047 | 0.201 | 0.383 | 0.384 | 0.386 | 0.214 | 100.0% | 10 | + | total | 0.047 | 0.201 | 0.383 | 0.384 | 0.386 | 0.214 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.791751146317 + Full duration: 5.66926693916 + + + + test scenario HttpRequests.check_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 0.044 | 0.046 | 0.052 | 0.052 | 0.053 | 0.048 | 100.0% | 10 | + | total | 0.044 | 0.046 | 0.052 | 0.052 | 0.053 | 0.048 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.181750059128 + Full duration: 5.16227507591 + + + + run_rally - INFO - Test scenario: "requests" OK. + + run_rally - INFO - + + + Rally Summary Report + +===================+============+===============+===========+ + | Module | Duration | nb. Test Run | Success | + +===================+============+===============+===========+ + | authenticate | 00:59 | 10 | 100.00% | + +-------------------+------------+---------------+-----------+ + | glance | 03:38 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | cinder | 22:59 | 50 | 100.00% | + +-------------------+------------+---------------+-----------+ + | heat | 11:16 | 35 | 100.00% | + +-------------------+------------+---------------+-----------+ + | keystone | 02:37 | 29 | 100.00% | + +-------------------+------------+---------------+-----------+ + | neutron | 10:03 | 31 | 100.00% | + +-------------------+------------+---------------+-----------+ + | nova | 47:41 | 61 | 100.00% | + +-------------------+------------+---------------+-----------+ + | quotas | 01:14 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | requests | 00:10 | 2 | 100.00% | + +-------------------+------------+---------------+-----------+ + +===================+============+===============+===========+ + | TOTAL: | 01:40:41 | 232 | 100.00% | + +===================+============+===============+===========+ +:: diff --git a/docs/results/fuel-os-nosdn-ovs-ha.rst b/docs/results/fuel-os-nosdn-ovs-ha.rst index c608e4df..d7fddaaf 100644 --- a/docs/results/fuel-os-nosdn-ovs-ha.rst +++ b/docs/results/fuel-os-nosdn-ovs-ha.rst @@ -1,10 +1,2279 @@ .. This work is licensed under a Creative Commons Attribution 4.0 International Licence. .. http://creativecommons.org/licenses/by/4.0 -Test results for fuel-os-nosdn-ovs-ha -===================================== +Detailed test results for fuel-os-nosdn-ovs-ha +------------------------------------------------------- -.. Add any text in here that could be useful for a reader. +The following section outlines the detailed Functest results for the Brahmaputra scenario +deploying OpenStack in a Pharos environment by the Fuel installer. -.. Add the test results in a consistent format. +vPing_SSH +^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-SSH test... + vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_ssh- INFO - Creating neutron network vping-net... + vPing_ssh- INFO - Creating security group 'vPing-sg'... + vPing_ssh- INFO - Using existing Flavor 'm1.small'... + vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35' + vPing_ssh- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + + vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'... + vPing_ssh- INFO - Floating IP created: '10.118.101.200' + vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2' + vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200... + vPing_ssh- INFO - Waiting for ping... + vPing_ssh- INFO - vPing detected! + vPing_ssh- INFO - vPing duration:'42.1' s. + vPing_ssh- INFO - Cleaning up... + vPing_ssh- INFO - vPing OK +:: + + +vPing_userdata +^^^^^^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-userdata test... + vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_userdata- INFO - Creating neutron network vping-net... + vPing_userdata- INFO - Creating security group 'vPing-sg'... + vPing_userdata- INFO - Flavor found 'm1.small' + vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00' + vPing_userdata- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + + vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_userdata- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + userdata= + #!/bin/sh + + while true; do + ping -c 1 192.168.130.4 2>&1 >/dev/null + RES=$? + if [ "Z$RES" = "Z0" ] ; then + echo 'vPing OK' + break + else + echo 'vPing KO' + fi + sleep 1 + done + + vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_userdata- INFO - Waiting for ping... + vPing_userdata- INFO - vPing detected! + vPing_userdata- INFO - vPing duration:'28.6' + vPing_userdata- INFO - vPing OK + vPing_userdata- INFO - Cleaning up... + vPing_userdata- INFO - Deleting network 'vping-net'... +:: + + +Tempest +^^^^^^^ +:: + +------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+ + | name | time | status | + +------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+ + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.42319 | success | + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.10399 | success | + | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 21.61136 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 24.17689 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 44.97306 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.61967 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.61148 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.36880 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.97375 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.39432 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.62328 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.37363 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.61586 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.35380 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.67239 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.38634 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 1.05724 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.53191 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.18318 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 1.22600 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 1.02248 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 2.15108 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 3.32340 | success | + | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 5.71240 | success | + | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 16.19396 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.08151 | success | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 5.38225 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.30658 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 1.03364 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.55185 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.60722 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.61518 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.10976 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.10289 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.10607 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.09006 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.39571 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.55219 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00134 | skip | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.20517 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.08353 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.01952 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.07490 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.11856 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.03290 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.04317 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.04307 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.08060 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.09867 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.31911 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.03124 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.10668 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.11260 | success | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.20834 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.75046 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.37893 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.36982 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.68314 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.57271 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.64458 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 4.92495 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 22.44224 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 30.13484 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 15.86074 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 12.98275 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 2.59054 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 3.72221 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 2.78814 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 1.60414 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 3.08274 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.16235 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 2.57737 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.46117 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.22501 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 1.11043 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 2.71277 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.10491 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.50933 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.94894 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 1.36216 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.57821 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.85906 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.81229 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.26423 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 1.39718 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.00093 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.29322 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02099 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.64378 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.06226 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.83135 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.08382 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.30164 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.04541 | success | + | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 0.0 | fail | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.97480 | success | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 1.05415 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.26485 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.02006 | success | + | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.84845 | success | + | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.0 | fail | + | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.10464 | success | + | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.02679 | success | + | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.64732 | success | + | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 2.79302 | success | + | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.0 | fail | + | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.38635 | success | + | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.0 | fail | + | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.67061 | success | + | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.34593 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.09899 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.08376 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.07817 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10831 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.09626 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.09352 | success | + | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.57765 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.66822 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 3.06984 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 3.62527 | success | + | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 6.08457 | success | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 2.35650 | success | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 2.99120 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 1.72175 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 3.61046 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 4.54154 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 2.24168 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 3.49353 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 3.50686 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 3.20151 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.69691 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.39375 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.38459 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.29588 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.51586 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 2.70137 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.60901 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.31436 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.32710 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.05551 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.45609 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 3.05677 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 2.98082 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.63311 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.09653 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.35475 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 2.90406 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 3.62630 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.17609 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.37848 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.09860 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 7.70778 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 4.78033 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 4.62080 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 3.61729 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 7.56892 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.67551 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 3.90091 | success | + | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 2.96428 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.98439 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.83806 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.29228 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.05162 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.96419 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.36613 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.64793 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 6.64806 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.04923 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.42249 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.61494 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.64431 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.61515 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.79836 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.84027 | success | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.71970 | success | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.06703 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 15.64501 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 3.81335 | success | + | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 3.28514 | success | + | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.08361 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 13.04419 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 17.72121 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 15.46298 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 19.52032 | success | + | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.06039 | success | + | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.07579 | success | + | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 56.52179 | success | + | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 42.52437 | success | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 81.46846 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 72.34328 | fail | + +------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+ + run_tempest - INFO - Results: {'timestart': '2016-02-1602:24:40.738841', 'duration': 234, 'tests': 210, 'failures': 26} +:: + + +vIMS +^^^^ +:: + FUNCTEST.info: Running vIMS test... + vIMS - INFO - Prepare OpenStack plateform (create tenant and user) + vIMS - INFO - Update OpenStack creds informations + vIMS - INFO - Upload some OS images if it doesn't exist + vIMS - INFO - centos_7 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - Update security group quota for this tenant + vIMS - INFO - Update cinder quota for this tenant + vIMS - INFO - Collect flavor id for cloudify manager server + vIMS - INFO - Prepare virtualenv for cloudify-cli + vIMS - INFO - Downloading the cloudify manager server blueprint + vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47' + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the cloudify-manager deployment + vIMS - INFO - Cloudify-manager server is UP ! + vIMS - INFO - Cloudify deployment duration:'1149.9' + vIMS - INFO - Collect flavor id for all clearwater vm + vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00' + vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the clearwater deployment + vIMS - INFO - The deployment of clearwater-opnfv is ended + vIMS - INFO - vIMS VNF deployment duration:'1133.8' + vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59' + vIMS - INFO - vIMS functional test duration:'2.9' + vIMS - INFO - Launching the clearwater-opnfv undeployment + vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; ' + vIMS - INFO - Launching the cloudify-manager undeployment + vIMS - INFO - Cloudify-manager server has been successfully removed! + vIMS - INFO - Removing vIMS tenant .. + vIMS - INFO - Removing vIMS user .. +:: + + +Promise +^^^^^^^ +:: + FUNCTEST.info: Running PROMISE test case... + Promise- INFO - Creating tenant 'promise'... + Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'... + Promise- INFO - Creating user 'promiser'... + Promise- INFO - Updating OpenStack credentials... + Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + Promise- INFO - Creating flavor 'promise-flavor'... + Promise- INFO - Exporting environment variables... + Promise- INFO - Running command: npm run -s test -- --reporter json + Promise- INFO - The test succeeded. + Promise- DEBUG - + { + "stats": { + "suites": 23, + "tests": 33, + "passes": 33, + "pending": 0, + "failures": 0, + "start": "2016-02-23T02:24:39.314Z", + "end": "2016-02-23T02:24:44.838Z", + "duration": 5524 + }, + "tests": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ], + "pending": [], + "failures": [], + "passes": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ] + } + Promise- INFO - + **************************************** + Promise test report + + **************************************** + Suites: 23 + Tests: 33 + Passes: 33 + Pending: 0 + Failures: 0 + Start: 2016-02-18T13:37:06.661Z + End: 2016-02-18T13:37:12.962Z + Duration: 6.301 + **************************************** +:: + + +Rally +^^^^^ +:: + FUNCTEST.info: Running Rally benchmark suite... + run_rally - INFO - Starting test scenario "authenticate" ... + run_rally - INFO - + Preparing input task + Task 3074958f-9ce1-47bc-9d9d-e78bc2233a68: started + Task 3074958f-9ce1-47bc-9d9d-e78bc2233a68: finished + + test scenario Authenticate.validate_glance + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_glance | 0.519 | 0.582 | 0.614 | 0.616 | 0.619 | 0.577 | 100.0% | 10 | + | authenticate.validate_glance (2) | 0.318 | 0.548 | 0.621 | 0.699 | 0.777 | 0.557 | 100.0% | 10 | + | total | 1.086 | 1.305 | 1.37 | 1.467 | 1.563 | 1.307 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.99583816528 + Full duration: 11.4604001045 + + + + test scenario Authenticate.keystone + +-----------------------------------------------------------------------------+ + | Response Times (sec) | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | total | 0.139 | 0.157 | 0.174 | 0.175 | 0.175 | 0.158 | 100.0% | 10 | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.509595870972 + Full duration: 8.08681082726 + + + + test scenario Authenticate.validate_heat + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_heat | 0.281 | 0.3 | 0.407 | 0.408 | 0.409 | 0.322 | 100.0% | 10 | + | authenticate.validate_heat (2) | 0.049 | 0.288 | 0.309 | 0.343 | 0.377 | 0.254 | 100.0% | 10 | + | total | 0.474 | 0.756 | 0.876 | 0.883 | 0.89 | 0.748 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.13345599174 + Full duration: 9.90360093117 + + + + test scenario Authenticate.validate_nova + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_nova | 0.263 | 0.305 | 0.334 | 0.394 | 0.454 | 0.313 | 100.0% | 10 | + | authenticate.validate_nova (2) | 0.031 | 0.045 | 0.061 | 0.07 | 0.079 | 0.048 | 100.0% | 10 | + | total | 0.456 | 0.517 | 0.555 | 0.62 | 0.686 | 0.525 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.58427906036 + Full duration: 9.08766698837 + + + + test scenario Authenticate.validate_cinder + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_cinder | 0.279 | 0.31 | 0.336 | 0.384 | 0.433 | 0.316 | 100.0% | 10 | + | authenticate.validate_cinder (2) | 0.023 | 0.284 | 0.356 | 0.475 | 0.594 | 0.244 | 100.0% | 10 | + | total | 0.44 | 0.784 | 0.989 | 1.066 | 1.142 | 0.75 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.06888413429 + Full duration: 9.67203593254 + + + + test scenario Authenticate.validate_neutron + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_neutron | 0.279 | 0.333 | 0.347 | 0.348 | 0.348 | 0.328 | 100.0% | 10 | + | authenticate.validate_neutron (2) | 0.042 | 0.302 | 0.341 | 0.374 | 0.407 | 0.263 | 100.0% | 10 | + | total | 0.467 | 0.804 | 0.848 | 0.869 | 0.89 | 0.757 | 100.0% | 10 | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.20722603798 + Full duration: 10.0450489521 + + + + run_rally - INFO - Test scenario: "authenticate" OK. + + run_rally - INFO - Starting test scenario "glance" ... + run_rally - INFO - + Preparing input task + Task 2d256e70-85ea-4394-a6ef-c1bb7f56a349: started + Task 2d256e70-85ea-4394-a6ef-c1bb7f56a349: finished + + test scenario GlanceImages.list_images + +---------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+------+--------+--------+--------+------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+------+--------+--------+--------+------+-------+---------+-------+ + | glance.list_images | 0.69 | 0.754 | 0.845 | 0.853 | 0.86 | 0.771 | 100.0% | 10 | + | total | 0.69 | 0.754 | 0.845 | 0.853 | 0.86 | 0.771 | 100.0% | 10 | + +--------------------+------+--------+--------+--------+------+-------+---------+-------+ + Load duration: 2.37443709373 + Full duration: 12.192773819 + + + + test scenario GlanceImages.create_image_and_boot_instances + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | glance.create_image | 7.016 | 7.626 | 8.071 | 8.175 | 8.28 | 7.656 | 100.0% | 10 | + | nova.boot_servers | 14.247 | 15.398 | 16.507 | 16.622 | 16.737 | 15.457 | 100.0% | 10 | + | total | 21.583 | 22.978 | 23.909 | 24.335 | 24.761 | 23.114 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 68.0709619522 + Full duration: 125.822338104 + + + + test scenario GlanceImages.create_and_list_image + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | glance.create_image | 7.021 | 7.699 | 9.045 | 14.322 | 19.599 | 8.763 | 100.0% | 10 | + | glance.list_images | 0.334 | 0.602 | 0.657 | 0.684 | 0.71 | 0.593 | 100.0% | 10 | + | total | 7.61 | 8.326 | 9.638 | 14.906 | 20.173 | 9.356 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 28.350317955 + Full duration: 54.6049070358 + + + + test scenario GlanceImages.create_and_delete_image + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | glance.create_image | 7.113 | 7.689 | 7.945 | 7.946 | 7.948 | 7.622 | 100.0% | 10 | + | glance.delete_image | 1.846 | 2.236 | 3.676 | 9.026 | 14.377 | 3.407 | 100.0% | 10 | + | total | 9.452 | 9.823 | 11.494 | 16.81 | 22.126 | 11.029 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 31.6257281303 + Full duration: 42.0794751644 + + + + run_rally - INFO - Test scenario: "glance" OK. + + run_rally - INFO - Starting test scenario "cinder" ... + run_rally - INFO - + Preparing input task + Task 9f092186-5955-4467-948a-16d0404a8c2f: started + Task 9f092186-5955-4467-948a-16d0404a8c2f: finished + + test scenario CinderVolumes.create_and_attach_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 10.268 | 12.476 | 13.344 | 13.444 | 13.544 | 12.273 | 100.0% | 10 | + | cinder.create_volume | 3.181 | 3.689 | 3.924 | 4.051 | 4.178 | 3.675 | 100.0% | 10 | + | nova.attach_volume | 3.763 | 4.185 | 6.83 | 6.904 | 6.978 | 4.705 | 100.0% | 10 | + | nova.detach_volume | 3.274 | 3.884 | 4.469 | 4.48 | 4.491 | 3.865 | 100.0% | 10 | + | cinder.delete_volume | 0.598 | 2.89 | 3.108 | 3.229 | 3.351 | 2.513 | 100.0% | 10 | + | nova.delete_server | 2.824 | 3.112 | 3.135 | 3.142 | 3.15 | 3.06 | 100.0% | 10 | + | total | 28.505 | 29.774 | 31.521 | 31.648 | 31.774 | 30.091 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 89.9433991909 + Full duration: 132.382716179 + + + + test scenario CinderVolumes.create_and_list_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | cinder.create_volume | 9.263 | 9.593 | 10.234 | 10.313 | 10.391 | 9.735 | 100.0% | 10 | + | cinder.list_volumes | 0.073 | 0.334 | 0.502 | 0.51 | 0.517 | 0.325 | 100.0% | 10 | + | total | 9.347 | 9.982 | 10.562 | 10.633 | 10.704 | 10.06 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 30.0611338615 + Full duration: 53.2253141403 + + + + test scenario CinderVolumes.create_and_list_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.693 | 3.995 | 4.393 | 4.446 | 4.498 | 4.011 | 100.0% | 10 | + | cinder.list_volumes | 0.073 | 0.365 | 0.473 | 0.503 | 0.532 | 0.334 | 100.0% | 10 | + | total | 3.792 | 4.367 | 4.739 | 4.852 | 4.964 | 4.345 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 13.0783438683 + Full duration: 34.8268380165 + + + + test scenario CinderVolumes.create_and_list_snapshots + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 3.034 | 3.324 | 3.749 | 4.714 | 5.679 | 3.488 | 100.0% | 10 | + | cinder.list_snapshots | 0.027 | 0.306 | 0.324 | 0.326 | 0.329 | 0.227 | 100.0% | 10 | + | total | 3.132 | 3.417 | 4.072 | 5.033 | 5.994 | 3.715 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.4324269295 + Full duration: 51.1932430267 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.495 | 3.952 | 4.201 | 4.213 | 4.224 | 3.929 | 100.0% | 10 | + | cinder.delete_volume | 0.559 | 2.729 | 3.265 | 3.327 | 3.389 | 2.111 | 100.0% | 10 | + | total | 4.352 | 6.379 | 7.367 | 7.421 | 7.476 | 6.04 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.7915260792 + Full duration: 37.4740400314 + + + + test scenario CinderVolumes.create_and_delete_volume + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.153 | 9.894 | 10.152 | 10.17 | 10.189 | 9.798 | 100.0% | 10 | + | cinder.delete_volume | 0.563 | 0.972 | 3.341 | 3.425 | 3.51 | 1.572 | 100.0% | 10 | + | total | 9.717 | 10.853 | 13.493 | 13.596 | 13.699 | 11.371 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 31.9503250122 + Full duration: 51.7525529861 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.461 | 3.688 | 4.442 | 4.444 | 4.447 | 3.838 | 100.0% | 10 | + | cinder.delete_volume | 0.493 | 0.917 | 3.039 | 3.183 | 3.328 | 1.504 | 100.0% | 10 | + | total | 4.048 | 4.704 | 7.416 | 7.425 | 7.434 | 5.343 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 16.7748939991 + Full duration: 35.0109767914 + + + + test scenario CinderVolumes.create_and_upload_volume_to_image + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.474 | 3.728 | 4.034 | 4.158 | 4.283 | 3.802 | 100.0% | 10 | + | cinder.upload_volume_to_image | 16.739 | 27.612 | 32.627 | 32.648 | 32.669 | 26.268 | 100.0% | 10 | + | cinder.delete_volume | 0.914 | 2.817 | 3.041 | 3.073 | 3.105 | 2.347 | 100.0% | 10 | + | nova.delete_image | 2.403 | 2.717 | 2.8 | 2.899 | 2.999 | 2.685 | 100.0% | 10 | + | total | 26.184 | 36.276 | 42.076 | 42.091 | 42.105 | 35.103 | 100.0% | 10 | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 100.882842064 + Full duration: 122.017296791 + + + + test scenario CinderVolumes.create_and_delete_snapshot + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 2.994 | 3.448 | 3.79 | 4.429 | 5.067 | 3.513 | 100.0% | 10 | + | cinder.delete_snapshot | 2.529 | 2.878 | 3.135 | 3.14 | 3.144 | 2.867 | 100.0% | 10 | + | total | 5.551 | 6.333 | 6.766 | 7.484 | 8.202 | 6.38 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 20.3024630547 + Full duration: 53.5971570015 + + + + test scenario CinderVolumes.create_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.445 | 3.759 | 3.809 | 3.811 | 3.814 | 3.703 | 100.0% | 10 | + | total | 3.445 | 3.759 | 3.809 | 3.812 | 3.814 | 3.703 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.0321419239 + Full duration: 28.9824199677 + + + + test scenario CinderVolumes.create_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.698 | 3.935 | 4.094 | 4.163 | 4.233 | 3.919 | 100.0% | 10 | + | total | 3.699 | 3.935 | 4.094 | 4.163 | 4.233 | 3.919 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.7128379345 + Full duration: 34.5113909245 + + + + test scenario CinderVolumes.list_volumes + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.list_volumes | 0.491 | 0.525 | 0.554 | 0.555 | 0.556 | 0.529 | 100.0% | 10 | + | total | 0.491 | 0.525 | 0.554 | 0.555 | 0.556 | 0.529 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.63166594505 + Full duration: 66.0012481213 + + + + test scenario CinderVolumes.create_nested_snapshots_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.397 | 3.887 | 4.192 | 4.206 | 4.22 | 3.861 | 100.0% | 10 | + | cinder.create_snapshot | 2.867 | 3.153 | 3.188 | 3.25 | 3.311 | 3.111 | 100.0% | 10 | + | nova.attach_volume | 3.869 | 5.36 | 10.321 | 11.444 | 12.567 | 6.387 | 100.0% | 10 | + | nova.detach_volume | 3.309 | 3.955 | 4.207 | 4.268 | 4.33 | 3.843 | 100.0% | 10 | + | cinder.delete_snapshot | 2.26 | 2.629 | 2.904 | 3.051 | 3.199 | 2.668 | 100.0% | 10 | + | cinder.delete_volume | 0.553 | 2.446 | 2.844 | 2.938 | 3.033 | 1.903 | 100.0% | 10 | + | total | 18.664 | 22.016 | 27.546 | 29.149 | 30.752 | 22.899 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 67.0612659454 + Full duration: 183.666878939 + + + + test scenario CinderVolumes.create_from_volume_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.553 | 3.919 | 4.193 | 4.206 | 4.219 | 3.896 | 100.0% | 10 | + | cinder.delete_volume | 2.698 | 3.101 | 3.447 | 3.564 | 3.682 | 3.136 | 100.0% | 10 | + | total | 6.251 | 7.071 | 7.484 | 7.564 | 7.645 | 7.032 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 21.0021979809 + Full duration: 55.9390618801 + + + + test scenario CinderVolumes.create_and_extend_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.435 | 4.074 | 4.424 | 4.424 | 4.425 | 4.026 | 100.0% | 10 | + | cinder.extend_volume | 0.707 | 1.246 | 3.299 | 3.344 | 3.389 | 1.877 | 100.0% | 10 | + | cinder.delete_volume | 0.692 | 1.948 | 3.07 | 3.114 | 3.157 | 1.937 | 100.0% | 10 | + | total | 5.944 | 8.052 | 8.803 | 9.273 | 9.743 | 7.84 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 23.8975720406 + Full duration: 43.0286390781 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.311 | 3.828 | 3.963 | 3.983 | 4.004 | 3.796 | 100.0% | 10 | + | cinder.create_snapshot | 2.536 | 2.956 | 3.228 | 3.282 | 3.336 | 2.967 | 100.0% | 10 | + | nova.attach_volume | 3.854 | 4.422 | 6.403 | 6.702 | 7.002 | 4.856 | 100.0% | 10 | + | nova.detach_volume | 3.28 | 3.968 | 4.168 | 4.23 | 4.291 | 3.861 | 100.0% | 10 | + | cinder.delete_snapshot | 2.409 | 2.566 | 2.92 | 2.931 | 2.943 | 2.652 | 100.0% | 10 | + | cinder.delete_volume | 0.616 | 2.517 | 2.894 | 3.087 | 3.279 | 2.098 | 100.0% | 10 | + | total | 19.096 | 21.622 | 23.818 | 24.006 | 24.195 | 21.486 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 61.8816320896 + Full duration: 192.880079985 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +-----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.008 | 3.875 | 4.246 | 4.262 | 4.278 | 3.77 | 100.0% | 10 | + | cinder.create_snapshot | 2.518 | 3.123 | 3.599 | 3.708 | 3.818 | 3.136 | 100.0% | 10 | + | nova.attach_volume | 3.945 | 5.453 | 7.683 | 8.854 | 10.024 | 5.87 | 100.0% | 10 | + | nova.detach_volume | 3.292 | 3.879 | 4.458 | 4.792 | 5.127 | 3.95 | 100.0% | 10 | + | cinder.delete_snapshot | 0.527 | 2.572 | 2.804 | 2.854 | 2.904 | 2.393 | 100.0% | 10 | + | cinder.delete_volume | 0.894 | 2.839 | 3.023 | 3.037 | 3.052 | 2.513 | 100.0% | 10 | + | total | 20.01 | 23.245 | 26.325 | 27.177 | 28.028 | 23.414 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 71.9912419319 + Full duration: 203.27274704 + + + + run_rally - INFO - Test scenario: "cinder" OK. + + run_rally - INFO - Starting test scenario "heat" ... + run_rally - INFO - + Preparing input task + Task f964ffc4-416b-4d44-b65d-29baeaea8bec: started + Task f964ffc4-416b-4d44-b65d-29baeaea8bec: finished + + test scenario HeatStacks.create_suspend_resume_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 3.969 | 4.357 | 4.55 | 4.551 | 4.551 | 4.324 | 100.0% | 10 | + | heat.suspend_stack | 1.657 | 1.711 | 1.822 | 1.868 | 1.915 | 1.731 | 100.0% | 10 | + | heat.resume_stack | 1.437 | 1.616 | 1.637 | 1.648 | 1.658 | 1.574 | 100.0% | 10 | + | heat.delete_stack | 1.403 | 1.555 | 1.702 | 2.211 | 2.721 | 1.658 | 100.0% | 10 | + | total | 8.875 | 9.374 | 9.503 | 9.735 | 9.967 | 9.288 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 27.5499420166 + Full duration: 37.6667420864 + + + + test scenario HeatStacks.create_and_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 3.985 | 4.305 | 4.343 | 4.374 | 4.405 | 4.237 | 100.0% | 10 | + | heat.delete_stack | 1.379 | 1.455 | 1.484 | 1.487 | 1.489 | 1.447 | 100.0% | 10 | + | total | 5.451 | 5.729 | 5.798 | 5.812 | 5.826 | 5.683 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 17.0478360653 + Full duration: 27.8095588684 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 26.314 | 28.232 | 29.851 | 29.855 | 29.859 | 28.255 | 100.0% | 10 | + | heat.delete_stack | 10.7 | 11.864 | 12.929 | 12.939 | 12.949 | 12.051 | 100.0% | 10 | + | total | 38.29 | 40.481 | 41.719 | 41.722 | 41.725 | 40.306 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 120.330497026 + Full duration: 130.361554861 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 22.65 | 24.176 | 25.608 | 26.138 | 26.667 | 24.433 | 100.0% | 10 | + | heat.delete_stack | 10.59 | 11.212 | 11.949 | 12.486 | 13.022 | 11.332 | 100.0% | 10 | + | total | 33.338 | 36.173 | 37.277 | 37.282 | 37.287 | 35.765 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 105.698035955 + Full duration: 115.92205596 + + + + test scenario HeatStacks.list_stacks_and_resources + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.list_stacks | 0.513 | 0.529 | 0.55 | 0.555 | 0.559 | 0.532 | 100.0% | 10 | + | heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | + | total | 0.513 | 0.529 | 0.55 | 0.555 | 0.56 | 0.532 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.66571998596 + Full duration: 10.2634401321 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+ + | heat.create_stack | 3.891 | 4.318 | 4.491 | 4.525 | 4.559 | 4.283 | 100.0% | 10 | + | heat.update_stack | 3.532 | 3.653 | 3.805 | 3.849 | 3.893 | 3.669 | 100.0% | 10 | + | heat.delete_stack | 1.517 | 2.659 | 2.766 | 2.767 | 2.768 | 2.555 | 100.0% | 10 | + | total | 9.434 | 10.591 | 10.815 | 10.957 | 11.1 | 10.507 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+--------+---------+-------+ + Load duration: 31.6606299877 + Full duration: 41.6391699314 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 3.815 | 4.241 | 4.394 | 4.403 | 4.411 | 4.206 | 100.0% | 10 | + | heat.update_stack | 3.536 | 3.637 | 3.758 | 3.809 | 3.86 | 3.655 | 100.0% | 10 | + | heat.delete_stack | 1.359 | 1.407 | 1.693 | 2.128 | 2.563 | 1.55 | 100.0% | 10 | + | total | 9.067 | 9.301 | 9.655 | 10.15 | 10.645 | 9.412 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 27.7025399208 + Full duration: 38.6538958549 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 3.845 | 4.648 | 5.545 | 5.549 | 5.552 | 4.702 | 100.0% | 10 | + | heat.update_stack | 5.818 | 5.896 | 6.239 | 6.242 | 6.246 | 5.982 | 100.0% | 10 | + | heat.delete_stack | 2.479 | 2.526 | 2.59 | 2.606 | 2.623 | 2.537 | 100.0% | 10 | + | total | 12.651 | 13.069 | 13.902 | 13.942 | 13.981 | 13.221 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.0307080746 + Full duration: 49.9186120033 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 5.244 | 5.361 | 5.485 | 5.498 | 5.511 | 5.375 | 100.0% | 10 | + | heat.update_stack | 9.239 | 9.295 | 9.34 | 9.346 | 9.353 | 9.298 | 100.0% | 10 | + | heat.delete_stack | 3.643 | 3.694 | 3.736 | 3.74 | 3.745 | 3.697 | 100.0% | 10 | + | total | 18.262 | 18.349 | 18.503 | 18.508 | 18.514 | 18.37 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 55.1248130798 + Full duration: 66.4681949615 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.185 | 4.4 | 4.476 | 4.481 | 4.486 | 4.371 | 100.0% | 10 | + | heat.update_stack | 5.806 | 5.891 | 5.921 | 5.933 | 5.946 | 5.879 | 100.0% | 10 | + | heat.delete_stack | 2.512 | 2.569 | 2.622 | 2.626 | 2.629 | 2.572 | 100.0% | 10 | + | total | 12.536 | 12.853 | 12.946 | 12.953 | 12.959 | 12.821 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 38.3984200954 + Full duration: 49.409635067 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 3.99 | 4.405 | 4.621 | 4.622 | 4.623 | 4.393 | 100.0% | 10 | + | heat.update_stack | 3.536 | 3.563 | 3.779 | 3.832 | 3.885 | 3.624 | 100.0% | 10 | + | heat.delete_stack | 1.335 | 2.488 | 2.546 | 2.555 | 2.564 | 2.09 | 100.0% | 10 | + | total | 9.272 | 10.325 | 10.734 | 10.81 | 10.886 | 10.107 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 30.7103030682 + Full duration: 41.7412381172 + + + + test scenario HeatStacks.create_and_list_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.146 | 4.271 | 4.393 | 4.448 | 4.504 | 4.284 | 100.0% | 10 | + | heat.list_stacks | 0.072 | 0.1 | 0.111 | 0.115 | 0.119 | 0.097 | 100.0% | 10 | + | total | 4.254 | 4.376 | 4.494 | 4.541 | 4.588 | 4.382 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 13.1074800491 + Full duration: 29.5266339779 + + + + test scenario HeatStacks.create_check_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 3.907 | 4.192 | 4.293 | 4.364 | 4.435 | 4.155 | 100.0% | 10 | + | heat.check_stack | 0.745 | 1.525 | 1.901 | 1.922 | 1.944 | 1.529 | 100.0% | 10 | + | heat.delete_stack | 1.391 | 2.514 | 2.598 | 2.642 | 2.685 | 2.316 | 100.0% | 10 | + | total | 7.026 | 8.237 | 8.42 | 8.494 | 8.569 | 8.0 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 23.9746980667 + Full duration: 35.3819260597 + + + + run_rally - INFO - Test scenario: "heat" OK. + + run_rally - INFO - Starting test scenario "keystone" ... + run_rally - INFO - + Preparing input task + Task 66a8f673-a0ba-4559-8d8e-34457024edd9: started + Task 66a8f673-a0ba-4559-8d8e-34457024edd9: finished + + test scenario KeystoneBasic.create_tenant_with_users + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.269 | 0.303 | 0.372 | 0.379 | 0.386 | 0.315 | 100.0% | 10 | + | keystone.create_users | 1.601 | 1.647 | 1.771 | 1.776 | 1.78 | 1.67 | 100.0% | 10 | + | total | 1.871 | 1.96 | 2.095 | 2.101 | 2.107 | 1.985 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 5.90541005135 + Full duration: 21.2136161327 + + + + test scenario KeystoneBasic.create_add_and_list_user_roles + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.274 | 0.295 | 0.314 | 0.347 | 0.379 | 0.299 | 100.0% | 10 | + | keystone.add_role | 0.254 | 0.271 | 0.354 | 0.378 | 0.401 | 0.289 | 100.0% | 10 | + | keystone.list_roles | 0.133 | 0.141 | 0.154 | 0.155 | 0.155 | 0.142 | 100.0% | 10 | + | total | 0.673 | 0.705 | 0.811 | 0.828 | 0.844 | 0.73 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.21612095833 + Full duration: 15.3072237968 + + + + test scenario KeystoneBasic.add_and_remove_user_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.278 | 0.365 | 0.443 | 0.457 | 0.472 | 0.359 | 100.0% | 10 | + | keystone.add_role | 0.262 | 0.275 | 0.348 | 0.352 | 0.356 | 0.291 | 100.0% | 10 | + | keystone.remove_role | 0.153 | 0.168 | 0.178 | 0.18 | 0.182 | 0.167 | 100.0% | 10 | + | total | 0.723 | 0.83 | 0.906 | 0.91 | 0.915 | 0.817 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.51204109192 + Full duration: 15.9939908981 + + + + test scenario KeystoneBasic.create_update_and_delete_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.283 | 0.313 | 0.4 | 0.402 | 0.403 | 0.333 | 100.0% | 10 | + | keystone.update_tenant | 0.128 | 0.156 | 0.251 | 0.251 | 0.251 | 0.178 | 100.0% | 10 | + | keystone.delete_tenant | 0.307 | 0.356 | 0.433 | 0.451 | 0.469 | 0.365 | 100.0% | 10 | + | total | 0.775 | 0.886 | 0.937 | 0.975 | 1.013 | 0.876 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.67470407486 + Full duration: 14.5480179787 + + + + test scenario KeystoneBasic.create_and_delete_service + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_service | 0.262 | 0.301 | 0.324 | 0.35 | 0.375 | 0.301 | 100.0% | 10 | + | keystone.delete_service | 0.136 | 0.163 | 0.181 | 0.209 | 0.236 | 0.165 | 100.0% | 10 | + | total | 0.413 | 0.47 | 0.521 | 0.522 | 0.524 | 0.467 | 100.0% | 10 | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.38856720924 + Full duration: 12.6957240105 + + + + test scenario KeystoneBasic.create_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.275 | 0.301 | 0.313 | 0.324 | 0.335 | 0.299 | 100.0% | 10 | + | total | 0.276 | 0.301 | 0.313 | 0.324 | 0.335 | 0.299 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.917107105255 + Full duration: 8.57450699806 + + + + test scenario KeystoneBasic.create_user + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.287 | 0.309 | 0.394 | 0.408 | 0.422 | 0.331 | 100.0% | 10 | + | total | 0.287 | 0.31 | 0.394 | 0.408 | 0.422 | 0.331 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.01195383072 + Full duration: 9.76411700249 + + + + test scenario KeystoneBasic.create_and_list_tenants + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.29 | 0.31 | 0.33 | 0.331 | 0.332 | 0.311 | 100.0% | 10 | + | keystone.list_tenants | 0.122 | 0.138 | 0.16 | 0.194 | 0.229 | 0.146 | 100.0% | 10 | + | total | 0.422 | 0.451 | 0.492 | 0.525 | 0.558 | 0.457 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.38993692398 + Full duration: 15.0407979488 + + + + test scenario KeystoneBasic.create_and_delete_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.29 | 0.367 | 0.474 | 0.501 | 0.528 | 0.374 | 100.0% | 10 | + | keystone.delete_role | 0.276 | 0.317 | 0.52 | 0.54 | 0.561 | 0.362 | 100.0% | 10 | + | total | 0.572 | 0.704 | 0.994 | 1.042 | 1.089 | 0.737 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.35643291473 + Full duration: 13.3514738083 + + + + test scenario KeystoneBasic.get_entities + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.266 | 0.31 | 0.344 | 0.369 | 0.393 | 0.313 | 100.0% | 10 | + | keystone.create_user | 0.137 | 0.157 | 0.169 | 0.174 | 0.179 | 0.158 | 100.0% | 10 | + | keystone.create_role | 0.124 | 0.142 | 0.164 | 0.199 | 0.234 | 0.151 | 100.0% | 10 | + | keystone.get_tenant | 0.112 | 0.129 | 0.147 | 0.149 | 0.15 | 0.13 | 100.0% | 10 | + | keystone.get_user | 0.126 | 0.135 | 0.148 | 0.15 | 0.153 | 0.137 | 100.0% | 10 | + | keystone.get_role | 0.116 | 0.127 | 0.143 | 0.156 | 0.169 | 0.131 | 100.0% | 10 | + | keystone.service_list | 0.117 | 0.135 | 0.218 | 0.224 | 0.23 | 0.152 | 100.0% | 10 | + | keystone.get_service | 0.12 | 0.13 | 0.172 | 0.197 | 0.221 | 0.141 | 100.0% | 10 | + | total | 1.204 | 1.319 | 1.391 | 1.394 | 1.398 | 1.315 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.94662213326 + Full duration: 21.1036419868 + + + + test scenario KeystoneBasic.create_and_list_users + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.28 | 0.313 | 0.343 | 0.364 | 0.385 | 0.32 | 100.0% | 10 | + | keystone.list_users | 0.123 | 0.141 | 0.158 | 0.197 | 0.235 | 0.148 | 100.0% | 10 | + | total | 0.43 | 0.461 | 0.516 | 0.53 | 0.545 | 0.468 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.41474604607 + Full duration: 9.85008382797 + + + + run_rally - INFO - Test scenario: "keystone" OK. + + run_rally - INFO - Starting test scenario "neutron" ... + run_rally - INFO - + Preparing input task + Task 2ead843e-f4d1-4ee2-a635-0d37175e3c39: started + Task 2ead843e-f4d1-4ee2-a635-0d37175e3c39: finished + + test scenario NeutronNetworks.create_and_delete_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.788 | 0.834 | 0.941 | 0.962 | 0.984 | 0.854 | 100.0% | 10 | + | neutron.delete_port | 0.229 | 0.625 | 0.757 | 0.814 | 0.871 | 0.637 | 100.0% | 10 | + | total | 1.057 | 1.507 | 1.702 | 1.707 | 1.712 | 1.492 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.537129879 + Full duration: 55.4609839916 + + + + test scenario NeutronNetworks.create_and_list_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.706 | 0.789 | 0.991 | 0.992 | 0.992 | 0.825 | 100.0% | 10 | + | neutron.create_router | 0.068 | 0.482 | 0.587 | 0.666 | 0.746 | 0.47 | 100.0% | 10 | + | neutron.add_interface_router | 0.711 | 0.784 | 0.907 | 1.031 | 1.155 | 0.817 | 100.0% | 10 | + | neutron.list_routers | 0.417 | 0.467 | 0.513 | 0.54 | 0.567 | 0.474 | 100.0% | 10 | + | total | 2.404 | 2.525 | 2.859 | 2.897 | 2.934 | 2.587 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.67870306969 + Full duration: 58.1500780582 + + + + test scenario NeutronNetworks.create_and_delete_routers + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.749 | 0.813 | 0.872 | 0.875 | 0.878 | 0.816 | 100.0% | 10 | + | neutron.create_router | 0.06 | 0.463 | 0.517 | 0.53 | 0.544 | 0.435 | 100.0% | 10 | + | neutron.add_interface_router | 0.335 | 0.772 | 0.867 | 0.868 | 0.869 | 0.707 | 100.0% | 10 | + | neutron.remove_interface_router | 0.341 | 0.691 | 0.901 | 0.916 | 0.93 | 0.69 | 100.0% | 10 | + | neutron.delete_router | 0.553 | 0.682 | 0.838 | 0.854 | 0.87 | 0.686 | 100.0% | 10 | + | total | 2.946 | 3.271 | 3.758 | 3.795 | 3.832 | 3.335 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 9.81285190582 + Full duration: 60.2574419975 + + + + test scenario NeutronNetworks.create_and_list_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.81 | 0.883 | 0.976 | 0.981 | 0.987 | 0.89 | 100.0% | 10 | + | neutron.list_ports | 0.563 | 0.626 | 0.776 | 0.827 | 0.877 | 0.652 | 100.0% | 10 | + | total | 1.398 | 1.535 | 1.661 | 1.723 | 1.785 | 1.542 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.79494190216 + Full duration: 57.4564638138 + + + + test scenario NeutronNetworks.create_and_delete_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.782 | 0.868 | 0.944 | 0.944 | 0.945 | 0.867 | 100.0% | 10 | + | neutron.delete_subnet | 0.579 | 0.66 | 0.806 | 0.813 | 0.82 | 0.679 | 100.0% | 10 | + | total | 1.374 | 1.515 | 1.721 | 1.735 | 1.75 | 1.546 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.67370796204 + Full duration: 54.8155629635 + + + + test scenario NeutronNetworks.create_and_delete_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.617 | 0.701 | 0.786 | 0.79 | 0.794 | 0.702 | 100.0% | 10 | + | neutron.delete_network | 0.516 | 0.595 | 0.635 | 0.66 | 0.685 | 0.592 | 100.0% | 10 | + | total | 1.156 | 1.302 | 1.382 | 1.392 | 1.401 | 1.294 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.91053414345 + Full duration: 34.4190309048 + + + + test scenario NeutronNetworks.create_and_list_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.605 | 0.698 | 0.893 | 0.897 | 0.901 | 0.723 | 100.0% | 10 | + | neutron.list_networks | 0.403 | 0.422 | 0.518 | 0.522 | 0.526 | 0.44 | 100.0% | 10 | + | total | 1.013 | 1.156 | 1.315 | 1.315 | 1.315 | 1.163 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.48294115067 + Full duration: 36.022400856 + + + + test scenario NeutronNetworks.create_and_update_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.749 | 0.82 | 0.85 | 0.884 | 0.919 | 0.816 | 100.0% | 10 | + | neutron.create_router | 0.077 | 0.47 | 0.6 | 0.73 | 0.861 | 0.482 | 100.0% | 10 | + | neutron.add_interface_router | 0.362 | 0.752 | 0.811 | 0.858 | 0.904 | 0.692 | 100.0% | 10 | + | neutron.update_router | 0.206 | 0.635 | 0.668 | 0.68 | 0.691 | 0.554 | 100.0% | 10 | + | total | 1.848 | 2.659 | 2.876 | 3.008 | 3.14 | 2.544 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.22650980949 + Full duration: 60.5388588905 + + + + test scenario NeutronNetworks.create_and_update_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.654 | 0.724 | 0.888 | 0.911 | 0.934 | 0.756 | 100.0% | 10 | + | neutron.update_network | 0.145 | 0.545 | 0.569 | 0.59 | 0.611 | 0.502 | 100.0% | 10 | + | total | 1.018 | 1.265 | 1.427 | 1.431 | 1.436 | 1.258 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.75120806694 + Full duration: 35.950884819 + + + + test scenario NeutronNetworks.create_and_update_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.814 | 0.896 | 0.995 | 1.01 | 1.024 | 0.896 | 100.0% | 10 | + | neutron.update_port | 0.181 | 0.562 | 0.612 | 0.65 | 0.689 | 0.537 | 100.0% | 10 | + | total | 0.995 | 1.461 | 1.585 | 1.597 | 1.608 | 1.433 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.42992901802 + Full duration: 55.774241209 + + + + test scenario NeutronNetworks.create_and_list_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.726 | 0.805 | 1.041 | 1.045 | 1.049 | 0.845 | 100.0% | 10 | + | neutron.list_subnets | 0.053 | 0.422 | 0.446 | 0.446 | 0.446 | 0.353 | 100.0% | 10 | + | total | 0.861 | 1.221 | 1.458 | 1.458 | 1.458 | 1.199 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.38276219368 + Full duration: 55.0756671429 + + + + test scenario NeutronNetworks.create_and_update_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.731 | 0.802 | 0.891 | 0.923 | 0.954 | 0.814 | 100.0% | 10 | + | neutron.update_subnet | 0.186 | 0.573 | 0.629 | 0.662 | 0.694 | 0.455 | 100.0% | 10 | + | total | 0.962 | 1.374 | 1.524 | 1.533 | 1.543 | 1.27 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.90665698051 + Full duration: 56.0127599239 + + + + run_rally - INFO - Test scenario: "neutron" OK. + + run_rally - INFO - Starting test scenario "nova" ... + run_rally - INFO - + Preparing input task + Task 63203b68-fb0f-4190-b881-339d49343b7e: started + Task 63203b68-fb0f-4190-b881-339d49343b7e: finished + + test scenario NovaKeypair.create_and_delete_keypair + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.701 | 0.818 | 0.937 | 1.171 | 1.406 | 0.867 | 100.0% | 10 | + | nova.delete_keypair | 0.032 | 0.044 | 0.06 | 0.062 | 0.065 | 0.046 | 100.0% | 10 | + | total | 0.733 | 0.862 | 0.986 | 1.228 | 1.471 | 0.913 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.58676719666 + Full duration: 44.6176929474 + + + + test scenario NovaServers.snapshot_server + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 13.231 | 15.082 | 16.288 | 16.485 | 16.681 | 15.005 | 100.0% | 10 | + | nova.create_image | 11.557 | 12.205 | 14.231 | 14.559 | 14.887 | 12.815 | 100.0% | 10 | + | nova.delete_server | 2.824 | 3.432 | 3.623 | 3.636 | 3.649 | 3.306 | 100.0% | 10 | + | nova.boot_server (2) | 11.125 | 13.278 | 14.799 | 15.311 | 15.823 | 13.287 | 100.0% | 10 | + | nova.delete_server (2) | 2.504 | 2.94 | 3.422 | 3.44 | 3.457 | 3.055 | 100.0% | 10 | + | nova.delete_image | 2.668 | 3.276 | 3.598 | 3.634 | 3.669 | 3.259 | 100.0% | 10 | + | total | 47.925 | 50.051 | 54.553 | 54.844 | 55.135 | 50.728 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 149.159065008 + Full duration: 223.027470827 + + + + test scenario NovaKeypair.boot_and_delete_server_with_keypair + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_keypair | 0.681 | 0.807 | 0.953 | 1.005 | 1.056 | 0.813 | 100.0% | 10 | + | nova.boot_server | 12.625 | 13.795 | 14.626 | 14.992 | 15.358 | 13.92 | 100.0% | 10 | + | nova.delete_server | 2.895 | 3.252 | 3.838 | 4.433 | 5.028 | 3.378 | 100.0% | 10 | + | nova.delete_keypair | 0.041 | 0.049 | 0.084 | 0.2 | 0.316 | 0.076 | 100.0% | 10 | + | total | 16.437 | 18.013 | 19.364 | 19.978 | 20.591 | 18.187 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 54.020512104 + Full duration: 122.761439085 + + + + test scenario NovaKeypair.create_and_list_keypairs + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.633 | 0.811 | 0.88 | 0.945 | 1.01 | 0.797 | 100.0% | 10 | + | nova.list_keypairs | 0.019 | 0.032 | 0.048 | 0.057 | 0.065 | 0.034 | 100.0% | 10 | + | total | 0.663 | 0.833 | 0.925 | 0.988 | 1.051 | 0.831 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.51079297066 + Full duration: 45.2959558964 + + + + test scenario NovaServers.list_servers + +---------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+------+-------+---------+-------+ + | nova.list_servers | 1.153 | 1.561 | 1.667 | 1.699 | 1.73 | 1.534 | 100.0% | 10 | + | total | 1.153 | 1.562 | 1.667 | 1.699 | 1.73 | 1.534 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+------+-------+---------+-------+ + Load duration: 4.51852703094 + Full duration: 136.974627972 + + + + test scenario NovaServers.resize_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.504 | 13.59 | 14.825 | 15.228 | 15.63 | 13.671 | 100.0% | 10 | + | nova.resize | 41.099 | 42.204 | 47.49 | 47.556 | 47.621 | 44.023 | 100.0% | 10 | + | nova.resize_confirm | 2.651 | 3.698 | 3.805 | 4.059 | 4.314 | 3.556 | 100.0% | 10 | + | nova.delete_server | 2.631 | 3.022 | 3.411 | 4.443 | 5.475 | 3.21 | 100.0% | 10 | + | total | 60.59 | 62.713 | 69.597 | 69.873 | 70.149 | 64.46 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 192.511741161 + Full duration: 232.632377863 + + + + test scenario NovaServers.boot_server_from_volume_and_delete + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.605 | 10.39 | 10.671 | 10.678 | 10.685 | 10.283 | 100.0% | 10 | + | nova.boot_server | 13.194 | 15.101 | 15.844 | 16.008 | 16.171 | 15.084 | 100.0% | 10 | + | nova.delete_server | 5.067 | 5.835 | 6.025 | 6.147 | 6.269 | 5.704 | 100.0% | 10 | + | total | 29.712 | 31.089 | 31.863 | 32.17 | 32.477 | 31.072 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 93.8591198921 + Full duration: 176.781407833 + + + + test scenario NovaServers.boot_and_migrate_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.007 | 12.628 | 15.251 | 15.726 | 16.2 | 13.337 | 100.0% | 10 | + | nova.stop_server | 5.734 | 6.679 | 7.157 | 7.198 | 7.239 | 6.643 | 100.0% | 10 | + | nova.migrate | 11.005 | 12.115 | 12.764 | 12.898 | 13.031 | 12.041 | 100.0% | 10 | + | nova.resize_confirm | 2.991 | 3.639 | 4.391 | 5.442 | 6.493 | 3.866 | 100.0% | 10 | + | nova.delete_server | 2.512 | 2.889 | 3.089 | 3.162 | 3.235 | 2.846 | 100.0% | 10 | + | total | 36.009 | 38.096 | 41.114 | 42.08 | 43.046 | 38.733 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 117.547358036 + Full duration: 158.547077894 + + + + test scenario NovaServers.boot_and_delete_server + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.11 | 12.864 | 14.437 | 14.962 | 15.486 | 13.148 | 100.0% | 10 | + | nova.delete_server | 2.855 | 3.146 | 3.605 | 3.624 | 3.644 | 3.198 | 100.0% | 10 | + | total | 15.189 | 15.944 | 18.012 | 18.222 | 18.433 | 16.346 | 100.0% | 10 | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 47.4842679501 + Full duration: 115.855407953 + + + + test scenario NovaServers.boot_and_rebuild_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 11.096 | 13.966 | 14.767 | 14.775 | 14.783 | 13.664 | 100.0% | 10 | + | nova.rebuild_server | 12.012 | 14.475 | 15.049 | 15.15 | 15.252 | 14.233 | 100.0% | 10 | + | nova.delete_server | 2.573 | 2.99 | 3.499 | 4.34 | 5.181 | 3.213 | 100.0% | 10 | + | total | 28.419 | 30.951 | 32.946 | 34.081 | 35.216 | 31.111 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 91.1762368679 + Full duration: 160.48626709 + + + + test scenario NovaSecGroup.create_and_list_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.384 | 5.131 | 5.534 | 5.638 | 5.741 | 5.066 | 100.0% | 10 | + | nova.create_100_rules | 42.262 | 43.319 | 44.707 | 45.482 | 46.258 | 43.582 | 100.0% | 10 | + | nova.list_security_groups | 0.18 | 0.248 | 0.52 | 0.602 | 0.685 | 0.299 | 100.0% | 10 | + | total | 47.342 | 48.922 | 49.657 | 50.789 | 51.921 | 48.948 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 145.205770016 + Full duration: 212.670469999 + + + + test scenario NovaSecGroup.create_and_delete_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 3.797 | 4.842 | 5.428 | 5.548 | 5.668 | 4.805 | 100.0% | 10 | + | nova.create_100_rules | 42.897 | 43.258 | 45.74 | 45.781 | 45.822 | 43.845 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.712 | 2.272 | 2.576 | 2.63 | 2.685 | 2.249 | 100.0% | 10 | + | total | 49.862 | 50.866 | 51.896 | 52.159 | 52.422 | 50.9 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 153.145931959 + Full duration: 195.681600094 + + + + test scenario NovaServers.boot_and_bounce_server + +-------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.233 | 14.014 | 14.779 | 15.28 | 15.781 | 13.878 | 100.0% | 10 | + | nova.reboot_server | 5.429 | 5.857 | 6.286 | 6.298 | 6.31 | 5.906 | 100.0% | 10 | + | nova.soft_reboot_server | 7.965 | 8.388 | 8.771 | 8.786 | 8.801 | 8.365 | 100.0% | 10 | + | nova.stop_server | 4.492 | 6.237 | 6.84 | 6.896 | 6.952 | 6.14 | 100.0% | 10 | + | nova.start_server | 3.528 | 4.271 | 5.459 | 5.844 | 6.229 | 4.465 | 100.0% | 10 | + | nova.rescue_server | 7.297 | 8.174 | 10.803 | 11.337 | 11.872 | 8.852 | 100.0% | 10 | + | nova.unrescue_server | 5.397 | 5.465 | 5.755 | 5.956 | 6.158 | 5.563 | 100.0% | 10 | + | nova.delete_server | 2.694 | 2.967 | 3.17 | 3.266 | 3.362 | 2.999 | 100.0% | 10 | + | total | 53.124 | 55.752 | 58.931 | 59.472 | 60.013 | 56.189 | 100.0% | 10 | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 166.732338905 + Full duration: 235.669921875 + + + + test scenario NovaServers.boot_server + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------+--------+--------+--------+--------+------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------+--------+--------+--------+--------+------+--------+---------+-------+ + | nova.boot_server | 12.435 | 13.902 | 14.341 | 14.37 | 14.4 | 13.679 | 100.0% | 10 | + | total | 12.435 | 13.903 | 14.341 | 14.37 | 14.4 | 13.679 | 100.0% | 10 | + +------------------+--------+--------+--------+--------+------+--------+---------+-------+ + Load duration: 40.4824538231 + Full duration: 98.6827569008 + + + + test scenario NovaSecGroup.boot_and_delete_server_with_secgroups + +-----------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.34 | 5.246 | 5.496 | 5.585 | 5.675 | 5.171 | 100.0% | 10 | + | nova.create_100_rules | 41.95 | 43.077 | 44.37 | 44.812 | 45.253 | 43.236 | 100.0% | 10 | + | nova.boot_server | 10.869 | 11.908 | 13.524 | 13.633 | 13.742 | 12.265 | 100.0% | 10 | + | nova.get_attached_security_groups | 0.224 | 0.267 | 0.504 | 0.555 | 0.607 | 0.332 | 100.0% | 10 | + | nova.delete_server | 2.533 | 2.618 | 3.078 | 3.091 | 3.103 | 2.742 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.637 | 1.754 | 2.383 | 2.591 | 2.798 | 1.972 | 100.0% | 10 | + | total | 64.243 | 65.856 | 66.932 | 67.145 | 67.358 | 65.721 | 100.0% | 10 | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 197.864094019 + Full duration: 266.162395 + + + + test scenario NovaServers.pause_and_unpause_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.223 | 14.903 | 15.571 | 15.708 | 15.844 | 14.546 | 100.0% | 10 | + | nova.pause_server | 2.791 | 3.173 | 3.334 | 3.379 | 3.424 | 3.141 | 100.0% | 10 | + | nova.unpause_server | 2.459 | 2.849 | 3.186 | 3.266 | 3.346 | 2.907 | 100.0% | 10 | + | nova.delete_server | 2.863 | 3.13 | 3.335 | 3.403 | 3.47 | 3.121 | 100.0% | 10 | + | total | 20.391 | 24.232 | 24.74 | 24.758 | 24.775 | 23.717 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 72.4143497944 + Full duration: 139.801489115 + + + + test scenario NovaServers.boot_server_from_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.672 | 10.675 | 10.972 | 11.222 | 11.472 | 10.543 | 100.0% | 10 | + | nova.boot_server | 14.233 | 16.466 | 17.095 | 17.399 | 17.704 | 16.109 | 100.0% | 10 | + | total | 23.906 | 27.176 | 27.879 | 28.21 | 28.54 | 26.653 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 79.5798490047 + Full duration: 145.711636782 + + + + test scenario NovaServers.boot_and_list_server + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 12.064 | 14.109 | 15.049 | 15.436 | 15.823 | 13.885 | 100.0% | 10 | + | nova.list_servers | 0.612 | 0.992 | 1.197 | 1.199 | 1.201 | 0.948 | 100.0% | 10 | + | total | 13.261 | 15.082 | 15.982 | 16.209 | 16.435 | 14.833 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 43.442057848 + Full duration: 128.433704138 + + + + run_rally - INFO - Test scenario: "nova" OK. + + run_rally - INFO - Starting test scenario "quotas" ... + run_rally - INFO - + Preparing input task + Task f60014e7-4880-41c6-afbc-ea7d18ef56e0: started + Task f60014e7-4880-41c6-afbc-ea7d18ef56e0: finished + + test scenario Quotas.cinder_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.111 | 1.203 | 1.671 | 1.682 | 1.692 | 1.279 | 100.0% | 10 | + | total | 1.111 | 1.203 | 1.671 | 1.682 | 1.692 | 1.279 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.63238286972 + Full duration: 15.5500700474 + + + + test scenario Quotas.neutron_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.392 | 0.43 | 0.632 | 0.65 | 0.667 | 0.482 | 100.0% | 10 | + | total | 0.555 | 0.597 | 0.799 | 0.808 | 0.816 | 0.64 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.90143704414 + Full duration: 12.9954409599 + + + + test scenario Quotas.cinder_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.086 | 1.207 | 1.358 | 1.436 | 1.513 | 1.228 | 100.0% | 10 | + | quotas.delete_quotas | 0.549 | 0.88 | 0.94 | 0.951 | 0.963 | 0.839 | 100.0% | 10 | + | total | 1.654 | 2.078 | 2.316 | 2.37 | 2.424 | 2.067 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 6.08279585838 + Full duration: 18.0140779018 + + + + test scenario Quotas.nova_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.573 | 0.62 | 0.652 | 0.658 | 0.664 | 0.619 | 100.0% | 10 | + | quotas.delete_quotas | 0.016 | 0.025 | 0.028 | 0.032 | 0.036 | 0.024 | 100.0% | 10 | + | total | 0.599 | 0.642 | 0.678 | 0.68 | 0.681 | 0.643 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.95340800285 + Full duration: 13.6638329029 + + + + test scenario Quotas.nova_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.575 | 0.616 | 0.669 | 0.681 | 0.692 | 0.622 | 100.0% | 10 | + | total | 0.575 | 0.616 | 0.669 | 0.681 | 0.692 | 0.622 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.90668487549 + Full duration: 13.5694701672 + + + + run_rally - INFO - Test scenario: "quotas" OK. + + run_rally - INFO - Starting test scenario "requests" ... + run_rally - INFO - + Preparing input task + Task 3835bbc7-faf5-4671-9261-aa07c1d6a1e2: started + Task 3835bbc7-faf5-4671-9261-aa07c1d6a1e2: finished + + test scenario HttpRequests.check_random_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 5.049 | 5.088 | 5.34 | 5.361 | 5.381 | 5.151 | 100.0% | 10 | + | total | 5.049 | 5.088 | 5.34 | 5.361 | 5.381 | 5.151 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 15.4988431931 + Full duration: 20.5546550751 + + + + test scenario HttpRequests.check_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 5.048 | 5.052 | 5.057 | 5.058 | 5.058 | 5.053 | 100.0% | 10 | + | total | 5.048 | 5.052 | 5.057 | 5.058 | 5.058 | 5.053 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 15.2044279575 + Full duration: 20.1352801323 + + + + run_rally - INFO - Test scenario: "requests" OK. + + run_rally - INFO - + + + Rally Summary Report + +===================+============+===============+===========+ + | Module | Duration | nb. Test Run | Success | + +===================+============+===============+===========+ + | authenticate | 00:58 | 10 | 100.00% | + +-------------------+------------+---------------+-----------+ + | glance | 03:54 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | cinder | 22:59 | 50 | 100.00% | + +-------------------+------------+---------------+-----------+ + | heat | 11:14 | 35 | 100.00% | + +-------------------+------------+---------------+-----------+ + | keystone | 02:37 | 29 | 100.00% | + +-------------------+------------+---------------+-----------+ + | neutron | 10:19 | 31 | 100.00% | + +-------------------+------------+---------------+-----------+ + | nova | 47:19 | 61 | 100.00% | + +-------------------+------------+---------------+-----------+ + | quotas | 01:13 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | requests | 00:40 | 2 | 100.00% | + +-------------------+------------+---------------+-----------+ + +===================+============+===============+===========+ + | TOTAL: | 01:41:19 | 232 | 100.00% | + +===================+============+===============+===========+ + +:: diff --git a/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst b/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst deleted file mode 100644 index d3202fa5..00000000 --- a/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst +++ /dev/null @@ -1,10 +0,0 @@ -.. This work is licensed under a Creative Commons Attribution 4.0 International Licence. -.. http://creativecommons.org/licenses/by/4.0 - -Test results for fuel-os-odl_l2-bgpvpn-ha -========================================= - -.. Add any text in here that could be useful for a reader. - -.. Add the test results in a consistent format. - diff --git a/docs/results/fuel-os-odl_l2-nofeature-ha.rst b/docs/results/fuel-os-odl_l2-nofeature-ha.rst index 39fb4207..efa6a178 100644 --- a/docs/results/fuel-os-odl_l2-nofeature-ha.rst +++ b/docs/results/fuel-os-odl_l2-nofeature-ha.rst @@ -1,10 +1,2387 @@ .. This work is licensed under a Creative Commons Attribution 4.0 International Licence. .. http://creativecommons.org/licenses/by/4.0 -Test results for fuel-os-odl_l2-nofeature-ha -============================================ +Detailed test results for fuel-os-odl_l2-nofeature-ha +------------------------------------------------------- -.. Add any text in here that could be useful for a reader. +The following section outlines the detailed Functest results for the Brahmaputra scenario +deploying OpenStack in a Pharos environment by the Fuel installer. -.. Add the test results in a consistent format. +vPing_SSH +^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-SSH test... + vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_ssh- INFO - Creating neutron network vping-net... + vPing_ssh- INFO - Creating security group 'vPing-sg'... + vPing_ssh- INFO - Using existing Flavor 'm1.small'... + vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35' + vPing_ssh- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + + vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'... + vPing_ssh- INFO - Floating IP created: '10.118.101.200' + vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2' + vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200... + vPing_ssh- INFO - Waiting for ping... + vPing_ssh- INFO - vPing detected! + vPing_ssh- INFO - vPing duration:'42.1' s. + vPing_ssh- INFO - Cleaning up... + vPing_ssh- INFO - vPing OK +:: + + +vPing_userdata +^^^^^^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-userdata test... + vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_userdata- INFO - Creating neutron network vping-net... + vPing_userdata- INFO - Creating security group 'vPing-sg'... + vPing_userdata- INFO - Flavor found 'm1.small' + vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00' + vPing_userdata- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + + vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_userdata- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + userdata= + #!/bin/sh + + while true; do + ping -c 1 192.168.130.4 2>&1 >/dev/null + RES=$? + if [ "Z$RES" = "Z0" ] ; then + echo 'vPing OK' + break + else + echo 'vPing KO' + fi + sleep 1 + done + + vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_userdata- INFO - Waiting for ping... + vPing_userdata- INFO - vPing detected! + vPing_userdata- INFO - vPing duration:'28.6' + vPing_userdata- INFO - vPing OK + vPing_userdata- INFO - Cleaning up... + vPing_userdata- INFO - Deleting network 'vping-net'... +:: + + +Tempest +^^^^^^^ +:: + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | name | time | status | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.49156 | success | + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.10940 | success | + | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 15.01623 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 29.41033 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 13.86580 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.60879 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.34531 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.33518 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.96138 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.90751 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.62183 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.62195 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.33497 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.64235 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 1.23145 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.83801 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 1.18842 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.35784 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.09813 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.88696 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.84049 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.52238 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 3.63444 | success | + | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 6.75102 | success | + | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 14.44295 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 316.24706 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.34052 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.75888 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 316.38576 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00196 | success | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.10067 | success | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 4.93829 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.78542 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.64749 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.89411 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.32315 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.91146 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.13496 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.11222 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.11119 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.09119 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.10776 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.57188 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00131 | skip | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.20660 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.08830 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.02378 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.33571 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.10769 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.02694 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.02251 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.04963 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.07987 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.08196 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.92759 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.03606 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.09925 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.10704 | success | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.20889 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.78463 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.44852 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.37770 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.72001 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.74485 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.67380 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 4.65947 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 19.27912 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 22.83188 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 13.05190 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 10.22705 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 3.02970 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 4.04190 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 2.67671 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 3.10372 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 3.80641 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.05689 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.62404 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.47470 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.21997 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 2.20741 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 3.12907 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.56617 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.38405 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.74547 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.94955 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.62631 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 1.24089 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.28176 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.39299 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 0.59369 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.00537 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.35547 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02691 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.77671 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.03595 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.67764 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.12390 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.35252 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.05395 | success | + | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 343.72467 | fail | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.95003 | success | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.99399 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.31689 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.02590 | success | + | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail | + | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.0 | fail | + | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.09974 | success | + | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.21063 | success | + | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.0 | fail | + | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.0 | fail | + | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.0 | fail | + | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.77355 | success | + | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.0 | fail | + | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.63115 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10751 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.08180 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.11419 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.09997 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.15346 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.10901 | success | + | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.26936 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.78244 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 2.75904 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 3.58070 | success | + | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 6.97865 | success | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.0 | fail | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 0.0 | fail | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 2.19846 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 3.01338 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 5.65439 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 5.23138 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 4.63026 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 4.20924 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 3.23093 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.72657 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.45440 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.37147 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.35779 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.30639 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 3.21748 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.64248 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.30977 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.03731 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.49862 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.26355 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 3.12061 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 3.35577 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.94748 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.39794 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.33413 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 3.39562 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 5.89837 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.99973 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.58956 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.48395 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 10.99445 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 6.94692 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 4.69234 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 0.56033 | fail | + | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 8.28629 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.94750 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 4.97154 | success | + | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 3.42252 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 2.06578 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.53065 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.29313 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.98492 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.10014 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.39465 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.76994 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 7.29710 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.05370 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.0 | fail | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 0.0 | fail | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.0 | fail | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 20.70674 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 12.57512 | success | + | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.94613 | success | + | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.13954 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 15.28613 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 17.92871 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 15.55119 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 19.10263 | success | + | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.07108 | success | + | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.37294 | success | + | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 25.63959 | fail | + | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 16.24070 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 343.58312 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 356.71394 | fail | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + run_tempest - INFO - Results: {'timestart': '2016-02-1905:28:37.031139', 'duration': 730, 'tests': 210, 'failures': 40} +:: + + +ODL +^^^^ +:: + ============================================================================== + Basic + ============================================================================== + Basic.010 Restconf OK :: Test suite to verify Restconf is OK + ============================================================================== + Get Controller Modules :: Get the controller modules via Restconf | PASS | + ------------------------------------------------------------------------------ + Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS | + 1 critical test, 1 passed, 0 failed + 1 test total, 1 passed, 0 failed + ============================================================================== + Basic | PASS | + 1 critical test, 1 passed, 0 failed + 1 test total, 1 passed, 0 failed + ============================================================================== + Output: /home/opnfv/repos/functest/output.xml + Log: /home/opnfv/repos/functest/log.html + Report: /home/opnfv/repos/functest/report.html + [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m + ============================================================================== + Neutron :: Test suite for Neutron Plugin + ============================================================================== + Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope... + ============================================================================== + Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | + ------------------------------------------------------------------------------ + Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | + ------------------------------------------------------------------------------ + Create Network :: Create new network in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check Network :: Check Network created in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Networks :: Checking Network created in OpenStack are push... | PASS | + 4 critical tests, 4 passed, 0 failed + 4 tests total, 4 passed, 0 failed + ============================================================================== + Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open... + ============================================================================== + Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS | + ------------------------------------------------------------------------------ + Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | + ------------------------------------------------------------------------------ + Create New subnet :: Create new subnet in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check New subnet :: Check new subnet created in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS | + 4 critical tests, 4 passed, 0 failed + 4 tests total, 4 passed, 0 failed + ============================================================================== + Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight + ============================================================================== + Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | + ------------------------------------------------------------------------------ + Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | + ------------------------------------------------------------------------------ + Create New Port :: Create new port in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check New Port :: Check new subnet created in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS | + 4 critical tests, 4 passed, 0 failed + 4 tests total, 4 passed, 0 failed + ============================================================================== + Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also... + ============================================================================== + Delete New Port :: Delete previously created port in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check Port Deleted :: Check port deleted in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS | + 2 critical tests, 2 passed, 0 failed + 2 tests total, 2 passed, 0 failed + ============================================================================== + Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted... + ============================================================================== + Delete New subnet :: Delete previously created subnet in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS | + 2 critical tests, 2 passed, 0 failed + 2 tests total, 2 passed, 0 failed + ============================================================================== + Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete... + ============================================================================== + Delete Network :: Delete network in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check Network deleted :: Check Network deleted in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS | + 2 critical tests, 2 passed, 0 failed + 2 tests total, 2 passed, 0 failed + ============================================================================== + Neutron :: Test suite for Neutron Plugin | PASS | + 18 critical tests, 18 passed, 0 failed + 18 tests total, 18 passed, 0 failed + ============================================================================== + Output: /home/opnfv/repos/functest/output.xml + Log: /home/opnfv/repos/functest/log.html + Report: /home/opnfv/repos/functest/report.html + [0;32mFinal report is located:[0m + Log: /home/opnfv/repos/functest/log.html + Report: /home/opnfv/repos/functest/report.html +:: + +vIMS +^^^^ +:: + FUNCTEST.info: Running vIMS test... + vIMS - INFO - Prepare OpenStack plateform (create tenant and user) + vIMS - INFO - Update OpenStack creds informations + vIMS - INFO - Upload some OS images if it doesn't exist + vIMS - INFO - centos_7 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - Update security group quota for this tenant + vIMS - INFO - Update cinder quota for this tenant + vIMS - INFO - Collect flavor id for cloudify manager server + vIMS - INFO - Prepare virtualenv for cloudify-cli + vIMS - INFO - Downloading the cloudify manager server blueprint + vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47' + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the cloudify-manager deployment + vIMS - INFO - Cloudify-manager server is UP ! + vIMS - INFO - Cloudify deployment duration:'1149.9' + vIMS - INFO - Collect flavor id for all clearwater vm + vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00' + vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the clearwater deployment + vIMS - INFO - The deployment of clearwater-opnfv is ended + vIMS - INFO - vIMS VNF deployment duration:'1133.8' + vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59' + vIMS - INFO - vIMS functional test duration:'2.9' + vIMS - INFO - Launching the clearwater-opnfv undeployment + vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; ' + vIMS - INFO - Launching the cloudify-manager undeployment + vIMS - INFO - Cloudify-manager server has been successfully removed! + vIMS - INFO - Removing vIMS tenant .. + vIMS - INFO - Removing vIMS user .. +:: + +Promise +^^^^^^^ +:: + FUNCTEST.info: Running PROMISE test case... + Promise- INFO - Creating tenant 'promise'... + Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'... + Promise- INFO - Creating user 'promiser'... + Promise- INFO - Updating OpenStack credentials... + Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + Promise- INFO - Creating flavor 'promise-flavor'... + Promise- INFO - Exporting environment variables... + Promise- INFO - Running command: npm run -s test -- --reporter json + Promise- INFO - The test succeeded. + Promise- DEBUG - + { + "stats": { + "suites": 23, + "tests": 33, + "passes": 33, + "pending": 0, + "failures": 0, + "start": "2016-02-19T05:41:25.739Z", + "end": "2016-02-19T05:41:31.140Z", + "duration": 5524 + }, + "tests": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ], + "pending": [], + "failures": [], + "passes": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ] + } + Promise- INFO - + **************************************** + Promise test report + + **************************************** + Suites: 23 + Tests: 33 + Passes: 33 + Pending: 0 + Failures: 0 + Start: 2016-02-19T05:41:25.739Z + End: 2016-02-19T05:41:31.140Z + Duration: 6.301 + **************************************** +:: + + +Rally +^^^^^ +:: + FUNCTEST.info: Running Rally benchmark suite... + run_rally - INFO - Starting test scenario "authenticate" ... + run_rally - INFO - + Preparing input task + Task c7f4e0fd-a882-4e14-ba02-553118d0cb77: started + Task c7f4e0fd-a882-4e14-ba02-553118d0cb77: finished + + test scenario Authenticate.validate_glance + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_glance | 0.535 | 0.78 | 0.847 | 0.86 | 0.874 | 0.74 | 100.0% | 10 | + | authenticate.validate_glance (2) | 0.667 | 0.689 | 0.793 | 0.807 | 0.821 | 0.717 | 100.0% | 10 | + | total | 1.381 | 1.677 | 1.718 | 1.735 | 1.752 | 1.625 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.80417394638 + Full duration: 12.8028140068 + + + + test scenario Authenticate.keystone + +-----------------------------------------------------------------------------+ + | Response Times (sec) | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | total | 0.121 | 0.149 | 0.163 | 0.164 | 0.166 | 0.149 | 100.0% | 10 | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.489310979843 + Full duration: 7.96697187424 + + + + test scenario Authenticate.validate_heat + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_heat | 0.259 | 0.318 | 0.482 | 0.511 | 0.539 | 0.371 | 100.0% | 10 | + | authenticate.validate_heat (2) | 0.051 | 0.287 | 0.385 | 0.386 | 0.387 | 0.24 | 100.0% | 10 | + | total | 0.512 | 0.771 | 0.957 | 0.996 | 1.035 | 0.776 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.53649091721 + Full duration: 10.2540290356 + + + + test scenario Authenticate.validate_nova + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_nova | 0.3 | 0.332 | 0.474 | 0.482 | 0.489 | 0.368 | 100.0% | 10 | + | authenticate.validate_nova (2) | 0.034 | 0.049 | 0.059 | 0.065 | 0.07 | 0.05 | 100.0% | 10 | + | total | 0.499 | 0.564 | 0.716 | 0.722 | 0.727 | 0.586 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.84303689003 + Full duration: 9.65319395065 + + + + test scenario Authenticate.validate_cinder + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_cinder | 0.274 | 0.428 | 0.475 | 0.509 | 0.543 | 0.405 | 100.0% | 10 | + | authenticate.validate_cinder (2) | 0.025 | 0.424 | 0.455 | 0.456 | 0.458 | 0.376 | 100.0% | 10 | + | total | 0.469 | 1.071 | 1.131 | 1.141 | 1.151 | 0.964 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.72650790215 + Full duration: 10.753674984 + + + + test scenario Authenticate.validate_neutron + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_neutron | 0.28 | 0.302 | 0.32 | 0.326 | 0.333 | 0.303 | 100.0% | 10 | + | authenticate.validate_neutron (2) | 0.046 | 0.31 | 0.334 | 0.34 | 0.346 | 0.262 | 100.0% | 10 | + | total | 0.467 | 0.764 | 0.81 | 0.838 | 0.866 | 0.728 | 100.0% | 10 | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.37260484695 + Full duration: 9.99744796753 + + + + run_rally - INFO - Test scenario: "authenticate" OK. + + run_rally - INFO - Starting test scenario "glance" ... + run_rally - INFO - + Preparing input task + Task d54fa25b-b992-4b4e-bef2-14425b86329c: started + Task d54fa25b-b992-4b4e-bef2-14425b86329c: finished + + test scenario GlanceImages.list_images + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.list_images | 0.877 | 0.902 | 0.997 | 0.998 | 0.999 | 0.932 | 100.0% | 10 | + | total | 0.877 | 0.902 | 0.997 | 0.998 | 0.999 | 0.932 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.92263484001 + Full duration: 13.4585630894 + + + + test scenario GlanceImages.create_image_and_boot_instances + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + | glance.create_image | 7.386 | 7.929 | 8.381 | 8.481 | 8.581 | 7.97 | 100.0% | 10 | + | nova.boot_servers | 8.641 | 10.384 | 10.714 | 11.007 | 11.3 | 10.241 | 100.0% | 10 | + | total | 16.702 | 18.427 | 18.943 | 19.047 | 19.15 | 18.211 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + Load duration: 54.6946680546 + Full duration: 110.071588039 + + + + test scenario GlanceImages.create_and_list_image + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.create_image | 7.081 | 7.618 | 8.085 | 8.19 | 8.296 | 7.689 | 100.0% | 10 | + | glance.list_images | 0.324 | 0.573 | 0.642 | 0.714 | 0.786 | 0.573 | 100.0% | 10 | + | total | 7.612 | 8.241 | 8.722 | 8.902 | 9.082 | 8.262 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 24.6801600456 + Full duration: 39.2870121002 + + + + test scenario GlanceImages.create_and_delete_image + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | glance.create_image | 7.449 | 7.593 | 7.856 | 8.073 | 8.289 | 7.673 | 100.0% | 10 | + | glance.delete_image | 2.001 | 2.442 | 12.75 | 13.42 | 14.089 | 5.507 | 100.0% | 10 | + | total | 9.487 | 10.064 | 20.503 | 21.441 | 22.378 | 13.18 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 40.0675120354 + Full duration: 50.2370131016 + + + + run_rally - INFO - Test scenario: "glance" OK. + + run_rally - INFO - Starting test scenario "cinder" ... + run_rally - INFO - + Preparing input task + Task 6b2be534-fd42-4a5f-be0e-9a789027d4b3: started + Task 6b2be534-fd42-4a5f-be0e-9a789027d4b3: finished + + test scenario CinderVolumes.create_and_attach_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 7.135 | 7.936 | 8.663 | 8.672 | 8.68 | 7.941 | 100.0% | 10 | + | cinder.create_volume | 3.274 | 3.507 | 4.072 | 4.096 | 4.12 | 3.616 | 100.0% | 10 | + | nova.attach_volume | 4.012 | 4.845 | 6.553 | 6.624 | 6.694 | 5.31 | 100.0% | 10 | + | nova.detach_volume | 3.256 | 3.739 | 3.938 | 4.096 | 4.253 | 3.716 | 100.0% | 10 | + | cinder.delete_volume | 0.464 | 2.707 | 2.98 | 3.154 | 3.328 | 1.98 | 100.0% | 10 | + | nova.delete_server | 2.784 | 3.059 | 3.15 | 3.19 | 3.23 | 3.04 | 100.0% | 10 | + | total | 22.316 | 26.079 | 27.631 | 28.362 | 29.094 | 25.604 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 73.9451169968 + Full duration: 116.516190052 + + + + test scenario CinderVolumes.create_and_list_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | cinder.create_volume | 9.065 | 9.591 | 9.94 | 9.943 | 9.945 | 9.554 | 100.0% | 10 | + | cinder.list_volumes | 0.048 | 0.346 | 0.386 | 0.394 | 0.402 | 0.301 | 100.0% | 10 | + | total | 9.138 | 9.94 | 10.313 | 10.324 | 10.335 | 9.855 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 28.8989629745 + Full duration: 51.7012848854 + + + + test scenario CinderVolumes.create_and_list_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.251 | 3.883 | 4.897 | 4.899 | 4.901 | 4.006 | 100.0% | 10 | + | cinder.list_volumes | 0.055 | 0.072 | 0.333 | 0.334 | 0.334 | 0.145 | 100.0% | 10 | + | total | 3.313 | 3.952 | 5.212 | 5.223 | 5.234 | 4.151 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.7280011177 + Full duration: 34.1200621128 + + + + test scenario CinderVolumes.create_and_list_snapshots + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 2.973 | 3.289 | 5.554 | 5.57 | 5.585 | 3.702 | 100.0% | 10 | + | cinder.list_snapshots | 0.027 | 0.162 | 0.313 | 0.32 | 0.326 | 0.168 | 100.0% | 10 | + | total | 3.001 | 3.593 | 5.586 | 5.601 | 5.616 | 3.871 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.6676809788 + Full duration: 51.8370318413 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.324 | 3.69 | 4.382 | 4.392 | 4.403 | 3.828 | 100.0% | 10 | + | cinder.delete_volume | 0.625 | 2.781 | 3.053 | 3.199 | 3.345 | 2.086 | 100.0% | 10 | + | total | 4.288 | 6.438 | 7.073 | 7.173 | 7.273 | 5.914 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.0577061176 + Full duration: 35.664162159 + + + + test scenario CinderVolumes.create_and_delete_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 7.41 | 9.74 | 10.091 | 10.094 | 10.097 | 9.522 | 100.0% | 10 | + | cinder.delete_volume | 0.54 | 0.965 | 3.092 | 3.097 | 3.103 | 1.691 | 100.0% | 10 | + | total | 7.95 | 10.903 | 12.9 | 12.964 | 13.029 | 11.214 | 100.0% | 10 | + +----------------------+------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 33.3823940754 + Full duration: 52.0277431011 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.681 | 3.946 | 4.01 | 4.051 | 4.092 | 3.903 | 100.0% | 10 | + | cinder.delete_volume | 0.506 | 2.848 | 3.217 | 3.222 | 3.228 | 2.122 | 100.0% | 10 | + | total | 4.188 | 6.787 | 7.161 | 7.175 | 7.189 | 6.026 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.0166649818 + Full duration: 35.4839038849 + + + + test scenario CinderVolumes.create_and_upload_volume_to_image + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.672 | 4.074 | 4.522 | 4.546 | 4.57 | 4.114 | 100.0% | 10 | + | cinder.upload_volume_to_image | 21.673 | 31.257 | 31.931 | 31.979 | 32.027 | 29.253 | 100.0% | 10 | + | cinder.delete_volume | 0.56 | 2.568 | 3.011 | 3.067 | 3.123 | 2.293 | 100.0% | 10 | + | nova.delete_image | 2.137 | 2.51 | 2.606 | 2.681 | 2.756 | 2.451 | 100.0% | 10 | + | total | 28.587 | 39.952 | 40.849 | 41.35 | 41.852 | 38.112 | 100.0% | 10 | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 110.444069147 + Full duration: 131.52224803 + + + + test scenario CinderVolumes.create_and_delete_snapshot + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 3.208 | 3.343 | 5.587 | 5.628 | 5.669 | 3.788 | 100.0% | 10 | + | cinder.delete_snapshot | 2.503 | 2.86 | 3.196 | 3.217 | 3.239 | 2.893 | 100.0% | 10 | + | total | 5.787 | 6.422 | 8.296 | 8.392 | 8.488 | 6.681 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.7773430347 + Full duration: 53.0582361221 + + + + test scenario CinderVolumes.create_volume + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.52 | 3.822 | 4.222 | 4.228 | 4.233 | 3.852 | 100.0% | 10 | + | total | 3.52 | 3.822 | 4.223 | 4.228 | 4.233 | 3.852 | 100.0% | 10 | + +----------------------+------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.2881109715 + Full duration: 29.6710369587 + + + + test scenario CinderVolumes.create_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.248 | 3.651 | 3.891 | 3.988 | 4.084 | 3.645 | 100.0% | 10 | + | total | 3.249 | 3.652 | 3.891 | 3.988 | 4.084 | 3.645 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.7785470486 + Full duration: 32.9540159702 + + + + test scenario CinderVolumes.list_volumes + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.list_volumes | 0.499 | 0.52 | 0.539 | 0.55 | 0.561 | 0.522 | 100.0% | 10 | + | total | 0.499 | 0.52 | 0.539 | 0.55 | 0.561 | 0.523 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.60948395729 + Full duration: 65.5444660187 + + + + test scenario CinderVolumes.create_nested_snapshots_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.547 | 3.82 | 3.891 | 3.927 | 3.962 | 3.787 | 100.0% | 10 | + | cinder.create_snapshot | 2.552 | 2.875 | 3.173 | 3.215 | 3.257 | 2.931 | 100.0% | 10 | + | nova.attach_volume | 3.633 | 5.774 | 8.279 | 8.853 | 9.427 | 6.038 | 100.0% | 10 | + | nova.detach_volume | 3.599 | 3.826 | 4.233 | 4.444 | 4.655 | 3.905 | 100.0% | 10 | + | cinder.delete_snapshot | 2.22 | 2.537 | 2.852 | 2.971 | 3.09 | 2.577 | 100.0% | 10 | + | cinder.delete_volume | 0.648 | 2.735 | 2.845 | 2.892 | 2.939 | 2.321 | 100.0% | 10 | + | total | 18.538 | 22.642 | 25.806 | 26.204 | 26.601 | 22.745 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 66.8299760818 + Full duration: 173.895985842 + + + + test scenario CinderVolumes.create_from_volume_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.481 | 3.953 | 4.613 | 5.302 | 5.991 | 4.167 | 100.0% | 10 | + | cinder.delete_volume | 1.163 | 3.065 | 3.469 | 3.474 | 3.479 | 2.919 | 100.0% | 10 | + | total | 5.012 | 7.114 | 7.89 | 8.462 | 9.034 | 7.087 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 20.8082921505 + Full duration: 55.4062600136 + + + + test scenario CinderVolumes.create_and_extend_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | cinder.create_volume | 3.417 | 3.839 | 3.908 | 3.925 | 3.941 | 3.742 | 100.0% | 10 | + | cinder.extend_volume | 0.938 | 2.978 | 3.574 | 3.713 | 3.853 | 2.396 | 100.0% | 10 | + | cinder.delete_volume | 0.577 | 1.808 | 3.066 | 3.146 | 3.225 | 1.858 | 100.0% | 10 | + | total | 5.44 | 8.275 | 9.921 | 10.095 | 10.269 | 7.997 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 23.5873560905 + Full duration: 41.9279878139 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +-----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.668 | 3.89 | 4.255 | 4.266 | 4.277 | 3.937 | 100.0% | 10 | + | cinder.create_snapshot | 2.268 | 2.949 | 3.306 | 3.36 | 3.414 | 2.903 | 100.0% | 10 | + | nova.attach_volume | 3.471 | 4.393 | 7.358 | 8.251 | 9.145 | 5.113 | 100.0% | 10 | + | nova.detach_volume | 3.277 | 3.925 | 4.509 | 4.566 | 4.622 | 3.926 | 100.0% | 10 | + | cinder.delete_snapshot | 2.286 | 2.607 | 2.849 | 2.862 | 2.875 | 2.614 | 100.0% | 10 | + | cinder.delete_volume | 0.591 | 2.677 | 2.96 | 3.019 | 3.078 | 2.352 | 100.0% | 10 | + | total | 18.8 | 21.654 | 23.365 | 25.201 | 27.038 | 21.974 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 65.2181398869 + Full duration: 179.069041967 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.22 | 3.682 | 4.259 | 4.27 | 4.281 | 3.723 | 100.0% | 10 | + | cinder.create_snapshot | 2.292 | 3.051 | 3.199 | 3.232 | 3.265 | 2.991 | 100.0% | 10 | + | nova.attach_volume | 3.891 | 4.365 | 6.53 | 6.577 | 6.625 | 4.971 | 100.0% | 10 | + | nova.detach_volume | 3.248 | 3.565 | 3.767 | 4.044 | 4.321 | 3.568 | 100.0% | 10 | + | cinder.delete_snapshot | 2.258 | 2.551 | 2.836 | 2.87 | 2.904 | 2.609 | 100.0% | 10 | + | cinder.delete_volume | 0.883 | 2.687 | 3.02 | 3.224 | 3.427 | 2.286 | 100.0% | 10 | + | total | 19.132 | 21.712 | 23.229 | 23.566 | 23.904 | 21.677 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 64.7866289616 + Full duration: 180.275881052 + + + + run_rally - INFO - Test scenario: "cinder" OK. + + run_rally - INFO - Starting test scenario "heat" ... + run_rally - INFO - + Preparing input task + Task 51925ef8-a527-44d2-8df3-6164af0ec62a: started + Task 51925ef8-a527-44d2-8df3-6164af0ec62a: finished + + test scenario HeatStacks.create_suspend_resume_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.245 | 4.317 | 4.434 | 4.474 | 4.514 | 4.348 | 100.0% | 10 | + | heat.suspend_stack | 1.497 | 1.713 | 1.747 | 1.75 | 1.753 | 1.7 | 100.0% | 10 | + | heat.resume_stack | 1.42 | 1.621 | 1.668 | 1.67 | 1.671 | 1.562 | 100.0% | 10 | + | heat.delete_stack | 1.377 | 1.573 | 1.716 | 2.249 | 2.782 | 1.675 | 100.0% | 10 | + | total | 8.851 | 9.198 | 9.402 | 9.981 | 10.56 | 9.285 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 27.3572640419 + Full duration: 37.0984110832 + + + + test scenario HeatStacks.create_and_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 3.911 | 4.181 | 4.323 | 4.325 | 4.327 | 4.149 | 100.0% | 10 | + | heat.delete_stack | 1.392 | 1.426 | 1.744 | 1.776 | 1.808 | 1.491 | 100.0% | 10 | + | total | 5.311 | 5.631 | 5.774 | 5.775 | 5.776 | 5.64 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 16.9275529385 + Full duration: 26.8473479748 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 20.192 | 23.206 | 23.805 | 23.826 | 23.847 | 22.465 | 100.0% | 10 | + | heat.delete_stack | 11.755 | 11.868 | 12.963 | 13.0 | 13.036 | 12.282 | 100.0% | 10 | + | total | 32.02 | 35.613 | 36.714 | 36.721 | 36.729 | 34.747 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 102.752908945 + Full duration: 112.369065046 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 16.808 | 18.33 | 20.748 | 20.751 | 20.755 | 18.654 | 100.0% | 10 | + | heat.delete_stack | 9.404 | 10.582 | 10.788 | 10.803 | 10.818 | 10.313 | 100.0% | 10 | + | total | 26.212 | 28.318 | 31.532 | 31.553 | 31.574 | 28.967 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 85.8598790169 + Full duration: 95.2520959377 + + + + test scenario HeatStacks.list_stacks_and_resources + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | heat.list_stacks | 0.45 | 0.485 | 0.512 | 0.512 | 0.512 | 0.487 | 100.0% | 10 | + | heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | + | total | 0.45 | 0.485 | 0.512 | 0.512 | 0.512 | 0.487 | 100.0% | 10 | + +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.48300600052 + Full duration: 9.57427692413 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 3.727 | 4.075 | 4.288 | 4.337 | 4.386 | 4.085 | 100.0% | 10 | + | heat.update_stack | 3.549 | 3.676 | 3.903 | 3.972 | 4.042 | 3.704 | 100.0% | 10 | + | heat.delete_stack | 1.405 | 2.619 | 2.76 | 2.774 | 2.789 | 2.212 | 100.0% | 10 | + | total | 9.105 | 10.287 | 10.719 | 10.741 | 10.763 | 10.001 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 29.4346759319 + Full duration: 39.5471699238 + + + + test scenario HeatStacks.create_update_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 3.915 | 4.067 | 4.171 | 4.199 | 4.227 | 4.052 | 100.0% | 10 | + | heat.update_stack | 3.521 | 3.661 | 3.773 | 3.791 | 3.81 | 3.658 | 100.0% | 10 | + | heat.delete_stack | 1.38 | 1.477 | 1.612 | 1.618 | 1.624 | 1.492 | 100.0% | 10 | + | total | 8.916 | 9.128 | 9.484 | 9.493 | 9.503 | 9.203 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 27.5511319637 + Full duration: 37.5252559185 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.023 | 4.301 | 4.59 | 5.029 | 5.468 | 4.38 | 100.0% | 10 | + | heat.update_stack | 5.783 | 5.888 | 6.061 | 6.08 | 6.1 | 5.912 | 100.0% | 10 | + | heat.delete_stack | 2.475 | 2.546 | 2.705 | 3.2 | 3.694 | 2.65 | 100.0% | 10 | + | total | 12.613 | 12.74 | 13.76 | 13.912 | 14.064 | 12.942 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 38.1860618591 + Full duration: 48.4381308556 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.094 | 5.24 | 5.479 | 5.528 | 5.577 | 5.17 | 100.0% | 10 | + | heat.update_stack | 8.178 | 9.243 | 9.316 | 9.324 | 9.332 | 8.862 | 100.0% | 10 | + | heat.delete_stack | 3.63 | 3.68 | 3.714 | 3.714 | 3.715 | 3.68 | 100.0% | 10 | + | total | 16.974 | 17.76 | 18.444 | 18.466 | 18.488 | 17.713 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 52.4500279427 + Full duration: 63.0265882015 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.113 | 4.273 | 4.647 | 4.934 | 5.22 | 4.362 | 100.0% | 10 | + | heat.update_stack | 5.809 | 5.888 | 5.941 | 6.056 | 6.17 | 5.907 | 100.0% | 10 | + | heat.delete_stack | 2.513 | 2.561 | 3.694 | 3.7 | 3.706 | 2.891 | 100.0% | 10 | + | total | 12.55 | 12.759 | 14.013 | 14.546 | 15.079 | 13.161 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.0816349983 + Full duration: 49.7756490707 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 3.762 | 4.115 | 4.19 | 4.27 | 4.35 | 4.062 | 100.0% | 10 | + | heat.update_stack | 3.543 | 3.63 | 3.844 | 3.977 | 4.11 | 3.69 | 100.0% | 10 | + | heat.delete_stack | 1.383 | 1.499 | 2.506 | 2.528 | 2.549 | 1.677 | 100.0% | 10 | + | total | 8.868 | 9.275 | 10.208 | 10.225 | 10.242 | 9.429 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 27.9543409348 + Full duration: 38.8234701157 + + + + test scenario HeatStacks.create_and_list_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.005 | 4.128 | 4.199 | 4.234 | 4.27 | 4.127 | 100.0% | 10 | + | heat.list_stacks | 0.075 | 0.094 | 0.108 | 0.112 | 0.117 | 0.094 | 100.0% | 10 | + | total | 4.112 | 4.226 | 4.281 | 4.313 | 4.345 | 4.221 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 12.6059498787 + Full duration: 27.8848700523 + + + + test scenario HeatStacks.create_check_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.084 | 4.153 | 4.178 | 4.217 | 4.256 | 4.153 | 100.0% | 10 | + | heat.check_stack | 0.706 | 1.53 | 1.571 | 1.586 | 1.6 | 1.459 | 100.0% | 10 | + | heat.delete_stack | 1.375 | 1.432 | 2.542 | 2.546 | 2.55 | 1.763 | 100.0% | 10 | + | total | 7.01 | 7.159 | 8.25 | 8.279 | 8.309 | 7.375 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 22.5798799992 + Full duration: 33.7318949699 + + + + run_rally - INFO - Test scenario: "heat" OK. + + run_rally - INFO - Starting test scenario "keystone" ... + run_rally - INFO - + Preparing input task + Task 98c40f01-0adc-48ce-91ca-105f22e60ec9: started + Task 98c40f01-0adc-48ce-91ca-105f22e60ec9: finished + + test scenario KeystoneBasic.create_tenant_with_users + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.263 | 0.291 | 0.401 | 0.408 | 0.415 | 0.322 | 100.0% | 10 | + | keystone.create_users | 1.508 | 1.599 | 1.672 | 1.733 | 1.793 | 1.601 | 100.0% | 10 | + | total | 1.782 | 1.949 | 2.051 | 2.066 | 2.081 | 1.923 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 5.82497000694 + Full duration: 20.636977911 + + + + test scenario KeystoneBasic.create_add_and_list_user_roles + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.256 | 0.273 | 0.292 | 0.296 | 0.3 | 0.274 | 100.0% | 10 | + | keystone.add_role | 0.24 | 0.262 | 0.297 | 0.319 | 0.341 | 0.267 | 100.0% | 10 | + | keystone.list_roles | 0.131 | 0.146 | 0.226 | 0.237 | 0.248 | 0.16 | 100.0% | 10 | + | total | 0.636 | 0.682 | 0.774 | 0.78 | 0.786 | 0.702 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.11375284195 + Full duration: 14.9668319225 + + + + test scenario KeystoneBasic.add_and_remove_user_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.267 | 0.326 | 0.368 | 0.376 | 0.383 | 0.322 | 100.0% | 10 | + | keystone.add_role | 0.244 | 0.255 | 0.278 | 0.302 | 0.326 | 0.263 | 100.0% | 10 | + | keystone.remove_role | 0.149 | 0.163 | 0.191 | 0.244 | 0.296 | 0.177 | 100.0% | 10 | + | total | 0.681 | 0.765 | 0.834 | 0.84 | 0.846 | 0.762 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.33364892006 + Full duration: 14.8711419106 + + + + test scenario KeystoneBasic.create_update_and_delete_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.272 | 0.316 | 0.391 | 0.394 | 0.396 | 0.327 | 100.0% | 10 | + | keystone.update_tenant | 0.125 | 0.141 | 0.169 | 0.215 | 0.261 | 0.152 | 100.0% | 10 | + | keystone.delete_tenant | 0.299 | 0.321 | 0.379 | 0.394 | 0.408 | 0.333 | 100.0% | 10 | + | total | 0.745 | 0.81 | 0.859 | 0.915 | 0.971 | 0.812 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.46658396721 + Full duration: 13.4442551136 + + + + test scenario KeystoneBasic.create_and_delete_service + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_service | 0.258 | 0.271 | 0.303 | 0.308 | 0.314 | 0.278 | 100.0% | 10 | + | keystone.delete_service | 0.146 | 0.158 | 0.181 | 0.203 | 0.226 | 0.164 | 100.0% | 10 | + | total | 0.408 | 0.442 | 0.464 | 0.475 | 0.487 | 0.442 | 100.0% | 10 | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.34449720383 + Full duration: 12.1886069775 + + + + test scenario KeystoneBasic.create_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.253 | 0.302 | 0.319 | 0.324 | 0.328 | 0.297 | 100.0% | 10 | + | total | 0.253 | 0.302 | 0.319 | 0.324 | 0.329 | 0.298 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.912425994873 + Full duration: 8.74173903465 + + + + test scenario KeystoneBasic.create_user + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.262 | 0.303 | 0.319 | 0.319 | 0.319 | 0.296 | 100.0% | 10 | + | total | 0.262 | 0.303 | 0.319 | 0.319 | 0.32 | 0.296 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.953788042068 + Full duration: 8.72430300713 + + + + test scenario KeystoneBasic.create_and_list_tenants + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.247 | 0.28 | 0.302 | 0.304 | 0.307 | 0.281 | 100.0% | 10 | + | keystone.list_tenants | 0.121 | 0.129 | 0.224 | 0.225 | 0.225 | 0.147 | 100.0% | 10 | + | total | 0.392 | 0.42 | 0.476 | 0.493 | 0.511 | 0.428 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.32897400856 + Full duration: 13.584346056 + + + + test scenario KeystoneBasic.create_and_delete_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.286 | 0.324 | 0.395 | 0.47 | 0.545 | 0.347 | 100.0% | 10 | + | keystone.delete_role | 0.25 | 0.32 | 0.487 | 0.522 | 0.557 | 0.344 | 100.0% | 10 | + | total | 0.546 | 0.62 | 0.889 | 0.913 | 0.936 | 0.691 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.18193697929 + Full duration: 12.766493082 + + + + test scenario KeystoneBasic.get_entities + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.271 | 0.283 | 0.299 | 0.311 | 0.322 | 0.287 | 100.0% | 10 | + | keystone.create_user | 0.145 | 0.156 | 0.162 | 0.165 | 0.167 | 0.155 | 100.0% | 10 | + | keystone.create_role | 0.122 | 0.133 | 0.155 | 0.183 | 0.211 | 0.141 | 100.0% | 10 | + | keystone.get_tenant | 0.109 | 0.126 | 0.145 | 0.178 | 0.211 | 0.133 | 100.0% | 10 | + | keystone.get_user | 0.12 | 0.133 | 0.2 | 0.205 | 0.21 | 0.148 | 100.0% | 10 | + | keystone.get_role | 0.106 | 0.12 | 0.137 | 0.155 | 0.172 | 0.126 | 100.0% | 10 | + | keystone.service_list | 0.112 | 0.126 | 0.144 | 0.178 | 0.212 | 0.134 | 100.0% | 10 | + | keystone.get_service | 0.104 | 0.125 | 0.131 | 0.134 | 0.136 | 0.123 | 100.0% | 10 | + | total | 1.177 | 1.23 | 1.321 | 1.328 | 1.334 | 1.248 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.83582210541 + Full duration: 20.6130208969 + + + + test scenario KeystoneBasic.create_and_list_users + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.295 | 0.312 | 0.374 | 0.386 | 0.399 | 0.326 | 100.0% | 10 | + | keystone.list_users | 0.114 | 0.129 | 0.148 | 0.148 | 0.149 | 0.133 | 100.0% | 10 | + | total | 0.419 | 0.442 | 0.521 | 0.535 | 0.549 | 0.458 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.37977695465 + Full duration: 9.29229903221 + + + + run_rally - INFO - Test scenario: "keystone" OK. + + run_rally - INFO - Starting test scenario "neutron" ... + run_rally - INFO - + Preparing input task + Task 0a18c72f-b575-481a-8997-6d3d52130ede: started + Task 0a18c72f-b575-481a-8997-6d3d52130ede: finished + + test scenario NeutronNetworks.create_and_delete_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.758 | 0.851 | 1.15 | 1.23 | 1.309 | 0.925 | 100.0% | 10 | + | neutron.delete_port | 0.241 | 0.578 | 0.611 | 0.618 | 0.625 | 0.488 | 100.0% | 10 | + | total | 0.998 | 1.415 | 1.73 | 1.808 | 1.886 | 1.414 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.22447299957 + Full duration: 51.8464670181 + + + + test scenario NeutronNetworks.create_and_list_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.768 | 0.804 | 0.942 | 1.007 | 1.073 | 0.852 | 100.0% | 10 | + | neutron.create_router | 0.08 | 0.425 | 0.456 | 0.469 | 0.482 | 0.394 | 100.0% | 10 | + | neutron.add_interface_router | 0.371 | 0.741 | 1.213 | 1.526 | 1.84 | 0.855 | 100.0% | 10 | + | neutron.list_routers | 0.048 | 0.405 | 0.478 | 0.502 | 0.527 | 0.286 | 100.0% | 10 | + | total | 1.684 | 2.22 | 3.085 | 3.308 | 3.53 | 2.388 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.42530488968 + Full duration: 57.8292651176 + + + + test scenario NeutronNetworks.create_and_delete_routers + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.689 | 0.768 | 0.931 | 0.941 | 0.95 | 0.811 | 100.0% | 10 | + | neutron.create_router | 0.408 | 0.421 | 0.457 | 0.547 | 0.636 | 0.441 | 100.0% | 10 | + | neutron.add_interface_router | 0.363 | 0.702 | 0.802 | 0.807 | 0.813 | 0.653 | 100.0% | 10 | + | neutron.remove_interface_router | 0.273 | 0.662 | 0.823 | 0.847 | 0.872 | 0.65 | 100.0% | 10 | + | neutron.delete_router | 0.178 | 0.557 | 0.661 | 0.665 | 0.669 | 0.541 | 100.0% | 10 | + | total | 2.291 | 3.046 | 3.598 | 3.647 | 3.695 | 3.096 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 9.11136102676 + Full duration: 56.6760940552 + + + + test scenario NeutronNetworks.create_and_list_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.746 | 0.824 | 0.923 | 0.946 | 0.968 | 0.846 | 100.0% | 10 | + | neutron.list_ports | 0.157 | 0.57 | 0.629 | 0.663 | 0.697 | 0.481 | 100.0% | 10 | + | total | 1.065 | 1.343 | 1.476 | 1.493 | 1.51 | 1.327 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.94901585579 + Full duration: 52.597589016 + + + + test scenario NeutronNetworks.create_and_delete_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.701 | 0.757 | 1.049 | 1.144 | 1.238 | 0.835 | 100.0% | 10 | + | neutron.delete_subnet | 0.196 | 0.565 | 0.691 | 0.725 | 0.759 | 0.531 | 100.0% | 10 | + | total | 0.939 | 1.384 | 1.496 | 1.595 | 1.694 | 1.366 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.35806703568 + Full duration: 51.0885548592 + + + + test scenario NeutronNetworks.create_and_delete_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.614 | 0.675 | 0.811 | 0.817 | 0.823 | 0.692 | 100.0% | 10 | + | neutron.delete_network | 0.491 | 0.545 | 0.62 | 0.624 | 0.628 | 0.554 | 100.0% | 10 | + | total | 1.133 | 1.231 | 1.388 | 1.415 | 1.443 | 1.246 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.68652009964 + Full duration: 30.7036879063 + + + + test scenario NeutronNetworks.create_and_list_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.556 | 0.652 | 0.754 | 0.757 | 0.759 | 0.665 | 100.0% | 10 | + | neutron.list_networks | 0.361 | 0.383 | 0.478 | 0.503 | 0.528 | 0.403 | 100.0% | 10 | + | total | 0.917 | 1.027 | 1.231 | 1.252 | 1.273 | 1.068 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.11869502068 + Full duration: 33.6655409336 + + + + test scenario NeutronNetworks.create_and_update_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.718 | 0.757 | 0.921 | 0.922 | 0.923 | 0.795 | 100.0% | 10 | + | neutron.create_router | 0.073 | 0.405 | 0.44 | 0.448 | 0.455 | 0.38 | 100.0% | 10 | + | neutron.add_interface_router | 0.65 | 0.699 | 0.805 | 0.827 | 0.849 | 0.717 | 100.0% | 10 | + | neutron.update_router | 0.228 | 0.537 | 0.661 | 0.677 | 0.693 | 0.53 | 100.0% | 10 | + | total | 2.134 | 2.511 | 2.583 | 2.583 | 2.583 | 2.422 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.21204185486 + Full duration: 58.3329060078 + + + + test scenario NeutronNetworks.create_and_update_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.59 | 0.678 | 0.77 | 0.785 | 0.8 | 0.684 | 100.0% | 10 | + | neutron.update_network | 0.452 | 0.51 | 0.55 | 0.569 | 0.587 | 0.514 | 100.0% | 10 | + | total | 1.054 | 1.188 | 1.314 | 1.319 | 1.323 | 1.198 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.48062801361 + Full duration: 33.7373108864 + + + + test scenario NeutronNetworks.create_and_update_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.724 | 0.911 | 1.036 | 1.046 | 1.055 | 0.915 | 100.0% | 10 | + | neutron.update_port | 0.332 | 0.55 | 0.569 | 0.573 | 0.578 | 0.53 | 100.0% | 10 | + | total | 1.173 | 1.466 | 1.591 | 1.607 | 1.623 | 1.445 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.40219402313 + Full duration: 52.9743890762 + + + + test scenario NeutronNetworks.create_and_list_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.768 | 0.823 | 0.981 | 1.001 | 1.02 | 0.857 | 100.0% | 10 | + | neutron.list_subnets | 0.053 | 0.403 | 0.472 | 0.483 | 0.495 | 0.316 | 100.0% | 10 | + | total | 0.821 | 1.249 | 1.342 | 1.384 | 1.426 | 1.173 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.63253998756 + Full duration: 52.0335438251 + + + + test scenario NeutronNetworks.create_and_update_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.721 | 0.797 | 0.952 | 0.953 | 0.954 | 0.82 | 100.0% | 10 | + | neutron.update_subnet | 0.233 | 0.605 | 0.745 | 0.753 | 0.761 | 0.589 | 100.0% | 10 | + | total | 1.002 | 1.432 | 1.561 | 1.638 | 1.715 | 1.409 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.58866596222 + Full duration: 52.8035202026 + + + + run_rally - INFO - Test scenario: "neutron" OK. + + run_rally - INFO - Starting test scenario "nova" ... + run_rally - INFO - + Preparing input task + Task 7bc9f24e-75ad-4e01-afd5-3647398a073e: started + Task 7bc9f24e-75ad-4e01-afd5-3647398a073e: finished + + test scenario NovaKeypair.create_and_delete_keypair + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.705 | 0.755 | 0.85 | 1.155 | 1.459 | 0.818 | 100.0% | 10 | + | nova.delete_keypair | 0.032 | 0.046 | 0.063 | 0.064 | 0.064 | 0.046 | 100.0% | 10 | + | total | 0.744 | 0.804 | 0.895 | 1.21 | 1.524 | 0.864 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.08747410774 + Full duration: 41.9948050976 + + + + test scenario NovaServers.snapshot_server + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.021 | 10.195 | 10.572 | 10.642 | 10.713 | 9.936 | 100.0% | 10 | + | nova.create_image | 10.782 | 11.261 | 11.548 | 11.631 | 11.715 | 11.242 | 100.0% | 10 | + | nova.delete_server | 2.821 | 3.28 | 3.4 | 3.426 | 3.452 | 3.222 | 100.0% | 10 | + | nova.boot_server (2) | 6.39 | 8.069 | 9.073 | 9.382 | 9.691 | 7.984 | 100.0% | 10 | + | nova.delete_server (2) | 2.855 | 2.91 | 3.425 | 3.429 | 3.434 | 3.04 | 100.0% | 10 | + | nova.delete_image | 2.558 | 2.911 | 3.161 | 3.22 | 3.279 | 2.887 | 100.0% | 10 | + | total | 35.039 | 38.279 | 39.897 | 40.21 | 40.523 | 38.314 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 115.44729495 + Full duration: 188.161262035 + + + + test scenario NovaKeypair.boot_and_delete_server_with_keypair + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_keypair | 0.64 | 0.869 | 1.365 | 1.399 | 1.433 | 0.948 | 100.0% | 10 | + | nova.boot_server | 7.047 | 8.139 | 10.062 | 10.11 | 10.159 | 8.606 | 100.0% | 10 | + | nova.delete_server | 2.522 | 3.1 | 3.242 | 3.267 | 3.292 | 3.041 | 100.0% | 10 | + | nova.delete_keypair | 0.042 | 0.051 | 0.061 | 0.068 | 0.075 | 0.052 | 100.0% | 10 | + | total | 11.115 | 12.323 | 14.176 | 14.258 | 14.341 | 12.648 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.1623878479 + Full duration: 108.56980896 + + + + test scenario NovaKeypair.create_and_list_keypairs + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.734 | 0.87 | 0.947 | 0.982 | 1.018 | 0.859 | 100.0% | 10 | + | nova.list_keypairs | 0.022 | 0.034 | 0.042 | 0.044 | 0.046 | 0.033 | 100.0% | 10 | + | total | 0.769 | 0.903 | 0.981 | 1.02 | 1.059 | 0.892 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.59114599228 + Full duration: 44.6869869232 + + + + test scenario NovaServers.list_servers + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.list_servers | 1.436 | 1.556 | 1.653 | 1.689 | 1.725 | 1.565 | 100.0% | 10 | + | total | 1.436 | 1.557 | 1.653 | 1.689 | 1.726 | 1.565 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.71795606613 + Full duration: 123.497851133 + + + + test scenario NovaServers.resize_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.388 | 9.39 | 10.016 | 10.105 | 10.194 | 9.406 | 100.0% | 10 | + | nova.resize | 40.666 | 42.089 | 46.186 | 46.669 | 47.151 | 42.721 | 100.0% | 10 | + | nova.resize_confirm | 3.322 | 3.648 | 4.206 | 5.097 | 5.989 | 3.842 | 100.0% | 10 | + | nova.delete_server | 2.499 | 2.977 | 3.32 | 3.383 | 3.446 | 3.012 | 100.0% | 10 | + | total | 56.246 | 58.698 | 61.838 | 62.514 | 63.19 | 58.982 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 180.054177999 + Full duration: 221.624077082 + + + + test scenario NovaServers.boot_server_from_volume_and_delete + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.965 | 10.647 | 11.15 | 11.275 | 11.4 | 10.648 | 100.0% | 10 | + | nova.boot_server | 8.986 | 10.62 | 12.102 | 12.345 | 12.587 | 10.685 | 100.0% | 10 | + | nova.delete_server | 3.355 | 5.419 | 5.857 | 5.908 | 5.96 | 5.311 | 100.0% | 10 | + | total | 23.598 | 26.481 | 28.991 | 29.016 | 29.041 | 26.644 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 79.5105199814 + Full duration: 161.905633926 + + + + test scenario NovaServers.boot_and_migrate_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.833 | 10.242 | 11.298 | 11.673 | 12.049 | 10.106 | 100.0% | 10 | + | nova.stop_server | 3.821 | 6.772 | 7.286 | 7.317 | 7.349 | 6.484 | 100.0% | 10 | + | nova.migrate | 8.569 | 12.084 | 12.564 | 12.67 | 12.776 | 11.309 | 100.0% | 10 | + | nova.resize_confirm | 2.922 | 3.398 | 4.001 | 4.054 | 4.107 | 3.49 | 100.0% | 10 | + | nova.delete_server | 2.522 | 2.922 | 3.396 | 3.406 | 3.416 | 2.976 | 100.0% | 10 | + | total | 29.694 | 34.582 | 36.24 | 36.517 | 36.795 | 34.367 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 100.483532906 + Full duration: 141.506958961 + + + + test scenario NovaServers.boot_and_delete_server + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.586 | 9.397 | 10.198 | 10.288 | 10.378 | 9.508 | 100.0% | 10 | + | nova.delete_server | 2.497 | 3.108 | 3.472 | 3.478 | 3.485 | 3.09 | 100.0% | 10 | + | total | 11.39 | 12.555 | 13.374 | 13.612 | 13.849 | 12.598 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 38.4852130413 + Full duration: 106.844094992 + + + + test scenario NovaServers.boot_and_rebuild_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.193 | 9.878 | 10.329 | 10.703 | 11.078 | 9.597 | 100.0% | 10 | + | nova.rebuild_server | 8.434 | 9.946 | 10.942 | 11.066 | 11.191 | 9.967 | 100.0% | 10 | + | nova.delete_server | 2.887 | 3.097 | 3.934 | 4.794 | 5.654 | 3.399 | 100.0% | 10 | + | total | 20.573 | 22.393 | 25.427 | 25.892 | 26.357 | 22.963 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 68.7611658573 + Full duration: 138.198104143 + + + + test scenario NovaSecGroup.create_and_list_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.914 | 5.073 | 5.815 | 5.965 | 6.116 | 5.288 | 100.0% | 10 | + | nova.create_100_rules | 41.66 | 44.384 | 45.431 | 45.816 | 46.201 | 44.305 | 100.0% | 10 | + | nova.list_security_groups | 0.152 | 0.533 | 0.902 | 0.96 | 1.018 | 0.5 | 100.0% | 10 | + | total | 47.592 | 50.13 | 51.2 | 51.527 | 51.854 | 50.094 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 149.717460871 + Full duration: 216.41701889 + + + + test scenario NovaSecGroup.create_and_delete_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.565 | 5.19 | 5.563 | 5.615 | 5.668 | 5.131 | 100.0% | 10 | + | nova.create_100_rules | 41.981 | 43.448 | 44.817 | 44.926 | 45.034 | 43.666 | 100.0% | 10 | + | nova.delete_10_security_groups | 2.07 | 2.522 | 2.976 | 3.171 | 3.366 | 2.551 | 100.0% | 10 | + | total | 49.35 | 51.576 | 51.781 | 52.087 | 52.394 | 51.349 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 154.714606047 + Full duration: 196.745972872 + + + + test scenario NovaServers.boot_and_bounce_server + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.097 | 9.924 | 11.182 | 11.428 | 11.673 | 10.029 | 100.0% | 10 | + | nova.reboot_server | 5.363 | 6.246 | 8.84 | 8.907 | 8.973 | 7.049 | 100.0% | 10 | + | nova.soft_reboot_server | 8.452 | 8.823 | 9.184 | 9.291 | 9.398 | 8.83 | 100.0% | 10 | + | nova.stop_server | 3.808 | 6.394 | 7.284 | 7.3 | 7.316 | 6.358 | 100.0% | 10 | + | nova.start_server | 3.677 | 5.011 | 5.706 | 5.852 | 5.997 | 4.954 | 100.0% | 10 | + | nova.rescue_server | 7.752 | 8.674 | 11.07 | 11.07 | 11.071 | 9.269 | 100.0% | 10 | + | nova.unrescue_server | 5.065 | 5.536 | 5.762 | 5.781 | 5.8 | 5.532 | 100.0% | 10 | + | nova.delete_server | 2.485 | 2.546 | 3.501 | 4.347 | 5.194 | 2.952 | 100.0% | 10 | + | total | 50.79 | 54.629 | 59.2 | 59.748 | 60.297 | 54.995 | 100.0% | 10 | + +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 166.248807907 + Full duration: 235.770923853 + + + + test scenario NovaServers.boot_server + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | nova.boot_server | 6.916 | 9.539 | 12.275 | 12.369 | 12.464 | 9.975 | 100.0% | 10 | + | total | 6.916 | 9.54 | 12.275 | 12.37 | 12.464 | 9.976 | 100.0% | 10 | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 29.8727550507 + Full duration: 87.0325229168 + + + + test scenario NovaSecGroup.boot_and_delete_server_with_secgroups + +-----------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 5.065 | 5.392 | 5.642 | 5.731 | 5.819 | 5.4 | 100.0% | 10 | + | nova.create_100_rules | 42.116 | 43.904 | 45.452 | 45.794 | 46.137 | 44.057 | 100.0% | 10 | + | nova.boot_server | 6.906 | 7.809 | 8.73 | 8.911 | 9.092 | 7.954 | 100.0% | 10 | + | nova.get_attached_security_groups | 0.209 | 0.264 | 0.361 | 0.463 | 0.565 | 0.289 | 100.0% | 10 | + | nova.delete_server | 2.508 | 2.562 | 2.7 | 2.829 | 2.959 | 2.607 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.784 | 2.564 | 3.087 | 3.153 | 3.218 | 2.561 | 100.0% | 10 | + | total | 60.06 | 63.125 | 63.757 | 63.889 | 64.021 | 62.869 | 100.0% | 10 | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 188.221204996 + Full duration: 257.303071976 + + + + test scenario NovaServers.pause_and_unpause_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 7.896 | 9.252 | 10.006 | 10.25 | 10.494 | 9.303 | 100.0% | 10 | + | nova.pause_server | 2.784 | 3.19 | 3.465 | 3.487 | 3.509 | 3.226 | 100.0% | 10 | + | nova.unpause_server | 2.782 | 3.172 | 3.226 | 3.258 | 3.29 | 3.105 | 100.0% | 10 | + | nova.delete_server | 2.553 | 3.301 | 3.545 | 3.619 | 3.693 | 3.248 | 100.0% | 10 | + | total | 17.692 | 19.035 | 19.794 | 19.85 | 19.905 | 18.883 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 56.6791820526 + Full duration: 126.811426163 + + + + test scenario NovaServers.boot_server_from_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.412 | 10.207 | 10.376 | 10.441 | 10.505 | 10.131 | 100.0% | 10 | + | nova.boot_server | 8.849 | 10.342 | 11.591 | 11.741 | 11.892 | 10.423 | 100.0% | 10 | + | total | 18.922 | 20.498 | 21.854 | 21.976 | 22.099 | 20.555 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 60.9860489368 + Full duration: 126.851632118 + + + + test scenario NovaServers.boot_and_list_server + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.227 | 8.931 | 10.864 | 10.959 | 11.054 | 9.41 | 100.0% | 10 | + | nova.list_servers | 0.624 | 1.017 | 1.144 | 1.153 | 1.163 | 0.949 | 100.0% | 10 | + | total | 8.969 | 9.945 | 11.851 | 11.89 | 11.928 | 10.359 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 30.9555499554 + Full duration: 111.845392942 + + + + run_rally - INFO - Test scenario: "nova" OK. + + run_rally - INFO - Starting test scenario "quotas" ... + run_rally - INFO - + Preparing input task + Task 1b950d54-5c1a-4680-9d86-cbebdb0d1b72: started + Task 1b950d54-5c1a-4680-9d86-cbebdb0d1b72: finished + + test scenario Quotas.cinder_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.138 | 1.278 | 1.336 | 1.347 | 1.357 | 1.267 | 100.0% | 10 | + | total | 1.138 | 1.278 | 1.336 | 1.347 | 1.357 | 1.267 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.75106191635 + Full duration: 16.480301857 + + + + test scenario Quotas.neutron_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.406 | 0.441 | 0.5 | 0.501 | 0.502 | 0.454 | 100.0% | 10 | + | total | 0.546 | 0.618 | 0.666 | 0.67 | 0.674 | 0.616 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.8795170784 + Full duration: 13.8104491234 + + + + test scenario Quotas.cinder_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.178 | 1.264 | 1.311 | 1.344 | 1.378 | 1.26 | 100.0% | 10 | + | quotas.delete_quotas | 0.89 | 0.996 | 1.091 | 1.115 | 1.138 | 1.003 | 100.0% | 10 | + | total | 2.155 | 2.273 | 2.366 | 2.404 | 2.442 | 2.264 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 6.68874502182 + Full duration: 18.7547061443 + + + + test scenario Quotas.nova_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.559 | 0.615 | 0.666 | 0.669 | 0.671 | 0.616 | 100.0% | 10 | + | quotas.delete_quotas | 0.013 | 0.022 | 0.026 | 0.028 | 0.029 | 0.022 | 100.0% | 10 | + | total | 0.585 | 0.641 | 0.68 | 0.687 | 0.693 | 0.638 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.9670290947 + Full duration: 13.6480379105 + + + + test scenario Quotas.nova_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.587 | 0.621 | 0.738 | 0.758 | 0.777 | 0.646 | 100.0% | 10 | + | total | 0.587 | 0.621 | 0.738 | 0.758 | 0.777 | 0.647 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.87492918968 + Full duration: 13.4147770405 + + + + run_rally - INFO - Test scenario: "quotas" OK. + + run_rally - INFO - Starting test scenario "requests" ... + run_rally - INFO - + Preparing input task + Task 21739b85-984f-45b9-ae85-066dbd1adce3: started + Task 21739b85-984f-45b9-ae85-066dbd1adce3: finished + + test scenario HttpRequests.check_random_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 5.047 | 5.181 | 5.389 | 5.395 | 5.401 | 5.204 | 100.0% | 10 | + | total | 5.047 | 5.181 | 5.39 | 5.395 | 5.401 | 5.205 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 15.7369980812 + Full duration: 20.6335179806 + + + + test scenario HttpRequests.check_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 5.048 | 5.052 | 5.058 | 5.058 | 5.058 | 5.053 | 100.0% | 10 | + | total | 5.049 | 5.052 | 5.058 | 5.058 | 5.058 | 5.053 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 15.2042939663 + Full duration: 20.2779421806 + + + + run_rally - INFO - Test scenario: "requests" OK. + + run_rally - INFO - + + + Rally Summary Report + +===================+============+===============+===========+ + | Module | Duration | nb. Test Run | Success | + +===================+============+===============+===========+ + | authenticate | 01:01 | 10 | 100.00% | + +-------------------+------------+---------------+-----------+ + | glance | 03:33 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | cinder | 22:00 | 50 | 100.00% | + +-------------------+------------+---------------+-----------+ + | heat | 10:19 | 35 | 100.00% | + +-------------------+------------+---------------+-----------+ + | keystone | 02:29 | 29 | 100.00% | + +-------------------+------------+---------------+-----------+ + | neutron | 09:44 | 31 | 100.00% | + +-------------------+------------+---------------+-----------+ + | nova | 43:55 | 61 | 100.00% | + +-------------------+------------+---------------+-----------+ + | quotas | 01:16 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | requests | 00:40 | 2 | 100.00% | + +-------------------+------------+---------------+-----------+ + +===================+============+===============+===========+ + | TOTAL: | 01:35:01 | 232 | 100.00% | + +===================+============+===============+===========+ + +:: diff --git a/docs/results/fuel-os-odl_l3-nofeature-ha.rst b/docs/results/fuel-os-odl_l3-nofeature-ha.rst deleted file mode 100644 index 475b2f65..00000000 --- a/docs/results/fuel-os-odl_l3-nofeature-ha.rst +++ /dev/null @@ -1,10 +0,0 @@ -.. This work is licensed under a Creative Commons Attribution 4.0 International Licence. -.. http://creativecommons.org/licenses/by/4.0 - -Test results for fuel-os-odl_l3-nofeature-ha -============================================ - -.. Add any text in here that could be useful for a reader. - -.. Add the test results in a consistent format. - diff --git a/docs/results/fuel-os-onos-nofeature-ha.rst b/docs/results/fuel-os-onos-nofeature-ha.rst index fb321858..d8774f01 100644 --- a/docs/results/fuel-os-onos-nofeature-ha.rst +++ b/docs/results/fuel-os-onos-nofeature-ha.rst @@ -1,10 +1,2610 @@ .. This work is licensed under a Creative Commons Attribution 4.0 International Licence. .. http://creativecommons.org/licenses/by/4.0 -Test results for apex-os-odl_l2-nofeature-ha -============================================ +Detailed test results for fuel-os-onos-nofeature-ha +------------------------------------------------------- -.. Add any text in here that could be useful for a reader. +The following section outlines the detailed Functest results for the Brahmaputra scenario +deploying OpenStack in a Pharos environment by the Fuel installer. -.. Add the test results in a consistent format. +vPing_SSH +^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-SSH test... + vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_ssh- INFO - Creating neutron network vping-net... + vPing_ssh- INFO - Creating security group 'vPing-sg'... + vPing_ssh- INFO - Using existing Flavor 'm1.small'... + vPing_ssh- INFO - vPing Start Time:'2016-02-21 09:42:15' + vPing_ssh- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=c921bde1-b564-4670-9801-7607bb7dd5f9 + network=ddbf909c-8936-4d5a-b499-ae5bc6e4981f + vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=c921bde1-b564-4670-9801-7607bb7dd5f9 + network=ddbf909c-8936-4d5a-b499-ae5bc6e4981f + + vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'... + vPing_ssh- INFO - Floating IP created: '10.118.101.200' + vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2' + vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200... + vPing_ssh- INFO - Waiting for ping... + vPing_ssh- INFO - vPing detected! + vPing_ssh- INFO - vPing duration:'267.2' s. + vPing_ssh- INFO - Cleaning up... + vPing_ssh- INFO - vPing OK +:: + + + + +Tempest +^^^^^^^ +:: + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | name | time | status | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.33888 | success | + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.10971 | success | + | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 15.11040 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 30.42278 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 13.85713 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.32690 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.34397 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.37412 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 1.53125 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.34050 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.55659 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.33680 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.57251 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.33960 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.69068 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.33768 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.67793 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.33491 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.60438 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 1.39355 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 1.24188 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.85431 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 2.83096 | success | + | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 6.66403 | success | + | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 13.11276 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.11312 | success | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 4.98764 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.62118 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 1.01188 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.73001 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 1.04071 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.53598 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.12633 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.13548 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.08098 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.08810 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.10130 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.63997 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00129 | skip | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.20987 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.10442 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.02285 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.10168 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08641 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.03051 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.02042 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.08087 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.06620 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.07583 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 1.02614 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.03649 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.10806 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.09498 | success | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.15150 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.76964 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.40090 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.38359 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.65971 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.66699 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.63491 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 5.25088 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 16.25121 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 22.90196 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 11.28175 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 12.26759 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 2.49600 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 2.57009 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 3.21321 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 3.04861 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 3.93770 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.76115 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.71809 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.21977 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.91452 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.95440 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 3.16889 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.57679 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.42447 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.46180 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 1.15287 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.87581 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.99209 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 0.58096 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.07971 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 1.73518 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.51942 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.32883 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.01961 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 1.56142 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.03891 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.62077 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.07524 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.29801 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.07714 | success | + | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 0.0 | fail | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 1.06122 | success | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 1.10604 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.41781 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.03176 | success | + | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail | + | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.34417 | success | + | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.0 | fail | + | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.00125 | success | + | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.64367 | success | + | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.0 | fail | + | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.38885 | success | + | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.0 | fail | + | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.0 | fail | + | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.52793 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.11210 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.08846 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.10244 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10511 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.10566 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.14063 | success | + | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.57457 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.72677 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 15.66304 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 3.84418 | success | + | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 5.53626 | success | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 2.54078 | success | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 4.09094 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 1.98866 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 2.87451 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 5.20792 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 2.28358 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 4.49162 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 3.79765 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 2.99403 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.66099 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.29854 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.32442 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.04955 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.33630 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 2.80651 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.65929 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.36943 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.38991 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.31486 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.30617 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 2.96002 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 3.15725 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.88622 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.32563 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.37153 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 3.19676 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 2.65017 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.26448 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.38004 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.32783 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 8.61053 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 5.36523 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 3.30263 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 2.90758 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 7.98249 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.15672 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 4.09748 | success | + | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 3.08662 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.74965 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.81896 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.31019 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.07790 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.59873 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.33280 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.62361 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 6.93849 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.07141 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.31814 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.61532 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.61600 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.59934 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.81253 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.84469 | success | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.72972 | success | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.06791 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 19.60479 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 3.74694 | success | + | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 3.11182 | success | + | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.04832 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 10.66890 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 18.01898 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 16.52370 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 17.05563 | success | + | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.08365 | success | + | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.05607 | success | + | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 374.04656 | fail | + | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 340.58084 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 349.05347 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 338.91569 | fail | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + run_tempest - INFO - Results: {'timestart': '2016-02-2109:47:08.529077', 'duration': 512, 'tests': 210, 'failures': 31} +:: + +ONOS +^^^^ +:: + FUNCTEST.info: Running ONOS test case... + FUNCvirNetNB - INFO - Creating component Handle: ONOSrest + ****************************** + CASE INIT + ****************************** + + ['ONOSrest'] + + ****************************** + Result summary for Testcase2 + ****************************** + + [2016-02-21 09:55:56.965174] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Network Post + [2016-02-21 09:55:56.965727] [FUNCvirNetNB] [STEP] 2.1: Generate Post Data + [2016-02-21 09:55:56.966454] [FUNCvirNetNB] [STEP] 2.2: Post Data via HTTP + [2016-02-21 09:55:57.006264] [FUNCvirNetNB] [STEP] 2.3: Get Data via HTTP + [2016-02-21 09:55:57.037745] [FUNCvirNetNB] [STEP] 2.4: Compare Send Id and Get Id + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase3 + ****************************** + + [2016-02-21 09:55:57.048240] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Network Update + [2016-02-21 09:55:57.048783] [FUNCvirNetNB] [STEP] 3.1: Generate Post Data + [2016-02-21 09:55:57.049571] [FUNCvirNetNB] [STEP] 3.2: Post Data via HTTP + [2016-02-21 09:55:57.056744] [FUNCvirNetNB] [STEP] 3.3: Update Data via HTTP + [2016-02-21 09:55:57.064248] [FUNCvirNetNB] [STEP] 3.4: Get Data via HTTP + [2016-02-21 09:55:57.072845] [FUNCvirNetNB] [STEP] 3.5: Compare Update data. + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase4 + ****************************** + + [2016-02-21 09:55:57.084363] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Network Delete + [2016-02-21 09:55:57.084882] [FUNCvirNetNB] [STEP] 4.1: Generate Post Data + [2016-02-21 09:55:57.085617] [FUNCvirNetNB] [STEP] 4.2: Post Data via HTTP + [2016-02-21 09:55:57.093018] [FUNCvirNetNB] [STEP] 4.3: Delete Data via HTTP + [2016-02-21 09:55:57.099770] [FUNCvirNetNB] [STEP] 4.4: Get Data is NULL + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase5 + ****************************** + + [2016-02-21 09:56:02.115745] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Subnet Post + [2016-02-21 09:56:02.116339] [FUNCvirNetNB] [STEP] 5.1: Generate Post Data + [2016-02-21 09:56:02.117459] [FUNCvirNetNB] [STEP] 5.2: Post Network Data via HTTP(Post Subnet need post network) + [2016-02-21 09:56:02.126052] [FUNCvirNetNB] [STEP] 5.3: Post Subnet Data via HTTP + [2016-02-21 09:56:02.159577] [FUNCvirNetNB] [STEP] 5.4: Get Subnet Data via HTTP + [2016-02-21 09:56:02.172655] [FUNCvirNetNB] [STEP] 5.5: Compare Post Subnet Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase6 + ****************************** + + [2016-02-21 09:56:02.183187] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Subnet Update + [2016-02-21 09:56:02.183876] [FUNCvirNetNB] [STEP] 6.1: Generate Post Data + [2016-02-21 09:56:02.184887] [FUNCvirNetNB] [STEP] 6.2: Post Network Data via HTTP(Post Subnet need post network) + [2016-02-21 09:56:02.192777] [FUNCvirNetNB] [STEP] 6.3: Post Subnet Data via HTTP + [2016-02-21 09:56:02.201349] [FUNCvirNetNB] [STEP] 6.4: Update Subnet Data via HTTP + [2016-02-21 09:56:02.209629] [FUNCvirNetNB] [STEP] 6.5: Get Subnet Data via HTTP + [2016-02-21 09:56:02.216700] [FUNCvirNetNB] [STEP] 6.6: Compare Subnet Data + [2016-02-21 09:56:02.217492] [FUNCvirNetNB] [STEP] 6.7: Delete Subnet via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase7 + ****************************** + + [2016-02-21 09:56:02.227738] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Subnet Delete + [2016-02-21 09:56:02.228309] [FUNCvirNetNB] [STEP] 7.1: Generate Post Data + [2016-02-21 09:56:02.229188] [FUNCvirNetNB] [STEP] 7.2: Post Network Data via HTTP(Post Subnet need post network) + [2016-02-21 09:56:02.237036] [FUNCvirNetNB] [STEP] 7.3: Post Subnet Data via HTTP + [2016-02-21 09:56:02.245482] [FUNCvirNetNB] [STEP] 7.4: Delete Subnet Data via HTTP + [2016-02-21 09:56:02.253076] [FUNCvirNetNB] [STEP] 7.5: Get Subnet Data is NULL + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase8 + ****************************** + + [2016-02-21 09:56:07.269037] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Port Post + [2016-02-21 09:56:07.269689] [FUNCvirNetNB] [STEP] 8.1: Generate Post Data + [2016-02-21 09:56:07.270772] [FUNCvirNetNB] [STEP] 8.2: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:07.279440] [FUNCvirNetNB] [STEP] 8.3: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:07.287800] [FUNCvirNetNB] [STEP] 8.4: Post Port Data via HTTP + [2016-02-21 09:56:07.296863] [FUNCvirNetNB] [STEP] 8.5: Get Port Data via HTTP + [2016-02-21 09:56:07.306388] [FUNCvirNetNB] [STEP] 8.6: Compare Post Port Data + [2016-02-21 09:56:07.307677] [FUNCvirNetNB] [STEP] 8.7: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase9 + ****************************** + + [2016-02-21 09:56:07.318023] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Port Update + [2016-02-21 09:56:07.318708] [FUNCvirNetNB] [STEP] 9.1: Generate Post Data + [2016-02-21 09:56:07.320149] [FUNCvirNetNB] [STEP] 9.2: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:07.327326] [FUNCvirNetNB] [STEP] 9.3: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:07.336517] [FUNCvirNetNB] [STEP] 9.4: Post Port Data via HTTP + [2016-02-21 09:56:07.345702] [FUNCvirNetNB] [STEP] 9.5: Update Port Data via HTTP + [2016-02-21 09:56:07.354021] [FUNCvirNetNB] [STEP] 9.6: Get Port Data via HTTP + [2016-02-21 09:56:07.360429] [FUNCvirNetNB] [STEP] 9.7: Compare Update Port Data + [2016-02-21 09:56:07.361666] [FUNCvirNetNB] [STEP] 9.8: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase10 + ****************************** + + [2016-02-21 09:56:07.372086] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Port Delete + [2016-02-21 09:56:07.372739] [FUNCvirNetNB] [STEP] 10.1: Generate Post Data + [2016-02-21 09:56:07.373778] [FUNCvirNetNB] [STEP] 10.2: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:07.380739] [FUNCvirNetNB] [STEP] 10.3: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:07.388862] [FUNCvirNetNB] [STEP] 10.4: Post Port Data via HTTP + [2016-02-21 09:56:07.396014] [FUNCvirNetNB] [STEP] 10.5: Delete Port Data via HTTP + [2016-02-21 09:56:07.417621] [FUNCvirNetNB] [STEP] 10.6: Get Port Data is NULL + [2016-02-21 09:56:12.430407] [FUNCvirNetNB] [STEP] 10.7: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + + ************************************* + Test Execution Summary + + ************************************* + + Test Start : 21 Feb 2016 09:55:56 + Test End : 21 Feb 2016 09:56:12 + Execution Time : 0:00:15.628718 + Total tests planned : 9 + Total tests RUN : 9 + Total Pass : 9 + Total Fail : 0 + Total No Result : 0 + Success Percentage : 100% + Execution Result : 100% + + + + ****************************** + CASE INIT + ****************************** + + ['ONOSrest'] + + ****************************** + Result summary for Testcase2 + ****************************** + + [2016-02-21 09:56:12.836955] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Router Post + [2016-02-21 09:56:12.838221] [FUNCvirNetNBL3] [STEP] 2.1: Post Network Data via HTTP(Post Router need post network) + [2016-02-21 09:56:12.873649] [FUNCvirNetNBL3] [STEP] 2.2: Post Router Data via HTTP + [2016-02-21 09:56:12.881751] [FUNCvirNetNBL3] [STEP] 2.3: Get Router Data via HTTP + [2016-02-21 09:56:12.914578] [FUNCvirNetNBL3] [STEP] 2.4: Compare Post Router Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase3 + ****************************** + + [2016-02-21 09:56:12.930658] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Router Update + [2016-02-21 09:56:12.931841] [FUNCvirNetNBL3] [STEP] 3.1: Post Network Data via HTTP(Post Router need post network) + [2016-02-21 09:56:12.939584] [FUNCvirNetNBL3] [STEP] 3.2: Post Router Data via HTTP + [2016-02-21 09:56:12.946895] [FUNCvirNetNBL3] [STEP] 3.3: Update Router Data via HTTP + [2016-02-21 09:56:12.953601] [FUNCvirNetNBL3] [STEP] 3.4: Get Router Data via HTTP + [2016-02-21 09:56:12.959887] [FUNCvirNetNBL3] [STEP] 3.5: Compare Router Data + [2016-02-21 09:56:12.961048] [FUNCvirNetNBL3] [STEP] 3.6: Delete Router via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase4 + ****************************** + + [2016-02-21 09:56:12.970433] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Router Delete + [2016-02-21 09:56:12.971622] [FUNCvirNetNBL3] [STEP] 4.1: Post Network Data via HTTP(Post Router need post network) + [2016-02-21 09:56:12.979473] [FUNCvirNetNBL3] [STEP] 4.2: Post Router Data via HTTP + [2016-02-21 09:56:12.986263] [FUNCvirNetNBL3] [STEP] 4.3: Delete Router Data via HTTP + [2016-02-21 09:56:12.992190] [FUNCvirNetNBL3] [STEP] 4.4: Get Router Data is NULL + Verify the Router status + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase5 + ****************************** + + [2016-02-21 09:56:18.008957] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - RouterInterface Post + [2016-02-21 09:56:18.010175] [FUNCvirNetNBL3] [STEP] 5.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:18.018296] [FUNCvirNetNBL3] [STEP] 5.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:18.026382] [FUNCvirNetNBL3] [STEP] 5.3: Post Port Data via HTTP + [2016-02-21 09:56:18.034099] [FUNCvirNetNBL3] [STEP] 5.4: Post Router Data via HTTP + [2016-02-21 09:56:18.040193] [FUNCvirNetNBL3] [STEP] 5.5: Put RouterInterface Data via HTTP + [2016-02-21 09:56:18.047317] [FUNCvirNetNBL3] [STEP] 5.6: Get RouterInterface Data via HTTP + [2016-02-21 09:56:18.053592] [FUNCvirNetNBL3] [STEP] 5.7: Compare Post Port Data + [2016-02-21 09:56:18.055253] [FUNCvirNetNBL3] [STEP] 5.8: Del RouterInterface Data via HTTP + [2016-02-21 09:56:18.062038] [FUNCvirNetNBL3] [STEP] 5.9: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase6 + ****************************** + + [2016-02-21 09:56:18.078391] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - RouterInterface Delete + [2016-02-21 09:56:18.079883] [FUNCvirNetNBL3] [STEP] 6.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:18.087420] [FUNCvirNetNBL3] [STEP] 6.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:18.095337] [FUNCvirNetNBL3] [STEP] 6.3: Post Port Data via HTTP + [2016-02-21 09:56:18.103345] [FUNCvirNetNBL3] [STEP] 6.4: Post Router Data via HTTP + [2016-02-21 09:56:18.109767] [FUNCvirNetNBL3] [STEP] 6.5: Post RouterInterface Data via HTTP + [2016-02-21 09:56:18.116024] [FUNCvirNetNBL3] [STEP] 6.6: Del RouterInterface Data via HTTP + [2016-02-21 09:56:18.122686] [FUNCvirNetNBL3] [STEP] 6.7: Delete Port Data via HTTP + [2016-02-21 09:56:18.129655] [FUNCvirNetNBL3] [STEP] 6.8: Get Port Data is NULL + [2016-02-21 09:56:23.145559] [FUNCvirNetNBL3] [STEP] 6.9: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase7 + ****************************** + + [2016-02-21 09:56:23.164294] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - FloatingIp Post + [2016-02-21 09:56:23.165631] [FUNCvirNetNBL3] [STEP] 7.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:23.173909] [FUNCvirNetNBL3] [STEP] 7.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:23.182105] [FUNCvirNetNBL3] [STEP] 7.3: Post Port Data via HTTP + [2016-02-21 09:56:23.189623] [FUNCvirNetNBL3] [STEP] 7.4: Post Router Data via HTTP + [2016-02-21 09:56:23.196108] [FUNCvirNetNBL3] [STEP] 7.5: Get Port Data via HTTP + [2016-02-21 09:56:23.204332] [FUNCvirNetNBL3] [STEP] 7.6: Post FloatingIp Data via HTTP + [2016-02-21 09:56:23.211580] [FUNCvirNetNBL3] [STEP] 7.7: Get Port Data via HTTP + [2016-02-21 09:56:23.218993] [FUNCvirNetNBL3] [STEP] 7.8: Get FloatingIp Data via HTTP + [2016-02-21 09:56:23.251318] [FUNCvirNetNBL3] [STEP] 7.9: Get FloatingIp Data via HTTP + [2016-02-21 09:56:23.259068] [FUNCvirNetNBL3] [STEP] 7.10: Compare Post FloatingIp Data + [2016-02-21 09:56:23.260001] [FUNCvirNetNBL3] [STEP] 7.11: Post FloatingIp Clean Data via HTTP + [2016-02-21 09:56:23.266784] [FUNCvirNetNBL3] [STEP] 7.12: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase8 + ****************************** + + [2016-02-21 09:56:23.289110] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - FloatingIp Update + [2016-02-21 09:56:23.291300] [FUNCvirNetNBL3] [STEP] 8.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:23.299318] [FUNCvirNetNBL3] [STEP] 8.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:23.307738] [FUNCvirNetNBL3] [STEP] 8.3: Post Port Data via HTTP + [2016-02-21 09:56:23.315822] [FUNCvirNetNBL3] [STEP] 8.4: Post Router Data via HTTP + [2016-02-21 09:56:23.322853] [FUNCvirNetNBL3] [STEP] 8.5: Post FloatingIp Data via HTTP + [2016-02-21 09:56:23.329316] [FUNCvirNetNBL3] [STEP] 8.6: Post Delete Data via HTTP + [2016-02-21 09:56:23.337183] [FUNCvirNetNBL3] [STEP] 8.7: Post NewPort Data via HTTP + [2016-02-21 09:56:23.345756] [FUNCvirNetNBL3] [STEP] 8.8: Post NewFloatingIp Data via HTTP + [2016-02-21 09:56:23.353311] [FUNCvirNetNBL3] [STEP] 8.9: Get NewFloatingIp Data via HTTP + [2016-02-21 09:56:23.384949] [FUNCvirNetNBL3] [STEP] 8.10: Compare Post FloatingIp Data + [2016-02-21 09:56:23.385934] [FUNCvirNetNBL3] [STEP] 8.11: Post FloatingIp Clean Data via HTTP + [2016-02-21 09:56:23.392515] [FUNCvirNetNBL3] [STEP] 8.12: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase9 + ****************************** + + [2016-02-21 09:56:23.416898] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - FloatingIp Delete + [2016-02-21 09:56:23.418399] [FUNCvirNetNBL3] [STEP] 9.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:23.425551] [FUNCvirNetNBL3] [STEP] 9.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:23.433217] [FUNCvirNetNBL3] [STEP] 9.3: Post Port Data via HTTP + [2016-02-21 09:56:23.440717] [FUNCvirNetNBL3] [STEP] 9.4: Post Router Data via HTTP + [2016-02-21 09:56:23.447116] [FUNCvirNetNBL3] [STEP] 9.5: Post FloatingIp Data via HTTP + [2016-02-21 09:56:23.454356] [FUNCvirNetNBL3] [STEP] 9.6: Post FloatingIp Clean Data via HTTP + [2016-02-21 09:56:23.465800] [FUNCvirNetNBL3] [STEP] 9.7: Get FloatingIp Data is NULL + [2016-02-21 09:56:28.479269] [FUNCvirNetNBL3] [STEP] 9.8: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase10 + ****************************** + + [2016-02-21 09:56:28.496538] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Gateway Post + [2016-02-21 09:56:28.498465] [FUNCvirNetNBL3] [STEP] 10.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:28.507466] [FUNCvirNetNBL3] [STEP] 10.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:28.515564] [FUNCvirNetNBL3] [STEP] 10.3: Post Port Data via HTTP + [2016-02-21 09:56:28.522598] [FUNCvirNetNBL3] [STEP] 10.4: Post Router Data via HTTP + [2016-02-21 09:56:28.528755] [FUNCvirNetNBL3] [STEP] 10.5: Get Gateway Data via HTTP + [2016-02-21 09:56:28.536142] [FUNCvirNetNBL3] [STEP] 10.6: Compare Post Gateway Data + [2016-02-21 09:56:28.537198] [FUNCvirNetNBL3] [STEP] 10.7: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase11 + ****************************** + + [2016-02-21 09:56:28.553805] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Gateway Update + [2016-02-21 09:56:28.555461] [FUNCvirNetNBL3] [STEP] 11.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:28.562664] [FUNCvirNetNBL3] [STEP] 11.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:28.570094] [FUNCvirNetNBL3] [STEP] 11.3: Post Port Data via HTTP + [2016-02-21 09:56:28.577203] [FUNCvirNetNBL3] [STEP] 11.4: Post Router Data via HTTP + [2016-02-21 09:56:28.583265] [FUNCvirNetNBL3] [STEP] 11.5: Post New Router Data via HTTP + [2016-02-21 09:56:28.589203] [FUNCvirNetNBL3] [STEP] 11.6: Get Gateway Data via HTTP + [2016-02-21 09:56:28.594700] [FUNCvirNetNBL3] [STEP] 11.7: Compare Post Gateway Data + [2016-02-21 09:56:28.595799] [FUNCvirNetNBL3] [STEP] 11.8: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + ****************************** + Result summary for Testcase12 + ****************************** + + [2016-02-21 09:56:28.611322] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Gateway Delete + [2016-02-21 09:56:28.612734] [FUNCvirNetNBL3] [STEP] 12.1: Post Network Data via HTTP(Post port need post network) + [2016-02-21 09:56:28.620160] [FUNCvirNetNBL3] [STEP] 12.2: Post Subnet Data via HTTP(Post port need post subnet) + [2016-02-21 09:56:28.628079] [FUNCvirNetNBL3] [STEP] 12.3: Post Port Data via HTTP + [2016-02-21 09:56:28.635761] [FUNCvirNetNBL3] [STEP] 12.4: Post Router Data via HTTP + [2016-02-21 09:56:28.642664] [FUNCvirNetNBL3] [STEP] 12.5: Post Del Gateway Data via HTTP + [2016-02-21 09:56:28.648775] [FUNCvirNetNBL3] [STEP] 12.6: Get Gateway Data via HTTP + [2016-02-21 09:56:28.654590] [FUNCvirNetNBL3] [STEP] 12.7: If Gateway Data is NULL + [2016-02-21 09:56:33.660980] [FUNCvirNetNBL3] [STEP] 12.8: Clean Data via HTTP + + ***************************** + Result: Pass + ***************************** + + + + ************************************* + Test Execution Summary + + ************************************* + + Test Start : 21 Feb 2016 09:56:12 + Test End : 21 Feb 2016 09:56:33 + Execution Time : 0:00:20.999784 + Total tests planned : 11 + Total tests RUN : 11 + Total Pass : 11 + Total Fail : 0 + Total No Result : 0 + Success Percentage : 100% + Execution Result : 100% +:: + + + +Promise +^^^^^^^ +:: + FUNCTEST.info: Running PROMISE test case... + Promise- INFO - Creating tenant 'promise'... + Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'... + Promise- INFO - Creating user 'promiser'... + Promise- INFO - Updating OpenStack credentials... + Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + Promise- INFO - Creating flavor 'promise-flavor'... + Promise- INFO - Exporting environment variables... + Promise- INFO - Running command: npm run -s test -- --reporter json + Promise- INFO - The test succeeded. + Promise- DEBUG - + { + "stats": { + "suites": 23, + "tests": 33, + "passes": 33, + "pending": 0, + "failures": 0, + "start": "2016-02-21T09:56:46.846Z", + "end": "2016-02-21T09:56:51.847Z", + "duration": 5524 + }, + "tests": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ], + "pending": [], + "failures": [], + "passes": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ] + } + Promise- INFO - + **************************************** + Promise test report + + **************************************** + Suites: 23 + Tests: 33 + Passes: 33 + Pending: 0 + Failures: 0 + Start: 2016-02-21T09:56:46.846Z + End: 2016-02-21T09:56:51.847Z + Duration: 6.301 + **************************************** +:: + + +Rally +^^^^^ +:: + FUNCTEST.info: Running Rally benchmark suite... + run_rally - INFO - Starting test scenario "authenticate" ... + run_rally - INFO - + Preparing input task + Task 938ee7f4-76f5-42f3-a908-9eb3557dac60: started + Task 938ee7f4-76f5-42f3-a908-9eb3557dac60: finished + + test scenario Authenticate.validate_glance + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_glance | 0.528 | 0.563 | 0.576 | 0.577 | 0.578 | 0.558 | 100.0% | 10 | + | authenticate.validate_glance (2) | 0.524 | 0.536 | 0.584 | 0.646 | 0.707 | 0.556 | 100.0% | 10 | + | total | 1.209 | 1.274 | 1.348 | 1.391 | 1.434 | 1.285 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.82395505905 + Full duration: 11.5060088634 + + + + test scenario Authenticate.keystone + +----------------------------------------------------------------------------+ + | Response Times (sec) | + +--------+-------+--------+--------+--------+------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------+-------+--------+--------+--------+------+-------+---------+-------+ + | total | 0.145 | 0.166 | 0.262 | 0.271 | 0.28 | 0.193 | 100.0% | 10 | + +--------+-------+--------+--------+--------+------+-------+---------+-------+ + Load duration: 0.597311973572 + Full duration: 8.39117598534 + + + + test scenario Authenticate.validate_heat + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_heat | 0.289 | 0.308 | 0.338 | 0.34 | 0.342 | 0.312 | 100.0% | 10 | + | authenticate.validate_heat (2) | 0.054 | 0.289 | 0.31 | 0.318 | 0.327 | 0.27 | 100.0% | 10 | + | total | 0.575 | 0.782 | 0.858 | 0.862 | 0.865 | 0.773 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.38020992279 + Full duration: 10.2995789051 + + + + test scenario Authenticate.validate_nova + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_nova | 0.279 | 0.311 | 0.459 | 0.464 | 0.468 | 0.352 | 100.0% | 10 | + | authenticate.validate_nova (2) | 0.033 | 0.056 | 0.061 | 0.063 | 0.065 | 0.053 | 100.0% | 10 | + | total | 0.477 | 0.53 | 0.699 | 0.711 | 0.723 | 0.569 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.69243693352 + Full duration: 9.33592200279 + + + + test scenario Authenticate.validate_cinder + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_cinder | 0.276 | 0.29 | 0.335 | 0.335 | 0.335 | 0.302 | 100.0% | 10 | + | authenticate.validate_cinder (2) | 0.257 | 0.29 | 0.318 | 0.346 | 0.374 | 0.297 | 100.0% | 10 | + | total | 0.719 | 0.773 | 0.853 | 0.863 | 0.873 | 0.781 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.3241250515 + Full duration: 9.87282705307 + + + + test scenario Authenticate.validate_neutron + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_neutron | 0.289 | 0.309 | 0.329 | 0.334 | 0.34 | 0.31 | 100.0% | 10 | + | authenticate.validate_neutron (2) | 0.044 | 0.294 | 0.324 | 0.365 | 0.406 | 0.265 | 100.0% | 10 | + | total | 0.533 | 0.752 | 0.809 | 0.831 | 0.854 | 0.734 | 100.0% | 10 | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.165102005 + Full duration: 9.4830288887 + + + + run_rally - INFO - Test scenario: "authenticate" OK. + + run_rally - INFO - Starting test scenario "glance" ... + run_rally - INFO - + Preparing input task + Task 158cf9e7-5336-4cfc-be40-3e75d061e99a: started + Task 158cf9e7-5336-4cfc-be40-3e75d061e99a: finished + + test scenario GlanceImages.list_images + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.list_images | 0.726 | 0.781 | 0.882 | 0.891 | 0.899 | 0.807 | 100.0% | 10 | + | total | 0.726 | 0.783 | 0.882 | 0.891 | 0.899 | 0.807 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.53244495392 + Full duration: 12.5428349972 + + + + test scenario GlanceImages.create_image_and_boot_instances + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | glance.create_image | 6.979 | 7.618 | 7.794 | 7.829 | 7.863 | 7.563 | 100.0% | 10 | + | nova.boot_servers | 8.651 | 10.765 | 11.756 | 11.781 | 11.807 | 10.556 | 100.0% | 10 | + | total | 15.879 | 18.421 | 19.261 | 19.311 | 19.36 | 18.119 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 53.8314111233 + Full duration: 120.073235035 + + + + test scenario GlanceImages.create_and_list_image + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.create_image | 7.329 | 7.6 | 7.99 | 8.113 | 8.236 | 7.653 | 100.0% | 10 | + | glance.list_images | 0.333 | 0.582 | 0.613 | 0.646 | 0.679 | 0.566 | 100.0% | 10 | + | total | 7.902 | 8.164 | 8.547 | 8.674 | 8.802 | 8.219 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 24.6576690674 + Full duration: 38.7420179844 + + + + test scenario GlanceImages.create_and_delete_image + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | glance.create_image | 7.217 | 7.695 | 7.985 | 8.039 | 8.092 | 7.694 | 100.0% | 10 | + | glance.delete_image | 1.995 | 2.137 | 2.493 | 2.608 | 2.722 | 2.22 | 100.0% | 10 | + | total | 9.374 | 10.024 | 10.211 | 10.289 | 10.367 | 9.914 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 29.6123759747 + Full duration: 39.9493000507 + + + + run_rally - INFO - Test scenario: "glance" OK. + + run_rally - INFO - Starting test scenario "cinder" ... + run_rally - INFO - + Preparing input task + Task b1aa2d13-0f7a-4bff-8331-81336fed8893: started + Task b1aa2d13-0f7a-4bff-8331-81336fed8893: finished + + test scenario CinderVolumes.create_and_attach_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 6.503 | 8.078 | 8.609 | 8.703 | 8.796 | 7.961 | 100.0% | 10 | + | cinder.create_volume | 3.188 | 3.68 | 3.956 | 3.978 | 4.0 | 3.679 | 100.0% | 10 | + | nova.attach_volume | 3.64 | 4.357 | 6.302 | 6.474 | 6.646 | 4.857 | 100.0% | 10 | + | nova.detach_volume | 3.578 | 3.916 | 4.783 | 4.818 | 4.854 | 4.034 | 100.0% | 10 | + | cinder.delete_volume | 0.561 | 1.816 | 3.1 | 3.132 | 3.165 | 1.823 | 100.0% | 10 | + | nova.delete_server | 2.774 | 2.91 | 3.153 | 3.263 | 3.373 | 2.961 | 100.0% | 10 | + | total | 22.849 | 25.428 | 26.942 | 27.99 | 29.037 | 25.315 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 75.149212122 + Full duration: 118.157259941 + + + + test scenario CinderVolumes.create_and_list_volume + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 7.83 | 9.929 | 10.531 | 10.536 | 10.541 | 9.772 | 100.0% | 10 | + | cinder.list_volumes | 0.08 | 0.374 | 0.44 | 0.453 | 0.465 | 0.361 | 100.0% | 10 | + | total | 8.172 | 10.346 | 10.952 | 10.96 | 10.967 | 10.134 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 29.4478600025 + Full duration: 52.5886940956 + + + + test scenario CinderVolumes.create_and_list_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.301 | 3.843 | 4.226 | 4.357 | 4.488 | 3.882 | 100.0% | 10 | + | cinder.list_volumes | 0.053 | 0.331 | 0.398 | 0.398 | 0.398 | 0.273 | 100.0% | 10 | + | total | 3.637 | 4.144 | 4.619 | 4.733 | 4.847 | 4.156 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 12.4273290634 + Full duration: 34.9144048691 + + + + test scenario CinderVolumes.create_and_list_snapshots + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 2.946 | 3.307 | 3.538 | 3.549 | 3.56 | 3.273 | 100.0% | 10 | + | cinder.list_snapshots | 0.028 | 0.295 | 0.328 | 0.338 | 0.348 | 0.201 | 100.0% | 10 | + | total | 3.176 | 3.555 | 3.638 | 3.662 | 3.686 | 3.474 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.5382380486 + Full duration: 51.362334013 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.624 | 3.895 | 4.231 | 4.281 | 4.331 | 3.947 | 100.0% | 10 | + | cinder.delete_volume | 0.812 | 1.949 | 3.114 | 3.122 | 3.131 | 1.972 | 100.0% | 10 | + | total | 4.618 | 5.84 | 7.204 | 7.278 | 7.351 | 5.92 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 16.7822580338 + Full duration: 34.5782420635 + + + + test scenario CinderVolumes.create_and_delete_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.294 | 9.687 | 9.755 | 9.776 | 9.798 | 9.602 | 100.0% | 10 | + | cinder.delete_volume | 0.832 | 2.037 | 2.912 | 3.099 | 3.287 | 1.974 | 100.0% | 10 | + | total | 10.153 | 11.549 | 12.579 | 12.706 | 12.832 | 11.576 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 33.8279159069 + Full duration: 52.5032699108 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.531 | 3.917 | 4.114 | 4.116 | 4.119 | 3.89 | 100.0% | 10 | + | cinder.delete_volume | 0.795 | 0.992 | 3.094 | 3.232 | 3.371 | 1.405 | 100.0% | 10 | + | total | 4.55 | 4.893 | 6.895 | 7.065 | 7.235 | 5.295 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 14.6577680111 + Full duration: 32.7706868649 + + + + test scenario CinderVolumes.create_and_upload_volume_to_image + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.529 | 3.821 | 4.216 | 4.22 | 4.223 | 3.861 | 100.0% | 10 | + | cinder.upload_volume_to_image | 19.02 | 29.858 | 31.714 | 31.91 | 32.105 | 28.579 | 100.0% | 10 | + | cinder.delete_volume | 0.778 | 2.823 | 3.199 | 3.243 | 3.288 | 2.495 | 100.0% | 10 | + | nova.delete_image | 2.394 | 2.794 | 4.071 | 9.486 | 14.9 | 3.949 | 100.0% | 10 | + | total | 28.359 | 39.027 | 42.376 | 45.938 | 49.5 | 38.885 | 100.0% | 10 | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 119.134256124 + Full duration: 139.814013958 + + + + test scenario CinderVolumes.create_and_delete_snapshot + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 3.047 | 3.312 | 3.751 | 4.588 | 5.426 | 3.504 | 100.0% | 10 | + | cinder.delete_snapshot | 2.515 | 2.959 | 3.129 | 3.134 | 3.139 | 2.904 | 100.0% | 10 | + | total | 5.93 | 6.273 | 6.77 | 7.355 | 7.941 | 6.408 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.6710958481 + Full duration: 52.810079813 + + + + test scenario CinderVolumes.create_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.645 | 3.983 | 4.278 | 4.284 | 4.291 | 4.015 | 100.0% | 10 | + | total | 3.645 | 3.983 | 4.278 | 4.284 | 4.291 | 4.015 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.9593629837 + Full duration: 30.0458798409 + + + + test scenario CinderVolumes.create_volume + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.5 | 4.11 | 4.423 | 4.479 | 4.535 | 4.045 | 100.0% | 10 | + | total | 3.5 | 4.11 | 4.423 | 4.479 | 4.535 | 4.045 | 100.0% | 10 | + +----------------------+-----+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.9883899689 + Full duration: 34.5793349743 + + + + test scenario CinderVolumes.list_volumes + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.list_volumes | 0.527 | 0.566 | 0.622 | 0.634 | 0.647 | 0.579 | 100.0% | 10 | + | total | 0.527 | 0.566 | 0.622 | 0.635 | 0.647 | 0.579 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.71377515793 + Full duration: 66.8403449059 + + + + test scenario CinderVolumes.create_nested_snapshots_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.423 | 3.79 | 4.204 | 4.228 | 4.253 | 3.832 | 100.0% | 10 | + | cinder.create_snapshot | 2.595 | 2.914 | 3.105 | 3.107 | 3.109 | 2.93 | 100.0% | 10 | + | nova.attach_volume | 3.943 | 6.629 | 7.921 | 8.552 | 9.183 | 6.368 | 100.0% | 10 | + | nova.detach_volume | 3.275 | 3.933 | 4.098 | 4.151 | 4.204 | 3.813 | 100.0% | 10 | + | cinder.delete_snapshot | 2.26 | 2.576 | 3.109 | 3.173 | 3.237 | 2.627 | 100.0% | 10 | + | cinder.delete_volume | 0.572 | 2.766 | 2.935 | 3.011 | 3.086 | 2.543 | 100.0% | 10 | + | total | 20.778 | 22.953 | 25.368 | 26.28 | 27.193 | 23.194 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 69.8529119492 + Full duration: 173.89911294 + + + + test scenario CinderVolumes.create_from_volume_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.664 | 3.994 | 4.4 | 4.405 | 4.411 | 4.043 | 100.0% | 10 | + | cinder.delete_volume | 2.706 | 3.262 | 3.503 | 3.525 | 3.547 | 3.211 | 100.0% | 10 | + | total | 6.956 | 7.239 | 7.437 | 7.513 | 7.589 | 7.254 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 21.7929730415 + Full duration: 56.4282138348 + + + + test scenario CinderVolumes.create_and_extend_volume + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.519 | 3.91 | 4.25 | 4.293 | 4.336 | 3.898 | 100.0% | 10 | + | cinder.extend_volume | 0.954 | 3.479 | 3.822 | 3.974 | 4.126 | 3.266 | 100.0% | 10 | + | cinder.delete_volume | 2.743 | 3.002 | 3.324 | 3.34 | 3.356 | 3.018 | 100.0% | 10 | + | total | 8.353 | 10.523 | 10.792 | 10.838 | 10.885 | 10.182 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 30.6360728741 + Full duration: 49.9283909798 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.39 | 3.97 | 4.263 | 4.45 | 4.638 | 3.957 | 100.0% | 10 | + | cinder.create_snapshot | 2.608 | 3.069 | 3.308 | 3.31 | 3.312 | 3.012 | 100.0% | 10 | + | nova.attach_volume | 4.043 | 5.478 | 7.465 | 8.181 | 8.896 | 5.734 | 100.0% | 10 | + | nova.detach_volume | 3.111 | 3.712 | 4.231 | 4.297 | 4.362 | 3.748 | 100.0% | 10 | + | cinder.delete_snapshot | 2.272 | 2.63 | 2.889 | 3.032 | 3.174 | 2.679 | 100.0% | 10 | + | cinder.delete_volume | 0.594 | 2.64 | 3.158 | 3.173 | 3.187 | 2.251 | 100.0% | 10 | + | total | 18.408 | 23.294 | 24.568 | 24.632 | 24.697 | 22.576 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 68.1245191097 + Full duration: 178.916586161 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.136 | 3.923 | 4.27 | 4.334 | 4.398 | 3.903 | 100.0% | 10 | + | cinder.create_snapshot | 2.708 | 2.894 | 3.269 | 3.309 | 3.348 | 2.997 | 100.0% | 10 | + | nova.attach_volume | 3.853 | 5.659 | 9.176 | 9.424 | 9.673 | 6.046 | 100.0% | 10 | + | nova.detach_volume | 3.349 | 3.857 | 4.334 | 4.582 | 4.829 | 3.88 | 100.0% | 10 | + | cinder.delete_snapshot | 2.261 | 2.578 | 3.148 | 3.183 | 3.219 | 2.687 | 100.0% | 10 | + | cinder.delete_volume | 2.584 | 2.856 | 3.08 | 3.208 | 3.335 | 2.877 | 100.0% | 10 | + | total | 21.769 | 23.113 | 27.189 | 27.9 | 28.611 | 24.037 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 69.8956279755 + Full duration: 185.589872122 + + + + run_rally - INFO - Test scenario: "cinder" OK. + + run_rally - INFO - Starting test scenario "heat" ... + run_rally - INFO - + Preparing input task + Task 6323c0be-a020-4b31-99f0-846288593cf5: started + Task 6323c0be-a020-4b31-99f0-846288593cf5: finished + + test scenario HeatStacks.create_suspend_resume_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 3.897 | 4.064 | 4.38 | 4.573 | 4.766 | 4.148 | 100.0% | 10 | + | heat.suspend_stack | 0.856 | 1.754 | 2.035 | 2.047 | 2.058 | 1.584 | 100.0% | 10 | + | heat.resume_stack | 1.455 | 1.659 | 1.714 | 1.716 | 1.718 | 1.62 | 100.0% | 10 | + | heat.delete_stack | 1.394 | 1.581 | 2.739 | 2.752 | 2.765 | 1.784 | 100.0% | 10 | + | total | 8.071 | 9.183 | 10.285 | 10.314 | 10.344 | 9.135 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 27.614921093 + Full duration: 38.014703989 + + + + test scenario HeatStacks.create_and_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.032 | 4.108 | 4.322 | 4.37 | 4.419 | 4.169 | 100.0% | 10 | + | heat.delete_stack | 1.408 | 1.463 | 1.821 | 2.204 | 2.588 | 1.599 | 100.0% | 10 | + | total | 5.497 | 5.706 | 5.963 | 6.33 | 6.698 | 5.768 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 17.1844079494 + Full duration: 27.193780899 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 22.283 | 23.81 | 24.26 | 24.642 | 25.023 | 23.576 | 100.0% | 10 | + | heat.delete_stack | 10.675 | 11.83 | 13.071 | 13.072 | 13.073 | 12.167 | 100.0% | 10 | + | total | 33.542 | 35.738 | 36.805 | 36.843 | 36.881 | 35.743 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 107.773921967 + Full duration: 118.200341225 + + + + test scenario HeatStacks.create_and_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 18.184 | 20.407 | 21.635 | 21.85 | 22.065 | 20.2 | 100.0% | 10 | + | heat.delete_stack | 10.601 | 10.722 | 11.882 | 11.945 | 12.008 | 11.03 | 100.0% | 10 | + | total | 28.903 | 31.02 | 33.025 | 33.24 | 33.455 | 31.23 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 92.4247808456 + Full duration: 102.624263048 + + + + test scenario HeatStacks.list_stacks_and_resources + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.list_stacks | 0.493 | 0.534 | 0.591 | 0.604 | 0.617 | 0.542 | 100.0% | 10 | + | heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | + | total | 0.493 | 0.534 | 0.592 | 0.604 | 0.617 | 0.542 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.70831894875 + Full duration: 10.6722428799 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.142 | 4.331 | 4.481 | 4.527 | 4.573 | 4.327 | 100.0% | 10 | + | heat.update_stack | 3.575 | 3.673 | 3.746 | 3.752 | 3.758 | 3.674 | 100.0% | 10 | + | heat.delete_stack | 1.9 | 2.609 | 2.795 | 2.836 | 2.877 | 2.6 | 100.0% | 10 | + | total | 9.714 | 10.635 | 10.858 | 10.879 | 10.899 | 10.601 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 32.1056320667 + Full duration: 42.6386361122 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 4.12 | 4.273 | 4.323 | 4.33 | 4.336 | 4.247 | 100.0% | 10 | + | heat.update_stack | 3.504 | 3.594 | 3.722 | 3.741 | 3.76 | 3.615 | 100.0% | 10 | + | heat.delete_stack | 1.391 | 1.433 | 1.71 | 2.139 | 2.568 | 1.584 | 100.0% | 10 | + | total | 9.04 | 9.38 | 9.599 | 10.09 | 10.581 | 9.447 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 29.2272830009 + Full duration: 40.1677620411 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 3.97 | 4.292 | 4.415 | 4.448 | 4.481 | 4.271 | 100.0% | 10 | + | heat.update_stack | 5.842 | 5.898 | 5.997 | 6.123 | 6.248 | 5.932 | 100.0% | 10 | + | heat.delete_stack | 2.495 | 2.556 | 3.706 | 3.713 | 3.721 | 2.769 | 100.0% | 10 | + | total | 12.606 | 12.776 | 13.842 | 13.936 | 14.029 | 12.972 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.4572560787 + Full duration: 50.1925730705 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + | heat.create_stack | 4.629 | 5.407 | 5.516 | 5.7 | 5.884 | 5.364 | 100.0% | 10 | + | heat.update_stack | 8.444 | 9.309 | 9.353 | 9.359 | 9.365 | 9.16 | 100.0% | 10 | + | heat.delete_stack | 3.645 | 3.715 | 3.749 | 3.76 | 3.771 | 3.715 | 100.0% | 10 | + | total | 17.585 | 18.448 | 18.542 | 18.731 | 18.92 | 18.239 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + Load duration: 54.5839819908 + Full duration: 66.1476221085 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.153 | 4.42 | 4.537 | 4.626 | 4.716 | 4.414 | 100.0% | 10 | + | heat.update_stack | 5.756 | 5.867 | 5.968 | 5.986 | 6.003 | 5.879 | 100.0% | 10 | + | heat.delete_stack | 2.537 | 2.569 | 3.682 | 3.771 | 3.859 | 2.812 | 100.0% | 10 | + | total | 12.735 | 12.934 | 13.781 | 13.841 | 13.901 | 13.105 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.6327600479 + Full duration: 51.5351819992 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 4.216 | 4.41 | 4.524 | 4.563 | 4.602 | 4.398 | 100.0% | 10 | + | heat.update_stack | 3.532 | 3.608 | 3.773 | 3.784 | 3.795 | 3.634 | 100.0% | 10 | + | heat.delete_stack | 1.377 | 1.48 | 2.549 | 2.553 | 2.557 | 1.868 | 100.0% | 10 | + | total | 9.266 | 9.676 | 10.603 | 10.665 | 10.728 | 9.9 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 29.3563029766 + Full duration: 41.178768158 + + + + test scenario HeatStacks.create_and_list_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.154 | 4.25 | 4.32 | 4.358 | 4.396 | 4.255 | 100.0% | 10 | + | heat.list_stacks | 0.074 | 0.097 | 0.126 | 0.128 | 0.13 | 0.104 | 100.0% | 10 | + | total | 4.279 | 4.357 | 4.412 | 4.448 | 4.484 | 4.359 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 13.1276688576 + Full duration: 29.3930869102 + + + + test scenario HeatStacks.create_check_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.092 | 4.317 | 4.556 | 4.566 | 4.577 | 4.328 | 100.0% | 10 | + | heat.check_stack | 1.476 | 1.524 | 1.598 | 1.722 | 1.845 | 1.56 | 100.0% | 10 | + | heat.delete_stack | 1.38 | 2.515 | 2.587 | 2.689 | 2.791 | 2.103 | 100.0% | 10 | + | total | 7.059 | 8.243 | 8.619 | 8.666 | 8.713 | 7.99 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 24.3825399876 + Full duration: 35.8954949379 + + + + run_rally - INFO - Test scenario: "heat" OK. + + run_rally - INFO - Starting test scenario "keystone" ... + run_rally - INFO - + Preparing input task + Task 01416586-e6ad-4e3a-a1a2-6fc6305bbaea: started + Task 01416586-e6ad-4e3a-a1a2-6fc6305bbaea: finished + + test scenario KeystoneBasic.create_tenant_with_users + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.27 | 0.298 | 0.409 | 0.435 | 0.46 | 0.321 | 100.0% | 10 | + | keystone.create_users | 1.62 | 1.702 | 1.784 | 1.8 | 1.816 | 1.71 | 100.0% | 10 | + | total | 1.925 | 2.027 | 2.126 | 2.152 | 2.178 | 2.031 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 6.16570997238 + Full duration: 22.7167549133 + + + + test scenario KeystoneBasic.create_add_and_list_user_roles + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.266 | 0.303 | 0.411 | 0.414 | 0.418 | 0.326 | 100.0% | 10 | + | keystone.add_role | 0.268 | 0.295 | 0.314 | 0.344 | 0.373 | 0.3 | 100.0% | 10 | + | keystone.list_roles | 0.148 | 0.159 | 0.168 | 0.169 | 0.17 | 0.158 | 100.0% | 10 | + | total | 0.695 | 0.767 | 0.865 | 0.868 | 0.872 | 0.784 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.35486006737 + Full duration: 15.306978941 + + + + test scenario KeystoneBasic.add_and_remove_user_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.29 | 0.387 | 0.421 | 0.453 | 0.485 | 0.366 | 100.0% | 10 | + | keystone.add_role | 0.258 | 0.281 | 0.337 | 0.355 | 0.373 | 0.294 | 100.0% | 10 | + | keystone.remove_role | 0.164 | 0.171 | 0.231 | 0.302 | 0.373 | 0.197 | 100.0% | 10 | + | total | 0.747 | 0.827 | 0.964 | 1.078 | 1.191 | 0.857 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.82508516312 + Full duration: 16.1954729557 + + + + test scenario KeystoneBasic.create_update_and_delete_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.258 | 0.319 | 0.527 | 0.533 | 0.538 | 0.37 | 100.0% | 10 | + | keystone.update_tenant | 0.138 | 0.159 | 0.258 | 0.263 | 0.269 | 0.18 | 100.0% | 10 | + | keystone.delete_tenant | 0.319 | 0.34 | 0.454 | 0.455 | 0.455 | 0.371 | 100.0% | 10 | + | total | 0.776 | 0.89 | 1.119 | 1.121 | 1.124 | 0.922 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.63998699188 + Full duration: 14.1927289963 + + + + test scenario KeystoneBasic.create_and_delete_service + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_service | 0.278 | 0.299 | 0.315 | 0.315 | 0.316 | 0.3 | 100.0% | 10 | + | keystone.delete_service | 0.15 | 0.17 | 0.241 | 0.247 | 0.253 | 0.182 | 100.0% | 10 | + | total | 0.434 | 0.481 | 0.533 | 0.538 | 0.544 | 0.482 | 100.0% | 10 | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.47481298447 + Full duration: 13.4397730827 + + + + test scenario KeystoneBasic.create_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.301 | 0.315 | 0.339 | 0.384 | 0.429 | 0.325 | 100.0% | 10 | + | total | 0.301 | 0.316 | 0.339 | 0.384 | 0.429 | 0.325 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.985784053802 + Full duration: 9.20213198662 + + + + test scenario KeystoneBasic.create_user + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+------+--------+--------+--------+-------+------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+------+--------+--------+--------+-------+------+---------+-------+ + | keystone.create_user | 0.31 | 0.315 | 0.333 | 0.333 | 0.333 | 0.32 | 100.0% | 10 | + | total | 0.31 | 0.315 | 0.333 | 0.333 | 0.333 | 0.32 | 100.0% | 10 | + +----------------------+------+--------+--------+--------+-------+------+---------+-------+ + Load duration: 1.00818705559 + Full duration: 9.22635006905 + + + + test scenario KeystoneBasic.create_and_list_tenants + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.287 | 0.304 | 0.325 | 0.327 | 0.329 | 0.306 | 100.0% | 10 | + | keystone.list_tenants | 0.127 | 0.136 | 0.153 | 0.157 | 0.16 | 0.139 | 100.0% | 10 | + | total | 0.42 | 0.445 | 0.462 | 0.466 | 0.469 | 0.445 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.36337804794 + Full duration: 14.8872029781 + + + + test scenario KeystoneBasic.create_and_delete_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.282 | 0.386 | 0.408 | 0.422 | 0.436 | 0.365 | 100.0% | 10 | + | keystone.delete_role | 0.268 | 0.3 | 0.401 | 0.491 | 0.581 | 0.334 | 100.0% | 10 | + | total | 0.575 | 0.677 | 0.804 | 0.911 | 1.018 | 0.699 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.04137206078 + Full duration: 14.1024041176 + + + + test scenario KeystoneBasic.get_entities + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.286 | 0.308 | 0.319 | 0.328 | 0.336 | 0.307 | 100.0% | 10 | + | keystone.create_user | 0.143 | 0.156 | 0.164 | 0.167 | 0.17 | 0.157 | 100.0% | 10 | + | keystone.create_role | 0.135 | 0.143 | 0.175 | 0.19 | 0.204 | 0.151 | 100.0% | 10 | + | keystone.get_tenant | 0.117 | 0.13 | 0.135 | 0.136 | 0.138 | 0.129 | 100.0% | 10 | + | keystone.get_user | 0.127 | 0.15 | 0.222 | 0.227 | 0.232 | 0.162 | 100.0% | 10 | + | keystone.get_role | 0.12 | 0.132 | 0.144 | 0.154 | 0.164 | 0.134 | 100.0% | 10 | + | keystone.service_list | 0.125 | 0.138 | 0.243 | 0.244 | 0.245 | 0.164 | 100.0% | 10 | + | keystone.get_service | 0.124 | 0.133 | 0.153 | 0.194 | 0.235 | 0.143 | 100.0% | 10 | + | total | 1.279 | 1.333 | 1.411 | 1.47 | 1.528 | 1.345 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.00930905342 + Full duration: 20.4269800186 + + + + test scenario KeystoneBasic.create_and_list_users + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.295 | 0.304 | 0.332 | 0.342 | 0.351 | 0.311 | 100.0% | 10 | + | keystone.list_users | 0.127 | 0.146 | 0.162 | 0.201 | 0.24 | 0.151 | 100.0% | 10 | + | total | 0.422 | 0.458 | 0.506 | 0.523 | 0.539 | 0.462 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.42111587524 + Full duration: 9.87036585808 + + + + run_rally - INFO - Test scenario: "keystone" OK. + + run_rally - INFO - Starting test scenario "neutron" ... + run_rally - INFO - + Preparing input task + Task 31a75089-836c-4dd2-bea5-146049608ff3: started + Task 31a75089-836c-4dd2-bea5-146049608ff3: finished + + test scenario NeutronNetworks.create_and_delete_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.763 | 0.911 | 1.019 | 1.048 | 1.078 | 0.909 | 100.0% | 10 | + | neutron.delete_port | 0.237 | 0.633 | 0.682 | 0.717 | 0.752 | 0.534 | 100.0% | 10 | + | total | 1.07 | 1.489 | 1.683 | 1.704 | 1.726 | 1.443 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.20432686806 + Full duration: 54.8132340908 + + + + test scenario NeutronNetworks.create_and_list_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.762 | 0.836 | 0.949 | 0.98 | 1.011 | 0.863 | 100.0% | 10 | + | neutron.create_router | 0.066 | 0.493 | 0.686 | 0.691 | 0.695 | 0.459 | 100.0% | 10 | + | neutron.add_interface_router | 0.262 | 0.695 | 0.795 | 0.844 | 0.892 | 0.637 | 100.0% | 10 | + | neutron.list_routers | 0.039 | 0.407 | 0.441 | 0.452 | 0.462 | 0.308 | 100.0% | 10 | + | total | 1.54 | 2.352 | 2.744 | 2.824 | 2.904 | 2.268 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.36094808578 + Full duration: 61.3011310101 + + + + test scenario NeutronNetworks.create_and_delete_routers + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.79 | 0.836 | 0.945 | 1.009 | 1.072 | 0.868 | 100.0% | 10 | + | neutron.create_router | 0.074 | 0.436 | 0.479 | 0.499 | 0.518 | 0.377 | 100.0% | 10 | + | neutron.add_interface_router | 0.284 | 0.545 | 0.739 | 0.812 | 0.886 | 0.527 | 100.0% | 10 | + | neutron.remove_interface_router | 0.221 | 0.615 | 0.709 | 0.724 | 0.739 | 0.518 | 100.0% | 10 | + | neutron.delete_router | 0.187 | 0.566 | 0.709 | 0.751 | 0.793 | 0.508 | 100.0% | 10 | + | total | 2.124 | 2.811 | 3.347 | 3.379 | 3.412 | 2.799 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 8.68784189224 + Full duration: 59.8806409836 + + + + test scenario NeutronNetworks.create_and_list_ports + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+------+---------+-------+ + | neutron.create_port | 0.777 | 0.895 | 0.981 | 1.01 | 1.039 | 0.89 | 100.0% | 10 | + | neutron.list_ports | 0.525 | 0.678 | 0.726 | 0.735 | 0.743 | 0.65 | 100.0% | 10 | + | total | 1.351 | 1.564 | 1.694 | 1.729 | 1.764 | 1.54 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+------+---------+-------+ + Load duration: 4.66481399536 + Full duration: 56.677120924 + + + + test scenario NeutronNetworks.create_and_delete_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.785 | 0.926 | 1.065 | 1.065 | 1.065 | 0.914 | 100.0% | 10 | + | neutron.delete_subnet | 0.193 | 0.762 | 0.952 | 1.035 | 1.117 | 0.745 | 100.0% | 10 | + | total | 1.258 | 1.702 | 1.876 | 1.903 | 1.929 | 1.659 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 5.09031915665 + Full duration: 56.7336909771 + + + + test scenario NeutronNetworks.create_and_delete_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.614 | 0.708 | 0.774 | 0.81 | 0.847 | 0.712 | 100.0% | 10 | + | neutron.delete_network | 0.144 | 0.554 | 0.592 | 0.645 | 0.698 | 0.489 | 100.0% | 10 | + | total | 0.809 | 1.248 | 1.41 | 1.418 | 1.427 | 1.202 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.66986989975 + Full duration: 34.80159688 + + + + test scenario NeutronNetworks.create_and_list_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.627 | 0.707 | 0.85 | 0.851 | 0.853 | 0.719 | 100.0% | 10 | + | neutron.list_networks | 0.059 | 0.439 | 0.513 | 0.515 | 0.518 | 0.413 | 100.0% | 10 | + | total | 0.909 | 1.126 | 1.242 | 1.306 | 1.371 | 1.132 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.38921308517 + Full duration: 36.8345379829 + + + + test scenario NeutronNetworks.create_and_update_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.751 | 0.824 | 0.876 | 0.921 | 0.967 | 0.832 | 100.0% | 10 | + | neutron.create_router | 0.431 | 0.473 | 0.541 | 0.577 | 0.613 | 0.489 | 100.0% | 10 | + | neutron.add_interface_router | 0.301 | 0.711 | 0.928 | 1.08 | 1.231 | 0.684 | 100.0% | 10 | + | neutron.update_router | 0.48 | 0.514 | 0.703 | 0.74 | 0.778 | 0.579 | 100.0% | 10 | + | total | 2.062 | 2.629 | 2.871 | 3.084 | 3.298 | 2.584 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.65487504005 + Full duration: 63.1229610443 + + + + test scenario NeutronNetworks.create_and_update_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.656 | 0.719 | 1.152 | 1.152 | 1.153 | 0.796 | 100.0% | 10 | + | neutron.update_network | 0.136 | 0.33 | 0.656 | 0.684 | 0.711 | 0.37 | 100.0% | 10 | + | total | 0.793 | 1.067 | 1.71 | 1.757 | 1.803 | 1.166 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.25723409653 + Full duration: 35.7245519161 + + + + test scenario NeutronNetworks.create_and_update_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.757 | 0.871 | 0.937 | 0.949 | 0.961 | 0.872 | 100.0% | 10 | + | neutron.update_port | 0.152 | 0.553 | 0.69 | 0.695 | 0.7 | 0.449 | 100.0% | 10 | + | total | 1.013 | 1.374 | 1.562 | 1.591 | 1.621 | 1.322 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.26963686943 + Full duration: 56.3142960072 + + + + test scenario NeutronNetworks.create_and_list_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.759 | 0.838 | 0.884 | 0.921 | 0.959 | 0.833 | 100.0% | 10 | + | neutron.list_subnets | 0.419 | 0.437 | 0.474 | 0.504 | 0.535 | 0.447 | 100.0% | 10 | + | total | 1.205 | 1.29 | 1.325 | 1.352 | 1.379 | 1.281 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.90167307854 + Full duration: 56.5125339031 + + + + test scenario NeutronNetworks.create_and_update_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.739 | 0.86 | 0.894 | 0.899 | 0.904 | 0.847 | 100.0% | 10 | + | neutron.update_subnet | 0.215 | 0.626 | 0.747 | 0.751 | 0.754 | 0.619 | 100.0% | 10 | + | total | 0.992 | 1.503 | 1.597 | 1.604 | 1.611 | 1.466 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.40182685852 + Full duration: 57.6830070019 + + + + run_rally - INFO - Test scenario: "neutron" OK. + + run_rally - INFO - Starting test scenario "nova" ... + run_rally - INFO - + Preparing input task + Task 584052d3-7a9b-44cb-b72b-0fa69c80ff0f: started + Task 584052d3-7a9b-44cb-b72b-0fa69c80ff0f: finished + + test scenario NovaKeypair.create_and_delete_keypair + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.784 | 0.836 | 1.474 | 1.484 | 1.495 | 0.974 | 100.0% | 10 | + | nova.delete_keypair | 0.034 | 0.05 | 0.055 | 0.057 | 0.058 | 0.047 | 100.0% | 10 | + | total | 0.832 | 0.883 | 1.529 | 1.541 | 1.553 | 1.022 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.34695100784 + Full duration: 45.7756779194 + + + + test scenario NovaServers.snapshot_server + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 7.554 | 10.346 | 11.835 | 11.965 | 12.095 | 10.244 | 100.0% | 10 | + | nova.create_image | 11.631 | 12.185 | 12.844 | 13.707 | 14.57 | 12.355 | 100.0% | 10 | + | nova.delete_server | 2.863 | 3.258 | 3.364 | 3.387 | 3.409 | 3.184 | 100.0% | 10 | + | nova.boot_server (2) | 7.672 | 8.531 | 9.58 | 9.806 | 10.032 | 8.647 | 100.0% | 10 | + | nova.delete_server (2) | 2.536 | 2.983 | 3.338 | 3.367 | 3.396 | 3.003 | 100.0% | 10 | + | nova.delete_image | 2.294 | 3.138 | 3.917 | 3.949 | 3.981 | 3.199 | 100.0% | 10 | + | total | 37.226 | 39.77 | 43.868 | 44.502 | 45.136 | 40.632 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 120.862003088 + Full duration: 196.742653131 + + + + test scenario NovaKeypair.boot_and_delete_server_with_keypair + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_keypair | 0.722 | 0.911 | 1.196 | 1.303 | 1.41 | 0.932 | 100.0% | 10 | + | nova.boot_server | 8.584 | 9.058 | 10.234 | 10.397 | 10.559 | 9.363 | 100.0% | 10 | + | nova.delete_server | 2.535 | 3.3 | 3.362 | 3.407 | 3.453 | 3.174 | 100.0% | 10 | + | nova.delete_keypair | 0.037 | 0.048 | 0.055 | 0.057 | 0.059 | 0.049 | 100.0% | 10 | + | total | 12.316 | 13.426 | 14.867 | 14.936 | 15.006 | 13.518 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.9865550995 + Full duration: 111.508669853 + + + + test scenario NovaKeypair.create_and_list_keypairs + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.648 | 0.815 | 1.082 | 1.098 | 1.113 | 0.837 | 100.0% | 10 | + | nova.list_keypairs | 0.019 | 0.028 | 0.042 | 0.042 | 0.042 | 0.03 | 100.0% | 10 | + | total | 0.674 | 0.84 | 1.113 | 1.126 | 1.139 | 0.868 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.55701994896 + Full duration: 46.8838369846 + + + + test scenario NovaServers.list_servers + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.list_servers | 1.225 | 1.717 | 2.028 | 2.148 | 2.269 | 1.703 | 100.0% | 10 | + | total | 1.225 | 1.717 | 2.028 | 2.149 | 2.269 | 1.703 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 5.18592405319 + Full duration: 131.096873999 + + + + test scenario NovaServers.resize_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 7.681 | 9.106 | 9.667 | 9.855 | 10.043 | 8.967 | 100.0% | 10 | + | nova.resize | 41.039 | 42.444 | 47.666 | 47.89 | 48.113 | 43.647 | 100.0% | 10 | + | nova.resize_confirm | 3.05 | 3.839 | 5.756 | 5.796 | 5.836 | 4.129 | 100.0% | 10 | + | nova.delete_server | 2.538 | 2.977 | 3.37 | 3.436 | 3.502 | 2.99 | 100.0% | 10 | + | total | 56.14 | 58.909 | 63.601 | 64.059 | 64.517 | 59.734 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 175.1216681 + Full duration: 218.552350998 + + + + test scenario NovaServers.boot_server_from_volume_and_delete + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 10.051 | 10.651 | 11.762 | 11.824 | 11.885 | 10.8 | 100.0% | 10 | + | nova.boot_server | 9.377 | 9.86 | 11.429 | 11.996 | 12.563 | 10.33 | 100.0% | 10 | + | nova.delete_server | 3.706 | 5.644 | 6.192 | 6.201 | 6.209 | 5.374 | 100.0% | 10 | + | total | 23.576 | 26.289 | 28.117 | 28.514 | 28.911 | 26.505 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 78.3103020191 + Full duration: 163.452836037 + + + + test scenario NovaServers.boot_and_migrate_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.257 | 9.346 | 10.61 | 10.662 | 10.713 | 9.544 | 100.0% | 10 | + | nova.stop_server | 4.295 | 6.497 | 7.089 | 7.118 | 7.147 | 6.056 | 100.0% | 10 | + | nova.migrate | 9.675 | 12.304 | 13.12 | 13.229 | 13.338 | 12.161 | 100.0% | 10 | + | nova.resize_confirm | 3.122 | 3.507 | 4.272 | 4.364 | 4.457 | 3.653 | 100.0% | 10 | + | nova.delete_server | 2.554 | 3.188 | 3.429 | 3.496 | 3.562 | 3.139 | 100.0% | 10 | + | total | 32.033 | 35.063 | 36.096 | 36.58 | 37.064 | 34.553 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 105.193811893 + Full duration: 148.141517878 + + + + test scenario NovaServers.boot_and_delete_server + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.014 | 9.185 | 9.831 | 10.523 | 11.215 | 9.243 | 100.0% | 10 | + | nova.delete_server | 2.908 | 3.295 | 3.466 | 3.472 | 3.478 | 3.254 | 100.0% | 10 | + | total | 11.295 | 12.557 | 13.028 | 13.839 | 14.649 | 12.498 | 100.0% | 10 | + +--------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 36.6073288918 + Full duration: 109.97128582 + + + + test scenario NovaServers.boot_and_rebuild_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 7.698 | 9.483 | 10.427 | 10.794 | 11.162 | 9.37 | 100.0% | 10 | + | nova.rebuild_server | 8.598 | 9.448 | 10.319 | 10.378 | 10.438 | 9.551 | 100.0% | 10 | + | nova.delete_server | 2.858 | 3.099 | 3.428 | 3.623 | 3.817 | 3.161 | 100.0% | 10 | + | total | 20.044 | 22.42 | 23.365 | 23.559 | 23.752 | 22.083 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 64.9432969093 + Full duration: 139.465661049 + + + + test scenario NovaSecGroup.create_and_list_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.683 | 5.344 | 5.852 | 5.859 | 5.866 | 5.356 | 100.0% | 10 | + | nova.create_100_rules | 42.414 | 45.678 | 47.163 | 47.368 | 47.574 | 45.254 | 100.0% | 10 | + | nova.list_security_groups | 0.175 | 0.212 | 0.354 | 0.608 | 0.863 | 0.283 | 100.0% | 10 | + | total | 47.348 | 51.421 | 52.56 | 52.638 | 52.716 | 50.893 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 151.312942028 + Full duration: 221.151799202 + + + + test scenario NovaSecGroup.create_and_delete_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.207 | 5.153 | 5.865 | 6.016 | 6.167 | 5.223 | 100.0% | 10 | + | nova.create_100_rules | 44.426 | 45.496 | 46.391 | 46.57 | 46.749 | 45.514 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.719 | 2.314 | 3.033 | 3.409 | 3.786 | 2.461 | 100.0% | 10 | + | total | 51.911 | 53.27 | 54.098 | 54.11 | 54.121 | 53.199 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 158.767210007 + Full duration: 204.404190063 + + + + test scenario NovaServers.boot_and_bounce_server + +-------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.232 | 10.238 | 11.257 | 11.387 | 11.516 | 9.989 | 100.0% | 10 | + | nova.reboot_server | 5.292 | 6.196 | 8.351 | 8.675 | 8.999 | 6.856 | 100.0% | 10 | + | nova.soft_reboot_server | 7.958 | 8.738 | 8.914 | 8.918 | 8.923 | 8.624 | 100.0% | 10 | + | nova.stop_server | 3.374 | 6.332 | 7.13 | 7.453 | 7.776 | 5.867 | 100.0% | 10 | + | nova.start_server | 2.904 | 4.376 | 4.992 | 5.042 | 5.093 | 4.338 | 100.0% | 10 | + | nova.rescue_server | 7.695 | 9.49 | 10.886 | 11.148 | 11.409 | 9.448 | 100.0% | 10 | + | nova.unrescue_server | 5.081 | 5.557 | 7.819 | 8.065 | 8.31 | 5.985 | 100.0% | 10 | + | nova.delete_server | 2.544 | 3.077 | 3.429 | 3.523 | 3.617 | 3.093 | 100.0% | 10 | + | total | 49.625 | 55.207 | 55.707 | 56.454 | 57.202 | 54.222 | 100.0% | 10 | + +-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 163.818984032 + Full duration: 233.215523958 + + + + test scenario NovaServers.boot_server + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | nova.boot_server | 8.48 | 8.958 | 10.243 | 10.531 | 10.819 | 9.243 | 100.0% | 10 | + | total | 8.481 | 8.958 | 10.244 | 10.531 | 10.819 | 9.244 | 100.0% | 10 | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 27.3609120846 + Full duration: 84.3593919277 + + + + test scenario NovaSecGroup.boot_and_delete_server_with_secgroups + +-----------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.247 | 5.184 | 5.369 | 5.396 | 5.424 | 5.095 | 100.0% | 10 | + | nova.create_100_rules | 40.661 | 43.059 | 43.938 | 44.458 | 44.978 | 42.794 | 100.0% | 10 | + | nova.boot_server | 6.947 | 8.26 | 9.169 | 9.358 | 9.548 | 8.098 | 100.0% | 10 | + | nova.get_attached_security_groups | 0.225 | 0.263 | 0.273 | 0.293 | 0.313 | 0.26 | 100.0% | 10 | + | nova.delete_server | 2.528 | 2.586 | 2.843 | 2.904 | 2.965 | 2.638 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.791 | 2.426 | 2.99 | 3.057 | 3.123 | 2.475 | 100.0% | 10 | + | total | 59.505 | 61.408 | 62.425 | 63.244 | 64.063 | 61.363 | 100.0% | 10 | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 184.570534945 + Full duration: 253.34465313 + + + + test scenario NovaServers.pause_and_unpause_server + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + | nova.boot_server | 7.448 | 9.26 | 10.374 | 10.502 | 10.629 | 9.397 | 100.0% | 10 | + | nova.pause_server | 2.424 | 3.161 | 3.286 | 3.379 | 3.472 | 3.026 | 100.0% | 10 | + | nova.unpause_server | 2.773 | 3.096 | 3.242 | 3.272 | 3.303 | 3.035 | 100.0% | 10 | + | nova.delete_server | 2.878 | 3.224 | 3.526 | 3.553 | 3.58 | 3.191 | 100.0% | 10 | + | total | 15.943 | 18.76 | 19.747 | 19.77 | 19.793 | 18.65 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 56.3870060444 + Full duration: 124.540560007 + + + + test scenario NovaServers.boot_server_from_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.453 | 10.083 | 10.563 | 10.801 | 11.039 | 10.104 | 100.0% | 10 | + | nova.boot_server | 9.213 | 10.415 | 10.885 | 11.116 | 11.346 | 10.301 | 100.0% | 10 | + | total | 18.667 | 20.779 | 21.44 | 21.628 | 21.816 | 20.405 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 60.3854188919 + Full duration: 124.319462061 + + + + test scenario NovaServers.boot_and_list_server + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.037 | 9.396 | 10.043 | 10.516 | 10.989 | 9.351 | 100.0% | 10 | + | nova.list_servers | 0.654 | 1.026 | 1.113 | 1.156 | 1.198 | 0.988 | 100.0% | 10 | + | total | 8.984 | 10.311 | 11.119 | 11.575 | 12.032 | 10.339 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 31.5458390713 + Full duration: 114.252287149 + + + + run_rally - INFO - Test scenario: "nova" OK. + + run_rally - INFO - Starting test scenario "quotas" ... + run_rally - INFO - + Preparing input task + Task 5d3885f2-1759-48e8-9284-c14f3492c4f3: started + Task 5d3885f2-1759-48e8-9284-c14f3492c4f3: finished + + test scenario Quotas.cinder_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.126 | 1.235 | 1.607 | 1.612 | 1.618 | 1.297 | 100.0% | 10 | + | total | 1.126 | 1.235 | 1.607 | 1.613 | 1.618 | 1.297 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.74135613441 + Full duration: 16.1623110771 + + + + test scenario Quotas.neutron_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.407 | 0.429 | 0.526 | 0.528 | 0.531 | 0.447 | 100.0% | 10 | + | total | 0.552 | 0.586 | 0.666 | 0.671 | 0.676 | 0.599 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.82448792458 + Full duration: 13.357311964 + + + + test scenario Quotas.cinder_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.093 | 1.146 | 1.27 | 1.276 | 1.282 | 1.177 | 100.0% | 10 | + | quotas.delete_quotas | 0.536 | 0.907 | 0.975 | 1.01 | 1.046 | 0.862 | 100.0% | 10 | + | total | 1.67 | 2.089 | 2.177 | 2.184 | 2.192 | 2.039 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 6.09977889061 + Full duration: 18.3411080837 + + + + test scenario Quotas.nova_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.58 | 0.636 | 0.718 | 0.764 | 0.81 | 0.652 | 100.0% | 10 | + | quotas.delete_quotas | 0.018 | 0.026 | 0.035 | 0.039 | 0.043 | 0.028 | 100.0% | 10 | + | total | 0.616 | 0.657 | 0.741 | 0.793 | 0.844 | 0.68 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.00378704071 + Full duration: 13.8784749508 + + + + test scenario Quotas.nova_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.583 | 0.637 | 0.914 | 1.049 | 1.185 | 0.713 | 100.0% | 10 | + | total | 0.583 | 0.637 | 0.914 | 1.05 | 1.186 | 0.713 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.00103402138 + Full duration: 13.8432979584 + + + + run_rally - INFO - Test scenario: "quotas" OK. + + run_rally - INFO - Starting test scenario "requests" ... + run_rally - INFO - + Preparing input task + Task 6e9ed029-0497-4707-a4d4-c83a848e12e4: started + Task 6e9ed029-0497-4707-a4d4-c83a848e12e4: finished + + test scenario HttpRequests.check_random_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 0.044 | 0.183 | 0.349 | 0.376 | 0.402 | 0.201 | 100.0% | 10 | + | total | 0.045 | 0.183 | 0.349 | 0.376 | 0.403 | 0.201 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.716305971146 + Full duration: 5.89718389511 + + + + test scenario HttpRequests.check_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 0.044 | 0.046 | 0.052 | 0.053 | 0.054 | 0.048 | 100.0% | 10 | + | total | 0.044 | 0.046 | 0.052 | 0.053 | 0.054 | 0.048 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.182355165482 + Full duration: 5.23191189766 + + + + run_rally - INFO - Test scenario: "requests" OK. + + run_rally - INFO - + + + Rally Summary Report + +===================+============+===============+===========+ + | Module | Duration | nb. Test Run | Success | + +===================+============+===============+===========+ + | authenticate | 00:58 | 10 | 100.00% | + +-------------------+------------+---------------+-----------+ + | glance | 03:31 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | cinder | 22:25 | 50 | 100.00% | + +-------------------+------------+---------------+-----------+ + | heat | 10:53 | 35 | 100.00% | + +-------------------+------------+---------------+-----------+ + | keystone | 02:39 | 29 | 100.00% | + +-------------------+------------+---------------+-----------+ + | neutron | 10:30 | 31 | 100.00% | + +-------------------+------------+---------------+-----------+ + | nova | 44:31 | 61 | 100.00% | + +-------------------+------------+---------------+-----------+ + | quotas | 01:15 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | requests | 00:11 | 2 | 100.00% | + +-------------------+------------+---------------+-----------+ + +===================+============+===============+===========+ + | TOTAL: | 01:36:57 | 232 | 100.00% | + +===================+============+===============+===========+ +:: |