diff options
Diffstat (limited to 'docs/results/fuel-os-odl_l2-nofeature-ha.rst')
| -rw-r--r-- | docs/results/fuel-os-odl_l2-nofeature-ha.rst | 2385 |
1 files changed, 2381 insertions, 4 deletions
diff --git a/docs/results/fuel-os-odl_l2-nofeature-ha.rst b/docs/results/fuel-os-odl_l2-nofeature-ha.rst index 39fb4207..efa6a178 100644 --- a/docs/results/fuel-os-odl_l2-nofeature-ha.rst +++ b/docs/results/fuel-os-odl_l2-nofeature-ha.rst @@ -1,10 +1,2387 @@ .. This work is licensed under a Creative Commons Attribution 4.0 International Licence. .. http://creativecommons.org/licenses/by/4.0 -Test results for fuel-os-odl_l2-nofeature-ha -============================================ +Detailed test results for fuel-os-odl_l2-nofeature-ha +------------------------------------------------------- -.. Add any text in here that could be useful for a reader. +The following section outlines the detailed Functest results for the Brahmaputra scenario +deploying OpenStack in a Pharos environment by the Fuel installer. -.. Add the test results in a consistent format. +vPing_SSH +^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-SSH test... + vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_ssh- INFO - Creating neutron network vping-net... + vPing_ssh- INFO - Creating security group 'vPing-sg'... + vPing_ssh- INFO - Using existing Flavor 'm1.small'... + vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35' + vPing_ssh- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=fff41d5d-579a-4c26-844d-4e86700c44f6 + network=a5137d46-dea8-4f85-8872-08c4a5927182 + + vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'... + vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'... + vPing_ssh- INFO - Floating IP created: '10.118.101.200' + vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2' + vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200... + vPing_ssh- INFO - Waiting for ping... + vPing_ssh- INFO - vPing detected! + vPing_ssh- INFO - vPing duration:'42.1' s. + vPing_ssh- INFO - Cleaning up... + vPing_ssh- INFO - vPing OK +:: + + +vPing_userdata +^^^^^^^^^^^^^^ +:: + FUNCTEST.info: Running vPing-userdata test... + vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + vPing_userdata- INFO - Creating neutron network vping-net... + vPing_userdata- INFO - Creating security group 'vPing-sg'... + vPing_userdata- INFO - Flavor found 'm1.small' + vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00' + vPing_userdata- INFO - Creating instance 'opnfv-vping-1'... + name=opnfv-vping-1 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + + vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE. + vPing_userdata- INFO - Creating instance 'opnfv-vping-2'... + name=opnfv-vping-2 + flavor=<Flavor: m1.small> + image=5e34c73d-91d0-4852-a407-5a4b4c1932c6 + network=a1efb318-1338-436f-8f26-3a1bacab0538 + userdata= + #!/bin/sh + + while true; do + ping -c 1 192.168.130.4 2>&1 >/dev/null + RES=$? + if [ "Z$RES" = "Z0" ] ; then + echo 'vPing OK' + break + else + echo 'vPing KO' + fi + sleep 1 + done + + vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE. + vPing_userdata- INFO - Waiting for ping... + vPing_userdata- INFO - vPing detected! + vPing_userdata- INFO - vPing duration:'28.6' + vPing_userdata- INFO - vPing OK + vPing_userdata- INFO - Cleaning up... + vPing_userdata- INFO - Deleting network 'vping-net'... +:: + + +Tempest +^^^^^^^ +:: + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | name | time | status | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.49156 | success | + | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.10940 | success | + | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 15.01623 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 29.41033 | success | + | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 13.86580 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.60879 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.34531 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.33518 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.96138 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.90751 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.62183 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.62195 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.33497 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.64235 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 1.23145 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.83801 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 1.18842 | success | + | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.35784 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.09813 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.88696 | success | + | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.84049 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.52238 | success | + | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 3.63444 | success | + | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 6.75102 | success | + | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 14.44295 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 316.24706 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.34052 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.75888 | success | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 316.38576 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00196 | success | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail | + | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.10067 | success | + | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 4.93829 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.78542 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.64749 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.89411 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.32315 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.91146 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.13496 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.11222 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.11119 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.09119 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.10776 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.57188 | success | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00131 | skip | + | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.20660 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.08830 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.02378 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.33571 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.10769 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.02694 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.02251 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.04963 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.07987 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.08196 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.92759 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.03606 | success | + | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.09925 | success | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 0.0 | fail | + | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 0.0 | fail | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.10704 | success | + | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.20889 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.78463 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.44852 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.37770 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.72001 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.74485 | success | + | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.67380 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 4.65947 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 19.27912 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 22.83188 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 13.05190 | success | + | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 10.22705 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 3.02970 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 4.04190 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 2.67671 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 3.10372 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 3.80641 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.05689 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.62404 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.47470 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.21997 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 2.20741 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 3.12907 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.56617 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.38405 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.74547 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.94955 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.62631 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 1.24089 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.28176 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.39299 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 0.59369 | success | + | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.00537 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.35547 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02691 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.77671 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.03595 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.67764 | success | + | tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.12390 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.35252 | success | + | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.05395 | success | + | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 343.72467 | fail | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.95003 | success | + | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.99399 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.31689 | success | + | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.02590 | success | + | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail | + | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.0 | fail | + | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.09974 | success | + | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.21063 | success | + | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.0 | fail | + | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.0 | fail | + | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.0 | fail | + | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.0 | fail | + | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.77355 | success | + | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.0 | fail | + | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.63115 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10751 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.08180 | success | + | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.11419 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.09997 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.15346 | success | + | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.10901 | success | + | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.26936 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.78244 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 2.75904 | success | + | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 3.58070 | success | + | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 6.97865 | success | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.0 | fail | + | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 0.0 | fail | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 2.19846 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 3.01338 | success | + | tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 5.65439 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 5.23138 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 4.63026 | success | + | tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 4.20924 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 3.23093 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.72657 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.45440 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.37147 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.35779 | success | + | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.30639 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 3.21748 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.64248 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.30977 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.03731 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.49862 | success | + | tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.26355 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 3.12061 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 3.35577 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.94748 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.39794 | success | + | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.33413 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 3.39562 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 5.89837 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.99973 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.58956 | success | + | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.48395 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 10.99445 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 6.94692 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 4.69234 | success | + | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 0.56033 | fail | + | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 8.28629 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.94750 | success | + | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 4.97154 | success | + | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 3.42252 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 2.06578 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.53065 | success | + | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.29313 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.98492 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.10014 | success | + | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.39465 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.76994 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 7.29710 | success | + | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.05370 | success | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.0 | fail | + | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.0 | fail | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 0.0 | fail | + | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.0 | fail | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 20.70674 | success | + | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 12.57512 | success | + | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.94613 | success | + | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.13954 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 15.28613 | success | + | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 17.92871 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 15.55119 | success | + | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 19.10263 | success | + | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.07108 | success | + | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.37294 | success | + | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 25.63959 | fail | + | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 16.24070 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 343.58312 | fail | + | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 356.71394 | fail | + +------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+ + run_tempest - INFO - Results: {'timestart': '2016-02-1905:28:37.031139', 'duration': 730, 'tests': 210, 'failures': 40} +:: + + +ODL +^^^^ +:: + ============================================================================== + Basic + ============================================================================== + Basic.010 Restconf OK :: Test suite to verify Restconf is OK + ============================================================================== + Get Controller Modules :: Get the controller modules via Restconf | PASS | + ------------------------------------------------------------------------------ + Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS | + 1 critical test, 1 passed, 0 failed + 1 test total, 1 passed, 0 failed + ============================================================================== + Basic | PASS | + 1 critical test, 1 passed, 0 failed + 1 test total, 1 passed, 0 failed + ============================================================================== + Output: /home/opnfv/repos/functest/output.xml + Log: /home/opnfv/repos/functest/log.html + Report: /home/opnfv/repos/functest/report.html + [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m + ============================================================================== + Neutron :: Test suite for Neutron Plugin + ============================================================================== + Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope... + ============================================================================== + Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | + ------------------------------------------------------------------------------ + Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | + ------------------------------------------------------------------------------ + Create Network :: Create new network in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check Network :: Check Network created in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Networks :: Checking Network created in OpenStack are push... | PASS | + 4 critical tests, 4 passed, 0 failed + 4 tests total, 4 passed, 0 failed + ============================================================================== + Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open... + ============================================================================== + Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS | + ------------------------------------------------------------------------------ + Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | + ------------------------------------------------------------------------------ + Create New subnet :: Create new subnet in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check New subnet :: Check new subnet created in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS | + 4 critical tests, 4 passed, 0 failed + 4 tests total, 4 passed, 0 failed + ============================================================================== + Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight + ============================================================================== + Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | + ------------------------------------------------------------------------------ + Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | + ------------------------------------------------------------------------------ + Create New Port :: Create new port in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check New Port :: Check new subnet created in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS | + 4 critical tests, 4 passed, 0 failed + 4 tests total, 4 passed, 0 failed + ============================================================================== + Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also... + ============================================================================== + Delete New Port :: Delete previously created port in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check Port Deleted :: Check port deleted in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS | + 2 critical tests, 2 passed, 0 failed + 2 tests total, 2 passed, 0 failed + ============================================================================== + Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted... + ============================================================================== + Delete New subnet :: Delete previously created subnet in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS | + 2 critical tests, 2 passed, 0 failed + 2 tests total, 2 passed, 0 failed + ============================================================================== + Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete... + ============================================================================== + Delete Network :: Delete network in OpenStack | PASS | + ------------------------------------------------------------------------------ + Check Network deleted :: Check Network deleted in OpenDaylight | PASS | + ------------------------------------------------------------------------------ + Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS | + 2 critical tests, 2 passed, 0 failed + 2 tests total, 2 passed, 0 failed + ============================================================================== + Neutron :: Test suite for Neutron Plugin | PASS | + 18 critical tests, 18 passed, 0 failed + 18 tests total, 18 passed, 0 failed + ============================================================================== + Output: /home/opnfv/repos/functest/output.xml + Log: /home/opnfv/repos/functest/log.html + Report: /home/opnfv/repos/functest/report.html + [0;32mFinal report is located:[0m + Log: /home/opnfv/repos/functest/log.html + Report: /home/opnfv/repos/functest/report.html +:: + +vIMS +^^^^ +:: + FUNCTEST.info: Running vIMS test... + vIMS - INFO - Prepare OpenStack plateform (create tenant and user) + vIMS - INFO - Update OpenStack creds informations + vIMS - INFO - Upload some OS images if it doesn't exist + vIMS - INFO - centos_7 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository. + Try downloading this image and upload on glance ! + vIMS - INFO - Update security group quota for this tenant + vIMS - INFO - Update cinder quota for this tenant + vIMS - INFO - Collect flavor id for cloudify manager server + vIMS - INFO - Prepare virtualenv for cloudify-cli + vIMS - INFO - Downloading the cloudify manager server blueprint + vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47' + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the cloudify-manager deployment + vIMS - INFO - Cloudify-manager server is UP ! + vIMS - INFO - Cloudify deployment duration:'1149.9' + vIMS - INFO - Collect flavor id for all clearwater vm + vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00' + vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint + vIMS - INFO - Writing the inputs file + vIMS - INFO - Launching the clearwater deployment + vIMS - INFO - The deployment of clearwater-opnfv is ended + vIMS - INFO - vIMS VNF deployment duration:'1133.8' + vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59' + vIMS - INFO - vIMS functional test duration:'2.9' + vIMS - INFO - Launching the clearwater-opnfv undeployment + vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; ' + vIMS - INFO - Launching the cloudify-manager undeployment + vIMS - INFO - Cloudify-manager server has been successfully removed! + vIMS - INFO - Removing vIMS tenant .. + vIMS - INFO - Removing vIMS user .. +:: + +Promise +^^^^^^^ +:: + FUNCTEST.info: Running PROMISE test case... + Promise- INFO - Creating tenant 'promise'... + Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'... + Promise- INFO - Creating user 'promiser'... + Promise- INFO - Updating OpenStack credentials... + Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'... + Promise- INFO - Creating flavor 'promise-flavor'... + Promise- INFO - Exporting environment variables... + Promise- INFO - Running command: npm run -s test -- --reporter json + Promise- INFO - The test succeeded. + Promise- DEBUG - + { + "stats": { + "suites": 23, + "tests": 33, + "passes": 33, + "pending": 0, + "failures": 0, + "start": "2016-02-19T05:41:25.739Z", + "end": "2016-02-19T05:41:31.140Z", + "duration": 5524 + }, + "tests": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ], + "pending": [], + "failures": [], + "passes": [ + { + "title": "should add a new OpenStack provider without error", + "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error", + "duration": 1217, + "err": {} + }, + { + "title": "should update promise.providers with a new entry", + "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry", + "duration": 10, + "err": {} + }, + { + "title": "should contain a new ResourceProvider record in the store", + "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should add more capacity to the reservation service without error", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error", + "duration": 25, + "err": {} + }, + { + "title": "should update promise.pools with a new entry", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry", + "duration": 1, + "err": {} + }, + { + "title": "should contain a ResourcePool record in the store", + "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should report total collections and utilizations", + "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations", + "duration": 18, + "err": {} + }, + { + "title": "should contain newly added capacity pool", + "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool", + "duration": 8, + "err": {} + }, + { + "title": "should create a new server in target provider without error", + "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error", + "duration": 1768, + "err": {} + }, + { + "title": "should update promise.allocations with a new entry", + "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry", + "duration": 2, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should reference the created server ID from the provider", + "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider", + "duration": 1, + "err": {} + }, + { + "title": "should have low priority state", + "fullTitle": "promise allocation without reservation create-instance should have low priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (no start/end) without error", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error", + "duration": 41, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry", + "duration": 7, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should create a new server in target provider (with reservation) without error", + "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error", + "duration": 1617, + "err": {} + }, + { + "title": "should contain a new ResourceAllocation record in the store", + "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store", + "duration": 1, + "err": {} + }, + { + "title": "should be referenced in the reservation record", + "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record", + "duration": 7, + "err": {} + }, + { + "title": "should have high priority state", + "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state", + "duration": 0, + "err": {} + }, + { + "title": "should create reservation record (for future) without error", + "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error", + "duration": 75, + "err": {} + }, + { + "title": "should update promise.reservations with a new entry", + "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry", + "duration": 17, + "err": {} + }, + { + "title": "should contain a new ResourceReservation record in the store", + "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store", + "duration": 0, + "err": {} + }, + { + "title": "should contain newly created future reservation", + "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation", + "duration": 61, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error", + "duration": 65, + "err": {} + }, + { + "title": "should modify existing reservation without error", + "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error", + "duration": 17, + "err": {} + }, + { + "title": "should no longer contain record of the deleted reservation", + "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation", + "duration": 0, + "err": {} + }, + { + "title": "should decrease available capacity from a provider in the future", + "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future", + "duration": 15, + "err": {} + }, + { + "title": "should increase available capacity from a provider in the future", + "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future", + "duration": 11, + "err": {} + }, + { + "title": "should report available collections and utilizations", + "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations", + "duration": 56, + "err": {} + }, + { + "title": "should fail to create immediate reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error", + "duration": 60, + "err": {} + }, + { + "title": "should fail to create future reservation record with proper error", + "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error", + "duration": 38, + "err": {} + }, + { + "title": "should successfully destroy all allocations", + "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations", + "duration": 361, + "err": {} + } + ] + } + Promise- INFO - + **************************************** + Promise test report + + **************************************** + Suites: 23 + Tests: 33 + Passes: 33 + Pending: 0 + Failures: 0 + Start: 2016-02-19T05:41:25.739Z + End: 2016-02-19T05:41:31.140Z + Duration: 6.301 + **************************************** +:: + + +Rally +^^^^^ +:: + FUNCTEST.info: Running Rally benchmark suite... + run_rally - INFO - Starting test scenario "authenticate" ... + run_rally - INFO - + Preparing input task + Task c7f4e0fd-a882-4e14-ba02-553118d0cb77: started + Task c7f4e0fd-a882-4e14-ba02-553118d0cb77: finished + + test scenario Authenticate.validate_glance + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_glance | 0.535 | 0.78 | 0.847 | 0.86 | 0.874 | 0.74 | 100.0% | 10 | + | authenticate.validate_glance (2) | 0.667 | 0.689 | 0.793 | 0.807 | 0.821 | 0.717 | 100.0% | 10 | + | total | 1.381 | 1.677 | 1.718 | 1.735 | 1.752 | 1.625 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.80417394638 + Full duration: 12.8028140068 + + + + test scenario Authenticate.keystone + +-----------------------------------------------------------------------------+ + | Response Times (sec) | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + | total | 0.121 | 0.149 | 0.163 | 0.164 | 0.166 | 0.149 | 100.0% | 10 | + +--------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.489310979843 + Full duration: 7.96697187424 + + + + test scenario Authenticate.validate_heat + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_heat | 0.259 | 0.318 | 0.482 | 0.511 | 0.539 | 0.371 | 100.0% | 10 | + | authenticate.validate_heat (2) | 0.051 | 0.287 | 0.385 | 0.386 | 0.387 | 0.24 | 100.0% | 10 | + | total | 0.512 | 0.771 | 0.957 | 0.996 | 1.035 | 0.776 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.53649091721 + Full duration: 10.2540290356 + + + + test scenario Authenticate.validate_nova + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_nova | 0.3 | 0.332 | 0.474 | 0.482 | 0.489 | 0.368 | 100.0% | 10 | + | authenticate.validate_nova (2) | 0.034 | 0.049 | 0.059 | 0.065 | 0.07 | 0.05 | 100.0% | 10 | + | total | 0.499 | 0.564 | 0.716 | 0.722 | 0.727 | 0.586 | 100.0% | 10 | + +--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.84303689003 + Full duration: 9.65319395065 + + + + test scenario Authenticate.validate_cinder + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_cinder | 0.274 | 0.428 | 0.475 | 0.509 | 0.543 | 0.405 | 100.0% | 10 | + | authenticate.validate_cinder (2) | 0.025 | 0.424 | 0.455 | 0.456 | 0.458 | 0.376 | 100.0% | 10 | + | total | 0.469 | 1.071 | 1.131 | 1.141 | 1.151 | 0.964 | 100.0% | 10 | + +----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.72650790215 + Full duration: 10.753674984 + + + + test scenario Authenticate.validate_neutron + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | authenticate.validate_neutron | 0.28 | 0.302 | 0.32 | 0.326 | 0.333 | 0.303 | 100.0% | 10 | + | authenticate.validate_neutron (2) | 0.046 | 0.31 | 0.334 | 0.34 | 0.346 | 0.262 | 100.0% | 10 | + | total | 0.467 | 0.764 | 0.81 | 0.838 | 0.866 | 0.728 | 100.0% | 10 | + +-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.37260484695 + Full duration: 9.99744796753 + + + + run_rally - INFO - Test scenario: "authenticate" OK. + + run_rally - INFO - Starting test scenario "glance" ... + run_rally - INFO - + Preparing input task + Task d54fa25b-b992-4b4e-bef2-14425b86329c: started + Task d54fa25b-b992-4b4e-bef2-14425b86329c: finished + + test scenario GlanceImages.list_images + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.list_images | 0.877 | 0.902 | 0.997 | 0.998 | 0.999 | 0.932 | 100.0% | 10 | + | total | 0.877 | 0.902 | 0.997 | 0.998 | 0.999 | 0.932 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.92263484001 + Full duration: 13.4585630894 + + + + test scenario GlanceImages.create_image_and_boot_instances + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + | glance.create_image | 7.386 | 7.929 | 8.381 | 8.481 | 8.581 | 7.97 | 100.0% | 10 | + | nova.boot_servers | 8.641 | 10.384 | 10.714 | 11.007 | 11.3 | 10.241 | 100.0% | 10 | + | total | 16.702 | 18.427 | 18.943 | 19.047 | 19.15 | 18.211 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+-------+--------+---------+-------+ + Load duration: 54.6946680546 + Full duration: 110.071588039 + + + + test scenario GlanceImages.create_and_list_image + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | glance.create_image | 7.081 | 7.618 | 8.085 | 8.19 | 8.296 | 7.689 | 100.0% | 10 | + | glance.list_images | 0.324 | 0.573 | 0.642 | 0.714 | 0.786 | 0.573 | 100.0% | 10 | + | total | 7.612 | 8.241 | 8.722 | 8.902 | 9.082 | 8.262 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 24.6801600456 + Full duration: 39.2870121002 + + + + test scenario GlanceImages.create_and_delete_image + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | glance.create_image | 7.449 | 7.593 | 7.856 | 8.073 | 8.289 | 7.673 | 100.0% | 10 | + | glance.delete_image | 2.001 | 2.442 | 12.75 | 13.42 | 14.089 | 5.507 | 100.0% | 10 | + | total | 9.487 | 10.064 | 20.503 | 21.441 | 22.378 | 13.18 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 40.0675120354 + Full duration: 50.2370131016 + + + + run_rally - INFO - Test scenario: "glance" OK. + + run_rally - INFO - Starting test scenario "cinder" ... + run_rally - INFO - + Preparing input task + Task 6b2be534-fd42-4a5f-be0e-9a789027d4b3: started + Task 6b2be534-fd42-4a5f-be0e-9a789027d4b3: finished + + test scenario CinderVolumes.create_and_attach_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 7.135 | 7.936 | 8.663 | 8.672 | 8.68 | 7.941 | 100.0% | 10 | + | cinder.create_volume | 3.274 | 3.507 | 4.072 | 4.096 | 4.12 | 3.616 | 100.0% | 10 | + | nova.attach_volume | 4.012 | 4.845 | 6.553 | 6.624 | 6.694 | 5.31 | 100.0% | 10 | + | nova.detach_volume | 3.256 | 3.739 | 3.938 | 4.096 | 4.253 | 3.716 | 100.0% | 10 | + | cinder.delete_volume | 0.464 | 2.707 | 2.98 | 3.154 | 3.328 | 1.98 | 100.0% | 10 | + | nova.delete_server | 2.784 | 3.059 | 3.15 | 3.19 | 3.23 | 3.04 | 100.0% | 10 | + | total | 22.316 | 26.079 | 27.631 | 28.362 | 29.094 | 25.604 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 73.9451169968 + Full duration: 116.516190052 + + + + test scenario CinderVolumes.create_and_list_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | cinder.create_volume | 9.065 | 9.591 | 9.94 | 9.943 | 9.945 | 9.554 | 100.0% | 10 | + | cinder.list_volumes | 0.048 | 0.346 | 0.386 | 0.394 | 0.402 | 0.301 | 100.0% | 10 | + | total | 9.138 | 9.94 | 10.313 | 10.324 | 10.335 | 9.855 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 28.8989629745 + Full duration: 51.7012848854 + + + + test scenario CinderVolumes.create_and_list_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.251 | 3.883 | 4.897 | 4.899 | 4.901 | 4.006 | 100.0% | 10 | + | cinder.list_volumes | 0.055 | 0.072 | 0.333 | 0.334 | 0.334 | 0.145 | 100.0% | 10 | + | total | 3.313 | 3.952 | 5.212 | 5.223 | 5.234 | 4.151 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.7280011177 + Full duration: 34.1200621128 + + + + test scenario CinderVolumes.create_and_list_snapshots + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 2.973 | 3.289 | 5.554 | 5.57 | 5.585 | 3.702 | 100.0% | 10 | + | cinder.list_snapshots | 0.027 | 0.162 | 0.313 | 0.32 | 0.326 | 0.168 | 100.0% | 10 | + | total | 3.001 | 3.593 | 5.586 | 5.601 | 5.616 | 3.871 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.6676809788 + Full duration: 51.8370318413 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.324 | 3.69 | 4.382 | 4.392 | 4.403 | 3.828 | 100.0% | 10 | + | cinder.delete_volume | 0.625 | 2.781 | 3.053 | 3.199 | 3.345 | 2.086 | 100.0% | 10 | + | total | 4.288 | 6.438 | 7.073 | 7.173 | 7.273 | 5.914 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.0577061176 + Full duration: 35.664162159 + + + + test scenario CinderVolumes.create_and_delete_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 7.41 | 9.74 | 10.091 | 10.094 | 10.097 | 9.522 | 100.0% | 10 | + | cinder.delete_volume | 0.54 | 0.965 | 3.092 | 3.097 | 3.103 | 1.691 | 100.0% | 10 | + | total | 7.95 | 10.903 | 12.9 | 12.964 | 13.029 | 11.214 | 100.0% | 10 | + +----------------------+------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 33.3823940754 + Full duration: 52.0277431011 + + + + test scenario CinderVolumes.create_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.681 | 3.946 | 4.01 | 4.051 | 4.092 | 3.903 | 100.0% | 10 | + | cinder.delete_volume | 0.506 | 2.848 | 3.217 | 3.222 | 3.228 | 2.122 | 100.0% | 10 | + | total | 4.188 | 6.787 | 7.161 | 7.175 | 7.189 | 6.026 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.0166649818 + Full duration: 35.4839038849 + + + + test scenario CinderVolumes.create_and_upload_volume_to_image + +-------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.672 | 4.074 | 4.522 | 4.546 | 4.57 | 4.114 | 100.0% | 10 | + | cinder.upload_volume_to_image | 21.673 | 31.257 | 31.931 | 31.979 | 32.027 | 29.253 | 100.0% | 10 | + | cinder.delete_volume | 0.56 | 2.568 | 3.011 | 3.067 | 3.123 | 2.293 | 100.0% | 10 | + | nova.delete_image | 2.137 | 2.51 | 2.606 | 2.681 | 2.756 | 2.451 | 100.0% | 10 | + | total | 28.587 | 39.952 | 40.849 | 41.35 | 41.852 | 38.112 | 100.0% | 10 | + +-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 110.444069147 + Full duration: 131.52224803 + + + + test scenario CinderVolumes.create_and_delete_snapshot + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_snapshot | 3.208 | 3.343 | 5.587 | 5.628 | 5.669 | 3.788 | 100.0% | 10 | + | cinder.delete_snapshot | 2.503 | 2.86 | 3.196 | 3.217 | 3.239 | 2.893 | 100.0% | 10 | + | total | 5.787 | 6.422 | 8.296 | 8.392 | 8.488 | 6.681 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 18.7773430347 + Full duration: 53.0582361221 + + + + test scenario CinderVolumes.create_volume + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.52 | 3.822 | 4.222 | 4.228 | 4.233 | 3.852 | 100.0% | 10 | + | total | 3.52 | 3.822 | 4.223 | 4.228 | 4.233 | 3.852 | 100.0% | 10 | + +----------------------+------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 11.2881109715 + Full duration: 29.6710369587 + + + + test scenario CinderVolumes.create_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.248 | 3.651 | 3.891 | 3.988 | 4.084 | 3.645 | 100.0% | 10 | + | total | 3.249 | 3.652 | 3.891 | 3.988 | 4.084 | 3.645 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 10.7785470486 + Full duration: 32.9540159702 + + + + test scenario CinderVolumes.list_volumes + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.list_volumes | 0.499 | 0.52 | 0.539 | 0.55 | 0.561 | 0.522 | 100.0% | 10 | + | total | 0.499 | 0.52 | 0.539 | 0.55 | 0.561 | 0.523 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.60948395729 + Full duration: 65.5444660187 + + + + test scenario CinderVolumes.create_nested_snapshots_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.547 | 3.82 | 3.891 | 3.927 | 3.962 | 3.787 | 100.0% | 10 | + | cinder.create_snapshot | 2.552 | 2.875 | 3.173 | 3.215 | 3.257 | 2.931 | 100.0% | 10 | + | nova.attach_volume | 3.633 | 5.774 | 8.279 | 8.853 | 9.427 | 6.038 | 100.0% | 10 | + | nova.detach_volume | 3.599 | 3.826 | 4.233 | 4.444 | 4.655 | 3.905 | 100.0% | 10 | + | cinder.delete_snapshot | 2.22 | 2.537 | 2.852 | 2.971 | 3.09 | 2.577 | 100.0% | 10 | + | cinder.delete_volume | 0.648 | 2.735 | 2.845 | 2.892 | 2.939 | 2.321 | 100.0% | 10 | + | total | 18.538 | 22.642 | 25.806 | 26.204 | 26.601 | 22.745 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 66.8299760818 + Full duration: 173.895985842 + + + + test scenario CinderVolumes.create_from_volume_and_delete_volume + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | cinder.create_volume | 3.481 | 3.953 | 4.613 | 5.302 | 5.991 | 4.167 | 100.0% | 10 | + | cinder.delete_volume | 1.163 | 3.065 | 3.469 | 3.474 | 3.479 | 2.919 | 100.0% | 10 | + | total | 5.012 | 7.114 | 7.89 | 8.462 | 9.034 | 7.087 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 20.8082921505 + Full duration: 55.4062600136 + + + + test scenario CinderVolumes.create_and_extend_volume + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | cinder.create_volume | 3.417 | 3.839 | 3.908 | 3.925 | 3.941 | 3.742 | 100.0% | 10 | + | cinder.extend_volume | 0.938 | 2.978 | 3.574 | 3.713 | 3.853 | 2.396 | 100.0% | 10 | + | cinder.delete_volume | 0.577 | 1.808 | 3.066 | 3.146 | 3.225 | 1.858 | 100.0% | 10 | + | total | 5.44 | 8.275 | 9.921 | 10.095 | 10.269 | 7.997 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 23.5873560905 + Full duration: 41.9279878139 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +-----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.668 | 3.89 | 4.255 | 4.266 | 4.277 | 3.937 | 100.0% | 10 | + | cinder.create_snapshot | 2.268 | 2.949 | 3.306 | 3.36 | 3.414 | 2.903 | 100.0% | 10 | + | nova.attach_volume | 3.471 | 4.393 | 7.358 | 8.251 | 9.145 | 5.113 | 100.0% | 10 | + | nova.detach_volume | 3.277 | 3.925 | 4.509 | 4.566 | 4.622 | 3.926 | 100.0% | 10 | + | cinder.delete_snapshot | 2.286 | 2.607 | 2.849 | 2.862 | 2.875 | 2.614 | 100.0% | 10 | + | cinder.delete_volume | 0.591 | 2.677 | 2.96 | 3.019 | 3.078 | 2.352 | 100.0% | 10 | + | total | 18.8 | 21.654 | 23.365 | 25.201 | 27.038 | 21.974 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 65.2181398869 + Full duration: 179.069041967 + + + + test scenario CinderVolumes.create_snapshot_and_attach_volume + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 3.22 | 3.682 | 4.259 | 4.27 | 4.281 | 3.723 | 100.0% | 10 | + | cinder.create_snapshot | 2.292 | 3.051 | 3.199 | 3.232 | 3.265 | 2.991 | 100.0% | 10 | + | nova.attach_volume | 3.891 | 4.365 | 6.53 | 6.577 | 6.625 | 4.971 | 100.0% | 10 | + | nova.detach_volume | 3.248 | 3.565 | 3.767 | 4.044 | 4.321 | 3.568 | 100.0% | 10 | + | cinder.delete_snapshot | 2.258 | 2.551 | 2.836 | 2.87 | 2.904 | 2.609 | 100.0% | 10 | + | cinder.delete_volume | 0.883 | 2.687 | 3.02 | 3.224 | 3.427 | 2.286 | 100.0% | 10 | + | total | 19.132 | 21.712 | 23.229 | 23.566 | 23.904 | 21.677 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 64.7866289616 + Full duration: 180.275881052 + + + + run_rally - INFO - Test scenario: "cinder" OK. + + run_rally - INFO - Starting test scenario "heat" ... + run_rally - INFO - + Preparing input task + Task 51925ef8-a527-44d2-8df3-6164af0ec62a: started + Task 51925ef8-a527-44d2-8df3-6164af0ec62a: finished + + test scenario HeatStacks.create_suspend_resume_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.245 | 4.317 | 4.434 | 4.474 | 4.514 | 4.348 | 100.0% | 10 | + | heat.suspend_stack | 1.497 | 1.713 | 1.747 | 1.75 | 1.753 | 1.7 | 100.0% | 10 | + | heat.resume_stack | 1.42 | 1.621 | 1.668 | 1.67 | 1.671 | 1.562 | 100.0% | 10 | + | heat.delete_stack | 1.377 | 1.573 | 1.716 | 2.249 | 2.782 | 1.675 | 100.0% | 10 | + | total | 8.851 | 9.198 | 9.402 | 9.981 | 10.56 | 9.285 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 27.3572640419 + Full duration: 37.0984110832 + + + + test scenario HeatStacks.create_and_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 3.911 | 4.181 | 4.323 | 4.325 | 4.327 | 4.149 | 100.0% | 10 | + | heat.delete_stack | 1.392 | 1.426 | 1.744 | 1.776 | 1.808 | 1.491 | 100.0% | 10 | + | total | 5.311 | 5.631 | 5.774 | 5.775 | 5.776 | 5.64 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 16.9275529385 + Full duration: 26.8473479748 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 20.192 | 23.206 | 23.805 | 23.826 | 23.847 | 22.465 | 100.0% | 10 | + | heat.delete_stack | 11.755 | 11.868 | 12.963 | 13.0 | 13.036 | 12.282 | 100.0% | 10 | + | total | 32.02 | 35.613 | 36.714 | 36.721 | 36.729 | 34.747 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 102.752908945 + Full duration: 112.369065046 + + + + test scenario HeatStacks.create_and_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 16.808 | 18.33 | 20.748 | 20.751 | 20.755 | 18.654 | 100.0% | 10 | + | heat.delete_stack | 9.404 | 10.582 | 10.788 | 10.803 | 10.818 | 10.313 | 100.0% | 10 | + | total | 26.212 | 28.318 | 31.532 | 31.553 | 31.574 | 28.967 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 85.8598790169 + Full duration: 95.2520959377 + + + + test scenario HeatStacks.list_stacks_and_resources + +-----------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+ + | heat.list_stacks | 0.45 | 0.485 | 0.512 | 0.512 | 0.512 | 0.487 | 100.0% | 10 | + | heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | + | total | 0.45 | 0.485 | 0.512 | 0.512 | 0.512 | 0.487 | 100.0% | 10 | + +---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.48300600052 + Full duration: 9.57427692413 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 3.727 | 4.075 | 4.288 | 4.337 | 4.386 | 4.085 | 100.0% | 10 | + | heat.update_stack | 3.549 | 3.676 | 3.903 | 3.972 | 4.042 | 3.704 | 100.0% | 10 | + | heat.delete_stack | 1.405 | 2.619 | 2.76 | 2.774 | 2.789 | 2.212 | 100.0% | 10 | + | total | 9.105 | 10.287 | 10.719 | 10.741 | 10.763 | 10.001 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 29.4346759319 + Full duration: 39.5471699238 + + + + test scenario HeatStacks.create_update_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 3.915 | 4.067 | 4.171 | 4.199 | 4.227 | 4.052 | 100.0% | 10 | + | heat.update_stack | 3.521 | 3.661 | 3.773 | 3.791 | 3.81 | 3.658 | 100.0% | 10 | + | heat.delete_stack | 1.38 | 1.477 | 1.612 | 1.618 | 1.624 | 1.492 | 100.0% | 10 | + | total | 8.916 | 9.128 | 9.484 | 9.493 | 9.503 | 9.203 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 27.5511319637 + Full duration: 37.5252559185 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.023 | 4.301 | 4.59 | 5.029 | 5.468 | 4.38 | 100.0% | 10 | + | heat.update_stack | 5.783 | 5.888 | 6.061 | 6.08 | 6.1 | 5.912 | 100.0% | 10 | + | heat.delete_stack | 2.475 | 2.546 | 2.705 | 3.2 | 3.694 | 2.65 | 100.0% | 10 | + | total | 12.613 | 12.74 | 13.76 | 13.912 | 14.064 | 12.942 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 38.1860618591 + Full duration: 48.4381308556 + + + + test scenario HeatStacks.create_update_delete_stack + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.094 | 5.24 | 5.479 | 5.528 | 5.577 | 5.17 | 100.0% | 10 | + | heat.update_stack | 8.178 | 9.243 | 9.316 | 9.324 | 9.332 | 8.862 | 100.0% | 10 | + | heat.delete_stack | 3.63 | 3.68 | 3.714 | 3.714 | 3.715 | 3.68 | 100.0% | 10 | + | total | 16.974 | 17.76 | 18.444 | 18.466 | 18.488 | 17.713 | 100.0% | 10 | + +-------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 52.4500279427 + Full duration: 63.0265882015 + + + + test scenario HeatStacks.create_update_delete_stack + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | heat.create_stack | 4.113 | 4.273 | 4.647 | 4.934 | 5.22 | 4.362 | 100.0% | 10 | + | heat.update_stack | 5.809 | 5.888 | 5.941 | 6.056 | 6.17 | 5.907 | 100.0% | 10 | + | heat.delete_stack | 2.513 | 2.561 | 3.694 | 3.7 | 3.706 | 2.891 | 100.0% | 10 | + | total | 12.55 | 12.759 | 14.013 | 14.546 | 15.079 | 13.161 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.0816349983 + Full duration: 49.7756490707 + + + + test scenario HeatStacks.create_update_delete_stack + +-----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | heat.create_stack | 3.762 | 4.115 | 4.19 | 4.27 | 4.35 | 4.062 | 100.0% | 10 | + | heat.update_stack | 3.543 | 3.63 | 3.844 | 3.977 | 4.11 | 3.69 | 100.0% | 10 | + | heat.delete_stack | 1.383 | 1.499 | 2.506 | 2.528 | 2.549 | 1.677 | 100.0% | 10 | + | total | 8.868 | 9.275 | 10.208 | 10.225 | 10.242 | 9.429 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 27.9543409348 + Full duration: 38.8234701157 + + + + test scenario HeatStacks.create_and_list_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.005 | 4.128 | 4.199 | 4.234 | 4.27 | 4.127 | 100.0% | 10 | + | heat.list_stacks | 0.075 | 0.094 | 0.108 | 0.112 | 0.117 | 0.094 | 100.0% | 10 | + | total | 4.112 | 4.226 | 4.281 | 4.313 | 4.345 | 4.221 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 12.6059498787 + Full duration: 27.8848700523 + + + + test scenario HeatStacks.create_check_delete_stack + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | heat.create_stack | 4.084 | 4.153 | 4.178 | 4.217 | 4.256 | 4.153 | 100.0% | 10 | + | heat.check_stack | 0.706 | 1.53 | 1.571 | 1.586 | 1.6 | 1.459 | 100.0% | 10 | + | heat.delete_stack | 1.375 | 1.432 | 2.542 | 2.546 | 2.55 | 1.763 | 100.0% | 10 | + | total | 7.01 | 7.159 | 8.25 | 8.279 | 8.309 | 7.375 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 22.5798799992 + Full duration: 33.7318949699 + + + + run_rally - INFO - Test scenario: "heat" OK. + + run_rally - INFO - Starting test scenario "keystone" ... + run_rally - INFO - + Preparing input task + Task 98c40f01-0adc-48ce-91ca-105f22e60ec9: started + Task 98c40f01-0adc-48ce-91ca-105f22e60ec9: finished + + test scenario KeystoneBasic.create_tenant_with_users + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.263 | 0.291 | 0.401 | 0.408 | 0.415 | 0.322 | 100.0% | 10 | + | keystone.create_users | 1.508 | 1.599 | 1.672 | 1.733 | 1.793 | 1.601 | 100.0% | 10 | + | total | 1.782 | 1.949 | 2.051 | 2.066 | 2.081 | 1.923 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 5.82497000694 + Full duration: 20.636977911 + + + + test scenario KeystoneBasic.create_add_and_list_user_roles + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.256 | 0.273 | 0.292 | 0.296 | 0.3 | 0.274 | 100.0% | 10 | + | keystone.add_role | 0.24 | 0.262 | 0.297 | 0.319 | 0.341 | 0.267 | 100.0% | 10 | + | keystone.list_roles | 0.131 | 0.146 | 0.226 | 0.237 | 0.248 | 0.16 | 100.0% | 10 | + | total | 0.636 | 0.682 | 0.774 | 0.78 | 0.786 | 0.702 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.11375284195 + Full duration: 14.9668319225 + + + + test scenario KeystoneBasic.add_and_remove_user_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.267 | 0.326 | 0.368 | 0.376 | 0.383 | 0.322 | 100.0% | 10 | + | keystone.add_role | 0.244 | 0.255 | 0.278 | 0.302 | 0.326 | 0.263 | 100.0% | 10 | + | keystone.remove_role | 0.149 | 0.163 | 0.191 | 0.244 | 0.296 | 0.177 | 100.0% | 10 | + | total | 0.681 | 0.765 | 0.834 | 0.84 | 0.846 | 0.762 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.33364892006 + Full duration: 14.8711419106 + + + + test scenario KeystoneBasic.create_update_and_delete_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.272 | 0.316 | 0.391 | 0.394 | 0.396 | 0.327 | 100.0% | 10 | + | keystone.update_tenant | 0.125 | 0.141 | 0.169 | 0.215 | 0.261 | 0.152 | 100.0% | 10 | + | keystone.delete_tenant | 0.299 | 0.321 | 0.379 | 0.394 | 0.408 | 0.333 | 100.0% | 10 | + | total | 0.745 | 0.81 | 0.859 | 0.915 | 0.971 | 0.812 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.46658396721 + Full duration: 13.4442551136 + + + + test scenario KeystoneBasic.create_and_delete_service + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_service | 0.258 | 0.271 | 0.303 | 0.308 | 0.314 | 0.278 | 100.0% | 10 | + | keystone.delete_service | 0.146 | 0.158 | 0.181 | 0.203 | 0.226 | 0.164 | 100.0% | 10 | + | total | 0.408 | 0.442 | 0.464 | 0.475 | 0.487 | 0.442 | 100.0% | 10 | + +-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.34449720383 + Full duration: 12.1886069775 + + + + test scenario KeystoneBasic.create_tenant + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.253 | 0.302 | 0.319 | 0.324 | 0.328 | 0.297 | 100.0% | 10 | + | total | 0.253 | 0.302 | 0.319 | 0.324 | 0.329 | 0.298 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.912425994873 + Full duration: 8.74173903465 + + + + test scenario KeystoneBasic.create_user + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.262 | 0.303 | 0.319 | 0.319 | 0.319 | 0.296 | 100.0% | 10 | + | total | 0.262 | 0.303 | 0.319 | 0.319 | 0.32 | 0.296 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 0.953788042068 + Full duration: 8.72430300713 + + + + test scenario KeystoneBasic.create_and_list_tenants + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.247 | 0.28 | 0.302 | 0.304 | 0.307 | 0.281 | 100.0% | 10 | + | keystone.list_tenants | 0.121 | 0.129 | 0.224 | 0.225 | 0.225 | 0.147 | 100.0% | 10 | + | total | 0.392 | 0.42 | 0.476 | 0.493 | 0.511 | 0.428 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.32897400856 + Full duration: 13.584346056 + + + + test scenario KeystoneBasic.create_and_delete_role + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_role | 0.286 | 0.324 | 0.395 | 0.47 | 0.545 | 0.347 | 100.0% | 10 | + | keystone.delete_role | 0.25 | 0.32 | 0.487 | 0.522 | 0.557 | 0.344 | 100.0% | 10 | + | total | 0.546 | 0.62 | 0.889 | 0.913 | 0.936 | 0.691 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.18193697929 + Full duration: 12.766493082 + + + + test scenario KeystoneBasic.get_entities + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_tenant | 0.271 | 0.283 | 0.299 | 0.311 | 0.322 | 0.287 | 100.0% | 10 | + | keystone.create_user | 0.145 | 0.156 | 0.162 | 0.165 | 0.167 | 0.155 | 100.0% | 10 | + | keystone.create_role | 0.122 | 0.133 | 0.155 | 0.183 | 0.211 | 0.141 | 100.0% | 10 | + | keystone.get_tenant | 0.109 | 0.126 | 0.145 | 0.178 | 0.211 | 0.133 | 100.0% | 10 | + | keystone.get_user | 0.12 | 0.133 | 0.2 | 0.205 | 0.21 | 0.148 | 100.0% | 10 | + | keystone.get_role | 0.106 | 0.12 | 0.137 | 0.155 | 0.172 | 0.126 | 100.0% | 10 | + | keystone.service_list | 0.112 | 0.126 | 0.144 | 0.178 | 0.212 | 0.134 | 100.0% | 10 | + | keystone.get_service | 0.104 | 0.125 | 0.131 | 0.134 | 0.136 | 0.123 | 100.0% | 10 | + | total | 1.177 | 1.23 | 1.321 | 1.328 | 1.334 | 1.248 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.83582210541 + Full duration: 20.6130208969 + + + + test scenario KeystoneBasic.create_and_list_users + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | keystone.create_user | 0.295 | 0.312 | 0.374 | 0.386 | 0.399 | 0.326 | 100.0% | 10 | + | keystone.list_users | 0.114 | 0.129 | 0.148 | 0.148 | 0.149 | 0.133 | 100.0% | 10 | + | total | 0.419 | 0.442 | 0.521 | 0.535 | 0.549 | 0.458 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.37977695465 + Full duration: 9.29229903221 + + + + run_rally - INFO - Test scenario: "keystone" OK. + + run_rally - INFO - Starting test scenario "neutron" ... + run_rally - INFO - + Preparing input task + Task 0a18c72f-b575-481a-8997-6d3d52130ede: started + Task 0a18c72f-b575-481a-8997-6d3d52130ede: finished + + test scenario NeutronNetworks.create_and_delete_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.758 | 0.851 | 1.15 | 1.23 | 1.309 | 0.925 | 100.0% | 10 | + | neutron.delete_port | 0.241 | 0.578 | 0.611 | 0.618 | 0.625 | 0.488 | 100.0% | 10 | + | total | 0.998 | 1.415 | 1.73 | 1.808 | 1.886 | 1.414 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.22447299957 + Full duration: 51.8464670181 + + + + test scenario NeutronNetworks.create_and_list_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.768 | 0.804 | 0.942 | 1.007 | 1.073 | 0.852 | 100.0% | 10 | + | neutron.create_router | 0.08 | 0.425 | 0.456 | 0.469 | 0.482 | 0.394 | 100.0% | 10 | + | neutron.add_interface_router | 0.371 | 0.741 | 1.213 | 1.526 | 1.84 | 0.855 | 100.0% | 10 | + | neutron.list_routers | 0.048 | 0.405 | 0.478 | 0.502 | 0.527 | 0.286 | 100.0% | 10 | + | total | 1.684 | 2.22 | 3.085 | 3.308 | 3.53 | 2.388 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.42530488968 + Full duration: 57.8292651176 + + + + test scenario NeutronNetworks.create_and_delete_routers + +------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.689 | 0.768 | 0.931 | 0.941 | 0.95 | 0.811 | 100.0% | 10 | + | neutron.create_router | 0.408 | 0.421 | 0.457 | 0.547 | 0.636 | 0.441 | 100.0% | 10 | + | neutron.add_interface_router | 0.363 | 0.702 | 0.802 | 0.807 | 0.813 | 0.653 | 100.0% | 10 | + | neutron.remove_interface_router | 0.273 | 0.662 | 0.823 | 0.847 | 0.872 | 0.65 | 100.0% | 10 | + | neutron.delete_router | 0.178 | 0.557 | 0.661 | 0.665 | 0.669 | 0.541 | 100.0% | 10 | + | total | 2.291 | 3.046 | 3.598 | 3.647 | 3.695 | 3.096 | 100.0% | 10 | + +---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 9.11136102676 + Full duration: 56.6760940552 + + + + test scenario NeutronNetworks.create_and_list_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.746 | 0.824 | 0.923 | 0.946 | 0.968 | 0.846 | 100.0% | 10 | + | neutron.list_ports | 0.157 | 0.57 | 0.629 | 0.663 | 0.697 | 0.481 | 100.0% | 10 | + | total | 1.065 | 1.343 | 1.476 | 1.493 | 1.51 | 1.327 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.94901585579 + Full duration: 52.597589016 + + + + test scenario NeutronNetworks.create_and_delete_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.701 | 0.757 | 1.049 | 1.144 | 1.238 | 0.835 | 100.0% | 10 | + | neutron.delete_subnet | 0.196 | 0.565 | 0.691 | 0.725 | 0.759 | 0.531 | 100.0% | 10 | + | total | 0.939 | 1.384 | 1.496 | 1.595 | 1.694 | 1.366 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.35806703568 + Full duration: 51.0885548592 + + + + test scenario NeutronNetworks.create_and_delete_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.614 | 0.675 | 0.811 | 0.817 | 0.823 | 0.692 | 100.0% | 10 | + | neutron.delete_network | 0.491 | 0.545 | 0.62 | 0.624 | 0.628 | 0.554 | 100.0% | 10 | + | total | 1.133 | 1.231 | 1.388 | 1.415 | 1.443 | 1.246 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.68652009964 + Full duration: 30.7036879063 + + + + test scenario NeutronNetworks.create_and_list_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.556 | 0.652 | 0.754 | 0.757 | 0.759 | 0.665 | 100.0% | 10 | + | neutron.list_networks | 0.361 | 0.383 | 0.478 | 0.503 | 0.528 | 0.403 | 100.0% | 10 | + | total | 0.917 | 1.027 | 1.231 | 1.252 | 1.273 | 1.068 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.11869502068 + Full duration: 33.6655409336 + + + + test scenario NeutronNetworks.create_and_update_routers + +---------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.718 | 0.757 | 0.921 | 0.922 | 0.923 | 0.795 | 100.0% | 10 | + | neutron.create_router | 0.073 | 0.405 | 0.44 | 0.448 | 0.455 | 0.38 | 100.0% | 10 | + | neutron.add_interface_router | 0.65 | 0.699 | 0.805 | 0.827 | 0.849 | 0.717 | 100.0% | 10 | + | neutron.update_router | 0.228 | 0.537 | 0.661 | 0.677 | 0.693 | 0.53 | 100.0% | 10 | + | total | 2.134 | 2.511 | 2.583 | 2.583 | 2.583 | 2.422 | 100.0% | 10 | + +------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 7.21204185486 + Full duration: 58.3329060078 + + + + test scenario NeutronNetworks.create_and_update_networks + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_network | 0.59 | 0.678 | 0.77 | 0.785 | 0.8 | 0.684 | 100.0% | 10 | + | neutron.update_network | 0.452 | 0.51 | 0.55 | 0.569 | 0.587 | 0.514 | 100.0% | 10 | + | total | 1.054 | 1.188 | 1.314 | 1.319 | 1.323 | 1.198 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.48062801361 + Full duration: 33.7373108864 + + + + test scenario NeutronNetworks.create_and_update_ports + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_port | 0.724 | 0.911 | 1.036 | 1.046 | 1.055 | 0.915 | 100.0% | 10 | + | neutron.update_port | 0.332 | 0.55 | 0.569 | 0.573 | 0.578 | 0.53 | 100.0% | 10 | + | total | 1.173 | 1.466 | 1.591 | 1.607 | 1.623 | 1.445 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.40219402313 + Full duration: 52.9743890762 + + + + test scenario NeutronNetworks.create_and_list_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.768 | 0.823 | 0.981 | 1.001 | 1.02 | 0.857 | 100.0% | 10 | + | neutron.list_subnets | 0.053 | 0.403 | 0.472 | 0.483 | 0.495 | 0.316 | 100.0% | 10 | + | total | 0.821 | 1.249 | 1.342 | 1.384 | 1.426 | 1.173 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.63253998756 + Full duration: 52.0335438251 + + + + test scenario NeutronNetworks.create_and_update_subnets + +--------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | neutron.create_subnet | 0.721 | 0.797 | 0.952 | 0.953 | 0.954 | 0.82 | 100.0% | 10 | + | neutron.update_subnet | 0.233 | 0.605 | 0.745 | 0.753 | 0.761 | 0.589 | 100.0% | 10 | + | total | 1.002 | 1.432 | 1.561 | 1.638 | 1.715 | 1.409 | 100.0% | 10 | + +-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.58866596222 + Full duration: 52.8035202026 + + + + run_rally - INFO - Test scenario: "neutron" OK. + + run_rally - INFO - Starting test scenario "nova" ... + run_rally - INFO - + Preparing input task + Task 7bc9f24e-75ad-4e01-afd5-3647398a073e: started + Task 7bc9f24e-75ad-4e01-afd5-3647398a073e: finished + + test scenario NovaKeypair.create_and_delete_keypair + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.705 | 0.755 | 0.85 | 1.155 | 1.459 | 0.818 | 100.0% | 10 | + | nova.delete_keypair | 0.032 | 0.046 | 0.063 | 0.064 | 0.064 | 0.046 | 100.0% | 10 | + | total | 0.744 | 0.804 | 0.895 | 1.21 | 1.524 | 0.864 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.08747410774 + Full duration: 41.9948050976 + + + + test scenario NovaServers.snapshot_server + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.021 | 10.195 | 10.572 | 10.642 | 10.713 | 9.936 | 100.0% | 10 | + | nova.create_image | 10.782 | 11.261 | 11.548 | 11.631 | 11.715 | 11.242 | 100.0% | 10 | + | nova.delete_server | 2.821 | 3.28 | 3.4 | 3.426 | 3.452 | 3.222 | 100.0% | 10 | + | nova.boot_server (2) | 6.39 | 8.069 | 9.073 | 9.382 | 9.691 | 7.984 | 100.0% | 10 | + | nova.delete_server (2) | 2.855 | 2.91 | 3.425 | 3.429 | 3.434 | 3.04 | 100.0% | 10 | + | nova.delete_image | 2.558 | 2.911 | 3.161 | 3.22 | 3.279 | 2.887 | 100.0% | 10 | + | total | 35.039 | 38.279 | 39.897 | 40.21 | 40.523 | 38.314 | 100.0% | 10 | + +------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 115.44729495 + Full duration: 188.161262035 + + + + test scenario NovaKeypair.boot_and_delete_server_with_keypair + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_keypair | 0.64 | 0.869 | 1.365 | 1.399 | 1.433 | 0.948 | 100.0% | 10 | + | nova.boot_server | 7.047 | 8.139 | 10.062 | 10.11 | 10.159 | 8.606 | 100.0% | 10 | + | nova.delete_server | 2.522 | 3.1 | 3.242 | 3.267 | 3.292 | 3.041 | 100.0% | 10 | + | nova.delete_keypair | 0.042 | 0.051 | 0.061 | 0.068 | 0.075 | 0.052 | 100.0% | 10 | + | total | 11.115 | 12.323 | 14.176 | 14.258 | 14.341 | 12.648 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 39.1623878479 + Full duration: 108.56980896 + + + + test scenario NovaKeypair.create_and_list_keypairs + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.create_keypair | 0.734 | 0.87 | 0.947 | 0.982 | 1.018 | 0.859 | 100.0% | 10 | + | nova.list_keypairs | 0.022 | 0.034 | 0.042 | 0.044 | 0.046 | 0.033 | 100.0% | 10 | + | total | 0.769 | 0.903 | 0.981 | 1.02 | 1.059 | 0.892 | 100.0% | 10 | + +---------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 2.59114599228 + Full duration: 44.6869869232 + + + + test scenario NovaServers.list_servers + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | nova.list_servers | 1.436 | 1.556 | 1.653 | 1.689 | 1.725 | 1.565 | 100.0% | 10 | + | total | 1.436 | 1.557 | 1.653 | 1.689 | 1.726 | 1.565 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 4.71795606613 + Full duration: 123.497851133 + + + + test scenario NovaServers.resize_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.388 | 9.39 | 10.016 | 10.105 | 10.194 | 9.406 | 100.0% | 10 | + | nova.resize | 40.666 | 42.089 | 46.186 | 46.669 | 47.151 | 42.721 | 100.0% | 10 | + | nova.resize_confirm | 3.322 | 3.648 | 4.206 | 5.097 | 5.989 | 3.842 | 100.0% | 10 | + | nova.delete_server | 2.499 | 2.977 | 3.32 | 3.383 | 3.446 | 3.012 | 100.0% | 10 | + | total | 56.246 | 58.698 | 61.838 | 62.514 | 63.19 | 58.982 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 180.054177999 + Full duration: 221.624077082 + + + + test scenario NovaServers.boot_server_from_volume_and_delete + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.965 | 10.647 | 11.15 | 11.275 | 11.4 | 10.648 | 100.0% | 10 | + | nova.boot_server | 8.986 | 10.62 | 12.102 | 12.345 | 12.587 | 10.685 | 100.0% | 10 | + | nova.delete_server | 3.355 | 5.419 | 5.857 | 5.908 | 5.96 | 5.311 | 100.0% | 10 | + | total | 23.598 | 26.481 | 28.991 | 29.016 | 29.041 | 26.644 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 79.5105199814 + Full duration: 161.905633926 + + + + test scenario NovaServers.boot_and_migrate_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.833 | 10.242 | 11.298 | 11.673 | 12.049 | 10.106 | 100.0% | 10 | + | nova.stop_server | 3.821 | 6.772 | 7.286 | 7.317 | 7.349 | 6.484 | 100.0% | 10 | + | nova.migrate | 8.569 | 12.084 | 12.564 | 12.67 | 12.776 | 11.309 | 100.0% | 10 | + | nova.resize_confirm | 2.922 | 3.398 | 4.001 | 4.054 | 4.107 | 3.49 | 100.0% | 10 | + | nova.delete_server | 2.522 | 2.922 | 3.396 | 3.406 | 3.416 | 2.976 | 100.0% | 10 | + | total | 29.694 | 34.582 | 36.24 | 36.517 | 36.795 | 34.367 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 100.483532906 + Full duration: 141.506958961 + + + + test scenario NovaServers.boot_and_delete_server + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.586 | 9.397 | 10.198 | 10.288 | 10.378 | 9.508 | 100.0% | 10 | + | nova.delete_server | 2.497 | 3.108 | 3.472 | 3.478 | 3.485 | 3.09 | 100.0% | 10 | + | total | 11.39 | 12.555 | 13.374 | 13.612 | 13.849 | 12.598 | 100.0% | 10 | + +--------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 38.4852130413 + Full duration: 106.844094992 + + + + test scenario NovaServers.boot_and_rebuild_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.193 | 9.878 | 10.329 | 10.703 | 11.078 | 9.597 | 100.0% | 10 | + | nova.rebuild_server | 8.434 | 9.946 | 10.942 | 11.066 | 11.191 | 9.967 | 100.0% | 10 | + | nova.delete_server | 2.887 | 3.097 | 3.934 | 4.794 | 5.654 | 3.399 | 100.0% | 10 | + | total | 20.573 | 22.393 | 25.427 | 25.892 | 26.357 | 22.963 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 68.7611658573 + Full duration: 138.198104143 + + + + test scenario NovaSecGroup.create_and_list_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.914 | 5.073 | 5.815 | 5.965 | 6.116 | 5.288 | 100.0% | 10 | + | nova.create_100_rules | 41.66 | 44.384 | 45.431 | 45.816 | 46.201 | 44.305 | 100.0% | 10 | + | nova.list_security_groups | 0.152 | 0.533 | 0.902 | 0.96 | 1.018 | 0.5 | 100.0% | 10 | + | total | 47.592 | 50.13 | 51.2 | 51.527 | 51.854 | 50.094 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 149.717460871 + Full duration: 216.41701889 + + + + test scenario NovaSecGroup.create_and_delete_secgroups + +--------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 4.565 | 5.19 | 5.563 | 5.615 | 5.668 | 5.131 | 100.0% | 10 | + | nova.create_100_rules | 41.981 | 43.448 | 44.817 | 44.926 | 45.034 | 43.666 | 100.0% | 10 | + | nova.delete_10_security_groups | 2.07 | 2.522 | 2.976 | 3.171 | 3.366 | 2.551 | 100.0% | 10 | + | total | 49.35 | 51.576 | 51.781 | 52.087 | 52.394 | 51.349 | 100.0% | 10 | + +--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 154.714606047 + Full duration: 196.745972872 + + + + test scenario NovaServers.boot_and_bounce_server + +------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.097 | 9.924 | 11.182 | 11.428 | 11.673 | 10.029 | 100.0% | 10 | + | nova.reboot_server | 5.363 | 6.246 | 8.84 | 8.907 | 8.973 | 7.049 | 100.0% | 10 | + | nova.soft_reboot_server | 8.452 | 8.823 | 9.184 | 9.291 | 9.398 | 8.83 | 100.0% | 10 | + | nova.stop_server | 3.808 | 6.394 | 7.284 | 7.3 | 7.316 | 6.358 | 100.0% | 10 | + | nova.start_server | 3.677 | 5.011 | 5.706 | 5.852 | 5.997 | 4.954 | 100.0% | 10 | + | nova.rescue_server | 7.752 | 8.674 | 11.07 | 11.07 | 11.071 | 9.269 | 100.0% | 10 | + | nova.unrescue_server | 5.065 | 5.536 | 5.762 | 5.781 | 5.8 | 5.532 | 100.0% | 10 | + | nova.delete_server | 2.485 | 2.546 | 3.501 | 4.347 | 5.194 | 2.952 | 100.0% | 10 | + | total | 50.79 | 54.629 | 59.2 | 59.748 | 60.297 | 54.995 | 100.0% | 10 | + +-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 166.248807907 + Full duration: 235.770923853 + + + + test scenario NovaServers.boot_server + +----------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + | nova.boot_server | 6.916 | 9.539 | 12.275 | 12.369 | 12.464 | 9.975 | 100.0% | 10 | + | total | 6.916 | 9.54 | 12.275 | 12.37 | 12.464 | 9.976 | 100.0% | 10 | + +------------------+-------+--------+--------+--------+--------+-------+---------+-------+ + Load duration: 29.8727550507 + Full duration: 87.0325229168 + + + + test scenario NovaSecGroup.boot_and_delete_server_with_secgroups + +-----------------------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.create_10_security_groups | 5.065 | 5.392 | 5.642 | 5.731 | 5.819 | 5.4 | 100.0% | 10 | + | nova.create_100_rules | 42.116 | 43.904 | 45.452 | 45.794 | 46.137 | 44.057 | 100.0% | 10 | + | nova.boot_server | 6.906 | 7.809 | 8.73 | 8.911 | 9.092 | 7.954 | 100.0% | 10 | + | nova.get_attached_security_groups | 0.209 | 0.264 | 0.361 | 0.463 | 0.565 | 0.289 | 100.0% | 10 | + | nova.delete_server | 2.508 | 2.562 | 2.7 | 2.829 | 2.959 | 2.607 | 100.0% | 10 | + | nova.delete_10_security_groups | 1.784 | 2.564 | 3.087 | 3.153 | 3.218 | 2.561 | 100.0% | 10 | + | total | 60.06 | 63.125 | 63.757 | 63.889 | 64.021 | 62.869 | 100.0% | 10 | + +-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 188.221204996 + Full duration: 257.303071976 + + + + test scenario NovaServers.pause_and_unpause_server + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 7.896 | 9.252 | 10.006 | 10.25 | 10.494 | 9.303 | 100.0% | 10 | + | nova.pause_server | 2.784 | 3.19 | 3.465 | 3.487 | 3.509 | 3.226 | 100.0% | 10 | + | nova.unpause_server | 2.782 | 3.172 | 3.226 | 3.258 | 3.29 | 3.105 | 100.0% | 10 | + | nova.delete_server | 2.553 | 3.301 | 3.545 | 3.619 | 3.693 | 3.248 | 100.0% | 10 | + | total | 17.692 | 19.035 | 19.794 | 19.85 | 19.905 | 18.883 | 100.0% | 10 | + +---------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 56.6791820526 + Full duration: 126.811426163 + + + + test scenario NovaServers.boot_server_from_volume + +----------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + | cinder.create_volume | 9.412 | 10.207 | 10.376 | 10.441 | 10.505 | 10.131 | 100.0% | 10 | + | nova.boot_server | 8.849 | 10.342 | 11.591 | 11.741 | 11.892 | 10.423 | 100.0% | 10 | + | total | 18.922 | 20.498 | 21.854 | 21.976 | 22.099 | 20.555 | 100.0% | 10 | + +----------------------+--------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 60.9860489368 + Full duration: 126.851632118 + + + + test scenario NovaServers.boot_and_list_server + +------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + | nova.boot_server | 8.227 | 8.931 | 10.864 | 10.959 | 11.054 | 9.41 | 100.0% | 10 | + | nova.list_servers | 0.624 | 1.017 | 1.144 | 1.153 | 1.163 | 0.949 | 100.0% | 10 | + | total | 8.969 | 9.945 | 11.851 | 11.89 | 11.928 | 10.359 | 100.0% | 10 | + +-------------------+-------+--------+--------+--------+--------+--------+---------+-------+ + Load duration: 30.9555499554 + Full duration: 111.845392942 + + + + run_rally - INFO - Test scenario: "nova" OK. + + run_rally - INFO - Starting test scenario "quotas" ... + run_rally - INFO - + Preparing input task + Task 1b950d54-5c1a-4680-9d86-cbebdb0d1b72: started + Task 1b950d54-5c1a-4680-9d86-cbebdb0d1b72: finished + + test scenario Quotas.cinder_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.138 | 1.278 | 1.336 | 1.347 | 1.357 | 1.267 | 100.0% | 10 | + | total | 1.138 | 1.278 | 1.336 | 1.347 | 1.357 | 1.267 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 3.75106191635 + Full duration: 16.480301857 + + + + test scenario Quotas.neutron_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.406 | 0.441 | 0.5 | 0.501 | 0.502 | 0.454 | 100.0% | 10 | + | total | 0.546 | 0.618 | 0.666 | 0.67 | 0.674 | 0.616 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.8795170784 + Full duration: 13.8104491234 + + + + test scenario Quotas.cinder_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 1.178 | 1.264 | 1.311 | 1.344 | 1.378 | 1.26 | 100.0% | 10 | + | quotas.delete_quotas | 0.89 | 0.996 | 1.091 | 1.115 | 1.138 | 1.003 | 100.0% | 10 | + | total | 2.155 | 2.273 | 2.366 | 2.404 | 2.442 | 2.264 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 6.68874502182 + Full duration: 18.7547061443 + + + + test scenario Quotas.nova_update_and_delete + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.559 | 0.615 | 0.666 | 0.669 | 0.671 | 0.616 | 100.0% | 10 | + | quotas.delete_quotas | 0.013 | 0.022 | 0.026 | 0.028 | 0.029 | 0.022 | 100.0% | 10 | + | total | 0.585 | 0.641 | 0.68 | 0.687 | 0.693 | 0.638 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.9670290947 + Full duration: 13.6480379105 + + + + test scenario Quotas.nova_update + +-------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | quotas.update_quotas | 0.587 | 0.621 | 0.738 | 0.758 | 0.777 | 0.646 | 100.0% | 10 | + | total | 0.587 | 0.621 | 0.738 | 0.758 | 0.777 | 0.647 | 100.0% | 10 | + +----------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 1.87492918968 + Full duration: 13.4147770405 + + + + run_rally - INFO - Test scenario: "quotas" OK. + + run_rally - INFO - Starting test scenario "requests" ... + run_rally - INFO - + Preparing input task + Task 21739b85-984f-45b9-ae85-066dbd1adce3: started + Task 21739b85-984f-45b9-ae85-066dbd1adce3: finished + + test scenario HttpRequests.check_random_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 5.047 | 5.181 | 5.389 | 5.395 | 5.401 | 5.204 | 100.0% | 10 | + | total | 5.047 | 5.181 | 5.39 | 5.395 | 5.401 | 5.205 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 15.7369980812 + Full duration: 20.6335179806 + + + + test scenario HttpRequests.check_request + +---------------------------------------------------------------------------------------------+ + | Response Times (sec) | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | action | min | median | 90%ile | 95%ile | max | avg | success | count | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + | requests.check_request | 5.048 | 5.052 | 5.058 | 5.058 | 5.058 | 5.053 | 100.0% | 10 | + | total | 5.049 | 5.052 | 5.058 | 5.058 | 5.058 | 5.053 | 100.0% | 10 | + +------------------------+-------+--------+--------+--------+-------+-------+---------+-------+ + Load duration: 15.2042939663 + Full duration: 20.2779421806 + + + + run_rally - INFO - Test scenario: "requests" OK. + + run_rally - INFO - + + + Rally Summary Report + +===================+============+===============+===========+ + | Module | Duration | nb. Test Run | Success | + +===================+============+===============+===========+ + | authenticate | 01:01 | 10 | 100.00% | + +-------------------+------------+---------------+-----------+ + | glance | 03:33 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | cinder | 22:00 | 50 | 100.00% | + +-------------------+------------+---------------+-----------+ + | heat | 10:19 | 35 | 100.00% | + +-------------------+------------+---------------+-----------+ + | keystone | 02:29 | 29 | 100.00% | + +-------------------+------------+---------------+-----------+ + | neutron | 09:44 | 31 | 100.00% | + +-------------------+------------+---------------+-----------+ + | nova | 43:55 | 61 | 100.00% | + +-------------------+------------+---------------+-----------+ + | quotas | 01:16 | 7 | 100.00% | + +-------------------+------------+---------------+-----------+ + | requests | 00:40 | 2 | 100.00% | + +-------------------+------------+---------------+-----------+ + +===================+============+===============+===========+ + | TOTAL: | 01:35:01 | 232 | 100.00% | + +===================+============+===============+===========+ + +:: |