aboutsummaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorMorgan Richomme <morgan.richomme@orange.com>2016-04-26 18:35:16 +0200
committerMorgan Richomme <morgan.richomme@orange.com>2016-04-27 17:55:53 +0200
commit385be28ce7c48928361d1ec70c54cb2c73450f9e (patch)
tree1638218506371cce04e7e6ca777dfdff5094e116
parent790fa04f4503dbf60123bf9414db131580f2c45a (diff)
Prepare Brahmaputra 3.0 release
Change-Id: I12530573ff6cac7764e169225e130d46455ce54f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Diffstat
-rw-r--r--docs/release-notes/functest-release.rst99
-rw-r--r--docs/results/apex-os-odl_l2-bgpvpn-ha.rst926
-rw-r--r--docs/results/fuel-os-nosdn-kvm-ha.rst1521
-rw-r--r--docs/results/fuel-os-odl_l2-bgpvpn-ha.rst1254
-rw-r--r--docs/results/fuel-os-odl_l2-sfc-ha.rst1262
-rw-r--r--docs/userguide/index.rst17
-rw-r--r--docs/userguide/introduction.rst5
-rw-r--r--docs/userguide/runfunctest.rst10
-rw-r--r--docs/userguide/troubleshooting.rst6
9 files changed, 5036 insertions, 64 deletions
diff --git a/docs/release-notes/functest-release.rst b/docs/release-notes/functest-release.rst
index 0c1f61f74..65480a23a 100644
--- a/docs/release-notes/functest-release.rst
+++ b/docs/release-notes/functest-release.rst
@@ -1,6 +1,6 @@
-===========================================
-OPNFV Brahmaputra release note for Functest
-===========================================
+==============================================
+OPNFV Brahmaputra3.0 release note for Functest
+==============================================
Abstract
========
@@ -28,6 +28,9 @@ Version history
| 2016-02-25 | 1.0.0 | Morgan Richomme | Functest for B release |
| | | (Orange) | |
+------------+----------+------------------+------------------------+
+| 2016-04-27 | 3.0.0 | Morgan Richomme | Add scenarios |
+| | | (Orange) | |
++------------+----------+------------------+------------------------+
OPNFV Brahmaputra Release
=========================
@@ -50,6 +53,7 @@ The OPNFV projects integrated into Functest framework for automation are:
* Promise
* Doctor
* ONOSFW
+ * bgpvpn
Release Data
============
@@ -96,55 +100,39 @@ Version change
Feature evolution
-----------------
- - dockerization of Functest
-
- - renaming of vPing into vPing userdata
-
- - Tempest update, use custom list of test cases
-
- - Rally update, use global scenario
-
- - Update jenkins logs
-
- - support of the different scenarios
+ - support new scenarios
New features
------------
- - introduction of a new vPing test case vPing ssh
-
- - introduction of vIMS test case
+ - minor bug fixes (formating)
- - support of Promise
+ - Modification of the configuration to support vPing_userdata on ONOS scenario
- - support of Doctor
-
- - support of ONOSFW
-
- - scenario management system
-
- - creation of a Test collection API
-
- - creation of the Test dashboard: https://www.opnfv.org/opnfvtestgraphs/summary
-
- - creation of Functest dashboard: http://testresults.opnfv.org/dashboard/
+ - Use serial option in Tempest to improve success rate
Scenario Matrix
===============
-For Brahmaputra, Functest supports the following scenarios:
+For Brahmaputra 3.0, Functest was succesfully tested on the following scenarios:
+----------------+---------+---------+---------+---------+
| Scenario | Apex | Compass | Fuel | Joid |
+================+=========+=========+=========+=========+
| odl_l2 | X | X | X | X |
+----------------+---------+---------+---------+---------+
-| onos | | X | | |
+| onos | | X | X | |
+----------------+---------+---------+---------+---------+
| nosdn | | X | X | |
+----------------+---------+---------+---------+---------+
| ovs (dpdk) | | | X | |
+----------------+---------+---------+---------+---------+
+| kvm | | | X | |
++----------------+---------+---------+---------+---------+
+| bgpvpn | X | | X | |
++----------------+---------+---------+---------+---------+
+| sfc | | | X | |
++----------------+---------+---------+---------+---------+
Functest defines the success criteria when having at least 4 consecutive
successful runs of a given scenario from the Continuous Integration.
@@ -158,6 +146,7 @@ The success criteria is defined as follows:
* ODL success rate = 100%
* ONOSFW success rate = 100%
* Promise success rate = 100%
+ * Bgpvpn success rate = 100%
* vIMS: deployement of the orchestrator and the vIMS VNF successful
Other scenarios are currently available but did not meet success criteria for
@@ -167,19 +156,23 @@ release.
Brahmaputra limitations
-----------------------
-- Fuel and Apex Tempest success rate was below 90% but above 80%. Some of the
-error causes were identified (workers, lack of IP)
+- Fuel and Apex Tempest success rate was below 90% but above 80% on some
+scenarios. Some of the error causes were identified (workers, lack of IP)
- vIMS failed in CI for joid/odl_l2 scenario
- vPing userdata and vIMS excluded from onos scenario
-- None of the odl_l3 scenarios has been successful due to vPing ssh issue.
+- vPing_ssh and vIMS excluded from bgpvpn and kvm scenario
-- joid/nosdn successful but the complete scenario not run 4 times in a raw
+- None of the odl_l3 scenarios has been successful due to vPing ssh issue (ODL
+bug reported https://bugs.opendaylight.org/show_bug.cgi?id=5582)
- apex/nosdn never run (not a target scenario) but probably succesful
+- vPing SSH and vPing userdata no more run on CI since modification of bgpvpn
+configuration regex.
+
See known issues section for details
Test and installer/scenario dependencies
@@ -191,10 +184,9 @@ following table details the dependencies of the test cases per scenario.
+----------------+-------------+-------------+-------------+-------------+
| Test cases | Apex | Compass | Fuel | Joid |
+================+=============+=============+=============+=============+
-| vPing SSH | all | all | all | all |
+| vPing SSH | all | all | all | all |
+----------------+-------------+-------------+-------------+-------------+
-| vPing userdata | all except | all except | all except | all except |
-| | ONOS | ONOS | ONOS | ONOS |
+| vPing userdata | all | all | all | all |
+----------------+-------------+-------------+-------------+-------------+
| Tempest | all | all | all | all |
+----------------+-------------+-------------+-------------+-------------+
@@ -211,6 +203,8 @@ following table details the dependencies of the test cases per scenario.
+----------------+-------------+-------------+-------------+-------------+
| Doctor | all | no | no | no |
+----------------+-------------+-------------+-------------+-------------+
+| Bgpvpn | all | no | all | no |
++----------------+-------------+-------------+-------------+-------------+
Test results
============
@@ -226,18 +220,6 @@ Test results are available in:
Known issues
------------
- - nova metadata service not supported in ONOS:
-
- - it excludes vPing userdata and vIMS test cases
-
- - Rally worker issues:
-
- - A workaround has been implemented to run Tempest test cases sequentially
-
- - It may explain why Tempest scenarios (mainly on apex) do not run the 210 tests
-
- - https://bugs.launchpad.net/testrepository/+bug/1538941
-
- IPv6 issues in tempest suite:
- tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools
@@ -248,7 +230,7 @@ Known issues
- Lack of IP addresses available lead to several errors in different test cases
- - vIMS:
+ - vIMS (http://testresults.opnfv.org/reporting/vims/):
- the VM needs to have access to OpenStack API.
@@ -258,24 +240,27 @@ Known issues
- That is the reason why it fails on joid/odl_l2 scenario on Orange POD 2
+ - case needs to be consolidated on new scenaios (bgpvpn, sfc, ovs)
+
Open JIRA tickets
=================
+------------------+-----------------------------------------+
| JIRA | Description |
+==================+=========================================+
+| FUNCTEST-231 | vPing SSH no more run systematically |
+| | in CI |
++------------------+-----------------------------------------+
+| FUNCTEST-230 | Heat issues in Rally scenarios |
++------------------+-----------------------------------------+
+| FUNCTEST-229 | Extend reporting to brahmaputra |
++------------------+-----------------------------------------+
| FUNCTEST-139 | prepare_env failed due to |
| | https://pypi.python.org/samples is not |
| | accessible |
+------------------+-----------------------------------------+
-| FUNCTEST-137 | Tempest success rate below 90 on apex |
-+------------------+-----------------------------------------+
-| FUNCTEST-136 | Tempest success rate below 90 on fuel |
-+------------------+-----------------------------------------+
| FUNCTEST-135 | vPing scenario failed in odl_l3 scenario|
+------------------+-----------------------------------------+
-| FUNCTEST-124 | odl test suite troubleshooting |
-+------------------+-----------------------------------------+
Useful links
============
diff --git a/docs/results/apex-os-odl_l2-bgpvpn-ha.rst b/docs/results/apex-os-odl_l2-bgpvpn-ha.rst
new file mode 100644
index 000000000..ca6d0942b
--- /dev/null
+++ b/docs/results/apex-os-odl_l2-bgpvpn-ha.rst
@@ -0,0 +1,926 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
+.. http://creativecommons.org/licenses/by/4.0
+
+Detailed test results for apex-os-odl_l2-bgpvpn-ha
+-----------------------------------------------------
+
+VIM
+---
+
+vping_userdata
+^^^^^^^^^^^^^^
+
+::
+
+ FUNCTEST.info: Running vPing-userdata test...
+ vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
+ vPing_userdata- INFO - Creating neutron network vping-net...
+ vPing_userdata- INFO - Creating security group 'vPing-sg'...
+ vPing_userdata- INFO - Flavor found 'm1.small'
+ vPing_userdata- INFO - vPing Start Time:'2016-04-26 15:40:43'
+ vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
+ vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
+ vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
+ vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
+ vPing_userdata- INFO - Waiting for ping...
+ vPing_userdata- INFO - vPing detected!
+ vPing_userdata- INFO - vPing duration:'87.1'
+ vPing_userdata- INFO - vPing OK
+ vPing_userdata- INFO - Cleaning up...
+ vPing_userdata- INFO - Deleting network 'vping-net'...
+
+Tempest
+^^^^^^^
+::
+
+ FUNCTEST.info: Running Tempest tests...
+ run_tempest - INFO - Creating tenant and user for Tempest suite
+ INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
+ INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
+ run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
+ Total results of verification:
+
+ +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
+ | UUID | Deployment UUID | Set name | Tests | Failures | Created at | Status |
+ +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
+ | 97cda33b-5d92-46c5-8425-861d087d0d57 | 938a64f1-d650-497c-897d-8964906711fb | | 188 | 27 | 2016-04-26 15:42:30.384572 | finished |
+ +--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
+
+ Tests:
+
+ +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
+ | name | time | status |
+ +----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.643 | success |
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.048 | success |
+ | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 6.046 | success |
+ | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 6.507 | success |
+ | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 5.748 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.049 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.325 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.053 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.251 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.048 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.044 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.085 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.102 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.131 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.137 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.323 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.081 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.430 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.350 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.198 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.132 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.367 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 0.577 | success |
+ | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 1.641 | success |
+ | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 4.390 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 303.566 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.154 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.173 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 300.550 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.001 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 303.713 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.094 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.674 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 300.091 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.001 | success |
+ | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.043 | success |
+ | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 1.587 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.262 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.121 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.178 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.135 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.113 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.047 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.040 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.040 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.038 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.259 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.391 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.001 | skip |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.090 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.053 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.009 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.041 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.041 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.014 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.009 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.023 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.036 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.045 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.649 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.012 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.042 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.000 | skip |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 2.819 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 6.846 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 303.888 | fail |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.347 | skip |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 317.471 | fail |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 301.431 | fail |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 301.068 | fail |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 5.488 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.041 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.080 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.308 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.170 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.174 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.306 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.331 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.307 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 1.770 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 6.074 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 8.126 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 5.697 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 5.928 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 0.458 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 1.032 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 0.597 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 1.087 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 0.463 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 0.398 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 0.439 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.445 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.312 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 1.065 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.301 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.304 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.432 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.221 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 0.459 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.313 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 0.249 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.275 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 0.284 | success |
+ | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.125 | success |
+ | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.043 | success |
+ | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 323.768 | fail |
+ | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.055 | success |
+ | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.289 | success |
+ | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.052 | success |
+ | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.009 | success |
+ | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.238 | success |
+ | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.107 | success |
+ | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.214 | success |
+ | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.102 | success |
+ | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.382 | success |
+ | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.000 | fail |
+ | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.894 | success |
+ | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.129 | success |
+ | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.168 | success |
+ | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.172 | success |
+ | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 0.000 | fail |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.018 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.018 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.027 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.019 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.082 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.019 | success |
+ | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.091 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 0.630 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 1.296 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 2.890 | success |
+ | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 1.435 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.663 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 0.946 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 0.000 | fail |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.000 | fail |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.000 | fail |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.000 | fail |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.000 | fail |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.000 | fail |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 0.000 | fail |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 0.000 | fail |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 0.000 | fail |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.000 | fail |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.000 | fail |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 1.425 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 2.459 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 0.711 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.099 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.094 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 3.077 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 1.372 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 1.769 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 0.889 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 3.092 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 1.691 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 1.689 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 1.001 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 0.748 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 1.306 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.142 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 0.748 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 1.189 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.074 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.278 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 2.527 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.015 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.629 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.355 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.333 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.335 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.353 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.339 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 2.951 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.022 | success |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 303.959 | fail |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 302.043 | fail |
+ | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 1.600 | success |
+ | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 1.606 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 8.446 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 8.743 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 8.966 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 10.497 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.105 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.038 | success |
+ | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 134.544 | fail |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 333.942 | fail |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 336.063 | fail |
+ +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
+ run_tempest - INFO - Results: {'timestart': '2016-04-2615:42:30.384572', 'duration': 1497, 'tests': 188, 'failures': 27}
+ run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
+ run_tempest - INFO - Deleting tenant and user for Tempest suite)
+
+Rally
+^^^^^
+::
+
+ FUNCTEST.info: Running Rally benchmark suite...
+ run_rally - INFO - Starting test scenario "authenticate" ...
+
+ Preparing input task
+ Task ad742546-c147-4903-a31f-841de938dd68: started
+ Task ad742546-c147-4903-a31f-841de938dd68: finished
+
+ test scenario Authenticate.validate_glance
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_glance_2_times | 0.196 | 0.321 | 0.365 | 0.372 | 0.38 | 0.302 | 100.0% | 10 |
+ | total | 0.278 | 0.405 | 0.481 | 0.487 | 0.492 | 0.398 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.25959300995
+ Full duration: 4.72824001312
+
+ test scenario Authenticate.keystone
+ +--------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.keystone | 0.076 | 0.084 | 0.111 | 0.116 | 0.121 | 0.09 | 100.0% | 10 |
+ | total | 0.076 | 0.084 | 0.111 | 0.116 | 0.121 | 0.09 | 100.0% | 10 |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.271264076233
+ Full duration: 3.62738013268
+
+ test scenario Authenticate.validate_heat
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_heat_2_times | 0.175 | 0.197 | 0.249 | 0.254 | 0.258 | 0.207 | 100.0% | 10 |
+ | total | 0.254 | 0.297 | 0.383 | 0.398 | 0.413 | 0.316 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.942983865738
+ Full duration: 4.24797916412
+
+ test scenario Authenticate.validate_nova
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_nova_2_times | 0.119 | 0.158 | 0.214 | 0.226 | 0.237 | 0.164 | 100.0% | 10 |
+ | total | 0.206 | 0.255 | 0.317 | 0.323 | 0.329 | 0.261 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.78842997551
+ Full duration: 4.25593304634
+
+ test scenario Authenticate.validate_cinder
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_cinder_2_times | 0.119 | 0.189 | 0.375 | 0.376 | 0.378 | 0.229 | 100.0% | 10 |
+ | total | 0.2 | 0.333 | 0.46 | 0.479 | 0.499 | 0.336 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.973871946335
+ Full duration: 4.23989796638
+
+ test scenario Authenticate.validate_neutron
+ +------------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_neutron_2_times | 0.195 | 0.211 | 0.231 | 0.247 | 0.263 | 0.215 | 100.0% | 10 |
+ | total | 0.277 | 0.305 | 0.331 | 0.345 | 0.359 | 0.309 | 100.0% | 10 |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.916023015976
+ Full duration: 4.58919405937
+
+ 2016-04-26 17:13:30,899 - run_rally - INFO - Test scenario: "authenticate" OK.
+ 2016-04-26 17:13:30,899 - run_rally - INFO - Starting test scenario "glance" ...
+ 2016-04-26 17:15:24,362 - run_rally - INFO -
+ Preparing input task
+ Task 9f0a1a59-63ee-4c5c-83b4-fda6ca64d4d3: started
+ Task 9f0a1a59-63ee-4c5c-83b4-fda6ca64d4d3: finished
+
+ test scenario GlanceImages.list_images
+ +-----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.list_images | 0.265 | 0.322 | 0.356 | 0.383 | 0.411 | 0.319 | 100.0% | 10 |
+ | total | 0.265 | 0.322 | 0.356 | 0.383 | 0.411 | 0.319 | 100.0% | 10 |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.958132982254
+ Full duration: 5.75791287422
+
+ test scenario GlanceImages.create_image_and_boot_instances
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 3.814 | 4.56 | 5.238 | 5.417 | 5.597 | 4.572 | 100.0% | 10 |
+ | nova.boot_servers | 6.063 | 7.369 | 7.972 | 8.963 | 9.955 | 7.357 | 100.0% | 10 |
+ | total | 10.969 | 11.692 | 12.712 | 13.839 | 14.965 | 11.929 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 34.7748630047
+ Full duration: 56.4055418968
+
+ test scenario GlanceImages.create_and_list_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 3.733 | 4.173 | 4.872 | 4.909 | 4.946 | 4.299 | 100.0% | 10 |
+ | glance.list_images | 0.034 | 0.108 | 0.128 | 0.141 | 0.153 | 0.1 | 100.0% | 10 |
+ | total | 3.841 | 4.25 | 4.982 | 5.018 | 5.055 | 4.399 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 13.4400930405
+ Full duration: 21.2837600708
+
+ test scenario GlanceImages.create_and_delete_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 3.579 | 4.549 | 4.615 | 4.621 | 4.627 | 4.302 | 100.0% | 10 |
+ | glance.delete_image | 0.561 | 0.882 | 1.06 | 1.077 | 1.093 | 0.878 | 100.0% | 10 |
+ | total | 4.529 | 5.366 | 5.55 | 5.629 | 5.707 | 5.18 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 15.3838078976
+ Full duration: 20.4000329971
+
+ 2016-04-26 17:15:25,993 - run_rally - INFO - Test scenario: "glance" OK.
+ 2016-04-26 17:15:25,993 - run_rally - INFO - Starting test scenario "cinder" ...
+ 2016-04-26 17:30:47,609 - run_rally - INFO -
+ Preparing input task
+ Task 814c7265-77f0-4627-b851-4d6307469184: started
+ Task 814c7265-77f0-4627-b851-4d6307469184: finished
+
+ test scenario CinderVolumes.create_and_attach_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 3.253 | 3.8 | 5.748 | 5.876 | 6.003 | 4.299 | 100.0% | 10 |
+ | cinder.create_volume | 2.647 | 2.849 | 3.122 | 3.314 | 3.506 | 2.905 | 100.0% | 10 |
+ | nova.attach_volume | 2.828 | 2.941 | 3.024 | 3.139 | 3.253 | 2.956 | 100.0% | 10 |
+ | nova.detach_volume | 2.694 | 2.805 | 3.047 | 3.066 | 3.085 | 2.854 | 100.0% | 10 |
+ | cinder.delete_volume | 0.465 | 2.501 | 2.589 | 2.62 | 2.652 | 2.292 | 100.0% | 10 |
+ | nova.delete_server | 2.31 | 2.432 | 2.572 | 2.61 | 2.647 | 2.445 | 100.0% | 10 |
+ | total | 17.005 | 17.344 | 19.667 | 19.684 | 19.702 | 17.752 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 52.3380470276
+ Full duration: 62.1368570328
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 5.365 | 5.628 | 6.335 | 7.213 | 8.09 | 5.894 | 100.0% | 10 |
+ | cinder.list_volumes | 0.12 | 0.13 | 0.179 | 0.324 | 0.47 | 0.165 | 100.0% | 10 |
+ | total | 5.492 | 5.753 | 6.503 | 7.531 | 8.56 | 6.059 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 17.5699410439
+ Full duration: 32.550137043
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.66 | 2.948 | 3.145 | 3.171 | 3.197 | 2.939 | 100.0% | 10 |
+ | cinder.list_volumes | 0.039 | 0.124 | 0.137 | 0.145 | 0.153 | 0.12 | 100.0% | 10 |
+ | total | 2.765 | 3.073 | 3.28 | 3.3 | 3.32 | 3.059 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 8.95114684105
+ Full duration: 20.4319190979
+
+ test scenario CinderVolumes.create_and_list_snapshots
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 2.53 | 4.717 | 6.846 | 6.861 | 6.875 | 4.502 | 100.0% | 10 |
+ | cinder.list_snapshots | 0.017 | 0.106 | 0.12 | 0.135 | 0.15 | 0.094 | 100.0% | 10 |
+ | total | 2.68 | 4.789 | 6.9 | 6.926 | 6.953 | 4.596 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 12.3801140785
+ Full duration: 44.4814119339
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.72 | 2.87 | 2.984 | 3.001 | 3.018 | 2.88 | 100.0% | 10 |
+ | cinder.delete_volume | 2.327 | 2.533 | 2.641 | 2.663 | 2.685 | 2.526 | 100.0% | 10 |
+ | total | 5.148 | 5.386 | 5.625 | 5.664 | 5.703 | 5.406 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 16.1617929935
+ Full duration: 23.7529392242
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 5.261 | 5.487 | 5.686 | 5.742 | 5.797 | 5.493 | 100.0% | 10 |
+ | cinder.delete_volume | 2.393 | 2.591 | 2.671 | 2.776 | 2.881 | 2.572 | 100.0% | 10 |
+ | total | 7.72 | 8.0 | 8.304 | 8.491 | 8.679 | 8.065 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 23.9920217991
+ Full duration: 31.16101408
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.683 | 2.83 | 2.958 | 3.031 | 3.105 | 2.838 | 100.0% | 10 |
+ | cinder.delete_volume | 2.446 | 2.601 | 2.755 | 2.757 | 2.759 | 2.621 | 100.0% | 10 |
+ | total | 5.209 | 5.463 | 5.632 | 5.673 | 5.715 | 5.459 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 16.2941839695
+ Full duration: 23.1591808796
+
+ test scenario CinderVolumes.create_and_upload_volume_to_image
+ +----------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.705 | 3.234 | 5.839 | 6.009 | 6.178 | 4.101 | 100.0% | 10 |
+ | cinder.upload_volume_to_image | 25.866 | 34.579 | 36.121 | 36.966 | 37.811 | 33.004 | 100.0% | 10 |
+ | cinder.delete_volume | 2.425 | 2.516 | 2.859 | 3.79 | 4.722 | 2.741 | 100.0% | 10 |
+ | nova.delete_image | 1.063 | 1.781 | 2.315 | 2.368 | 2.421 | 1.768 | 100.0% | 10 |
+ | total | 33.42 | 42.477 | 46.051 | 46.561 | 47.071 | 41.614 | 100.0% | 10 |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 122.33260107
+ Full duration: 130.417927027
+
+ test scenario CinderVolumes.create_and_delete_snapshot
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 2.619 | 4.753 | 5.128 | 5.998 | 6.868 | 4.741 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.341 | 4.464 | 4.614 | 4.628 | 4.642 | 3.881 | 100.0% | 10 |
+ | total | 5.069 | 9.108 | 9.651 | 10.58 | 11.51 | 8.622 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 23.5147559643
+ Full duration: 42.4243760109
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.687 | 2.862 | 5.341 | 5.342 | 5.342 | 3.334 | 100.0% | 10 |
+ | total | 2.687 | 2.862 | 5.341 | 5.342 | 5.343 | 3.335 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 8.59894013405
+ Full duration: 18.9968831539
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.891 | 3.117 | 5.147 | 5.186 | 5.225 | 3.853 | 100.0% | 10 |
+ | total | 2.892 | 3.118 | 5.147 | 5.186 | 5.225 | 3.853 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 11.1855640411
+ Full duration: 23.8357381821
+
+ test scenario CinderVolumes.list_volumes
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.list_volumes | 0.23 | 0.276 | 0.313 | 0.333 | 0.353 | 0.281 | 100.0% | 10 |
+ | total | 0.23 | 0.276 | 0.313 | 0.333 | 0.354 | 0.281 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.832192182541
+ Full duration: 49.1499869823
+
+ test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.745 | 3.988 | 5.311 | 5.419 | 5.527 | 4.036 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.448 | 3.519 | 4.951 | 5.828 | 6.704 | 3.762 | 100.0% | 10 |
+ | nova.attach_volume | 2.902 | 4.661 | 5.677 | 6.517 | 7.356 | 4.515 | 100.0% | 10 |
+ | nova.detach_volume | 2.665 | 3.03 | 5.013 | 5.036 | 5.058 | 3.398 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.347 | 2.526 | 4.474 | 4.544 | 4.615 | 3.094 | 100.0% | 10 |
+ | cinder.delete_volume | 2.357 | 2.512 | 2.616 | 2.622 | 2.629 | 2.497 | 100.0% | 10 |
+ | total | 16.23 | 22.038 | 24.243 | 25.404 | 26.565 | 21.659 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 61.302448988
+ Full duration: 101.445744038
+
+ test scenario CinderVolumes.create_from_volume_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.012 | 5.284 | 7.846 | 8.73 | 9.613 | 5.488 | 100.0% | 10 |
+ | cinder.delete_volume | 2.465 | 4.731 | 6.986 | 7.116 | 7.247 | 4.39 | 100.0% | 10 |
+ | total | 5.537 | 10.039 | 14.516 | 14.707 | 14.898 | 9.877 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 25.7450320721
+ Full duration: 44.7656638622
+
+ test scenario CinderVolumes.create_and_extend_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.809 | 2.87 | 3.171 | 3.173 | 3.174 | 2.925 | 100.0% | 10 |
+ | cinder.extend_volume | 2.68 | 2.828 | 5.155 | 5.156 | 5.157 | 3.67 | 100.0% | 10 |
+ | cinder.delete_volume | 2.351 | 2.533 | 2.633 | 2.64 | 2.648 | 2.537 | 100.0% | 10 |
+ | total | 8.073 | 8.443 | 10.604 | 10.657 | 10.711 | 9.133 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 26.884996891
+ Full duration: 34.1721270084
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.775 | 2.863 | 2.974 | 3.062 | 3.151 | 2.888 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.383 | 3.589 | 6.958 | 7.815 | 8.672 | 4.208 | 100.0% | 10 |
+ | nova.attach_volume | 2.875 | 3.242 | 5.488 | 6.395 | 7.302 | 4.124 | 100.0% | 10 |
+ | nova.detach_volume | 2.665 | 2.896 | 3.035 | 3.047 | 3.059 | 2.879 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.154 | 2.468 | 2.771 | 3.49 | 4.209 | 2.6 | 100.0% | 10 |
+ | cinder.delete_volume | 0.443 | 2.52 | 2.652 | 2.664 | 2.677 | 2.341 | 100.0% | 10 |
+ | total | 16.386 | 19.141 | 21.529 | 23.357 | 25.184 | 19.466 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 56.0006937981
+ Full duration: 103.148792982
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 2.734 | 2.837 | 2.972 | 2.98 | 2.987 | 2.853 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.361 | 4.585 | 7.125 | 7.96 | 8.794 | 4.799 | 100.0% | 10 |
+ | nova.attach_volume | 2.861 | 3.062 | 5.2 | 5.255 | 5.311 | 3.579 | 100.0% | 10 |
+ | nova.detach_volume | 2.776 | 2.919 | 3.111 | 3.147 | 3.183 | 2.942 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.381 | 3.48 | 6.541 | 6.595 | 6.649 | 3.908 | 100.0% | 10 |
+ | cinder.delete_volume | 2.273 | 2.579 | 4.795 | 5.881 | 6.967 | 3.176 | 100.0% | 10 |
+ | total | 16.565 | 23.291 | 23.896 | 24.12 | 24.344 | 21.919 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 62.6618189812
+ Full duration: 108.85529089
+
+SDN Controller
+--------------
+
+ODL
+^^^
+::
+
+ FUNCTEST.info: Running ODL test...
+ ==============================================================================
+ Basic
+ ==============================================================================
+ Basic.010 Restconf OK :: Test suite to verify Restconf is OK
+ ==============================================================================
+ Get Controller Modules :: Get the controller modules via Restconf | PASS |
+ ------------------------------------------------------------------------------
+ Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
+ 1 critical test, 1 passed, 0 failed
+ 1 test total, 1 passed, 0 failed
+ ==============================================================================
+ Basic | PASS |
+ 1 critical test, 1 passed, 0 failed
+ 1 test total, 1 passed, 0 failed
+ ==============================================================================
+ Output: /home/opnfv/output.xml
+ Log: /home/opnfv/log.html
+ Report: /home/opnfv/report.html
+ ==============================================================================
+ Neutron :: Test suite for Neutron Plugin
+ ==============================================================================
+ Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
+ ==============================================================================
+ Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
+ ------------------------------------------------------------------------------
+ Create Network :: Create new network in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Network :: Check Network created in OpenDaylight | FAIL |
+ 404 != 200
+ ------------------------------------------------------------------------------
+ Neutron.Networks :: Checking Network created in OpenStack are push... | FAIL |
+ 4 critical tests, 3 passed, 1 failed
+ 4 tests total, 3 passed, 1 failed
+ ==============================================================================
+ Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
+ ==============================================================================
+ Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
+ ------------------------------------------------------------------------------
+ Create New subnet :: Create new subnet in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New subnet :: Check new subnet created in OpenDaylight | FAIL |
+ 404 != 200
+ ------------------------------------------------------------------------------
+ Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | FAIL |
+ 4 critical tests, 3 passed, 1 failed
+ 4 tests total, 3 passed, 1 failed
+ ==============================================================================
+ Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
+ ==============================================================================
+ Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
+ ------------------------------------------------------------------------------
+ Create New Port :: Create new port in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New Port :: Check new subnet created in OpenDaylight | FAIL |
+ 404 != 200
+ ------------------------------------------------------------------------------
+ Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | FAIL |
+ 4 critical tests, 3 passed, 1 failed
+ 4 tests total, 3 passed, 1 failed
+ ==============================================================================
+ Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
+ ==============================================================================
+ Delete New Port :: Delete previously created port in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
+ ==============================================================================
+ Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
+ ==============================================================================
+ Delete Network :: Delete network in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron :: Test suite for Neutron Plugin | FAIL |
+ 18 critical tests, 15 passed, 3 failed
+ 18 tests total, 15 passed, 3 failed
+ ==============================================================================
+ Output: /home/opnfv/output.xml
+ Log: /home/opnfv/log.html
+ Report: /home/opnfv/report.html
+ Log: /home/opnfv/log.html
+ Report: /home/opnfv/report.html
+
+Feature tests
+-------------
+
+vIMS
+^^^^
+
+::
+
+ FUNCTEST.info: Running vIMS test...
+ vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
+ vIMS - INFO - Update OpenStack creds informations
+ vIMS - INFO - Upload some OS images if it doesn't exist
+ vIMS - INFO - centos_7 image doesn't exist on glance repository.
+ Try downloading this image and upload on glance !
+ vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
+ Try downloading this image and upload on glance !
+ vIMS - INFO - Update security group quota for this tenant
+ vIMS - INFO - Update cinder quota for this tenant
+ vIMS - INFO - Collect flavor id for cloudify manager server
+ vIMS - INFO - Prepare virtualenv for cloudify-cli
+ vIMS - INFO - Downloading the cloudify manager server blueprint
+ vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 08:04:17'
+ vIMS - INFO - Writing the inputs file
+ vIMS - INFO - Launching the cloudify-manager deployment
+ vIMS - INFO - Cloudify-manager server is UP !
+ vIMS - INFO - Cloudify deployment duration:'495.7'
+ vIMS - INFO - Collect flavor id for all clearwater vm
+ vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 08:12:33'
+ vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
+ vIMS - INFO - Writing the inputs file
+ vIMS - INFO - Launching the clearwater deployment
+ vIMS - INFO - The deployment of clearwater-opnfv is ended
+ vIMS - INFO - vIMS VNF deployment duration:'759.1'
+ vIMS - INFO - vIMS functional test Start Time:'2016-02-23 08:28:17'
+ vIMS - INFO - vIMS functional test duration:'109.1'
+ vIMS - INFO - Launching the clearwater-opnfv undeployment
+ vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
+ vIMS - INFO - Launching the cloudify-manager undeployment
+ vIMS - INFO - Cloudify-manager server has been successfully removed!
+ vIMS - INFO - Removing vIMS tenant ..
+ vIMS - INFO - Removing vIMS user ..
+
+Doctor
+^^^^^^
+
+::
+
+ FUNCTEST.info: Running Doctor test...
+ doctor - DEBUG - Executing command : cd /home/opnfv/repos/doctor/tests && ./run.sh
+ doctor - DEBUG - + IMAGE_URL=https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img
+ Note: doctor/tests/run.sh has been executed.
+ PING 192.30.9.7 (192.30.9.7) 56(84) bytes of data.
+ 64 bytes from 192.30.9.7: icmp_seq=1 ttl=63 time=0.753 ms
+
+ --- 192.30.9.7 ping statistics ---
+ 1 packets transmitted, 1 received, 0% packet loss, time 0ms
+ rtt min/avg/max/mdev = 0.753/0.753/0.753/0.000 ms
+ preparing VM image...
+ +------------------+--------------------------------------+
+ | Property | Value |
+ +------------------+--------------------------------------+
+ | checksum | 7ca2842a166c276d49880998e4b397d5 |
+ | container_format | bare |
+ | created_at | 2016-04-26T17:07:58Z |
+ | disk_format | qcow2 |
+ | id | ccc11584-d901-4c83-9bbe-1e35b12f03ee |
+ | min_disk | 0 |
+ | min_ram | 0 |
+ | name | cirros |
+ | owner | 8f39920048ea444d9dedb35e601c1292 |
+ | protected | False |
+ | size | 15446 |
+ | status | active |
+ | tags | [] |
+ | updated_at | 2016-04-26T17:07:59Z |
+ | virtual_size | None |
+ | visibility | public |
+ +------------------+--------------------------------------+
+ starting doctor sample components...
+ creating VM and alarm...
+ +--------------------------------------+-----------------------------------------------+
+ | Property | Value |
+ +--------------------------------------+-----------------------------------------------+
+ | OS-DCF:diskConfig | MANUAL |
+ | OS-EXT-AZ:availability_zone | |
+ | OS-EXT-SRV-ATTR:host | - |
+ | OS-EXT-SRV-ATTR:hypervisor_hostname | - |
+ | OS-EXT-SRV-ATTR:instance_name | instance-00000048 |
+ | OS-EXT-STS:power_state | 0 |
+ | OS-EXT-STS:task_state | scheduling |
+ | OS-EXT-STS:vm_state | building |
+ | OS-SRV-USG:launched_at | - |
+ | OS-SRV-USG:terminated_at | - |
+ | accessIPv4 | |
+ | accessIPv6 | |
+ | adminPass | AaUNZaoqw74Q |
+ | config_drive | |
+ | created | 2016-04-26T17:08:01Z |
+ | flavor | m1.tiny (1) |
+ | hostId | |
+ | id | 1ab94214-1d8c-46b5-8467-3d3e3b602f04 |
+ | image | cirros (0074bf80-807e-4cb7-b904-bf4347c2a668) |
+ | key_name | - |
+ | metadata | {} |
+ | name | doctor_vm1 |
+ | os-extended-volumes:volumes_attached | [] |
+ | progress | 0 |
+ | security_groups | default |
+ | status | BUILD |
+ | tenant_id | 3d15a63c2519439f839df6785236b0e1 |
+ | updated | 2016-02-24T07:59:49Z |
+ | user_id | 0cfa3d72e33b490880278ff6676aa961 |
+ +--------------------------------------+-----------------------------------------------+
+
+ +---------------------------+----------------------------------------------------------------------+
+ | Property | Value |
+ +---------------------------+----------------------------------------------------------------------+
+ | alarm_actions | ["http://localhost:12346/failure"] |
+ | alarm_id | 739ca887-1a9d-4fb4-ad77-17793de1db16 |
+ | description | VM failure |
+ | enabled | True |
+ | event_type | compute.instance.update |
+ | insufficient_data_actions | [] |
+ | name | doctor_alarm1 |
+ | ok_actions | [] |
+ | project_id | 3d15a63c2519439f839df6785236b0e1 |
+ | query | [{"field": "traits.state", "type": "string", "value": "error", "op": |
+ | | "eq"}, {"field": "traits.instance_id", "type": "string", "value": |
+ | | "1ab94214-1d8c-46b5-8467-3d3e3b602f04", "op": "eq"}] |
+ | repeat_actions | False |
+ | severity | moderate |
+ | state | insufficient data |
+ | type | event |
+ | user_id | 0cfa3d72e33b490880278ff6676aa961 |
+ +---------------------------+----------------------------------------------------------------------+
+ waiting for vm launch...
+ injecting host failure...
+ disabling network of comupte host [overcloud-novacompute-0] for 3 mins...
+ Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
+ Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
+ 0 OK
+ done
+ cleanup...
+ 24120
+ 24124
+ 24122
+ 24144
+ Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
+ Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
+ Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
+ Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
+ 24125
+ 24136
+ + ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i instack_key heat-admin@192.30.9.7 '[ -e disable_network.log ] && cat disable_network.log'
+ Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
+ sudo ip link set enp8s0 down
+ <Response [200]>
+ Request to delete server doctor_vm1 has been accepted.
+ waiting disabled compute host back to be enabled...
+
+ doctor - INFO - doctor OK
+
+bgpvpn
+^^^^^^
+
+::
+
+ ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover} --load-list /tmp/tmpvjQxKe
+ {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn [0.191925s] ... ok
+ {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail [0.078978s] ... ok
+
+ ======
+ Totals
+ ======
+ Ran: 2 tests in 7.0000 sec.
+ - Passed: 2
+ - Skipped: 0
+ - Expected Fail: 0
+ - Unexpected Success: 0
+ - Failed: 0
+ Sum of execute time for each test: 0.2709 sec.
diff --git a/docs/results/fuel-os-nosdn-kvm-ha.rst b/docs/results/fuel-os-nosdn-kvm-ha.rst
new file mode 100644
index 000000000..1693ad578
--- /dev/null
+++ b/docs/results/fuel-os-nosdn-kvm-ha.rst
@@ -0,0 +1,1521 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
+.. http://creativecommons.org/licenses/by/4.0
+
+Detailed test results for fuel-os-nosdn-kvm-ha
+----------------------------------------------
+
+VIM
+---
+
+Tempest
+^^^^^^^
+::
+
+ +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
+ | name | time | status |
+ +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.37487 | success |
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.09209 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.94115 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 1.59631 | success |
+ | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 3.03178 | success |
+ | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 11.13795 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.07863 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00116 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.08504 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.00099 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 7.63607 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.06693 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.13367 | success |
+ | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_create | 0.0 | skip |
+ | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_get | 0.0 | skip |
+ | tempest.api.data_processing.test_cluster_templates.ClusterTemplateTest.test_cluster_template_list | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_create | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_get | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_external_hdfs_data_source_list | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_create | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_get | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_local_hdfs_data_source_list | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_create | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_get | 0.0 | skip |
+ | tempest.api.data_processing.test_data_sources.DataSourceTest.test_swift_data_source_list | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_create | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_get | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_internal_db_job_binary_list | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_job_binary_get_data | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_create | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_get | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binaries.JobBinaryTest.test_swift_job_binary_list | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_create | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_get | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_get_data | 0.0 | skip |
+ | tempest.api.data_processing.test_job_binary_internals.JobBinaryInternalTest.test_job_binary_internal_list | 0.0 | skip |
+ | tempest.api.data_processing.test_jobs.JobTest.test_job_create | 0.0 | skip |
+ | tempest.api.data_processing.test_jobs.JobTest.test_job_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_jobs.JobTest.test_job_get | 0.0 | skip |
+ | tempest.api.data_processing.test_jobs.JobTest.test_job_list | 0.0 | skip |
+ | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_create | 0.0 | skip |
+ | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_delete | 0.0 | skip |
+ | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_get | 0.0 | skip |
+ | tempest.api.data_processing.test_node_group_templates.NodeGroupTemplateTest.test_node_group_template_list | 0.0 | skip |
+ | tempest.api.data_processing.test_plugins.PluginsTest.test_plugin_get | 0.0 | skip |
+ | tempest.api.data_processing.test_plugins.PluginsTest.test_plugin_list | 0.0 | skip |
+ | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_compare_db_flavors_with_os | 0.0 | skip |
+ | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_get_db_flavor | 0.0 | skip |
+ | tempest.api.database.flavors.test_flavors.DatabaseFlavorsTest.test_list_db_flavors | 0.0 | skip |
+ | tempest.api.database.limits.test_limits.DatabaseLimitsTest.test_absolute_limits | 0.0 | skip |
+ | tempest.api.database.versions.test_versions.DatabaseVersionsTest.test_list_db_versions | 0.0 | skip |
+ | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.57347 | success |
+ | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.17627 | success |
+ | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.33315 | success |
+ | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.08263 | success |
+ | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.82181 | success |
+ | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.42812 | success |
+ | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 1.89984 | success |
+ | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.33804 | success |
+ | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.26122 | success |
+ | tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list | 0.43116 | success |
+ | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.40022 | success |
+ | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 1.70626 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.07075 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.06209 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.06225 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.08494 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.04772 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.05578 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.27065 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 2.38206 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 2.46710 | success |
+ | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 2.88813 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.91435 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 1.63719 | success |
+ | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network | 1.30351 | success |
+ | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port | 1.98554 | success |
+ | tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet | 3.09141 | success |
+ | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network | 1.40844 | success |
+ | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port | 1.67281 | success |
+ | tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet | 2.34230 | success |
+ | tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet | 1.77383 | success |
+ | tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility | 0.27369 | success |
+ | tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks | 0.21206 | success |
+ | tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets | 0.05304 | success |
+ | tempest.api.network.test_networks.NetworksIpV6Test.test_show_network | 0.03923 | success |
+ | tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet | 0.21345 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 1.96905 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.41775 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.04545 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.03878 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.03483 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.19582 | success |
+ | tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet | 1.74789 | success |
+ | tempest.api.network.test_networks.NetworksTest.test_external_network_visibility | 0.23307 | success |
+ | tempest.api.network.test_networks.NetworksTest.test_list_networks | 0.05593 | success |
+ | tempest.api.network.test_networks.NetworksTest.test_list_subnets | 0.03420 | success |
+ | tempest.api.network.test_networks.NetworksTest.test_show_network | 0.22495 | success |
+ | tempest.api.network.test_networks.NetworksTest.test_show_subnet | 0.04874 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 1.87449 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 1.73660 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.47535 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.07632 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.22105 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 1.88100 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 2.43974 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 0.73850 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.23058 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.22952 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 4.10475 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 2.05694 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 1.35753 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 1.43959 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 3.83507 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 2.17349 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 1.93067 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 1.12709 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.29264 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 1.59275 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.03756 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 1.57130 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 1.52547 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.05488 | success |
+ | tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools | 1.47037 | success |
+ | tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota | 0.0 | fail |
+ | tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object | 0.0 | fail |
+ | tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata | 0.0 | fail |
+ | tempest.api.object_storage.test_account_services.AccountTest.test_list_containers | 0.0 | fail |
+ | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object | 0.32095 | fail |
+ | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects | 0.02198 | fail |
+ | tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object | 0.01216 | fail |
+ | tempest.api.object_storage.test_container_services.ContainerTest.test_create_container | 0.36258 | fail |
+ | tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents | 0.01330 | fail |
+ | tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata | 0.01521 | fail |
+ | tempest.api.object_storage.test_object_services.ObjectTest.test_create_object | 0.0 | fail |
+ | tempest.api.object_storage.test_object_services.ObjectTest.test_get_object | 0.0 | fail |
+ | tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata | 0.0 | fail |
+ | tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata | 0.0 | fail |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.40358 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 4.40282 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.04414 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.05533 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.48932 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.49844 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.49092 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.60408 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.63262 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 2.74910 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.04588 | success |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 5.96533 | success |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 2.93564 | success |
+ | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.06137 | success |
+ | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.08282 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 7.85484 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 13.98156 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 7.31661 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 14.01416 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.06604 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.25951 | success |
+ | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 49.36369 | success |
+ | tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops | 25.33085 | success |
+ | tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes | 0.0 | skip |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 103.45858 | success |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 76.91454 | success |
+ +---------------------------------------------------------------------------------------------------------------------------+-----------+---------+
+ 2016-04-26 01:22:55,788 - run_tempest - INFO - Results: {'timestart': '2016-04-2601:09:10.555191', 'duration': 824, 'tests': 171, 'failures': 14}
+
+Rally
+^^^^^
+::
+
+ FUNCTEST.info: Running Rally benchmark suite...
+ 2016-04-26 01:24:50,982 - run_rally - INFO - Starting test scenario "authenticate" ...
+ 2016-04-26 01:25:56,731 - run_rally - INFO -
+ Preparing input task
+ Task 8204ef26-e392-473b-b607-fe79c30f3c6c: started
+ Task 8204ef26-e392-473b-b607-fe79c30f3c6c: finished
+
+ test scenario Authenticate.validate_glance
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_glance_2_times | 0.823 | 0.883 | 0.951 | 0.954 | 0.957 | 0.885 | 100.0% | 10 |
+ | total | 1.01 | 1.089 | 1.144 | 1.158 | 1.172 | 1.085 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 3.33679389954
+ Full duration: 10.0142049789
+
+ test scenario Authenticate.keystone
+ +--------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.keystone | 0.173 | 0.191 | 0.195 | 0.201 | 0.206 | 0.189 | 100.0% | 10 |
+ | total | 0.173 | 0.191 | 0.195 | 0.201 | 0.206 | 0.189 | 100.0% | 10 |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.59915304184
+ Full duration: 6.89671802521
+
+ test scenario Authenticate.validate_heat
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_heat_2_times | 0.436 | 0.468 | 0.496 | 0.499 | 0.502 | 0.47 | 100.0% | 10 |
+ | total | 0.637 | 0.668 | 0.704 | 0.705 | 0.707 | 0.671 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.02648496628
+ Full duration: 8.63242101669
+
+ test scenario Authenticate.validate_nova
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_nova_2_times | 0.245 | 0.281 | 0.405 | 0.41 | 0.416 | 0.301 | 100.0% | 10 |
+ | total | 0.423 | 0.459 | 0.585 | 0.607 | 0.628 | 0.488 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.44381713867
+ Full duration: 8.15497398376
+
+ test scenario Authenticate.validate_cinder
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_cinder_2_times | 0.245 | 0.435 | 0.501 | 0.598 | 0.695 | 0.446 | 100.0% | 10 |
+ | total | 0.416 | 0.662 | 0.692 | 0.777 | 0.862 | 0.642 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.90059304237
+ Full duration: 8.63323712349
+
+ test scenario Authenticate.validate_neutron
+ +------------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_neutron_2_times | 0.312 | 0.491 | 0.599 | 0.608 | 0.617 | 0.493 | 100.0% | 10 |
+ | total | 0.512 | 0.69 | 0.788 | 0.798 | 0.808 | 0.69 | 100.0% | 10 |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.07425689697
+ Full duration: 8.5414249897
+
+ 2016-04-26 01:25:58,048 - run_rally - INFO - Test scenario: "authenticate" OK.
+
+ 2016-04-26 01:25:58,314 - run_rally - INFO - Starting test scenario "glance" ...
+ 2016-04-26 01:29:06,596 - run_rally - INFO -
+ Preparing input task
+ Task 4929df57-a129-42f5-bf1e-e1acf761f7dd: started
+ Task 4929df57-a129-42f5-bf1e-e1acf761f7dd: finished
+
+ test scenario GlanceImages.list_images
+ +-----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.list_images | 0.629 | 0.677 | 0.844 | 0.862 | 0.879 | 0.706 | 100.0% | 10 |
+ | total | 0.629 | 0.677 | 0.844 | 0.862 | 0.879 | 0.706 | 100.0% | 10 |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.06210279465
+ Full duration: 11.1119971275
+
+ test scenario GlanceImages.create_image_and_boot_instances
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 6.132 | 6.43 | 6.695 | 6.801 | 6.907 | 6.444 | 100.0% | 10 |
+ | nova.boot_servers | 12.665 | 13.469 | 14.176 | 14.374 | 14.573 | 13.486 | 100.0% | 10 |
+ | total | 19.057 | 19.947 | 20.84 | 20.94 | 21.039 | 19.931 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 58.8742520809
+ Full duration: 95.2440040112
+
+ test scenario GlanceImages.create_and_list_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 6.278 | 6.53 | 7.761 | 11.222 | 14.683 | 7.394 | 100.0% | 10 |
+ | glance.list_images | 0.299 | 0.472 | 0.515 | 0.522 | 0.529 | 0.462 | 100.0% | 10 |
+ | total | 6.752 | 7.034 | 8.227 | 11.691 | 15.154 | 7.856 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 22.2857620716
+ Full duration: 34.3181619644
+
+ test scenario GlanceImages.create_and_delete_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 6.137 | 6.554 | 6.898 | 6.924 | 6.95 | 6.58 | 100.0% | 10 |
+ | glance.delete_image | 1.285 | 1.713 | 1.917 | 1.962 | 2.006 | 1.713 | 100.0% | 10 |
+ | total | 7.602 | 8.362 | 8.696 | 8.748 | 8.799 | 8.292 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 25.0005450249
+ Full duration: 34.4151468277
+
+ 2016-04-26 01:29:07,930 - run_rally - INFO - Test scenario: "glance" OK.
+
+ 2016-04-26 01:29:08,087 - run_rally - INFO - Starting test scenario "cinder" ...
+ 2016-04-26 02:24:09,641 - run_rally - INFO - Percentage error: n/a, | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+
+ 2016-04-26 02:24:09,661 - run_rally - INFO - Percentage error: n/a, | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+
+ 2016-04-26 02:24:09,663 - run_rally - INFO - Percentage error: n/a, | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+
+ 2016-04-26 02:24:09,666 - run_rally - INFO - Percentage error: n/a, | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+
+ 2016-04-26 02:24:09,780 - run_rally - INFO -
+ Preparing input task
+ Task 3d8fb27f-5dfb-4a07-ad7d-cec99384404f: started
+ Task 3d8fb27f-5dfb-4a07-ad7d-cec99384404f: finished
+
+ test scenario CinderVolumes.create_and_attach_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | cinder.create_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.attach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.detach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 438.78555584
+ Full duration: 476.062150002
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 7.312 | 9.44 | 9.821 | 9.964 | 10.107 | 9.128 | 100.0% | 10 |
+ | cinder.list_volumes | 0.058 | 0.27 | 0.297 | 0.324 | 0.35 | 0.215 | 100.0% | 10 |
+ | total | 7.37 | 9.626 | 10.164 | 10.275 | 10.386 | 9.343 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 28.7357289791
+ Full duration: 47.5475459099
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.202 | 3.516 | 3.662 | 3.711 | 3.761 | 3.5 | 100.0% | 10 |
+ | cinder.list_volumes | 0.05 | 0.224 | 0.315 | 0.344 | 0.372 | 0.193 | 100.0% | 10 |
+ | total | 3.298 | 3.743 | 3.868 | 3.888 | 3.907 | 3.693 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 11.2217340469
+ Full duration: 27.984375
+
+ test scenario CinderVolumes.create_and_list_snapshots
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 2.92 | 3.143 | 4.9 | 4.966 | 5.032 | 3.472 | 100.0% | 10 |
+ | cinder.list_snapshots | 0.023 | 0.029 | 0.218 | 0.233 | 0.248 | 0.072 | 100.0% | 10 |
+ | total | 2.955 | 3.197 | 4.927 | 4.993 | 5.06 | 3.545 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 9.69527101517
+ Full duration: 42.2511930466
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.018 | 3.457 | 3.685 | 3.737 | 3.788 | 3.413 | 100.0% | 10 |
+ | cinder.delete_volume | 0.914 | 2.612 | 3.053 | 3.069 | 3.085 | 2.563 | 100.0% | 10 |
+ | total | 3.932 | 6.16 | 6.58 | 6.669 | 6.759 | 5.977 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 17.8796432018
+ Full duration: 31.8870809078
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 8.958 | 9.585 | 9.884 | 10.249 | 10.614 | 9.589 | 100.0% | 10 |
+ | cinder.delete_volume | 0.775 | 2.647 | 3.059 | 3.255 | 3.451 | 2.387 | 100.0% | 10 |
+ | total | 10.49 | 12.128 | 12.864 | 13.066 | 13.269 | 11.977 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 35.2168581486
+ Full duration: 50.825067997
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.192 | 3.607 | 4.26 | 4.265 | 4.27 | 3.682 | 100.0% | 10 |
+ | cinder.delete_volume | 2.551 | 2.625 | 3.0 | 3.039 | 3.079 | 2.731 | 100.0% | 10 |
+ | total | 5.766 | 6.169 | 7.217 | 7.239 | 7.262 | 6.413 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 19.1643960476
+ Full duration: 32.8357338905
+
+ test scenario CinderVolumes.create_and_upload_volume_to_image
+ +----------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.223 | 3.533 | 3.679 | 3.775 | 3.87 | 3.545 | 100.0% | 10 |
+ | cinder.upload_volume_to_image | 24.815 | 36.631 | 39.206 | 39.953 | 40.701 | 34.888 | 100.0% | 10 |
+ | cinder.delete_volume | 2.335 | 2.578 | 2.734 | 2.742 | 2.75 | 2.535 | 100.0% | 10 |
+ | nova.delete_image | 1.988 | 2.228 | 2.551 | 2.734 | 2.917 | 2.296 | 100.0% | 10 |
+ | total | 32.77 | 45.39 | 47.552 | 48.244 | 48.935 | 43.265 | 100.0% | 10 |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 124.777842999
+ Full duration: 139.828857899
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.281 | 3.509 | 3.788 | 3.8 | 3.812 | 3.517 | 100.0% | 10 |
+ | total | 3.281 | 3.509 | 3.788 | 3.8 | 3.813 | 3.517 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 10.4726939201
+ Full duration: 25.0890491009
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.219 | 3.547 | 3.845 | 3.858 | 3.872 | 3.556 | 100.0% | 10 |
+ | total | 3.22 | 3.548 | 3.845 | 3.858 | 3.872 | 3.556 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 10.6221859455
+ Full duration: 28.0074269772
+
+ test scenario CinderVolumes.list_volumes
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.list_volumes | 0.459 | 0.521 | 0.574 | 0.58 | 0.585 | 0.523 | 100.0% | 10 |
+ | total | 0.459 | 0.521 | 0.574 | 0.58 | 0.586 | 0.523 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.56029701233
+ Full duration: 54.4247999191
+
+ test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | cinder.create_snapshot | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.attach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.detach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 428.079464197
+ Full duration: 524.52899909
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | cinder.create_snapshot | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.attach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.detach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 423.273214102
+ Full duration: 1129.47603798
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | cinder.create_snapshot | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.attach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | nova.detach_volume | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 5 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 426.579771996
+ Full duration: 529.032740116
+
+ test scenario CinderVolumes.create_and_delete_snapshot
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 2.8 | 2.961 | 3.287 | 4.217 | 5.148 | 3.157 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.364 | 2.643 | 2.86 | 2.881 | 2.902 | 2.611 | 100.0% | 10 |
+ | total | 5.173 | 5.494 | 6.148 | 7.099 | 8.05 | 5.769 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 16.4653530121
+ Full duration: 44.3639709949
+
+ test scenario CinderVolumes.create_and_extend_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.119 | 3.685 | 4.169 | 4.22 | 4.27 | 3.741 | 100.0% | 10 |
+ | cinder.extend_volume | 2.536 | 3.106 | 3.175 | 3.189 | 3.203 | 3.023 | 100.0% | 10 |
+ | cinder.delete_volume | 2.42 | 2.895 | 3.05 | 3.068 | 3.087 | 2.822 | 100.0% | 10 |
+ | total | 8.68 | 9.571 | 10.355 | 10.358 | 10.362 | 9.586 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 28.6492631435
+ Full duration: 42.1216299534
+
+ test scenario CinderVolumes.create_from_volume_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.108 | 3.632 | 3.846 | 3.968 | 4.089 | 3.621 | 100.0% | 10 |
+ | cinder.delete_volume | 2.54 | 2.847 | 3.276 | 3.29 | 3.304 | 2.881 | 100.0% | 10 |
+ | total | 6.172 | 6.512 | 6.734 | 6.756 | 6.778 | 6.502 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 19.1909890175
+ Full duration: 46.976804018
+
+ 2016-04-26 02:24:11,068 - run_rally - INFO - Test scenario: "cinder" Failed.
+
+ 2016-04-26 02:24:12,074 - run_rally - INFO - Starting test scenario "heat" ...
+ 2016-04-26 04:42:36,239 - run_rally - INFO - Percentage error: n/a, | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 6 |
+
+ 2016-04-26 04:42:36,363 - run_rally - INFO -
+ Preparing input task
+ Task e9e698b5-79f5-41a7-be5f-04761a3c0034: started
+ Task e9e698b5-79f5-41a7-be5f-04761a3c0034: finished
+
+ test scenario HeatStacks.create_suspend_resume_delete_stack
+ +-----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.62 | 3.722 | 4.104 | 4.115 | 4.126 | 3.846 | 100.0% | 10 |
+ | heat.suspend_stack | 1.392 | 1.475 | 1.609 | 1.616 | 1.623 | 1.493 | 100.0% | 10 |
+ | heat.resume_stack | 1.339 | 1.369 | 1.514 | 1.533 | 1.553 | 1.406 | 100.0% | 10 |
+ | heat.delete_stack | 1.283 | 1.429 | 1.447 | 1.461 | 1.474 | 1.382 | 100.0% | 10 |
+ | total | 7.77 | 8.014 | 8.597 | 8.614 | 8.631 | 8.127 | 100.0% | 10 |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 24.2256169319
+ Full duration: 33.6042699814
+
+ test scenario HeatStacks.create_and_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.528 | 3.756 | 3.905 | 3.933 | 3.961 | 3.764 | 100.0% | 10 |
+ | heat.delete_stack | 1.311 | 1.341 | 1.386 | 1.503 | 1.62 | 1.366 | 100.0% | 10 |
+ | total | 5.037 | 5.102 | 5.246 | 5.271 | 5.296 | 5.13 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 15.2723751068
+ Full duration: 24.6334218979
+
+ test scenario HeatStacks.create_and_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 20.555 | 22.623 | 23.694 | 23.77 | 23.845 | 22.663 | 100.0% | 10 |
+ | heat.delete_stack | 9.082 | 10.25 | 10.461 | 10.929 | 11.397 | 9.938 | 100.0% | 10 |
+ | total | 29.655 | 32.918 | 33.982 | 33.989 | 33.997 | 32.602 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 97.7232019901
+ Full duration: 107.206387043
+
+ test scenario HeatStacks.create_and_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 6 |
+ | heat.delete_stack | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 6 |
+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 6 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 7201.48637915
+ Full duration: 7812.01388121
+
+ test scenario HeatStacks.list_stacks_and_resources
+ +------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.list_stacks | 0.371 | 0.401 | 0.42 | 0.421 | 0.423 | 0.4 | 100.0% | 10 |
+ | heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
+ | total | 0.371 | 0.401 | 0.42 | 0.422 | 0.423 | 0.4 | 100.0% | 10 |
+ +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.24707102776
+ Full duration: 7.24165606499
+
+ test scenario HeatStacks.create_update_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.41 | 3.442 | 3.472 | 3.481 | 3.49 | 3.444 | 100.0% | 10 |
+ | heat.update_stack | 3.427 | 3.453 | 3.509 | 3.599 | 3.69 | 3.475 | 100.0% | 10 |
+ | heat.delete_stack | 1.295 | 1.311 | 1.326 | 1.329 | 1.332 | 1.312 | 100.0% | 10 |
+ | total | 8.162 | 8.205 | 8.277 | 8.357 | 8.436 | 8.231 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 24.6856651306
+ Full duration: 32.1383240223
+
+ test scenario HeatStacks.create_update_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.326 | 3.417 | 3.624 | 3.676 | 3.728 | 3.459 | 100.0% | 10 |
+ | heat.update_stack | 3.408 | 3.52 | 3.811 | 3.819 | 3.828 | 3.573 | 100.0% | 10 |
+ | heat.delete_stack | 1.276 | 1.302 | 1.335 | 1.398 | 1.46 | 1.317 | 100.0% | 10 |
+ | total | 8.14 | 8.309 | 8.56 | 8.596 | 8.632 | 8.349 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 25.028924942
+ Full duration: 32.9079070091
+
+ test scenario HeatStacks.create_update_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.527 | 4.137 | 4.746 | 4.747 | 4.748 | 4.133 | 100.0% | 10 |
+ | heat.update_stack | 5.668 | 5.712 | 5.744 | 5.767 | 5.789 | 5.712 | 100.0% | 10 |
+ | heat.delete_stack | 2.413 | 2.431 | 2.441 | 2.446 | 2.451 | 2.431 | 100.0% | 10 |
+ | total | 11.652 | 12.305 | 12.891 | 12.9 | 12.909 | 12.276 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 37.3458311558
+ Full duration: 45.2056248188
+
+ test scenario HeatStacks.create_update_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 4.501 | 4.64 | 4.77 | 4.782 | 4.793 | 4.64 | 100.0% | 10 |
+ | heat.update_stack | 7.947 | 9.065 | 9.146 | 9.207 | 9.269 | 8.97 | 100.0% | 10 |
+ | heat.delete_stack | 2.4 | 2.442 | 2.645 | 3.133 | 3.62 | 2.563 | 100.0% | 10 |
+ | total | 14.999 | 16.132 | 16.488 | 16.984 | 17.479 | 16.174 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 49.7609598637
+ Full duration: 58.2143821716
+
+ test scenario HeatStacks.create_update_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.481 | 3.63 | 4.77 | 4.771 | 4.772 | 4.024 | 100.0% | 10 |
+ | heat.update_stack | 5.615 | 5.681 | 5.721 | 5.745 | 5.77 | 5.683 | 100.0% | 10 |
+ | heat.delete_stack | 2.4 | 2.433 | 2.467 | 2.492 | 2.516 | 2.438 | 100.0% | 10 |
+ | total | 11.536 | 11.803 | 12.864 | 12.933 | 13.001 | 12.145 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 36.3764190674
+ Full duration: 44.1169888973
+
+ test scenario HeatStacks.create_update_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.513 | 3.601 | 3.641 | 3.658 | 3.674 | 3.59 | 100.0% | 10 |
+ | heat.update_stack | 3.405 | 3.427 | 3.437 | 3.457 | 3.477 | 3.427 | 100.0% | 10 |
+ | heat.delete_stack | 1.298 | 1.326 | 1.353 | 1.356 | 1.358 | 1.328 | 100.0% | 10 |
+ | total | 8.251 | 8.353 | 8.412 | 8.416 | 8.42 | 8.345 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 25.0552000999
+ Full duration: 33.6825659275
+
+ test scenario HeatStacks.create_and_list_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.53 | 3.568 | 3.594 | 3.61 | 3.626 | 3.57 | 100.0% | 10 |
+ | heat.list_stacks | 0.047 | 0.073 | 0.102 | 0.107 | 0.111 | 0.075 | 100.0% | 10 |
+ | total | 3.6 | 3.639 | 3.69 | 3.696 | 3.702 | 3.646 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 11.0165708065
+ Full duration: 22.4389858246
+
+ test scenario HeatStacks.create_check_delete_stack
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | heat.create_stack | 3.561 | 3.575 | 3.625 | 3.627 | 3.63 | 3.585 | 100.0% | 10 |
+ | heat.check_stack | 1.396 | 1.41 | 1.433 | 1.439 | 1.445 | 1.413 | 100.0% | 10 |
+ | heat.delete_stack | 1.266 | 1.309 | 1.32 | 1.323 | 1.327 | 1.302 | 100.0% | 10 |
+ | total | 6.234 | 6.289 | 6.339 | 6.347 | 6.355 | 6.3 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 18.943114996
+ Full duration: 27.5446438789
+
+ 2016-04-26 04:42:37,867 - run_rally - INFO - Test scenario: "heat" Failed.
+
+ 2016-04-26 04:42:38,263 - run_rally - INFO - Starting test scenario "keystone" ...
+ 2016-04-26 04:44:49,615 - run_rally - INFO -
+ Preparing input task
+ Task 20bc8dfd-1a51-488b-97df-c30ea71319be: started
+ Task 20bc8dfd-1a51-488b-97df-c30ea71319be: finished
+
+ test scenario KeystoneBasic.create_tenant_with_users
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_tenant | 0.27 | 0.29 | 0.299 | 0.303 | 0.308 | 0.289 | 100.0% | 10 |
+ | keystone.create_users | 1.059 | 1.132 | 1.206 | 1.212 | 1.218 | 1.138 | 100.0% | 10 |
+ | total | 1.348 | 1.431 | 1.504 | 1.507 | 1.51 | 1.427 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 4.29734396935
+ Full duration: 16.6833910942
+
+ test scenario KeystoneBasic.create_add_and_list_user_roles
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_role | 0.241 | 0.277 | 0.302 | 0.303 | 0.303 | 0.275 | 100.0% | 10 |
+ | keystone.add_role | 0.16 | 0.176 | 0.19 | 0.193 | 0.196 | 0.177 | 100.0% | 10 |
+ | keystone.list_roles | 0.085 | 0.095 | 0.1 | 0.104 | 0.108 | 0.095 | 100.0% | 10 |
+ | total | 0.501 | 0.55 | 0.583 | 0.589 | 0.595 | 0.547 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.68035697937
+ Full duration: 10.5181751251
+
+ test scenario KeystoneBasic.add_and_remove_user_role
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_role | 0.267 | 0.289 | 0.32 | 0.322 | 0.324 | 0.294 | 100.0% | 10 |
+ | keystone.add_role | 0.148 | 0.172 | 0.194 | 0.195 | 0.196 | 0.172 | 100.0% | 10 |
+ | keystone.remove_role | 0.093 | 0.132 | 0.166 | 0.168 | 0.169 | 0.133 | 100.0% | 10 |
+ | total | 0.527 | 0.616 | 0.63 | 0.638 | 0.646 | 0.599 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.79448008537
+ Full duration: 10.6772811413
+
+ test scenario KeystoneBasic.create_update_and_delete_tenant
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_tenant | 0.277 | 0.31 | 0.398 | 0.421 | 0.443 | 0.33 | 100.0% | 10 |
+ | keystone.update_tenant | 0.083 | 0.097 | 0.116 | 0.117 | 0.118 | 0.1 | 100.0% | 10 |
+ | keystone.delete_tenant | 0.198 | 0.236 | 0.247 | 0.249 | 0.251 | 0.232 | 100.0% | 10 |
+ | total | 0.598 | 0.643 | 0.731 | 0.761 | 0.791 | 0.662 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.00753998756
+ Full duration: 9.88667607307
+
+ test scenario KeystoneBasic.create_and_delete_service
+ +----------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_service | 0.276 | 0.302 | 0.313 | 0.344 | 0.374 | 0.305 | 100.0% | 10 |
+ | keystone.delete_service | 0.092 | 0.105 | 0.118 | 0.118 | 0.119 | 0.106 | 100.0% | 10 |
+ | total | 0.369 | 0.41 | 0.421 | 0.444 | 0.467 | 0.411 | 100.0% | 10 |
+ +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.31590604782
+ Full duration: 9.7633960247
+
+ test scenario KeystoneBasic.create_tenant
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_tenant | 0.283 | 0.314 | 0.348 | 0.359 | 0.371 | 0.32 | 100.0% | 10 |
+ | total | 0.283 | 0.315 | 0.348 | 0.36 | 0.371 | 0.32 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.971438169479
+ Full duration: 6.68577694893
+
+ test scenario KeystoneBasic.create_user
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_user | 0.308 | 0.325 | 0.341 | 0.345 | 0.349 | 0.326 | 100.0% | 10 |
+ | total | 0.308 | 0.326 | 0.341 | 0.345 | 0.349 | 0.326 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.01120591164
+ Full duration: 6.84676504135
+
+ test scenario KeystoneBasic.create_and_list_tenants
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_tenant | 0.26 | 0.276 | 0.295 | 0.297 | 0.3 | 0.277 | 100.0% | 10 |
+ | keystone.list_tenants | 0.071 | 0.082 | 0.09 | 0.094 | 0.098 | 0.083 | 100.0% | 10 |
+ | total | 0.333 | 0.361 | 0.378 | 0.38 | 0.383 | 0.36 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.12287592888
+ Full duration: 9.86326503754
+
+ test scenario KeystoneBasic.create_and_delete_role
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_role | 0.285 | 0.323 | 0.381 | 0.382 | 0.382 | 0.33 | 100.0% | 10 |
+ | keystone.delete_role | 0.167 | 0.191 | 0.225 | 0.226 | 0.228 | 0.194 | 100.0% | 10 |
+ | total | 0.47 | 0.513 | 0.582 | 0.595 | 0.609 | 0.524 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.57796812057
+ Full duration: 9.51138591766
+
+ test scenario KeystoneBasic.get_entities
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_tenant | 0.282 | 0.31 | 0.334 | 0.364 | 0.395 | 0.315 | 100.0% | 10 |
+ | keystone.create_user | 0.1 | 0.104 | 0.122 | 0.122 | 0.123 | 0.108 | 100.0% | 10 |
+ | keystone.create_role | 0.079 | 0.092 | 0.102 | 0.107 | 0.112 | 0.094 | 100.0% | 10 |
+ | keystone.get_tenant | 0.072 | 0.08 | 0.087 | 0.089 | 0.092 | 0.081 | 100.0% | 10 |
+ | keystone.get_user | 0.087 | 0.091 | 0.114 | 0.139 | 0.163 | 0.099 | 100.0% | 10 |
+ | keystone.get_role | 0.07 | 0.078 | 0.085 | 0.086 | 0.088 | 0.078 | 100.0% | 10 |
+ | keystone.service_list | 0.079 | 0.086 | 0.103 | 0.124 | 0.145 | 0.093 | 100.0% | 10 |
+ | keystone.get_service | 0.069 | 0.086 | 0.093 | 0.096 | 0.098 | 0.084 | 100.0% | 10 |
+ | total | 0.889 | 0.939 | 1.023 | 1.035 | 1.048 | 0.952 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.919891119
+ Full duration: 15.3317778111
+
+ test scenario KeystoneBasic.create_and_list_users
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | keystone.create_user | 0.287 | 0.314 | 0.336 | 0.345 | 0.354 | 0.316 | 100.0% | 10 |
+ | keystone.list_users | 0.072 | 0.081 | 0.096 | 0.097 | 0.097 | 0.083 | 100.0% | 10 |
+ | total | 0.365 | 0.393 | 0.424 | 0.431 | 0.437 | 0.399 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.23520803452
+ Full duration: 7.35707998276
+
+ 2016-04-26 04:44:50,952 - run_rally - INFO - Test scenario: "keystone" OK.
+
+ 2016-04-26 04:44:51,319 - run_rally - INFO - Starting test scenario "neutron" ...
+ 2016-04-26 04:51:16,265 - run_rally - INFO -
+ Preparing input task
+ Task 256bf66d-8312-4077-869b-394a1574c2e3: started
+ Task 256bf66d-8312-4077-869b-394a1574c2e3: finished
+
+ test scenario NeutronNetworks.create_and_delete_ports
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_port | 0.607 | 0.653 | 0.721 | 0.75 | 0.78 | 0.666 | 100.0% | 10 |
+ | neutron.delete_port | 0.175 | 0.407 | 0.455 | 0.462 | 0.469 | 0.37 | 100.0% | 10 |
+ | total | 0.814 | 1.09 | 1.137 | 1.137 | 1.137 | 1.036 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 3.12694001198
+ Full duration: 32.3510808945
+
+ test scenario NeutronNetworks.create_and_list_routers
+ +---------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_subnet | 0.578 | 0.606 | 0.635 | 0.643 | 0.65 | 0.609 | 100.0% | 10 |
+ | neutron.create_router | 0.06 | 0.256 | 0.307 | 0.341 | 0.376 | 0.237 | 100.0% | 10 |
+ | neutron.add_interface_router | 0.244 | 0.508 | 0.566 | 0.589 | 0.612 | 0.476 | 100.0% | 10 |
+ | neutron.list_routers | 0.04 | 0.238 | 0.271 | 0.275 | 0.278 | 0.194 | 100.0% | 10 |
+ | total | 1.169 | 1.517 | 1.722 | 1.742 | 1.762 | 1.517 | 100.0% | 10 |
+ +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 4.54089903831
+ Full duration: 35.4128360748
+
+ test scenario NeutronNetworks.create_and_update_networks
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_network | 0.523 | 0.561 | 0.635 | 0.642 | 0.648 | 0.573 | 100.0% | 10 |
+ | neutron.update_network | 0.106 | 0.337 | 0.376 | 0.391 | 0.406 | 0.303 | 100.0% | 10 |
+ | total | 0.691 | 0.877 | 1.006 | 1.007 | 1.008 | 0.876 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.54131317139
+ Full duration: 19.3984429836
+
+ test scenario NeutronNetworks.create_and_list_ports
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_port | 0.581 | 0.643 | 0.971 | 1.006 | 1.042 | 0.712 | 100.0% | 10 |
+ | neutron.list_ports | 0.102 | 0.365 | 0.455 | 0.469 | 0.483 | 0.307 | 100.0% | 10 |
+ | total | 0.725 | 1.086 | 1.149 | 1.292 | 1.435 | 1.019 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.83818507195
+ Full duration: 32.8225178719
+
+ test scenario NeutronNetworks.create_and_delete_subnets
+ +--------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_subnet | 0.571 | 0.62 | 0.673 | 0.682 | 0.69 | 0.626 | 100.0% | 10 |
+ | neutron.delete_subnet | 0.136 | 0.358 | 0.5 | 0.571 | 0.642 | 0.333 | 100.0% | 10 |
+ | total | 0.724 | 0.978 | 1.14 | 1.183 | 1.227 | 0.959 | 100.0% | 10 |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 3.04690408707
+ Full duration: 31.1584250927
+
+ test scenario NeutronNetworks.create_and_update_subnets
+ +--------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_subnet | 0.579 | 0.74 | 0.789 | 0.831 | 0.873 | 0.728 | 100.0% | 10 |
+ | neutron.update_subnet | 0.166 | 0.4 | 0.491 | 0.516 | 0.541 | 0.378 | 100.0% | 10 |
+ | total | 0.789 | 1.155 | 1.275 | 1.279 | 1.283 | 1.106 | 100.0% | 10 |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 3.20878195763
+ Full duration: 31.9853599072
+
+ test scenario NeutronNetworks.create_and_list_networks
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_network | 0.524 | 0.589 | 0.694 | 0.736 | 0.779 | 0.613 | 100.0% | 10 |
+ | neutron.list_networks | 0.046 | 0.171 | 0.409 | 0.461 | 0.513 | 0.211 | 100.0% | 10 |
+ | total | 0.58 | 0.747 | 1.083 | 1.09 | 1.096 | 0.824 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.37781405449
+ Full duration: 19.9551098347
+
+ test scenario NeutronNetworks.create_and_update_routers
+ +---------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_subnet | 0.592 | 0.623 | 0.664 | 0.665 | 0.667 | 0.628 | 100.0% | 10 |
+ | neutron.create_router | 0.269 | 0.279 | 0.31 | 0.32 | 0.329 | 0.287 | 100.0% | 10 |
+ | neutron.add_interface_router | 0.28 | 0.484 | 0.653 | 0.671 | 0.688 | 0.477 | 100.0% | 10 |
+ | neutron.update_router | 0.156 | 0.389 | 0.45 | 0.456 | 0.462 | 0.361 | 100.0% | 10 |
+ | total | 1.388 | 1.739 | 1.953 | 1.981 | 2.009 | 1.754 | 100.0% | 10 |
+ +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 5.26099705696
+ Full duration: 37.1857252121
+
+ test scenario NeutronNetworks.create_and_delete_routers
+ +------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_subnet | 0.558 | 0.624 | 0.707 | 0.736 | 0.765 | 0.637 | 100.0% | 10 |
+ | neutron.create_router | 0.044 | 0.288 | 0.341 | 0.362 | 0.383 | 0.253 | 100.0% | 10 |
+ | neutron.add_interface_router | 0.299 | 0.527 | 0.563 | 0.573 | 0.583 | 0.502 | 100.0% | 10 |
+ | neutron.remove_interface_router | 0.241 | 0.46 | 0.559 | 0.56 | 0.561 | 0.444 | 100.0% | 10 |
+ | neutron.delete_router | 0.15 | 0.392 | 0.469 | 0.487 | 0.505 | 0.343 | 100.0% | 10 |
+ | total | 1.845 | 2.118 | 2.453 | 2.507 | 2.56 | 2.179 | 100.0% | 10 |
+ +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 6.46906304359
+ Full duration: 37.6224770546
+
+ test scenario NeutronNetworks.create_and_update_ports
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_port | 0.605 | 0.665 | 0.825 | 0.85 | 0.876 | 0.691 | 100.0% | 10 |
+ | neutron.update_port | 0.126 | 0.359 | 0.409 | 0.423 | 0.437 | 0.325 | 100.0% | 10 |
+ | total | 0.731 | 1.054 | 1.179 | 1.192 | 1.205 | 1.017 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 3.16282176971
+ Full duration: 34.5440177917
+
+ test scenario NeutronNetworks.create_and_list_subnets
+ +--------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_subnet | 0.578 | 0.613 | 0.667 | 0.678 | 0.689 | 0.622 | 100.0% | 10 |
+ | neutron.list_subnets | 0.23 | 0.266 | 0.336 | 0.34 | 0.344 | 0.276 | 100.0% | 10 |
+ | total | 0.835 | 0.9 | 0.963 | 0.966 | 0.969 | 0.898 | 100.0% | 10 |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.74195313454
+ Full duration: 32.8288888931
+
+ test scenario NeutronNetworks.create_and_delete_networks
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | neutron.create_network | 0.525 | 0.612 | 0.729 | 0.735 | 0.74 | 0.626 | 100.0% | 10 |
+ | neutron.delete_network | 0.133 | 0.375 | 0.446 | 0.474 | 0.501 | 0.35 | 100.0% | 10 |
+ | total | 0.739 | 1.004 | 1.113 | 1.177 | 1.242 | 0.976 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.94529485703
+ Full duration: 19.0619311333
+
+ 2016-04-26 04:51:17,592 - run_rally - INFO - Test scenario: "neutron" OK.
+
+ 2016-04-26 04:51:18,073 - run_rally - INFO - Starting test scenario "nova" ...
+ 2016-04-26 07:03:18,875 - run_rally - INFO -
+ Preparing input task
+ Task a238f5f4-fd3d-4015-95c9-2b0ba5d314b6: started
+ Task a238f5f4-fd3d-4015-95c9-2b0ba5d314b6: finished
+
+ test scenario NovaKeypair.create_and_delete_keypair
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.create_keypair | 0.579 | 0.646 | 0.774 | 0.918 | 1.062 | 0.695 | 100.0% | 10 |
+ | nova.delete_keypair | 0.023 | 0.027 | 0.048 | 0.051 | 0.054 | 0.033 | 100.0% | 10 |
+ | total | 0.627 | 0.687 | 0.8 | 0.943 | 1.085 | 0.728 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.11327505112
+ Full duration: 24.7004601955
+
+ test scenario NovaServers.snapshot_server
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 9.939 | 11.728 | 13.031 | 13.319 | 13.606 | 11.722 | 100.0% | 10 |
+ | nova.create_image | 9.473 | 9.734 | 10.003 | 10.052 | 10.1 | 9.728 | 100.0% | 10 |
+ | nova.delete_server | 2.63 | 2.927 | 3.279 | 3.899 | 4.52 | 3.033 | 100.0% | 10 |
+ | nova.boot_server (2) | 9.986 | 10.959 | 11.567 | 11.737 | 11.907 | 10.921 | 100.0% | 10 |
+ | nova.delete_server (2) | 2.41 | 2.772 | 2.958 | 2.963 | 2.968 | 2.712 | 100.0% | 10 |
+ | nova.delete_image | 1.467 | 2.001 | 2.188 | 2.332 | 2.477 | 1.95 | 100.0% | 10 |
+ | total | 37.87 | 39.802 | 41.419 | 42.304 | 43.189 | 40.067 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 120.693696976
+ Full duration: 164.095020056
+
+ test scenario NovaKeypair.boot_and_delete_server_with_keypair
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.create_keypair | 0.515 | 0.637 | 0.702 | 0.714 | 0.726 | 0.631 | 100.0% | 10 |
+ | nova.boot_server | 10.03 | 11.695 | 12.539 | 12.808 | 13.076 | 11.597 | 100.0% | 10 |
+ | nova.delete_server | 2.581 | 2.755 | 2.899 | 3.003 | 3.108 | 2.769 | 100.0% | 10 |
+ | nova.delete_keypair | 0.026 | 0.036 | 0.044 | 0.044 | 0.045 | 0.036 | 100.0% | 10 |
+ | total | 13.194 | 15.135 | 15.888 | 16.111 | 16.334 | 15.033 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 43.7031610012
+ Full duration: 84.4934301376
+
+ test scenario NovaKeypair.create_and_list_keypairs
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.create_keypair | 0.613 | 0.68 | 0.8 | 0.83 | 0.859 | 0.701 | 100.0% | 10 |
+ | nova.list_keypairs | 0.017 | 0.029 | 0.055 | 0.132 | 0.209 | 0.045 | 100.0% | 10 |
+ | total | 0.631 | 0.715 | 0.893 | 0.919 | 0.945 | 0.746 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.10457396507
+ Full duration: 25.5227000713
+
+ test scenario NovaServers.list_servers
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.list_servers | 0.963 | 1.205 | 1.239 | 1.272 | 1.304 | 1.187 | 100.0% | 10 |
+ | total | 0.963 | 1.205 | 1.239 | 1.272 | 1.305 | 1.187 | 100.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 3.61515402794
+ Full duration: 89.3156220913
+
+ test scenario NovaServers.resize_server
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 11.077 | 11.648 | 13.586 | 13.788 | 13.99 | 12.144 | 100.0% | 10 |
+ | nova.resize | 97.438 | 98.364 | 99.784 | 101.736 | 103.687 | 98.895 | 100.0% | 10 |
+ | nova.resize_confirm | 2.462 | 2.85 | 3.013 | 3.032 | 3.052 | 2.81 | 100.0% | 10 |
+ | nova.delete_server | 2.362 | 2.635 | 2.717 | 2.759 | 2.802 | 2.576 | 100.0% | 10 |
+ | total | 114.396 | 116.205 | 117.751 | 119.281 | 120.811 | 116.425 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 352.596132994
+ Full duration: 373.961167812
+
+ test scenario NovaServers.boot_server_from_volume_and_delete
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 9.652 | 10.151 | 10.573 | 10.621 | 10.669 | 10.165 | 100.0% | 10 |
+ | nova.boot_server | 10.713 | 13.21 | 14.394 | 14.695 | 14.996 | 13.013 | 100.0% | 10 |
+ | nova.delete_server | 4.701 | 4.969 | 5.039 | 5.159 | 5.279 | 4.942 | 100.0% | 10 |
+ | total | 25.26 | 27.982 | 30.104 | 30.137 | 30.17 | 28.121 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 83.7665529251
+ Full duration: 133.76401782
+
+ test scenario NovaServers.boot_and_migrate_server
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 9.342 | 11.196 | 12.987 | 13.225 | 13.463 | 11.305 | 80.0% | 10 |
+ | nova.stop_server | 61.257 | 62.345 | 63.163 | 63.249 | 63.336 | 62.301 | 80.0% | 10 |
+ | nova.migrate | 8.224 | 9.522 | 11.336 | 11.478 | 11.62 | 9.663 | 80.0% | 10 |
+ | nova.resize_confirm | 2.413 | 2.724 | 3.003 | 3.108 | 3.213 | 2.704 | 100.0% | 8 |
+ | nova.delete_server | 2.397 | 2.418 | 2.638 | 2.652 | 2.666 | 2.495 | 100.0% | 8 |
+ | total | 85.3 | 88.008 | 91.856 | 92.68 | 93.504 | 88.469 | 80.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 282.145553112
+ Full duration: 310.275305033
+
+ test scenario NovaServers.boot_and_delete_server
+ +-----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 10.164 | 10.763 | 21.145 | 31.824 | 42.503 | 14.815 | 80.0% | 10 |
+ | nova.delete_server | 2.439 | 2.701 | 2.959 | 2.97 | 2.982 | 2.728 | 88.9% | 9 |
+ | total | 12.997 | 13.446 | 23.964 | 34.453 | 44.942 | 17.544 | 80.0% | 10 |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 352.537348986
+ Full duration: 997.781033993
+
+ test scenario NovaServers.boot_and_rebuild_server
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 10.618 | 11.665 | 12.726 | 12.764 | 12.802 | 11.718 | 70.0% | 10 |
+ | nova.rebuild_server | 69.264 | 71.18 | 72.314 | 72.575 | 72.836 | 71.097 | 100.0% | 7 |
+ | nova.delete_server | 2.391 | 2.632 | 2.88 | 2.883 | 2.886 | 2.639 | 100.0% | 7 |
+ | total | 83.337 | 85.019 | 87.645 | 87.923 | 88.201 | 85.454 | 70.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 477.006741047
+ Full duration: 1121.04293394
+
+ test scenario NovaSecGroup.create_and_list_secgroups
+ +-----------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.create_10_security_groups | 3.03 | 3.488 | 3.933 | 3.989 | 4.044 | 3.487 | 100.0% | 10 |
+ | nova.create_100_rules | 22.925 | 23.261 | 23.92 | 24.188 | 24.456 | 23.425 | 100.0% | 10 |
+ | nova.list_security_groups | 0.126 | 0.16 | 0.213 | 0.294 | 0.376 | 0.18 | 100.0% | 10 |
+ | total | 26.54 | 26.984 | 27.591 | 27.704 | 27.817 | 27.092 | 100.0% | 10 |
+ +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 81.6362090111
+ Full duration: 118.557869911
+
+ test scenario NovaSecGroup.create_and_delete_secgroups
+ +-----------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.create_10_security_groups | 2.934 | 3.533 | 3.804 | 3.912 | 4.021 | 3.522 | 100.0% | 10 |
+ | nova.create_100_rules | 22.89 | 23.403 | 23.74 | 23.847 | 23.953 | 23.394 | 100.0% | 10 |
+ | nova.delete_10_security_groups | 1.219 | 1.282 | 1.629 | 1.634 | 1.64 | 1.372 | 100.0% | 10 |
+ | total | 27.6 | 28.387 | 28.547 | 28.634 | 28.722 | 28.288 | 100.0% | 10 |
+ +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 85.2456521988
+ Full duration: 109.930608988
+
+ test scenario NovaServers.boot_and_bounce_server
+ +----------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 10.584 | 11.76 | 12.966 | 13.02 | 13.073 | 11.794 | 57.1% | 7 |
+ | nova.reboot_server | 4.802 | 5.11 | 5.257 | 5.278 | 5.299 | 5.08 | 100.0% | 4 |
+ | nova.soft_reboot_server | 123.97 | 124.161 | 125.321 | 125.531 | 125.741 | 124.508 | 100.0% | 4 |
+ | nova.stop_server | 61.413 | 62.307 | 63.351 | 63.532 | 63.713 | 62.435 | 100.0% | 4 |
+ | nova.start_server | 2.747 | 2.775 | 2.996 | 3.039 | 3.082 | 2.845 | 100.0% | 4 |
+ | nova.rescue_server | 64.447 | 66.021 | 66.521 | 66.564 | 66.607 | 65.774 | 100.0% | 4 |
+ | nova.unrescue_server | 2.368 | 4.579 | 4.599 | 4.6 | 4.601 | 4.032 | 100.0% | 4 |
+ | nova.delete_server | 2.398 | 2.511 | 2.663 | 2.679 | 2.694 | 2.528 | 100.0% | 4 |
+ | total | 274.414 | 278.786 | 282.788 | 283.426 | 284.064 | 279.013 | 57.1% | 7 |
+ +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 584.260617018
+ Full duration: 1223.11469412
+
+ test scenario NovaServers.boot_server
+ +---------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 11.343 | 11.648 | 12.248 | 12.342 | 12.435 | 11.804 | 55.6% | 9 |
+ | total | 11.344 | 11.648 | 12.249 | 12.342 | 12.435 | 11.804 | 55.6% | 9 |
+ +------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 339.613210917
+ Full duration: 959.207664013
+
+ test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+ +--------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.create_10_security_groups | 2.471 | 2.641 | 2.886 | 2.916 | 2.947 | 2.686 | 37.5% | 8 |
+ | nova.create_100_rules | 20.403 | 20.759 | 21.005 | 21.036 | 21.067 | 20.743 | 37.5% | 8 |
+ | nova.boot_server | 8.329 | 10.397 | 10.543 | 10.561 | 10.58 | 9.768 | 37.5% | 8 |
+ | nova.get_attached_security_groups | 0.177 | 0.18 | 0.189 | 0.19 | 0.191 | 0.183 | 100.0% | 3 |
+ | nova.delete_server | 2.417 | 2.424 | 2.563 | 2.58 | 2.597 | 2.48 | 100.0% | 3 |
+ | nova.delete_10_security_groups | 1.146 | 1.185 | 1.295 | 1.309 | 1.323 | 1.218 | 100.0% | 3 |
+ | total | 35.785 | 37.72 | 37.728 | 37.729 | 37.73 | 37.079 | 37.5% | 8 |
+ +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 653.787332058
+ Full duration: 698.373892784
+
+ test scenario NovaServers.pause_and_unpause_server
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 9.228 | 10.626 | 10.698 | 10.707 | 10.715 | 10.19 | 37.5% | 8 |
+ | nova.pause_server | 2.325 | 2.628 | 2.631 | 2.631 | 2.631 | 2.528 | 100.0% | 3 |
+ | nova.unpause_server | 2.624 | 2.647 | 2.691 | 2.697 | 2.702 | 2.658 | 100.0% | 3 |
+ | nova.delete_server | 2.596 | 2.732 | 2.747 | 2.749 | 2.751 | 2.693 | 100.0% | 3 |
+ | total | 16.772 | 18.711 | 18.72 | 18.722 | 18.723 | 18.069 | 37.5% | 8 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 607.316802025
+ Full duration: 645.979089022
+
+ test scenario NovaServers.boot_server_from_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 8.57 | 9.398 | 10.796 | 10.932 | 11.068 | 9.692 | 60.0% | 10 |
+ | nova.boot_server | 11.064 | 12.084 | 12.627 | 12.859 | 13.092 | 12.061 | 60.0% | 10 |
+ | total | 20.261 | 21.884 | 22.881 | 22.979 | 23.078 | 21.754 | 60.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 377.391654015
+ Full duration: 411.411114931
+
+ test scenario NovaServers.boot_and_list_server
+ +----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 9.689 | 10.784 | 12.049 | 12.245 | 12.44 | 10.872 | 60.0% | 10 |
+ | nova.list_servers | 0.2 | 0.431 | 0.5 | 0.513 | 0.526 | 0.414 | 100.0% | 6 |
+ | total | 10.11 | 11.216 | 12.386 | 12.649 | 12.913 | 11.286 | 60.0% | 10 |
+ +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 339.637984037
+ Full duration: 382.637588978
+
+ 2016-04-26 07:03:20,320 - run_rally - INFO - Test scenario: "nova" Failed.
+ 2016-04-26 07:03:20,864 - run_rally - INFO - Starting test scenario "quotas" ...
+ 2016-04-26 07:04:24,690 - run_rally - INFO -
+ Preparing input task
+ Task 31d451cc-0c33-44e6-8ce1-a226ec4d3747: started
+ Task 31d451cc-0c33-44e6-8ce1-a226ec4d3747: finished
+
+ test scenario Quotas.cinder_update
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | quotas.update_quotas | 0.676 | 0.77 | 1.004 | 1.007 | 1.01 | 0.823 | 100.0% | 10 |
+ | total | 0.676 | 0.77 | 1.005 | 1.007 | 1.01 | 0.823 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.49713397026
+ Full duration: 10.5032558441
+
+ test scenario Quotas.neutron_update
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | quotas.update_quotas | 0.214 | 0.235 | 0.26 | 0.262 | 0.263 | 0.238 | 100.0% | 10 |
+ | total | 0.372 | 0.415 | 0.426 | 0.427 | 0.428 | 0.408 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.27715206146
+ Full duration: 8.95948386192
+
+ test scenario Quotas.cinder_update_and_delete
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | quotas.update_quotas | 0.77 | 0.834 | 0.965 | 0.99 | 1.015 | 0.857 | 100.0% | 10 |
+ | quotas.delete_quotas | 0.345 | 0.54 | 0.562 | 0.581 | 0.6 | 0.505 | 100.0% | 10 |
+ | total | 1.127 | 1.365 | 1.437 | 1.498 | 1.56 | 1.362 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 4.07208108902
+ Full duration: 12.2027239799
+
+ test scenario Quotas.nova_update_and_delete
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | quotas.update_quotas | 0.448 | 0.48 | 0.54 | 0.679 | 0.819 | 0.511 | 100.0% | 10 |
+ | quotas.delete_quotas | 0.012 | 0.019 | 0.024 | 0.025 | 0.027 | 0.019 | 100.0% | 10 |
+ | total | 0.463 | 0.499 | 0.563 | 0.699 | 0.836 | 0.53 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.53432106972
+ Full duration: 9.25113201141
+
+ test scenario Quotas.nova_update
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | quotas.update_quotas | 0.395 | 0.469 | 0.541 | 0.549 | 0.557 | 0.47 | 100.0% | 10 |
+ | total | 0.395 | 0.469 | 0.541 | 0.549 | 0.557 | 0.47 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.49797797203
+ Full duration: 8.86192798615
+
+ 2016-04-26 07:04:26,066 - run_rally - INFO - Test scenario: "quotas" OK.
+ 2016-04-26 07:04:26,381 - run_rally - INFO - Starting test scenario "requests" ...
+ 2016-04-26 07:04:56,876 - run_rally - INFO -
+ Preparing input task
+ Task 1c6ea3eb-b807-414a-b07a-d9ecf1aa2344: started
+ Task 1c6ea3eb-b807-414a-b07a-d9ecf1aa2344: finished
+
+ test scenario HttpRequests.check_random_request
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | requests.check_request | 0.018 | 0.542 | 5.956 | 8.184 | 10.411 | 2.811 | 100.0% | 10 |
+ | total | 0.018 | 0.542 | 5.956 | 8.184 | 10.411 | 2.812 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 10.5026738644
+ Full duration: 13.9263000488
+
+ test scenario HttpRequests.check_request
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | requests.check_request | 0.016 | 0.059 | 5.062 | 5.063 | 5.065 | 2.047 | 100.0% | 10 |
+ | total | 0.016 | 0.059 | 5.062 | 5.063 | 5.065 | 2.047 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 5.16210699081
+ Full duration: 8.87197899818
+
+ 2016-04-26 07:04:58,210 - run_rally - INFO - Test scenario: "requests" OK.
+ 2016-04-26 07:04:58,402 - run_rally - INFO -
+
+ Rally Summary Report
+
+ +===================+============+===============+===========+
+ | Module | Duration | nb. Test Run | Success |
+ +===================+============+===============+===========+
+ | authenticate | 00:50 | 12 | 100.00% |
+ +-------------------+------------+---------------+-----------+
+ | glance | 02:55 | 11 | 100.00% |
+ +-------------------+------------+---------------+-----------+
+ | cinder | 54:33 | 59 | 76.47% |
+ +-------------------+------------+---------------+-----------+
+ | heat | 18:00 | 48 | 92.31% |
+ +-------------------+------------+---------------+-----------+
+ | keystone | 01:53 | 40 | 100.00% |
+ +-------------------+------------+---------------+-----------+
+ | neutron | 06:04 | 43 | 100.00% |
+ +-------------------+------------+---------------+-----------+
+ | nova | 11:14 | 79 | 79.87% |
+ +-------------------+------------+---------------+-----------+
+ | quotas | 00:49 | 12 | 100.00% |
+ +-------------------+------------+---------------+-----------+
+ | requests | 00:22 | 4 | 100.00% |
+ +-------------------+------------+---------------+-----------+
+ +===================+============+===============+===========+
+ | TOTAL: | 05:36:44 | 308 | 94.29% |
+ +===================+============+===============+===========+
+
+Feature tests
+-------------
+
+Promise
+^^^^^^^
+::
+
+ FUNCTEST.info: Running PROMISE test case...
+ 2016-04-26 01:23:01,296 - Promise- INFO - Creating tenant 'promise'...
+ 2016-04-26 01:23:01,461 - Promise- INFO - Adding role 'a6da18e9c7e94ee9975e85b6f26c974a' to tenant 'promise'...
+ 2016-04-26 01:23:01,553 - Promise- INFO - Creating user 'promiser'...
+ 2016-04-26 01:23:01,666 - Promise- INFO - Updating OpenStack credentials...
+ 2016-04-26 01:23:01,687 - Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
+ 2016-04-26 01:23:05,215 - Promise- INFO - Creating flavor 'promise-flavor'...
+ 2016-04-26 01:23:05,871 - Promise- INFO - Exporting environment variables...
+ 2016-04-26 01:23:05,871 - Promise- INFO - Running command: npm run -s test -- --reporter json
+ 2016-04-26 01:23:12,658 - Promise- INFO - The test succeeded.
+ 2016-04-26 01:23:12,660 - Promise- INFO -
+ ****************************************
+ Promise test report
+
+ ****************************************
+ Suites: 23
+ Tests: 33
+ Passes: 33
+ Pending: 0
+ Failures: 0
+ Start: 2016-04-26T01:23:08.348Z
+ End: 2016-04-26T01:23:12.610Z
+ Duration: 4.262
diff --git a/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst b/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst
new file mode 100644
index 000000000..652db3369
--- /dev/null
+++ b/docs/results/fuel-os-odl_l2-bgpvpn-ha.rst
@@ -0,0 +1,1254 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
+.. http://creativecommons.org/licenses/by/4.0
+
+Detailed test results for fuel-os-odl_l2-bgpvpn-ha
+-----------------------------------------------------
+
+VIM
+---
+
+vping_userdata
+^^^^^^^^^^^^^^
+::
+
+ FUNCTEST.info: Running vPing-userdata test...
+ vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
+ vPing_userdata- INFO - Creating neutron network vping-net...
+ vPing_userdata- INFO - Creating security group 'vPing-sg'...
+ vPing_userdata- INFO - Flavor found 'm1.small'
+ vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
+ vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
+ name=opnfv-vping-1
+ flavor=<Flavor: m1.small>
+ image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
+ network=a1efb318-1338-436f-8f26-3a1bacab0538
+
+ vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
+ vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
+ name=opnfv-vping-2
+ flavor=<Flavor: m1.small>
+ image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
+ network=a1efb318-1338-436f-8f26-3a1bacab0538
+ userdata=
+ #!/bin/sh
+
+ while true; do
+ ping -c 1 192.168.130.4 2>&1 >/dev/null
+ RES=$?
+ if [ "Z$RES" = "Z0" ] ; then
+ echo 'vPing OK'
+ break
+ else
+ echo 'vPing KO'
+ fi
+ sleep 1
+ done
+
+ vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
+ vPing_userdata- INFO - Waiting for ping...
+ vPing_userdata- INFO - vPing detected!
+ vPing_userdata- INFO - vPing duration:'79.7'
+ vPing_userdata- INFO - vPing OK
+ vPing_userdata- INFO - Cleaning up...
+ vPing_userdata- INFO - Deleting network 'vping-net'...
+
+Tempest
+^^^^^^^
+::
+
+ +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
+ | name | time | status |
+ +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.281 | success |
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.114 | success |
+ | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 12.926 | success |
+ | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 24.849 | success |
+ | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 36.056 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.547 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.768 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.486 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 1.049 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.347 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.299 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.952 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.529 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.260 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.786 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.487 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.624 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.792 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.859 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.417 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.461 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.160 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 2.692 | success |
+ | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 4.500 | success |
+ | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 9.766 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 300.727 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.330 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.687 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 302.209 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.002 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 300.741 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.455 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.680 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 302.095 | fail |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.002 | success |
+ | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.084 | success |
+ | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 3.891 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.470 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.001 | skip |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.220 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.530 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.437 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.143 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.001 | skip |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.103 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.079 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.096 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.721 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.001 | skip |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.181 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.091 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.018 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.095 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.088 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.030 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.035 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.054 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.069 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.084 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.699 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.022 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.075 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.002 | skip |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 5.318 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 10.683 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 306.252 | fail |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.838 | skip |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 311.592 | fail |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 15.370 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 25.343 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 9.258 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.091 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.152 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.491 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.366 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.286 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.567 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.727 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.596 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 4.330 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 14.127 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 18.635 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 12.265 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 12.122 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 1.506 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 2.128 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 1.933 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 2.111 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 2.560 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.578 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.508 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.998 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.998 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 2.359 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.243 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.306 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.421 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.998 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.635 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.974 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.015 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.512 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 0.886 | success |
+ | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.250 | success |
+ | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.052 | success |
+ | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 336.810 | fail |
+ | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.740 | success |
+ | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.093 | success |
+ | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.535 | success |
+ | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.028 | success |
+ | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.750 | success |
+ | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.245 | success |
+ | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.398 | success |
+ | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.097 | success |
+ | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.904 | success |
+ | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.520 | success |
+ | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 2.415 | success |
+ | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.403 | success |
+ | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.292 | success |
+ | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.521 | success |
+ | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.183 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.109 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.086 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.080 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.089 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.089 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.077 | success |
+ | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.269 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.917 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 15.399 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 20.214 | success |
+ | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 5.865 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 1.207 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 2.604 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 2.662 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.556 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.059 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.041 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.278 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.271 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 2.640 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 2.800 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 2.208 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.293 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.300 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 2.291 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 2.745 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 1.368 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.318 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.065 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 5.069 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 3.298 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 2.237 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 2.321 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 5.779 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 2.980 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 2.462 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 2.617 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.811 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.256 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.033 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 1.774 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 2.789 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.077 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.565 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 6.751 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.047 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.299 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.592 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.613 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.569 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.805 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.762 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.270 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.048 | success |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 6.732 | success |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 3.526 | success |
+ | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 3.356 | success |
+ | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.875 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 9.723 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 17.070 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 9.744 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 18.252 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.284 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.048 | success |
+ | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 322.942 | fail |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 335.472 | fail |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 332.744 | fail |
+ +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
+ 2016-04-26 21:34:37,839 - run_tempest - INFO - Results: {'timestart': '2016-04-2620:21:12.306509', 'duration': 803, 'tests': 188, 'failures': 10}
+
+Rally
+^^^^^
+::
+
+ FUNCTEST.info: Running Rally benchmark suite...
+ 2016-04-26 21:36:15,676 - run_rally - INFO - Starting test scenario "authenticate" ...
+ 2016-04-26 21:37:35,906 - run_rally - INFO -
+ Preparing input task
+ Task a8cb2031-5232-47f0-bc43-9316bd7ceefa: started
+ Task a8cb2031-5232-47f0-bc43-9316bd7ceefa: finished
+
+ test scenario Authenticate.validate_glance
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_glance_2_times | 1.015 | 1.244 | 1.415 | 1.476 | 1.536 | 1.249 | 100.0% | 10 |
+ | total | 1.281 | 1.505 | 1.685 | 1.744 | 1.804 | 1.516 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 4.44646310806
+ Full duration: 12.853926897
+
+ test scenario Authenticate.keystone
+ +--------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.keystone | 0.214 | 0.249 | 0.267 | 0.269 | 0.272 | 0.248 | 100.0% | 10 |
+ | total | 0.214 | 0.249 | 0.267 | 0.269 | 0.272 | 0.248 | 100.0% | 10 |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.754605054855
+ Full duration: 9.11485695839
+
+ test scenario Authenticate.validate_heat
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_heat_2_times | 0.343 | 0.61 | 0.662 | 0.733 | 0.805 | 0.606 | 100.0% | 10 |
+ | total | 0.589 | 0.871 | 0.971 | 1.045 | 1.12 | 0.878 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.61781597137
+ Full duration: 11.0082919598
+
+ test scenario Authenticate.validate_nova
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_nova_2_times | 0.328 | 0.371 | 0.479 | 0.495 | 0.51 | 0.391 | 100.0% | 10 |
+ | total | 0.555 | 0.619 | 0.743 | 0.756 | 0.769 | 0.643 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.93781709671
+ Full duration: 10.4554929733
+
+ test scenario Authenticate.validate_cinder
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_cinder_2_times | 0.31 | 0.64 | 0.927 | 0.962 | 0.998 | 0.67 | 100.0% | 10 |
+ | total | 0.549 | 0.921 | 1.219 | 1.236 | 1.253 | 0.939 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.9773349762
+ Full duration: 11.6194210052
+
+ test scenario Authenticate.validate_neutron
+ +------------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_neutron_2_times | 0.304 | 0.558 | 0.576 | 0.611 | 0.646 | 0.539 | 100.0% | 10 |
+ | total | 0.569 | 0.804 | 0.819 | 0.851 | 0.882 | 0.785 | 100.0% | 10 |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.409938097
+ Full duration: 11.0552449226
+
+ 2016-04-26 21:37:37,881 - run_rally - INFO - Test scenario: "authenticate" OK.
+
+ 2016-04-26 21:37:37,882 - run_rally - INFO - Starting test scenario "glance" ...
+ 2016-04-26 21:41:19,902 - run_rally - INFO -
+ Preparing input task
+ Task 5a858da8-1039-4f20-960f-2d44354c4c60: started
+ Task 5a858da8-1039-4f20-960f-2d44354c4c60: finished
+
+ test scenario GlanceImages.list_images
+ +-----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.list_images | 0.803 | 0.914 | 1.107 | 1.148 | 1.189 | 0.949 | 100.0% | 10 |
+ | total | 0.803 | 0.914 | 1.107 | 1.148 | 1.189 | 0.949 | 100.0% | 10 |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.9055929184
+ Full duration: 14.7421119213
+
+ test scenario GlanceImages.create_image_and_boot_instances
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 7.493 | 7.807 | 9.069 | 12.596 | 16.122 | 8.653 | 100.0% | 10 |
+ | nova.boot_servers | 9.309 | 10.032 | 11.628 | 11.726 | 11.824 | 10.411 | 100.0% | 10 |
+ | total | 17.19 | 18.474 | 20.176 | 22.804 | 25.432 | 19.064 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 54.8601989746
+ Full duration: 113.092097998
+
+ test scenario GlanceImages.create_and_list_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 7.313 | 7.52 | 8.653 | 12.221 | 15.788 | 8.359 | 100.0% | 10 |
+ | glance.list_images | 0.356 | 0.537 | 0.57 | 0.599 | 0.627 | 0.519 | 100.0% | 10 |
+ | total | 7.817 | 8.058 | 9.194 | 12.748 | 16.302 | 8.878 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 24.3566281796
+ Full duration: 40.1059360504
+
+ test scenario GlanceImages.create_and_delete_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 7.08 | 7.515 | 7.968 | 8.084 | 8.201 | 7.585 | 100.0% | 10 |
+ | glance.delete_image | 1.893 | 2.224 | 2.429 | 2.431 | 2.434 | 2.198 | 100.0% | 10 |
+ | total | 9.374 | 9.68 | 10.313 | 10.449 | 10.585 | 9.783 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 29.927503109
+ Full duration: 40.712335825
+
+ 2016-04-26 21:41:21,905 - run_rally - INFO - Test scenario: "glance" OK.
+
+ 2016-04-26 21:41:21,905 - run_rally - INFO - Starting test scenario "cinder" ...
+ 2016-04-26 22:02:57,566 - run_rally - INFO -
+ Preparing input task
+ Task 8714ce27-ec07-493c-894b-0378b012f768: started
+ Task 8714ce27-ec07-493c-894b-0378b012f768: finished
+
+ test scenario CinderVolumes.create_and_attach_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 7.315 | 7.849 | 8.808 | 9.275 | 9.743 | 8.131 | 100.0% | 10 |
+ | cinder.create_volume | 3.204 | 3.91 | 4.165 | 4.209 | 4.253 | 3.777 | 100.0% | 10 |
+ | nova.attach_volume | 4.193 | 5.576 | 6.847 | 6.918 | 6.989 | 5.577 | 100.0% | 10 |
+ | nova.detach_volume | 3.591 | 4.036 | 4.652 | 4.887 | 5.122 | 4.155 | 100.0% | 10 |
+ | cinder.delete_volume | 0.805 | 2.91 | 3.015 | 3.158 | 3.301 | 2.362 | 100.0% | 10 |
+ | nova.delete_server | 2.813 | 3.044 | 3.223 | 3.232 | 3.24 | 3.033 | 100.0% | 10 |
+ | total | 24.205 | 26.801 | 29.041 | 29.115 | 29.188 | 27.034 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 81.0580990314
+ Full duration: 112.19692111
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 10.993 | 11.11 | 11.434 | 11.435 | 11.436 | 11.186 | 100.0% | 10 |
+ | cinder.list_volumes | 0.069 | 0.33 | 0.436 | 0.474 | 0.512 | 0.268 | 100.0% | 10 |
+ | total | 11.084 | 11.476 | 11.601 | 11.714 | 11.828 | 11.454 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 34.1340601444
+ Full duration: 55.759376049
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.45 | 3.958 | 4.546 | 4.569 | 4.591 | 4.003 | 100.0% | 10 |
+ | cinder.list_volumes | 0.062 | 0.325 | 0.344 | 0.345 | 0.345 | 0.275 | 100.0% | 10 |
+ | total | 3.513 | 4.292 | 4.865 | 4.9 | 4.935 | 4.279 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 12.6924929619
+ Full duration: 34.0712091923
+
+ test scenario CinderVolumes.create_and_list_snapshots
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 3.235 | 3.344 | 3.856 | 4.736 | 5.617 | 3.629 | 100.0% | 10 |
+ | cinder.list_snapshots | 0.039 | 0.285 | 0.337 | 0.376 | 0.416 | 0.254 | 100.0% | 10 |
+ | total | 3.333 | 3.676 | 4.127 | 4.892 | 5.657 | 3.884 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 10.8523409367
+ Full duration: 47.7997851372
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.471 | 3.85 | 4.197 | 4.341 | 4.485 | 3.858 | 100.0% | 10 |
+ | cinder.delete_volume | 0.532 | 2.741 | 3.118 | 3.184 | 3.251 | 2.077 | 100.0% | 10 |
+ | total | 4.328 | 6.376 | 7.081 | 7.248 | 7.416 | 5.935 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 17.2594389915
+ Full duration: 34.9955868721
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 8.676 | 10.604 | 11.06 | 11.115 | 11.17 | 10.243 | 100.0% | 10 |
+ | cinder.delete_volume | 0.894 | 2.767 | 3.153 | 3.195 | 3.237 | 2.369 | 100.0% | 10 |
+ | total | 9.774 | 12.84 | 13.865 | 14.089 | 14.313 | 12.612 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 37.8307890892
+ Full duration: 56.2227160931
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.45 | 3.88 | 4.434 | 4.439 | 4.445 | 3.935 | 100.0% | 10 |
+ | cinder.delete_volume | 0.8 | 0.932 | 3.003 | 3.159 | 3.316 | 1.539 | 100.0% | 10 |
+ | total | 4.496 | 4.916 | 6.901 | 7.325 | 7.749 | 5.474 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 16.0426750183
+ Full duration: 32.9341490269
+
+ test scenario CinderVolumes.create_and_upload_volume_to_image
+ +----------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.49 | 3.782 | 4.253 | 4.255 | 4.256 | 3.847 | 100.0% | 10 |
+ | cinder.upload_volume_to_image | 16.394 | 27.4 | 31.961 | 32.07 | 32.18 | 25.735 | 100.0% | 10 |
+ | cinder.delete_volume | 0.68 | 2.971 | 3.15 | 3.173 | 3.195 | 2.523 | 100.0% | 10 |
+ | nova.delete_image | 2.479 | 2.591 | 14.325 | 14.525 | 14.725 | 4.969 | 100.0% | 10 |
+ | total | 24.827 | 37.87 | 49.56 | 51.384 | 53.208 | 37.075 | 100.0% | 10 |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 101.809072971
+ Full duration: 121.969902992
+
+ test scenario CinderVolumes.create_and_delete_snapshot
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 3.076 | 3.402 | 3.707 | 4.558 | 5.409 | 3.552 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.541 | 2.81 | 3.096 | 3.171 | 3.246 | 2.854 | 100.0% | 10 |
+ | total | 5.963 | 6.195 | 6.881 | 7.543 | 8.206 | 6.406 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 18.6676621437
+ Full duration: 51.159060955
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.592 | 3.816 | 3.986 | 4.022 | 4.058 | 3.828 | 100.0% | 10 |
+ | total | 3.592 | 3.816 | 3.986 | 4.022 | 4.058 | 3.828 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 11.4555690289
+ Full duration: 28.3837711811
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.49 | 3.885 | 4.203 | 4.22 | 4.238 | 3.914 | 100.0% | 10 |
+ | total | 3.49 | 3.885 | 4.203 | 4.22 | 4.238 | 3.914 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 11.7762680054
+ Full duration: 32.9480211735
+
+ test scenario CinderVolumes.list_volumes
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.list_volumes | 0.556 | 0.603 | 0.646 | 0.687 | 0.728 | 0.61 | 100.0% | 10 |
+ | total | 0.556 | 0.603 | 0.646 | 0.687 | 0.728 | 0.611 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.8286819458
+ Full duration: 63.6903710365
+
+ test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.584 | 3.868 | 4.043 | 4.092 | 4.141 | 3.882 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.795 | 3.099 | 3.183 | 3.279 | 3.376 | 3.058 | 100.0% | 10 |
+ | nova.attach_volume | 3.804 | 4.321 | 9.448 | 9.664 | 9.88 | 5.664 | 100.0% | 10 |
+ | nova.detach_volume | 3.584 | 4.108 | 4.341 | 4.345 | 4.349 | 4.073 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.527 | 2.796 | 3.137 | 3.155 | 3.172 | 2.849 | 100.0% | 10 |
+ | cinder.delete_volume | 0.516 | 2.694 | 3.048 | 3.146 | 3.244 | 2.193 | 100.0% | 10 |
+ | total | 19.584 | 21.934 | 25.955 | 26.608 | 27.261 | 22.822 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 65.3636519909
+ Full duration: 157.771946192
+
+ test scenario CinderVolumes.create_from_volume_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.799 | 4.234 | 6.551 | 6.658 | 6.765 | 4.608 | 100.0% | 10 |
+ | cinder.delete_volume | 2.709 | 3.319 | 3.584 | 3.584 | 3.585 | 3.276 | 100.0% | 10 |
+ | total | 7.064 | 7.351 | 9.902 | 9.97 | 10.037 | 7.885 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 24.1967608929
+ Full duration: 56.604929924
+
+ test scenario CinderVolumes.create_and_extend_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.542 | 3.816 | 3.903 | 3.913 | 3.923 | 3.81 | 100.0% | 10 |
+ | cinder.extend_volume | 1.122 | 3.325 | 3.477 | 3.479 | 3.482 | 2.916 | 100.0% | 10 |
+ | cinder.delete_volume | 0.537 | 2.74 | 3.216 | 3.222 | 3.227 | 2.259 | 100.0% | 10 |
+ | total | 5.854 | 9.459 | 10.487 | 10.503 | 10.52 | 8.985 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 28.2484090328
+ Full duration: 46.2826929092
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.569 | 3.853 | 3.95 | 4.015 | 4.08 | 3.829 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.31 | 2.832 | 3.33 | 3.355 | 3.38 | 2.897 | 100.0% | 10 |
+ | nova.attach_volume | 4.043 | 4.744 | 7.838 | 8.729 | 9.621 | 5.643 | 100.0% | 10 |
+ | nova.detach_volume | 3.471 | 4.246 | 4.498 | 4.498 | 4.498 | 4.184 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.532 | 2.852 | 2.92 | 2.971 | 3.022 | 2.789 | 100.0% | 10 |
+ | cinder.delete_volume | 0.549 | 2.606 | 2.992 | 3.023 | 3.053 | 2.117 | 100.0% | 10 |
+ | total | 18.473 | 22.08 | 25.688 | 26.47 | 27.253 | 22.541 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 66.4576151371
+ Full duration: 166.03899312
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.15 | 3.42 | 3.637 | 3.78 | 3.923 | 3.45 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.546 | 2.911 | 3.114 | 3.207 | 3.301 | 2.929 | 100.0% | 10 |
+ | nova.attach_volume | 4.077 | 5.64 | 7.857 | 8.865 | 9.874 | 5.963 | 100.0% | 10 |
+ | nova.detach_volume | 3.76 | 4.056 | 4.468 | 4.626 | 4.784 | 4.137 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.242 | 2.665 | 2.932 | 2.947 | 2.961 | 2.633 | 100.0% | 10 |
+ | cinder.delete_volume | 0.539 | 2.723 | 3.0 | 3.115 | 3.23 | 2.577 | 100.0% | 10 |
+ | total | 19.142 | 22.899 | 26.465 | 27.264 | 28.063 | 23.373 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 68.2796330452
+ Full duration: 167.136126041
+
+SDN Controller
+--------------
+
+ODL
+^^^^
+::
+
+ ==============================================================================
+ Basic
+ ==============================================================================
+ Basic.010 Restconf OK :: Test suite to verify Restconf is OK
+ ==============================================================================
+ Get Controller Modules :: Get the controller modules via Restconf | PASS |
+ ------------------------------------------------------------------------------
+ Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
+ 1 critical test, 1 passed, 0 failed
+ 1 test total, 1 passed, 0 failed
+ ==============================================================================
+ Basic | PASS |
+ 1 critical test, 1 passed, 0 failed
+ 1 test total, 1 passed, 0 failed
+ ==============================================================================
+ Output: /home/opnfv/repos/functest/output.xml
+ Log: /home/opnfv/repos/functest/log.html
+ Report: /home/opnfv/repos/functest/report.html
+ [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m
+ ==============================================================================
+ Neutron :: Test suite for Neutron Plugin
+ ==============================================================================
+ Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
+ ==============================================================================
+ Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
+ ------------------------------------------------------------------------------
+ Create Network :: Create new network in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Network :: Check Network created in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
+ 4 critical tests, 4 passed, 0 failed
+ 4 tests total, 4 passed, 0 failed
+ ==============================================================================
+ Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
+ ==============================================================================
+ Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
+ ------------------------------------------------------------------------------
+ Create New subnet :: Create new subnet in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New subnet :: Check new subnet created in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
+ 4 critical tests, 4 passed, 0 failed
+ 4 tests total, 4 passed, 0 failed
+ ==============================================================================
+ Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
+ ==============================================================================
+ Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
+ ------------------------------------------------------------------------------
+ Create New Port :: Create new port in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New Port :: Check new subnet created in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
+ 4 critical tests, 4 passed, 0 failed
+ 4 tests total, 4 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
+ ==============================================================================
+ Delete New Port :: Delete previously created port in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
+ ==============================================================================
+ Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
+ ==============================================================================
+ Delete Network :: Delete network in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron :: Test suite for Neutron Plugin | PASS |
+ 18 critical tests, 18 passed, 0 failed
+ 18 tests total, 18 passed, 0 failed
+ ==============================================================================
+ Output: /home/opnfv/repos/functest/output.xml
+ Log: /home/opnfv/repos/functest/log.html
+ Report: /home/opnfv/repos/functest/report.html
+ [0;32mFinal report is located:[0m
+ Log: /home/opnfv/repos/functest/log.html
+ Report: /home/opnfv/repos/functest/report.html
+
+Feature tests
+-------------
+
+vIMS
+^^^^
+::
+
+ FUNCTEST.info: Running vIMS test...
+ vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
+ vIMS - INFO - Update OpenStack creds informations
+ vIMS - INFO - Upload some OS images if it doesn't exist
+ vIMS - INFO - centos_7 image doesn't exist on glance repository.
+ Try downloading this image and upload on glance !
+ vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
+ Try downloading this image and upload on glance !
+ vIMS - INFO - Update security group quota for this tenant
+ vIMS - INFO - Update cinder quota for this tenant
+ vIMS - INFO - Collect flavor id for cloudify manager server
+ vIMS - INFO - Prepare virtualenv for cloudify-cli
+ vIMS - INFO - Downloading the cloudify manager server blueprint
+ vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
+ vIMS - INFO - Writing the inputs file
+ vIMS - INFO - Launching the cloudify-manager deployment
+ vIMS - INFO - Cloudify-manager server is UP !
+ vIMS - INFO - Cloudify deployment duration:'1149.9'
+ vIMS - INFO - Collect flavor id for all clearwater vm
+ vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
+ vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
+ vIMS - INFO - Writing the inputs file
+ vIMS - INFO - Launching the clearwater deployment
+ vIMS - INFO - The deployment of clearwater-opnfv is ended
+ vIMS - INFO - vIMS VNF deployment duration:'1133.8'
+ vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
+ vIMS - INFO - vIMS functional test duration:'2.9'
+ vIMS - INFO - Launching the clearwater-opnfv undeployment
+ vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
+ vIMS - INFO - Launching the cloudify-manager undeployment
+ vIMS - INFO - Cloudify-manager server has been successfully removed!
+ vIMS - INFO - Removing vIMS tenant ..
+ vIMS - INFO - Removing vIMS user ..
+
+Promise
+^^^^^^^
+::
+
+ FUNCTEST.info: Running PROMISE test case...
+ Promise- INFO - Creating tenant 'promise'...
+ Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
+ Promise- INFO - Creating user 'promiser'...
+ Promise- INFO - Updating OpenStack credentials...
+ Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
+ Promise- INFO - Creating flavor 'promise-flavor'...
+ Promise- INFO - Exporting environment variables...
+ Promise- INFO - Running command: npm run -s test -- --reporter json
+ Promise- INFO - The test succeeded.
+ Promise- DEBUG -
+ {
+ "stats": {
+ "suites": 23,
+ "tests": 33,
+ "passes": 33,
+ "pending": 0,
+ "failures": 0,
+ "start": "2016-02-19T05:41:25.739Z",
+ "end": "2016-02-19T05:41:31.140Z",
+ "duration": 5524
+ },
+ "tests": [
+ {
+ "title": "should add a new OpenStack provider without error",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
+ "duration": 1217,
+ "err": {}
+ },
+ {
+ "title": "should update promise.providers with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
+ "duration": 10,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceProvider record in the store",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should add more capacity to the reservation service without error",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
+ "duration": 25,
+ "err": {}
+ },
+ {
+ "title": "should update promise.pools with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should contain a ResourcePool record in the store",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should report total collections and utilizations",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
+ "duration": 18,
+ "err": {}
+ },
+ {
+ "title": "should contain newly added capacity pool",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
+ "duration": 8,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider without error",
+ "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
+ "duration": 1768,
+ "err": {}
+ },
+ {
+ "title": "should update promise.allocations with a new entry",
+ "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
+ "duration": 2,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should reference the created server ID from the provider",
+ "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should have low priority state",
+ "fullTitle": "promise allocation without reservation create-instance should have low priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (no start/end) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
+ "duration": 41,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider (with reservation) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
+ "duration": 1617,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should be referenced in the reservation record",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should have high priority state",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (for future) without error",
+ "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
+ "duration": 75,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should contain newly created future reservation",
+ "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
+ "duration": 61,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
+ "duration": 65,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should no longer contain record of the deleted reservation",
+ "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should decrease available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
+ "duration": 15,
+ "err": {}
+ },
+ {
+ "title": "should increase available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
+ "duration": 11,
+ "err": {}
+ },
+ {
+ "title": "should report available collections and utilizations",
+ "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
+ "duration": 56,
+ "err": {}
+ },
+ {
+ "title": "should fail to create immediate reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
+ "duration": 60,
+ "err": {}
+ },
+ {
+ "title": "should fail to create future reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
+ "duration": 38,
+ "err": {}
+ },
+ {
+ "title": "should successfully destroy all allocations",
+ "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
+ "duration": 361,
+ "err": {}
+ }
+ ],
+ "pending": [],
+ "failures": [],
+ "passes": [
+ {
+ "title": "should add a new OpenStack provider without error",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
+ "duration": 1217,
+ "err": {}
+ },
+ {
+ "title": "should update promise.providers with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
+ "duration": 10,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceProvider record in the store",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should add more capacity to the reservation service without error",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
+ "duration": 25,
+ "err": {}
+ },
+ {
+ "title": "should update promise.pools with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should contain a ResourcePool record in the store",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should report total collections and utilizations",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
+ "duration": 18,
+ "err": {}
+ },
+ {
+ "title": "should contain newly added capacity pool",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
+ "duration": 8,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider without error",
+ "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
+ "duration": 1768,
+ "err": {}
+ },
+ {
+ "title": "should update promise.allocations with a new entry",
+ "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
+ "duration": 2,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should reference the created server ID from the provider",
+ "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should have low priority state",
+ "fullTitle": "promise allocation without reservation create-instance should have low priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (no start/end) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
+ "duration": 41,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider (with reservation) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
+ "duration": 1617,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should be referenced in the reservation record",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should have high priority state",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (for future) without error",
+ "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
+ "duration": 75,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should contain newly created future reservation",
+ "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
+ "duration": 61,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
+ "duration": 65,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should no longer contain record of the deleted reservation",
+ "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should decrease available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
+ "duration": 15,
+ "err": {}
+ },
+ {
+ "title": "should increase available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
+ "duration": 11,
+ "err": {}
+ },
+ {
+ "title": "should report available collections and utilizations",
+ "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
+ "duration": 56,
+ "err": {}
+ },
+ {
+ "title": "should fail to create immediate reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
+ "duration": 60,
+ "err": {}
+ },
+ {
+ "title": "should fail to create future reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
+ "duration": 38,
+ "err": {}
+ },
+ {
+ "title": "should successfully destroy all allocations",
+ "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
+ "duration": 361,
+ "err": {}
+ }
+ ]
+ }
+ Promise- INFO -
+ ****************************************
+ Promise test report
+
+ ****************************************
+ Suites: 23
+ Tests: 33
+ Passes: 33
+ Pending: 0
+ Failures: 0
+ Start: 2016-04-26T21:35:23.780Z
+ End: 2016-04-26T21:35:29.337Z
+ Duration: 5.557
+ ****************************************
+
+bgpvpn
+^^^^^^
+::
+
+ ${PYTHON:-python} -m subunit.run discover -t ${OS_TOP_LEVEL:-./} ${OS_TEST_PATH:-./tempest/test_discover} --load-list /tmp/tmpB17uh4
+ {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn [0.640872s] ... ok
+ {0} networking_bgpvpn_tempest.tests.api.test_bgpvpn.BgpvpnTest.test_create_bgpvpn_as_non_admin_fail [0.293540s] ... ok
+
+ ======
+ Totals
+ ======
+ Ran: 2 tests in 13.0000 sec.
+ - Passed: 2
+ - Skipped: 0
+ - Expected Fail: 0
+ - Unexpected Success: 0
+ - Failed: 0
+ Sum of execute time for each test: 0.9344 sec.
diff --git a/docs/results/fuel-os-odl_l2-sfc-ha.rst b/docs/results/fuel-os-odl_l2-sfc-ha.rst
new file mode 100644
index 000000000..a827ecf73
--- /dev/null
+++ b/docs/results/fuel-os-odl_l2-sfc-ha.rst
@@ -0,0 +1,1262 @@
+.. This work is licensed under a Creative Commons Attribution 4.0 International Licence.
+.. http://creativecommons.org/licenses/by/4.0
+
+Detailed test results for fuel-os-odl_l2-sfc-ha
+-----------------------------------------------------
+
+VIM
+---
+
+vping_ssh
+^^^^^^^^^
+::
+
+ FUNCTEST.info: Running vPing-SSH test...
+ vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
+ vPing_ssh- INFO - Creating neutron network vping-net...
+ vPing_ssh- INFO - Creating security group 'vPing-sg'...
+ vPing_ssh- INFO - Using existing Flavor 'm1.small'...
+ vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
+ vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
+ name=opnfv-vping-1
+ flavor=<Flavor: m1.small>
+ image=fff41d5d-579a-4c26-844d-4e86700c44f6
+ network=a5137d46-dea8-4f85-8872-08c4a5927182
+
+ vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
+ vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
+ vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
+ name=opnfv-vping-2
+ flavor=<Flavor: m1.small>
+ image=fff41d5d-579a-4c26-844d-4e86700c44f6
+ network=a5137d46-dea8-4f85-8872-08c4a5927182
+
+ vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
+ vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
+ vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
+ vPing_ssh- INFO - Floating IP created: '10.118.101.200'
+ vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
+ vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
+ vPing_ssh- INFO - Waiting for ping...
+ vPing_ssh- INFO - vPing detected!
+ vPing_ssh- INFO - vPing duration:'34.7' s.
+ vPing_ssh- INFO - Cleaning up...
+ vPing_ssh- INFO - vPing OK
+
+vping_userdata
+^^^^^^^^^^^^^^
+::
+
+ FUNCTEST.info: Running vPing-userdata test...
+ vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
+ vPing_userdata- INFO - Creating neutron network vping-net...
+ vPing_userdata- INFO - Creating security group 'vPing-sg'...
+ vPing_userdata- INFO - Flavor found 'm1.small'
+ vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
+ vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
+ name=opnfv-vping-1
+ flavor=<Flavor: m1.small>
+ image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
+ network=a1efb318-1338-436f-8f26-3a1bacab0538
+
+ vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
+ vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
+ name=opnfv-vping-2
+ flavor=<Flavor: m1.small>
+ image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
+ network=a1efb318-1338-436f-8f26-3a1bacab0538
+ userdata=
+ #!/bin/sh
+
+ while true; do
+ ping -c 1 192.168.130.4 2>&1 >/dev/null
+ RES=$?
+ if [ "Z$RES" = "Z0" ] ; then
+ echo 'vPing OK'
+ break
+ else
+ echo 'vPing KO'
+ fi
+ sleep 1
+ done
+
+ vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
+ vPing_userdata- INFO - Waiting for ping...
+ vPing_userdata- INFO - vPing detected!
+ vPing_userdata- INFO - vPing duration:'20.2'
+ vPing_userdata- INFO - vPing OK
+ vPing_userdata- INFO - Cleaning up...
+ vPing_userdata- INFO - Deleting network 'vping-net'...
+
+Tempest
+^^^^^^^
+::
+ +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
+ | name | time | status |
+ +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.254 | success |
+ | tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.125 | success |
+ | tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 12.388 | success |
+ | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 24.859 | success |
+ | tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 11.610 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.780 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.301 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.308 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 1.031 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.525 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.310 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.327 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.451 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.657 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.624 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.325 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.614 | success |
+ | tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.537 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.637 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.480 | success |
+ | tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.480 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.447 | success |
+ | tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 2.524 | success |
+ | tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 5.127 | success |
+ | tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 9.604 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 3.288 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.114 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.489 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.209 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.001 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 15.311 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.090 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.467 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.207 | success |
+ | tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.001 | success |
+ | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.085 | success |
+ | tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 3.900 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.712 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.001 | skip |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.713 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.622 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.433 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.110 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.001 | skip |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.094 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.076 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.093 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.528 | success |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.001 | skip |
+ | tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.173 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.093 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.025 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.093 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.080 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.020 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.025 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.043 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.581 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.066 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.288 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.030 | success |
+ | tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.096 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.001 | skip |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 5.780 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 10.302 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 11.027 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 1.138 | skip |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 11.793 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 14.743 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 24.954 | success |
+ | tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 8.319 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.102 | success |
+ | tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.170 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.536 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.507 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.449 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.688 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.515 | success |
+ | tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.556 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 3.590 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 12.764 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 21.680 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 9.787 | success |
+ | tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 11.049 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 2.045 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 2.190 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 2.549 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 2.194 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 2.236 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.806 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.026 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.050 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.552 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 1.557 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.266 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.803 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.824 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.778 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.357 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 1.212 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.691 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.931 | success |
+ | tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.165 | success |
+ | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.248 | success |
+ | tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.078 | success |
+ | tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 47.118 | success |
+ | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.111 | success |
+ | tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.097 | success |
+ | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.262 | success |
+ | tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.016 | success |
+ | tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.809 | success |
+ | tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.233 | success |
+ | tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.397 | success |
+ | tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.077 | success |
+ | tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.966 | success |
+ | tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.513 | success |
+ | tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 2.311 | success |
+ | tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.401 | success |
+ | tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.332 | success |
+ | tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.555 | success |
+ | tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.059 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.086 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.091 | success |
+ | tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.078 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.087 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.083 | success |
+ | tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.076 | success |
+ | tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.579 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 2.026 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 2.947 | success |
+ | tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 15.745 | success |
+ | tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 4.489 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 1.373 | success |
+ | tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 3.080 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 2.565 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.671 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.317 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.042 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.282 | success |
+ | tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.045 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 2.800 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 2.487 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.722 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.272 | success |
+ | tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.282 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 2.391 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 2.499 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 1.658 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.062 | success |
+ | tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.087 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 5.549 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 3.796 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 3.120 | success |
+ | tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 2.261 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 6.149 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 3.659 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 2.738 | success |
+ | tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 2.213 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.612 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 2.371 | success |
+ | tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.043 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 1.383 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.275 | success |
+ | tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.237 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.531 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 5.699 | success |
+ | tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.045 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.426 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.579 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.680 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.622 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.799 | success |
+ | tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.770 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.216 | success |
+ | tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.051 | success |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 18.428 | success |
+ | tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 3.313 | success |
+ | tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.580 | success |
+ | tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.176 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 10.232 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 17.327 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 11.862 | success |
+ | tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 17.953 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.304 | success |
+ | tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.680 | success |
+ | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 45.140 | success |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 115.284 | success |
+ | tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 88.143 | success |
+ +------------------------------------------------------------------------------------------------------------------------------------------+---------+---------+
+ run_tempest - INFO - Results: {'timestart': '2016-04-2701:33:43.774958', 'duration': 1541, 'tests': 188, 'failures': 0}
+
+Rally
+^^^^^
+::
+
+ FUNCTEST.info: Running Rally benchmark suite...
+ 2016-04-27 02:14:20,172 - run_rally - INFO - Starting test scenario "authenticate" ...
+ 2016-04-27 02:15:40,641 - run_rally - INFO -
+ Preparing input task
+ Task 1491f5fb-1f66-45d3-b04b-31a8cf53eb71: started
+ Task 1491f5fb-1f66-45d3-b04b-31a8cf53eb71: finished
+
+ test scenario Authenticate.validate_glance
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_glance_2_times | 0.966 | 1.042 | 1.146 | 1.191 | 1.236 | 1.063 | 100.0% | 10 |
+ | total | 1.21 | 1.272 | 1.393 | 1.45 | 1.507 | 1.307 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 3.89922785759
+ Full duration: 12.1358039379
+
+ test scenario Authenticate.keystone
+ +--------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.keystone | 0.216 | 0.247 | 0.379 | 0.382 | 0.385 | 0.267 | 100.0% | 10 |
+ | total | 0.216 | 0.247 | 0.379 | 0.382 | 0.386 | 0.268 | 100.0% | 10 |
+ +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 0.732311964035
+ Full duration: 8.95613193512
+
+ test scenario Authenticate.validate_heat
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_heat_2_times | 0.346 | 0.575 | 0.619 | 0.625 | 0.63 | 0.505 | 100.0% | 10 |
+ | total | 0.575 | 0.807 | 0.866 | 0.899 | 0.932 | 0.77 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.38545608521
+ Full duration: 11.1800699234
+
+ test scenario Authenticate.validate_nova
+ +---------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_nova_2_times | 0.31 | 0.388 | 0.536 | 0.54 | 0.543 | 0.409 | 100.0% | 10 |
+ | total | 0.553 | 0.635 | 0.773 | 0.794 | 0.814 | 0.663 | 100.0% | 10 |
+ +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.93493509293
+ Full duration: 10.6224660873
+
+ test scenario Authenticate.validate_cinder
+ +-----------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_cinder_2_times | 0.296 | 0.55 | 0.598 | 0.713 | 0.828 | 0.553 | 100.0% | 10 |
+ | total | 0.525 | 0.815 | 0.942 | 1.052 | 1.162 | 0.829 | 100.0% | 10 |
+ +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.46085309982
+ Full duration: 10.4235949516
+
+ test scenario Authenticate.validate_neutron
+ +------------------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | authenticate.validate_neutron_2_times | 0.526 | 0.601 | 0.73 | 0.74 | 0.749 | 0.615 | 100.0% | 10 |
+ | total | 0.797 | 0.826 | 0.973 | 0.981 | 0.989 | 0.86 | 100.0% | 10 |
+ +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.49738502502
+ Full duration: 11.2271738052
+
+ 2016-04-27 02:15:42,749 - run_rally - INFO - Test scenario: "authenticate" OK.
+ 2016-04-27 02:15:42,749 - run_rally - INFO - Starting test scenario "glance" ...
+ 2016-04-27 02:19:48,692 - run_rally - INFO -
+ Preparing input task
+ Task 661ec9b2-9c4d-4fcd-b522-0cf3f1dbc4ec: started
+ Task 661ec9b2-9c4d-4fcd-b522-0cf3f1dbc4ec: finished
+
+ test scenario GlanceImages.list_images
+ +-----------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.list_images | 0.763 | 0.847 | 0.96 | 0.961 | 0.962 | 0.858 | 100.0% | 10 |
+ | total | 0.763 | 0.847 | 0.96 | 0.961 | 0.962 | 0.859 | 100.0% | 10 |
+ +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 2.59311103821
+ Full duration: 13.8837060928
+
+ test scenario GlanceImages.create_image_and_boot_instances
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 7.004 | 7.656 | 20.755 | 26.239 | 31.723 | 11.873 | 100.0% | 10 |
+ | nova.boot_servers | 8.947 | 10.367 | 10.531 | 10.637 | 10.744 | 10.109 | 100.0% | 10 |
+ | total | 15.951 | 18.072 | 31.179 | 36.629 | 42.078 | 21.982 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 66.442127943
+ Full duration: 112.407797098
+
+ test scenario GlanceImages.create_and_list_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 7.244 | 7.582 | 7.891 | 7.95 | 8.009 | 7.634 | 100.0% | 10 |
+ | glance.list_images | 0.306 | 0.566 | 0.613 | 0.638 | 0.663 | 0.546 | 100.0% | 10 |
+ | total | 7.774 | 8.159 | 8.369 | 8.413 | 8.457 | 8.181 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 24.4534111023
+ Full duration: 55.2102069855
+
+ test scenario GlanceImages.create_and_delete_image
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | glance.create_image | 7.177 | 7.831 | 16.251 | 17.887 | 19.523 | 9.669 | 100.0% | 10 |
+ | glance.delete_image | 1.407 | 2.22 | 2.375 | 2.45 | 2.525 | 2.125 | 100.0% | 10 |
+ | total | 9.332 | 9.768 | 18.192 | 20.001 | 21.809 | 11.794 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 40.9665431976
+ Full duration: 52.3726029396
+
+ 22016-04-27 02:19:50,772 - run_rally - INFO - Test scenario: "glance" OK.
+ 2016-04-27 02:19:50,773 - run_rally - INFO - Starting test scenario "cinder" ...
+ 2016-04-27 02:41:55,538 - run_rally - INFO -
+ Preparing input task
+ Task a74fb68a-1212-4fff-afdd-a8ad044039fd: started
+ Task a74fb68a-1212-4fff-afdd-a8ad044039fd: finished
+
+ test scenario CinderVolumes.create_and_attach_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | nova.boot_server | 7.389 | 8.334 | 9.206 | 9.56 | 9.914 | 8.417 | 100.0% | 10 |
+ | cinder.create_volume | 3.216 | 3.747 | 4.031 | 4.195 | 4.359 | 3.726 | 100.0% | 10 |
+ | nova.attach_volume | 3.856 | 4.202 | 7.174 | 7.341 | 7.508 | 4.8 | 100.0% | 10 |
+ | nova.detach_volume | 4.017 | 4.272 | 4.467 | 4.641 | 4.815 | 4.302 | 100.0% | 10 |
+ | cinder.delete_volume | 0.631 | 2.93 | 3.151 | 3.193 | 3.235 | 2.346 | 100.0% | 10 |
+ | nova.delete_server | 2.937 | 3.051 | 3.119 | 3.273 | 3.426 | 3.078 | 100.0% | 10 |
+ | total | 23.718 | 25.911 | 29.125 | 29.723 | 30.322 | 26.67 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 78.0439009666
+ Full duration: 110.455639839
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 9.979 | 10.793 | 11.421 | 11.46 | 11.499 | 10.766 | 100.0% | 10 |
+ | cinder.list_volumes | 0.074 | 0.299 | 0.372 | 0.384 | 0.397 | 0.235 | 100.0% | 10 |
+ | total | 10.062 | 11.109 | 11.668 | 11.734 | 11.8 | 11.002 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 32.7168459892
+ Full duration: 54.91467309
+
+ test scenario CinderVolumes.create_and_list_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.417 | 3.882 | 4.164 | 4.19 | 4.217 | 3.871 | 100.0% | 10 |
+ | cinder.list_volumes | 0.077 | 0.338 | 0.473 | 0.485 | 0.497 | 0.335 | 100.0% | 10 |
+ | total | 3.881 | 4.176 | 4.51 | 4.539 | 4.568 | 4.206 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 12.7357430458
+ Full duration: 32.5659849644
+
+ test scenario CinderVolumes.create_and_list_snapshots
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 3.051 | 3.454 | 5.626 | 5.696 | 5.765 | 3.827 | 100.0% | 10 |
+ | cinder.list_snapshots | 0.035 | 0.296 | 0.325 | 0.325 | 0.325 | 0.227 | 100.0% | 10 |
+ | total | 3.355 | 3.657 | 5.947 | 6.0 | 6.052 | 4.054 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 13.0978519917
+ Full duration: 50.9691619873
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.632 | 3.83 | 4.025 | 4.124 | 4.223 | 3.857 | 100.0% | 10 |
+ | cinder.delete_volume | 0.55 | 0.83 | 2.782 | 2.965 | 3.147 | 1.365 | 100.0% | 10 |
+ | total | 4.281 | 4.87 | 6.615 | 6.841 | 7.066 | 5.222 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 15.9277088642
+ Full duration: 34.237901926
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 10.252 | 10.977 | 11.943 | 11.948 | 11.953 | 11.097 | 100.0% | 10 |
+ | cinder.delete_volume | 0.82 | 1.996 | 2.99 | 3.013 | 3.036 | 1.938 | 100.0% | 10 |
+ | total | 11.877 | 12.968 | 14.015 | 14.471 | 14.927 | 13.036 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 37.8433139324
+ Full duration: 56.9522650242
+
+ test scenario CinderVolumes.create_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.852 | 4.061 | 4.498 | 4.604 | 4.711 | 4.133 | 100.0% | 10 |
+ | cinder.delete_volume | 0.835 | 0.977 | 2.77 | 2.939 | 3.108 | 1.5 | 100.0% | 10 |
+ | total | 4.799 | 5.266 | 6.888 | 6.964 | 7.039 | 5.634 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 17.0594739914
+ Full duration: 34.639097929
+
+ test scenario CinderVolumes.create_and_upload_volume_to_image
+ +----------------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.582 | 3.801 | 4.194 | 4.213 | 4.231 | 3.878 | 100.0% | 10 |
+ | cinder.upload_volume_to_image | 19.387 | 31.495 | 32.341 | 32.354 | 32.367 | 29.335 | 100.0% | 10 |
+ | cinder.delete_volume | 0.844 | 2.45 | 2.784 | 2.825 | 2.866 | 1.905 | 100.0% | 10 |
+ | nova.delete_image | 2.332 | 2.682 | 2.872 | 2.969 | 3.065 | 2.677 | 100.0% | 10 |
+ | total | 26.258 | 39.786 | 40.849 | 41.006 | 41.163 | 37.796 | 100.0% | 10 |
+ +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 111.222266197
+ Full duration: 129.783249855
+
+ test scenario CinderVolumes.create_and_delete_snapshot
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_snapshot | 3.34 | 3.423 | 5.731 | 5.746 | 5.76 | 3.87 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.556 | 3.104 | 3.272 | 3.285 | 3.299 | 3.068 | 100.0% | 10 |
+ | total | 6.365 | 6.599 | 8.332 | 8.543 | 8.755 | 6.938 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 19.7357230186
+ Full duration: 50.7531559467
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.497 | 3.901 | 4.226 | 4.246 | 4.266 | 3.883 | 100.0% | 10 |
+ | total | 3.497 | 3.901 | 4.226 | 4.246 | 4.266 | 3.883 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 11.6317541599
+ Full duration: 29.422949791
+
+ test scenario CinderVolumes.create_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.649 | 3.933 | 4.176 | 4.178 | 4.179 | 3.939 | 100.0% | 10 |
+ | total | 3.649 | 3.933 | 4.176 | 4.178 | 4.179 | 3.939 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 11.7954070568
+ Full duration: 33.4074928761
+
+ test scenario CinderVolumes.list_volumes
+ +------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.list_volumes | 0.559 | 0.596 | 0.645 | 0.658 | 0.671 | 0.603 | 100.0% | 10 |
+ | total | 0.559 | 0.596 | 0.645 | 0.658 | 0.671 | 0.603 | 100.0% | 10 |
+ +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 1.80386185646
+ Full duration: 65.103438139
+
+ test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.223 | 4.031 | 4.142 | 4.196 | 4.25 | 3.949 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.821 | 3.096 | 3.318 | 3.349 | 3.38 | 3.082 | 100.0% | 10 |
+ | nova.attach_volume | 4.011 | 4.73 | 9.508 | 10.629 | 11.75 | 5.874 | 100.0% | 10 |
+ | nova.detach_volume | 3.603 | 4.136 | 4.42 | 4.481 | 4.542 | 4.112 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.532 | 2.593 | 2.862 | 2.973 | 3.084 | 2.691 | 100.0% | 10 |
+ | cinder.delete_volume | 0.626 | 2.709 | 3.035 | 3.087 | 3.139 | 2.413 | 100.0% | 10 |
+ | total | 20.294 | 22.503 | 27.052 | 28.211 | 29.37 | 23.272 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 67.9758191109
+ Full duration: 167.151215076
+
+ test scenario CinderVolumes.create_from_volume_and_delete_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.396 | 4.269 | 4.654 | 5.616 | 6.578 | 4.385 | 100.0% | 10 |
+ | cinder.delete_volume | 2.712 | 3.275 | 3.476 | 3.485 | 3.493 | 3.193 | 100.0% | 10 |
+ | total | 6.117 | 7.6 | 8.118 | 8.975 | 9.831 | 7.578 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 24.3931138515
+ Full duration: 56.1436901093
+
+ test scenario CinderVolumes.create_and_extend_volume
+ +-------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.562 | 4.002 | 4.303 | 4.334 | 4.364 | 4.012 | 100.0% | 10 |
+ | cinder.extend_volume | 0.691 | 1.1 | 3.236 | 3.411 | 3.587 | 1.713 | 100.0% | 10 |
+ | cinder.delete_volume | 0.583 | 0.974 | 3.176 | 3.253 | 3.33 | 1.51 | 100.0% | 10 |
+ | total | 5.58 | 6.337 | 10.123 | 10.341 | 10.559 | 7.236 | 100.0% | 10 |
+ +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 20.3285830021
+ Full duration: 37.9043469429
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.524 | 4.049 | 4.167 | 4.196 | 4.225 | 3.94 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.743 | 3.026 | 3.356 | 3.408 | 3.46 | 3.053 | 100.0% | 10 |
+ | nova.attach_volume | 4.113 | 4.635 | 6.974 | 7.136 | 7.298 | 5.464 | 100.0% | 10 |
+ | nova.detach_volume | 3.695 | 4.078 | 4.306 | 4.692 | 5.078 | 4.146 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.489 | 2.864 | 3.117 | 3.127 | 3.136 | 2.861 | 100.0% | 10 |
+ | cinder.delete_volume | 0.577 | 2.556 | 2.985 | 3.013 | 3.041 | 2.272 | 100.0% | 10 |
+ | total | 19.553 | 22.646 | 25.102 | 25.135 | 25.168 | 22.862 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 67.4835031033
+ Full duration: 178.220266819
+
+ test scenario CinderVolumes.create_snapshot_and_attach_volume
+ +---------------------------------------------------------------------------------------------------------------------------+
+ | Response Times (sec) |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ | cinder.create_volume | 3.143 | 3.843 | 3.997 | 4.099 | 4.2 | 3.793 | 100.0% | 10 |
+ | cinder.create_snapshot | 2.558 | 2.892 | 3.176 | 3.328 | 3.48 | 2.92 | 100.0% | 10 |
+ | nova.attach_volume | 4.209 | 5.877 | 7.368 | 8.681 | 9.994 | 6.076 | 100.0% | 10 |
+ | nova.detach_volume | 3.533 | 3.91 | 4.349 | 4.363 | 4.378 | 3.99 | 100.0% | 10 |
+ | cinder.delete_snapshot | 2.531 | 2.847 | 3.044 | 3.101 | 3.158 | 2.802 | 100.0% | 10 |
+ | cinder.delete_volume | 0.626 | 2.561 | 2.989 | 3.03 | 3.071 | 2.206 | 100.0% | 10 |
+ | total | 20.143 | 23.986 | 25.362 | 26.711 | 28.06 | 23.469 | 100.0% | 10 |
+ +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+
+ Load duration: 67.7886071205
+ Full duration: 169.118987083
+
+ 2016-04-27 02:41:57,893 - run_rally - INFO - Test scenario: "cinder" OK.
+
+SDN Controller
+--------------
+
+ODL
+^^^^
+::
+
+ ==============================================================================
+ Basic
+ ==============================================================================
+ Basic.010 Restconf OK :: Test suite to verify Restconf is OK
+ ==============================================================================
+ Get Controller Modules :: Get the controller modules via Restconf | PASS |
+ ------------------------------------------------------------------------------
+ Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
+ 1 critical test, 1 passed, 0 failed
+ 1 test total, 1 passed, 0 failed
+ ==============================================================================
+ Basic | PASS |
+ 1 critical test, 1 passed, 0 failed
+ 1 test total, 1 passed, 0 failed
+ ==============================================================================
+ Output: /home/opnfv/repos/functest/output.xml
+ Log: /home/opnfv/repos/functest/log.html
+ Report: /home/opnfv/repos/functest/report.html
+ [1;32mStarting test: test/csit/suites/openstack/neutron/ [0m
+ ==============================================================================
+ Neutron :: Test suite for Neutron Plugin
+ ==============================================================================
+ Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
+ ==============================================================================
+ Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
+ ------------------------------------------------------------------------------
+ Create Network :: Create new network in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Network :: Check Network created in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
+ 4 critical tests, 4 passed, 0 failed
+ 4 tests total, 4 passed, 0 failed
+ ==============================================================================
+ Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
+ ==============================================================================
+ Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
+ ------------------------------------------------------------------------------
+ Create New subnet :: Create new subnet in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New subnet :: Check new subnet created in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
+ 4 critical tests, 4 passed, 0 failed
+ 4 tests total, 4 passed, 0 failed
+ ==============================================================================
+ Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
+ ==============================================================================
+ Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
+ ------------------------------------------------------------------------------
+ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
+ ------------------------------------------------------------------------------
+ Create New Port :: Create new port in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New Port :: Check new subnet created in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
+ 4 critical tests, 4 passed, 0 failed
+ 4 tests total, 4 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
+ ==============================================================================
+ Delete New Port :: Delete previously created port in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
+ ==============================================================================
+ Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
+ ==============================================================================
+ Delete Network :: Delete network in OpenStack | PASS |
+ ------------------------------------------------------------------------------
+ Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
+ ------------------------------------------------------------------------------
+ Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
+ 2 critical tests, 2 passed, 0 failed
+ 2 tests total, 2 passed, 0 failed
+ ==============================================================================
+ Neutron :: Test suite for Neutron Plugin | PASS |
+ 18 critical tests, 18 passed, 0 failed
+ 18 tests total, 18 passed, 0 failed
+ ==============================================================================
+ Output: /home/opnfv/repos/functest/output.xml
+ Log: /home/opnfv/repos/functest/log.html
+ Report: /home/opnfv/repos/functest/report.html
+ [0;32mFinal report is located:[0m
+ Log: /home/opnfv/repos/functest/log.html
+ Report: /home/opnfv/repos/functest/report.html
+
+Feature tests
+-------------
+
+Promise
+^^^^^^^
+::
+
+ FUNCTEST.info: Running PROMISE test case...
+ Promise- INFO - Creating tenant 'promise'...
+ Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
+ Promise- INFO - Creating user 'promiser'...
+ Promise- INFO - Updating OpenStack credentials...
+ Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
+ Promise- INFO - Creating flavor 'promise-flavor'...
+ Promise- INFO - Exporting environment variables...
+ Promise- INFO - Running command: npm run -s test -- --reporter json
+ Promise- INFO - The test succeeded.
+ Promise- DEBUG -
+ {
+ "stats": {
+ "suites": 23,
+ "tests": 33,
+ "passes": 33,
+ "pending": 0,
+ "failures": 0,
+ "start": "2016-04-27T02:00:03.021Z",
+ "end": "2016-04-27T02:00:08.968Z",
+ "duration": 5947
+ },
+ "tests": [
+ {
+ "title": "should add a new OpenStack provider without error",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
+ "duration": 1217,
+ "err": {}
+ },
+ {
+ "title": "should update promise.providers with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
+ "duration": 10,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceProvider record in the store",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should add more capacity to the reservation service without error",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
+ "duration": 25,
+ "err": {}
+ },
+ {
+ "title": "should update promise.pools with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should contain a ResourcePool record in the store",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should report total collections and utilizations",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
+ "duration": 18,
+ "err": {}
+ },
+ {
+ "title": "should contain newly added capacity pool",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
+ "duration": 8,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider without error",
+ "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
+ "duration": 1768,
+ "err": {}
+ },
+ {
+ "title": "should update promise.allocations with a new entry",
+ "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
+ "duration": 2,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should reference the created server ID from the provider",
+ "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should have low priority state",
+ "fullTitle": "promise allocation without reservation create-instance should have low priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (no start/end) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
+ "duration": 41,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider (with reservation) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
+ "duration": 1617,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should be referenced in the reservation record",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should have high priority state",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (for future) without error",
+ "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
+ "duration": 75,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should contain newly created future reservation",
+ "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
+ "duration": 61,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
+ "duration": 65,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should no longer contain record of the deleted reservation",
+ "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should decrease available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
+ "duration": 15,
+ "err": {}
+ },
+ {
+ "title": "should increase available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
+ "duration": 11,
+ "err": {}
+ },
+ {
+ "title": "should report available collections and utilizations",
+ "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
+ "duration": 56,
+ "err": {}
+ },
+ {
+ "title": "should fail to create immediate reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
+ "duration": 60,
+ "err": {}
+ },
+ {
+ "title": "should fail to create future reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
+ "duration": 38,
+ "err": {}
+ },
+ {
+ "title": "should successfully destroy all allocations",
+ "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
+ "duration": 361,
+ "err": {}
+ }
+ ],
+ "pending": [],
+ "failures": [],
+ "passes": [
+ {
+ "title": "should add a new OpenStack provider without error",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
+ "duration": 1217,
+ "err": {}
+ },
+ {
+ "title": "should update promise.providers with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
+ "duration": 10,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceProvider record in the store",
+ "fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should add more capacity to the reservation service without error",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
+ "duration": 25,
+ "err": {}
+ },
+ {
+ "title": "should update promise.pools with a new entry",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should contain a ResourcePool record in the store",
+ "fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should report total collections and utilizations",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
+ "duration": 18,
+ "err": {}
+ },
+ {
+ "title": "should contain newly added capacity pool",
+ "fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
+ "duration": 8,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider without error",
+ "fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
+ "duration": 1768,
+ "err": {}
+ },
+ {
+ "title": "should update promise.allocations with a new entry",
+ "fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
+ "duration": 2,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should reference the created server ID from the provider",
+ "fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should have low priority state",
+ "fullTitle": "promise allocation without reservation create-instance should have low priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (no start/end) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
+ "duration": 41,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create a new server in target provider (with reservation) without error",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
+ "duration": 1617,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceAllocation record in the store",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
+ "duration": 1,
+ "err": {}
+ },
+ {
+ "title": "should be referenced in the reservation record",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
+ "duration": 7,
+ "err": {}
+ },
+ {
+ "title": "should have high priority state",
+ "fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should create reservation record (for future) without error",
+ "fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
+ "duration": 75,
+ "err": {}
+ },
+ {
+ "title": "should update promise.reservations with a new entry",
+ "fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should contain a new ResourceReservation record in the store",
+ "fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should contain newly created future reservation",
+ "fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
+ "duration": 61,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
+ "duration": 65,
+ "err": {}
+ },
+ {
+ "title": "should modify existing reservation without error",
+ "fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
+ "duration": 17,
+ "err": {}
+ },
+ {
+ "title": "should no longer contain record of the deleted reservation",
+ "fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
+ "duration": 0,
+ "err": {}
+ },
+ {
+ "title": "should decrease available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
+ "duration": 15,
+ "err": {}
+ },
+ {
+ "title": "should increase available capacity from a provider in the future",
+ "fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
+ "duration": 11,
+ "err": {}
+ },
+ {
+ "title": "should report available collections and utilizations",
+ "fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
+ "duration": 56,
+ "err": {}
+ },
+ {
+ "title": "should fail to create immediate reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
+ "duration": 60,
+ "err": {}
+ },
+ {
+ "title": "should fail to create future reservation record with proper error",
+ "fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
+ "duration": 38,
+ "err": {}
+ },
+ {
+ "title": "should successfully destroy all allocations",
+ "fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
+ "duration": 361,
+ "err": {}
+ }
+ ]
+ }
+ Promise- INFO -
+ ****************************************
+ Promise test report
+
+ ****************************************
+ Suites: 23
+ Tests: 33
+ Passes: 33
+ Pending: 0
+ Failures: 0
+ Start: 2016-04-27T02:00:03.021Z
+ End: 2016-04-27T02:00:08.968Z
+ Duration: 5.947
+ ****************************************
+
+vIMS
+^^^^^^^
+::
+
+ FUNCTEST.info: Running vIMS test...
+ 2016-04-27 02:00:26,953 - vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
+ 2016-04-27 02:00:27,734 - vIMS - INFO - Update OpenStack creds informations
+ 2016-04-27 02:00:27,734 - vIMS - INFO - Upload some OS images if it doesn't exist
+ 2016-04-27 02:00:28,202 - vIMS - INFO - centos_7 image doesn't exist on glance repository.
+ Try downloading this image and upload on glance !
+ 2016-04-27 02:01:55,022 - vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
+ Try downloading this image and upload on glance !
+ 2016-04-27 02:03:39,709 - vIMS - INFO - Update security group quota for this tenant
+ 2016-04-27 02:03:40,572 - vIMS - INFO - Update cinder quota for this tenant
+ 2016-04-27 02:03:41,548 - vIMS - INFO - Collect flavor id for cloudify manager server
+ 2016-04-27 02:03:43,403 - vIMS - INFO - Prepare virtualenv for cloudify-cli
+ 2016-04-27 02:04:20,255 - vIMS - INFO - Downloading the cloudify manager server blueprint
+ 2016-04-27 02:04:21,701 - vIMS - INFO - Cloudify deployment Start Time:'2016-04-27 02:04:21'
+ 2016-04-27 02:04:21,701 - vIMS - INFO - Writing the inputs file
+ 2016-04-27 02:04:21,706 - vIMS - INFO - Launching the cloudify-manager deployment
+ 2016-04-27 02:11:57,797 - vIMS - INFO - Cloudify-manager server is UP !
+ 2016-04-27 02:11:57,797 - vIMS - INFO - Cloudify deployment duration:'456.1'
+ 2016-04-27 02:11:57,798 - vIMS - INFO - Collect flavor id for all clearwater vm
+ 2016-04-27 02:12:00,174 - vIMS - INFO - vIMS VNF deployment Start Time:'2016-04-27 02:12:00'
+ 2016-04-27 02:12:00,174 - vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
+ 2016-04-27 02:12:01,517 - vIMS - INFO - Writing the inputs file
+ 2016-04-27 02:12:01,520 - vIMS - INFO - Launching the clearwater deployment
+ 2016-04-27 02:13:46,397 - vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/opnfv-cloudify-clearwater; cfy blueprints upload -b clearwater -p openstack-blueprint.yaml; cfy deployments create -b clearwater -d clearwater-opnfv --inputs inputs.yaml; cfy executions start -w install -d clearwater-opnfv --timeout 1800; '
+ 2016-04-27 02:13:46,398 - vIMS - ERROR - RuntimeError: Workflow failed: Task failed 'nova_plugin.server.start' -> NonRecoverableError('Unexpected server state ERROR:None',)
diff --git a/docs/userguide/index.rst b/docs/userguide/index.rst
index dcca57bef..60bbc5b1a 100644
--- a/docs/userguide/index.rst
+++ b/docs/userguide/index.rst
@@ -350,7 +350,21 @@ The available 33 test cases can be grouped into 7 test suites:
#. Cleanup test allocations: Destroys all allocations in OpenStack.
-
+SDNVPN
+^^^^^^
+Many telecom network functions are relying on layer-3 infrastructure services,
+within a VNF between components, or towards existing external networks.
+In many cases, these external networks are implemented in MPLS/BGP technology in
+existing service provider wide-area-networks (WAN). This proven technology
+provides a good mechanism for inter-operation of a NFV Infrastructure (NFVI)
+and WAN.
+
+The SDNVPN project defined a bgpvpn suite.
+This bgpvpn suite deals with 2 Tempest cases dedicated to the test of the
+OpenStack bgpvpn API:
+
+ * test_create_bgpvpn
+ * test_create_bgpvpn_as_non_admin_fail
.. include:: ./runfunctest.rst
@@ -369,7 +383,6 @@ Test Dashboard
==============
Based on results collected in CI, a test dashboard is dynamically generated.
-The URL of this dashboard is TODO LF
.. include:: ./troubleshooting.rst
diff --git a/docs/userguide/introduction.rst b/docs/userguide/introduction.rst
index 03039ef87..65f8dc48b 100644
--- a/docs/userguide/introduction.rst
+++ b/docs/userguide/introduction.rst
@@ -50,6 +50,11 @@ The current list of test suites can be distributed in 3 main domains: VIM
| | | * Consistent resource state awareness |
| | | (compute), see `Doctor User Guide`_ for |
| | | details |
+| +----------------+-------------------------------------------+
+| | SDNVPN | Implementation of the OpenStack bgpvpn API|
+| | | from the SDNVPN feature project. |
+| | | It allowing the cration of BGP VPNs |
+| | | see SDNVPN User Guide for |
+----------------+----------------+-------------------------------------------+
diff --git a/docs/userguide/runfunctest.rst b/docs/userguide/runfunctest.rst
index 7777e4fde..b7bdda282 100644
--- a/docs/userguide/runfunctest.rst
+++ b/docs/userguide/runfunctest.rst
@@ -37,7 +37,7 @@ several options::
-s|--serial run tests in one thread
-t|--test run specific set of tests
<test_name> one or more of the following separated by comma:
- vping_ssh,vping_userdata,odl,onos,tempest,rally,vims,promise,doctor
+ vping_ssh,vping_userdata,odl,onos,tempest,rally,vims,promise,doctor,bgpvpn
examples:
run_tests.sh
@@ -55,7 +55,7 @@ by default Functest will launch all the test suites in the following order:
1) vPing test cases
2) Tempest suite
3) SDN controller suites
- 4) Feature project tests cases (Promise, Doctor, ...)
+ 4) Feature project tests cases (Promise, Doctor, SDNVPN)
5) vIMS suite
6) Rally suite
@@ -127,7 +127,7 @@ variables:
* The scenario [controller]-[feature]-[mode], stored in DEPLOY_SCENARIO with
* controller = (odl|onos|ocl|nosdn)
- * feature = (ovs(dpdk)|kvm)
+ * feature = (ovs(dpdk)|kvm|sfc|bgpvpn)
* mode = (ha|noha)
The constraints per test case are defined in the Functest configuration file
@@ -169,7 +169,7 @@ The order of execution is also described in the Functest configuration file::
8: promise
9: odl-vpnservice
10: bgpvpn
- 11: openstack-neutron-bgpvpn-api-extension-tests
+ #11: openstack-neutron-bgpvpn-api-extension-tests
12: vims
13: rally
@@ -178,7 +178,7 @@ The tests are executed in the following order:
1) vPing test cases
2) Tempest suite
3) SDN controller suites
- 4) Feature project tests cases (Promise, Doctor, ...)
+ 4) Feature project tests cases (Promise, Doctor, BGPVPN...)
5) vIMS suite
6) Rally suite
diff --git a/docs/userguide/troubleshooting.rst b/docs/userguide/troubleshooting.rst
index 7eb62c6d5..406aaad2a 100644
--- a/docs/userguide/troubleshooting.rst
+++ b/docs/userguide/troubleshooting.rst
@@ -340,3 +340,9 @@ Promise
^^^^^^^
Please refer to the Promise documentation.
+
+
+SDNVPN
+^^^^^^^
+
+Please refer to the SNVPN documentation.