--- tiers: - name: smoke order: 1 description: >- Set of basic Functional tests to validate the OPNFV scenarios. testcases: - case_name: neutron-tempest-plugin-api project_name: functest criteria: 100 blocking: false deny_skipping: true tests_count: 515 description: >- This test case runs the Tempest suite proposed by the Neutron project. The list of test cases is generated by Tempest automatically and depends on the parameters of the OpenStack deployment. run: name: tempest_common args: mode: "(?!.*test_logging)\ (?!.*test_logging_negative)\ (?!.*test_network_segment_range)\ (?!.*test_ports.PortTestCasesResourceRequest)\ (?!.*test_floating_ips.FloatingIPPoolTestJSON)\ (?!.*test_metering_extensions)\ (?!.*test_metering_negative)\ (?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)\ (?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)\ (?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)\ (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)\ (?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)\ (?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)\ (?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)\ (?!.*test_router_interface_fip)\ (?!.*test_security_groups.RbacSharedSecurityGroupTest)\ (?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)\ (?!.*test_qos.QosMinimumBandwidthRuleTestJSON)\ (^neutron_tempest_plugin.api)" option: - '--concurrency=4' - case_name: tempest_cinder project_name: functest criteria: 100 blocking: false deny_skipping: true tests_count: 7 description: >- This test case runs the Tempest suite proposed by the Cinder project. run: name: tempest_common args: mode: "(?!.*test_incremental_backup)\ (?!.*test_consistencygroups)\ (^cinder_tempest_plugin.)" option: - '--concurrency=4' - case_name: tempest_keystone project_name: functest criteria: 100 blocking: false deny_skipping: true tests_count: 38 description: >- This test case runs the Tempest suite proposed by the Keystone project. run: name: tempest_common args: mode: "(?!.*scenario.test_federated_authentication)\ keystone_tempest_plugin." option: - '--concurrency=4' - case_name: rally_sanity project_name: functest criteria: 100 blocking: false description: >- This test case runs a sub group of tests of the OpenStack Rally suite in smoke mode. run: name: rally_sanity args: tests: - 'authenticate' - 'glance' - 'cinder' - 'heat' - 'keystone' - 'neutron' - 'nova' - 'quotas' - 'swift' - case_name: tempest_full project_name: functest criteria: 100 blocking: false deny_skipping: true tests_count: 1293 description: >- The list of test cases is generated by Tempest automatically and depends on the parameters of the OpenStack deployment. https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L83 run: name: tempest_common args: mode: "(?!.*test_fixed_ips)\ (?!.*test_fixed_ips_negative)\ (?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)\ (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)\ (?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)\ (?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)\ (?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)\ (?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)\ (?!.*certificates.test_certificates)\ (?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)\ (?!.*test_novnc)(?!.*test_server_personality)\ (?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)\ (?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)\ (?!.*servers.test_virtual_interfaces)\ (?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)\ (?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)\ (?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)\ (?!.*test_security_group_default_rules)\ (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)\ (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)\ (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)\ (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)\ (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)\ (?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)\ (?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)\ (?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)\ (?!.*compute.test_networks)\ (?!.*test_attach_volume.AttachVolumeMultiAttach)\ (?!.*identity.admin.v2)(?!.*identity.v2)\ (?!.*image.v1)\ (?!.*test_metering_extensions)(?!.*network.test_tags)\ (?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)\ (?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)\ (?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)\ (?!.*test_multi_backend)\ (?!.*test_volume_retype.VolumeRetypeWithMigrationTest)\ (?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)\ (?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)\ (?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)\ (?!.*\\[.*\\bslow\\b.*\\])(^tempest.api)" option: - '--concurrency=4' - case_name: tempest_scenario project_name: functest criteria: 100 blocking: false deny_skipping: true tests_count: 9 description: >- The list of test cases is generated by Tempest automatically and depends on the parameters of the OpenStack deployment. https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84 run: name: tempest_scenario args: mode: "(?!.*test_network_v6)\ (?!.*test_volume_boot_pattern.TestVolumeBootPattern.test_boot_server_from_encrypted_volume_luks)\ (?!.*\\[.*\\bslow\\b.*\\])(^tempest.scenario)" option: - '--concurrency=1' - case_name: tempest_slow project_name: functest criteria: 100 blocking: false deny_skipping: true tests_count: 37 description: >- The list of test cases is generated by Tempest automatically and depends on the parameters of the OpenStack deployment. https://github.com/openstack/tempest/blob/18.0.0/tox.ini#L84 run: name: tempest_common args: mode: "(?!.*test_volume_swap)\ (?!.*test_server_personality)\ (?!.*test_container_sync.ContainerSyncTest.test_container_synchronization)\ (?!.*test_encrypted_cinder_volumes)\ (?!.*test_minbw_allocation_placement)\ (?!.*test_network_v6)\ (?!.*test_stamp_pattern.TestStampPattern.test_stamp_pattern)\ (?!.*test_volume_migrate_attached)\ (?=.*\\[.*\\bslow\\b.*\\])(^tempest.)" option: - '--concurrency=1'