From eb8f57466325f398c6b8b5f4d15005c71879a269 Mon Sep 17 00:00:00 2001 From: Cédric Ollivier Date: Tue, 3 Jul 2018 15:28:38 +0200 Subject: Refactor tempest common MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit It also renames two testcases and updates all docs because tests run in parallel in case of tempest smoke. To force one thread as before: run: module: 'functest.opnfv_tests.openstack.tempest.tempest' class: 'TempestCommon' args: mode: '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' option: - '--concurrency=1' JIRA: FUNCTEST-989 Change-Id: I1348f5908400a5046be8edf983db4afa12e546c3 Signed-off-by: Cédric Ollivier --- docs/release/release-notes/functest-release.rst | 2 +- docs/testing/developer/devguide/index.rst | 4 ++-- docs/testing/user/userguide/reporting.rst | 2 +- docs/testing/user/userguide/test_details.rst | 11 ++++------- docs/testing/user/userguide/test_overview.rst | 2 +- docs/testing/user/userguide/troubleshooting.rst | 3 +-- 6 files changed, 10 insertions(+), 14 deletions(-) (limited to 'docs') diff --git a/docs/release/release-notes/functest-release.rst b/docs/release/release-notes/functest-release.rst index 1c6ef227c..bb7600d35 100644 --- a/docs/release/release-notes/functest-release.rst +++ b/docs/release/release-notes/functest-release.rst @@ -34,7 +34,7 @@ The internal test cases are: * odl * snaps_smoke * neutron_trunk - * tempest_full_parallel + * tempest_full * rally_full * cloudify_ims * vyos_vrouter diff --git a/docs/testing/developer/devguide/index.rst b/docs/testing/developer/devguide/index.rst index aabd72d4c..caa1ccb3b 100644 --- a/docs/testing/developer/devguide/index.rst +++ b/docs/testing/developer/devguide/index.rst @@ -90,8 +90,8 @@ The internal test cases in Euphrates are: * odl * rally_full * rally_sanity - * tempest_smoke_serial - * tempest_full_parallel + * tempest_smoke + * tempest_full * cloudify_ims By internal, we mean that this particular test cases have been developed and/or diff --git a/docs/testing/user/userguide/reporting.rst b/docs/testing/user/userguide/reporting.rst index 337c203db..7c8c48ece 100644 --- a/docs/testing/user/userguide/reporting.rst +++ b/docs/testing/user/userguide/reporting.rst @@ -25,7 +25,7 @@ and features) corresponding to this scenario. +---------------------+---------+---------+---------+---------+ | vPing_userdata | X | X | X | X | +---------------------+---------+---------+---------+---------+ - | tempest_smoke_serial| X | X | X | X | + | tempest_smoke | X | X | X | X | +---------------------+---------+---------+---------+---------+ | rally_sanity | X | X | X | X | +---------------------+---------+---------+---------+---------+ diff --git a/docs/testing/user/userguide/test_details.rst b/docs/testing/user/userguide/test_details.rst index 688b67431..992b546f5 100644 --- a/docs/testing/user/userguide/test_details.rst +++ b/docs/testing/user/userguide/test_details.rst @@ -166,17 +166,14 @@ console output is stored to a *log* file for further analysis. The Tempest testcases are distributed across three Tiers: - * Smoke Tier - Test Case 'tempest_smoke_serial' - * Components Tier - Test case 'tempest_full_parallel' + * Smoke Tier - Test Case 'tempest_smoke' + * Components Tier - Test case 'tempest_full' * Neutron Trunk Port - Test case 'neutron_trunk' * OpenStack interop testcases - Test case 'refstack_defcore' * Testing and verifying RBAC policy enforcement - Test case 'patrole' -NOTE: Test case 'tempest_smoke_serial' executes a defined set of tempest smoke -tests with a single thread (i.e. serial mode). Test case -'tempest_full_parallel' executes all defined Tempest tests using several -concurrent threads (i.e. parallel mode). The number of threads activated -corresponds to the number of available logical CPUs. +NOTE: Test case 'tempest_smoke' executes a defined set of tempest smoke +tests. Test case 'tempest_full' executes all defined Tempest tests. NOTE: The 'neutron_trunk' test set allows to connect a VM to multiple VLAN separated networks using a single NIC. The feature neutron trunk ports have diff --git a/docs/testing/user/userguide/test_overview.rst b/docs/testing/user/userguide/test_overview.rst index d85668687..2ff14f732 100644 --- a/docs/testing/user/userguide/test_overview.rst +++ b/docs/testing/user/userguide/test_overview.rst @@ -55,7 +55,7 @@ validate the scenario for the release. | | +------------+----------------------------------+ | | | tempest | Generate and run a relevant | | |               | \_smoke | Tempest Test Suite in smoke mode.| -| | | \_serial | The generated test set is | +| | | | The generated test set is | | | | | dependent on the OpenStack | | | | | deployment environment | | | +------------+----------------------------------+ diff --git a/docs/testing/user/userguide/troubleshooting.rst b/docs/testing/user/userguide/troubleshooting.rst index 375b6ed28..5755544e6 100644 --- a/docs/testing/user/userguide/troubleshooting.rst +++ b/docs/testing/user/userguide/troubleshooting.rst @@ -20,8 +20,7 @@ VIM --- This section covers the test cases related to the VIM (healthcheck, vping_ssh, -vping_userdata, tempest_smoke_serial, tempest_full_parallel, rally_sanity, -rally_full). +vping_userdata, tempest_smoke, tempest_full, rally_sanity, rally_full). vPing common ^^^^^^^^^^^^ -- cgit 1.2.3-korg