diff options
| author |   Cédric Ollivier <cedric.ollivier@orange.com> | 2018-02-04 14:01:12 +0100 |
|---|---|---|
| committer | Cédric Ollivier <cedric.ollivier@orange.com> | 2018-02-04 14:06:52 +0100 |
| commit | e556a792b6b0c7275c20c779688f4ffc383b7f2a (patch) | |
| tree | 7ac6b9dc3c386a5b12d8d3297bf5d8c798da3b2b /docs/testing | |
| parent | ae96d483a99cfa2506128abcbf6b72d890407089 (diff) | |
Update results printed in configguide.rststable/euphrates
It mainly takes into account that:
- vyos_vrouter is now available in functest-vnf
- all orchestra testcases are mostly disabled
- odl is skipped if os-nosdn-nofeature-ha
Change-Id: Idc92cc82a1656d9118d080eeb1f7e1fc80f6296e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
Diffstat (limited to 'docs/testing')
| -rw-r--r-- | docs/testing/user/configguide/configguide.rst | 131 |
1 files changed, 66 insertions, 65 deletions
diff --git a/docs/testing/user/configguide/configguide.rst b/docs/testing/user/configguide/configguide.rst index 2ee5d9e79..14b31b169 100644 --- a/docs/testing/user/configguide/configguide.rst +++ b/docs/testing/user/configguide/configguide.rst @@ -122,7 +122,7 @@ Results shall be displayed as follows:: | rally_sanity | functest | smoke | 19:42 | PASS | | refstack_defcore | functest | smoke | 22:00 | PASS | | snaps_smoke | functest | smoke | 41:14 | PASS | - | odl | functest | smoke | 00:16 | PASS | + | odl | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | | fds | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ @@ -141,16 +141,16 @@ Run features suite:: Results shall be displayed as follows:: - +---------------------------+--------------------------+------------------+------------------+----------------+ - | TEST CASE | PROJECT | TIER | DURATION | RESULT | - +---------------------------+--------------------------+------------------+------------------+----------------+ - | promise | promise | features | 00:00 | SKIP | - | bgpvpn | sdnvpn | features | 00:00 | SKIP | - | security_scan | securityscanning | features | 00:00 | SKIP | - | functest-odl-sfc | sfc | features | 00:00 | SKIP | - | domino-multinode | domino | features | 00:00 | SKIP | - | barometercollectd | barometer | features | 00:00 | SKIP | - +---------------------------+--------------------------+------------------+------------------+----------------+ + +-----------------------------+-------------------+------------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +-----------------------------+-------------------+------------------+------------------+----------------+ + | domino-multinode | domino | features | 00:23 | PASS | + | promise | promise | features | 00:00 | SKIP | + | doctor-notification | doctor | features | 00:00 | SKIP | + | bgpvpn | sdnvpn | features | 00:00 | SKIP | + | functest-odl-sfc | sfc | features | 00:00 | SKIP | + | barometercollectd | barometer | features | 00:00 | SKIP | + +-----------------------------+-------------------+------------------+------------------+----------------+ Note: if the scenario does not support some tests, they are indicated as SKIP. See User guide for details. @@ -185,13 +185,14 @@ sudo docker run --env-file env \ Results shall be displayed as follows:: - +---------------------------------+------------------+--------------+------------------+----------------+ - | TEST CASE | PROJECT | TIER | DURATION | RESULT | - +---------------------------------+------------------+--------------+------------------+----------------+ - | cloudify_ims | functest | vnf | 21:25 | PASS | - | orchestra_openims | functest | vnf | 11:02 | FAIL | - | orchestra_clearwaterims | functest | vnf | 09:13 | FAIL | - +---------------------------------+------------------+--------------+------------------+----------------+ + +---------------------------------+-------------------+--------------+------------------+----------------+ + | TEST CASE | PROJECT | TIER | DURATION | RESULT | + +---------------------------------+-------------------+--------------+------------------+----------------+ + | cloudify_ims | functest | vnf | 40:07 | PASS | + | vyos_vrouter | functest | vnf | 18:36 | PASS | + | orchestra_openims | orchestra | vnf | 00:00 | SKIP | + | orchestra_clearwaterims | orchestra | vnf | 00:00 | SKIP | + +---------------------------------+-------------------+--------------+------------------+----------------+ Environment variables @@ -402,58 +403,58 @@ The structure of functest repo can be described as follows:: | |-- models.py | `-- swagger |-- ci - │ |-- check_deployment.py - │ |-- config_aarch64_patch.yaml - │ |-- config_functest.yaml - │ |-- config_patch.yaml - │ |-- download_images.sh - │ |-- logging.ini - │ |-- prepare_env.py - │ |-- rally_aarch64_patch.conf - │ |-- run_tests.py - │ |-- testcases.yaml - │ |-- tier_builder.py - │ |-- tier_handler.py + │ |-- check_deployment.py + │ |-- config_aarch64_patch.yaml + │ |-- config_functest.yaml + │ |-- config_patch.yaml + │ |-- download_images.sh + │ |-- logging.ini + │ |-- prepare_env.py + │ |-- rally_aarch64_patch.conf + │ |-- run_tests.py + │ |-- testcases.yaml + │ |-- tier_builder.py + │ |-- tier_handler.py |-- cli - │ |-- cli_base.py - │ |-- commands - │ │ |-- cli_env.py - │ │ |-- cli_os.py - │ │ |-- cli_testcase.py - │ │ |-- cli_tier.py - │ |-- functest-complete.sh + │ |-- cli_base.py + │ |-- commands + │ │ |-- cli_env.py + │ │ |-- cli_os.py + │ │ |-- cli_testcase.py + │ │ |-- cli_tier.py + │ |-- functest-complete.sh |-- core - │ |-- feature.py - │ |-- testcase.py - │ |-- unit.py - │ |-- vnf.py + │ |-- feature.py + │ |-- testcase.py + │ |-- unit.py + │ |-- vnf.py |-- energy - │ |-- energy.py + │ |-- energy.py |-- opnfv_tests - │ `-- openstack - │ |-- rally - │ |-- refstack_client - │ |-- snaps - │ |-- tempest - │ |-- vping - │ `-- sdn - │ │ `-- odl - │ `-- vnf - │ |-- ims - │ `-- router + │ `-- openstack + │ |-- rally + │ |-- refstack_client + │ |-- snaps + │ |-- tempest + │ |-- vping + │ `-- sdn + │ │ `-- odl + │ `-- vnf + │ |-- ims + │ `-- router |-- tests - │ `-- unit - │ |-- ci - │ |-- cli - │ |-- core - │ |-- energy - │ |-- features - │ |-- odl - │ |-- openstack - │ |-- opnfv_tests - │ |-- test_utils.py - │ |-- utils - │ `-- vnf + │ `-- unit + │ |-- ci + │ |-- cli + │ |-- core + │ |-- energy + │ |-- features + │ |-- odl + │ |-- openstack + │ |-- opnfv_tests + │ |-- test_utils.py + │ |-- utils + │ `-- vnf |-- utils | |-- config.py | |-- constants.py |