.. This work is licensed under a Creative Commons Attribution 4.0 International License. .. http://creativecommons.org/licenses/by/4.0 Executing the functest suites ============================= Manual testing -------------- This section assumes the following: * The Functest Docker container is running * The docker prompt is shown * The Functest environment is ready (Functest CLI command 'functest env prepare' has been executed) If any of the above steps are missing please refer to the Functest Config Guide as they are a prerequisite and all the commands explained in this section **must** be performed **inside the container**. Note: In Colorado release, the scripts **run_tests.sh** is now replaced with a new Functest CLI. One difference, is that tests run through the Functest CLI will always clean-up OpenStack resources. See the `Troubleshooting`_ section of this document, where this difference is discussed. The Functest CLI offers two commands (functest tier ...) and (functest testcase ... ) for the execution of Test Tiers or Test Cases:: root@22e436918db0:~/repos/functest/ci# functest tier --help Usage: functest tier [OPTIONS] COMMAND [ARGS]... Options: -h, --help Show this message and exit. Commands: get-tests Prints the tests in a tier. list Lists the available tiers. run Executes all the tests within a tier. show Shows information about a tier. root@22e436918db0:~/repos/functest/ci# functest testcase --help Usage: functest testcase [OPTIONS] COMMAND [ARGS]... Options: -h, --help Show this message and exit. Commands: list Lists the available testcases. run Executes a test case. show Shows information about a test case. More details on the existing Tiers and Test Cases can be seen with the 'list' command:: root@22e436918db0:~/repos/functest/ci# functest tier list - 0. healthcheck: ['healthcheck'] - 1. smoke: ['vping_ssh', 'vping_userdata', 'tempest_smoke_serial', 'rally_sanity'] - 2. sdn_suites: ['odl'] - 3. features: ['doctor', 'security_scan'] - 4. openstack: ['tempest_full_parallel', 'rally_full'] - 5. vnf: ['vims'] and root@22e436918db0:~/repos/functest/ci# functest testcase list healthcheck vping_ssh vping_userdata tempest_smoke_serial rally_sanity odl doctor security_scan tempest_full_parallel rally_full vims More specific details on specific Tiers or Test Cases can be seen wih the 'show' command:: root@22e436918db0:~/repos/functest/ci# functest tier show smoke +======================================================================+ | Tier: smoke | +======================================================================+ | Order: 1 | | CI Loop: (daily)|(weekly) | | Description: | | Set of basic Functional tests to validate the OpenStack | | deployment. | | Test cases: | | - vping_ssh | | - vping_userdata | | - tempest_smoke_serial | | - rally_sanity | | | +----------------------------------------------------------------------+ and root@22e436918db0:~/repos/functest/ci# functest testcase show tempest_smoke_serial +======================================================================+ | Testcase: tempest_smoke_serial | +======================================================================+ | Description: | | This test case runs the smoke subset of the OpenStack Tempest | | suite. The list of test cases is generated by Tempest | | automatically and depends on the parameters of the OpenStack | | deplopyment. | | Dependencies: | | - Installer: | | - Scenario : | | | +----------------------------------------------------------------------+ To execute a Test Tier or Test Case, the 'r
##############################################################################
# Copyright (c) 2017 Huawei Technologies Co.,Ltd and others.
#
# All rights reserved. This program and the accompanying materials
# are made available under the terms of the Apache License, Version 2.0
# which accompanies this distribution, and is available at
# http://www.apache.org/licenses/LICENSE-2.0
##############################################################################
---
# Fuel integration test task suite
schema: "yardstick:suite:0.1"
name: "fuel_test_suite"
test_cases_dir: "samples/"
test_cases:
-
file_name: ping.yaml
-
file_name: iperf3.yaml