.. This work is licensed under a Creative Commons Attribution 4.0 International License. .. http://creativecommons.org/licenses/by/4.0 Overview of the Functest suites =============================== Functest is the OPNFV project primarily targeting function testing. In the Continuous Integration pipeline, it is launched after an OPNFV fresh installation to validate and verify the basic functions of the infrastructure. The current list of test suites can be distributed over 4 main domains: VIM (Virtualised Infrastructure Manager), Controllers (i.e. SDN Controllers), Features and VNF (Virtual Network Functions). +-------------+---------------+----------------+----------------------------------+ | Domain | Tier | Test case | Comments | +=============+===============+================+==================================+ | VIM | healthcheck | healthcheck | Verify basic operation in VIM | | +---------------+----------------+----------------------------------+ | | smoke | vPing_SSH | NFV "Hello World" using an SSH | | | | | connection to a destination VM | | | | | over a created floating IP | | | | | address on the SUT Public / | | | | | External network. Using the SSH | | | | | connection a test script is then | | | | | copied to the destination | | | | | VM and then executed via SSH. | | | | | The script will ping another | | | | | VM on a specified IP address over| | | | | the SUT Private Tenant network. | | | +----------------+----------------------------------+ | | | vPing_userdata | Uses Ping with given userdata | | | | | to test intra-VM connectivity | | | | | over the SUT Private Tenant | | | | | network. The correct operation | | | | | of the NOVA Metadata service is | | | | | also verified in this test. | | | +----------------+----------------------------------+ | | | tempest_smoke | Generate and run a relevant | | | | \_serial | Tempest Test Suite in smoke mode.| | | | | The generated test set is | | | | | dependent on the OpenStack | | | | | deployment environment. | | | +----------------+----------------------------------+ | | | rally_sanity | Run a subset of the OpenStack | | | | | Rally Test Suite in smoke mode | | +---------------+----------------+----------------------------------+ | | openstack | tempest_full | Generate and run a full set of | | | | \_parallel | the OpenStack Tempest Test Suite.| | | | | See the OpenStack reference test | | | | | suite `[2]`_. The generated | | | | | test set is dependent on the | | | | | OpenStack deployment environment.| | | +----------------+----------------------------------+ | | | rally_full | Run the OpenStack testing tool | | | | | benchmarking OpenStack modules | | | | | See the Rally documents `[3]`_. | +-------------+---------------+----------------+----------------------------------+ | Controllers | sdn_suites | odl | Opendaylight Test suite | | | | | Limited test suite to check the | | | | | basic neutron (Layer 2) | | | | | operations mainly based on | | | | | upstream testcases. See below | | | | | for details | | | +----------------+----------------------------------+ | | | onos | Test suite of ONOS L2 and L3 | | | | | functions. | | | | | See `ONOSFW User Guide`_ for | | | | | details. | +-------------+---------------+----------------+----------------------------------+ | Features | features | Promise | Resource reservation and | | | | | management project to identify | | | | | NFV related requirements and | | | | | realize resource reservation for | | | | | future usage by capacity | | | | | management of resource pools | | | | | regarding compute, network and | | | | | storage. | | | | | See `Promise User Guide`_ for | | | | | details. | | | +----------------+----------------------------------+ | | | Doctor | Doctor platform, as of Colorado | | | | | release, provides the three | | | | | features: | | | | | * Immediate Notification | | | | | * Consistent resource state | | | | | awareness for compute host down | | | | | * Valid compute host status | | | | | given to VM owner | | | | | See `Doctor User Guide`_ for | | | | | details | | | +----------------+----------------------------------+ | | | bgpvpn | Implementation of the OpenStack | | | | | bgpvpn API from the SDNVPN | | | | | feature project. It allows for | | | | | the creation of BGP VPNs. | | | | | See `SDNVPN User Guide`_ for | | | | | details | | | +----------------+----------------------------------+ | | | security_scan | Implementation of a simple | | | | | security scan. (Currently | | | | | available only for the Apex | | | | | installer environment) | | | +----------------+----------------------------------+ | | | onos-sfc | SFC testing for onos scenarios | | | | | TODO See for details | | | +----------------+----------------------------------+ | | | odl-sfc | SFC testing for odl scenarios | | | | | TODO See for details | | | +----------------+----------------------------------+ | | | domino | Domino provides TOSCA template | | | | | distribution service for network | | | | | service and VNF descriptors | | | | | among MANO components e.g., | | | | | NFVO, VNFM, VIM, SDN-C, etc., | | | | | as well as OSS/BSS functions. | | | | | See `Domino User Guide`_ for | | | | | details | | | +----------------+----------------------------------+ | | | copper | Deployment policy | | | | | TODO See for details | | | +----------------+----------------------------------+ | | | multisites | Multisites | | | | | TODO See for details | | | +----------------+----------------------------------+ | | | moon | Security management system | | | | | TODO See for details | +-------------+---------------+----------------+----------------------------------+ | VNF | vnf | vims | Example of a real VNF deployment | | | | | to show the NFV capabilities of | | | | | the platform. The IP Multimedia | | | | | Subsytem is a typical Telco test | | | | | case, referenced by ETSI. | | | | | It provides a fully functional | | | | | VoIP System | + +---------------+----------------+----------------------------------+ | | | parser | Parser is an integration project | | | | | which aims to provide | | | | | placement/deployment templates | | | | | translation for OPNFV platform, | | | | | including TOSCA -> HOT, POLICY ->| | | | | TOSCA and YANG -> TOSCA. | | | | | See `Parser User Guide`_ for | | | | | details | +-------------+---------------+----------------+----------------------------------+ As shown in the above table, Functest is structured into different 'domains', 'tiers' and 'test cases'. Each 'test case' usually represents an actual 'Test Suite' comprised -in turn- of several test cases internally. Test cases also have an implicit execution order. For example, if t