.. This work is licensed under a Creative Commons Attribution 4.0 International License. .. SPDX-License-Identifier: CC-BY-4.0 ======= License ======= OPNFV Danube release note for Functest Docs (c) by Jose Lausuch (Ericsson) OPNFV Danube release note for Functest Docs are licensed under a Creative Commons Attribution 4.0 International License. You should have received a copy of the license along with this. If not, see . =========================================== OPNFV Danube1.0 release note for Functest =========================================== Abstract ======== This document describes the release note of Functest project. Version history =============== +------------+----------+------------------+------------------------+ | **Date** | **Ver.** | **Author** | **Comment** | | | | | | +------------+----------+------------------+------------------------+ | 2016-08-17 | 1.0.0 | Morgan Richomme | Functest for Colorado | | | | (Orange) | release | +------------+----------+------------------+------------------------+ | 2017-03-27 | 4.0.0 | Jose Lausuch | Functest for Danube | | | | (Ericsson) | release | +------------+----------+------------------+------------------------+ OPNFV Danube Release ====================== Functest deals with functional testing of the OPNFV solution. It includes test cases developed within the project and test cases developed in other OPNFV projects and other upstream communities. The internal test cases are: * connection_check * api_check * snaps_health_check * vping_ssh * vping_userdata * tempest_smoke_serial * refstack_defcore * snaps_smoke * rally_sanity * odl * tempest_full_parallel * rally_full * cloudify_ims The OPNFV projects integrated into Functest framework for automation are: * barometer * bgpvpn * doctor * domino * fds * multisite * netready * onos * odl-sfc * odl-netvirt * orchestra_ims * parser * promise * security scan * vyos_vrouter The validation of a scenario requires a subset of these tests depending on the installer and the scenario. The test cases from vnf (cloudify_ims, orchestra_ims, vyos_vrouter) and component categories (tempest full parallel, Rally full) are not considered for scenario validation. Release Data ============ +--------------------------------------+--------------------------------------+ | **Project** | functest | | | | +--------------------------------------+--------------------------------------+ | **Repo/tag** | danube.1.0 | | | | +--------------------------------------+--------------------------------------+ | **Release designation** | Danube base release | | | | +--------------------------------------+--------------------------------------+ | **Release date** | April 3rd 2017 | | | | +--------------------------------------+--------------------------------------+ | **Purpose of the delivery** | Danube base release | | | | +--------------------------------------+--------------------------------------+ Deliverables ============ Software -------- - The Functest Docker image: https://hub.docker.com/r/opnfv/functest (tag: danube.1.0) - The TestAPI Docker image: https://hub.docker.com/r/opnfv/testapi (tag:danube.1.0) Documents --------- - Installation/configuration guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/user/configguide/index.html - User Guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/user/userguide/index.html - Developer Guide: http://docs.opnfv.org/en/latest/submodules/functest/docs/testing/developer/devguide/index.html Version change ============== Feature evolution ----------------- - Adoption of SNAPS as middleware in 4 new test cases (connection_check, api_check, snaps_health_check and snaps_smoke) - Introduction of refstack suite - Support new odl suites (odl-netvirt, fds) - Introduction of VNF onboarding capabilities - Support of new feature projects (fds, netready, barometer, orchestra, vyos_vrouter) Framework --------- - Harmonization of the naming, better adoption of OpenStack coding conventions - Pythonization, rewritting of bash scripts - Introduction of abstraction classes to ease and harmonize the integration of test cases (internal or from feature projects) - New management of logger, env variables and configuration files - Creation of unit tests on the whole framework to ensure stability - Creation or ARM Functest docker Test API --------- - automatic documentation (html & pdf) - full dockerization and automation of the deployment on testresults.opnfv.org - automation of test database backup on artifact Scenario Matrix =============== For Danube 1.0, Functest was tested on the following HA scenarios (new dabube scenarios in bold): +---------------------+---------+---------+---------+---------+ | Scenario | Apex | Compass | Fuel | Joid | +=====================+=========+=========+=========+=========+ | nosdn | X | X | X | X | +---------------------+---------+---------+---------+---------+ | **fdio** | X | | | | +---------------------+---------+---------+---------+---------+ | kvm | X | | X | | +---------------------+---------+---------+---------+---------+ | **kvm_ovs_dpdk** | | | X | | +---------------------+---------+---------+---------+---------+ | **kvm_ovs_dpdk-bar**| | | X | | +------
##############################################################################
# Copyright (c) 2017 Huawei Technologies Co.,Ltd and others.
#
# All rights reserved. This program and the accompanying materials
# are made available under the terms of the Apache License, Version 2.0
# which accompanies this distribution, and is available at
# http://www.apache.org/licenses/LICENSE-2.0
##############################################################################
---
# os-odl_l3-ovs-ha daily task suite

schema: "yardstick:suite:0.1"

name: "os-odl_l3-ovs-ha"
test_cases_dir: "tests/opnfv/test_cases/"
test_cases:
-
  file_name: opnfv_yardstick_tc002.yaml
-
  file_name: opnfv_yardstick_tc005.yaml
-
  file_name: opnfv_yardstick_tc010.yaml
-
  file_name: opnfv_yardstick_tc011.yaml
  constraint:
      installer: compass
-
  file_name: opnfv_yardstick_tc012.yaml
-
  file_name: opnfv_yardstick_tc014.yaml
-
  file_name: opnfv_yardstick_tc037.yaml
-
  file_name: opnfv_yardstick_tc055.yaml
  constraint:
      installer: compass
      pod: huawei-pod1
  task_args:
      huawei-pod1: '{"file": "etc/yardstick/nodes/compass_sclab_physical/pod.yaml",
      "host": "node5"}'
-
  file_name: opnfv_yardstick_tc063.yaml
  constraint:
      installer: compass
      pod: huawei-pod1
  task_args:
      huawei-pod1: '{"file": "etc/yardstick/nodes/compass_sclab_physical/pod.yaml",
      "host": "node5"}'
-
  file_name: opnfv_yardstick_tc069.yaml
-
  file_name: opnfv_yardstick_tc070.yaml
-
  file_name: opnfv_yardstick_tc071.yaml
-
  file_name: opnfv_yardstick_tc072.yaml
-
  file_name: opnfv_yardstick_tc075.yaml
  constraint:
      installer: compass
      pod: huawei-pod1
  task_args:
      huawei-pod1: '{"file": "etc/yardstick/nodes/compass_sclab_physical/pod.yaml",
      "host": "node1"}'
ses.yaml Test results ============ Test results are available in: - test results document: http://artifacts.opnfv.org/functest - jenkins logs on CI: https://build.opnfv.org/ci/view/functest/ - jenkins logs on ARM CI: https://build.opnfv.org/ci/view/armband/ Open JIRA tickets ================= +------------------+-----------------------------------------------+ | JIRA | Description | +==================+===============================================+ ************* TODO ***************************************** | | | | | | +------------------+-----------------------------------------------+ Useful links ============ - wiki project page: https://wiki.opnfv.org/opnfv_functional_testing - wiki Functest Danube page: https://wiki.opnfv.org/display/functest/Functest+Danube - Functest repo: https://git.opnfv.org/cgit/functest - Functest CI dashboard: https://build.opnfv.org/ci/view/functest/ - JIRA dashboard: https://jira.opnfv.org/secure/Dashboard.jspa?selectPageId=10611 - Functest IRC chan: #opnfv-functest - Reporting page: http://testresults.opnfv.org/reporting/danube.html - Functest test configuration: https://git.opnfv.org/cgit/functest/tree/functest/ci/testcases.yaml