summaryrefslogtreecommitdiffstats
path: root/docs/testing/user/testspecification/vnf/index.rst
blob: 43f6cd0c1a9b287f16f74570201851b25e03e80c (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
.. This work is licensed under a Creative Commons Attribution 4.0 International License.
.. http://creativecommons.org/licenses/by/4.0
.. (c) Ericsson AB

======================
VNF test specification
======================

.. toctree::
   :maxdepth: 2

Scope
=====

The VNF test area evaluates basic NFV capabilities of the system under test.
These capabilities include creating a small number of virtual machines,
establishing the SUT VNF, VNFs which are going to support the test activities
and an Orchestrator as well as verifying the proper behavior of the basic VNF.


References
==========

This test area references the following specifications and guides:

- Functest repo for detailed description of the below testcases

  - https://github.com/opnfv/functest/blob/master/docs/testing/user/userguide/test_details.rst

- 3GPP LTE

  - http://www.3gpp.org/technologies/keywords-acronyms/98-lte

- ETSI -  TS 24.301

  - https://www.etsi.org/deliver/etsi_ts/124300_124399/124301/10.03.00_60/ts_124301v100300p.pdf

- ABoT : Test Orchestration Solution

  - https://www.rebaca.com/abot-test-orchestration-tool/


Definitions and abbreviations
=============================

The following terms and abbreviations are used in conjunction with this test
area

- 3GPP - 3rd Generation Partnership Project
- EPC - Evolved Packet Core
- ETSI - European Telecommunications Standards Institute
- LTE - Long Term Evolution
- NFV - Network functions virtualization
- OAI - Open Air Interface
- TS - Technical Specifications
- VM - Virtual machine
- VNF - Virtual Network Function



System Under Test (SUT)
=======================

The system under test is assumed to be the VNF and VIM in operation on a
Pharos compliant infrastructure.


Test Area Structure
===================

The test area is structured in two separate tests which are executed
sequentially. The order of the tests is arbitrary as there are no dependencies
across the tests. Specifically, every test performs clean-up operations which
return the system to the same state as before the test.


Test Descriptions
=================

----------------------------------------------------------------
Test Case 1 - vEPC
----------------------------------------------------------------

Short name
----------

dovetail.vnf.vepc


Use case specification
----------------------

The Evolved Packet Core (EPC) is the main component of the System Architecture
Evolution (SAE) which forms the core of the 3GPP LTE specification.

vEPC has been integrated in Functest to demonstrate the capability to deploy
a complex mobility-specific NFV scenario on the OPNFV platform. The OAI EPC
supports most of the essential functions defined by the 3GPP Technical Specs;
hence the successful execution of functional tests on the OAI EPC provides a
good endorsement of the underlying NFV platform.


Test preconditions
------------------

At least one compute node is available. No further pre-configuration needed.


Basic test flow execution description and pass/fail criteria
------------------------------------------------------------

Methodology for verifying connectivity
''''''''''''''''''''''''''''''''''''''

This integration also includes ABot, a Test Orchestration system that enables
test scenarios to be defined in high-level DSL. ABot is also deployed as a VM
on the OPNFV platform; and this provides an example of the automation driver
and the Test VNF being both deployed as separate VNFs on the underlying OPNFV
platform.


Test execution
''''''''''''''
* Test action 1: Deploy Juju controller (VNF Manager) using Bootstrap command.
* Test action 2: Deploy ABot (Orchestrator) and OAI EPC as Juju charms.
  Configuration of ABot and OAI EPC components is handled through built-in Juju
  relations.
* Test action 3: Execution of ABot feature files triggered by Juju actions.
  This executes a suite of LTE signalling tests on the OAI EPC.
* Test action 4: ABot test results are parsed accordingly.
* Test action 5: The deployed VMS are deleted.


Pass / fail criteria
''''''''''''''''''''

The VNF Manager (juju) should be deployed successfully

Test executor (ABot), test Orchestration system is deployed and enables test
scenarios to be defined in high-level DSL

VMs which are act as VNFs (including the VNF that is the SUT for test case) are
following the 3GPP technical specifications accordingly.


Post conditions
---------------

The clean-up operations are run.