summaryrefslogtreecommitdiffstats
path: root/docs/results/results.rst
blob: f3831b8651eff3e8fd001fab387790e5905849cf (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
.. This work is licensed under a Creative Commons Attribution 4.0 International
.. License.
.. http://creativecommons.org/licenses/by/4.0


======================
Yardstick Test Results
======================

.. toctree::
   :maxdepth: 2


Scenario Results
================

.. _Dashboard: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main
.. _Jenkins: https://build.opnfv.org/ci/view/yardstick/

The following documents contain results of Yardstick test cases executed on
OPNFV labs, triggered by OPNFV CI pipeline, documented per scenario.


Ready scenarios
---------------

The following scenarios run at least four consecutive times Yardstick test
cases suite:

.. toctree::
   :maxdepth: 1

   apex-os-odl_l2-nofeature-ha.rst
   compass-os-nosdn-nofeature-ha.rst
   compass-os-odl_l2-nofeature-ha.rst
   compass-os-onos-nofeature-ha.rst
   fuel-os-nosdn-nofeature-ha.rst
   fuel-os-odl_l2-nofeature-ha.rst
   fuel-os-onos-nofeature-ha.rst
   fuel-os-nosdn-kvm-ha
   joid-os-odl_l2-nofeature-ha.rst


Limitations
-----------

For the following scenarios, Yardstick generic test cases suite was executed at
least one time however less than four consecutive times, measurements
collected:


   * fuel-os-odl_l2-bgpvpn-ha

   * fuel-os-odl_l3-nofeature-ha

   * joid-os-nosdn-nofeature-ha

   * joid-os-onos-nofeature-ha


For the following scenario, Yardstick generic test cases suite was executed
four consecutive times, measurements collected; no feature test cases were
executed, therefore the feature is not verified by Yardstick:

    * apex-os-odl_l2-bgpvpn-ha


For the following scenario, Yardstick generic test cases suite was executed
three consecutive times, measurements collected; no feature test cases
were executed, therefore the feature is not verified by Yardstick:

    * fuel-os-odl_l2-sfc-ha


Test results of executed tests are avilable in Dashboard_ and logs in Jenkins_.



Feature Test Results
====================

The following features were verified by Yardstick test cases:

   * IPv6

   * HA (see :doc:`yardstick-opnfv-ha`)

   * KVM

   * Parser

   * Virtual Traffic Classifier (see :doc:`yardstick-opnfv-vtc`)

.. note:: The test cases for IPv6 and Parser Projects are included in the
  compass scenario.