summaryrefslogtreecommitdiffstats
path: root/ci/testcases.yaml
diff options
context:
space:
mode:
authorMorgan Richomme <morgan.richomme@orange.com>2016-06-02 07:41:44 +0000
committerGerrit Code Review <gerrit@172.30.200.206>2016-06-02 07:41:44 +0000
commit7a55bacfa9d2c2fff84904578e7ebff0eb4cfb09 (patch)
treeb37a243958b78ec30e04833ed8d57a6790549710 /ci/testcases.yaml
parent5bf1647dec6860464eeb082b2875798f0759aa91 (diff)
parent69fe5baee1cfb9f55c798620dda3151eab700bc7 (diff)
Merge "Add criteria in testcases.yaml and Test class"
Diffstat (limited to 'ci/testcases.yaml')
-rw-r--r--ci/testcases.yaml15
1 files changed, 15 insertions, 0 deletions
diff --git a/ci/testcases.yaml b/ci/testcases.yaml
index 4cbc00add..4281f73ce 100644
--- a/ci/testcases.yaml
+++ b/ci/testcases.yaml
@@ -9,6 +9,7 @@ tiers:
testcases:
-
name: healthcheck
+ criteria: 'status == "PASS"'
description: >-
This test case verifies the basic OpenStack services like
Keystone, Glance, Cinder, Neutron and Nova.
@@ -26,6 +27,7 @@ tiers:
testcases:
-
name: vping_ssh
+ criteria: 'status == "PASS"'
description: >-
This test case verifies: 1) SSH to an instance using floating
IPs over the public network. 2) Connectivity between 2 instances
@@ -36,6 +38,7 @@ tiers:
-
name: vping_userdata
+ criteria: 'status == "PASS"'
description: >-
This test case verifies: 1) Boot a VM with given userdata.
2) Connectivity between 2 instances over a private network.
@@ -45,6 +48,7 @@ tiers:
-
name: tempest_smoke_serial
+ criteria: 'success_rate == 100%'
description: >-
This test case runs the smoke subset of the OpenStack
Tempest suite. The list of test cases is generated by
@@ -56,6 +60,7 @@ tiers:
-
name: rally_sanity
+ criteria: 'success_rate == 100%'
description: >-
This test case runs a sub group of tests of the OpenStack
Rally suite in smoke mode.
@@ -73,6 +78,7 @@ tiers:
testcases:
-
name: odl
+ criteria: 'success_rate == 100%'
description: >-
Test Suite for the OpenDaylight SDN Controller. It integrates
some test suites from upstream using Robot as the test
@@ -83,6 +89,7 @@ tiers:
-
name: onos
+ criteria: 'status == "PASS"'
description: >-
Test Suite for the ONOS SDN Controller. It integrates
some test suites from upstream using TestON as the test
@@ -93,6 +100,7 @@ tiers:
-
name: ovno
+ criteria: 'status == "PASS"'
description: >-
Test Suite for the Open Contrail SDN Controller.
framework.
@@ -110,6 +118,7 @@ tiers:
testcases:
-
name: promise
+ criteria: 'success_rate == 100%'
description: >-
Test suite from Promise project.
dependencies:
@@ -118,6 +127,7 @@ tiers:
-
name: doctor
+ criteria: 'status == "PASS"'
description: >-
Test suite from Doctor project.
dependencies:
@@ -126,6 +136,7 @@ tiers:
-
name: bgpvpn
+ criteria: 'status == "PASS"'
description: >-
Test suite from SDNVPN project.
dependencies:
@@ -134,6 +145,7 @@ tiers:
-
name: security_scan
+ criteria: 'status == "PASS"'
description: >-
Simple security Scan
dependencies:
@@ -149,6 +161,7 @@ tiers:
testcases:
-
name: tempest_full_parallel
+ criteria: 'success_rate >= 80%'
description: >-
The list of test cases is generated by
Tempest automatically and depends on the parameters of
@@ -159,6 +172,7 @@ tiers:
-
name: rally_full
+ criteria: 'success_rate >= 90%'
description: >-
This test case runs the full suite of scenarios of the OpenStack
Rally suite using several threads and iterations.
@@ -175,6 +189,7 @@ tiers:
testcases:
-
name: vims
+ criteria: 'status == "PASS"'
description: >-
This test case deploys an OpenSource vIMS solution from Clearwater
using the Cloudify orchestrator. It also runs some signaling traffic.