From f525b7a55bc592cbb7c62d61128a7eacca1aded1 Mon Sep 17 00:00:00 2001
From: "jose.lausuch" <jose.lausuch@ericsson.com>
Date: Tue, 13 Sep 2016 11:51:00 +0200
Subject: [SDNVPN] Disable Rally Sanity test case for bgpvpn scenarios
Due to a known issue with API performance when bgpvpn extension
is activated which causes some delays and the tests take longer
time than normal, we get a lot of Jenkins Job timeouts and the
scenario cannot be validated.
Since it is a performance issue, we black list rally sanity, which
takes 1 hour to complete and will re-enable it in Colorado.2.0
where ODL Boron release will be available and SDNVPN team
thinks this will be fixed.
Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 642661f2de6afa12268e2d2cb854652f3db10ab8)
---
ci/testcases.yaml | 2 +-
docs/release-notes/functest-release.rst | 10 +++++++++-
2 files changed, 10 insertions(+), 2 deletions(-)
diff --git a/ci/testcases.yaml b/ci/testcases.yaml
index 4fcdd1b02..3b76e139d 100644
--- a/ci/testcases.yaml
+++ b/ci/testcases.yaml
@@ -71,7 +71,7 @@ tiers:
Rally suite in smoke mode.
dependencies:
installer: ''
- scenario: ''
+ scenario: '^((?!bgpvpn).)*$'
-
name: sdn_suites
diff --git a/docs/release-notes/functest-release.rst b/docs/release-notes/functest-release.rst
index 9623b43d4..816ed74c9 100644
--- a/docs/release-notes/functest-release.rst
+++ b/docs/release-notes/functest-release.rst
@@ -251,7 +251,15 @@ Colorado known restrictions/issues
+-----------+-----------+----------------------------------------------+
| apex/fuel | *-bgpvpn | vPing_ssh (floating ips not supported) and |
| | | vIMS excluded. Some Tempest cases related to |
-| | | floating ips also excluded. |
+| | | floating ips also excluded. Some performance |
+| | | issues have been detected in this scenario |
+| | | (i.e. BGPVPN extension enabled) when running |
+| | | commands against the OpenStack APIs, thus |
+| | | Rally sanity test case has been disabled. |
+| | | Performance issues seem to be connected to |
+| | | the ODL version. It is planned to reintroduce|
+| | | Rally sanity in Colorado 2.0 with the |
+| | | adoption of ODL Boron release. |
+-----------+-----------+----------------------------------------------+
| compass | moon | First ODL test FAILS because ODL/Openstack |
| | | federation done in moon is partial. Only |
--
cgit