From f525b7a55bc592cbb7c62d61128a7eacca1aded1 Mon Sep 17 00:00:00 2001 From: "jose.lausuch" Date: Tue, 13 Sep 2016 11:51:00 +0200 Subject: [SDNVPN] Disable Rally Sanity test case for bgpvpn scenarios Due to a known issue with API performance when bgpvpn extension is activated which causes some delays and the tests take longer time than normal, we get a lot of Jenkins Job timeouts and the scenario cannot be validated. Since it is a performance issue, we black list rally sanity, which takes 1 hour to complete and will re-enable it in Colorado.2.0 where ODL Boron release will be available and SDNVPN team thinks this will be fixed. Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4 Signed-off-by: jose.lausuch (cherry picked from commit 642661f2de6afa12268e2d2cb854652f3db10ab8) --- ci/testcases.yaml | 2 +- docs/release-notes/functest-release.rst | 10 +++++++++- 2 files changed, 10 insertions(+), 2 deletions(-) diff --git a/ci/testcases.yaml b/ci/testcases.yaml index 4fcdd1b02..3b76e139d 100644 --- a/ci/testcases.yaml +++ b/ci/testcases.yaml @@ -71,7 +71,7 @@ tiers: Rally suite in smoke mode. dependencies: installer: '' - scenario: '' + scenario: '^((?!bgpvpn).)*$' - name: sdn_suites diff --git a/docs/release-notes/functest-release.rst b/docs/release-notes/functest-release.rst index 9623b43d4..816ed74c9 100644 --- a/docs/release-notes/functest-release.rst +++ b/docs/release-notes/functest-release.rst @@ -251,7 +251,15 @@ Colorado known restrictions/issues +-----------+-----------+----------------------------------------------+ | apex/fuel | *-bgpvpn | vPing_ssh (floating ips not supported) and | | | | vIMS excluded. Some Tempest cases related to | -| | | floating ips also excluded. | +| | | floating ips also excluded. Some performance | +| | | issues have been detected in this scenario | +| | | (i.e. BGPVPN extension enabled) when running | +| | | commands against the OpenStack APIs, thus | +| | | Rally sanity test case has been disabled. | +| | | Performance issues seem to be connected to | +| | | the ODL version. It is planned to reintroduce| +| | | Rally sanity in Colorado 2.0 with the | +| | | adoption of ODL Boron release. | +-----------+-----------+----------------------------------------------+ | compass | moon | First ODL test FAILS because ODL/Openstack | | | | federation done in moon is partial. Only | -- cgit 1.2.3-korg