Adding Posca Testsuite in Bottlenecks

JIRA: BOTTLENECK-92

The POSCA (Parametric Bottlenecks Testing Catalogue) testsuite
classifies the bottlenecks test cases and results into 5 categories.
Then the results will be analyzed and decoupled  bottlenecks will be
searched among these categories.

The POSCA testsuite aims to locate the bottlenecks in parmetric
manner and to decouple the bottlenecks regarding the deployment
requirements.

The POSCA testsuite provides an user friendly way to profile and
understand the E2E system behavior and deployment requirements.

Goals of the POSCA testsuite:
a) Automatically locate the bottlenecks in a iterative manner.
b) Automatically generate the testing report for bottlenecks in
   different categories.
c) Implementing Automated Staging.

Scopes of the POSCA testsuite:
a) Modeling, Testing and Test Result analysis.
b) Parameters choosing and Algorithms

Test stories of the POSCA testsuite:
a) Factor test: base test cases that Feature test and Optimization
   will be dependant on
b) Feature test: test cases for features/scenarios
c) Optimization test: test to tune the system parameter

For more details of the proposal, please refer to
https://jira.opnfv.org/secure/attachment/11479/
POSCA%20Testsuite%20Proposal%20in%20Bottlenecks.pdf

Changes:

1. Add Posca testsuite directories and files to Bottleneks,
leaving adding test cases for latter commits.

2. Fix file appd issue.

3. Delete the un-used packages in testsuites/posca/run_posca.py

4. Add testcase processing logic to run_posca.py

5. Add config dimensions

6. Add scripts directory

Change-Id: I54d9b51381a804b76a83680912227e058da3165e
Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>

1 files changed, 21 insertions, 1 deletions

diff --git a/run_tests.sh b/run_tests.sh
index d5c30592..ad0b31c5 100755
--- a/run_tests.sh
+++ b/run_tests.sh
@@ -26,7 +26,7 @@ examples:
 
 report=true
 
-arr_test_suite=(rubbos vstf)
+arr_test_suite=(rubbos vstf posca)
 
 function check_testcase(){
 
@@ -38,6 +38,9 @@ function check_testcase(){
          "-vstf")
              SUITE_PREFIX=$SUITE_PREFIX_CONFIG/vstf/testcase_cfg
          ;;
+         "-posca")
+             SUITE_PREFIX=$SUITE_PREFIX_CONFIG/posca/testcase_cfg
+         ;;
     esac
 
     TEST_CASE=$2
@@ -99,6 +102,23 @@ function run_test(){
                 python /home/opnfv/bottlenecks/testsuites/vstf/run_vstf.py -c $file
             done
         ;;
+        "posca")
+            info "Running posca test suite"
+            test_file="/home/opnfv/bottlenecks/testsuites/posca/testsuite_story/posca_factor_test"
+            if [[ -f $test_file ]]; then
+                testcases=($(cat $test_file))
+            else
+                error "no posca test suite file "
+            fi
+            for i in "${testcases[@]}"; do
+                #check if the testcase is legal or not
+                check_testcase -posca $i
+                #adjust config parameters
+                #run test case
+                file=${BASEDIR}/testsuites/posca/testcase_cfg/${i}.yaml
+                python /home/opnfv/bottlenecks/testsuites/posca/run_posca.py -c $file
+            done
+        ;;
     esac
 }