summaryrefslogtreecommitdiffstats
path: root/ci/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2016-09-21Add odl_sfc test in apex as the scenario is runMorgan Richomme1-1/+1
Change-Id: I81a74a9f7c6ae54ba1b2be7ec27a11ae3a2392b9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 4de89d461ca0df0bd88c56a0f0eeedaf358ba345)
2016-09-20Remove parser test case from bgpvpn scenariosjose.lausuch1-1/+2
Due to the same performance issue encountered in bgpvpn scenarios, Jenkins still times out and can't have a summary of all the tests and upload logs to artifacts. The removal of this test case will affect only Colorado 1.0, and will be reactivated in Colorado 2.0 with ODL Boron. Change-Id: Ic2d8cc43a1a732daa063aa7c01a309a3dfa2050d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 1f156fc7881491d2a557e54e43178d46bc3d69a1)
2016-09-15Exclude Doctor from Functest for fuel scenariosMorgan Richomme1-1/+1
Doctor, as part of the feature project, is FAIL on fuel scenarios JIRA: FUNCTEST-192 Change-Id: Ic5b9b4afe80fbb2d5887bdf46410a0fc72e7be37 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 3097840a4cf0d4c4a32ce24b38af4cc2c601526b)
2016-09-14Exclude copper, doctor and security_scan from apex/fdio scenariosMorgan Richomme1-3/+3
JIRA: FUNCTEST-475 Change-Id: I720b9d88db94d66f067601608ab2d1435fc93d47 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 81c7246253d97ec07a10a01b528b3ef99b2281f4)
2016-09-13[SDNVPN] Disable Rally Sanity test case for bgpvpn scenariosjose.lausuch1-1/+1
Due to a known issue with API performance when bgpvpn extension is activated which causes some delays and the tests take longer time than normal, we get a lot of Jenkins Job timeouts and the scenario cannot be validated. Since it is a performance issue, we black list rally sanity, which takes 1 hour to complete and will re-enable it in Colorado.2.0 where ODL Boron release will be available and SDNVPN team thinks this will be fixed. Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 642661f2de6afa12268e2d2cb854652f3db10ab8)
2016-08-31Remove copper from lxd scenarioMorgan Richomme1-1/+1
JIRA: FUNCTEST-452 Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit bb699b3cfc146566ba54aa96111cf5a05839322a)
2016-08-31parser fails on virtual environementSerenaFeng1-1/+1
Parser tests needs lots of resources, such as vcpu/memory/disk, virtuals pod may not meet the requirements, so exclude Parser running on virtual pods by exclude 'noha' scenario JIRA: FUNCTEST-444 Change-Id: I6f2832fa0f727f762987c41d7a3485dede041151 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 35cf15a87126b6947b59899cd726f4b92599fe79)
2016-08-30Exclude healthcheck from lxd scenariosMorgan Richomme1-1/+1
JIRA: FUNCTEST-442 Change-Id: I1f6888dbddebf28af4b565ca87d9791a21cd4d7e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 9b77f96822457e20bd5c5249c41bf498a3351b2b)
2016-08-23Enable security scan for apex scenariosvitikkan1-1/+1
Change-Id: I6c2925237d7ae437f49d60d37ef906ed8029eb03 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com> (cherry picked from commit da6398642446f98240d9d1bf924e959e64a73d63)
2016-08-23doctor test support fuel installerdongwenjuan1-1/+1
Change-Id: I9229d4de823568bfefd4f2c1ab5c5c1a1ded6d2c Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn> (cherry picked from commit e0a17212d21ae7d76c55791ab8bcde1c66df3158)
2016-08-18resume Parser test run on fuel onosSerenaFeng1-1/+1
Parser tests was removed by onos people in change https://gerrit.opnfv.org/gerrit/#/c/18821/. After we talk about this, we found it was a mis-removal. JIRA: FUNCTEST-422 Change-Id: I76da8786cac0fc5c874aa69e937d6ae19b20c6b1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-17Remove parser tests from fuel onoswuwb19891-1/+1
Change-Id: I72467575ca3eb79cbd0094882d3a5be73c2cf308 Signed-off-by: wuwb1989 <wuwenbin2@huawei.com>
2016-08-17[multisite] set the criteria as 100%meimei1-1/+1
Change-Id: I8e6a274c0f250b63c3e6f698b527fc476e1162b8 Signed-off-by: meimei <meimei@huawei.com>
2016-08-15Merge "add parser to feature tier to make it run daily"Morgan Richomme1-10/+9
2016-08-14add parser to feature tier to make it run dailySerenaFeng1-10/+9
For now parser belongs to vnf tier, but this tier is defined to run weekly, which is not parser wanted, so I move it to feature tier to make it run daily. JIRA: FUNCTEST-413 Change-Id: I5b1fe3e7b140d26fe2e71f0a625e0ffad7937a13 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-12Improve LXD scenario supportboucherv1-1/+1
JIRA: FUNCTEST-268 Change-Id: I8c8a3eff4a7e94b963c0307010a60723dc13a537 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-08Merge "Enable Copper functest under JOID"Morgan Richomme1-1/+1
2016-08-04unify test result check for feature project and apply to parserSerenaFeng1-1/+1
add check_test_result() method to unify test result process JIRA: FUNCTEST-405 Change-Id: Iee4d2876cbbf372f8c3e3bf94448036669bc7f7e Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-03Enable Copper functest under JOIDblsaws1-1/+1
JIRA: COPPER-4 Change-Id: Ief49cea34ed15ba9c877bf4acd512f4d77cb5016 Signed-off-by: blsaws <bryan.sullivan@att.com>
2016-07-30Add onos_sfc scenariowuwenbin21-0/+10
JIRA:ONOSFW-172 Change-Id: I019edf79f8d343f794aa7af151d8e30c18e2c5f6 Signed-off-by: wuwenbin2 <wuwenbin2@huawei.com>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch1-1/+1
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Functional testing for tosca2heat translationSerenaFeng1-0/+9
in Dockerfile, add parser related work in config_functest.yaml/testcase.yaml, add parser related configuration in exec_test.sh to run parser test add vnf/RNC/parser.py script JIRA: FUNCTEST-187 Change-Id: I8b53774da00f13b630ec5d9f750817db892a82bb Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-27Disable security scan testsjose.lausuch1-1/+1
Change-Id: Ic6800f4b1401c44dbded160f45fdd17c706f14f8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27Enable odl-sfc in CIManuel Buil1-0/+9
JIRA:FUNCTEST-392 Change-Id: If1c931df26062501695061e1155eb26ad007c8de Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
2016-07-25Turn off vPing_ssh for odl_l3 scenarios due to odl bugjose.lausuch1-1/+1
https://bugs.opendaylight.org/show_bug.cgi?id=5586 JIRA: FUNCTEST-363 Change-Id: I4d195ae7ebbe10cfc4fe2947eecf5f0c051fd4e3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-25Create a flag in the tests to indicate if they should be blocking or notjose.lausuch1-0/+18
JIRA: FUNCTEST-380 Change-Id: I737d71a47ddac80bf0222a1f004af05f509c5971 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-18[multisite] run on the env of fuel and compassmeimei1-1/+1
Change-Id: Ie590a99e8b571af66cc2164c291dd8e9eed47e4a Signed-off-by: meimei <meimei@huawei.com>
2016-07-15Use blacklist of Tempest test cases for SDNVPN scenariojose.lausuch1-1/+1
This patch disables tempest smoke from being executed in bgpvpn scenarios. Since there is a known upstream issue which won't be resolved before Colorado, it doesn't make sense to run the test cases in Tempest that will fail due to that issue. The Tempest suite will be triggered along with the "features" tier, with a given blacklist of the known test that will fail. JIRA: FUNCTEST-369 Change-Id: Ifc533077207e9d62d49bcedcc3cd0936df312891 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Revert "Disable ODL test."Jose Lausuch1-1/+1
This reverts commit adf9811e8c0f2fa92ca1c45658a3360e1de8be7e. JIRA: FUNCTEST-371 Change-Id: I677ed08e017e2b147eec9433b050d3fa480565a2 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-15Disable ODL test.jose.lausuch1-1/+1
It triggers a lot of errors. See log in the JIRA ticket: JIRA: FUNCTEST-371 Change-Id: Ia039d36773158850f7746ae6d3a2a65fb350e382 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Enable domino multi-node test case in FunctestUlas Kozat1-1/+8
This includes: - Add domino.py script - Add call to domino.py - Add the Domino repo in the Dockerfile - Add the test case definition in testcases.yaml JIRA: FUNCTEST-246 Change-Id: I5a8c3345a14c43fa80e6e86678ae5fb1417b3147 Signed-off-by: Ulas Kozat <ulas.kozat@gmail.com>
2016-07-13[multisite] add interface of multisite test suitemeimei1-0/+8
JIRA: FUNCTEST-179 Change-Id: I23ae0f73a6efb410e54fedd75537bb2e219344e0 Signed-off-by: meimei <meimei@huawei.com>
2016-07-06Add Moon in FunctestMorgan Richomme1-0/+8
JIRA: FUNCTEST-210 Change-Id: Ibc8792f74c4c62122856cff355e55cda88fc691e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-06Add copper for CI integrationMorgan Richomme1-0/+9
JIRA: FUNCTEST-67 Change-Id: Idffa4ccae4eb51ad335a5c49876bb18731990e84 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-07-01Remove OVNO test for ColoradoMorgan Richomme1-10/+0
JIRA: FUNCTEST-260 Change-Id: I745ac49b47ad97185868f4e7277410c609fcdbf1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-01Add criteria in testcases.yaml and Test classjose.lausuch1-0/+15
JIRA: FUNCTEST-257 Added example of usage in vping_ssh Change-Id: Iac143b811db163f0f86682b0688948c20843ede5 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-25Add security_scan in Functest CI pipelineMorgan Richomme1-0/+8
JIRA: FUNCTEST-258 Change-Id: Idbf6006910982a9a165952ca3031966855bcb29d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-24Join Rally_full and Tempest_full in the same Tierjose.lausuch1-20/+3
JIRA: FUNCTEST-190 Change-Id: Ib82c59e0a68ed73caba79a0d5b2000861ee31552 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-11Fix typos in testcases.yamlCédric Ollivier1-2/+2
Change-Id: I7b014c55b626a06c0b4aaba006691f726f88acac Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-11Split tempest into smoke and full modesvitikkan1-12/+12
"tempest_smoke_serial" and "tempest_full_parallel" test cases replace the original "tempest" case. Corrected fetching tempest results from "rally verify list" output (last result is taken instead of the first one). This correction is needed when "rally verify start" is run multiple times. JIRA: FUNCTEST-242 Change-Id: I544a22081655af819dbaaaafc0ba0fa6eae1e4ea Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-05-10Enable sanity mode of Rally test for the CI runsJuha Kosonen1-10/+10
JIRA: FUNCTEST-241 Change-Id: Ie37657bf9e8c01ae4126c1c45146d8aadb2c5775 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2016-05-10Adapt tiers to run depending on WEEKLY/DAILYjose.lausuch1-10/+10
JIRA: FUNCTEST-244 Change-Id: I11bf28baff52b75b0f6c58845edc22f266dfcbe8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-09CLI implementationjose.lausuch1-2/+2
JIRA: FUNCTEST-243 Change-Id: Ibf0ef9bcc5f3aeda96b050827b954ce060317613 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-05-04Refactor improvementsjose.lausuch1-29/+28
JIRA: FUNCTEST-190 - Deleted unnecessary old scripts - Fixed healtcheck logging - Moved config_functest.yaml to /ci/ - Created env var CONFIG_FUNCTEST_YAML pointing to that new location - Modified all scripts which open config_functest.yaml using the new env var Change-Id: Ic4f0e40a70c02ac08287a1d621956f602bdee177 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-28Create run_test.py using the tier mechanism to run the testsjose.lausuch1-20/+17
JIRA: FUNCTEST-227 JIRA: FUNCTEST-190 Change-Id: I5445ad36ec65e62d48c8f5b16352caea2e51e3c9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-04-27Create prepare_env.py from prepare_env.sh and config_functest.pyjose.lausuch1-0/+196
JIRA: FUNCTEST-227 Change-Id: I1aa890b9f91ec524c766ba3c460666ed227f2126 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>