aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2017-03-16Bugfix: fix the criteria of refstack_defcoreLinda Wang1-1/+1
The criteria of refstack_defcore is supposed to be ">= 80%" rather than "== 80%". Change-Id: I9f9e38c84925c3725289e8b427e5735d131459f1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-15Parse refstack_defcore resultsLinda Wang1-1/+1
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 Parse refstack_defcore results, including: 1. show number of tests passed, skipped and failed 2. record the detailed info about testcases passed, skipped and failed. Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-15refstack client integrationMatthewLi1-0/+15
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-10Exclude Doctor from Joid scnenariosMorgan Richomme1-1/+1
Doctor feature not available for Joid on Danube Change-Id: I1d39ff15a1fe003689828f6923b92c7e7c7d716f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Change scenario for odl_netvirt tests to be os-odl_l3-nofeatureJamo Luhrsen1-2/+2
Change-Id: Ibf04adcaa0b14c4cdda8fba2ef2826a0c7f3b7d4 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-03-09Change the order of HealthCheck testsMorgan Richomme1-16/+16
currently the snaps healthcheck (dhcp) is tried first it should be connectivity, api, dhcp the reporting looks for scenario based on connectivity testing dhcp first => scenarios ok on connectivy but failed with DHCP are not considered, which could be misleading Change-Id: I0eb34b1f5ba163540281e5ef0dcb12c8cefa88bd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Introduce smoke tests for FDSTomas Cechvala1-0/+19
Added: - fds repository to docker file - fds test to smoke tier in testcases - config values for fds tests A new robot var OS_AUTH_URL is defined as expected by FDS robot files. Method args switch from Keystone IP to OS_AUTH_URL which is more precised. The argument parsing is changed too. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ife27ab4a83f0110cbdcf7c9d47d9b3fb4c0ec705 Signed-off-by: Tomas Cechvala <tcechval@cisco.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-08Exclude SNAPS smoke for lxd scenarioMorgan Richomme1-42/+14
SNAPS healthcheck is already excluded due to the use of QCOW2 images, not compatible with lxd scenarios 2 JIRAs have been cretaed to adapt the SNAPS cases to lxd in Euphrates https://jira.opnfv.org/browse/FUNCTEST-752 https://jira.opnfv.org/browse/FUNCTEST-753 Additionnal cleaning done on testcases.yaml - remove juju_epc case (no one from OAI available for Danube) - remove orchestra (as standalone test case of the MANO stack, postponed to Euphrates) - comment aaa (empty sample used to illustrate the VNF abstraction but not completed for Danube) Change-Id: Ibad6cad4c92ee9897b6665b29c09b62cb1986aae Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-02fix KeyError: 'clean_flag'Ryota MIBU1-0/+1
Change-Id: I26d24ed1db0668aba4c737058c82e2d655bbf818 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-03-02Merge "Add clean_flag to test cases"Jose Lausuch1-0/+33
2017-03-01Merge "Adopt TestcaseBase for ONOS and ONOS SFC"Jose Lausuch1-1/+6
2017-03-01Adopt TestcaseBase for ONOS and ONOS SFChelenyao1-1/+6
1. Adopted TestcaseBase for ONOS and ONOS SFC 2. Removed the ONOS testcase from exec_test.sh This patch is not meant to refactor the code which can be improved in a later patch. Change-Id: Ib8ac47742f598648c7575c9a8968477307629d42 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-01Merge "Re-enable the tests for bgpvpn scenario wich use floating ips"Jose Lausuch1-2/+2
2017-03-01Merge "Add custom tempest test."Helen Yao1-0/+16
2017-03-01Add clean_flag to test casesjose.lausuch1-0/+33
Some test cases such as tempest or those using SNAPS have a built-in cleaup or teardown mechanism. This patch helps to save some time by bypassing the openstack snapshot and cleanup when running those kind of tests cases. Change-Id: I50e7a17937a813532b3756474158416d3e85b922 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-28Merge "Add domino testcase"Morgan Richomme1-0/+12
2017-02-27Merge "Adding vRouter test codes using TestCasesBase"Morgan Richomme1-0/+13
2017-02-26Merge "Remove shell Healtcheck test case"Jose Lausuch1-13/+1
2017-02-25Re-enable the tests for bgpvpn scenario wich use floating ipsjose.lausuch1-2/+2
Change-Id: Ia468b9c9ab9f74a3255aa3647916d1018cef2902 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-25Add custom tempest test.jose.lausuch1-0/+16
Some users need to run a specific list of tempest test cases. This patch allows them to do that by running the command: functest testcase run tempest_custom Change-Id: If8e7726b98c3a71398c7abdf80aea79f10653ebf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Merge "Add Tempest Defcore test case"Jose Lausuch1-23/+35
2017-02-24Add Tempest Defcore test casejose.lausuch1-23/+35
Refstack is the OpenStack project that provides the tooling to run the approved specific tempest test cases (Defcore guidelines) by the Interop working group and by the OpenStack board for OpenStack certification purposes. For more info: https://refstack.openstack.org/ This adds the possibility for a Functest user to run this list of tempest test cases by just issuing the command: functest testcase run tempest_defcore The test will be run on daily loops with the scenario nosdn-nofeature on any installer. Change-Id: I920b2a44cff418116008fdf514425e69dc959412 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Adding vRouter test codes using TestCasesBaseh-hayashi1-0/+13
JIRA: FUNCTEST-530 1.setting "nosdn-nofeature" scinario in testcase.yaml. 1.adding process of setting result details for push DB 2.Delete of define "vrouter_data" in config_functest.yaml. 3.modify of vrouter git tag's name "stable". 4.modrify of testcase name "vyos_vrouter" In order to more specific. Change-Id: I0602c01dbf9a5e71bf85943c2b5e40ef51269ffd Signed-off-by: Hideyasu Hayashi <hideyasu.hayashi@okinawaopenlabs.org>
2017-02-24Integration of orchestra_ims testMorgan Richomme1-2/+2
JIRA: FUNCTEST-726 Change-Id: Ie6a35a817aa327a7e9143d93b5ea2582e99e0066 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-23Add domino testcaseUlas Kozat1-0/+12
Change-Id: I177820638c7b050764c5354cd7ed22a7ccf3acbc Signed-off-by: Ulas Kozat <ulas.kozat@gmail.com>
2017-02-23Remove shell Healtcheck test casejose.lausuch1-13/+1
The healthcheck tier has grown thanks to the adoption of SNAPs library. Now we have a SNAPs test case that checks that creating a Network, a VM and making sure it gets an IP from the DHCP agent works. Basically, we are duplicating both test cases. This patch removes the execution of the former test without eliminating the code. Change-Id: Iad6fec10fa1c247151c68313dc3760a55e511555 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-22Merge "Integrate BAROMETER feature test case"Jose Lausuch1-0/+15
2017-02-21Integrate BAROMETER feature test casejose.lausuch1-0/+15
Also, add a executor method in VNFBase to allow re-write it for some cases where the feature is another python script instead of shell script. Change-Id: Id734553dffe32fdc9a0befc3f4c0e29e5d56fc61 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-20Remove cloudify_ims from ci daily loopboucherv1-4/+4
JIRA: FUNCTEST-734 Change-Id: I018ba3b14d21b29935a16e1689015c01cb11ffd7 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-16Merge "Integration of NETREADY test case"Serena Feng1-0/+12
2017-02-15Integration of NETREADY test casejose.lausuch1-0/+12
Change-Id: I523a05e0f0fbf5971ab7d10a177d793bcff60421 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-15Merge "update cloudify_ims case"valentin boucher1-4/+4
2017-02-15update cloudify_ims caseboucherv1-4/+4
bug fixes Provisional change of the ci loop var to daily for VNF testcase. JIRA: FUNCTEST-710 Change-Id: I6dc8072b4e56c96473a2b09f1881b96024259db5 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-14Merge "Add ODL netvirt connectivity suites to list of robot tests"Morgan Richomme1-3/+24
2017-02-13Add ODL netvirt connectivity suites to list of robot testsJamo Luhrsen1-3/+24
Change-Id: I9eb543b18d7646c7746caeec43d610be52a1af65 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-02-10Merge "Logic to trigger Security Scan project"Morgan Richomme1-1/+4
2017-02-10Merge "Integrating PyTest contained in SNAPS as a replacement to the old ↵Jose Lausuch1-0/+16
bash healthcheck."
2017-02-08Logic to trigger Security Scan projecthelenyao1-1/+4
1. Removed the calling from exec_test.sh 2. Used FeatureBase instead 3. Removed the legacy security scan code Change-Id: I1984ec951973f337f275e50543b277cd90d9a202 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-02-07Integrating PyTest contained in SNAPS as a replacement to the oldspisarski1-0/+16
bash healthcheck. JIRA: FUNCTEST-570 Change-Id: Ia90dc152d48144c9c53967d5c30256389793ce91 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-02-07Exclude Moon feature for DanubeMorgan Richomme1-9/+0
Moon will come back mid March with a micro service version Moon testing could be enabled on this new version Change-Id: I160fab5d609bad2b0e8a8c81a4a180498c935b2f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-07Merge "Move api_check and connection check to healthcheck category"Jose Lausuch1-35/+34
2017-02-03Move api_check and connection check to healthcheck categoryMorgan Richomme1-35/+34
They used to be on smoke but seems to be supported now by all the installers more relevant to put these tests in this tier JIRA: FUNCTEST-568 Change-Id: Id0c60c0b90daed81dc0d230108e2275c868c208c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-02Merge "Allow multiple sets of suites in ODL"Jose Lausuch1-0/+4
2017-02-02Allow multiple sets of suites in ODLCédric Ollivier1-0/+4
ODLTests can manage multiple sets of suites passing as run args. It avoids duplicating odl.py according to ODL features installed (e.g. netvirt). Change-Id: Ibb0697ef9441506c3f33627e13a0845cc482e23f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-02-02Exclude Copper until copper/installer integration completedMorgan Richomme1-12/+12
JIRA: FUNCTEST-34 Change-Id: I70d551904a429b25947f914aa67f6f13f9e5b6ef Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-02Adapt Promise to new frameworkMorgan Richomme1-0/+3
JIRA: FUNCTEST-549 Change-Id: I01018bc10f5b1717af217457018a5d56f86d60cd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-31Adapt doctor test case to the FeatureBase frameworkh-hayashi1-0/+3
JIRA: FUNCTEST-545 1. Modification of “doctor.py” to adapt Feature Base framework. deletion of detail("timestart and duration , status). 2. Deletion of definition of doctor’s repo directory in “functest_const.py" Change-Id: I81d944dc64a81346cbf465c452111f11474ea83c Signed-off-by: Hideyasu Hayashi <hideyasu.hayashi@okinawaopenlabs.org>
2017-01-30[doctor] allow testing with fuel and joidRyota MIBU1-1/+1
Change-Id: Ib128c5f9f7de550fb288580fd36fb03fd49f7d8b Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-01-25Refactor Rally to adopt OOhelenyao1-0/+6
JIRA: FUNCTEST-541 Change-Id: Ife04f58dc31ca9ba6316cc31577f81a6bf0e0405 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-01-18Merge "Add VnfOnBoarding Abstraction"Jose Lausuch1-3/+68