aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci/testcases.yaml
AgeCommit message (Collapse)AuthorFilesLines
2017-08-21Euphrates cleaning: remove any reference to aaa vnfMorgan Richomme1-16/+0
aaa vnf was created in Danube to illustrate the vnf abstraction as real implementations are now available and nobody really implements a real aaa test case, it is better to remove any reference to aaa vnf Note modification on the documentation will be done accordingly Change-Id: Iab6d96c955a6a7dc178588592382e42d68ec604c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-21Remove opera testcase as Opera is inactiveCédric Ollivier1-15/+0
testcases.yaml is updated as well. Change-Id: I88b3a51a732496899f6825fd38137bcf7e6a8caa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-20Complete the container opnfv-vnfCédric Ollivier1-1/+1
It adds the following testcases: - aaa - orchestra_openims - orchestra_clearwaterims opera_vims is not yet integrated as it depends on Opera [1] and its package must be fixed before being installed in Functest [2]. vyos_vrouter will be added when a package is available for installing opnfv-functest-vrouter [3]. [1] https://wiki.opnfv.org/display/OPERA/Opera+Home [2] https://git.opnfv.org/opera/tree/requirements.txt [3] https://github.com/oolorg/opnfv-functest-vrouter Change-Id: Iccd4626ec29c1e9eb1c2accc81fdf1a9ae1e613f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-20Fix ci_loop conditions for vnfCédric Ollivier1-1/+1
Weekly jobs should run all tests (vnf included). Change-Id: I25b43654d48e9ae5df5c18fd565423a310d4c68b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-18Merge "Remove multisite support"Morgan Richomme1-15/+0
2017-08-18Remove multisite supportJuha Kosonen1-15/+0
JIRA: FUNCTEST-866 Change-Id: I55a4416688b2aca0897910cac69b33e154e73095 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-08-17Disable temporarily Doctor from FunctestMorgan Richomme1-0/+1
The test case is currently failing whatever the scenario/installer It is misleading for some scenarios (e.g. barometer) As it is systematically failing for the moment, it makes more sense to disable the test rather than complexify regex constraints The test case will be reenabled when the following points will be fixed: - Python 3 support (pending question to Release Manager) - packaging OK: pending patches [1] [2] (need merge of [1]) - remove packet installation in run [1] https://gerrit.opnfv.org/gerrit/#/c/38177/ [2] https://gerrit.opnfv.org/gerrit/#/c/38053/ Change-Id: Ic06786f0d516f1702dc44dc521ba8ca810ee76f9 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-08-17Merge "add orchestra_clearwaterims testcase"Morgan Richomme1-5/+18
2017-08-17Merge "Switch to blocking: false for ODL testcase"Cedric Ollivier1-1/+1
2017-08-17Switch to blocking: false for ODL testcaseNikolas Hermanns1-1/+1
ODL basic suite doesn't support Keystone v3 [1] and then the related testcase should not block the testing till it's fixed. [1] https://jira.opnfv.org/browse/FUNCTEST-862 Change-Id: Ib9c92c5ff37ab720bdfc311df834f18bac39daa7 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-08-16Merge "Remove copper refs"Cedric Ollivier1-17/+0
2017-08-16Merge "Remove netready refs"Cedric Ollivier1-17/+0
2017-08-16Revert "Enable parser project"Cedric Ollivier1-0/+1
This reverts commit 39e2116d5ff360dae7159f5557caa2b2a46c48b2. Change-Id: I7c0b63b22c5cf6e9fa2ee1f182abad96a3931098 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-12Remove copper refsCédric Ollivier1-17/+0
Copper withdrew from E release (see comments in [1]). [1] https://gerrit.opnfv.org/gerrit/#/c/38851/ Change-Id: I1af463f5d60a6099592c1005ce27d3ca0c40cbbf Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-12Remove netready refsCédric Ollivier1-17/+0
Netready withdrew from E release [1] [1] https://lists.opnfv.org/pipermail/opnfv-tech-discuss/2017-August/017453.html Change-Id: I456b91e0bb454a4205df98d0e96032302d3b20a6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-10add orchestra_clearwaterims testcaseMichael Pauls1-5/+18
-rename testcase orchestra_ims to orchestra_openims -add orchestra_clearwaterims testcase -add unit tests Change-Id: I5291f84068915fa15e3fb7b63c5dbd0daec0acca Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-08-10Integrate the netready packageCédric Ollivier1-1/+1
It also adds the related testcases in functest-features. Change-Id: I584da9d890622c1bdd2ace0b12b4be37250fda56 Depends-On: I3842e6828f60972cb1df0bc15f849cd08badd895 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-10Integrate the promise packageCédric Ollivier1-1/+1
Change-Id: I128bfa62b9ccd8e53683def329e8470693c2e556 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-10Merge "Add copper and domino in functest-features"Cedric Ollivier1-2/+2
2017-08-10Merge "Add functest-features based on Alpine"Cedric Ollivier1-2/+2
2017-08-10Merge "Add all ODL testcases in functest-smoke"Cedric Ollivier1-6/+6
2017-08-08Merge "update/improve orchestra_ims"Morgan Richomme1-2/+2
2017-08-07Add copper and domino in functest-featuresCédric Ollivier1-2/+2
Change-Id: I6f7a35b84c9b7f8cde88998f545b30cc200c8ff1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-02Add functest-features based on AlpineCédric Ollivier1-2/+2
It integrates the next testcases: - bgpvpn - security_scan - functest-odl-sfc - barometercollectd It also modifies several cmds in the former testcases.yaml to ensure backward compatibility. Depends-On: I75aaf950f7b072c142fa9894cef7ef7f057adac3 Depends-On: I50219cad42bf0e085c2edf2e1abe149c2e057a99 Change-Id: Idf3d6b4a769edd1a5401748886e0ed64d4f5f281 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-02Add all ODL testcases in functest-smokeCédric Ollivier1-6/+6
It clones the related git repositories in /src and adapts the former Dockerfiles too. Change-Id: Ied5016f8cd5ed49f4e29bae5aa4413fad2477637 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-28update/improve orchestra_imsMichael Pauls1-2/+2
-enable orchestra_ims testcase -update orchestra_ims according to restructed vnf base class -SNAPS integration -improve code based on pylint suggestions -add unit tests (to be completed) Change-Id: Id12f645c76096376b8a867bf36d7bbb69bac58e7 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-07-25Enable parser projectshangxdy1-1/+0
Enable parser project in functest Change-Id: I9bbf5dc5904f53d1a0a640726fbf57b2b702bdfe Signed-off-by: shangxdy <shang.xiaodong@zte.com.cn>
2017-07-05Enable cloudify_imsMorgan Richomme1-2/+2
- set VNF test cases as daily cases - remove enabled: False only for cloudify_ims - precise default generic scenrio (run only on basic scenario first) Vnf and cloudify_ims leveraging vnf are ready for merge [1] [1]: https://gerrit.opnfv.org/gerrit/#/c/36315/ Change-Id: I95ae89358e940ef5e9b8ceabc37588bbcfccfc6c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-06-30Update securityscanning section in testcases.yamlCédric Ollivier1-1/+1
It follows the next updates of the securityscanning package: - Define config.ini as data_file [1] - Define security_scan console script [2] [1] https://gerrit.opnfv.org/gerrit/36635 [2] https://gerrit.opnfv.org/gerrit/36771 Depends-On: I54ffa61f4bcd366c185596056b49e492c88cc78b Change-Id: I342c00392bb68aad704a89060841eac665e91bdb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-28Update paths in functest/ci/testcases.yamlCédric Ollivier1-3/+3
It follows the changes switching to python packages. It shall be noted that several cmds could be enhanced. Change-Id: I8cf3595d1e8044b650deb4ec733bf973c0bf1b3f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-27Updated fds testcase criteriajuraj.linkes1-1/+1
Initially, we only executed fds testcase on odl_l2 fdio scenarios. Now we're extending this to all odl fdio scenarios. Change-Id: Ieb2454f02847361fdf3274b11f20a996a916ad90 Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2017-06-27enable doctor-notification test caseRyota MIBU1-1/+0
Change-Id: If2b6b46f3f192f58636c55f3ddc9e80b9e22be3c Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-06-20Change barometer module to loadJose Lausuch1-1/+1
As [1] is merged, the way to call the barometer test case is different as it is hosted in Barometer repo instead of Functest. The former files are also simply removed too. baro-tests is no longer a requirement. It is installed as any third party project. [1] https://gerrit.opnfv.org/gerrit/#/c/35927/ Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Iea56b48fa781600eb3a6ac74662ea8a29f556f99 Signed-off-by: Jose Lausuch <jose.lausuch@ericsson.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier1-33/+0
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-29Merge "Re-Enable Promise testcases"Morgan Richomme1-1/+0
2017-05-19Activating SDNVPN test cases for master.Tim Irnich1-1/+0
Change-Id: I4ba995d412bfeadc708d5a3c643576097867d1ac Signed-off-by: Tim Irnich <tim.irnich@ericsson.com>
2017-05-19Re-Enable Promise testcasesGerald Kunzmann1-1/+0
Change-Id: I438c8f5ad9a517a19b675205964a427e8b57ac44 Signed-off-by: Gerald Kunzmann <kunzmann@docomolab-euro.com>
2017-05-16Add enabled flag in testcases.yamljose.lausuch1-16/+43
This will allow enable/disable test cases directly using true/false. Change-Id: Iaa7d051ebb8dd9e5a6f835a823f58f1e17a87b8d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-03Updated basic attributes for opera testcasehelenyao1-3/+3
The original value as unknown is not reasonable. Change-Id: I23672ea70fff9b3badb2d2cf4f32dc3e038d7bb3 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-04-26Manage criteria in TestCaseCédric Ollivier1-33/+33
It converts all criteria values to the corresponding percent in functest/ci/testcases.yaml. Result is expected to be equal or greater than criteria. If both are 0, result is considered as false. It is compatible with the old behavior but warns to update. It will allow a safer remove. It also fixes a bug in test_tempest to allow merging [1] and tier_handler.py which required that type criteria was str. [1] https://gerrit.opnfv.org/gerrit/#/c/27949/ Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-20Remove exec right for ci config filesCédric Ollivier1-0/+0
Change-Id: Ibf7e549252234fb69dd6e0cc7920b66759469aea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-14Add copper section in testcases.yamlAimee Ukasick1-0/+17
JIRA: COPPER-34 Change-Id: I7301745718b9c035493c2e5c162e2a4e117982db Signed-off-by: Aimee Ukasick <aimeeu.opensource@gmail.com>
2017-04-14Remove deprecated feature modulesCédric Ollivier1-16/+32
All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier1-32/+64
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Write feature case names in testcases.yamlLinda Wang1-5/+5
It replaces some project names by the corresponding case names. Else some feature projects results failed to be pushed to DB. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-792 Change-Id: Id81644406bafb361da46e397a92e60b4da2ec068 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Add unit tests for parserCédric Ollivier1-1/+1
It also fixes the corresponding case name in testcases.yaml. Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-31Make tempest cleanup resources after runningLinda Wang1-4/+4
JIRA: FUNCTEST-773 1. When running refstack_defcore, create tenant and user failed due to conflict with those created when runnning tempest_smoke_serial. 2. Clean all resources created for tempest_smoke_serial. Change-Id: Icf8ec95f6db0b2f93bf6c56ec10a6e8ea1a91ab1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-30Re-enable rally and tempest full for weeklyjose.lausuch1-43/+31
Change-Id: I640531ebcc471adebe780c75627d822cf8fd956d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-29Added test case for opera vimshelenyao1-4/+4
1. Created a ImsOnBoardingBase to wrap up all common ims operations 2. Created test case to test opera vims onboarding Change-Id: Idf3a82e10661271ad413f4dd5795c80ca4421d73 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-28Remove vping_ssh from bgpvpn and gluon scenarioNikolas Hermanns1-1/+1
Cause of the bug: https://bugs.opendaylight.org/show_bug.cgi?id=5586 Floating ip is not working at the moment for us. We don't want to remove the vping_ssh test from fuel. the scenarios are called different in fuel and in apex. odl-bgpvpn in apex. odl_l2-bgpvpn in fuel. Change-Id: Iaa2e6cea8a4fdb8635f018427aaf30634fd8d2d5 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>