aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests
AgeCommit message (Collapse)AuthorFilesLines
2017-05-04Merge "refstack-client userguide"Morgan Richomme1-1/+8
2017-05-03refstack-client userguideMatthewLi1-1/+8
JIRA: FUNCTEST-758 container setup steps are skipped, since they already included in the functest userguide documents. Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-02Merge "Fix pylint warnings in snaps"Jose Lausuch3-9/+9
2017-05-02Merge "rename tempest.conf to refstack_tempest.conf"Jose Lausuch1-2/+2
2017-04-30Fix pylint warnings in snapsCédric Ollivier3-9/+9
Pylint only warns about missing module docstrings now. Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-27Fix the instance initialization error for OnosSfchelenyao1-29/+37
Change-Id: I1820bed1bbb7dbddd3923ea6439f58592595f5c8 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-04-26Catch os.makedirs() exceptions in tempest.pyCédric Ollivier1-4/+2
It can raise an error exception if the leaf directory already exists or cannot be created [1]. [1] https://docs.python.org/2/library/os.html JIRA: FUNCTEST-804 Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier11-15/+15
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-24Remove useless lines of code in barometer.pyCédric Ollivier1-3/+0
Change-Id: Ie312dbd296a85a35096294331c28a45f8dc10d0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-22rename tempest.conf to refstack_tempest.confMatthewLi1-2/+2
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-18Fix Sphinx warnings/errorsCédric Ollivier1-2/+3
It takes into account the following warnings/errors: - Inline strong start-string without end-string - Unexpected indentation Change-Id: Idb05c7b04ba98ef8f3ef65e6ec7c9bb5b7571cad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-14Merge "Updated method calls to SNAPS tests."Cedric Ollivier6-28/+28
2017-04-14Remove deprecated feature modulesCédric Ollivier10-209/+0
All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-13Updated method calls to SNAPS tests.spisarski6-28/+28
Due to the refactoring performed in gerrit patch 31435, the calls to the SNAPS tests needed to be updated. JIRA: SNAPS-23 Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-04-12Refactor the Feature frameworkCédric Ollivier10-37/+44
run() returns the expected status code (see following JIRA tickets). repo, pre() and post() are removed as they were quite useless. A dedicated class is proposed for bash programs. Unit tests have been added to fully cover this module. All features have been modified to conform with these modifications. It also removes the decorators which skipped several unit tests. JIRA: FUNCTEST-778 JIRA: FUNCTEST-779 JIRA: FUNCTEST-780 JIRA: FUNCTEST-781 Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier27-97/+125
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Add unit tests for parserCédric Ollivier1-2/+2
It also fixes the corresponding case name in testcases.yaml. Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-07Bugfixing the testcases execusionNikolas Hermanns1-2/+1
tempest.api.compute.servers.test_server_actions\ .ServerActionsTestJSON.test_reboot_server_hard is working in fuel so do test it. The "-" was missing so tempest.scenario.test_server_basic_ops .TestServerBasicOps.test_server_basic_ops was executed on fuel which is known to be not working since metadata service is not available. That was added already long ago but through the not adding of the "-" it got added again. Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-04-06Bugfix: Add case_name as constructor arg for snaps_smokeLinda Wang1-3/+2
JIRA: FUNCTEST-791 When running snaps_smoke, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I4a59828ba735ba14a286d000d1d061be14878d1c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-05Add case_name as args in all featuresCédric Ollivier9-18/+18
Now run_tests.py forces case_name as arg of every TestCase or Feature. It also updates the related unit tests. Change-Id: I4d70005b53730f36785f0ac95f4f0f6a04455794 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-05Merge "refstack client: improvement and fix of TestCase usage"Cedric Ollivier2-13/+11
2017-04-05Merge "Bugfix: Add case_name as constructor arg for snaps and rally"Cedric Ollivier5-17/+12
2017-04-05Bugfix: Add case_name as constructor arg for snaps and rallyLinda Wang5-17/+12
When running healthcheck tier and rally, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I078094921f08b457b88beabee60eabf40b657411 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-04Fix VIM onboarding and ims deploymentMichael Pauls2-12/+52
VIM onboarding: check for API version of OpenStack -> support of v2 and v3 ims deployment: fix userdata in order to wait for EMS registration Change-Id: Id0932232ddb1f1163ef3c37460bc88b71b9c0bdd Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-04-04refstack client: improvement and fix of TestCase usageMatthewLi2-13/+11
JIRA: FUNCTEST-772 1, RefstackClientParser should not be a subclass of TestCase 2, tempest_conf.py used for generating reference tempest.conf file not related to functest cmd, use logger is enough Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-04Merge "Add case_name as constructor arg"valentin boucher21-61/+45
2017-04-04Add case_name as constructor argCédric Ollivier21-61/+45
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-31[Clearwater Test] Fix bug in error messageboucherv1-2/+1
Change-Id: I5d1a3f44915821fcf778c4bcecb32d2aaf475262 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-30Merge "Clean up Tempest blacklist"Jose Lausuch1-20/+0
2017-03-30Merge "Disable tempest server reboot test for SDNVPN and Gluon"Jose Lausuch1-0/+12
2017-03-30Clean up Tempest blacklistjose.lausuch1-20/+0
This list has been generated in Colorado and there are some scenarios that are deprecated and there is no need to list them here. Change-Id: I62a30b5026ed1df65ebdb7a68a6acf3364469865 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-29Disable tempest server reboot test for SDNVPN and GluonGeorg Kunz1-0/+12
Bug report: https://bugs.opendaylight.org/show_bug.cgi?id=5586 As a result, floating IPs are not working in Apex at the moment. Change-Id: I437c10b53dc01810ed757f040d3378c92320274b Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-03-29Merge "rename FeatureBase to Feature"Cedric Ollivier12-12/+12
2017-03-29Merge "rename feature_base to feature"Cedric Ollivier12-12/+12
2017-03-29Merge "Add docstrings in odl"Jose Lausuch1-0/+69
2017-03-29Merge "refstack: bugfix of name TestCase"Morgan Richomme2-4/+4
2017-03-29Added test case for opera vimshelenyao3-476/+272
1. Created a ImsOnBoardingBase to wrap up all common ims operations 2. Created test case to test opera vims onboarding Change-Id: Idf3a82e10661271ad413f4dd5795c80ca4421d73 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-28refstack: bugfix of name TestCaseMatthewLi2-4/+4
JIRA: FUNCTEST-758 Change-Id: I1b90597c9745faa67afa58e5653f72411a95aa3d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-28Add docstrings in odlCédric Ollivier1-0/+69
It has been rated at 10.00/10 by pylint. Change-Id: If45656080a47c2582556f841a02379b37e481fd9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-28rename FeatureBase to FeatureSerenaFeng12-12/+12
delete useless suffix 'Base' Change-Id: Ie789da2e83cc90585fd281fe183e8430af498436 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-28rename feature_base to featureSerenaFeng12-12/+12
remove useless suffix _base Change-Id: I63a73fd6fef2fccd9b92c405f64dda50735b0026 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-28Merge "Revert "Make SFC test a python call to main()""Cedric Ollivier1-4/+2
2017-03-28Revert "Make SFC test a python call to main()"George Paraskevopoulos1-4/+2
This reverts commit d5820bef80ea4bdb871380dbfe41db12290fc5f8. Robot test runs before SFC test and it imports https://github.com/robotframework/SSHLibrary which does a monkey patching in the python runtime / paramiko. Untill now sfc run in a new python process (clean) because it run using the bash command. But when importing it as a module and call main() from python, it will run in the patched runtime and it will error out. https://hastebin.com/iyobuxutib.py Change-Id: I54237c32c957718b363d302efe84e01bc78e4f47 Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2017-03-28refstack client: manually running improvementMatthewLi2-28/+78
JIRA: FUNCTEST-758 1.python tempest_conf.py can generate a reference tempest.conf under /hom/opnfv/.../refstack_client this is based on "rally verify configure-verifier" surely, user can define his/her own tempest.conf by not using this 2.python refstack_client.py -c <tempest_conf_path> --testlist <testlist_file_path> if not given, will use default path, if file not exists, will have error Change-Id: I1ceecbe8fe86fbe0d53b736a0f3b9a9ae01f262f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-28Merge "Fix pylint warnings in odl"Jose Lausuch1-26/+30
2017-03-28Merge "Rename testcase_base to testcase"Cedric Ollivier8-46/+46
2017-03-28Merge "Switch TestcaseBase to TestCase"Cedric Ollivier8-38/+38
2017-03-27Fix pylint warnings in odlCédric Ollivier1-26/+30
It takes into account the following warnings: - invalid-name - logging-not-lazy - dangerous-default-value - broad-except (locally-disabled) - too-few-public-methods (locally-disabled) Change-Id: Iec59108cc16872090c5def0bb38c10a7aeec46fc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27Changing project name of vRouterShuyaNakama1-1/+1
JIRA: FUNCTEST-769 When pushing result to DB in vRouter module an error occurred. couse is wrong project name. We changed project name from "vRouter" to "functest". Change-Id: I8b8289b48330b17b6d6620524024dea4f488e38a Signed-off-by: Shuya Nakama <shuya.nakama@okinawaopenlabs.org>
2017-03-27Rename testcase_base to testcaseCédric Ollivier8-46/+46
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>