aboutsummaryrefslogtreecommitdiffstats
path: root/functest/core
AgeCommit message (Collapse)AuthorFilesLines
2017-04-14Add license in feature.pySerenaFeng1-0/+7
Change-Id: I75f51f216dcbf0db1c563cf381c28efc47241d3c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-04-14Remove deprecated feature modulesCédric Ollivier1-3/+13
All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-12Refactor the Feature frameworkCédric Ollivier1-42/+24
run() returns the expected status code (see following JIRA tickets). repo, pre() and post() are removed as they were quite useless. A dedicated class is proposed for bash programs. Unit tests have been added to fully cover this module. All features have been modified to conform with these modifications. It also removes the decorators which skipped several unit tests. JIRA: FUNCTEST-778 JIRA: FUNCTEST-779 JIRA: FUNCTEST-780 JIRA: FUNCTEST-781 Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier4-15/+14
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-05Bugfix: Add case_name as constructor arg for snaps and rallyLinda Wang1-2/+2
When running healthcheck tier and rally, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I078094921f08b457b88beabee60eabf40b657411 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-04Add case_name as constructor argCédric Ollivier3-8/+7
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-29Merge "rename FeatureBase to Feature"Cedric Ollivier1-2/+2
2017-03-29Merge "rename feature_base to feature"Cedric Ollivier1-0/+0
2017-03-29Added test case for opera vimshelenyao1-11/+15
1. Created a ImsOnBoardingBase to wrap up all common ims operations 2. Created test case to test opera vims onboarding Change-Id: Idf3a82e10661271ad413f4dd5795c80ca4421d73 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-28rename FeatureBase to FeatureSerenaFeng1-2/+2
delete useless suffix 'Base' Change-Id: Ie789da2e83cc90585fd281fe183e8430af498436 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-28rename feature_base to featureSerenaFeng1-0/+0
remove useless suffix _base Change-Id: I63a73fd6fef2fccd9b92c405f64dda50735b0026 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-27Add docstrings in testcase.pyCédric Ollivier1-0/+51
testcase.py is now rated at 10.00/10 by pylint. Change-Id: Ia90e53db7a25aac3827cd29bb9fd6baaa46cd487 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27Rename testcase_base to testcaseCédric Ollivier4-3/+3
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27Switch TestcaseBase to TestCaseCédric Ollivier4-18/+18
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and removes the useless suffix too. [1] https://gerrit.opnfv.org/gerrit/#/c/25391/ Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-26Fix pylint warnings in testcase_baseCédric Ollivier1-2/+3
It takes into account the following warnings: - bare-except - unused-argument - broad-except Change-Id: I3a50bf6d07823edc80a7f0f78f46681ace7f4a39 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-20[vnf_base] improve exceptionboucherv1-5/+10
Return on part of previous changes in commit: 30257 https://gerrit.opnfv.org/gerrit/#/c/30257/ Change-Id: I11b33ee2a6f9d4cbcf1449006b47be508fce655e Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-10Remove raise exceptionsMorgan Richomme1-6/+8
until exceptions are better managed in abstraction Currently it triggers an exit from the jenkins job and prevent other tests to be run Change-Id: Id3b18c1d6d3b786fc78456b3ad51963d2cbb2cc1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-08Improve error log into vnf test stepboucherv1-2/+4
Change-Id: Ied92224bc80ab4e02611e7b1f4bf33f276914e89 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-08Added support for scenario-based flavor creation.spisarski1-2/+0
As certain scenarios such as, DPDK, FDIO, and OVS use cases require special 'hw:' settings to flavors, SNAPS-OO has just implemented the ability to take in these configuration values to apply to its integration tests. This change checks the scenario and should be configuring the flavor metadata accordingly. Also see SNAPS-38 Used this as an opportunity to refactor the SNAPS test classes as well... JIRA: FUNCTEST-746 Change-Id: I63535776acde088a7461f602966a324b6207592d Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-02-22Merge "Integrate BAROMETER feature test case"Jose Lausuch1-1/+9
2017-02-21Integrate BAROMETER feature test casejose.lausuch1-1/+9
Also, add a executor method in VNFBase to allow re-write it for some cases where the feature is another python script instead of shell script. Change-Id: Id734553dffe32fdc9a0befc3f4c0e29e5d56fc61 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-21Fix neutron auth issueboucherv1-4/+11
Adding admin role to the new_user for the new tenant It will fix this bug for other tests based on this class JIRA: FUNCTEST-734 Change-Id: Ia3b8797fa391f528d24425a5b13c1b329cb992f4 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-16Fix auth errorboucherv1-4/+6
JIRA: FUNCTEST-734 Change-Id: I9e13b9b9459b9051981766fbf32126583a761656 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-15Merge "update cloudify_ims case"valentin boucher1-2/+2
2017-02-15update cloudify_ims caseboucherv1-2/+2
bug fixes Provisional change of the ci loop var to daily for VNF testcase. JIRA: FUNCTEST-710 Change-Id: I6dc8072b4e56c96473a2b09f1881b96024259db5 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-14Merge changes from topic 'revert_write_to_file'Jose Lausuch1-36/+11
* changes: Add can_dump_request_to_file decorator Revert "write test results to a local file"
2017-02-13Merge "[WIP] update cloudify_ims case"valentin boucher1-26/+0
2017-02-13Revert "write test results to a local file"Cédric Ollivier1-36/+11
This reverts commit ee21af78fbfc93e888acda121f08d2b216dd0159. Change-Id: If7c8d3b645073574862eb67225b1e11b0dd7a021 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-02-09[WIP] update cloudify_ims caseMorgan Richomme1-26/+0
bug fixes + adaptation to abstraction class JIRA: FUNCTEST-710 Change-Id: I687876637bd9eeeba9256e28b98a1e3a4f5c3e22 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-08Logic to trigger Security Scan projecthelenyao1-0/+1
1. Removed the calling from exec_test.sh 2. Used FeatureBase instead 3. Removed the legacy security scan code Change-Id: I1984ec951973f337f275e50543b277cd90d9a202 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-01-31Tempest and SNAPS not pushing results to DB in case of FAILMorgan Richomme1-2/+6
this problem was due to the fact that we add exit condition EX_ERROR when the result was FAIL EX_ERROR shall be used as exit condition when there is an execution error, i.e the test case cannot be run if it can be run, there is no execution error the result can be PASS or FAIL, but from the CI, execution is OK JIRA: FUNCTEST-714 Change-Id: Id434bb9aa88b50277c40c717259304f26f7b3966 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-22Merge "Reverted the file permission"Helen Yao1-0/+0
2017-01-20bug fix case name for VNFonboardingMorgan Richomme1-1/+2
the case paramter was not provided to the anstraction class Change-Id: I42ba63a3b4fd20f6d076f20369fed56715237640 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-20VNF_BASE - fix quota update failedboucherv1-4/+5
JIRA: FUNCTEST-702 Change-Id: Ia831d35079f9286f924d0b407a64bf376b1cff21 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-01-19Merge "write test results to a local file"Morgan Richomme1-11/+36
2017-01-18Add VnfOnBoarding AbstractionMorgan Richomme1-0/+246
JIRA: FUNCTEST-535 Change-Id: Idfa3dfd64554472aaac3f26a504e1f74d2f42926 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-17write test results to a local filewu.zhihui1-11/+36
Write test result to a file or push it to DB depends on the value format of test_db_url which is defined in config_functest.yaml. Meanwhile, test_db_url can be set by os envrion value "RESULT_STORE". If test_db_url is a url, e.g. http:// or https://, then push result to DB. If test_db_url is a file location, e.g. file:///, then write results to a file with json data. One result record, one line. JIRA: FUNCTEST-657 Change-Id: I579087cd2c24d61a79142b5d67003fb486b6c723 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-01-04Reverted the file permissionhelenyao1-0/+0
There are some files whose permissions are changed unintendedly. Revert all of them. mode change 100644 <= 100755 functest/core/pytest_suite_runner.py mode change 100644 <= 100755 functest/opnfv_tests/openstack/vping/vping_base.py mode change 100644 <= 100755 functest/utils/openstack_tacker.py mode change 100644 <= 100755 functest/tests/unit/odl/test_odl.py mode change 100644 <= 100755 requirements.txt mode change 100644 <= 100755 test-requirements.txt Historical comments that changed the permission for reference changeID: Ia02760fd98aaab59a6cf0a90a2020b76e0c92df6 changeID: Id6815f96a11f2918bc2c7bc1c33f38c3f5754e11 changeID: Ic8c01b9b7ed86d3bdd9f5125504bc47f46a37700 changeID: I9f1a408f0e43bff4499575fa57cabd1a83d99b3a Change-Id: I1deadd77cc78f2186f82de79233aabe97ac21b26 Signed-off-by: helenyao <yaohelan@huawei.com>
2016-12-21Refactor test run related modules using new constants providerSerenaFeng1-7/+3
JIRA: FUNCTEST-673 Change-Id: Ia37fb5a08c8fbc4a8acb666565ea887f9ae48b83 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-21refactor vping using new constants providerSerenaFeng1-2/+2
JIRA: FUNCTEST-673 Change-Id: I56ac66662b53593257609fa87c16df52440f7458 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-20Remove backslash to meet PEP8 requirementhelenyao1-2/+2
JIRA: FUNCTEST-630 Change-Id: Ia02760fd98aaab59a6cf0a90a2020b76e0c92df6 Signed-off-by: helenyao <yaohelan@huawei.com>
2016-12-15Add check_criteria() in testcase_baseCédric Ollivier1-0/+10
It allows checking testcase results and then returning an error value to CI. Now run() should return EX_OK even if criteria is FAILED. It also fixes an issue induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/24561/ Change-Id: Iaa095696f9dcb87f8cc95179b4f404b092d1e23e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-12-09Snaps integrationMorgan Richomme1-9/+8
Fix testcase class name Minor change on criteria, start_time, stop_time Change-Id: I9ba49781c3a3212f03b7ab822f9ab311a4fafd3d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-09Merge "abstract umbrella part to make integration code simpler"Serena Feng1-0/+58
2016-12-08Added test cases for running the Python Tests included with SNAPS.spisarski1-0/+56
JIRA: FUNCTEST-570 The three new tests are: 1. healthcheck/connecton_check - Retrieves different OpenStack clients and may exercise a query function 2. healthcheck/api_check - Exercises many of the OpenStack APIs by performing basic CRUD operations 3. smoke/snaps_smoke - Creates VMs and some optionally test SSH into floating IPs Removed configured exernal network name and replaced it with a dynamic lookup. Fixed typo in run_tests.py Change-Id: Icb87a77c7cdd99dd9aa3a66bcc5a25b4b5935fef Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2016-12-07abstract umbrella part to make integration code simplerSerenaFeng1-0/+58
implement an abstract class Umbrella, and take parser for instance JIRA: FUNCTEST-618 Change-Id: Iadf71ad49abd901b9659cb71135fc902a3b616d1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-02Rename TestCasesBase into TestcaseBasehelenyao1-5/+5
JIRA: FUNCTEST-628 1. rename the TestCasesBase into TestcaseBase 2. updated the module name to testcase_base.py Change-Id: Ic6b5d8209098c136613a2419c3790668fdbd493e Signed-off-by: helenyao <yaohelan@huawei.com>
2016-12-02remove functest_repo from TestBase, move it to vPingBaseMorgan Richomme1-2/+0
Change-Id: I6e9ebc7280b24ced9b62bfa4fa38b08128febb42 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-30Revert "solve failure testcases are not pushed to testDB problem"Morgan Richomme1-1/+0
This reverts commit a41264c46d583a68d48de041663213752dc62bf3. Change-Id: Id62c5342fffb5d75672127d9765d4cc882e3f4df Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-24Extracted all global parameters into functest_constants.pyhelenyao1-1/+2
JIRA: FUNCTEST-533 1. Extracted all global variables into functest_constants.py and updated all affected areas accordingly 2. Used os.path.join to replace '/' to come up with the path for better cross-platform support and improve the path accuracy 3. Removed unused variables 4. Updated the hardcoded path in Dockerfile by using variable reference 5. Removed "/" ending from all path variables 6. Updated the unit test Change-Id: Ib30a81d1f0c83fbaef042d63c187c27bd18301bb Signed-off-by: helenyao <yaohelan@huawei.com>