aboutsummaryrefslogtreecommitdiffstats
path: root/functest/core
AgeCommit message (Collapse)AuthorFilesLines
2017-03-26Fix pylint warnings in testcase_baseCédric Ollivier1-2/+3
It takes into account the following warnings: - bare-except - unused-argument - broad-except Change-Id: I3a50bf6d07823edc80a7f0f78f46681ace7f4a39 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-20[vnf_base] improve exceptionboucherv1-5/+10
Return on part of previous changes in commit: 30257 https://gerrit.opnfv.org/gerrit/#/c/30257/ Change-Id: I11b33ee2a6f9d4cbcf1449006b47be508fce655e Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-10Remove raise exceptionsMorgan Richomme1-6/+8
until exceptions are better managed in abstraction Currently it triggers an exit from the jenkins job and prevent other tests to be run Change-Id: Id3b18c1d6d3b786fc78456b3ad51963d2cbb2cc1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-08Improve error log into vnf test stepboucherv1-2/+4
Change-Id: Ied92224bc80ab4e02611e7b1f4bf33f276914e89 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-08Added support for scenario-based flavor creation.spisarski1-2/+0
As certain scenarios such as, DPDK, FDIO, and OVS use cases require special 'hw:' settings to flavors, SNAPS-OO has just implemented the ability to take in these configuration values to apply to its integration tests. This change checks the scenario and should be configuring the flavor metadata accordingly. Also see SNAPS-38 Used this as an opportunity to refactor the SNAPS test classes as well... JIRA: FUNCTEST-746 Change-Id: I63535776acde088a7461f602966a324b6207592d Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-02-22Merge "Integrate BAROMETER feature test case"Jose Lausuch1-1/+9
2017-02-21Integrate BAROMETER feature test casejose.lausuch1-1/+9
Also, add a executor method in VNFBase to allow re-write it for some cases where the feature is another python script instead of shell script. Change-Id: Id734553dffe32fdc9a0befc3f4c0e29e5d56fc61 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-21Fix neutron auth issueboucherv1-4/+11
Adding admin role to the new_user for the new tenant It will fix this bug for other tests based on this class JIRA: FUNCTEST-734 Change-Id: Ia3b8797fa391f528d24425a5b13c1b329cb992f4 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-16Fix auth errorboucherv1-4/+6
JIRA: FUNCTEST-734 Change-Id: I9e13b9b9459b9051981766fbf32126583a761656 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-15Merge "update cloudify_ims case"valentin boucher1-2/+2
2017-02-15update cloudify_ims caseboucherv1-2/+2
bug fixes Provisional change of the ci loop var to daily for VNF testcase. JIRA: FUNCTEST-710 Change-Id: I6dc8072b4e56c96473a2b09f1881b96024259db5 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-02-14Merge changes from topic 'revert_write_to_file'Jose Lausuch1-36/+11
* changes: Add can_dump_request_to_file decorator Revert "write test results to a local file"
2017-02-13Merge "[WIP] update cloudify_ims case"valentin boucher1-26/+0
2017-02-13Revert "write test results to a local file"Cédric Ollivier1-36/+11
This reverts commit ee21af78fbfc93e888acda121f08d2b216dd0159. Change-Id: If7c8d3b645073574862eb67225b1e11b0dd7a021 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-02-09[WIP] update cloudify_ims caseMorgan Richomme1-26/+0
bug fixes + adaptation to abstraction class JIRA: FUNCTEST-710 Change-Id: I687876637bd9eeeba9256e28b98a1e3a4f5c3e22 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-08Logic to trigger Security Scan projecthelenyao1-0/+1
1. Removed the calling from exec_test.sh 2. Used FeatureBase instead 3. Removed the legacy security scan code Change-Id: I1984ec951973f337f275e50543b277cd90d9a202 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-01-31Tempest and SNAPS not pushing results to DB in case of FAILMorgan Richomme1-2/+6
this problem was due to the fact that we add exit condition EX_ERROR when the result was FAIL EX_ERROR shall be used as exit condition when there is an execution error, i.e the test case cannot be run if it can be run, there is no execution error the result can be PASS or FAIL, but from the CI, execution is OK JIRA: FUNCTEST-714 Change-Id: Id434bb9aa88b50277c40c717259304f26f7b3966 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-22Merge "Reverted the file permission"Helen Yao1-0/+0
2017-01-20bug fix case name for VNFonboardingMorgan Richomme1-1/+2
the case paramter was not provided to the anstraction class Change-Id: I42ba63a3b4fd20f6d076f20369fed56715237640 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-20VNF_BASE - fix quota update failedboucherv1-4/+5
JIRA: FUNCTEST-702 Change-Id: Ia831d35079f9286f924d0b407a64bf376b1cff21 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-01-19Merge "write test results to a local file"Morgan Richomme1-11/+36
2017-01-18Add VnfOnBoarding AbstractionMorgan Richomme1-0/+246
JIRA: FUNCTEST-535 Change-Id: Idfa3dfd64554472aaac3f26a504e1f74d2f42926 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-17write test results to a local filewu.zhihui1-11/+36
Write test result to a file or push it to DB depends on the value format of test_db_url which is defined in config_functest.yaml. Meanwhile, test_db_url can be set by os envrion value "RESULT_STORE". If test_db_url is a url, e.g. http:// or https://, then push result to DB. If test_db_url is a file location, e.g. file:///, then write results to a file with json data. One result record, one line. JIRA: FUNCTEST-657 Change-Id: I579087cd2c24d61a79142b5d67003fb486b6c723 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-01-04Reverted the file permissionhelenyao1-0/+0
There are some files whose permissions are changed unintendedly. Revert all of them. mode change 100644 <= 100755 functest/core/pytest_suite_runner.py mode change 100644 <= 100755 functest/opnfv_tests/openstack/vping/vping_base.py mode change 100644 <= 100755 functest/utils/openstack_tacker.py mode change 100644 <= 100755 functest/tests/unit/odl/test_odl.py mode change 100644 <= 100755 requirements.txt mode change 100644 <= 100755 test-requirements.txt Historical comments that changed the permission for reference changeID: Ia02760fd98aaab59a6cf0a90a2020b76e0c92df6 changeID: Id6815f96a11f2918bc2c7bc1c33f38c3f5754e11 changeID: Ic8c01b9b7ed86d3bdd9f5125504bc47f46a37700 changeID: I9f1a408f0e43bff4499575fa57cabd1a83d99b3a Change-Id: I1deadd77cc78f2186f82de79233aabe97ac21b26 Signed-off-by: helenyao <yaohelan@huawei.com>
2016-12-21Refactor test run related modules using new constants providerSerenaFeng1-7/+3
JIRA: FUNCTEST-673 Change-Id: Ia37fb5a08c8fbc4a8acb666565ea887f9ae48b83 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-21refactor vping using new constants providerSerenaFeng1-2/+2
JIRA: FUNCTEST-673 Change-Id: I56ac66662b53593257609fa87c16df52440f7458 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-20Remove backslash to meet PEP8 requirementhelenyao1-2/+2
JIRA: FUNCTEST-630 Change-Id: Ia02760fd98aaab59a6cf0a90a2020b76e0c92df6 Signed-off-by: helenyao <yaohelan@huawei.com>
2016-12-15Add check_criteria() in testcase_baseCédric Ollivier1-0/+10
It allows checking testcase results and then returning an error value to CI. Now run() should return EX_OK even if criteria is FAILED. It also fixes an issue induced by [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/24561/ Change-Id: Iaa095696f9dcb87f8cc95179b4f404b092d1e23e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-12-09Snaps integrationMorgan Richomme1-9/+8
Fix testcase class name Minor change on criteria, start_time, stop_time Change-Id: I9ba49781c3a3212f03b7ab822f9ab311a4fafd3d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-12-09Merge "abstract umbrella part to make integration code simpler"Serena Feng1-0/+58
2016-12-08Added test cases for running the Python Tests included with SNAPS.spisarski1-0/+56
JIRA: FUNCTEST-570 The three new tests are: 1. healthcheck/connecton_check - Retrieves different OpenStack clients and may exercise a query function 2. healthcheck/api_check - Exercises many of the OpenStack APIs by performing basic CRUD operations 3. smoke/snaps_smoke - Creates VMs and some optionally test SSH into floating IPs Removed configured exernal network name and replaced it with a dynamic lookup. Fixed typo in run_tests.py Change-Id: Icb87a77c7cdd99dd9aa3a66bcc5a25b4b5935fef Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2016-12-07abstract umbrella part to make integration code simplerSerenaFeng1-0/+58
implement an abstract class Umbrella, and take parser for instance JIRA: FUNCTEST-618 Change-Id: Iadf71ad49abd901b9659cb71135fc902a3b616d1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-02Rename TestCasesBase into TestcaseBasehelenyao1-5/+5
JIRA: FUNCTEST-628 1. rename the TestCasesBase into TestcaseBase 2. updated the module name to testcase_base.py Change-Id: Ic6b5d8209098c136613a2419c3790668fdbd493e Signed-off-by: helenyao <yaohelan@huawei.com>
2016-12-02remove functest_repo from TestBase, move it to vPingBaseMorgan Richomme1-2/+0
Change-Id: I6e9ebc7280b24ced9b62bfa4fa38b08128febb42 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-30Revert "solve failure testcases are not pushed to testDB problem"Morgan Richomme1-1/+0
This reverts commit a41264c46d583a68d48de041663213752dc62bf3. Change-Id: Id62c5342fffb5d75672127d9765d4cc882e3f4df Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-24Extracted all global parameters into functest_constants.pyhelenyao1-1/+2
JIRA: FUNCTEST-533 1. Extracted all global variables into functest_constants.py and updated all affected areas accordingly 2. Used os.path.join to replace '/' to come up with the path for better cross-platform support and improve the path accuracy 3. Removed unused variables 4. Updated the hardcoded path in Dockerfile by using variable reference 5. Removed "/" ending from all path variables 6. Updated the unit test Change-Id: Ib30a81d1f0c83fbaef042d63c187c27bd18301bb Signed-off-by: helenyao <yaohelan@huawei.com>
2016-11-23Merge "solve failure testcases are not pushed to testDB problem"Morgan Richomme1-0/+1
2016-11-23Merge "Adapt vping testcases to the new template"Morgan Richomme1-0/+1
2016-11-23Adapt vping testcases to the new templateSerenaFeng1-0/+1
JIRA: FUNCTEST-540 Change-Id: I05f3704e3fc38e21d7d6484f4d7f53f030d5c34b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-11-23solve failure testcases are not pushed to testDB problemSerenaFeng1-0/+1
In the new framework, only success testcases will be pushed to testDB, a failure testcases will not be pushed to testDB, which is not correct Modify it with only skipped testcases will not be pushed to testDB Change-Id: Ie3cb06ef0d0f75a7ab0b540d2f9f79d4b56746e6 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-11-18Adapt Domino to Test AbstractionMorgan Richomme1-3/+3
JIRA: FUNCTEST-547 Change-Id: Iaeb1bb3e6f4529343eacc2f5ceda6d61ca6d96f7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-11-09Repo structure modificationMorgan Richomme2-0/+53
- create functest subdirectory - rename unit tests - adapt path in exec and config files JIRA: FUNCTEST-525 Change-Id: Ifd5c6edfb5bda1b09f82848e2269ad5fbeb84d0a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>