aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests
AgeCommit message (Collapse)AuthorFilesLines
2017-06-13Merge "Refactor core VNF class"valentin boucher5-232/+151
2017-06-07Configure the param auth_version in tempest.confLinda Wang1-0/+5
1. If the auth_url is "https://192.168.31.222:443/identity-admin/v3", the auth_version in tempest.conf is supposed to be "v3", not "id". 2. For rally 0.8.1. it is a bug when obtaining the auth_version, please see [1], which has been fixed in rally master. [1]: https://review.openstack.org/#/c/468599/ Change-Id: Ia7474938a741a0954f17f7c7650544dbc0a28853 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-06-06Refactor core VNF classMorgan Richomme5-232/+151
- Simplify processing - Implement run method to inherit testcase methods - Add unit tests - Fix all pylint issues It also obliges vnf and its uts to be rated 10/10 by pylint. JIRA: FUNCTEST-830 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I8dd24eea55089277c9e5b2b51fb14dc377f2fcaf Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-02Use constants in odlLinda Wang1-3/+5
Change-Id: I134b0efd3dd0faec389087a4dac59de09eae087e Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-06-02Merge "Use CONST to retrieve db_url rather than getter function"Jose Lausuch1-2/+1
2017-06-01Use CONST to retrieve db_url rather than getter functionLinda Wang1-2/+1
1. Remove get_db_url() 2. If TEST_DB_URL declared in env, update test_db_url in config_functest.yaml file during env preparation 3. No matter TEST_DB_URL declared in env or not, Result_DB = CONST.__getattribute__("results_test_db_url") JIRA: FUNCTEST-763 Change-Id: I20da7ef98bbcc56731e0ff7061b05c1dde6cbfc3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-31Added unit tests for the connection_check test case.spisarski2-6/+22
JIRA: FUNCTEST-813 Change-Id: Ib851a3942e181b1a91cad695504613868a340d15 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-30Merge "Define create_snapshot() and clean() in TestCase"Cedric Ollivier4-8/+8
2017-05-30Merge "vping&snaps_xxx support not_hugepage_supported pod"Serena Feng2-2/+2
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier4-8/+8
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-30Merge "Switch shebangs to /usr/bin/env python"Cedric Ollivier11-11/+11
2017-05-29Merge "Fix some pylint errors in onos package"Morgan Richomme2-48/+55
2017-05-28Switch shebangs to /usr/bin/env pythonCédric Ollivier11-11/+11
It modified the shebang to /usr/bin/env which is considered as more flexible. Change-Id: I9c8cdb4243d41a83d524499cc91060d3700e008b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-25vping&snaps_xxx support not_hugepage_supported podSerenaFeng2-2/+2
if flavor_metadata is set to {'hw:mem_page_size': 'any'}, it means hugepage must be support by pod. but actually hugepage is not supported by all pods Change-Id: Ib0b716ecedacf7eeba2c0d0080be2707b1a87e73 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-05-24Merge "Rename the class TestSuiteRunner to Suite"valentin boucher1-1/+1
2017-05-24Merge "Rename pytest_suite_runner.py to unit.py"valentin boucher1-2/+2
2017-05-24Fix some pylint errors in onos packageLinda Wang2-48/+55
Directories affected: - functest/opnfv_tests/sdn/onos/ JIRA: FUNCTEST-796 Change-Id: Iffbb0e9a021d31a32d940128435a9f6ed43a504f Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-23Rename the class TestSuiteRunner to SuiteCédric Ollivier1-1/+1
It conforms with [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/35211/ Change-Id: I11bbdcd63a1691835fb7c6198549edbaf6b758a1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-23Rename pytest_suite_runner.py to unit.pyCédric Ollivier1-2/+2
It also adds the rst files to include this module in apidoc. Change-Id: Iabbb17bc8601265bd9436c75d1afc0b470df1eb4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-23Bugfix: fix two typosLinda Wang1-1/+1
1. In run_tests.py, test case name is shown before running: logger.error(kwargs['test']) -> logger.info(kwargs['test']) 2. In tempest.py, Verication -> Verification Change-Id: I117838cdb4b0f920c4cf855645d910e623e06868 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-22Merge "Bugfix: fix the errors of onos_sfc"Morgan Richomme1-4/+4
2017-05-22Merge "Precise self.result in pytest_suite_runner.py"valentin boucher1-1/+1
2017-05-22Merge "Replace CONST.* by getattribute/setattr for refstack"Morgan Richomme2-15/+17
2017-05-19Bugfix: fix the errors of onos_sfcLinda Wang1-4/+4
1. Update the service type to "identity", "network", "compute" and "image", other than "keystone", "neutron", "nova" and "glance". JIRA: FUNCTEST-820 Change-Id: I81b2311760fd717570561e6471525773378ad2f2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Precise self.result in pytest_suite_runner.pyCédric Ollivier1-1/+1
It also adds the related unit tests. Change-Id: I8325bd9a55c69b229e3c48a9e64aa963e685e03d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Replace CONST.* by getattribute/setattr for refstackLinda Wang2-15/+17
Directories affected: - functest/opnfv_tests/openstack/refstack_client and respective unit test JIRA: FUNCTEST-796 Change-Id: I7f7047d44d71e82bcc1f66ec0b760ff30a13dbd5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Replace CONST.* by getattribute/setattr for rally and tempestLinda Wang3-84/+100
Directories affected: - functest/opnfv_tests/openstack/rally - functest/opnfv_tests/openstack/tempest and respective unit test JIRA: FUNCTEST-796 Change-Id: I963f5947663f0b660337f3304defb697f5d338f3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Merge "Use StringIO in odl.py"Morgan Richomme1-13/+5
2017-05-19Merge "Add a new directory to hold pre-downloaded images"Helen Yao3-3/+3
2017-05-18Merge "Remove check_success_rate"Jose Lausuch3-22/+34
2017-05-18Use StringIO in odl.pyCédric Ollivier1-13/+5
It avoids creating and removing the temporary file to dump robot output. Change-Id: Ia5ea66e76ffb8b8327f2da938f177e8ef4c61dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Remove check_success_ratejose.lausuch3-22/+34
After the introduction of is_successful method in TestCase class, this is not needed anymore. Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-18Merge "Fix the opera ims instance initialization error"Jose Lausuch1-4/+4
2017-05-18Add a new directory to hold pre-downloaded imageshelenyao3-3/+3
Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-17Update self.result value to INTjose.lausuch1-1/+3
So far, the test cases are storing a string "PASS" "FAIL" in the self.result variable. The way the new framework works is with INT Values. Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-17Merge "Add Python3 support to the ODL testcase"Jose Lausuch1-5/+5
2017-05-17Add Python3 support to the ODL testcaseCédric Ollivier1-5/+5
It also adds this support to its dependencies. Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Converted vPing to leverage the object-oriented SNAPS library.spisarski6-397/+445
JIRA: FUNCTEST-577 1. Replaced procedural openstack_utils with the object-oriented SNAPS library 2. Tests now clean themselves up. 3. Improved code documentation. 4. Removed dependency on file-based Cirros image and now leveraging the download URL. 5. Removed hardcoded location to the testcases.yaml file to leverage the value in config_functest.yaml 6. Included optional flavor metadata based on the scenario being tested 7. Included support for multi-part images. 8. Added enhanced support for configurable images. see SNAPS-76 Fixed line length verification problem with the previous submission Fixed retrieval of external network name to be dynamic. Changed external network name retrieval to leverage the newly merged snap_util.get_ext_net_name() function Added the creation and deletion of flavors. SNAPS now has the ability to add/remove security groups from running instances. Changed VMInstance constructor by moving userdata to configuration object. Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-10Merge "Conform ODL with last framework updates"Morgan Richomme1-1/+8
2017-05-09Merge "Bugfix: initialize the logger for snaps"Cedric Ollivier1-0/+3
2017-05-09Conform ODL with last framework updatesCédric Ollivier1-1/+8
Now ODL TestCase calculates the ratio between critical tests passed and failed and saves it in result. Non-critical test cases can fail as result doesn't take them into account [1]. It also updates default attribute values in TestCase and allows result to be float. [1] http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-criticality Change-Id: Id4a89271b5b1a90cd3c1e2b08591ff26ffaffee0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Rename VnfOnBoardingBase to VnfOnBoardingCédric Ollivier3-3/+3
Change-Id: I514340fc6180e29b31ef11bdea9f719aa2bbb738 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Rename vnf_base to vnfCédric Ollivier3-7/+7
Change-Id: I0b8b9b2e85717fc92a233e4f7344b3419421778d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Bugfix: initialize the logger for snapsLinda Wang1-0/+3
Testcases about snaps failed due to the absence of attribute 'logger'. Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-08Fix the opera ims instance initialization errorhelenyao1-4/+4
Change-Id: I50f0e1ba91c8c4adcf407d493fb86d9089554cc5 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-05Merge "Extended the timeout for Opera"Jose Lausuch1-6/+6
2017-05-05Merge "Define loggers as class-private members"Jose Lausuch2-16/+20
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch20-43/+49
2017-05-04Define loggers as class-private membersCédric Ollivier2-16/+20
This mangling ensures that all info messages printed from core packages are shown in console. It also avoids sphinx to print them. Change-Id: I07db9f33060c195bce3b48b06a6640eb6c56c2eb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier20-43/+49
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>