aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests
AgeCommit message (Collapse)AuthorFilesLines
2017-05-23Bugfix: fix two typosLinda Wang1-1/+1
1. In run_tests.py, test case name is shown before running: logger.error(kwargs['test']) -> logger.info(kwargs['test']) 2. In tempest.py, Verication -> Verification Change-Id: I117838cdb4b0f920c4cf855645d910e623e06868 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-22Merge "Bugfix: fix the errors of onos_sfc"Morgan Richomme1-4/+4
2017-05-22Merge "Precise self.result in pytest_suite_runner.py"valentin boucher1-1/+1
2017-05-22Merge "Replace CONST.* by getattribute/setattr for refstack"Morgan Richomme2-15/+17
2017-05-19Bugfix: fix the errors of onos_sfcLinda Wang1-4/+4
1. Update the service type to "identity", "network", "compute" and "image", other than "keystone", "neutron", "nova" and "glance". JIRA: FUNCTEST-820 Change-Id: I81b2311760fd717570561e6471525773378ad2f2 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Precise self.result in pytest_suite_runner.pyCédric Ollivier1-1/+1
It also adds the related unit tests. Change-Id: I8325bd9a55c69b229e3c48a9e64aa963e685e03d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Replace CONST.* by getattribute/setattr for refstackLinda Wang2-15/+17
Directories affected: - functest/opnfv_tests/openstack/refstack_client and respective unit test JIRA: FUNCTEST-796 Change-Id: I7f7047d44d71e82bcc1f66ec0b760ff30a13dbd5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Replace CONST.* by getattribute/setattr for rally and tempestLinda Wang3-84/+100
Directories affected: - functest/opnfv_tests/openstack/rally - functest/opnfv_tests/openstack/tempest and respective unit test JIRA: FUNCTEST-796 Change-Id: I963f5947663f0b660337f3304defb697f5d338f3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Merge "Use StringIO in odl.py"Morgan Richomme1-13/+5
2017-05-19Merge "Add a new directory to hold pre-downloaded images"Helen Yao3-3/+3
2017-05-18Merge "Remove check_success_rate"Jose Lausuch3-22/+34
2017-05-18Use StringIO in odl.pyCédric Ollivier1-13/+5
It avoids creating and removing the temporary file to dump robot output. Change-Id: Ia5ea66e76ffb8b8327f2da938f177e8ef4c61dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Remove check_success_ratejose.lausuch3-22/+34
After the introduction of is_successful method in TestCase class, this is not needed anymore. Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-18Merge "Fix the opera ims instance initialization error"Jose Lausuch1-4/+4
2017-05-18Add a new directory to hold pre-downloaded imageshelenyao3-3/+3
Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-17Update self.result value to INTjose.lausuch1-1/+3
So far, the test cases are storing a string "PASS" "FAIL" in the self.result variable. The way the new framework works is with INT Values. Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-17Merge "Add Python3 support to the ODL testcase"Jose Lausuch1-5/+5
2017-05-17Add Python3 support to the ODL testcaseCédric Ollivier1-5/+5
It also adds this support to its dependencies. Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Converted vPing to leverage the object-oriented SNAPS library.spisarski6-397/+445
JIRA: FUNCTEST-577 1. Replaced procedural openstack_utils with the object-oriented SNAPS library 2. Tests now clean themselves up. 3. Improved code documentation. 4. Removed dependency on file-based Cirros image and now leveraging the download URL. 5. Removed hardcoded location to the testcases.yaml file to leverage the value in config_functest.yaml 6. Included optional flavor metadata based on the scenario being tested 7. Included support for multi-part images. 8. Added enhanced support for configurable images. see SNAPS-76 Fixed line length verification problem with the previous submission Fixed retrieval of external network name to be dynamic. Changed external network name retrieval to leverage the newly merged snap_util.get_ext_net_name() function Added the creation and deletion of flavors. SNAPS now has the ability to add/remove security groups from running instances. Changed VMInstance constructor by moving userdata to configuration object. Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-10Merge "Conform ODL with last framework updates"Morgan Richomme1-1/+8
2017-05-09Merge "Bugfix: initialize the logger for snaps"Cedric Ollivier1-0/+3
2017-05-09Conform ODL with last framework updatesCédric Ollivier1-1/+8
Now ODL TestCase calculates the ratio between critical tests passed and failed and saves it in result. Non-critical test cases can fail as result doesn't take them into account [1]. It also updates default attribute values in TestCase and allows result to be float. [1] http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-criticality Change-Id: Id4a89271b5b1a90cd3c1e2b08591ff26ffaffee0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Rename VnfOnBoardingBase to VnfOnBoardingCédric Ollivier3-3/+3
Change-Id: I514340fc6180e29b31ef11bdea9f719aa2bbb738 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Rename vnf_base to vnfCédric Ollivier3-7/+7
Change-Id: I0b8b9b2e85717fc92a233e4f7344b3419421778d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Bugfix: initialize the logger for snapsLinda Wang1-0/+3
Testcases about snaps failed due to the absence of attribute 'logger'. Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-08Fix the opera ims instance initialization errorhelenyao1-4/+4
Change-Id: I50f0e1ba91c8c4adcf407d493fb86d9089554cc5 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-05Merge "Extended the timeout for Opera"Jose Lausuch1-6/+6
2017-05-05Merge "Define loggers as class-private members"Jose Lausuch2-16/+20
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch20-43/+49
2017-05-04Define loggers as class-private membersCédric Ollivier2-16/+20
This mangling ensures that all info messages printed from core packages are shown in console. It also avoids sphinx to print them. Change-Id: I07db9f33060c195bce3b48b06a6640eb6c56c2eb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier20-43/+49
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Merge "Update tempest.conf to enable tempest from external server"Jose Lausuch1-1/+8
2017-05-04Merge changes from topic 'remove_openstack_dir'Morgan Richomme1-128/+0
* changes: Remove openstack directory Remove create_instance_and_ip.py
2017-05-04Merge "refstack-client userguide"Morgan Richomme1-1/+8
2017-05-04Extended the timeout for Operahelenyao1-6/+6
Change-Id: Ifeb4aecf66d75c9bb98d5dafdbe20be78423565e Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-03Update tempest.conf to enable tempest from external serverLinda Wang1-1/+8
1. The endpoint type to use for OpenStack Identity API v3 "v3_endpoint_type" is set to be "adminURL" by default, which should be updated to the env OS_ENDPOINT_TYPE with the value "publicURL" 2. Reset the identity region name to "RegionOne" 3. For keystone api v3 in Newton, 5 testcases aimming at identity admin v2 test should be omitted. JIRA: FUNCTEST-801 Change-Id: I47ae41a80de0a52d32d25c9783860955f465099c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-03refstack-client userguideMatthewLi1-1/+8
JIRA: FUNCTEST-758 container setup steps are skipped, since they already included in the functest userguide documents. Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-02Merge "Fix pylint warnings in snaps"Jose Lausuch3-9/+9
2017-05-02Remove create_instance_and_ip.pyjose.lausuch1-128/+0
JIRA: FUNCTEST-817 Change-Id: Ib297ec656a19c9ea4e06c6f2e133ed514a1dbf35 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-02Merge "rename tempest.conf to refstack_tempest.conf"Jose Lausuch1-2/+2
2017-04-30Fix pylint warnings in snapsCédric Ollivier3-9/+9
Pylint only warns about missing module docstrings now. Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-27Fix the instance initialization error for OnosSfchelenyao1-29/+37
Change-Id: I1820bed1bbb7dbddd3923ea6439f58592595f5c8 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-04-26Catch os.makedirs() exceptions in tempest.pyCédric Ollivier1-4/+2
It can raise an error exception if the leaf directory already exists or cannot be created [1]. [1] https://docs.python.org/2/library/os.html JIRA: FUNCTEST-804 Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier11-15/+15
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-24Remove useless lines of code in barometer.pyCédric Ollivier1-3/+0
Change-Id: Ie312dbd296a85a35096294331c28a45f8dc10d0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-22rename tempest.conf to refstack_tempest.confMatthewLi1-2/+2
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-18Fix Sphinx warnings/errorsCédric Ollivier1-2/+3
It takes into account the following warnings/errors: - Inline strong start-string without end-string - Unexpected indentation Change-Id: Idb05c7b04ba98ef8f3ef65e6ec7c9bb5b7571cad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-14Merge "Updated method calls to SNAPS tests."Cedric Ollivier6-28/+28
2017-04-14Remove deprecated feature modulesCédric Ollivier10-209/+0
All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-13Updated method calls to SNAPS tests.spisarski6-28/+28
Due to the refactoring performed in gerrit patch 31435, the calls to the SNAPS tests needed to be updated. JIRA: SNAPS-23 Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29 Signed-off-by: spisarski <s.pisarski@cablelabs.com>