summaryrefslogtreecommitdiffstats
path: root/docs/submodules/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-05-22Update git submodulesvalentin boucher1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Print stack when catching exceptions in run_tests.py" - Print stack when catching exceptions in run_tests.py Change-Id: Id94475dd519ce04b87da470f6e6bb5a1c1aa2d75 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-22Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Replace CONST.* by getattribute/setattr for refstack" - Replace CONST.* by getattribute/setattr for refstack Directories affected: - functest/opnfv_tests/openstack/refstack_client and respective unit test JIRA: FUNCTEST-796 Change-Id: I7f7047d44d71e82bcc1f66ec0b760ff30a13dbd5 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Update git submodulesTim Irnich1-0/+0
* Update docs/submodules/functest from branch 'master' - Activating SDNVPN test cases for master. Change-Id: I4ba995d412bfeadc708d5a3c643576097867d1ac Signed-off-by: Tim Irnich <tim.irnich@ericsson.com>
2017-05-19Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Replace CONST.* by getattribute/setattr for rally and tempest" - Replace CONST.* by getattribute/setattr for rally and tempest Directories affected: - functest/opnfv_tests/openstack/rally - functest/opnfv_tests/openstack/tempest and respective unit test JIRA: FUNCTEST-796 Change-Id: I963f5947663f0b660337f3304defb697f5d338f3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Define Runner class" - Define Runner class It simply converts run_tests.py's functions to Runner's methods. This proposal could be enhanced in a second step to fully leverage on object programming. It defines as instance variables the former static variables to allow multiple runs (it's mandatory for unit testing). All false positives in unit tests are fixed but run_tests.py is still not fully covered. Change-Id: I8f91c132aa8b2248041f31e46238dd5598344d34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Modify how to disable logging in unit test." - Modify how to disable logging in unit test. Logs are only disabled when the unit tests are run from cmdline. It allows running them via pytest_suite_runner.py and printing their results to functest.log. You should notice that the unit test must disable the logger of the tested TestCase (e.g. testcase.TestCase.logger.disabled = 1). Otherwise false logs will be printed in console. Change-Id: Ic171e4575c8bab2e52db1897ae026b61a03b6247 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Documentation for unit test project" - Documentation for unit test project JIRA: FUNCTEST-594 Change-Id: I2ae821f4bc2283d736a635357aea89dc95a7c839 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-05-19Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Use StringIO in odl.py" - Use StringIO in odl.py It avoids creating and removing the temporary file to dump robot output. Change-Id: Ia5ea66e76ffb8b8327f2da938f177e8ef4c61dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Move few local ODL SFC confs to global functest confs" - Move few local ODL SFC confs to global functest confs - Currently ODL SFC maitains image url, name, format in its local config.yaml - This makes it complicated to override some of the params for other architecture - like aarch64. This should help overriding some params during functest env prepare - based on arch Change-Id: I81a62566634e0bd87a53f5d0431492468a5f478c Signed-off-by: Vijayendra Radhakrishna <vradhakrishna@mvista.com>
2017-05-19Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Replace CONST.* by getattribute/setattr for cli" - Replace CONST.* by getattribute/setattr for cli Directories affected: - functest/cli/commands and respective unit test JIRA: FUNCTEST-796 Change-Id: I2ad721819d4b8f97098c589c3b5ed3dcc945409d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Update git submodulesHelen Yao1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Add a new directory to hold pre-downloaded images" - Add a new directory to hold pre-downloaded images Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-18Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Use logger instead of printing in console" - Use logger instead of printing in console It modifies pytest_suite_runner.py to dump unit test results in functest.log via logging. Change-Id: Ic4e7567c5e52e00ad0e485ccb070029b135041b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Remove check_success_rate" - Remove check_success_rate After the introduction of is_successful method in TestCase class, this is not needed anymore. Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-18Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fix 2 issues related to logger in pytest_suite_runer.py" - Fix 2 issues related to logger in pytest_suite_runer.py logging.ini requires the full name otherwise all log messages are lost. Calling basicConfig() is useless as it has been correctly configured by run_tests.py before. Change-Id: I03663c01f795b1b844239a9e24379faa529829aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Allow running unittest.TestCase via run_tests.py" - Allow running unittest.TestCase via run_tests.py pytest_suite_runner can run any unittest.TestCase thanks to name passed as run arg. Here is the related functest/ci/testcases.yaml: run: module: 'functest.core.pytest_suite_runner' class: 'PyTestSuiteRunner' args: name: 'functest.tests.unit.odl.test_odl' Change-Id: I7c2c611c4afbad1e52bfdca4a3288ccc21491389 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Clean test-requirements.txt" - Clean test-requirements.txt Now only the mandatory requirements related to unit testing are listed in test-requirements.txt. Change-Id: I2f17a9e18e90d779ddc80b1ace9ac770a76c3385 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fix the opera ims instance initialization error" - Fix the opera ims instance initialization error Change-Id: I50f0e1ba91c8c4adcf407d493fb86d9089554cc5 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-17Update git submodulesjose.lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Update self.result value to INT So far, the test cases are storing a string "PASS" "FAIL" in the self.result variable. The way the new framework works is with INT Values. Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-17Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Conform constants.py with the minimal standards" - Conform constants.py with the minimal standards It adds the shebang to constants.py and its dependencies and stops importing from a relative path. It stops printing obsolete values too. It adds python3 support to them by the way. Change-Id: Ie7bddcf253eb245844d9e11c17acc69943c1ba63 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fix an unorderable types error (if python 3)" - Fix an unorderable types error (if python 3) Change-Id: I07c5a548f10a1779faead4d9c596a1976aff8866 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Add Python3 support to the ODL testcase" - Add Python3 support to the ODL testcase It also adds this support to its dependencies. Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Converted vPing to leverage the object-oriented SNAPS library." - Converted vPing to leverage the object-oriented SNAPS library. JIRA: FUNCTEST-577 1. Replaced procedural openstack_utils with the object-oriented SNAPS library 2. Tests now clean themselves up. 3. Improved code documentation. 4. Removed dependency on file-based Cirros image and now leveraging the download URL. 5. Removed hardcoded location to the testcases.yaml file to leverage the value in config_functest.yaml 6. Included optional flavor metadata based on the scenario being tested 7. Included support for multi-part images. 8. Added enhanced support for configurable images. see SNAPS-76 Fixed line length verification problem with the previous submission Fixed retrieval of external network name to be dynamic. Changed external network name retrieval to leverage the newly merged snap_util.get_ext_net_name() function Added the creation and deletion of flavors. SNAPS now has the ability to add/remove security groups from running instances. Changed VMInstance constructor by moving userdata to configuration object. Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-17Update git submodulesJamo Luhrsen1-0/+0
* Update docs/submodules/functest from branch 'master' - Update/Add requirements to run ODL robot CSIT It conforms test_odl.py with the new RobotFramework API too. It also updates test-requirements.txt as required by the current implementation of run_unit_tests.sh. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ibca0150a40d3b8a3f736be1e9dcbf9ce56af0299 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fix one minor typo" - Fix one minor typo Change-Id: Id17070985adfbe7817f3be25b47f583cb9ef90b6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fully cover the decorator" - Fully cover the decorator Change-Id: I1f1c938f0715e6afb7edbb8242f9a6c9cbfa65b5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Assign the wrapped function’s attributes" - Assign the wrapped function’s attributes It mainly assigns to the wrapper push_results_to_db's __name__, __module__ and __doc__ and the documentation string. Change-Id: Idc882ac4e743699a4887e46c5066e0983c90afd9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Additional Unit Tests for core modules" - Additional Unit Tests for core modules This patch adds unit tests for vnf and pytest_suite_runner. It also fixes several pylint warnings/errors. Additional tests are required to check args values. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I75a829233481655c794402830e1da037ab7cdb8d Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-05-16Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Get a logger before printing" - Get a logger before printing It also fixes pylint errors. Change-Id: I0d973360574a517724d0be3986c788c3ce7f54d4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesjose.lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Add enabled flag in testcases.yaml This will allow enable/disable test cases directly using true/false. Change-Id: Iaa7d051ebb8dd9e5a6f835a823f58f1e17a87b8d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-16Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Switch from generate_report to PrettyTable run_tests.py now relies on PrettyTable as most of the openstack clients. generate_report.py and its related unit tests are simply removed. It sets padding_width=5 in testcase.py too to conform with run_tests.py. Now report is printed in every case. Change-Id: Id9ce93f984503f25d6a2150482f397853fa3dd64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Update framework pres It takes into account the next framework modifications: - Switch TestCase attribute criteria to result [1] - Manage criteria in TestCase [2] - Print the real testcase duration [3] - Rename TestCase check_result() to is_successful() [4] [1] https://gerrit.opnfv.org/gerrit/#/c/33695/ [2] https://gerrit.opnfv.org/gerrit/#/c/33697/ [3] https://gerrit.opnfv.org/gerrit/#/c/34369/ [4] https://gerrit.opnfv.org/gerrit/#/c/34373/ Change-Id: I3a6790e4233ef4c55b0535618dacf702f779f28b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Fix how to get tier_name The tier name was incorrect when passing a test case as run_test.py arg. Change-Id: I6f439fc7b90facb3f0553798bd1fe06ac9f09475 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Modify TestCase.__str__() to use PrettyTable" - Modify TestCase.__str__() to use PrettyTable It adds PrettyTable as requirement even if it's already defined in OpenStack client dependencies. If the TestCase object is considered as invalid, it simply returns the default str. Change-Id: Iee788aef2a13694d9482560977cbbf21c7f2c967 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-15Update git submodulesGeorge Paraskevopoulos1-0/+0
* Update docs/submodules/functest from branch 'master' - Upgrade robotframework-sshlibrary to 2.1.3 Robotframework sshlibrary monkeypatches paramiko runtime and version 2.1.1 causes 2017-03-27 15:24:23,196 - SSH utils - ERROR - _custom_start_client() got an unexpected keyword argument 'timeout' errors in SFC test because of the issue https://github.com/robotframework/SSHLibrary/issues/158 This issue is resolved in version 2.1.3 Change-Id: I07f570c1a90f358b9f17aa6c959642d67e07a7e4 Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2017-05-12Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Add Energy recording support" - Add Energy recording support It adds helpers to send notifications to Energy recording API and related unit tests. It requires a dedicated section in functest config file to set connectivity parameters to Energy recording API. It is using shared API Recording at http://161.105.253.100:8888 Change-Id: Idcb74d1bf7341ccce7cc1c3926f22338ce24f714 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-05-10Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Conform ODL with last framework updates" - Conform ODL with last framework updates Now ODL TestCase calculates the ratio between critical tests passed and failed and saves it in result. Non-critical test cases can fail as result doesn't take them into account [1]. It also updates default attribute values in TestCase and allows result to be float. [1] http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-criticality Change-Id: Id4a89271b5b1a90cd3c1e2b08591ff26ffaffee0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-10Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge changes from topic 'add_testcase_str' * changes: Remove the former results in DB url Implement TestCase __str__() - Remove the former results in DB url It conforms generate_report.py with the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/33511/ Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> - Implement TestCase __str__() It's designed to be called by run_tests.py when printing the results of test cases and when generating the global report. Change-Id: If4a6f023ef2344bbc4f940d07dde4b776dce5d68 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Bugfix: initialize the logger for snaps" - Bugfix: initialize the logger for snaps Testcases about snaps failed due to the absence of attribute 'logger'. Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-09Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Rename VnfOnBoardingBase to VnfOnBoarding Change-Id: I514340fc6180e29b31ef11bdea9f719aa2bbb738 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> - Rename vnf_base to vnf Change-Id: I0b8b9b2e85717fc92a233e4f7344b3419421778d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-06Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Rename TestCase check_result() to is_successful()" - Rename TestCase check_result() to is_successful() Change-Id: I41cea33b4c1dae79e75231e7c7e069fc89736f34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Print the real testcase duration" - Print the real testcase duration TestCase offers a new public method to calculate and print the duration. It also adds the related unit tests and adapts run_tests.py. Change-Id: Ib6a7e637dafacb9027146199aeb033c2dcb986c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Replace CONST.* by getattribute/setattr" - Replace CONST.* by getattribute/setattr Directories affected: - ci - core and respective unit tests Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Extended the timeout for Opera" - Extended the timeout for Opera Change-Id: Ifeb4aecf66d75c9bb98d5dafdbe20be78423565e Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Add iniparse to requirements.txt" - Add iniparse to requirements.txt Package iniparse is absent for functest, while it is required by rally.py Change-Id: Ia50216cfebdc9033f6a5f4abc6338951aaa2e8ab Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Check open args in test_odl" - Check open args in test_odl Change-Id: I4b0060502621c7491820b9aa42d8f2f63b06a9ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Replace project_name by case_name in result file name" - Replace project_name by case_name in result file name It avoids erasing functest.log when project_name = functest. Change-Id: Icae898abb8b51c89b79bb1124adfadab8b0b3b99 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Add Danube 2.0 reporting status Change-Id: Icc09b824a4e7906dfab031b679ba3d0aa86ab0cd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Forbid calling generate_report from cmdline" - Forbid calling generate_report from cmdline Change-Id: Ic9ea7507dc5f1f781b57c4573e971a2c8a8ca9ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Define loggers as class-private members" - Define loggers as class-private members This mangling ensures that all info messages printed from core packages are shown in console. It also avoids sphinx to print them. Change-Id: I07db9f33060c195bce3b48b06a6640eb6c56c2eb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Delete functest.utils.functest_logger" - Delete functest.utils.functest_logger It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>