summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-05-21Remove former run_unit_tests.shCédric Ollivier1-5/+0
Depends-On: I934f4ac739d99d0cb29bea8c6aac6d6780b30901 Change-Id: I67c8a25a2e712babf99e32fb4c049b0acfd2e44d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Check python3 support when running toxCédric Ollivier2-4/+52
It only tests testcase, feature and odl which supports python3. It creates a temporary requirements.py3.txt which will be safely removed when we stop using subprocess32 [1] and robotframework-sshlibrary. [1] https://jira.opnfv.org/browse/FUNCTEST-827 Change-Id: I92021dcb4aca03f64e2441e3bcff34675a3ae879 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Generate api doc when running toxCédric Ollivier2-1/+7
Change-Id: I78b18981d9f916e6174d44c6280706e404c7c9f2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Update apidoc to conform with vnf moduleCédric Ollivier3-8/+8
It completes [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/34467/ Change-Id: Ia4a850b740764774b926d5cdb92c8813bc93f9e4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Analyse code when running toxCédric Ollivier2-1/+10
It filters all messages to ease reading the report. Change-Id: Iab55bc71cb6026edde29fb9f084a07b2dedf564f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Check style when running toxCédric Ollivier2-1/+8
Change-Id: Idedf823a1572c40692e445694461b4196b75275d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Delete line breaks before binary operatorCédric Ollivier2-6/+7
They are considered as warnings by flake8. Change-Id: I84ffedc41c24133aa0d45e312bb095526aa1095b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Sort keys when dumping jsonCédric Ollivier2-2/+3
Otherwise dumping them could break some unit tests as they are unordered collections [1]. [1] https://build.opnfv.org/ci/job/functest-verify-master/4122/ Change-Id: I108e946926ae9690cf2421e565f2bb81500f9160 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-21Ignore .toxCédric Ollivier1-0/+1
Change-Id: I50e39057edbbfadd57ea912f1f1ba32389639809 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-20Tox utility to run unit testsashishk19943-65/+15
Now run_unit_tests.sh only calls tox to allow merging. It can be safely deleted as soon as the related jjob is updated. It also removes test_logging.ini. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I934f4ac739d99d0cb29bea8c6aac6d6780b30901 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-20Update requests as defined in relengCédric Ollivier1-1/+1
Change-Id: I808cb796d18cf7f193a37e7b7d9073a037bb2ae7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-20Add baro_tests as requirementsCédric Ollivier3-7/+3
It also stops cloning it when building the docker container and updates the related unit tests. It bypasses the bug when importing collectd [1]. [1] https://jira.opnfv.org/browse/BAROMETER-79 Change-Id: Ie9f8ea2b3c95d6b1f5405d76b018cdcb62343a58 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-20Install releng via requirements.txtCédric Ollivier4-16/+1
It should work in all branches if the right requirements.txt is selected. Change-Id: I9c46cd52496528835a92e371320debf92117b4fa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Set default value for CONFIG_FUNCTEST_YAMLCédric Ollivier4-5/+8
It calculates via the full path of env.py. Change-Id: Ief958833f5116cdb116d0153d85a0ae03063ec5c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Activating SDNVPN test cases for master.Tim Irnich1-1/+0
Change-Id: I4ba995d412bfeadc708d5a3c643576097867d1ac Signed-off-by: Tim Irnich <tim.irnich@ericsson.com>
2017-05-19Merge "Replace CONST.* by getattribute/setattr for rally and tempest"Jose Lausuch6-113/+129
2017-05-19Merge "Define Runner class"Jose Lausuch2-275/+300
2017-05-19Replace CONST.* by getattribute/setattr for rally and tempestLinda Wang6-113/+129
Directories affected: - functest/opnfv_tests/openstack/rally - functest/opnfv_tests/openstack/tempest and respective unit test JIRA: FUNCTEST-796 Change-Id: I963f5947663f0b660337f3304defb697f5d338f3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-19Merge "Modify how to disable logging in unit test."Jose Lausuch30-65/+36
2017-05-19Merge "Documentation for unit test project"Morgan Richomme1-10/+66
2017-05-19Merge "Use StringIO in odl.py"Morgan Richomme2-53/+5
2017-05-19Merge "Move few local ODL SFC confs to global functest confs"Morgan Richomme2-0/+14
2017-05-19Merge "Replace CONST.* by getattribute/setattr for cli"Morgan Richomme8-66/+85
2017-05-19Merge "Add a new directory to hold pre-downloaded images"Helen Yao10-12/+64
2017-05-18Merge "Use logger instead of printing in console"Jose Lausuch1-3/+13
2017-05-18Modify how to disable logging in unit test.Cédric Ollivier30-65/+36
Logs are only disabled when the unit tests are run from cmdline. It allows running them via pytest_suite_runner.py and printing their results to functest.log. You should notice that the unit test must disable the logger of the tested TestCase (e.g. testcase.TestCase.logger.disabled = 1). Otherwise false logs will be printed in console. Change-Id: Ic171e4575c8bab2e52db1897ae026b61a03b6247 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Merge "Remove check_success_rate"Jose Lausuch7-79/+34
2017-05-18Use StringIO in odl.pyCédric Ollivier2-53/+5
It avoids creating and removing the temporary file to dump robot output. Change-Id: Ia5ea66e76ffb8b8327f2da938f177e8ef4c61dd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Merge "Fix 2 issues related to logger in pytest_suite_runer.py"Jose Lausuch1-3/+1
2017-05-18Merge "Allow running unittest.TestCase via run_tests.py"Jose Lausuch1-0/+5
2017-05-18Use logger instead of printing in consoleCédric Ollivier1-3/+13
It modifies pytest_suite_runner.py to dump unit test results in functest.log via logging. Change-Id: Ic4e7567c5e52e00ad0e485ccb070029b135041b2 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Merge "Clean test-requirements.txt"Jose Lausuch3-23/+5
2017-05-18Remove check_success_ratejose.lausuch7-79/+34
After the introduction of is_successful method in TestCase class, this is not needed anymore. Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-18Merge "Fix the opera ims instance initialization error"Jose Lausuch1-4/+4
2017-05-18Replace CONST.* by getattribute/setattr for cliLinda Wang8-66/+85
Directories affected: - functest/cli/commands and respective unit test JIRA: FUNCTEST-796 Change-Id: I2ad721819d4b8f97098c589c3b5ed3dcc945409d Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-18Add a new directory to hold pre-downloaded imageshelenyao10-12/+64
Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-18Fix 2 issues related to logger in pytest_suite_runer.pyCédric Ollivier1-3/+1
logging.ini requires the full name otherwise all log messages are lost. Calling basicConfig() is useless as it has been correctly configured by run_tests.py before. Change-Id: I03663c01f795b1b844239a9e24379faa529829aa Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Allow running unittest.TestCase via run_tests.pyCédric Ollivier1-0/+5
pytest_suite_runner can run any unittest.TestCase thanks to name passed as run arg. Here is the related functest/ci/testcases.yaml: run: module: 'functest.core.pytest_suite_runner' class: 'PyTestSuiteRunner' args: name: 'functest.tests.unit.odl.test_odl' Change-Id: I7c2c611c4afbad1e52bfdca4a3288ccc21491389 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Clean test-requirements.txtCédric Ollivier3-23/+5
Now only the mandatory requirements related to unit testing are listed in test-requirements.txt. Change-Id: I2f17a9e18e90d779ddc80b1ace9ac770a76c3385 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Update self.result value to INTjose.lausuch4-9/+11
So far, the test cases are storing a string "PASS" "FAIL" in the self.result variable. The way the new framework works is with INT Values. Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-17Merge "Conform constants.py with the minimal standards"Cedric Ollivier3-21/+21
2017-05-17Conform constants.py with the minimal standardsCédric Ollivier3-21/+21
It adds the shebang to constants.py and its dependencies and stops importing from a relative path. It stops printing obsolete values too. It adds python3 support to them by the way. Change-Id: Ie7bddcf253eb245844d9e11c17acc69943c1ba63 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Merge "Fix an unorderable types error (if python 3)"Jose Lausuch1-0/+1
2017-05-17Merge "Add Python3 support to the ODL testcase"Jose Lausuch8-91/+95
2017-05-17Merge "Converted vPing to leverage the object-oriented SNAPS library."Jose Lausuch8-404/+471
2017-05-17Fix an unorderable types error (if python 3)Cédric Ollivier1-0/+1
Change-Id: I07c5a548f10a1779faead4d9c596a1976aff8866 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Add Python3 support to the ODL testcaseCédric Ollivier8-91/+95
It also adds this support to its dependencies. Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-17Update/Add requirements to run ODL robot CSITJamo Luhrsen3-11/+12
It conforms test_odl.py with the new RobotFramework API too. It also updates test-requirements.txt as required by the current implementation of run_unit_tests.sh. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ibca0150a40d3b8a3f736be1e9dcbf9ce56af0299 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Converted vPing to leverage the object-oriented SNAPS library.spisarski8-404/+471
JIRA: FUNCTEST-577 1. Replaced procedural openstack_utils with the object-oriented SNAPS library 2. Tests now clean themselves up. 3. Improved code documentation. 4. Removed dependency on file-based Cirros image and now leveraging the download URL. 5. Removed hardcoded location to the testcases.yaml file to leverage the value in config_functest.yaml 6. Included optional flavor metadata based on the scenario being tested 7. Included support for multi-part images. 8. Added enhanced support for configurable images. see SNAPS-76 Fixed line length verification problem with the previous submission Fixed retrieval of external network name to be dynamic. Changed external network name retrieval to leverage the newly merged snap_util.get_ext_net_name() function Added the creation and deletion of flavors. SNAPS now has the ability to add/remove security groups from running instances. Changed VMInstance constructor by moving userdata to configuration object. Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-16Define Runner classCédric Ollivier2-275/+300
It simply converts run_tests.py's functions to Runner's methods. This proposal could be enhanced in a second step to fully leverage on object programming. It defines as instance variables the former static variables to allow multiple runs (it's mandatory for unit testing). All false positives in unit tests are fixed but run_tests.py is still not fully covered. Change-Id: I8f91c132aa8b2248041f31e46238dd5598344d34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>