Age | Commit message (Collapse) | Author | Files | Lines |
|
Now only the mandatory requirements related to unit testing are listed
in test-requirements.txt.
Change-Id: I2f17a9e18e90d779ddc80b1ace9ac770a76c3385
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
So far, the test cases are storing a string "PASS" "FAIL"
in the self.result variable.
The way the new framework works is with INT Values.
Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
|
|
It adds the shebang to constants.py and its dependencies and stops
importing from a relative path. It stops printing obsolete values too.
It adds python3 support to them by the way.
Change-Id: Ie7bddcf253eb245844d9e11c17acc69943c1ba63
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
|
|
Change-Id: I07c5a548f10a1779faead4d9c596a1976aff8866
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also adds this support to its dependencies.
Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It conforms test_odl.py with the new RobotFramework API too.
It also updates test-requirements.txt as required by the current
implementation of run_unit_tests.sh.
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ibca0150a40d3b8a3f736be1e9dcbf9ce56af0299
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-577
1. Replaced procedural openstack_utils with the object-oriented SNAPS
library
2. Tests now clean themselves up.
3. Improved code documentation.
4. Removed dependency on file-based Cirros image and now leveraging the
download URL.
5. Removed hardcoded location to the testcases.yaml file to leverage
the value in config_functest.yaml
6. Included optional flavor metadata based on the scenario being tested
7. Included support for multi-part images.
8. Added enhanced support for configurable images. see SNAPS-76
Fixed line length verification problem with the previous submission
Fixed retrieval of external network name to be dynamic.
Changed external network name retrieval to leverage the newly merged
snap_util.get_ext_net_name() function
Added the creation and deletion of flavors.
SNAPS now has the ability to add/remove security groups from running instances.
Changed VMInstance constructor by moving userdata to configuration object.
Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26
Signed-off-by: spisarski <s.pisarski@cablelabs.com>
|
|
|
|
|
|
|
|
|
|
|
|
This will allow enable/disable test cases directly
using true/false.
Change-Id: Iaa7d051ebb8dd9e5a6f835a823f58f1e17a87b8d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
run_tests.py now relies on PrettyTable as most of the openstack clients.
generate_report.py and its related unit tests are simply removed.
It sets padding_width=5 in testcase.py too to conform with
run_tests.py.
Now report is printed in every case.
Change-Id: Id9ce93f984503f25d6a2150482f397853fa3dd64
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account the next framework modifications:
- Switch TestCase attribute criteria to result [1]
- Manage criteria in TestCase [2]
- Print the real testcase duration [3]
- Rename TestCase check_result() to is_successful() [4]
[1] https://gerrit.opnfv.org/gerrit/#/c/33695/
[2] https://gerrit.opnfv.org/gerrit/#/c/33697/
[3] https://gerrit.opnfv.org/gerrit/#/c/34369/
[4] https://gerrit.opnfv.org/gerrit/#/c/34373/
Change-Id: I3a6790e4233ef4c55b0535618dacf702f779f28b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The tier name was incorrect when passing a test case as run_test.py arg.
Change-Id: I6f439fc7b90facb3f0553798bd1fe06ac9f09475
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Change-Id: Id17070985adfbe7817f3be25b47f583cb9ef90b6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This patch adds unit tests for vnf and pytest_suite_runner.
It also fixes several pylint warnings/errors.
Additional tests are required to check args values.
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I75a829233481655c794402830e1da037ab7cdb8d
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
It also fixes pylint errors.
Change-Id: I0d973360574a517724d0be3986c788c3ce7f54d4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I1f1c938f0715e6afb7edbb8242f9a6c9cbfa65b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mainly assigns to the wrapper push_results_to_db's __name__,
__module__ and __doc__ and the documentation string.
Change-Id: Idc882ac4e743699a4887e46c5066e0983c90afd9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Robotframework sshlibrary monkeypatches paramiko runtime and version
2.1.1 causes
2017-03-27 15:24:23,196 - SSH utils - ERROR - _custom_start_client() got
an unexpected keyword argument 'timeout'
errors in SFC test because of the issue
https://github.com/robotframework/SSHLibrary/issues/158
This issue is resolved in version 2.1.3
Change-Id: I07f570c1a90f358b9f17aa6c959642d67e07a7e4
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
|
|
|
|
It adds PrettyTable as requirement even if it's already defined in
OpenStack client dependencies.
If the TestCase object is considered as invalid, it simply returns the
default str.
Change-Id: Iee788aef2a13694d9482560977cbbf21c7f2c967
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
* changes:
Remove the former results in DB url
Implement TestCase __str__()
|
|
|
|
It conforms generate_report.py with the previous change [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/33511/
Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It adds helpers to send notifications to Energy recording API and
related unit tests.
It requires a dedicated section in functest config file
to set connectivity parameters to Energy recording API.
It is using shared API Recording at http://161.105.253.100:8888
Change-Id: Idcb74d1bf7341ccce7cc1c3926f22338ce24f714
Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
|
|
Now ODL TestCase calculates the ratio between critical tests passed
and failed and saves it in result. Non-critical test cases can fail as
result doesn't take them into account [1].
It also updates default attribute values in TestCase and allows result
to be float.
[1] http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-criticality
Change-Id: Id4a89271b5b1a90cd3c1e2b08591ff26ffaffee0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I514340fc6180e29b31ef11bdea9f719aa2bbb738
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I0b8b9b2e85717fc92a233e4f7344b3419421778d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Testcases about snaps failed due to the absence of attribute 'logger'.
Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It's designed to be called by run_tests.py when printing the results of
test cases and when generating the global report.
Change-Id: If4a6f023ef2344bbc4f940d07dde4b776dce5d68
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
Change-Id: I41cea33b4c1dae79e75231e7c7e069fc89736f34
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
TestCase offers a new public method to calculate and print the duration.
It also adds the related unit tests and adapts run_tests.py.
Change-Id: Ib6a7e637dafacb9027146199aeb033c2dcb986c6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
Directories affected:
- ci
- core
and respective unit tests
Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
|
|
|
|
|
|
It avoids erasing functest.log when project_name = functest.
Change-Id: Icae898abb8b51c89b79bb1124adfadab8b0b3b99
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|