Age | Commit message (Collapse) | Author | Files | Lines |
|
Now ODL TestCase calculates the ratio between critical tests passed
and failed and saves it in result. Non-critical test cases can fail as
result doesn't take them into account [1].
It also updates default attribute values in TestCase and allows result
to be float.
[1] http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-criticality
Change-Id: Id4a89271b5b1a90cd3c1e2b08591ff26ffaffee0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I4b0060502621c7491820b9aa42d8f2f63b06a9ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mainly removes _fake_url_for() which is useless since get_endpoint()
is not called for identity.
Coverage for functest/tests/unit/odl/test_odl.py : 100%
Change-Id: I5809c5eac4021c44113e70379621ab311187c669
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mainly avoids mixing input and output.
Criteria is now an input set in functest/ci/testcases.yaml and then
must be passed as __init__() args (which will be proposed in an
additional change).
Then it also renames the related TestCase method to
check_result().
Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Every feature/testcase now allows receiving the data defined in
testcases.yaml as args (name is renamed to case_name).
From the time being, only project and case names are handled. Next
pending patches will add criteria, cmd and repo to this list.
It keeps the default values for case names except for features which
will be aggregated into Feature.
Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account the following warnings:
- wrong-import-order
- bad-continuation
- unused-argument
- invalid-name
- too-many-arguments
missing-docstring is partially disabled as they are unit tests.
It has been rated at 10.00/10.
Change-Id: I35886ec75a9e66817cfd0fe18534f157d7500a2b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It simply removes the useless suffix.
Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and
removes the useless suffix too.
[1] https://gerrit.opnfv.org/gerrit/#/c/25391/
Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Added:
- fds repository to docker file
- fds test to smoke tier in testcases
- config values for fds tests
A new robot var OS_AUTH_URL is defined as expected by FDS robot files.
Method args switch from Keystone IP to OS_AUTH_URL which is more
precised. The argument parsing is changed too.
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Ife27ab4a83f0110cbdcf7c9d47d9b3fb4c0ec705
Signed-off-by: Tomas Cechvala <tcechval@cisco.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
For the odl test the default odl port is 8080. In netvirt this is the
same as apex.
Change-Id: I949510e4f7fb57bcf8ec01f69f7941c5d55c98e7
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
|
|
ODLTests can manage multiple sets of suites passing as run args.
It avoids duplicating odl.py according to ODL features installed (e.g.
netvirt).
Change-Id: Ibb0697ef9441506c3f33627e13a0845cc482e23f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-690
The detailed benefits are listed in the JIRA description.
1. Refactored the functest_logger to make use of configuration file
2. Avoided configuring the logging every time a logger is initialized
3. Applied separate logging configuration fo unit test by removing
saving log to file
Change-Id: I6e27eaba727ae6d704f0301f15359dc3ea7b2f97
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
Change-Id: Ie3579254b8f09eda3707fbc4b8d098a292f52a93
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
|
|
Apex has enabled tripleo firewall in deployments which block access to
port 8181. Only port 8081 is exposed on the admin network now.
Change-Id: I58e5eaf16cfc0738c248e1468b2d59cc9f542ddd
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
The ODL testcase is now fully covered by unit tests.
Change-Id: I856a40138739b148babcfa96e82da05bb83e63e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It helps covering lines about args parsing without calling main.
It also excludes 'if __name__ == .__main__.:' from coverage.
The related unit tests are added too.
Change-Id: I8e001a9d35081000977e0e546ae505f7cf2870e6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
re.sub() is now tested.
Change-Id: I83cf69b66cd1407f5e4439d8c545338c5fb0bde7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
/home/opnfv is no longer required.
Change-Id: Iefb8faf3a7d548f3ae7d4076005d7b0bb93e63e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It avoids creating a dummy functest.log for unit testing.
Change-Id: Ib163d5d58284822b1904444fb60b08e92ee0ab9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It adds unit tests to cover ODLResultVisitor and then increases the
coverage to 78%. It also fixes a nit in details pushed to DB.
Change-Id: Ie4c31df67b5197c4273ee835242153e74b50601d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It partially reverts [1] (odl.py + test_odl.py).
[1] https://gerrit.opnfv.org/gerrit/#/c/24619/
Change-Id: Ie51ccf10f8ffa0a63086796f8bb722ef50567b2d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows checking testcase results and then returning an error value
to CI. Now run() should return EX_OK even if criteria is FAILED.
It also fixes an issue induced by [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/24561/
Change-Id: Iaa095696f9dcb87f8cc95179b4f404b092d1e23e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-529
1. use keystoneauth1.session to initialize the client for each service
The keystoneauth1.session.Session class was introduced into keystoneauth1 as an attempt
to bring a unified interface to the various OpenStack clients that share common authentication
and request parameters between a variety of services.
2. update ODL case to leverage session to get the endpoint info
Change-Id: Ic8c01b9b7ed86d3bdd9f5125504bc47f46a37700
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
JIRA: FUNCTEST-628
1. rename the TestCasesBase into TestcaseBase
2. updated the module name to testcase_base.py
Change-Id: Ic6b5d8209098c136613a2419c3790668fdbd493e
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
JIRA: FUNCTEST-579
Change-Id: Iaa545db70bfb76770df0a3d17871e29ce518ff2d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
|
|
JIRA: FUNCTEST-621
Change-Id: Ic9dd73861d84e3dbfb3e6611ffc9e5e2c09fcaed
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
JIRA: FUNCTEST-533
1. Extracted all global variables into functest_constants.py and updated all affected areas accordingly
2. Used os.path.join to replace '/' to come up with the path for better cross-platform support and improve the path accuracy
3. Removed unused variables
4. Updated the hardcoded path in Dockerfile by using variable reference
5. Removed "/" ending from all path variables
6. Updated the unit test
Change-Id: Ib30a81d1f0c83fbaef042d63c187c27bd18301bb
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
- create functest subdirectory
- rename unit tests
- adapt path in exec and config files
JIRA: FUNCTEST-525
Change-Id: Ifd5c6edfb5bda1b09f82848e2269ad5fbeb84d0a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|