Age | Commit message (Collapse) | Author | Files | Lines |
|
The next packages/modules are not yet covered:
- functest/cli/setup.py
- functest/core/pytest_suite_runner.py
- functest/opnfv_tests/mano
- functest/opnfv_tests/openstack/examples
- functest/opnfv_tests/openstack/snaps
- functest/opnfv_tests/openstack/vping
- functest/opnfv_tests/sdn/onos
- functest/opnfv_tests/vnf/aaa
- functest/opnfv_tests/vnf/ims
- functest/opnfv_tests/vnf/router
- functest/utils/openstack
Change-Id: Id62749796864537615f0ca8b162ce77b6c1a3309
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Pylint only warns about missing module docstrings now.
Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I1820bed1bbb7dbddd3923ea6439f58592595f5c8
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
It avoids creating a python object for every message printed.
Change-Id: Ia42b59db9f7ce4eadc7e91da4d193db646b54d85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It fixes the return values and the side effects expected from the next
methods:
- configure_tempest
- create_tempest_resources
- generate_test_list
- apply_tempest_blacklist
- run_verifier_tests
- parse_verifier_result
JIRA: FUNCTEST-803
Change-Id: Ib7dbd28e003cf0f27f497ad8e63cf7ae5ce564de
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It can raise an error exception if the leaf directory already exists or
cannot be created [1].
[1] https://docs.python.org/2/library/os.html
JIRA: FUNCTEST-804
Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It converts all criteria values to the corresponding percent in
functest/ci/testcases.yaml.
Result is expected to be equal or greater than criteria. If both are 0,
result is considered as false.
It is compatible with the old behavior but warns to update.
It will allow a safer remove.
It also fixes a bug in test_tempest to allow merging [1] and
tier_handler.py which required that type criteria was str.
[1] https://gerrit.opnfv.org/gerrit/#/c/27949/
Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mainly avoids mixing input and output.
Criteria is now an input set in functest/ci/testcases.yaml and then
must be passed as __init__() args (which will be proposed in an
additional change).
Then it also renames the related TestCase method to
check_result().
Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Change-Id: I41a8db181adf6c0c67b9de8380c3ccdd1ad3b529
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ie312dbd296a85a35096294331c28a45f8dc10d0c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Iea64673788a3d5ab5eb3028522f659de183440ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
|
|
|
|
|
|
Support existing tenant and user with a get_or_create_tenant method.
If the tenant and user already exist it only get the id of those
JIRA: FUNCTEST-799
Change-Id: Id5daf2904592e42199471bdd3547e861e6db6e32
Signed-off-by: boucherv <valentin.boucher@orange.com>
|
|
Change-Id: Ibf7e549252234fb69dd6e0cc7920b66759469aea
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I8afb00fb2942d2144968896981532324ac8e322d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ie6c53feb97053248c909d641753b44b5f51c8719
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It removes case_name from the list of attributes that run() must set
because it's now managed by run_tests.py (see __init__())
Change-Id: Id6228880257d0e9fb27483c56aa9985197feb04e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Adding results in url is useless as it is defined in results
section in config_functest.yaml.
It allows defining the full name in case of dumping to file (see
decorator.py). The commented local file is the value required by
dovetail.
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I35ba9b34d99e138292f099934e28585ee8b85604
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Package mock is absent for functest, while it is required by
decorators.py.
Change-Id: I0d042def0335e369c4e22a349e3068829e1d2c59
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It also modifies the testcase module docstring.
Now features.py is rated 10/10 by pylint.
Change-Id: I83f2ac385b2a713d116c1ae4b49ba9cc9b26a83c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's now useless as it's passed as run() args.
Change-Id: I97e14bd431a8844cd90905bf2050c48fb00f1cc5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account the following warnings/errors:
- Inline strong start-string without end-string
- Unexpected indentation
Change-Id: Idb05c7b04ba98ef8f3ef65e6ec7c9bb5b7571cad
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
The packages/modules which are part of Functest framework are parsed.
It also generates ODL TestCase API as it's well commented.
The content is simply referring to modules.
Change-Id: I873ae1535fc05c9d7e426f5fb54f9579eb01e6d1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Idb446213274b7dfb03b0ee072717a35e03428609
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
|
|
Change-Id: I91a5c6fb14f7c76a348bb4329d023bab53a3804c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Change-Id: Idf0380930e97e1aa4584ba000f32d742a87d9486
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
JIRA: COPPER-34
Change-Id: I7301745718b9c035493c2e5c162e2a4e117982db
Signed-off-by: Aimee Ukasick <aimeeu.opensource@gmail.com>
|
|
Change-Id: I75f51f216dcbf0db1c563cf381c28efc47241d3c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
All features running bash programs are now simply defined in
testcases.yaml. All deprecated modules and unit tests are removed.
Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
If there's not a / on the end of the admin url then port is not found
public already handled this correctly. updating admin to match public
JIRA: FUNCTEST-793
Change-Id: I01d654dfe247c6102a90ba7ea3921a9f15991789
Signed-off-by: Dan Radez <dradez@redhat.com>
|
|
Kingbird tests require that image and flavor are defined in tempest
configuration file.
JIRA: FUNCTEST-783
Change-Id: If96ef8e38e3f1a5946b687f1e5c8c0a6c3a90d54
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
Due to the refactoring performed in gerrit patch
31435, the calls to the SNAPS tests needed to be
updated.
JIRA: SNAPS-23
Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29
Signed-off-by: spisarski <s.pisarski@cablelabs.com>
|
|
run() returns the expected status code (see following JIRA tickets).
repo, pre() and post() are removed as they were quite useless.
A dedicated class is proposed for bash programs.
Unit tests have been added to fully cover this module.
All features have been modified to conform with these modifications.
It also removes the decorators which skipped several unit tests.
JIRA: FUNCTEST-778
JIRA: FUNCTEST-779
JIRA: FUNCTEST-780
JIRA: FUNCTEST-781
Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Every feature/testcase now allows receiving the data defined in
testcases.yaml as args (name is renamed to case_name).
From the time being, only project and case names are handled. Next
pending patches will add criteria, cmd and repo to this list.
It keeps the default values for case names except for features which
will be aggregated into Feature.
Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It fixes errors when importing modules too.
It completes the review "Added test case for opera vims" [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/30681
Change-Id: Ib3cf9c66eb9a2c25ff4fb58d48e4b15a44556f7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It replaces some project names by the corresponding case names.
Else some feature projects results failed to be pushed to DB.
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
JIRA: FUNCTEST-792
Change-Id: Id81644406bafb361da46e397a92e60b4da2ec068
Signed-off-by: Linda Wang <wangwulin@huawei.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also fixes the corresponding case name in testcases.yaml.
Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
tempest.api.compute.servers.test_server_actions\
.ServerActionsTestJSON.test_reboot_server_hard
is working in fuel so do test it.
The "-" was missing so
tempest.scenario.test_server_basic_ops
.TestServerBasicOps.test_server_basic_ops
was executed on fuel which is known to be
not working since metadata service is not
available. That was added already long
ago but through the not adding
of the "-" it got added again.
Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
|
|
|