Age | Commit message (Collapse) | Author | Files | Lines |
|
It mainly avoids mixing input and output.
Criteria is now an input set in functest/ci/testcases.yaml and then
must be passed as __init__() args (which will be proposed in an
additional change).
Then it also renames the related TestCase method to
check_result().
Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I41a8db181adf6c0c67b9de8380c3ccdd1ad3b529
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
All features running bash programs are now simply defined in
testcases.yaml. All deprecated modules and unit tests are removed.
Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
run() returns the expected status code (see following JIRA tickets).
repo, pre() and post() are removed as they were quite useless.
A dedicated class is proposed for bash programs.
Unit tests have been added to fully cover this module.
All features have been modified to conform with these modifications.
It also removes the decorators which skipped several unit tests.
JIRA: FUNCTEST-778
JIRA: FUNCTEST-779
JIRA: FUNCTEST-780
JIRA: FUNCTEST-781
Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Every feature/testcase now allows receiving the data defined in
testcases.yaml as args (name is renamed to case_name).
From the time being, only project and case names are handled. Next
pending patches will add criteria, cmd and repo to this list.
It keeps the default values for case names except for features which
will be aggregated into Feature.
Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It fixes errors when importing modules too.
It completes the review "Added test case for opera vims" [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/30681
Change-Id: Ib3cf9c66eb9a2c25ff4fb58d48e4b15a44556f7c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also fixes the corresponding case name in testcases.yaml.
Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Now run_tests.py forces case_name as arg of every TestCase or Feature.
It also updates the related unit tests.
Change-Id: I4d70005b53730f36785f0ac95f4f0f6a04455794
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They partially cover feature but already highlight bugs.
Several tests are skipped to allow merging. Their decorators could be
removed as soon as feature is fixed.
I think bad-continuation is false positive so it's disabled (pep8 and
flake8 return ok).
JIRA: FUNCTEST-779
Change-Id: I89b9e2ec0388eea2471d941b2c653deca7fbddf6
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Idda799c01408aa9afd09d573e23f42e011f3fafb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ie4ebc4e2bc6f2e66f5f567f45f44c073cd9d313d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I538fcedbfbef46ae36b8eff5a20acaa28a8bfb85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I8eb037a8c2427695d42207897064b79cb2b03a5d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I45f9209c55bd65c9538fc3b1181ccbcfbdd23a40
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ie6671080a3d38a17da0ee608a362605a6d9df9db
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Iba3c63592623623507e009b0b9f514792c82d25e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ia4e53e2aee5b93071b3acd3d75c7e42841321a0a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
2 tests are skipped to allow merging [1]
[1] https://jira.opnfv.org/browse/FUNCTEST-777
Change-Id: Ida376a03266489e252f7ef8de1ff40f1474c500a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It allows managing multiple TestCase names with only one TestCase
module. It is mainly required by odl which implements:
- odl,
- odl_netvirt,
- fds.
It also renames case to case_name in Features to conform with
TestCases.
JIRA: FUNCTEST-762
Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Implement a functionality to check if a rule concerning
a specific security group exists
- function get_security_group_rules(neutron_client, sg_id)
returns the list of the security rules for a specific security group
- function check_security_group_rules(neutron_client,
sg_id, direction,
protocol,
port_min=None,
port_max=None)
checks if a specific rule for a specific security group exists
and returns True or False
- implement unit tests for the two new functions
This new functionality is needed for sdnvpn project
Change-Id: Ib930bc9a76141932f4164d88e2640b49f3df4d77
Signed-off-by: tomsou <soth@intracom-telecom.com>
|
|
|
|
|
|
|
|
This patch adds more unit tests for
openstack/tempest/ and ims/ modules
with coverage >= 80%
Change-Id: I7c18cea791ac8dc3e890da98066179225283b068
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
1. Created a ImsOnBoardingBase to wrap up all common ims operations
2. Created test case to test opera vims onboarding
Change-Id: Idf3a82e10661271ad413f4dd5795c80ca4421d73
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
It partially takes into account missing-docstring.
It is disabled for public methods as they are unit tests.
It has been rated at 10.00/10.
Change-Id: I70e6729b9228d58cc67a18da29b925dad22cf5bd
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It follows "Rename testcase_base to testcase" [1]
[1] https://gerrit.opnfv.org/gerrit/#/c/31879/
Change-Id: I54bb62a37bdab842f433790688128a459b0ac78c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account the following warnings:
- wrong-import-order
- bad-continuation
- unused-argument
- invalid-name
- too-many-arguments
missing-docstring is partially disabled as they are unit tests.
It has been rated at 10.00/10.
Change-Id: I35886ec75a9e66817cfd0fe18534f157d7500a2b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This patch adds some more unit tests for
utils/openstack_tacker file and also
adds unit tests for utils/functest_logger file
Change-Id: I1a4c91eff87aebc3614ef01c3b5de0d2e6716afa
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
This patch adds more unit tests for ci/prepare_env,
ci/run_tests and ci/tier_handler to reach the coverage
more than 80%
Change-Id: Ia3b7105542105bf8c5e3db58c898ba0569190a80
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
It simply removes the useless suffix.
Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and
removes the useless suffix too.
[1] https://gerrit.opnfv.org/gerrit/#/c/25391/
Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It takes into account the following warnings:
- wrong-import-order
- no-value-for-parameter
The 'no-value-for-parameter' warnings are false positive. The added
default values are useless but avoid them.
Change-Id: I50d0af178d9da668a3c72e75f5af467d36ca0e6a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
test_check_credentials_missing_env was corrected
but correction lead to good execution but false results
Change-Id: I47ff7d6aa0d5dda78cd978f1905b570c02160a8a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
|
|
|
|
Return on part of previous changes in commit: 30257
https://gerrit.opnfv.org/gerrit/#/c/30257/
Change-Id: I11b33ee2a6f9d4cbcf1449006b47be508fce655e
Signed-off-by: boucherv <valentin.boucher@orange.com>
|
|
a first fix had been done
but the version was retrieved 2 times with the regex
this patch removes the second regex and re-use get_version
the associated unit tests has been removed because even
if the build_tag is badly formated, it will not prevent
the results to be pushed with version = unknown
JIRA: FUNCTEST-765
Change-Id: I2cbe8ba1dd7278c3f3510a47c667c433f65e00f8
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
- fix regex issue
- add unit test to cover weekly and dummy build tags
- remove useless logs
JIRA: FUNCTEST-765
Change-Id: I7a8d40b4662f4557cd080669da46fb1c32d2ad6d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
main and init functions in generate_reports"
|
|
|
|
|
|
|
|
|
|
|
|
JIRA: DOVETAIL-366
JIRA: FUNCTEST-758
Parse refstack_defcore results, including:
1. show number of tests passed, skipped and failed
2. record the detailed info about testcases passed, skipped and failed.
Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: DOVETAIL-366
JIRA: FUNCTEST-758
usage:
1,functest testcase run refstack_defcore, will run the
default testcases in defcore_201608.txt
2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client
python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path>
this has been worked with openstack-refstack experts, etc.
tested workedi.
result see http://paste.openstack.org/show/602173/
Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
So far DB url was retrieved from configuration file
If you want to use the CI chain (jenkins, testapi, test DB,
functest, ..) then you have a problem
calling functest will systematically point to the configuration
from the repo
Supporting env variable allow to avoid post processing in the
configuration file and as a consequence offer the possibility
to create a local DB to host local results
Change-Id: Ie64b8b265827d7f5724c7066a8c173de8cf012e2
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|