Age | Commit message (Collapse) | Author | Files | Lines |
|
The previous implementation waited for /bin/sh to finish instead of
refstack-client. Then tempest still ran in background even if the
tescase was considered as finished.
Now all tempest logs are only printed in the dedicated file.
Change-Id: I94cd7c6fe68f3bc21782d8d9c43feee338c103ae
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Test cases are:
- rally (sanity and full)
- refstack
- cloudify_ims
- vping_ssh
It also fix a bug on "energy_recording" decorator of energy module.
Change-Id: I625c214552ad1b89eaf7e196e706d7c69b37da33
Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
|
|
When refstack is run in https environment, SSL checks
will be skipped if no cacert file is provided.
JIRA: FUNCTEST-828
Change-Id: Ib44582b4f2f508c7a255a1510dbdc33110fe0f14
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Only prepare_env.py and run_tests.py remain executable to avoid
breaking the gate.
As soon as the jenkins jobs are updated to run them from $PATH, tox
will be updated to protect against chmod a+x py files. Dockerfile
will be simplified as well.
Change-Id: Iac1a7ceb6b344e800177226ea39919826f6d3735
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As refstack-client is reinstalled only by the shell setup_env, the path of
.venv and .tempest have been changed.
Change-Id: Id50d0c6384295c2448705961942104abbd799b9b
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It also removes relative (and incomplete) references which could be
defined in modules instead of this global configuration.
Change-Id: Ie20dc3547e49b6224aa8100cd380d37b87ece5a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They replace the former calls in run_tests which are not suitable for all
test cases. Now any test case can define how to clean its resources.
If the snapshot cannot be created, the test case is considered as
failed. Only a message is printed if any failure during cleaning.
It also defines a new class called OSGCTestCase useful for test cases
which don't clean their OpenStack resources.
All test cases located in opnfv_tests/openstack inherit from it to
keep the global behavior unchanged.
It also deletes exit instructions in openstack_clean and
openstack_snapshot, removes clean flags in testcases.yaml and updates
the related utils.
All Docs are modified as well.
JIRA: FUNCTEST-438
Change-Id: I8938e6255708012380389763a24059ace4ce45d8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Directories affected:
- functest/opnfv_tests/openstack/refstack_client
and respective unit test
JIRA: FUNCTEST-796
Change-Id: I7f7047d44d71e82bcc1f66ec0b760ff30a13dbd5
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
After the introduction of is_successful method
in TestCase class, this is not needed anymore.
Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
It deletes functest.utils.functest_logger and the related unit tests.
Then it modifies all functest modules to get all loggers via
logging.getLogger(). __name__ is mainly used as getLogger arg as
proposed by logging [1].
All loggers and handlers are now defined via functest/ci/logging.ini
instead of a dict loaded by an external json file.
Now only warn messages and info messages from ci and core packages are
printed in console.
[1] https://docs.python.org/2/library/logging.html
Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
JIRA: FUNCTEST-758
container setup steps are skipped, since they already
included in the functest userguide documents.
Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|
|
It mainly avoids mixing input and output.
Criteria is now an input set in functest/ci/testcases.yaml and then
must be passed as __init__() args (which will be proposed in an
additional change).
Then it also renames the related TestCase method to
check_result().
Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
since for tempest smoke/full, etc, will also use a file named
tempest.conf this wil cover the refstack tempest.conf,
rename it to refstack_tempest.conf, then easily for users to
debug to check if the configure file is correct or not.
Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
Every feature/testcase now allows receiving the data defined in
testcases.yaml as args (name is renamed to case_name).
From the time being, only project and case names are handled. Next
pending patches will add criteria, cmd and repo to this list.
It keeps the default values for case names except for features which
will be aggregated into Feature.
Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-772
1, RefstackClientParser should not be a subclass of TestCase
2, tempest_conf.py used for generating reference tempest.conf file
not related to functest cmd, use logger is enough
Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
It allows managing multiple TestCase names with only one TestCase
module. It is mainly required by odl which implements:
- odl,
- odl_netvirt,
- fds.
It also renames case to case_name in Features to conform with
TestCases.
JIRA: FUNCTEST-762
Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-758
Change-Id: I1b90597c9745faa67afa58e5653f72411a95aa3d
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
JIRA: FUNCTEST-758
1.python tempest_conf.py can generate a reference tempest.conf under /hom/opnfv/.../refstack_client
this is based on "rally verify configure-verifier"
surely, user can define his/her own tempest.conf by not using this
2.python refstack_client.py -c <tempest_conf_path> --testlist <testlist_file_path>
if not given, will use default path, if file not exists, will have error
Change-Id: I1ceecbe8fe86fbe0d53b736a0f3b9a9ae01f262f
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
It simply removes the useless suffix.
Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and
removes the useless suffix too.
[1] https://gerrit.opnfv.org/gerrit/#/c/25391/
Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
1. Remove the file "refstack-error.log", and all the stderr and stdout
will be stored in refstack.log
2. Clean redundant error logs in the console and all the detailed error
logs will be found in refstack.log.
Change-Id: I7e71567c98dc89c529421eccbf1b497962b07405
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
JIRA: DOVETAIL-366
JIRA: DOVETAIL-758
1)for compass, joid, failure log
https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull
https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull
volume_device_name should be set vdb.
for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc
testcase test_attach_detach_volume is not dynamic enough, to skip temporarily.
2)rename defcore_201608.txt to defcore.txt
since this file is the default running file, can be changed as version changes.
and will be easy for dovetail to consume with a general name rather than a special name.
then dovetail can define the testcases to replace this file when running.
Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
Update the keys of details in refstack_defcore ("num_tests", "num_failures",
and "failed") to "tests", "failures" and "errors", in order to be consistent
with those in tempest.
Change-Id: I24f8a23548ffa253621083bbf6eb988306fd6edb
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: DOVETAIL-366
JIRA: FUNCTEST-758
Parse refstack_defcore results, including:
1. show number of tests passed, skipped and failed
2. record the detailed info about testcases passed, skipped and failed.
Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: DOVETAIL-366
JIRA: FUNCTEST-758
usage:
1,functest testcase run refstack_defcore, will run the
default testcases in defcore_201608.txt
2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client
python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path>
this has been worked with openstack-refstack experts, etc.
tested workedi.
result see http://paste.openstack.org/show/602173/
Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|