Age | Commit message (Collapse) | Author | Files | Lines |
|
|
|
Use Snaps to create resources before running a testcase and to clean up
afterwards.
Use Tempest Cleanup utility to clean other resources.
Change-Id: Ic0f69d3bafb60dfb283d18ac507e9f5992e9ae38
Signed-off-by: Martin Kulhavy <martin.kulhavy@nokia.com>
|
|
|
|
CI_LOOP is more human-readable than BUILD_TAG and could be set by env.
Weekly is still the default value even if it can be considered than
daily is more relevant.
Change-Id: Ia8e370fe0f967ba2c83d0212f8e045d815b4ddb3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
In some deployments, the retrieved external network by the
def get_external_net checked by "router:external" is not available.
So it is necessary to specify the available external network
as an env by user for some deployments.
JIRA: FUNCTEST-865
Change-Id: I561bc7d57e06214516a4cdbebd67632cd9746fba
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: FUNCTEST-763
Change-Id: Id334745a1eac8b933d77f9cb36a506a02366d760
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
Use the ID of the domain when creating a tenant on keystone v3.
Change-Id: Ic415237e2bb2d537f07ab2245816a575f977aaa0
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
|
|
JIRA: FUNCTEST-763
Change-Id: I86b0b515a3d51df20a35c2aeb461a95d0c5797fd
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
For alpine testing in compass OSA, sourcing openrc failed due to space
lines included.
Change-Id: I23166090a2fa7c2ce0aa03be581231cbb3cea34a
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Different endpoint urls can be searched with 'admin', 'internal' and
'public' interface.
Change-Id: I57207826d0dc2c18ce0e6a0abf09140f639f64ba
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
When refstack is run in https environment, SSL checks
will be skipped if no cacert file is provided.
JIRA: FUNCTEST-828
Change-Id: Ib44582b4f2f508c7a255a1510dbdc33110fe0f14
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
- Delete all shell commands to use cloudify python lib
- Cloudify Manager installation with a packaged image
- SNAPS integration
- Adapt test_vnf unit tests
- Initiate test cloudify_ims unit tests (to be completed)
JIRA: FUNCTEST-838
Change-Id: Ia4b499d4155e6af5d37d6d5cf4310a5a9693c7ce
Signed-off-by: boucherv <valentin.boucher@orange.com>
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
Only prepare_env.py and run_tests.py remain executable to avoid
breaking the gate.
As soon as the jenkins jobs are updated to run them from $PATH, tox
will be updated to protect against chmod a+x py files. Dockerfile
will be simplified as well.
Change-Id: Iac1a7ceb6b344e800177226ea39919826f6d3735
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
These util functions should be under control of the SDNVPN
project. After [1] and [2] it is safe to remove them in Functest
[1] https://gerrit.opnfv.org/gerrit/#/c/36655/
[2] https://gerrit.opnfv.org/gerrit/#/c/36505/
Change-Id: I2f6596cd60678bb0c50adb9b4bc0d59545c3fb0a
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
floatingips is a list of dictionaries where the attributes
are a bit different than in the previous implementation.
Change-Id: I8e8429b1819bba35a4a829f274c60b77ab2eea7e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
|
|
|
|
Nova does not longer support floating ip creation/deletion.
This patch moves that logic to neutron client.
Change-Id: I2c4146149fe5be534d9c50d78d831b5af1957ad7
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
When running in https environment, rally should support insecure
deployment if no cacert file is provided.
JIRA: FUNCTEST-828
Change-Id: I29b0fc8c2e1b74a1ce08293706cd9f11f975b6d5
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
1. Images list is not supported by novaclient 8.0.0
2. It moves images list out of nova and into glance
Change-Id: I2a2d40a2ca3a0cf1ebfb55697b3c58af8748a805
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
1. When running in https environment, functest should provide an
option to disable server certificate verification.
2. For check_os.sh, the param "--insecure" is passed to openstack
cli, e.g.. openstack --insecure server list.
JIRA: FUNCTEST-828
Change-Id: Ie2c5b14152c92e87318fcfaf8b234f59275eb6b8
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It also removes relative (and incomplete) references which could be
defined in modules instead of this global configuration.
Change-Id: Ie20dc3547e49b6224aa8100cd380d37b87ece5a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Functest is no longer a git clone.
Change-Id: Ieaceacaa820e9a7a3c64e8c1fbd2a8a9321f234d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows functest to be run directly from a zip file [1].
[1] https://setuptools.readthedocs.io/en/latest/setuptools.html#setting-the-zip-safe-flag
Change-Id: I596a71e8cf2bed6dd79655bd5beeb047876a188c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
openstack_snapshot and openstack_clean should return 0 when they are run
successfully.
JIRA: FUNCTEST-835
Change-Id: I3fcc24ab985de382e0e59b129cb467d66a9a0de2
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
- Simplify processing
- Implement run method to inherit testcase methods
- Add unit tests
- Fix all pylint issues
It also obliges vnf and its uts to be rated 10/10 by pylint.
JIRA: FUNCTEST-830
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I8dd24eea55089277c9e5b2b51fb14dc377f2fcaf
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: Ie7c60b8ca174c9c95920d0b7ef73b8eff60ae7e1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
1. Remove get_db_url()
2. If TEST_DB_URL declared in env, update test_db_url in
config_functest.yaml file during env preparation
3. No matter TEST_DB_URL declared in env or not,
Result_DB = CONST.__getattribute__("results_test_db_url")
JIRA: FUNCTEST-763
Change-Id: I20da7ef98bbcc56731e0ff7061b05c1dde6cbfc3
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
They replace the former calls in run_tests which are not suitable for all
test cases. Now any test case can define how to clean its resources.
If the snapshot cannot be created, the test case is considered as
failed. Only a message is printed if any failure during cleaning.
It also defines a new class called OSGCTestCase useful for test cases
which don't clean their OpenStack resources.
All test cases located in opnfv_tests/openstack inherit from it to
keep the global behavior unchanged.
It also deletes exit instructions in openstack_clean and
openstack_snapshot, removes clean flags in testcases.yaml and updates
the related utils.
All Docs are modified as well.
JIRA: FUNCTEST-438
Change-Id: I8938e6255708012380389763a24059ace4ce45d8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
They are considered as warnings by flake8.
Change-Id: I84ffedc41c24133aa0d45e312bb095526aa1095b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Otherwise dumping them could break some unit tests as they are
unordered collections [1].
[1] https://build.opnfv.org/ci/job/functest-verify-master/4122/
Change-Id: I108e946926ae9690cf2421e565f2bb81500f9160
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It calculates via the full path of env.py.
Change-Id: Ief958833f5116cdb116d0153d85a0ae03063ec5c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
After the introduction of is_successful method
in TestCase class, this is not needed anymore.
Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
So far, the test cases are storing a string "PASS" "FAIL"
in the self.result variable.
The way the new framework works is with INT Values.
Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
It adds the shebang to constants.py and its dependencies and stops
importing from a relative path. It stops printing obsolete values too.
It adds python3 support to them by the way.
Change-Id: Ie7bddcf253eb245844d9e11c17acc69943c1ba63
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also adds this support to its dependencies.
Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mainly assigns to the wrapper push_results_to_db's __name__,
__module__ and __doc__ and the documentation string.
Change-Id: Idc882ac4e743699a4887e46c5066e0983c90afd9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It deletes functest.utils.functest_logger and the related unit tests.
Then it modifies all functest modules to get all loggers via
logging.getLogger(). __name__ is mainly used as getLogger arg as
proposed by logging [1].
All loggers and handlers are now defined via functest/ci/logging.ini
instead of a dict loaded by an external json file.
Now only warn messages and info messages from ci and core packages are
printed in console.
[1] https://docs.python.org/2/library/logging.html
Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
It is useles right now and won't be used in the future.
Change-Id: I9aa121544051f49f7e7e794ae3b2c4a9ea516e47
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
1. When functest is running on external host not jumpserver,
keystoneclient is used to retrieve or create projects/tenants
and users, which would fail to establish connection to the admin
endpoint.
2. Keystoneclient will connect to the public endpoint by setting the
env OS_INTERFACE to be public.
3. Remove the admin endpoint check in check_os.sh.
JIRA: FUNCTEST-801
Change-Id: I324f5c8fdf61447319070a23f6b6bc6b1bbc1d48
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
1. The rally_conf.json is obtained via def get_credentials_for_rally(),
where the parameter endpoint_type is supposed to get from the env
OS_ENDPOINT_TYPE or OS_INTERFACE, just as the def
get_creds_from_env_vars() in rally project [1].
[1] https://github.com/openstack/rally/blob/master/rally/cli/envutils.py
JIRA: FUNCTEST-801
Change-Id: I6b6be82b9ff7f04948b47c4fca836d415fe13f8b
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It avoids creating a python object for every message printed.
Change-Id: Ia42b59db9f7ce4eadc7e91da4d193db646b54d85
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It converts all criteria values to the corresponding percent in
functest/ci/testcases.yaml.
Result is expected to be equal or greater than criteria. If both are 0,
result is considered as false.
It is compatible with the old behavior but warns to update.
It will allow a safer remove.
It also fixes a bug in test_tempest to allow merging [1] and
tier_handler.py which required that type criteria was str.
[1] https://gerrit.opnfv.org/gerrit/#/c/27949/
Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mainly avoids mixing input and output.
Criteria is now an input set in functest/ci/testcases.yaml and then
must be passed as __init__() args (which will be proposed in an
additional change).
Then it also renames the related TestCase method to
check_result().
Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|