Age | Commit message (Collapse) | Author | Files | Lines |
|
As [1] is merged, the way to call the barometer test case is
different as it is hosted in Barometer repo instead of Functest.
The former files are also simply removed too.
baro-tests is no longer a requirement. It is installed as any
third party project.
[1] https://gerrit.opnfv.org/gerrit/#/c/35927/
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: Iea56b48fa781600eb3a6ac74662ea8a29f556f99
Signed-off-by: Jose Lausuch <jose.lausuch@ericsson.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also removes relative (and incomplete) references which could be
defined in modules instead of this global configuration.
Change-Id: Ie20dc3547e49b6224aa8100cd380d37b87ece5a9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
1. If the auth_url is "https://192.168.31.222:443/identity-admin/v3", the
auth_version in tempest.conf is supposed to be "v3", not "id".
2. For rally 0.8.1. it is a bug when obtaining the auth_version, please see
[1], which has been fixed in rally master.
[1]: https://review.openstack.org/#/c/468599/
Change-Id: Ia7474938a741a0954f17f7c7650544dbc0a28853
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
- Simplify processing
- Implement run method to inherit testcase methods
- Add unit tests
- Fix all pylint issues
It also obliges vnf and its uts to be rated 10/10 by pylint.
JIRA: FUNCTEST-830
Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com>
Change-Id: I8dd24eea55089277c9e5b2b51fb14dc377f2fcaf
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I134b0efd3dd0faec389087a4dac59de09eae087e
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
1. Remove get_db_url()
2. If TEST_DB_URL declared in env, update test_db_url in
config_functest.yaml file during env preparation
3. No matter TEST_DB_URL declared in env or not,
Result_DB = CONST.__getattribute__("results_test_db_url")
JIRA: FUNCTEST-763
Change-Id: I20da7ef98bbcc56731e0ff7061b05c1dde6cbfc3
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
JIRA: FUNCTEST-813
Change-Id: Ib851a3942e181b1a91cad695504613868a340d15
Signed-off-by: spisarski <s.pisarski@cablelabs.com>
|
|
|
|
|
|
They replace the former calls in run_tests which are not suitable for all
test cases. Now any test case can define how to clean its resources.
If the snapshot cannot be created, the test case is considered as
failed. Only a message is printed if any failure during cleaning.
It also defines a new class called OSGCTestCase useful for test cases
which don't clean their OpenStack resources.
All test cases located in opnfv_tests/openstack inherit from it to
keep the global behavior unchanged.
It also deletes exit instructions in openstack_clean and
openstack_snapshot, removes clean flags in testcases.yaml and updates
the related utils.
All Docs are modified as well.
JIRA: FUNCTEST-438
Change-Id: I8938e6255708012380389763a24059ace4ce45d8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
It modified the shebang to /usr/bin/env which is considered as more
flexible.
Change-Id: I9c8cdb4243d41a83d524499cc91060d3700e008b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
if flavor_metadata is set to {'hw:mem_page_size': 'any'}, it means
hugepage must be support by pod. but actually hugepage is not supported
by all pods
Change-Id: Ib0b716ecedacf7eeba2c0d0080be2707b1a87e73
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
|
|
Directories affected:
- functest/opnfv_tests/sdn/onos/
JIRA: FUNCTEST-796
Change-Id: Iffbb0e9a021d31a32d940128435a9f6ed43a504f
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It conforms with [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/35211/
Change-Id: I11bbdcd63a1691835fb7c6198549edbaf6b758a1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also adds the rst files to include this module in apidoc.
Change-Id: Iabbb17bc8601265bd9436c75d1afc0b470df1eb4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
1. In run_tests.py, test case name is shown before running:
logger.error(kwargs['test']) -> logger.info(kwargs['test'])
2. In tempest.py, Verication -> Verification
Change-Id: I117838cdb4b0f920c4cf855645d910e623e06868
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
|
|
|
|
1. Update the service type to "identity", "network", "compute" and
"image", other than "keystone", "neutron", "nova" and "glance".
JIRA: FUNCTEST-820
Change-Id: I81b2311760fd717570561e6471525773378ad2f2
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It also adds the related unit tests.
Change-Id: I8325bd9a55c69b229e3c48a9e64aa963e685e03d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Directories affected:
- functest/opnfv_tests/openstack/refstack_client
and respective unit test
JIRA: FUNCTEST-796
Change-Id: I7f7047d44d71e82bcc1f66ec0b760ff30a13dbd5
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Directories affected:
- functest/opnfv_tests/openstack/rally
- functest/opnfv_tests/openstack/tempest
and respective unit test
JIRA: FUNCTEST-796
Change-Id: I963f5947663f0b660337f3304defb697f5d338f3
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
|
|
|
|
|
|
It avoids creating and removing the temporary file to dump robot output.
Change-Id: Ia5ea66e76ffb8b8327f2da938f177e8ef4c61dd4
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
After the introduction of is_successful method
in TestCase class, this is not needed anymore.
Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
|
|
Put all images in the new direcotry. If users want to use the
local image, map the local directory to the ${HOME}/functest/images
Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
So far, the test cases are storing a string "PASS" "FAIL"
in the self.result variable.
The way the new framework works is with INT Values.
Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
|
|
It also adds this support to its dependencies.
Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-577
1. Replaced procedural openstack_utils with the object-oriented SNAPS
library
2. Tests now clean themselves up.
3. Improved code documentation.
4. Removed dependency on file-based Cirros image and now leveraging the
download URL.
5. Removed hardcoded location to the testcases.yaml file to leverage
the value in config_functest.yaml
6. Included optional flavor metadata based on the scenario being tested
7. Included support for multi-part images.
8. Added enhanced support for configurable images. see SNAPS-76
Fixed line length verification problem with the previous submission
Fixed retrieval of external network name to be dynamic.
Changed external network name retrieval to leverage the newly merged
snap_util.get_ext_net_name() function
Added the creation and deletion of flavors.
SNAPS now has the ability to add/remove security groups from running instances.
Changed VMInstance constructor by moving userdata to configuration object.
Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26
Signed-off-by: spisarski <s.pisarski@cablelabs.com>
|
|
|
|
|
|
Now ODL TestCase calculates the ratio between critical tests passed
and failed and saves it in result. Non-critical test cases can fail as
result doesn't take them into account [1].
It also updates default attribute values in TestCase and allows result
to be float.
[1] http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-criticality
Change-Id: Id4a89271b5b1a90cd3c1e2b08591ff26ffaffee0
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I514340fc6180e29b31ef11bdea9f719aa2bbb738
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I0b8b9b2e85717fc92a233e4f7344b3419421778d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Testcases about snaps failed due to the absence of attribute 'logger'.
Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
Change-Id: I50f0e1ba91c8c4adcf407d493fb86d9089554cc5
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
|
|
|
|
|