Age | Commit message (Collapse) | Author | Files | Lines |
|
So far, the test cases are storing a string "PASS" "FAIL"
in the self.result variable.
The way the new framework works is with INT Values.
Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
It also adds this support to its dependencies.
Change-Id: I0534f0c7b0e15a9ee89f522f314cf5200874454c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I1f1c938f0715e6afb7edbb8242f9a6c9cbfa65b5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
It deletes functest.utils.functest_logger and the related unit tests.
Then it modifies all functest modules to get all loggers via
logging.getLogger(). __name__ is mainly used as getLogger arg as
proposed by logging [1].
All loggers and handlers are now defined via functest/ci/logging.ini
instead of a dict loaded by an external json file.
Now only warn messages and info messages from ci and core packages are
printed in console.
[1] https://docs.python.org/2/library/logging.html
Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
1. When functest is running on external host not jumpserver,
keystoneclient is used to retrieve or create projects/tenants
and users, which would fail to establish connection to the admin
endpoint.
2. Keystoneclient will connect to the public endpoint by setting the
env OS_INTERFACE to be public.
3. Remove the admin endpoint check in check_os.sh.
JIRA: FUNCTEST-801
Change-Id: I324f5c8fdf61447319070a23f6b6bc6b1bbc1d48
Signed-off-by: Linda Wang <wangwulin@huawei.com>
|
|
It converts all criteria values to the corresponding percent in
functest/ci/testcases.yaml.
Result is expected to be equal or greater than criteria. If both are 0,
result is considered as false.
It is compatible with the old behavior but warns to update.
It will allow a safer remove.
It also fixes a bug in test_tempest to allow merging [1] and
tier_handler.py which required that type criteria was str.
[1] https://gerrit.opnfv.org/gerrit/#/c/27949/
Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It mainly avoids mixing input and output.
Criteria is now an input set in functest/ci/testcases.yaml and then
must be passed as __init__() args (which will be proposed in an
additional change).
Then it also renames the related TestCase method to
check_result().
Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Every feature/testcase now allows receiving the data defined in
testcases.yaml as args (name is renamed to case_name).
From the time being, only project and case names are handled. Next
pending patches will add criteria, cmd and repo to this list.
It keeps the default values for case names except for features which
will be aggregated into Feature.
Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Implement a functionality to check if a rule concerning
a specific security group exists
- function get_security_group_rules(neutron_client, sg_id)
returns the list of the security rules for a specific security group
- function check_security_group_rules(neutron_client,
sg_id, direction,
protocol,
port_min=None,
port_max=None)
checks if a specific rule for a specific security group exists
and returns True or False
- implement unit tests for the two new functions
This new functionality is needed for sdnvpn project
Change-Id: Ib930bc9a76141932f4164d88e2640b49f3df4d77
Signed-off-by: tomsou <soth@intracom-telecom.com>
|
|
This patch adds some more unit tests for
utils/openstack_tacker file and also
adds unit tests for utils/functest_logger file
Change-Id: I1a4c91eff87aebc3614ef01c3b5de0d2e6716afa
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
test_check_credentials_missing_env was corrected
but correction lead to good execution but false results
Change-Id: I47ff7d6aa0d5dda78cd978f1905b570c02160a8a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
|
|
a first fix had been done
but the version was retrieved 2 times with the regex
this patch removes the second regex and re-use get_version
the associated unit tests has been removed because even
if the build_tag is badly formated, it will not prevent
the results to be pushed with version = unknown
JIRA: FUNCTEST-765
Change-Id: I2cbe8ba1dd7278c3f3510a47c667c433f65e00f8
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
- fix regex issue
- add unit test to cover weekly and dummy build tags
- remove useless logs
JIRA: FUNCTEST-765
Change-Id: I7a8d40b4662f4557cd080669da46fb1c32d2ad6d
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
So far DB url was retrieved from configuration file
If you want to use the CI chain (jenkins, testapi, test DB,
functest, ..) then you have a problem
calling functest will systematically point to the configuration
from the repo
Supporting env variable allow to avoid post processing in the
configuration file and as a consequence offer the possibility
to create a local DB to host local results
Change-Id: Ie64b8b265827d7f5724c7066a8c173de8cf012e2
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
JIRA: FUNCTEST-757
Change-Id: Ic87bee3020b9714bcd83105127440a9c1a7ff2ad
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
JIRA: FUNCTEST-748
Sometimes Openstack doesn't handle deletion in a timely manner which can lead
to openstack_clean to think there are leftovers from a previous test when in
fact the instances are pending deletion. This patch tries to better handle
this kind of situation that would otherwise result in a double free and
eventually <class 'nova.exception.InstanceInvalidState'> (HTTP 500)
Change-Id: Id0d9b61d8380e9b12fc7acd46cd84260714f4baf
Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
|
|
Introduces function to retrieve a HEAT client. For the moment, the
only wrapper function is the one to retrieve resources.
Added unit tests to cover the new functions.
python-heatclient is added to requirements.txt and test_requirements.txt.
Change-Id: I547138141c6aad611f2353599fb70a013c83058a
Signed-off-by: Juan Vidal <juan.vidal.allende@ericsson.com>
|
|
Only ' located and the beginning or at the end of the string are
removed. It completes the first proposal [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/28563/
Change-Id: Ic21cea4c6e98d92983f385c875c3e214411b5f2d
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It fixes issues raised when an env var contains '=' (e.g. LS_COLORS).
It now exports the vars listed in rc_file without creating a new
process.
Change-Id: I6e6a4e3ab9c45afe4d40015831acb283acbe564c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
when using Functest out of CI, such env variables may not be set
This shall not result in Error messages
JIRA: FUNCTEST-716
Change-Id: I86d2023145480dfa9c8d593ea274acbd9e431ef7
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
JIRA:SFC-70
Printing the VNFD template during VNFD creation was left on error level.
Move it on info level and make printing prettier.
Fix unit test for create_vnfd
Change-Id: Ib04a43d72abcf9b6fbcaec9ea05d57b9f017b53f
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
|
|
JIRA: FUNCTEST-690
The detailed benefits are listed in the JIRA description.
1. Refactored the functest_logger to make use of configuration file
2. Avoided configuring the logging every time a logger is initialized
3. Applied separate logging configuration fo unit test by removing
saving log to file
Change-Id: I6e27eaba727ae6d704f0301f15359dc3ea7b2f97
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
|
|
|
|
JIRA: FUNCTEST-683
Change-Id: I0e4b27d3fab093d5f3a086df739c1fb6bc6a0939
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
Tests added for:
utils/openstack_clean
utils/openstack_snapshot
utils/openstack_tacker
JIRA: FUNCTEST-683
Change-Id: I2d510e70fae73daf35c24b2935ab99bbb241f1f5
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
It avoids creating a dummy functest.log for unit testing.
Change-Id: Ib163d5d58284822b1904444fb60b08e92ee0ab9b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-683
Change-Id: I181d98847b2ca94ce84a670239b8a958bfae44cd
Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
|
|
urllib2.urlopen() is now patched when testing the internet connectivity
helper.
Change-Id: I4ddf1dd8f494fe282735e1051986a0b5dd1a040f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-533
1. Extracted all global variables into functest_constants.py and updated all affected areas accordingly
2. Used os.path.join to replace '/' to come up with the path for better cross-platform support and improve the path accuracy
3. Removed unused variables
4. Updated the hardcoded path in Dockerfile by using variable reference
5. Removed "/" ending from all path variables
6. Updated the unit test
Change-Id: Ib30a81d1f0c83fbaef042d63c187c27bd18301bb
Signed-off-by: helenyao <yaohelan@huawei.com>
|
|
- create functest subdirectory
- rename unit tests
- adapt path in exec and config files
JIRA: FUNCTEST-525
Change-Id: Ifd5c6edfb5bda1b09f82848e2269ad5fbeb84d0a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|