Age | Commit message (Collapse) | Author | Files | Lines |
|
|
|
|
|
Ci module's run_tests.py references utils module's functest_utils,
and functest_utils references ci module's tier_handler.
Form a bidirectional dependencies between two packages.
JIRA: FUNCTEST-456
Change-Id: Idbdd4896fb1ec786fcfd656832bfe2d4048a8278
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
This fixes a race condition where the cleanup method is trying to remove
HA networks, while Neutron is also trying to remove the network - after
the HA router is removed. This only applies to installations where
Neutron L3 HA is enabled (nosdn cases only).
JIRA: FUNCTEST-454
Change-Id: If06b6f6297e99dcce4b0f2aff8ec80b47488ee90
Signed-off-by: Tim Rozet <trozet@redhat.com>
|
|
Add function to create an association between a router and a bgpvpn
Change-Id: I23449a0363f9d8f3c77ea3be1e104586d3c111d1
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
|
|
Change-Id: I8b91979380d0f4794d5ceaf8edb2a9d80cd7170f
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Change-Id: Iaf0859775933ba09cbbe170af3ce4ed1e6d3e9a1
Signed-off-by: boucherv <valentin.boucher@orange.com>
|
|
It follows the recommendations described in the next review [1].
[1] https://gerrit.opnfv.org/gerrit/#/c/19795/
Change-Id: Ie7ce28451122c554f135caad068844c0303deaeb
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
functest repo is used by almost every testcase, each place we get it like:
REPOS_DIR = os.getenv('repos_dir')
FUNCTEST_REPO = ("%s/functest" % REPOS_DIR)
provide a common interface in functest_util.py
JIRA: FUNCTEST-453
Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
functest_yaml is needed in almost all of the testcases, the obtain process is the same:
with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f:
functest_yaml = yaml.safe_load(f)
f.close()
abstract a method to unify the process, and provide the interface
JIRA: FUNCTEST-447
Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
As it modifies method params, it could break the testcases.
JIRA: FUNCTEST-428
Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It's the first step to safely remove all logers as method args.
Outputs printed by bash scripts called by execute_command are no longer
written in functest.log. Else logs printed by python scripts will
be duplicated in it.
JIRA: FUNCTEST-428
Change-Id: I60702f3b62121f731cd6845c335e227f97df37c9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever
testcases.yaml is needed, abstract a method to provide unified interface
JIRA: FUNCTEST-449
Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
It avoids mixed logs in Jenkins' console by flushing every message
printed by the forked programs as logger.info() does.
It must be complete by refactoring logger management in util functions
[1] and by preventing output buffering in forked programs.
[1] https://jira.opnfv.org/browse/FUNCTEST-428
JIRA: FUNCTEST-441
Change-Id: Id8da814d79ea6b1e6b91b49e23a85c3802e11515
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Now env vars are mandatory in push_results_to_db. It avoids testing
programs to check them even if they are useless from their points of
view.
The related getters aren't removed to help debugging via
logger_test_results which could be run without report.
Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Some places shared network is created through create_network_full first,
then update it to shared, abstract a uniformed method to eliminate reduplicate
JIRA: FUNCTEST-437
Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
Some places when create image is referred, they check if image exist,
if exist use it directly, else create a new one.
Abstract a method to integrate the process
JIRA: FUNCTEST-432
Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
|
|
When run_tests.py sets logger as execute_command arg, logs are
duplicated in functest.log and not shown in console (as every DEBUG
message). As logger is mainly managed by the python scripts in charge
of testing, it can be safely removed here.
stderr is also redirected to stdout in execute_command to print
possible relevant data.
JIRA: FUNCTEST-431
Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
In openstack_util.py, when create/get/update network or other resources failed,
False is returned, which is incompatible with success return value such as id, network_nic.
JIRA: FUNCTEST-427
Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
when Exceptions happen, the print code is too difficult
to understand and maintain, modify to make it clear
jira: FUNCTEST-425
Change-Id: Ie12af989e711df3791167955642f2edf1164b146
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
When pod is not exist in DB, exception will be shown as
'Error pushing results into Database '<type 'exceptions.TypeError'>'',
very unclear, make it very difficult to fix the problem.
Modify it to show as the testapi returned
'HTTPError: HTTP 404: Not Found (Could not find pod [zte-no])'
JIRA: FUNCTEST-424
Change-Id: I55fc4639d745b84f6d32a148bd13793d236e2a09
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
Change-Id: I82741a8727fc17bc6648e1b1e92511b3efd93b8a
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Now an HTTPError exception is raised in case of a 4XX or 5XX error
response.
Change-Id: Idd91c1d2b2a1b81a1cf7d075527cb302099cdb4e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-416
Change-Id: I1a5800be0dcf75573f44e6214b23917aadc1cbf7
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
Adding support of LXD scenario
JIRA: FUNCTEST-268
Change-Id: I5891ff9de674d99d32d8db747be501ee8a2e6609
Signed-off-by: boucherv <valentin.boucher@orange.com>
|
|
|
|
add check_test_result() method to unify test result process
JIRA: FUNCTEST-405
Change-Id: Iee4d2876cbbf372f8c3e3bf94448036669bc7f7e
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
resolution
JIRA: FUNCTEST-402
Change-Id: I5fa9204aafb13330eb810950aa7bc728f1a69162
Signed-off-by: boucherv <valentin.boucher@orange.com>
|
|
add method check_success_rate() to unify criteria check by success_rate
JIRA: FUNCTEST-398
Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
refine a unified method to log the test results
and use it to parser.
JIRA: FUNCTEST-397
Change-Id: I5ed6b04107be5590b1d9d5683c8f1846fef5a4d4
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
Currently functest doesn't account for regions when it tries to
instantieate OpenStack clients. As a result, the code fails when
functest is used in a multi-region environment.
The fix forces functest account for region name.
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
Change-Id: Iebbd20042548c02da9d5ed7e58a454347a555778
|
|
By default public endpoint was used but now you can use internal or admin
JIRA: FUNCTEST-387
Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9
Signed-off-by: boucherv <valentin.boucher@orange.com>
|
|
Sometimes, when using the same container for a different deployment,
the IDs of the openstack resources are different but the names are
the same. This will avoid cleaning for example the user 'admin'
regardless of the ID it has.
JIRA: FUNCTEST-383
Change-Id: If27603f8f6d0cb7ad0aeba6e3c89ca19e2b8aed2
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
This function wasn't showing anything for some commands,
like 'rally show images' and 'rally show flavors'
JIRA: FUNCTEST-348
Change-Id: I75bf5f3504ea8ffea42c2fb237d6863c655259e1
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: FUNCTEST-376
Also some fixes to get rid of flake8 violations in onos-sfc
Change-Id: I52c2fd30a6b81af20ea779db2d73b9386524f7ce
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
This will help to see the exception error when something
fails
JIRA: FUNCTEST-376
Change-Id: Ibaa6954fc63af00d552ac32b3cf903b9218200d1
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: FUNCTEST-375
Change-Id: I4f0cb68639b927f2980389d9331ec260605c8caf
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: FUNCTEST-236
Change-Id: I37bfa4ebe88a8cf02f2cddc8fc4cce70ad87b775
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Instead of repeating the code in all the scripts and
importing the openstack libraries, the clients shall
be given by openstack utils, which is its purpose
JIRA: FUNCTEST-163
Change-Id: I1ccc05a3af44ee1ab5938ea9e4e01dbe55f4816d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
All files where __main__ is checked can now be executed by everyone.
It results from [1].
[1] find . -name "*.py" |xargs grep __main__ |cut -d\: -f 1 |xargs chmod 755
Change-Id: I9ad153cfdde0447213e35dac102e668d9e754cf9
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
This is needed i.e. for sdnvpn test case
Change-Id: I235a6871a86b7a0c4a9ab27a3aef4bfd62ba4d43
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: FUNCTEST-99
Change-Id: I0d28e5d07c857f4e80d7cf96a2ff4dbf87075abe
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: FUNCTEST-99
Change-Id: I23fd3fae08255d36ec158e5a522640615b5d8a10
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Running this test case illustrates how Functest code base and
performance tend to grow when trying to catch more and more
bugs in OPNFV environment. The case is not bound to any tier.
Change-Id: Ib3c2f3f3d9d78c1251fbb35e6ea6afd3cf1afbdb
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
|
|
JIRA: FUNCTEST-99
Change-Id: Ia3fd91ec1dff5283edc3df098bb5cec342f87aea
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: FUNCTEST-99
These functions are used by sdnvpn test cases
to create vpns and network associations
Change-Id: I2fb25c84d8d02ea1cc92677e6a33e469a5d3ddc3
Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
|