Age | Commit message (Collapse) | Author | Files | Lines |
|
Change-Id: I81a74a9f7c6ae54ba1b2be7ec27a11ae3a2392b9
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 4de89d461ca0df0bd88c56a0f0eeedaf358ba345)
|
|
A iteration is added so that the test is run several times.
We are experiencing that ODL requires one deployment for things
to work
Change-Id: Ic70e8f2dabbf03827dd6d7396d2ab8177140cc97
Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
(cherry picked from commit 89195402a303f6340b5f409b1df2e8bab1304270)
|
|
This fixes a small bug in
https://gerrit.opnfv.org/gerrit/#/c/21833/
JIRA: JIRA: SFC-48
Change-Id: I92ad973369109a107700443c074dfae6f6c21516
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 248af30770fc0c882122c429a3bf033a37c5c167)
|
|
JIRA: SFC-48
After some troublehsooting done in Boron RC3.5, vPing
doesn't work because the instances are created on 2
security groups. One (vping-sg) opens port 22 but
the default secgroup doesn't. This patch allows port
22 also on the default and therefore vPing passes.
This patch is to workaround a bug in ODL. The bug
will be reported to the corresponding community.
Change-Id: I807249d42cebe7c8dccd78a3496c1d34996d73ee
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 738246d6c7ea3e175f49d75b87c60ed3a0a0f601)
|
|
Due to the same performance issue encountered in bgpvpn
scenarios, Jenkins still times out and can't have a summary
of all the tests and upload logs to artifacts.
The removal of this test case will affect only
Colorado 1.0, and will be reactivated in
Colorado 2.0 with ODL Boron.
Change-Id: Ic2d8cc43a1a732daa063aa7c01a309a3dfa2050d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 1f156fc7881491d2a557e54e43178d46bc3d69a1)
|
|
Change-Id: I9335ed1517097e83175a265b603a6707adf476b6
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
(cherry picked from commit 0fa8de695dd6b50b7b01131376aefef9c13c21c1)
|
|
Doctor, as part of the feature project, is FAIL on fuel
scenarios
JIRA: FUNCTEST-192
Change-Id: Ic5b9b4afe80fbb2d5887bdf46410a0fc72e7be37
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 3097840a4cf0d4c4a32ce24b38af4cc2c601526b)
|
|
JIRA: FUNCTEST-475
Change-Id: I720b9d88db94d66f067601608ab2d1435fc93d47
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 81c7246253d97ec07a10a01b528b3ef99b2281f4)
|
|
Missing parameter prevented using of customer defined
installer type when executing "functest env prepare" command.
JIRA: FUNCTEST-467
Change-Id: I69b69fa43584ec7ae4e4d8925f99624711131ef9
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
(cherry picked from commit a2c1165dfa22e5645eff20d8758ead07b638ccf5)
|
|
Change-Id: I414338616aecda161a51a780abb24c9e3a8f5c54
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
(cherry picked from commit a31877af04542bb0cd3c4da6d53f4d4ab580a295)
|
|
Due to a known issue with API performance when bgpvpn extension
is activated which causes some delays and the tests take longer
time than normal, we get a lot of Jenkins Job timeouts and the
scenario cannot be validated.
Since it is a performance issue, we black list rally sanity, which
takes 1 hour to complete and will re-enable it in Colorado.2.0
where ODL Boron release will be available and SDNVPN team
thinks this will be fixed.
Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 642661f2de6afa12268e2d2cb854652f3db10ab8)
|
|
JIRA: FUNCTEST-463
Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
(cherry picked from commit 55d301a2622ff5b63d431b9272caa68224d53843)
|
|
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/
**** Do not import objects, only modules (*) ****
so direct FUNCTEST_REPO import should be avoided
from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO
JIRA: FUNCTEST-459
Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
Since there is a function in functest_utils to get
a value from the config_functest.yaml directly, there
is no need to load again that file. Better to use common
functions that are designed for that.
Also, Replace location of the results json file to
the results directory. It will be also pushed to artifacts
repository.
Change-Id: Ic6422ed78ccd0f8b40b519342a7dcf38c502924e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit 861ad3fe18c6ee672c8c82d5d8ad39c6131fdf85)
|
|
JIRA: FUNCTEST-446
Reduce the logs that appear in the Jenkins CI console to make the output
of the SFC test case more readable
- Redirect tacker installation logs to results folder
/home/opnfv/functest/results/odl-sfc.log
- Split odl-sfc preparation into a new script
- Pipe STDERR in the sfc.py script so that "Added to known hosts"
messages do not show in the output
Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
|
|
As it modifies method params, it could break the testcases.
JIRA: FUNCTEST-428
Conflicts:
testcases/features/copper.py
testcases/features/doctor.py
testcases/features/domino.py
Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8bfe49ee5a6d7b93b3ce7fb6aae0072acb1171d9)
|
|
|
|
functest repo is used by almost every testcase, each place we get it like:
REPOS_DIR = os.getenv('repos_dir')
FUNCTEST_REPO = ("%s/functest" % REPOS_DIR)
provide a common interface in functest_util.py
JIRA: FUNCTEST-453
Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
(cherry picked from commit 470f573a3ac2eb1783efec6da01a3bee33360c65)
|
|
In some scenarios (bgpvpn) the timeout defined in promise
to boot/delete vms is too tight. Having less memory
might fix the problem as it will take less time and it
doesn't impact the promise test case.
Change-Id: Ib3165ea5d6518d88384f76c8edd10dddb0b529a3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
(cherry picked from commit abc3abc3981ba33d32b446fba8b2d40ceb59ec17)
|
|
functest_yaml is needed in almost all of the testcases, the obtain process is the same:
with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f:
functest_yaml = yaml.safe_load(f)
f.close()
abstract a method to unify the process, and provide the interface
JIRA: FUNCTEST-447
Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
(cherry picked from commit f4d0a05011e961a363c6d99522684ecdeb959716)
|
|
JIRA: FUNCTEST-452
Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit bb699b3cfc146566ba54aa96111cf5a05839322a)
|
|
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever
testcases.yaml is needed, abstract a method to provide unified interface
JIRA: FUNCTEST-449
Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
(cherry picked from commit f5afb93a4a2ed9547757655c1405ef27fabed11b)
|
|
Parser tests needs lots of resources, such as vcpu/memory/disk,
virtuals pod may not meet the requirements, so exclude Parser
running on virtual pods by exclude 'noha' scenario
JIRA: FUNCTEST-444
Change-Id: I6f2832fa0f727f762987c41d7a3485dede041151
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
(cherry picked from commit 35cf15a87126b6947b59899cd726f4b92599fe79)
|
|
JIRA: FUNCTEST-442
Change-Id: I1f6888dbddebf28af4b565ca87d9791a21cd4d7e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
(cherry picked from commit 9b77f96822457e20bd5c5249c41bf498a3351b2b)
|
|
Change-Id: I6005000762eb6e7bb7e40ccaea35004a07b47aa1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 8afd88fdf4574136d44cfaa8b01a4fa89e6a7a81)
|
|
It protects against mixed logs as lots of python scripts directly call
print which doesn't flush stdout as opposed to log.info(). This
requirement is induced by subprocess.Popen() initiated by run_tests.py.
The following programs could switch to logging instead of print [1]
[1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \
|grep \ print\ |cut -d: -f 1 |sort -u
./testcases/Controllers/ODL/OpenDaylightTesting.py
./testcases/Controllers/ONOS/Sfc/Sfc_fun.py
./testcases/Controllers/ONOS/Sfc/Sfc.py
./testcases/Controllers/ONOS/Teston/adapters/client.py
./testcases/Controllers/ONOS/Teston/adapters/connection.py
./testcases/Controllers/ONOS/Teston/adapters/environment.py
./testcases/Controllers/ONOS/Teston/adapters/foundation.py
./testcases/OpenStack/vPing/vping_util.py
./testcases/security_scan/connect.py
./utils/functest_utils.py
./utils/functest_vacation.py
./utils/openstack_clean.py
JIRA: FUNCTEST-441
Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d32ff56af10bcc15163d573a64970013242c689c)
|
|
Change-Id: I587ac6d210135e7124ba006a977a675a4d38b518
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit fee070fcc4a31735abb88b303742bb05f12b53e7)
|
|
Now env vars are mandatory in push_results_to_db. It avoids testing
programs to check them even if they are useless from their points of
view.
The related getters aren't removed to help debugging via
logger_test_results which could be run without report.
Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 66334bc798c25d5769f92f2a6292daaf6220da79)
|
|
Now run_tests.py calls directly OpenDaylightTesting.functest_run().
It mainly reads env vars as exec_test.sh does.
Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit d6484df9b602f0888450ef1e29ccc0a5f6c94675)
|
|
Change-Id: I7580f02dd5b2db6cf06690ef0163768ea59079fe
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 683db3a5d67aeead1090008bce7701ffb208a15c)
|
|
When run_tests.py sets logger as execute_command arg, logs are
duplicated in functest.log and not shown in console (as every DEBUG
message). As logger is mainly managed by the python scripts in charge
of testing, it can be safely removed here.
stderr is also redirected to stdout in execute_command to print
possible relevant data.
JIRA: FUNCTEST-431
Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
(cherry picked from commit 53fd052b7fce64294c50ca170d42367d711ccc3f)
|
|
Change-Id: I6c2925237d7ae437f49d60d37ef906ed8029eb03
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
(cherry picked from commit da6398642446f98240d9d1bf924e959e64a73d63)
|
|
Change-Id: I9229d4de823568bfefd4f2c1ab5c5c1a1ded6d2c
Signed-off-by: dongwenjuan <dong.wenjuan@zte.com.cn>
(cherry picked from commit e0a17212d21ae7d76c55791ab8bcde1c66df3158)
|
|
|
|
|
|
There are lots of common processes in vPing_userdata.py
and vPing_ssh.py, abstract and refactor them.
JIRA: FUNCTEST-414
Change-Id: I4cd2c635318c063319d2a3c31f9a1e512eeea6c8
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
All files where __main__ is checked can now be executed by everyone.
It results from [1] like the next commit [2].
[1] find . -name "*.py" |xargs grep __main__ |cut -d\: -f 1 |xargs chmod 755
[2] https://gerrit.opnfv.org/gerrit/#/c/16737/
Change-Id: I75395892e9e6afbf8ac9c995258496be557aad5f
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It now relies on Robotframework API instead of parsing output.xml.
The type of critical and elapsedime fields are now bool and int
respectively. start_date and stop_date has been fixed too.
JIRA: FUNCTEST-367
Change-Id: I59f3ad2109345395ccf01a714301a14f9323f088
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I9c3fd786574622977870b12d38b92f8bed8a929c
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Set default instance flavor to m1.tiny in order to keep
hardware resources requirements at the minimum.
Change-Id: If070e25389e1d7978c34dec8621414c8938a262f
Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
|
|
It removes useless odlreport2db args as functest_utils parses env vars
too and erases this previous values.
All mandatory env vars are still checked in exec_test.sh.
Change-Id: I3dd299dcad1758b994cf9d53ef65a5b83dc46b97
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
|
|
JIRA: FUNCTEST-210
Change-Id: I97be5542ae4ae87f1b8d62394ff66068e77f4082
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
There are two slashes appeared in the path when we execute case test:
/home/opnfv/functest/conf//openstack.creds
/home/opnfv/repos/functest//testcases/OpenStack/vPing/vPing_userdata.py
JIRA: FUNCTEST-421
Change-Id: I4fa8a11499e301dd84d1e1de7c72189b8d84459b
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
Parser tests was removed by onos people in
change https://gerrit.opnfv.org/gerrit/#/c/18821/.
After we talk about this, we found it was a mis-removal.
JIRA: FUNCTEST-422
Change-Id: I76da8786cac0fc5c874aa69e937d6ae19b20c6b1
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
Change-Id: I72467575ca3eb79cbd0094882d3a5be73c2cf308
Signed-off-by: wuwb1989 <wuwenbin2@huawei.com>
|
|
JIRA: FUNCTEST-416
Change-Id: I1a5800be0dcf75573f44e6214b23917aadc1cbf7
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|