Age | Commit message (Collapse) | Author | Files | Lines |
|
Include Neutron rally-jobs.
Change-Id: Ic1122962bd7d876d179729640a8a321bc36442d8
Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
(cherry picked from commit 5d54a533d25a989dc64a2789788ff2f2fd6ad5c6)
|
|
Change-Id: Ide63c601b50ec2f6f02ef2682035b937ca2a1662
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I409975acd1493e2f5a6bdcb3a4bd6ff6e383e02e
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It also updates all jobs and fixes Dockerhub hooks.
Change-Id: Ib182155736b4dbdb829293081741a9d5cb8ea6d7
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It allows loading functest and functest-kubernetes jjbs in one
Jenkins.
Change-Id: Ia52e84583bc25aad0d1508096b536cbd5585d261
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Change-Id: I245d0fbe8f026a24138ede4041caae4dccc15cc0
Signed-off-by: Qiaowei Ren <qiaowei.ren@intel.com>
|
|
Change-Id: Ib65203e74244d87f7ac6b24f6e6abf723c57a786
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
As opposed to the Releng ones, they are designed to be easily
executed by endusers as well. They can be considered as a first step
towards a full Functest CI/CD toolchain deployed via docker-compose.
All components testcases are enabled here.
They hugely leverage on templates to load the right yamls per branch
and multijobs to run testcases in parallel. Many steps are proposed
allowing running part of the chain.
Executors have to be increased to allow running them (it was tested
vs 10 and more).
At first, all docker images are downloaded to avoid different
versions between testcases.
They will be improved in a second change to ensure that only one node
is selected and to take all Functest env vars into account.
Change-Id: I99c7b8ee5d0ddbb00102b3147739b5e8b5c65c23
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-525
Change-Id: I6b09eaec55e42a3ee1474b21bc7ed87a71118e60
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
- create functest subdirectory
- rename unit tests
- adapt path in exec and config files
JIRA: FUNCTEST-525
Change-Id: Ifd5c6edfb5bda1b09f82848e2269ad5fbeb84d0a
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
It modifies run_tests.py to dynamically execute testcases and then
removes the test condition about odl.
It also induces that the modules and the related classes must be
defined in ci/testcases.yaml.
JIRA: FUNCTEST-353
Change-Id: I6ad67b70624aac6bf805c9bde4dfef7c9fbd5c00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
We added support for multi-compute and changed one file from bash to python
Change-Id: Ife3d5a8e41936c044cfe88664187d81c18d96b93
Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
|
|
Now ODLTestCases inherits from TestCasesBase what induces several
modifications of function definitions.
It also renames functest_run to run and run to main and they now
return the code status defined in TestCasesBase instead of True and
False (run_tests.py has been adapted as well).
It checks if errno is equal to EEXIST when makedir raises an OSError
exception.
JIRA: FUNCTEST-353
Change-Id: I88240a9ce8e491dab4c7e6c604f3ecc62cf9edce
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It simply removes the exit call in ft_utils.execute_command which is
quite safe as every testcase sets exit_on_error to False
JIRA: FUNCTEST-438
Change-Id: Ia273de0955cc3ea65a150c626638400ce614da00
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
JIRA: FUNCTEST-487
Change-Id: I41d0180b622623699bccc3f7413ffbbb468f7656
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
Change-Id: I81a74a9f7c6ae54ba1b2be7ec27a11ae3a2392b9
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
A iteration is added so that the test is run several times.
We are experiencing that ODL requires one deployment for things
to work
Change-Id: Ic70e8f2dabbf03827dd6d7396d2ab8177140cc97
Signed-off-by: Manuel Buil <manuel.buil@ericsson.com>
|
|
This fixes a small bug in
https://gerrit.opnfv.org/gerrit/#/c/21833/
JIRA: JIRA: SFC-48
Change-Id: I92ad973369109a107700443c074dfae6f6c21516
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: SFC-48
After some troublehsooting done in Boron RC3.5, vPing
doesn't work because the instances are created on 2
security groups. One (vping-sg) opens port 22 but
the default secgroup doesn't. This patch allows port
22 also on the default and therefore vPing passes.
This patch is to workaround a bug in ODL. The bug
will be reported to the corresponding community.
Change-Id: I807249d42cebe7c8dccd78a3496c1d34996d73ee
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Due to the same performance issue encountered in bgpvpn
scenarios, Jenkins still times out and can't have a summary
of all the tests and upload logs to artifacts.
The removal of this test case will affect only
Colorado 1.0, and will be reactivated in
Colorado 2.0 with ODL Boron.
Change-Id: Ic2d8cc43a1a732daa063aa7c01a309a3dfa2050d
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
Change-Id: I9335ed1517097e83175a265b603a6707adf476b6
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
|
|
Doctor, as part of the feature project, is FAIL on fuel
scenarios
JIRA: FUNCTEST-192
Change-Id: Ic5b9b4afe80fbb2d5887bdf46410a0fc72e7be37
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
JIRA: FUNCTEST-475
Change-Id: I720b9d88db94d66f067601608ab2d1435fc93d47
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
Missing parameter prevented using of customer defined
installer type when executing "functest env prepare" command.
JIRA: FUNCTEST-467
Change-Id: I69b69fa43584ec7ae4e4d8925f99624711131ef9
Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
|
|
suggestins"
|
|
Change-Id: I414338616aecda161a51a780abb24c9e3a8f5c54
Signed-off-by: juraj.linkes <jlinkes@cisco.com>
|
|
Due to a known issue with API performance when bgpvpn extension
is activated which causes some delays and the tests take longer
time than normal, we get a lot of Jenkins Job timeouts and the
scenario cannot be validated.
Since it is a performance issue, we black list rally sanity, which
takes 1 hour to complete and will re-enable it in Colorado.2.0
where ODL Boron release will be available and SDNVPN team
thinks this will be fixed.
Change-Id: Idc68e30ea15d52d0fd4b63bc57ddf643f3f7c8b4
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
JIRA: FUNCTEST-463
Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/
**** Do not import objects, only modules (*) ****
so direct FUNCTEST_REPO import should be avoided
from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO
JIRA: FUNCTEST-459
Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
JIRA: FUNCTEST-446
Reduce the logs that appear in the Jenkins CI console to make the output
of the SFC test case more readable
- Redirect tacker installation logs to results folder
/home/opnfv/functest/results/odl-sfc.log
- Split odl-sfc preparation into a new script
- Pipe STDERR in the sfc.py script so that "Added to known hosts"
messages do not show in the output
Change-Id: Ibf871ade6827d4817f33623b935c5f1d904086bb
Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
|
|
Since there is a function in functest_utils to get
a value from the config_functest.yaml directly, there
is no need to load again that file. Better to use common
functions that are designed for that.
Also, Replace location of the results json file to
the results directory. It will be also pushed to artifacts
repository.
Change-Id: Ic6422ed78ccd0f8b40b519342a7dcf38c502924e
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
In some scenarios (bgpvpn) the timeout defined in promise
to boot/delete vms is too tight. Having less memory
might fix the problem as it will take less time and it
doesn't impact the promise test case.
Change-Id: Ib3165ea5d6518d88384f76c8edd10dddb0b529a3
Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
|
|
functest repo is used by almost every testcase, each place we get it like:
REPOS_DIR = os.getenv('repos_dir')
FUNCTEST_REPO = ("%s/functest" % REPOS_DIR)
provide a common interface in functest_util.py
JIRA: FUNCTEST-453
Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
|
|
JIRA: FUNCTEST-452
Change-Id: I35c6417e6650ce190e499384f9cf9cca1fa35eb1
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
functest_yaml is needed in almost all of the testcases, the obtain process is the same:
with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f:
functest_yaml = yaml.safe_load(f)
f.close()
abstract a method to unify the process, and provide the interface
JIRA: FUNCTEST-447
Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
As it modifies method params, it could break the testcases.
JIRA: FUNCTEST-428
Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Parser tests needs lots of resources, such as vcpu/memory/disk,
virtuals pod may not meet the requirements, so exclude Parser
running on virtual pods by exclude 'noha' scenario
JIRA: FUNCTEST-444
Change-Id: I6f2832fa0f727f762987c41d7a3485dede041151
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever
testcases.yaml is needed, abstract a method to provide unified interface
JIRA: FUNCTEST-449
Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
JIRA: FUNCTEST-442
Change-Id: I1f6888dbddebf28af4b565ca87d9791a21cd4d7e
Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
|
|
Change-Id: I6005000762eb6e7bb7e40ccaea35004a07b47aa1
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
It protects against mixed logs as lots of python scripts directly call
print which doesn't flush stdout as opposed to log.info(). This
requirement is induced by subprocess.Popen() initiated by run_tests.py.
The following programs could switch to logging instead of print [1]
[1] $ find . -name "*.py" |xargs grep -v ^[[:space:]]*# \
|grep \ print\ |cut -d: -f 1 |sort -u
./testcases/Controllers/ODL/OpenDaylightTesting.py
./testcases/Controllers/ONOS/Sfc/Sfc_fun.py
./testcases/Controllers/ONOS/Sfc/Sfc.py
./testcases/Controllers/ONOS/Teston/adapters/client.py
./testcases/Controllers/ONOS/Teston/adapters/connection.py
./testcases/Controllers/ONOS/Teston/adapters/environment.py
./testcases/Controllers/ONOS/Teston/adapters/foundation.py
./testcases/OpenStack/vPing/vping_util.py
./testcases/security_scan/connect.py
./utils/functest_utils.py
./utils/functest_vacation.py
./utils/openstack_clean.py
JIRA: FUNCTEST-441
Change-Id: I7e9a888507f10352be7e85abd7f27dba4b1a7b53
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Change-Id: I587ac6d210135e7124ba006a977a675a4d38b518
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
Now env vars are mandatory in push_results_to_db. It avoids testing
programs to check them even if they are useless from their points of
view.
The related getters aren't removed to help debugging via
logger_test_results which could be run without report.
Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|
|
|
|
Now run_tests.py calls directly OpenDaylightTesting.functest_run().
It mainly reads env vars as exec_test.sh does.
Change-Id: Ibb44a7ca67e9218d34d13b8dd539e772902fe5b8
Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
|