aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2017-03-23Merge "Enable functest offline by installing tempest system wide"Jose Lausuch1-1/+1
2017-03-23Merge "Switch test_db_url to a directory"Morgan Richomme1-0/+2
2017-03-23Merge "Support running on openstack which enabled https"Jose Lausuch1-6/+23
2017-03-22Disable blocking status for odl_netvirtJamo Luhrsen1-1/+1
Change-Id: I4a3f10a82d3109a44f8db237cbd7beda06a361da Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-03-22Switch test_db_url to a directoryxudan1-0/+2
We must now set a dir (e.g. /home/opnfv/db) to dump results. It avoids replacing "results" and prevent from limiting the use of this decorator. All data will be dumped into url/dump.txt As also proposed in FUNCTEST-729, missing directories are created too. The decorator will raise exceptions if dir exists or if target is not a directory. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-729 Change-Id: I9650c72493043539f17725f5c328c12639ecc059 Signed-off-by: xudan <xudan16@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-22Merge "refstack: bugfix of testcase failure"Jose Lausuch1-1/+1
2017-03-22refstack: bugfix of testcase failureMatthewLi1-1/+1
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-22Merge "Set refstack_defcore criteria to 100%"Morgan Richomme1-1/+1
2017-03-22Merge changes from topics '644', 'improve_unix_permission_check'Cedric Ollivier3-0/+0
* changes: Change execute bits Improve unix permissions fixes
2017-03-21Change execute bitsCédric Ollivier3-0/+0
It applies the rules proposed by "Improve unix permissions fixes" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/31171/ Change-Id: If5142befb74165a982f9281e8770289b303d483d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-21Set refstack_defcore criteria to 100%Linda Wang1-1/+1
In order to be consistent with other tests, set refstack_defcore criteria to 100%. Change-Id: Iab8bc0cb66b834a661b860a032192d502fde578b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-20Enable functest offline by installing tempest system wideLinda Wang1-1/+1
JIRA: FUNCTEST-764 1. When creating verifier via rally in functest env prepare, without the parameter "--system-wide", rally will install tempest and its dependent packages into the virtual env of rally. Thus, it needs to connect internet when installing tempest, which will not enable functest offline. 2. Some packages are needed for multisite testcase, and they are installed in virtual env of rally before. But if "--system-wide" is set, there packages should be installed addtionally. Change-Id: I340701e9ed4a0f8f278ff952f0dd61470c6deed1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-16Remove functest_defcore testcasesMorgan Richomme1-14/+0
refstack_defcore has been merged the testcase is no more needed (duplication) Change-Id: I287406b40cdd89ff2c4eadcde7e9d5a93e21953a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-16Bugfix: fix the criteria of refstack_defcoreLinda Wang1-1/+1
The criteria of refstack_defcore is supposed to be ">= 80%" rather than "== 80%". Change-Id: I9f9e38c84925c3725289e8b427e5735d131459f1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-16Merge "Added Unit Tests for ci/generate_report with argument refactoring for ↵Morgan Richomme1-2/+2
main and init functions in generate_reports"
2017-03-15Parse refstack_defcore resultsLinda Wang1-1/+1
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 Parse refstack_defcore results, including: 1. show number of tests passed, skipped and failed 2. record the detailed info about testcases passed, skipped and failed. Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-15Merge "refstack client integration"Morgan Richomme2-0/+22
2017-03-15refstack client integrationMatthewLi2-0/+22
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-15Added Unit Tests for ci/generate_report withashishk19941-2/+2
argument refactoring for main and init functions in generate_reports Change-Id: I291d04a9c0ed381f4b92e989270c0b9a37c15264 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-14bug fix: remove reference to ovnoMorgan Richomme1-1/+0
ovno has no danube branch and is not used clean the ovno from functest to avoid side effect when producing danube functest docker file Change-Id: I5347111fc90a04ca9018679b5578ca30ae33b2f2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-14[tempest/defcore] Configure volume device nameMichael Polenchuk1-0/+1
Actually attach_detach_volume must be skipped because the device name ain't reliable and that's using a hard-coded device name in config. This test should just get the device info after the attach and use that rather than the hard-coded config option in Tempest that ain't likely to work - the test should have been written more dynamically. However, set volume device name to "vdc" since "vdb" is used for config drive when force_config_drive=True is in action. Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-03-13Support running on openstack which enabled httpshelenyao1-6/+23
JIRA: FUNCTEST-757 Change-Id: Ic87bee3020b9714bcd83105127440a9c1a7ff2ad Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-10Exclude Doctor from Joid scnenariosMorgan Richomme1-1/+1
Doctor feature not available for Joid on Danube Change-Id: I1d39ff15a1fe003689828f6923b92c7e7c7d716f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Change scenario for odl_netvirt tests to be os-odl_l3-nofeatureJamo Luhrsen1-2/+2
Change-Id: Ibf04adcaa0b14c4cdda8fba2ef2826a0c7f3b7d4 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-03-09Change the order of HealthCheck testsMorgan Richomme1-16/+16
currently the snaps healthcheck (dhcp) is tried first it should be connectivity, api, dhcp the reporting looks for scenario based on connectivity testing dhcp first => scenarios ok on connectivy but failed with DHCP are not considered, which could be misleading Change-Id: I0eb34b1f5ba163540281e5ef0dcb12c8cefa88bd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Introduce smoke tests for FDSTomas Cechvala2-0/+20
Added: - fds repository to docker file - fds test to smoke tier in testcases - config values for fds tests A new robot var OS_AUTH_URL is defined as expected by FDS robot files. Method args switch from Keystone IP to OS_AUTH_URL which is more precised. The argument parsing is changed too. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ife27ab4a83f0110cbdcf7c9d47d9b3fb4c0ec705 Signed-off-by: Tomas Cechvala <tcechval@cisco.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-09Merge "Exclude SNAPS smoke for lxd scenario"Morgan Richomme1-42/+14
2017-03-09Install kingbird verifier extension for tempestJuha Kosonen1-0/+1
JIRA: FUNCTEST-742 Change-Id: I5de8ed22932250c542751e38eae3185c4a263cd0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-08Exclude SNAPS smoke for lxd scenarioMorgan Richomme1-42/+14
SNAPS healthcheck is already excluded due to the use of QCOW2 images, not compatible with lxd scenarios 2 JIRAs have been cretaed to adapt the SNAPS cases to lxd in Euphrates https://jira.opnfv.org/browse/FUNCTEST-752 https://jira.opnfv.org/browse/FUNCTEST-753 Additionnal cleaning done on testcases.yaml - remove juju_epc case (no one from OAI available for Danube) - remove orchestra (as standalone test case of the MANO stack, postponed to Euphrates) - comment aaa (empty sample used to illustrate the VNF abstraction but not completed for Danube) Change-Id: Ibad6cad4c92ee9897b6665b29c09b62cb1986aae Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-08Modification of repo path for vrouterh-hayashi1-1/+1
JIRA: FUNCTEST-750 1.Modification of repo path for vrouter in config_functest.yaml Change-Id: I798e27df9667c3dea55dddba51c53f6ac0d13381 Signed-off-by: Hideyasu Hayashi <hideyasu.hayashi@okinawaopenlabs.org>
2017-03-07Merge "delete ft_constants and file functest_constants.py"Morgan Richomme1-5/+0
2017-03-07delete ft_constants and file functest_constants.pySerenaFeng1-5/+0
delete no longer used ft_constants in run_test.py substitute ft_constants with CONST in foundation.py and remove useless str() finally delete not-used file functest_constants.py Change-Id: I109a5409e501b610f41aae7d75c55ca745a3d4c1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-06Aarch64 adaption in functest for snaps healthcheckCristina Pauna1-4/+4
This commit is half of the fix for adapting the snaps healthcheck to run on an aarch64 POD. The fix consists in reading the custom parameters and passing them to the snaps test The snaps part that uses this info is https://gerrit.opnfv.org/gerrit/29853 JIRA: ARMBAND-222 Change-Id: I2027f2ef3afe0caddef781771f2190fc173aff8c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-02Merge "Remove exec_test.sh"Jose Lausuch2-162/+3
2017-03-02fix KeyError: 'clean_flag'Ryota MIBU1-0/+1
Change-Id: I26d24ed1db0668aba4c737058c82e2d655bbf818 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-03-02Merge "Add clean_flag to test cases"Jose Lausuch4-4/+49
2017-03-01Remove exec_test.shjose.lausuch2-162/+3
After the patch https://gerrit.opnfv.org/gerrit/#/c/29403/ all the test cases in functest have been adapted to the new framework using modules/classes. This patch removes the need for having the script exec_tests.sh which is not used any more by the framework. Change-Id: I7547c908d2eca60edf8c867db920c7da4f23d312 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-01Merge "Adopt TestcaseBase for ONOS and ONOS SFC"Jose Lausuch3-10/+9
2017-03-01Adopt TestcaseBase for ONOS and ONOS SFChelenyao3-10/+9
1. Adopted TestcaseBase for ONOS and ONOS SFC 2. Removed the ONOS testcase from exec_test.sh This patch is not meant to refactor the code which can be improved in a later patch. Change-Id: Ib8ac47742f598648c7575c9a8968477307629d42 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-01Merge "Re-enable the tests for bgpvpn scenario wich use floating ips"Jose Lausuch1-2/+2
2017-03-01Bugfix: fix the CI failure for compass and joidhelenyao1-25/+33
The bug was induced by [1] 1. the key try logic is added back 2. the logic of patch_config_file is updated as NoneType error was thrown 3. refactored the patch_config_file to avoid calling the same function twice on every type of POD. For non-aarch64, only calling the function once is enough [1] https://gerrit.opnfv.org/gerrit/#/c/28945/ Change-Id: I2e9fdc5ac3c04800cfc898ea654ff24e2bdeaef4 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-01Merge "Update cirros image to latest version"Morgan Richomme2-6/+6
2017-03-01Merge "Add custom tempest test."Helen Yao1-0/+16
2017-03-01Add clean_flag to test casesjose.lausuch4-4/+49
Some test cases such as tempest or those using SNAPS have a built-in cleaup or teardown mechanism. This patch helps to save some time by bypassing the openstack snapshot and cleanup when running those kind of tests cases. Change-Id: I50e7a17937a813532b3756474158416d3e85b922 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-28Update cirros image to latest versionMichael Polenchuk2-6/+6
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-28Merge "Add aarch64 custom config"Jose Lausuch3-36/+88
2017-02-28Merge "Add domino testcase"Morgan Richomme1-0/+12
2017-02-27Add aarch64 custom configCristina Pauna3-36/+88
In order to run functest on an aarch64 POD, some custom configuration is needed. Up until now that custom configuration was put on the arm jenkins slave. With this commit it is integrated in functest project. 1. In order to identify if the POD is aarch64 or x86 function get_arch() from https://gerrit.opnfv.org/gerrit/#/c/29099 is used 2. Changes to config_functest.yaml are made via a new patch file config_aarch64_patch.yaml which is applied for all scenarios. Function patch_config_file() is modified to be more generic. It now receives a file as parameter and merges any type of patch file 3. The aarch64 cirros images are downloaded into the data directory. Functest can be run from both an aarch64 or a x86 jenkins slave in order to test an aarch64 POD. So the images are downloded in both dockerfiles 4. Other custom config needs to be added to /etc/rally/rally.conf in the docker. The custom config is set in rally_aarch64_patch.conf and inserted in the needed file before the rally environment is set up JIRA: ARMBAND-60 Change-Id: I8e460cdf02d297c259cbbd9c05e7983367fd2bb9 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-02-27Merge "Adding vRouter test codes using TestCasesBase"Morgan Richomme2-0/+14
2017-02-26Merge "Remove shell Healtcheck test case"Jose Lausuch1-13/+1