summaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2017-03-23Merge "Support running on openstack which enabled https" into stable/danubeMorgan Richomme1-6/+23
2017-03-23Support running on openstack which enabled httpshelenyao1-6/+23
JIRA: FUNCTEST-757 Change-Id: Ic87bee3020b9714bcd83105127440a9c1a7ff2ad Signed-off-by: helenyao <yaohelan@huawei.com> (cherry picked from commit 4a989722feca53e1baa6f64985841bd6a244d627)
2017-03-23Enable functest offline by installing tempest system wideLinda Wang1-1/+1
JIRA: FUNCTEST-764 1. When creating verifier via rally in functest env prepare, without the parameter "--system-wide", rally will install tempest and its dependent packages into the virtual env of rally. Thus, it needs to connect internet when installing tempest, which will not enable functest offline. 2. Some packages are needed for multisite testcase, and they are installed in virtual env of rally before. But if "--system-wide" is set, there packages should be installed addtionally. Change-Id: I340701e9ed4a0f8f278ff952f0dd61470c6deed1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 264896f475e3f0975754c9fa78980051661698c0)
2017-03-23Switch test_db_url to a directoryxudan1-0/+2
We must now set a dir (e.g. /home/opnfv/db) to dump results. It avoids replacing "results" and prevent from limiting the use of this decorator. All data will be dumped into url/dump.txt As also proposed in FUNCTEST-729, missing directories are created too. The decorator will raise exceptions if dir exists or if target is not a directory. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-729 Change-Id: I9650c72493043539f17725f5c328c12639ecc059 Signed-off-by: xudan <xudan16@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 18bdde48e866f198b5d08b62fc9e26e3dfe4e818)
2017-03-23refstack: bugfix of testcase failureMatthewLi1-1/+1
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 9ae14f931da5baf42a3b62eef49c644e762405fc)
2017-03-22Disable blocking status for odl_netvirtJamo Luhrsen1-1/+1
Change-Id: I4a3f10a82d3109a44f8db237cbd7beda06a361da Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com> (cherry picked from commit 569182f4b24de6b0f020754d717129a82d19930b)
2017-03-22Set refstack_defcore criteria to 100%Linda Wang1-1/+1
In order to be consistent with other tests, set refstack_defcore criteria to 100%. Change-Id: Iab8bc0cb66b834a661b860a032192d502fde578b Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit fa1dea1dbcf36e7a9d44fcb716fa9af0ef47b445)
2017-03-21Remove functest_defcore testcasesMorgan Richomme1-14/+0
refstack_defcore has been merged the testcase is no more needed (duplication) Change-Id: I287406b40cdd89ff2c4eadcde7e9d5a93e21953a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 9f6db60565be34a886f457d92d655d364bd71f9d)
2017-03-16Bugfix: fix the criteria of refstack_defcoreLinda Wang1-1/+1
The criteria of refstack_defcore is supposed to be ">= 80%" rather than "== 80%". Change-Id: I9f9e38c84925c3725289e8b427e5735d131459f1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 5f500e6a33c9b8ea904a46b2f84d734f26da4aaf)
2017-03-16Parse refstack_defcore resultsLinda Wang1-1/+1
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 Parse refstack_defcore results, including: 1. show number of tests passed, skipped and failed 2. record the detailed info about testcases passed, skipped and failed. Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 2223051412c8855afebb7a9d657c90e9f235f78a)
2017-03-16refstack client integrationMatthewLi2-0/+22
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 99f308dc9b11e8f99d928840de576af274229331)
2017-03-16Added Unit Tests for ci/generate_report withashishk19941-2/+2
argument refactoring for main and init functions in generate_reports Change-Id: I291d04a9c0ed381f4b92e989270c0b9a37c15264 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com> (cherry picked from commit cc72b61456aeaa9752527d55541df3791ff1fbbf)
2017-03-14bug fix: remove reference to ovnoMorgan Richomme1-1/+0
ovno has no danube branch and is not used clean the ovno from functest to avoid side effect when producing danube functest docker file Change-Id: I5347111fc90a04ca9018679b5578ca30ae33b2f2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 65b26f2e9db7e0cf336c147d46d91cb1c828a67b)
2017-03-14[tempest/defcore] Configure volume device nameMichael Polenchuk1-0/+1
Actually attach_detach_volume must be skipped because the device name ain't reliable and that's using a hard-coded device name in config. This test should just get the device info after the attach and use that rather than the hard-coded config option in Tempest that ain't likely to work - the test should have been written more dynamically. However, set volume device name to "vdc" since "vdb" is used for config drive when force_config_drive=True is in action. Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 3b006a6a3742325c0fe4ccc557b7a8e140f2cab2)
2017-03-10Exclude Doctor from Joid scnenariosMorgan Richomme1-1/+1
Doctor feature not available for Joid on Danube Change-Id: I1d39ff15a1fe003689828f6923b92c7e7c7d716f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Change scenario for odl_netvirt tests to be os-odl_l3-nofeatureJamo Luhrsen1-2/+2
Change-Id: Ibf04adcaa0b14c4cdda8fba2ef2826a0c7f3b7d4 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-03-09Change the order of HealthCheck testsMorgan Richomme1-16/+16
currently the snaps healthcheck (dhcp) is tried first it should be connectivity, api, dhcp the reporting looks for scenario based on connectivity testing dhcp first => scenarios ok on connectivy but failed with DHCP are not considered, which could be misleading Change-Id: I0eb34b1f5ba163540281e5ef0dcb12c8cefa88bd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Introduce smoke tests for FDSTomas Cechvala2-0/+20
Added: - fds repository to docker file - fds test to smoke tier in testcases - config values for fds tests A new robot var OS_AUTH_URL is defined as expected by FDS robot files. Method args switch from Keystone IP to OS_AUTH_URL which is more precised. The argument parsing is changed too. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ife27ab4a83f0110cbdcf7c9d47d9b3fb4c0ec705 Signed-off-by: Tomas Cechvala <tcechval@cisco.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-09Merge "Exclude SNAPS smoke for lxd scenario"Morgan Richomme1-42/+14
2017-03-09Install kingbird verifier extension for tempestJuha Kosonen1-0/+1
JIRA: FUNCTEST-742 Change-Id: I5de8ed22932250c542751e38eae3185c4a263cd0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-08Exclude SNAPS smoke for lxd scenarioMorgan Richomme1-42/+14
SNAPS healthcheck is already excluded due to the use of QCOW2 images, not compatible with lxd scenarios 2 JIRAs have been cretaed to adapt the SNAPS cases to lxd in Euphrates https://jira.opnfv.org/browse/FUNCTEST-752 https://jira.opnfv.org/browse/FUNCTEST-753 Additionnal cleaning done on testcases.yaml - remove juju_epc case (no one from OAI available for Danube) - remove orchestra (as standalone test case of the MANO stack, postponed to Euphrates) - comment aaa (empty sample used to illustrate the VNF abstraction but not completed for Danube) Change-Id: Ibad6cad4c92ee9897b6665b29c09b62cb1986aae Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-08Modification of repo path for vrouterh-hayashi1-1/+1
JIRA: FUNCTEST-750 1.Modification of repo path for vrouter in config_functest.yaml Change-Id: I798e27df9667c3dea55dddba51c53f6ac0d13381 Signed-off-by: Hideyasu Hayashi <hideyasu.hayashi@okinawaopenlabs.org>
2017-03-07Merge "delete ft_constants and file functest_constants.py"Morgan Richomme1-5/+0
2017-03-07delete ft_constants and file functest_constants.pySerenaFeng1-5/+0
delete no longer used ft_constants in run_test.py substitute ft_constants with CONST in foundation.py and remove useless str() finally delete not-used file functest_constants.py Change-Id: I109a5409e501b610f41aae7d75c55ca745a3d4c1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-06Aarch64 adaption in functest for snaps healthcheckCristina Pauna1-4/+4
This commit is half of the fix for adapting the snaps healthcheck to run on an aarch64 POD. The fix consists in reading the custom parameters and passing them to the snaps test The snaps part that uses this info is https://gerrit.opnfv.org/gerrit/29853 JIRA: ARMBAND-222 Change-Id: I2027f2ef3afe0caddef781771f2190fc173aff8c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-02Merge "Remove exec_test.sh"Jose Lausuch2-162/+3
2017-03-02fix KeyError: 'clean_flag'Ryota MIBU1-0/+1
Change-Id: I26d24ed1db0668aba4c737058c82e2d655bbf818 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-03-02Merge "Add clean_flag to test cases"Jose Lausuch4-4/+49
2017-03-01Remove exec_test.shjose.lausuch2-162/+3
After the patch https://gerrit.opnfv.org/gerrit/#/c/29403/ all the test cases in functest have been adapted to the new framework using modules/classes. This patch removes the need for having the script exec_tests.sh which is not used any more by the framework. Change-Id: I7547c908d2eca60edf8c867db920c7da4f23d312 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-01Merge "Adopt TestcaseBase for ONOS and ONOS SFC"Jose Lausuch3-10/+9
2017-03-01Adopt TestcaseBase for ONOS and ONOS SFChelenyao3-10/+9
1. Adopted TestcaseBase for ONOS and ONOS SFC 2. Removed the ONOS testcase from exec_test.sh This patch is not meant to refactor the code which can be improved in a later patch. Change-Id: Ib8ac47742f598648c7575c9a8968477307629d42 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-01Merge "Re-enable the tests for bgpvpn scenario wich use floating ips"Jose Lausuch1-2/+2
2017-03-01Bugfix: fix the CI failure for compass and joidhelenyao1-25/+33
The bug was induced by [1] 1. the key try logic is added back 2. the logic of patch_config_file is updated as NoneType error was thrown 3. refactored the patch_config_file to avoid calling the same function twice on every type of POD. For non-aarch64, only calling the function once is enough [1] https://gerrit.opnfv.org/gerrit/#/c/28945/ Change-Id: I2e9fdc5ac3c04800cfc898ea654ff24e2bdeaef4 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-01Merge "Update cirros image to latest version"Morgan Richomme2-6/+6
2017-03-01Merge "Add custom tempest test."Helen Yao1-0/+16
2017-03-01Add clean_flag to test casesjose.lausuch4-4/+49
Some test cases such as tempest or those using SNAPS have a built-in cleaup or teardown mechanism. This patch helps to save some time by bypassing the openstack snapshot and cleanup when running those kind of tests cases. Change-Id: I50e7a17937a813532b3756474158416d3e85b922 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-28Update cirros image to latest versionMichael Polenchuk2-6/+6
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-28Merge "Add aarch64 custom config"Jose Lausuch3-36/+88
2017-02-28Merge "Add domino testcase"Morgan Richomme1-0/+12
2017-02-27Add aarch64 custom configCristina Pauna3-36/+88
In order to run functest on an aarch64 POD, some custom configuration is needed. Up until now that custom configuration was put on the arm jenkins slave. With this commit it is integrated in functest project. 1. In order to identify if the POD is aarch64 or x86 function get_arch() from https://gerrit.opnfv.org/gerrit/#/c/29099 is used 2. Changes to config_functest.yaml are made via a new patch file config_aarch64_patch.yaml which is applied for all scenarios. Function patch_config_file() is modified to be more generic. It now receives a file as parameter and merges any type of patch file 3. The aarch64 cirros images are downloaded into the data directory. Functest can be run from both an aarch64 or a x86 jenkins slave in order to test an aarch64 POD. So the images are downloded in both dockerfiles 4. Other custom config needs to be added to /etc/rally/rally.conf in the docker. The custom config is set in rally_aarch64_patch.conf and inserted in the needed file before the rally environment is set up JIRA: ARMBAND-60 Change-Id: I8e460cdf02d297c259cbbd9c05e7983367fd2bb9 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-02-27Merge "Adding vRouter test codes using TestCasesBase"Morgan Richomme2-0/+14
2017-02-26Merge "Remove shell Healtcheck test case"Jose Lausuch1-13/+1
2017-02-25Re-enable the tests for bgpvpn scenario wich use floating ipsjose.lausuch1-2/+2
Change-Id: Ia468b9c9ab9f74a3255aa3647916d1018cef2902 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-25Add custom tempest test.jose.lausuch1-0/+16
Some users need to run a specific list of tempest test cases. This patch allows them to do that by running the command: functest testcase run tempest_custom Change-Id: If8e7726b98c3a71398c7abdf80aea79f10653ebf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-25Merge "Bugfix:Added the adapter info for compass and joid"Jose Lausuch2-26/+31
2017-02-24Merge "Add Tempest Defcore test case"Jose Lausuch1-23/+35
2017-02-24Add Tempest Defcore test casejose.lausuch1-23/+35
Refstack is the OpenStack project that provides the tooling to run the approved specific tempest test cases (Defcore guidelines) by the Interop working group and by the OpenStack board for OpenStack certification purposes. For more info: https://refstack.openstack.org/ This adds the possibility for a Functest user to run this list of tempest test cases by just issuing the command: functest testcase run tempest_defcore The test will be run on daily loops with the scenario nosdn-nofeature on any installer. Change-Id: I920b2a44cff418116008fdf514425e69dc959412 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Merge "Integration of orchestra_ims test"Morgan Richomme2-2/+3
2017-02-24Merge "WIP: Cirros TestVM: Allow config of username/password"Jose Lausuch1-0/+2
2017-02-24Adding vRouter test codes using TestCasesBaseh-hayashi2-0/+14
JIRA: FUNCTEST-530 1.setting "nosdn-nofeature" scinario in testcase.yaml. 1.adding process of setting result details for push DB 2.Delete of define "vrouter_data" in config_functest.yaml. 3.modify of vrouter git tag's name "stable". 4.modrify of testcase name "vyos_vrouter" In order to more specific. Change-Id: I0602c01dbf9a5e71bf85943c2b5e40ef51269ffd Signed-off-by: Hideyasu Hayashi <hideyasu.hayashi@okinawaopenlabs.org>