aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2017-06-27Updated fds testcase criteriajuraj.linkes1-1/+1
Initially, we only executed fds testcase on odl_l2 fdio scenarios. Now we're extending this to all odl fdio scenarios. Change-Id: Ieb2454f02847361fdf3274b11f20a996a916ad90 Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2017-06-26Remove Domino from apex/DanubeMorgan Richomme1-1/+1
Change-Id: Iba8bb7b1df1686b1bba8f8e2fe8c4c6e2a88d44c Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-13Remove the former results in DB urlCédric Ollivier1-3/+3
It conforms generate_report.py with the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/33511/ Conflicts: functest/tests/unit/ci/test_generate_report.py Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit a212763c3e9f4cf6d52200aa614e42a911c5dbf7)
2017-05-13rename tempest.conf to refstack_tempest.confMatthewLi1-1/+1
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 8bbfda2df0a3a10d069a41c0f074b0de69737767)
2017-05-13Stop hardcoding results suffix in push_to_dbMatthewLi1-3/+3
Adding results in url is useless as it is defined in results section in config_functest.yaml. It allows defining the full name in case of dumping to file (see decorator.py). The commented local file is the value required by dovetail. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I35ba9b34d99e138292f099934e28585ee8b85604 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 7e15dbb5136b1b298d86a82c03199bf1f7a6fe46)
2017-05-13Rename testcase_base to testcaseCédric Ollivier1-3/+3
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 69e51470d8e9f51e02d5f0bd6e957c4e24c603c6)
2017-05-13Switch TestcaseBase to TestCaseCédric Ollivier1-2/+2
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and removes the useless suffix too. [1] https://gerrit.opnfv.org/gerrit/#/c/25391/ Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 407d27585f109e3381bb49041abc49a14b7b5bfe)
2017-04-07Increase ram for tempest tests (aarch64)Cristina Pauna1-2/+2
The following tests fail on armband because the VM cannot boot. tempest.api.compute.servers.test_server_actions. ServerActionsTestJSON.test_reboot_server_hard tempest.scenario.test_network_basic_ops. TestNetworkBasicOps.test_network_basic_ops tempest.scenario.test_volume_boot_pattern. TestVolumeBootPattern.test_volume_boot_pattern tempest.scenario.test_volume_boot_pattern. TestVolumeBootPatternV2.test_volume_boot_pattern The reason for the failure is that the 128 ram is insufficient for the image to boot. The fix consists in increasing the ram to 256 JIRA: ARMBAND-61 Change-Id: I5be1a44a8038b4952cca100511e8d08b7a37681c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com> (cherry picked from commit 5a417f076549941e0dae176849045aab32bf0be5)
2017-03-31Make tempest cleanup resources after runningLinda Wang1-4/+4
JIRA: FUNCTEST-773 1. When running refstack_defcore, create tenant and user failed due to conflict with those created when runnning tempest_smoke_serial. 2. Clean all resources created for tempest_smoke_serial. Change-Id: Icf8ec95f6db0b2f93bf6c56ec10a6e8ea1a91ab1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit f94a1744e7a4d3a48466b6171a205e1ed84026d7)
2017-03-30Re-enable rally and tempest full for weeklyjose.lausuch1-43/+31
Change-Id: I640531ebcc471adebe780c75627d822cf8fd956d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit 6c9981cf03127c847481235e2b26377ecd108c2d)
2017-03-28Remove vping_ssh from bgpvpn and gluon scenarioNikolas Hermanns1-1/+1
Cause of the bug: https://bugs.opendaylight.org/show_bug.cgi?id=5586 Floating ip is not working at the moment for us. We don't want to remove the vping_ssh test from fuel. the scenarios are called different in fuel and in apex. odl-bgpvpn in apex. odl_l2-bgpvpn in fuel. Change-Id: Iaa2e6cea8a4fdb8635f018427aaf30634fd8d2d5 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com> (cherry picked from commit 5af67bcca589c275b73fe5e4bca9bea5871948aa)
2017-03-23Merge "Support running on openstack which enabled https" into stable/danubeMorgan Richomme1-6/+23
2017-03-23Support running on openstack which enabled httpshelenyao1-6/+23
JIRA: FUNCTEST-757 Change-Id: Ic87bee3020b9714bcd83105127440a9c1a7ff2ad Signed-off-by: helenyao <yaohelan@huawei.com> (cherry picked from commit 4a989722feca53e1baa6f64985841bd6a244d627)
2017-03-23Enable functest offline by installing tempest system wideLinda Wang1-1/+1
JIRA: FUNCTEST-764 1. When creating verifier via rally in functest env prepare, without the parameter "--system-wide", rally will install tempest and its dependent packages into the virtual env of rally. Thus, it needs to connect internet when installing tempest, which will not enable functest offline. 2. Some packages are needed for multisite testcase, and they are installed in virtual env of rally before. But if "--system-wide" is set, there packages should be installed addtionally. Change-Id: I340701e9ed4a0f8f278ff952f0dd61470c6deed1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 264896f475e3f0975754c9fa78980051661698c0)
2017-03-23Switch test_db_url to a directoryxudan1-0/+2
We must now set a dir (e.g. /home/opnfv/db) to dump results. It avoids replacing "results" and prevent from limiting the use of this decorator. All data will be dumped into url/dump.txt As also proposed in FUNCTEST-729, missing directories are created too. The decorator will raise exceptions if dir exists or if target is not a directory. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-729 Change-Id: I9650c72493043539f17725f5c328c12639ecc059 Signed-off-by: xudan <xudan16@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 18bdde48e866f198b5d08b62fc9e26e3dfe4e818)
2017-03-23refstack: bugfix of testcase failureMatthewLi1-1/+1
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 9ae14f931da5baf42a3b62eef49c644e762405fc)
2017-03-22Disable blocking status for odl_netvirtJamo Luhrsen1-1/+1
Change-Id: I4a3f10a82d3109a44f8db237cbd7beda06a361da Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com> (cherry picked from commit 569182f4b24de6b0f020754d717129a82d19930b)
2017-03-22Set refstack_defcore criteria to 100%Linda Wang1-1/+1
In order to be consistent with other tests, set refstack_defcore criteria to 100%. Change-Id: Iab8bc0cb66b834a661b860a032192d502fde578b Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit fa1dea1dbcf36e7a9d44fcb716fa9af0ef47b445)
2017-03-21Remove functest_defcore testcasesMorgan Richomme1-14/+0
refstack_defcore has been merged the testcase is no more needed (duplication) Change-Id: I287406b40cdd89ff2c4eadcde7e9d5a93e21953a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 9f6db60565be34a886f457d92d655d364bd71f9d)
2017-03-16Bugfix: fix the criteria of refstack_defcoreLinda Wang1-1/+1
The criteria of refstack_defcore is supposed to be ">= 80%" rather than "== 80%". Change-Id: I9f9e38c84925c3725289e8b427e5735d131459f1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 5f500e6a33c9b8ea904a46b2f84d734f26da4aaf)
2017-03-16Parse refstack_defcore resultsLinda Wang1-1/+1
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 Parse refstack_defcore results, including: 1. show number of tests passed, skipped and failed 2. record the detailed info about testcases passed, skipped and failed. Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 2223051412c8855afebb7a9d657c90e9f235f78a)
2017-03-16refstack client integrationMatthewLi2-0/+22
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 99f308dc9b11e8f99d928840de576af274229331)
2017-03-16Added Unit Tests for ci/generate_report withashishk19941-2/+2
argument refactoring for main and init functions in generate_reports Change-Id: I291d04a9c0ed381f4b92e989270c0b9a37c15264 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com> (cherry picked from commit cc72b61456aeaa9752527d55541df3791ff1fbbf)
2017-03-14bug fix: remove reference to ovnoMorgan Richomme1-1/+0
ovno has no danube branch and is not used clean the ovno from functest to avoid side effect when producing danube functest docker file Change-Id: I5347111fc90a04ca9018679b5578ca30ae33b2f2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 65b26f2e9db7e0cf336c147d46d91cb1c828a67b)
2017-03-14[tempest/defcore] Configure volume device nameMichael Polenchuk1-0/+1
Actually attach_detach_volume must be skipped because the device name ain't reliable and that's using a hard-coded device name in config. This test should just get the device info after the attach and use that rather than the hard-coded config option in Tempest that ain't likely to work - the test should have been written more dynamically. However, set volume device name to "vdc" since "vdb" is used for config drive when force_config_drive=True is in action. Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 3b006a6a3742325c0fe4ccc557b7a8e140f2cab2)
2017-03-10Exclude Doctor from Joid scnenariosMorgan Richomme1-1/+1
Doctor feature not available for Joid on Danube Change-Id: I1d39ff15a1fe003689828f6923b92c7e7c7d716f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Change scenario for odl_netvirt tests to be os-odl_l3-nofeatureJamo Luhrsen1-2/+2
Change-Id: Ibf04adcaa0b14c4cdda8fba2ef2826a0c7f3b7d4 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-03-09Change the order of HealthCheck testsMorgan Richomme1-16/+16
currently the snaps healthcheck (dhcp) is tried first it should be connectivity, api, dhcp the reporting looks for scenario based on connectivity testing dhcp first => scenarios ok on connectivy but failed with DHCP are not considered, which could be misleading Change-Id: I0eb34b1f5ba163540281e5ef0dcb12c8cefa88bd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Introduce smoke tests for FDSTomas Cechvala2-0/+20
Added: - fds repository to docker file - fds test to smoke tier in testcases - config values for fds tests A new robot var OS_AUTH_URL is defined as expected by FDS robot files. Method args switch from Keystone IP to OS_AUTH_URL which is more precised. The argument parsing is changed too. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ife27ab4a83f0110cbdcf7c9d47d9b3fb4c0ec705 Signed-off-by: Tomas Cechvala <tcechval@cisco.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-09Merge "Exclude SNAPS smoke for lxd scenario"Morgan Richomme1-42/+14
2017-03-09Install kingbird verifier extension for tempestJuha Kosonen1-0/+1
JIRA: FUNCTEST-742 Change-Id: I5de8ed22932250c542751e38eae3185c4a263cd0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-08Exclude SNAPS smoke for lxd scenarioMorgan Richomme1-42/+14
SNAPS healthcheck is already excluded due to the use of QCOW2 images, not compatible with lxd scenarios 2 JIRAs have been cretaed to adapt the SNAPS cases to lxd in Euphrates https://jira.opnfv.org/browse/FUNCTEST-752 https://jira.opnfv.org/browse/FUNCTEST-753 Additionnal cleaning done on testcases.yaml - remove juju_epc case (no one from OAI available for Danube) - remove orchestra (as standalone test case of the MANO stack, postponed to Euphrates) - comment aaa (empty sample used to illustrate the VNF abstraction but not completed for Danube) Change-Id: Ibad6cad4c92ee9897b6665b29c09b62cb1986aae Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-08Modification of repo path for vrouterh-hayashi1-1/+1
JIRA: FUNCTEST-750 1.Modification of repo path for vrouter in config_functest.yaml Change-Id: I798e27df9667c3dea55dddba51c53f6ac0d13381 Signed-off-by: Hideyasu Hayashi <hideyasu.hayashi@okinawaopenlabs.org>
2017-03-07Merge "delete ft_constants and file functest_constants.py"Morgan Richomme1-5/+0
2017-03-07delete ft_constants and file functest_constants.pySerenaFeng1-5/+0
delete no longer used ft_constants in run_test.py substitute ft_constants with CONST in foundation.py and remove useless str() finally delete not-used file functest_constants.py Change-Id: I109a5409e501b610f41aae7d75c55ca745a3d4c1 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-06Aarch64 adaption in functest for snaps healthcheckCristina Pauna1-4/+4
This commit is half of the fix for adapting the snaps healthcheck to run on an aarch64 POD. The fix consists in reading the custom parameters and passing them to the snaps test The snaps part that uses this info is https://gerrit.opnfv.org/gerrit/29853 JIRA: ARMBAND-222 Change-Id: I2027f2ef3afe0caddef781771f2190fc173aff8c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-02Merge "Remove exec_test.sh"Jose Lausuch2-162/+3
2017-03-02fix KeyError: 'clean_flag'Ryota MIBU1-0/+1
Change-Id: I26d24ed1db0668aba4c737058c82e2d655bbf818 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2017-03-02Merge "Add clean_flag to test cases"Jose Lausuch4-4/+49
2017-03-01Remove exec_test.shjose.lausuch2-162/+3
After the patch https://gerrit.opnfv.org/gerrit/#/c/29403/ all the test cases in functest have been adapted to the new framework using modules/classes. This patch removes the need for having the script exec_tests.sh which is not used any more by the framework. Change-Id: I7547c908d2eca60edf8c867db920c7da4f23d312 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-01Merge "Adopt TestcaseBase for ONOS and ONOS SFC"Jose Lausuch3-10/+9
2017-03-01Adopt TestcaseBase for ONOS and ONOS SFChelenyao3-10/+9
1. Adopted TestcaseBase for ONOS and ONOS SFC 2. Removed the ONOS testcase from exec_test.sh This patch is not meant to refactor the code which can be improved in a later patch. Change-Id: Ib8ac47742f598648c7575c9a8968477307629d42 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-01Merge "Re-enable the tests for bgpvpn scenario wich use floating ips"Jose Lausuch1-2/+2
2017-03-01Bugfix: fix the CI failure for compass and joidhelenyao1-25/+33
The bug was induced by [1] 1. the key try logic is added back 2. the logic of patch_config_file is updated as NoneType error was thrown 3. refactored the patch_config_file to avoid calling the same function twice on every type of POD. For non-aarch64, only calling the function once is enough [1] https://gerrit.opnfv.org/gerrit/#/c/28945/ Change-Id: I2e9fdc5ac3c04800cfc898ea654ff24e2bdeaef4 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-01Merge "Update cirros image to latest version"Morgan Richomme2-6/+6
2017-03-01Merge "Add custom tempest test."Helen Yao1-0/+16
2017-03-01Add clean_flag to test casesjose.lausuch4-4/+49
Some test cases such as tempest or those using SNAPS have a built-in cleaup or teardown mechanism. This patch helps to save some time by bypassing the openstack snapshot and cleanup when running those kind of tests cases. Change-Id: I50e7a17937a813532b3756474158416d3e85b922 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-28Update cirros image to latest versionMichael Polenchuk2-6/+6
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-28Merge "Add aarch64 custom config"Jose Lausuch3-36/+88
2017-02-28Merge "Add domino testcase"Morgan Richomme1-0/+12