summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-03-23Ignore certain modules for loggingjose.lausuch1-1/+12
Some modules are logged to functest.log or the console and are not relevant for us since they are already in the openstack logs. This causes a huge log which makes it unreadable. Change-Id: I3f0fb83e2080e41cd5bf815f8448f5bc25e3464a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> (cherry picked from commit d6f4f25e6269a23120b37f58178164740f1cf0e9)
2017-03-23Enable functest offline by installing tempest system wideLinda Wang3-1/+17
JIRA: FUNCTEST-764 1. When creating verifier via rally in functest env prepare, without the parameter "--system-wide", rally will install tempest and its dependent packages into the virtual env of rally. Thus, it needs to connect internet when installing tempest, which will not enable functest offline. 2. Some packages are needed for multisite testcase, and they are installed in virtual env of rally before. But if "--system-wide" is set, there packages should be installed addtionally. Change-Id: I340701e9ed4a0f8f278ff952f0dd61470c6deed1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 264896f475e3f0975754c9fa78980051661698c0)
2017-03-23Switch test_db_url to a directoryxudan2-1/+10
We must now set a dir (e.g. /home/opnfv/db) to dump results. It avoids replacing "results" and prevent from limiting the use of this decorator. All data will be dumped into url/dump.txt As also proposed in FUNCTEST-729, missing directories are created too. The decorator will raise exceptions if dir exists or if target is not a directory. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-729 Change-Id: I9650c72493043539f17725f5c328c12639ecc059 Signed-off-by: xudan <xudan16@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com> (cherry picked from commit 18bdde48e866f198b5d08b62fc9e26e3dfe4e818)
2017-03-23Make SFC test a python call to main()jose.lausuch1-2/+4
Instead of python -> bash -> python, call the SFC test using the execute() method that is inherited from FeatureBase and it's a bash call by default. With this change, we call the SFC test using main() of run_tests.py of SFC repo and will have real time output. Change-Id: I6d59821e603c88697a82b95c5626c5b703c11026 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com> Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com> (cherry picked from commit d5820bef80ea4bdb871380dbfe41db12290fc5f8)
2017-03-23refstack: bugfix of testcase failureMatthewLi2-2/+2
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 9ae14f931da5baf42a3b62eef49c644e762405fc)
2017-03-22Disable blocking status for odl_netvirtJamo Luhrsen1-1/+1
Change-Id: I4a3f10a82d3109a44f8db237cbd7beda06a361da Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com> (cherry picked from commit 569182f4b24de6b0f020754d717129a82d19930b)
2017-03-22bugfix: fail to push odl-sfc test result to TestDBSerenaFeng1-1/+1
'functest-odl-sfc"' will appear as [functest-odl-sfc"], tailing with ", it is not defined in TestDB. led to failure pushing Change-Id: I43966236e25578aed12952710b22ba99e244cf56 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn> (cherry picked from commit 3137017fd435547abdcc2df0d73be5f1b2ef443a)
2017-03-22Update keys of details dic for refstack_defcoreLinda Wang1-3/+3
Update the keys of details in refstack_defcore ("num_tests", "num_failures", and "failed") to "tests", "failures" and "errors", in order to be consistent with those in tempest. Change-Id: I24f8a23548ffa253621083bbf6eb988306fd6edb Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 93d5bf2ad47f431bfab173ed718bb7469b67514f)
2017-03-22Set refstack_defcore criteria to 100%Linda Wang1-1/+1
In order to be consistent with other tests, set refstack_defcore criteria to 100%. Change-Id: Iab8bc0cb66b834a661b860a032192d502fde578b Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit fa1dea1dbcf36e7a9d44fcb716fa9af0ef47b445)
2017-03-21bug fix: version not retrieved on weekly jobsMorgan Richomme2-26/+1
a first fix had been done but the version was retrieved 2 times with the regex this patch removes the second regex and re-use get_version the associated unit tests has been removed because even if the build_tag is badly formated, it will not prevent the results to be pushed with version = unknown JIRA: FUNCTEST-765 Change-Id: I2cbe8ba1dd7278c3f3510a47c667c433f65e00f8 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit afc59e6af25a60c68a3095365c780974721f1364)
2017-03-21[cloudify_ims] Change VNF flavor valueboucherv2-3/+3
Change-Id: I843f77fa5051a99be8bdbdbb76300ab965e9d8af Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit 442cedd8fd0453d5b662319c6d307bc0ee6437da)
2017-03-21Remove functest_defcore testcasesMorgan Richomme1-14/+0
refstack_defcore has been merged the testcase is no more needed (duplication) Change-Id: I287406b40cdd89ff2c4eadcde7e9d5a93e21953a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 9f6db60565be34a886f457d92d655d364bd71f9d)
2017-03-20Fix usage of v3 APIs of OpenStackMichael Pauls1-4/+7
Using OS_PROJECT_ID instead of OS_TENANT_NAME as tenant when onboarding a new VIM/PoP with Open Baton Change-Id: I873badc73e7b33179fa487505d18ce89840d6599 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de> (cherry picked from commit 340cf9330af728dac334de7b391c3ea3971fd125)
2017-03-20[vnf_base] improve exceptionboucherv3-18/+23
Return on part of previous changes in commit: 30257 https://gerrit.opnfv.org/gerrit/#/c/30257/ Change-Id: I11b33ee2a6f9d4cbcf1449006b47be508fce655e Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit 3575dcb2a262c623dd4ded0823bc78adf3a1012e)
2017-03-20Remove raise exceptionsMorgan Richomme2-14/+21
until exceptions are better managed in abstraction Currently it triggers an exit from the jenkins job and prevent other tests to be run Change-Id: Id3b18c1d6d3b786fc78456b3ad51963d2cbb2cc1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 6ac6937237bc03b27935f71bbb33c0abffc1e993)
2017-03-19Bug Fix: retrieve version from build tag in weekly jobsMorgan Richomme2-5/+15
- fix regex issue - add unit test to cover weekly and dummy build tags - remove useless logs JIRA: FUNCTEST-765 Change-Id: I7a8d40b4662f4557cd080669da46fb1c32d2ad6d Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit f15a4f277fb61b86074e949e2323b8f652969dd1)
2017-03-19[cloudify_ims] fix signaling test errorboucherv1-3/+5
Change-Id: I6d6cf36c2a82df1ff9943cc3084b38967033bb94 Signed-off-by: boucherv <valentin.boucher@orange.com> (cherry picked from commit 5b8aa73c0ae774649998c62d9d38d4c7bd09bb84)
2017-03-17Fix deployment flavor of orchestra machine; Improve bootstrapMichael Pauls2-3/+3
Change-Id: I3aa00be7e6e7d3e8de86a8b6a8e9564dc548a3d3 Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de> (cherry picked from commit dce6afeedc21ec9e5b97d630493b9307682ccaa4)
2017-03-16Bugfix: fix the criteria of refstack_defcoreLinda Wang1-1/+1
The criteria of refstack_defcore is supposed to be ">= 80%" rather than "== 80%". Change-Id: I9f9e38c84925c3725289e8b427e5735d131459f1 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 5f500e6a33c9b8ea904a46b2f84d734f26da4aaf)
2017-03-16refstack-client: arm dockerfile supportMatthewLi1-0/+5
JIRA: FUNCTEST-758 JIRA: DOVETAIL-366 Change-Id: I02784263bca26a1bfc786949b933d688c35c950f Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 0deaa18a03be4ba14a3d1c7c71ae404e0f6837a8)
2017-03-16Parse refstack_defcore resultsLinda Wang4-13/+88
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 Parse refstack_defcore results, including: 1. show number of tests passed, skipped and failed 2. record the detailed info about testcases passed, skipped and failed. Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 2223051412c8855afebb7a9d657c90e9f235f78a)
2017-03-16refstack client integrationMatthewLi12-140/+742
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 99f308dc9b11e8f99d928840de576af274229331)
2017-03-16Added Unit Tests for ci/generate_report withashishk19942-2/+131
argument refactoring for main and init functions in generate_reports Change-Id: I291d04a9c0ed381f4b92e989270c0b9a37c15264 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com> (cherry picked from commit cc72b61456aeaa9752527d55541df3791ff1fbbf)
2017-03-16Added Unit Tests for ci/run_testsashishk19941-0/+192
Change-Id: I5cd900cee809b8fd935a5c8b862a9ecd6278bdf5 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com> (cherry picked from commit 0077ad99834d51654a75a5ccf49fcfcaf828b905)
2017-03-16Added Unit Tests for ci/tier_builderashishk19941-0/+83
Change-Id: I66f43fb09472948bc71178cd8aeb14dc1ab5fa55 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com> (cherry picked from commit f651565ffc8979ef99a1d9bc001561bf1fba3779)
2017-03-16env variable support for test DB urlMorgan Richomme2-2/+20
So far DB url was retrieved from configuration file If you want to use the CI chain (jenkins, testapi, test DB, functest, ..) then you have a problem calling functest will systematically point to the configuration from the repo Supporting env variable allow to avoid post processing in the configuration file and as a consequence offer the possibility to create a local DB to host local results Change-Id: Ie64b8b265827d7f5724c7066a8c173de8cf012e2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 0c194ede4dd9eb46b61af49e85527fcc368a8fca)
2017-03-14bug fix: remove reference to ovnoMorgan Richomme4-4/+0
ovno has no danube branch and is not used clean the ovno from functest to avoid side effect when producing danube functest docker file Change-Id: I5347111fc90a04ca9018679b5578ca30ae33b2f2 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com> (cherry picked from commit 65b26f2e9db7e0cf336c147d46d91cb1c828a67b)
2017-03-14[snaps] Pass flavor metadata to smoke testsMichael Polenchuk1-0/+1
Change-Id: I774d3625d35e3d264d609ba9aa7538a723923bcf Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 1ee860c3f5391234e5424b49e5e9cba9cdebf593)
2017-03-14[tempest/defcore] Configure volume device nameMichael Polenchuk3-2/+6
Actually attach_detach_volume must be skipped because the device name ain't reliable and that's using a hard-coded device name in config. This test should just get the device info after the attach and use that rather than the hard-coded config option in Tempest that ain't likely to work - the test should have been written more dynamically. However, set volume device name to "vdc" since "vdb" is used for config drive when force_config_drive=True is in action. Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 3b006a6a3742325c0fe4ccc557b7a8e140f2cab2)
2017-03-10Merge "cloudify_ims: fix error on account creation"Morgan Richomme1-0/+3
2017-03-10cloudify_ims: fix error on account creationboucherv1-0/+3
Change-Id: I43550b2062c69d7b4eb144057a90806f92328739 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-10Merge "Add extra check to avoid double delete of instances"Morgan Richomme2-2/+62
2017-03-10Merge "Exclude Doctor from Joid scnenarios"Morgan Richomme1-1/+1
2017-03-10Merge "cloudify_ims: fix sip public domain name"Morgan Richomme1-1/+1
2017-03-10cloudify_ims: fix sip public domain nameboucherv1-1/+1
Change-Id: I25423cc3fbab54f81047fbebd0bc33895d826186 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-10Exclude Doctor from Joid scnenariosMorgan Richomme1-1/+1
Doctor feature not available for Joid on Danube Change-Id: I1d39ff15a1fe003689828f6923b92c7e7c7d716f Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-10Merge "Unit tests added for openstack/tempest"Morgan Richomme5-6/+372
2017-03-09Change scenario for odl_netvirt tests to be os-odl_l3-nofeatureJamo Luhrsen1-2/+2
Change-Id: Ibf04adcaa0b14c4cdda8fba2ef2826a0c7f3b7d4 Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-03-10Merge "Show verification details in tempest log"Morgan Richomme1-1/+2
2017-03-10Merge "Change the order of HealthCheck tests"Morgan Richomme1-16/+16
2017-03-09Merge "fix vnf deployment"Morgan Richomme1-1/+1
2017-03-09fix vnf deploymentboucherv1-1/+1
Change-Id: If92c7d402b88f59367564f7279d426eb8f3b582a Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-09Change the order of HealthCheck testsMorgan Richomme1-16/+16
currently the snaps healthcheck (dhcp) is tried first it should be connectivity, api, dhcp the reporting looks for scenario based on connectivity testing dhcp first => scenarios ok on connectivy but failed with DHCP are not considered, which could be misleading Change-Id: I0eb34b1f5ba163540281e5ef0dcb12c8cefa88bd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Merge "Update tempest to the latest 15.0.0"Morgan Richomme2-2/+2
2017-03-09Show verification details in tempest logJuha Kosonen1-1/+2
JIRA: FUNCTEST-747 Change-Id: I85f15188315136cc44876914325e3693f7973af8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-09Merge "Introduce smoke tests for FDS"Morgan Richomme5-16/+47
2017-03-09Introduce smoke tests for FDSTomas Cechvala5-16/+47
Added: - fds repository to docker file - fds test to smoke tier in testcases - config values for fds tests A new robot var OS_AUTH_URL is defined as expected by FDS robot files. Method args switch from Keystone IP to OS_AUTH_URL which is more precised. The argument parsing is changed too. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: Ife27ab4a83f0110cbdcf7c9d47d9b3fb4c0ec705 Signed-off-by: Tomas Cechvala <tcechval@cisco.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-09Merge "Revert "Change barometer target log file""Morgan Richomme1-4/+1
2017-03-09Revert "Change barometer target log file"Morgan Richomme1-4/+1
This reverts commit 044de9eb0c74fb2ef9cb34b6487bf0536412058d. Change-Id: I9179f4b5ce866456e8ec85cb8a730a5d7f2af16e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-09Merge "Change barometer target log file"Morgan Richomme1-2/+2