aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-05-16Add enabled flag in testcases.yamljose.lausuch6-17/+65
This will allow enable/disable test cases directly using true/false. Change-Id: Iaa7d051ebb8dd9e5a6f835a823f58f1e17a87b8d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-16Switch from generate_report to PrettyTableCédric Ollivier8-334/+30
run_tests.py now relies on PrettyTable as most of the openstack clients. generate_report.py and its related unit tests are simply removed. It sets padding_width=5 in testcase.py too to conform with run_tests.py. Now report is printed in every case. Change-Id: Id9ce93f984503f25d6a2150482f397853fa3dd64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Update framework presCédric Ollivier1-12/+15
It takes into account the next framework modifications: - Switch TestCase attribute criteria to result [1] - Manage criteria in TestCase [2] - Print the real testcase duration [3] - Rename TestCase check_result() to is_successful() [4] [1] https://gerrit.opnfv.org/gerrit/#/c/33695/ [2] https://gerrit.opnfv.org/gerrit/#/c/33697/ [3] https://gerrit.opnfv.org/gerrit/#/c/34369/ [4] https://gerrit.opnfv.org/gerrit/#/c/34373/ Change-Id: I3a6790e4233ef4c55b0535618dacf702f779f28b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Fix how to get tier_nameCédric Ollivier3-1/+14
The tier name was incorrect when passing a test case as run_test.py arg. Change-Id: I6f439fc7b90facb3f0553798bd1fe06ac9f09475 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Merge "Modify TestCase.__str__() to use PrettyTable"Jose Lausuch4-8/+16
2017-05-12Upgrade robotframework-sshlibrary to 2.1.3George Paraskevopoulos2-2/+2
Robotframework sshlibrary monkeypatches paramiko runtime and version 2.1.1 causes 2017-03-27 15:24:23,196 - SSH utils - ERROR - _custom_start_client() got an unexpected keyword argument 'timeout' errors in SFC test because of the issue https://github.com/robotframework/SSHLibrary/issues/158 This issue is resolved in version 2.1.3 Change-Id: I07f570c1a90f358b9f17aa6c959642d67e07a7e4 Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2017-05-12Merge "Add Energy recording support"Morgan Richomme6-1/+491
2017-05-11Modify TestCase.__str__() to use PrettyTableCédric Ollivier4-8/+16
It adds PrettyTable as requirement even if it's already defined in OpenStack client dependencies. If the TestCase object is considered as invalid, it simply returns the default str. Change-Id: Iee788aef2a13694d9482560977cbbf21c7f2c967 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-10Merge "Conform ODL with last framework updates"Morgan Richomme3-9/+38
2017-05-10Merge changes from topic 'add_testcase_str'Morgan Richomme5-10/+57
* changes: Remove the former results in DB url Implement TestCase __str__()
2017-05-09Merge "Bugfix: initialize the logger for snaps"Cedric Ollivier2-0/+4
2017-05-09Remove the former results in DB urlCédric Ollivier2-7/+7
It conforms generate_report.py with the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/33511/ Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Add Energy recording supportBenoit HERARD6-1/+491
It adds helpers to send notifications to Energy recording API and related unit tests. It requires a dedicated section in functest config file to set connectivity parameters to Energy recording API. It is using shared API Recording at http://161.105.253.100:8888 Change-Id: Idcb74d1bf7341ccce7cc1c3926f22338ce24f714 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-05-09Conform ODL with last framework updatesCédric Ollivier3-9/+38
Now ODL TestCase calculates the ratio between critical tests passed and failed and saves it in result. Non-critical test cases can fail as result doesn't take them into account [1]. It also updates default attribute values in TestCase and allows result to be float. [1] http://robotframework.org/robotframework/latest/RobotFrameworkUserGuide.html#setting-criticality Change-Id: Id4a89271b5b1a90cd3c1e2b08591ff26ffaffee0 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Rename VnfOnBoardingBase to VnfOnBoardingCédric Ollivier5-7/+7
Change-Id: I514340fc6180e29b31ef11bdea9f719aa2bbb738 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Rename vnf_base to vnfCédric Ollivier5-10/+10
Change-Id: I0b8b9b2e85717fc92a233e4f7344b3419421778d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Bugfix: initialize the logger for snapsLinda Wang2-0/+4
Testcases about snaps failed due to the absence of attribute 'logger'. Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-06Implement TestCase __str__()Cédric Ollivier3-3/+50
It's designed to be called by run_tests.py when printing the results of test cases and when generating the global report. Change-Id: If4a6f023ef2344bbc4f940d07dde4b776dce5d68 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-06Merge "Rename TestCase check_result() to is_successful()"Cedric Ollivier2-10/+10
2017-05-05Merge "Print the real testcase duration"Jose Lausuch3-12/+53
2017-05-05Rename TestCase check_result() to is_successful()Cédric Ollivier2-10/+10
Change-Id: I41cea33b4c1dae79e75231e7c7e069fc89736f34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Print the real testcase durationCédric Ollivier3-12/+53
TestCase offers a new public method to calculate and print the duration. It also adds the related unit tests and adapts run_tests.py. Change-Id: Ib6a7e637dafacb9027146199aeb033c2dcb986c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Merge "Replace CONST.* by getattribute/setattr"Jose Lausuch7-157/+181
2017-05-05Merge "Extended the timeout for Opera"Jose Lausuch1-6/+6
2017-05-05Replace CONST.* by getattribute/setattrjose.lausuch7-157/+181
Directories affected: - ci - core and respective unit tests Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-05Merge "Add iniparse to requirements.txt"Jose Lausuch1-0/+1
2017-05-05Merge "Check open args in test_odl"Jose Lausuch1-3/+9
2017-05-05Merge "Replace project_name by case_name in result file name"Morgan Richomme2-2/+2
2017-05-05Replace project_name by case_name in result file nameCédric Ollivier2-2/+2
It avoids erasing functest.log when project_name = functest. Change-Id: Icae898abb8b51c89b79bb1124adfadab8b0b3b99 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Add iniparse to requirements.txtLinda Wang1-0/+1
Package iniparse is absent for functest, while it is required by rally.py Change-Id: Ia50216cfebdc9033f6a5f4abc6338951aaa2e8ab Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-05Check open args in test_odlCédric Ollivier1-3/+9
Change-Id: I4b0060502621c7491820b9aa42d8f2f63b06a9ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Add Danube 2.0 reporting statusMorgan Richomme6-0/+5084
Change-Id: Icc09b824a4e7906dfab031b679ba3d0aa86ab0cd Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-05-05Merge "Forbid calling generate_report from cmdline"Jose Lausuch1-6/+0
2017-05-05Merge "Define loggers as class-private members"Jose Lausuch5-48/+56
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch37-231/+159
2017-05-04Forbid calling generate_report from cmdlineCédric Ollivier1-6/+0
Change-Id: Ic9ea7507dc5f1f781b57c4573e971a2c8a8ca9ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Define loggers as class-private membersCédric Ollivier5-48/+56
This mangling ensures that all info messages printed from core packages are shown in console. It also avoids sphinx to print them. Change-Id: I07db9f33060c195bce3b48b06a6640eb6c56c2eb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier37-231/+159
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Merge "Update tempest.conf to enable tempest from external server"Jose Lausuch1-1/+8
2017-05-04Merge "Update rally_conf.json for creating deployment"Jose Lausuch1-2/+10
2017-05-04Merge "Add the choice of interface for keystoneclient"Jose Lausuch3-38/+40
2017-05-04Merge "Publish framework presentation"Cedric Ollivier2-0/+318
2017-05-04Merge changes from topic 'remove_openstack_dir'Morgan Richomme6-163/+0
* changes: Remove openstack directory Remove create_instance_and_ip.py
2017-05-04Merge "refstack-client userguide"Morgan Richomme3-3/+127
2017-05-04Extended the timeout for Operahelenyao1-6/+6
Change-Id: Ifeb4aecf66d75c9bb98d5dafdbe20be78423565e Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-03Merge "Update INFO file for Euphrates"Jose Lausuch1-13/+18
2017-05-03Remove openstack directoryjose.lausuch5-35/+0
It is useles right now and won't be used in the future. Change-Id: I9aa121544051f49f7e7e794ae3b2c4a9ea516e47 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-03Update tempest.conf to enable tempest from external serverLinda Wang1-1/+8
1. The endpoint type to use for OpenStack Identity API v3 "v3_endpoint_type" is set to be "adminURL" by default, which should be updated to the env OS_ENDPOINT_TYPE with the value "publicURL" 2. Reset the identity region name to "RegionOne" 3. For keystone api v3 in Newton, 5 testcases aimming at identity admin v2 test should be omitted. JIRA: FUNCTEST-801 Change-Id: I47ae41a80de0a52d32d25c9783860955f465099c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-03Merge "Updated basic attributes for opera testcase"Jose Lausuch1-3/+3
2017-05-03refstack-client userguideMatthewLi3-3/+127
JIRA: FUNCTEST-758 container setup steps are skipped, since they already included in the functest userguide documents. Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>