aboutsummaryrefslogtreecommitdiffstats
path: root/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-05-05Merge "Print the real testcase duration"Jose Lausuch3-12/+53
2017-05-05Print the real testcase durationCédric Ollivier3-12/+53
TestCase offers a new public method to calculate and print the duration. It also adds the related unit tests and adapts run_tests.py. Change-Id: Ib6a7e637dafacb9027146199aeb033c2dcb986c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Merge "Replace CONST.* by getattribute/setattr"Jose Lausuch7-157/+181
2017-05-05Merge "Extended the timeout for Opera"Jose Lausuch1-6/+6
2017-05-05Replace CONST.* by getattribute/setattrjose.lausuch7-157/+181
Directories affected: - ci - core and respective unit tests Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-05Merge "Check open args in test_odl"Jose Lausuch1-3/+9
2017-05-05Replace project_name by case_name in result file nameCédric Ollivier2-2/+2
It avoids erasing functest.log when project_name = functest. Change-Id: Icae898abb8b51c89b79bb1124adfadab8b0b3b99 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Check open args in test_odlCédric Ollivier1-3/+9
Change-Id: I4b0060502621c7491820b9aa42d8f2f63b06a9ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Merge "Forbid calling generate_report from cmdline"Jose Lausuch1-6/+0
2017-05-05Merge "Define loggers as class-private members"Jose Lausuch5-48/+56
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch37-231/+159
2017-05-04Forbid calling generate_report from cmdlineCédric Ollivier1-6/+0
Change-Id: Ic9ea7507dc5f1f781b57c4573e971a2c8a8ca9ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Define loggers as class-private membersCédric Ollivier5-48/+56
This mangling ensures that all info messages printed from core packages are shown in console. It also avoids sphinx to print them. Change-Id: I07db9f33060c195bce3b48b06a6640eb6c56c2eb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier37-231/+159
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Merge "Update tempest.conf to enable tempest from external server"Jose Lausuch1-1/+8
2017-05-04Merge "Update rally_conf.json for creating deployment"Jose Lausuch1-2/+10
2017-05-04Merge "Add the choice of interface for keystoneclient"Jose Lausuch3-38/+40
2017-05-04Merge changes from topic 'remove_openstack_dir'Morgan Richomme6-163/+0
* changes: Remove openstack directory Remove create_instance_and_ip.py
2017-05-04Merge "refstack-client userguide"Morgan Richomme1-1/+8
2017-05-04Extended the timeout for Operahelenyao1-6/+6
Change-Id: Ifeb4aecf66d75c9bb98d5dafdbe20be78423565e Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-03Remove openstack directoryjose.lausuch5-35/+0
It is useles right now and won't be used in the future. Change-Id: I9aa121544051f49f7e7e794ae3b2c4a9ea516e47 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-03Update tempest.conf to enable tempest from external serverLinda Wang1-1/+8
1. The endpoint type to use for OpenStack Identity API v3 "v3_endpoint_type" is set to be "adminURL" by default, which should be updated to the env OS_ENDPOINT_TYPE with the value "publicURL" 2. Reset the identity region name to "RegionOne" 3. For keystone api v3 in Newton, 5 testcases aimming at identity admin v2 test should be omitted. JIRA: FUNCTEST-801 Change-Id: I47ae41a80de0a52d32d25c9783860955f465099c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-03Merge "Updated basic attributes for opera testcase"Jose Lausuch1-3/+3
2017-05-03refstack-client userguideMatthewLi1-1/+8
JIRA: FUNCTEST-758 container setup steps are skipped, since they already included in the functest userguide documents. Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-03Updated basic attributes for opera testcasehelenyao1-3/+3
The original value as unknown is not reasonable. Change-Id: I23672ea70fff9b3badb2d2cf4f32dc3e038d7bb3 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-02Merge "Remove missing statements in test_odl"Jose Lausuch1-25/+19
2017-05-02Merge "Fix pylint warnings in snaps"Jose Lausuch3-9/+9
2017-05-02Remove create_instance_and_ip.pyjose.lausuch1-128/+0
JIRA: FUNCTEST-817 Change-Id: Ib297ec656a19c9ea4e06c6f2e133ed514a1dbf35 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-02Merge "rename tempest.conf to refstack_tempest.conf"Jose Lausuch2-3/+3
2017-05-02Add the choice of interface for keystoneclientLinda Wang3-38/+40
1. When functest is running on external host not jumpserver, keystoneclient is used to retrieve or create projects/tenants and users, which would fail to establish connection to the admin endpoint. 2. Keystoneclient will connect to the public endpoint by setting the env OS_INTERFACE to be public. 3. Remove the admin endpoint check in check_os.sh. JIRA: FUNCTEST-801 Change-Id: I324f5c8fdf61447319070a23f6b6bc6b1bbc1d48 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-30Remove missing statements in test_odlCédric Ollivier1-25/+19
It mainly removes _fake_url_for() which is useless since get_endpoint() is not called for identity. Coverage for functest/tests/unit/odl/test_odl.py : 100% Change-Id: I5809c5eac4021c44113e70379621ab311187c669 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-30Fix pylint warnings in snapsCédric Ollivier3-9/+9
Pylint only warns about missing module docstrings now. Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-27Update rally_conf.json for creating deploymentLinda Wang1-2/+10
1. The rally_conf.json is obtained via def get_credentials_for_rally(), where the parameter endpoint_type is supposed to get from the env OS_ENDPOINT_TYPE or OS_INTERFACE, just as the def get_creds_from_env_vars() in rally project [1]. [1] https://github.com/openstack/rally/blob/master/rally/cli/envutils.py JIRA: FUNCTEST-801 Change-Id: I6b6be82b9ff7f04948b47c4fca836d415fe13f8b Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-27Fix the instance initialization error for OnosSfchelenyao1-29/+37
Change-Id: I1820bed1bbb7dbddd3923ea6439f58592595f5c8 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-04-26Logger must be a singletonCédric Ollivier1-0/+7
It avoids creating a python object for every message printed. Change-Id: Ia42b59db9f7ce4eadc7e91da4d193db646b54d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Fix false positives in test_tempestCédric Ollivier1-92/+74
It fixes the return values and the side effects expected from the next methods: - configure_tempest - create_tempest_resources - generate_test_list - apply_tempest_blacklist - run_verifier_tests - parse_verifier_result JIRA: FUNCTEST-803 Change-Id: Ib7dbd28e003cf0f27f497ad8e63cf7ae5ce564de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Catch os.makedirs() exceptions in tempest.pyCédric Ollivier1-4/+2
It can raise an error exception if the leaf directory already exists or cannot be created [1]. [1] https://docs.python.org/2/library/os.html JIRA: FUNCTEST-804 Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Manage criteria in TestCaseCédric Ollivier9-74/+127
It converts all criteria values to the corresponding percent in functest/ci/testcases.yaml. Result is expected to be equal or greater than criteria. If both are 0, result is considered as false. It is compatible with the old behavior but warns to update. It will allow a safer remove. It also fixes a bug in test_tempest to allow merging [1] and tier_handler.py which required that type criteria was str. [1] https://gerrit.opnfv.org/gerrit/#/c/27949/ Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier22-63/+64
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Merge "Remove the useless opnfv_tests dir in tests"Cedric Ollivier15-0/+0
2017-04-24Remove the useless opnfv_tests dir in testsCédric Ollivier15-0/+0
Change-Id: I41a8db181adf6c0c67b9de8380c3ccdd1ad3b529 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-24Remove useless lines of code in barometer.pyCédric Ollivier1-3/+0
Change-Id: Ie312dbd296a85a35096294331c28a45f8dc10d0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-22rename tempest.conf to refstack_tempest.confMatthewLi2-3/+3
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-21Switch testcase to test case in docstringsCédric Ollivier2-5/+5
Change-Id: Iea64673788a3d5ab5eb3028522f659de183440ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Merge "Minor changes in docstrings"Serena Feng2-16/+19
2017-04-21Merge "Remove exec right for ci config files"Cedric Ollivier3-0/+0
2017-04-21Merge "Fix pylint warnings in decorators.py"Cedric Ollivier1-8/+12
2017-04-21Merge "Stop hardcoding results suffix in push_to_db"Cedric Ollivier3-6/+7
2017-04-20[VNF_base] Support existing tenant and userboucherv2-62/+63
Support existing tenant and user with a get_or_create_tenant method. If the tenant and user already exist it only get the id of those JIRA: FUNCTEST-799 Change-Id: Id5daf2904592e42199471bdd3547e861e6db6e32 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-04-20Remove exec right for ci config filesCédric Ollivier3-0/+0
Change-Id: Ibf7e549252234fb69dd6e0cc7920b66759469aea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>