aboutsummaryrefslogtreecommitdiffstats
path: root/functest/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-05-09Rename vnf_base to vnfCédric Ollivier1-3/+3
Change-Id: I0b8b9b2e85717fc92a233e4f7344b3419421778d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-06Merge "Rename TestCase check_result() to is_successful()"Cedric Ollivier1-8/+8
2017-05-05Merge "Print the real testcase duration"Jose Lausuch1-1/+28
2017-05-05Rename TestCase check_result() to is_successful()Cédric Ollivier1-8/+8
Change-Id: I41cea33b4c1dae79e75231e7c7e069fc89736f34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Print the real testcase durationCédric Ollivier1-1/+28
TestCase offers a new public method to calculate and print the duration. It also adds the related unit tests and adapts run_tests.py. Change-Id: Ib6a7e637dafacb9027146199aeb033c2dcb986c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Replace CONST.* by getattribute/setattrjose.lausuch3-54/+62
Directories affected: - ci - core and respective unit tests Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-05Merge "Check open args in test_odl"Jose Lausuch1-3/+9
2017-05-05Replace project_name by case_name in result file nameCédric Ollivier1-1/+1
It avoids erasing functest.log when project_name = functest. Change-Id: Icae898abb8b51c89b79bb1124adfadab8b0b3b99 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Check open args in test_odlCédric Ollivier1-3/+9
Change-Id: I4b0060502621c7491820b9aa42d8f2f63b06a9ae Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch1-48/+0
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier1-48/+0
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Merge "Add the choice of interface for keystoneclient"Jose Lausuch1-13/+37
2017-05-02Add the choice of interface for keystoneclientLinda Wang1-13/+37
1. When functest is running on external host not jumpserver, keystoneclient is used to retrieve or create projects/tenants and users, which would fail to establish connection to the admin endpoint. 2. Keystoneclient will connect to the public endpoint by setting the env OS_INTERFACE to be public. 3. Remove the admin endpoint check in check_os.sh. JIRA: FUNCTEST-801 Change-Id: I324f5c8fdf61447319070a23f6b6bc6b1bbc1d48 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-30Remove missing statements in test_odlCédric Ollivier1-25/+19
It mainly removes _fake_url_for() which is useless since get_endpoint() is not called for identity. Coverage for functest/tests/unit/odl/test_odl.py : 100% Change-Id: I5809c5eac4021c44113e70379621ab311187c669 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Fix false positives in test_tempestCédric Ollivier1-92/+74
It fixes the return values and the side effects expected from the next methods: - configure_tempest - create_tempest_resources - generate_test_list - apply_tempest_blacklist - run_verifier_tests - parse_verifier_result JIRA: FUNCTEST-803 Change-Id: Ib7dbd28e003cf0f27f497ad8e63cf7ae5ce564de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Manage criteria in TestCaseCédric Ollivier4-17/+67
It converts all criteria values to the corresponding percent in functest/ci/testcases.yaml. Result is expected to be equal or greater than criteria. If both are 0, result is considered as false. It is compatible with the old behavior but warns to update. It will allow a safer remove. It also fixes a bug in test_tempest to allow merging [1] and tier_handler.py which required that type criteria was str. [1] https://gerrit.opnfv.org/gerrit/#/c/27949/ Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier5-22/+23
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-24Remove the useless opnfv_tests dir in testsCédric Ollivier15-0/+0
Change-Id: I41a8db181adf6c0c67b9de8380c3ccdd1ad3b529 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-14Remove deprecated feature modulesCédric Ollivier10-371/+19
All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-12Refactor the Feature frameworkCédric Ollivier11-136/+83
run() returns the expected status code (see following JIRA tickets). repo, pre() and post() are removed as they were quite useless. A dedicated class is proposed for bash programs. Unit tests have been added to fully cover this module. All features have been modified to conform with these modifications. It also removes the decorators which skipped several unit tests. JIRA: FUNCTEST-778 JIRA: FUNCTEST-779 JIRA: FUNCTEST-780 JIRA: FUNCTEST-781 Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier14-36/+78
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Rename test_ims_base.by to test_ims_base.pyCédric Ollivier1-3/+3
It fixes errors when importing modules too. It completes the review "Added test case for opera vims" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/30681 Change-Id: Ib3cf9c66eb9a2c25ff4fb58d48e4b15a44556f7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Add unit tests for parserCédric Ollivier3-0/+38
It also fixes the corresponding case name in testcases.yaml. Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-05Add case_name as args in all featuresCédric Ollivier9-9/+10
Now run_tests.py forces case_name as arg of every TestCase or Feature. It also updates the related unit tests. Change-Id: I4d70005b53730f36785f0ac95f4f0f6a04455794 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for featureCédric Ollivier1-0/+108
They partially cover feature but already highlight bugs. Several tests are skipped to allow merging. Their decorators could be removed as soon as feature is fixed. I think bad-continuation is false positive so it's disabled (pep8 and flake8 return ok). JIRA: FUNCTEST-779 Change-Id: I89b9e2ec0388eea2471d941b2c653deca7fbddf6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for security_scanCédric Ollivier1-0/+42
Change-Id: Idda799c01408aa9afd09d573e23f42e011f3fafb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for sdnvpnCédric Ollivier1-0/+39
Change-Id: Ie4ebc4e2bc6f2e66f5f567f45f44c073cd9d313d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for promiseCédric Ollivier1-0/+39
Change-Id: I538fcedbfbef46ae36b8eff5a20acaa28a8bfb85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for odl_sfcCédric Ollivier1-0/+39
Change-Id: I8eb037a8c2427695d42207897064b79cb2b03a5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for netreadyCédric Ollivier1-0/+39
Change-Id: I45f9209c55bd65c9538fc3b1181ccbcfbdd23a40 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for dominoCédric Ollivier1-0/+38
Change-Id: Ie6671080a3d38a17da0ee608a362605a6d9df9db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for doctorCédric Ollivier1-0/+38
Change-Id: Iba3c63592623623507e009b0b9f514792c82d25e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for copperCédric Ollivier1-0/+38
Change-Id: Ia4e53e2aee5b93071b3acd3d75c7e42841321a0a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for barometerCédric Ollivier2-0/+54
2 tests are skipped to allow merging [1] [1] https://jira.opnfv.org/browse/FUNCTEST-777 Change-Id: Ida376a03266489e252f7ef8de1ff40f1474c500a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Merge "Add case_name as constructor arg"valentin boucher2-7/+11
2017-04-04Add case_name as constructor argCédric Ollivier2-7/+11
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-30Merge "Check a rule existence for a specific security group"Jose Lausuch1-0/+55
2017-03-30Check a rule existence for a specific security grouptomsou1-0/+55
Implement a functionality to check if a rule concerning a specific security group exists - function get_security_group_rules(neutron_client, sg_id) returns the list of the security rules for a specific security group - function check_security_group_rules(neutron_client, sg_id, direction, protocol, port_min=None, port_max=None) checks if a specific rule for a specific security group exists and returns True or False - implement unit tests for the two new functions This new functionality is needed for sdnvpn project Change-Id: Ib930bc9a76141932f4164d88e2640b49f3df4d77 Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-03-30Merge "More Unit Tests for utils module"Morgan Richomme2-10/+130
2017-03-30Merge "More Unit Tests for ci directory"Morgan Richomme3-5/+199
2017-03-30Merge "More Unit Tests for tempest and IMS module"Morgan Richomme4-4/+358
2017-03-29More Unit Tests for tempest and IMS moduleashishk19944-4/+358
This patch adds more unit tests for openstack/tempest/ and ims/ modules with coverage >= 80% Change-Id: I7c18cea791ac8dc3e890da98066179225283b068 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-29Added test case for opera vimshelenyao2-83/+93
1. Created a ImsOnBoardingBase to wrap up all common ims operations 2. Created test case to test opera vims onboarding Change-Id: Idf3a82e10661271ad413f4dd5795c80ca4421d73 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-28Fully fix pylint warnings in test_testcaseCédric Ollivier1-0/+7
It partially takes into account missing-docstring. It is disabled for public methods as they are unit tests. It has been rated at 10.00/10. Change-Id: I70e6729b9228d58cc67a18da29b925dad22cf5bd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-28Rename test_testcase_base to test_testcaseCédric Ollivier1-0/+0
It follows "Rename testcase_base to testcase" [1] [1] https://gerrit.opnfv.org/gerrit/#/c/31879/ Change-Id: I54bb62a37bdab842f433790688128a459b0ac78c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-28Fix pylint warnings in test_odlCédric Ollivier1-155/+216
It takes into account the following warnings: - wrong-import-order - bad-continuation - unused-argument - invalid-name - too-many-arguments missing-docstring is partially disabled as they are unit tests. It has been rated at 10.00/10. Change-Id: I35886ec75a9e66817cfd0fe18534f157d7500a2b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-28More Unit Tests for utils moduleashishk19942-10/+130
This patch adds some more unit tests for utils/openstack_tacker file and also adds unit tests for utils/functest_logger file Change-Id: I1a4c91eff87aebc3614ef01c3b5de0d2e6716afa Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-27More Unit Tests for ci directoryashishk19943-5/+199
This patch adds more unit tests for ci/prepare_env, ci/run_tests and ci/tier_handler to reach the coverage more than 80% Change-Id: Ia3b7105542105bf8c5e3db58c898ba0569190a80 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-27Rename testcase_base to testcaseCédric Ollivier5-60/+60
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27Switch TestcaseBase to TestCaseCédric Ollivier5-50/+50
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and removes the useless suffix too. [1] https://gerrit.opnfv.org/gerrit/#/c/25391/ Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>