summaryrefslogtreecommitdiffstats
path: root/docs/submodules/functest
AgeCommit message (Collapse)AuthorFilesLines
2017-05-03Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Update INFO file for Euphrates" - Update INFO file for Euphrates Change-Id: Iddc36c0c9d3ce897c15393479e7ccb2d2a3230c9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-03Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Updated basic attributes for opera testcase" - Updated basic attributes for opera testcase The original value as unknown is not reasonable. Change-Id: I23672ea70fff9b3badb2d2cf4f32dc3e038d7bb3 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-02Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Remove missing statements in test_odl" - Remove missing statements in test_odl It mainly removes _fake_url_for() which is useless since get_endpoint() is not called for identity. Coverage for functest/tests/unit/odl/test_odl.py : 100% Change-Id: I5809c5eac4021c44113e70379621ab311187c669 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-02Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Restrict coverage output to all functest packages" - Restrict coverage output to all functest packages The next packages/modules are not yet covered: - functest/cli/setup.py - functest/core/pytest_suite_runner.py - functest/opnfv_tests/mano - functest/opnfv_tests/openstack/examples - functest/opnfv_tests/openstack/snaps - functest/opnfv_tests/openstack/vping - functest/opnfv_tests/sdn/onos - functest/opnfv_tests/vnf/aaa - functest/opnfv_tests/vnf/ims - functest/opnfv_tests/vnf/router - functest/utils/openstack Change-Id: Id62749796864537615f0ca8b162ce77b6c1a3309 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-02Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fix pylint warnings in snaps" - Fix pylint warnings in snaps Pylint only warns about missing module docstrings now. Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-02Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "rename tempest.conf to refstack_tempest.conf" - rename tempest.conf to refstack_tempest.conf since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-27Update git submoduleshelenyao1-0/+0
* Update docs/submodules/functest from branch 'master' - Fix the instance initialization error for OnosSfc Change-Id: I1820bed1bbb7dbddd3923ea6439f58592595f5c8 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-04-26Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Logger must be a singleton It avoids creating a python object for every message printed. Change-Id: Ia42b59db9f7ce4eadc7e91da4d193db646b54d85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Fix false positives in test_tempest It fixes the return values and the side effects expected from the next methods: - configure_tempest - create_tempest_resources - generate_test_list - apply_tempest_blacklist - run_verifier_tests - parse_verifier_result JIRA: FUNCTEST-803 Change-Id: Ib7dbd28e003cf0f27f497ad8e63cf7ae5ce564de Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Catch os.makedirs() exceptions in tempest.py It can raise an error exception if the leaf directory already exists or cannot be created [1]. [1] https://docs.python.org/2/library/os.html JIRA: FUNCTEST-804 Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Manage criteria in TestCase It converts all criteria values to the corresponding percent in functest/ci/testcases.yaml. Result is expected to be equal or greater than criteria. If both are 0, result is considered as false. It is compatible with the old behavior but warns to update. It will allow a safer remove. It also fixes a bug in test_tempest to allow merging [1] and tier_handler.py which required that type criteria was str. [1] https://gerrit.opnfv.org/gerrit/#/c/27949/ Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Switch TestCase attribute criteria to result It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Remove the useless opnfv_tests dir in tests" - Remove the useless opnfv_tests dir in tests Change-Id: I41a8db181adf6c0c67b9de8380c3ccdd1ad3b529 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-25Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Remove useless lines of code in barometer.py Change-Id: Ie312dbd296a85a35096294331c28a45f8dc10d0c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Switch testcase to test case in docstrings Change-Id: Iea64673788a3d5ab5eb3028522f659de183440ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Update git submodulesSerena Feng1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Minor changes in docstrings" - Minor changes in docstrings It removes case_name from the list of attributes that run() must set because it's now managed by run_tests.py (see __init__()) Change-Id: Id6228880257d0e9fb27483c56aa9985197feb04e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Ignore _build (sphinx output dir)" - Ignore _build (sphinx output dir) Change-Id: I8afb00fb2942d2144968896981532324ac8e322d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Remove exec right for ci config files" - Remove exec right for ci config files Change-Id: Ibf7e549252234fb69dd6e0cc7920b66759469aea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fix pylint warnings in decorators.py" - Fix pylint warnings in decorators.py Change-Id: Ie6c53feb97053248c909d641753b44b5f51c8719 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Stop hardcoding results suffix in push_to_db" - Stop hardcoding results suffix in push_to_db Adding results in url is useless as it is defined in results section in config_functest.yaml. It allows defining the full name in case of dumping to file (see decorator.py). The commented local file is the value required by dovetail. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I35ba9b34d99e138292f099934e28585ee8b85604 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-21Update git submodulesboucherv1-0/+0
* Update docs/submodules/functest from branch 'master' - [VNF_base] Support existing tenant and user Support existing tenant and user with a get_or_create_tenant method. If the tenant and user already exist it only get the id of those JIRA: FUNCTEST-799 Change-Id: Id5daf2904592e42199471bdd3547e861e6db6e32 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-04-19Update git submodulesLinda Wang1-0/+0
* Update docs/submodules/functest from branch 'master' - Add mock to requirements.txt Package mock is absent for functest, while it is required by decorators.py. Change-Id: I0d042def0335e369c4e22a349e3068829e1d2c59 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-18Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Add docstings in feature.py It also modifies the testcase module docstring. Now features.py is rated 10/10 by pylint. Change-Id: I83f2ac385b2a713d116c1ae4b49ba9cc9b26a83c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-18Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Remove former cmd instance attribute It's now useless as it's passed as run() args. Change-Id: I97e14bd431a8844cd90905bf2050c48fb00f1cc5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-18Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Fix Sphinx warnings/errors It takes into account the following warnings/errors: - Inline strong start-string without end-string - Unexpected indentation Change-Id: Idb05c7b04ba98ef8f3ef65e6ec7c9bb5b7571cad Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-18Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Use Sphinx to create API documentation The packages/modules which are part of Functest framework are parsed. It also generates ODL TestCase API as it's well commented. The content is simply referring to modules. Change-Id: I873ae1535fc05c9d7e426f5fb54f9579eb01e6d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-17Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Fix the irc channel Change-Id: Idb446213274b7dfb03b0ee072717a35e03428609 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-17Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Add class attribute docstrings in testcase.py" - Add class attribute docstrings in testcase.py Change-Id: I91a5c6fb14f7c76a348bb4329d023bab53a3804c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-17Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Fix typos in vnf_base.py" - Fix typos in vnf_base.py Change-Id: Idf0380930e97e1aa4584ba000f32d742a87d9486 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-15Update git submodulesJose Lausuch1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Add copper section in testcases.yaml" - Add copper section in testcases.yaml JIRA: COPPER-34 Change-Id: I7301745718b9c035493c2e5c162e2a4e117982db Signed-off-by: Aimee Ukasick <aimeeu.opensource@gmail.com>
2017-04-14Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Updated method calls to SNAPS tests." - Updated method calls to SNAPS tests. Due to the refactoring performed in gerrit patch 31435, the calls to the SNAPS tests needed to be updated. JIRA: SNAPS-23 Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-04-14Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Set image and flavor id in tempest config file" - Set image and flavor id in tempest config file Kingbird tests require that image and flavor are defined in tempest configuration file. JIRA: FUNCTEST-783 Change-Id: If96ef8e38e3f1a5946b687f1e5c8c0a6c3a90d54 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-04-14Update git submodulesSerenaFeng1-0/+0
* Update docs/submodules/functest from branch 'master' - Add license in feature.py Change-Id: I75f51f216dcbf0db1c563cf381c28efc47241d3c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-04-14Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Remove deprecated feature modules All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-13Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "update check_os.sh admin port seds to match public" - update check_os.sh admin port seds to match public If there's not a / on the end of the admin url then port is not found public already handled this correctly. updating admin to match public JIRA: FUNCTEST-793 Change-Id: I01d654dfe247c6102a90ba7ea3921a9f15991789 Signed-off-by: Dan Radez <dradez@redhat.com>
2017-04-12Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Refactor the Feature framework run() returns the expected status code (see following JIRA tickets). repo, pre() and post() are removed as they were quite useless. A dedicated class is proposed for bash programs. Unit tests have been added to fully cover this module. All features have been modified to conform with these modifications. It also removes the decorators which skipped several unit tests. JIRA: FUNCTEST-778 JIRA: FUNCTEST-779 JIRA: FUNCTEST-780 JIRA: FUNCTEST-781 Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-12Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Modify TestCase constructor attributes Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-12Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Rename test_ims_base.by to test_ims_base.py It fixes errors when importing modules too. It completes the review "Added test case for opera vims" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/30681 Change-Id: Ib3cf9c66eb9a2c25ff4fb58d48e4b15a44556f7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-12Update git submodulesLinda Wang1-0/+0
* Update docs/submodules/functest from branch 'master' - Write feature case names in testcases.yaml It replaces some project names by the corresponding case names. Else some feature projects results failed to be pushed to DB. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-792 Change-Id: Id81644406bafb361da46e397a92e60b4da2ec068 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-12Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Add unit tests for parser It also fixes the corresponding case name in testcases.yaml. Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-07Update git submodulesNikolas Hermanns1-0/+0
* Update docs/submodules/functest from branch 'master' - Bugfixing the testcases execusion tempest.api.compute.servers.test_server_actions\ .ServerActionsTestJSON.test_reboot_server_hard is working in fuel so do test it. The "-" was missing so tempest.scenario.test_server_basic_ops .TestServerBasicOps.test_server_basic_ops was executed on fuel which is known to be not working since metadata service is not available. That was added already long ago but through the not adding of the "-" it got added again. Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-04-07Update git submodulesHelen Yao1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Enable the deployment info print for compass" - Enable the deployment info print for compass Change-Id: Ifcd81ac4694df46109a78e522da2e399b166c867 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-04-07Update git submodulesMorgan Richomme1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Increase ram for tempest tests (aarch64)" - Increase ram for tempest tests (aarch64) The following tests fail on armband because the VM cannot boot. tempest.api.compute.servers.test_server_actions. ServerActionsTestJSON.test_reboot_server_hard tempest.scenario.test_network_basic_ops. TestNetworkBasicOps.test_network_basic_ops tempest.scenario.test_volume_boot_pattern. TestVolumeBootPattern.test_volume_boot_pattern tempest.scenario.test_volume_boot_pattern. TestVolumeBootPatternV2.test_volume_boot_pattern The reason for the failure is that the 128 ram is insufficient for the image to boot. The fix consists in increasing the ram to 256 JIRA: ARMBAND-61 Change-Id: I5be1a44a8038b4952cca100511e8d08b7a37681c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-04-06Update git submodulesLinda Wang1-0/+0
* Update docs/submodules/functest from branch 'master' - Bugfix: Add case_name as constructor arg for snaps_smoke JIRA: FUNCTEST-791 When running snaps_smoke, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I4a59828ba735ba14a286d000d1d061be14878d1c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-05Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Add case_name as args in all features Now run_tests.py forces case_name as arg of every TestCase or Feature. It also updates the related unit tests. Change-Id: I4d70005b53730f36785f0ac95f4f0f6a04455794 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-05Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "refstack client: improvement and fix of TestCase usage" - refstack client: improvement and fix of TestCase usage JIRA: FUNCTEST-772 1, RefstackClientParser should not be a subclass of TestCase 2, tempest_conf.py used for generating reference tempest.conf file not related to functest cmd, use logger is enough Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-05Update git submodulesCedric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Merge "Bugfix: Add case_name as constructor arg for snaps and rally" - Bugfix: Add case_name as constructor arg for snaps and rally When running healthcheck tier and rally, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I078094921f08b457b88beabee60eabf40b657411 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-05Update git submodulesMichael Pauls1-0/+0
* Update docs/submodules/functest from branch 'master' - Fix VIM onboarding and ims deployment VIM onboarding: check for API version of OpenStack -> support of v2 and v3 ims deployment: fix userdata in order to wait for EMS registration Change-Id: Id0932232ddb1f1163ef3c37460bc88b71b9c0bdd Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-04-04Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Add unit tests for feature They partially cover feature but already highlight bugs. Several tests are skipped to allow merging. Their decorators could be removed as soon as feature is fixed. I think bad-continuation is false positive so it's disabled (pep8 and flake8 return ok). JIRA: FUNCTEST-779 Change-Id: I89b9e2ec0388eea2471d941b2c653deca7fbddf6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Update git submodulesCédric Ollivier1-0/+0
* Update docs/submodules/functest from branch 'master' - Add unit tests for security_scan Change-Id: Idda799c01408aa9afd09d573e23f42e011f3fafb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>