summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-04-18Use Sphinx to create API documentationCédric Ollivier13-0/+693
The packages/modules which are part of Functest framework are parsed. It also generates ODL TestCase API as it's well commented. The content is simply referring to modules. Change-Id: I873ae1535fc05c9d7e426f5fb54f9579eb01e6d1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-17Fix the irc channelCédric Ollivier1-1/+1
Change-Id: Idb446213274b7dfb03b0ee072717a35e03428609 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-17Merge "Add class attribute docstrings in testcase.py"Cedric Ollivier1-0/+7
2017-04-17Merge "Fix typos in vnf_base.py"Cedric Ollivier1-2/+2
2017-04-15Merge "Add copper section in testcases.yaml"Jose Lausuch1-0/+17
2017-04-14Add class attribute docstrings in testcase.pyCédric Ollivier1-0/+7
Change-Id: I91a5c6fb14f7c76a348bb4329d023bab53a3804c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-14Merge "Updated method calls to SNAPS tests."Cedric Ollivier6-28/+28
2017-04-14Fix typos in vnf_base.pyCédric Ollivier1-2/+2
Change-Id: Idf0380930e97e1aa4584ba000f32d742a87d9486 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-14Merge "Set image and flavor id in tempest config file"Cedric Ollivier1-0/+4
2017-04-14Add copper section in testcases.yamlAimee Ukasick1-0/+17
JIRA: COPPER-34 Change-Id: I7301745718b9c035493c2e5c162e2a4e117982db Signed-off-by: Aimee Ukasick <aimeeu.opensource@gmail.com>
2017-04-14Add license in feature.pySerenaFeng1-0/+7
Change-Id: I75f51f216dcbf0db1c563cf381c28efc47241d3c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-04-14Remove deprecated feature modulesCédric Ollivier23-600/+64
All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-13Merge "update check_os.sh admin port seds to match public"Cedric Ollivier1-2/+2
2017-04-13update check_os.sh admin port seds to match publicDan Radez1-2/+2
If there's not a / on the end of the admin url then port is not found public already handled this correctly. updating admin to match public JIRA: FUNCTEST-793 Change-Id: I01d654dfe247c6102a90ba7ea3921a9f15991789 Signed-off-by: Dan Radez <dradez@redhat.com>
2017-04-13Set image and flavor id in tempest config fileJuha Kosonen1-0/+4
Kingbird tests require that image and flavor are defined in tempest configuration file. JIRA: FUNCTEST-783 Change-Id: If96ef8e38e3f1a5946b687f1e5c8c0a6c3a90d54 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-04-13Updated method calls to SNAPS tests.spisarski6-28/+28
Due to the refactoring performed in gerrit patch 31435, the calls to the SNAPS tests needed to be updated. JIRA: SNAPS-23 Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-04-12Refactor the Feature frameworkCédric Ollivier22-215/+151
run() returns the expected status code (see following JIRA tickets). repo, pre() and post() are removed as they were quite useless. A dedicated class is proposed for bash programs. Unit tests have been added to fully cover this module. All features have been modified to conform with these modifications. It also removes the decorators which skipped several unit tests. JIRA: FUNCTEST-778 JIRA: FUNCTEST-779 JIRA: FUNCTEST-780 JIRA: FUNCTEST-781 Change-Id: Ifb1e4c4f68260a4e20d895f67f07f369ca959374 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier49-183/+285
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Rename test_ims_base.by to test_ims_base.pyCédric Ollivier1-3/+3
It fixes errors when importing modules too. It completes the review "Added test case for opera vims" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/30681 Change-Id: Ib3cf9c66eb9a2c25ff4fb58d48e4b15a44556f7c Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Write feature case names in testcases.yamlLinda Wang1-5/+5
It replaces some project names by the corresponding case names. Else some feature projects results failed to be pushed to DB. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-792 Change-Id: Id81644406bafb361da46e397a92e60b4da2ec068 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Add unit tests for parserCédric Ollivier6-3/+42
It also fixes the corresponding case name in testcases.yaml. Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-07Bugfixing the testcases execusionNikolas Hermanns1-2/+1
tempest.api.compute.servers.test_server_actions\ .ServerActionsTestJSON.test_reboot_server_hard is working in fuel so do test it. The "-" was missing so tempest.scenario.test_server_basic_ops .TestServerBasicOps.test_server_basic_ops was executed on fuel which is known to be not working since metadata service is not available. That was added already long ago but through the not adding of the "-" it got added again. Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-04-07Merge "Enable the deployment info print for compass"Helen Yao1-4/+4
2017-04-07Merge "Increase ram for tempest tests (aarch64)"Morgan Richomme1-2/+2
2017-04-06Bugfix: Add case_name as constructor arg for snaps_smokeLinda Wang1-3/+2
JIRA: FUNCTEST-791 When running snaps_smoke, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I4a59828ba735ba14a286d000d1d061be14878d1c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-05Increase ram for tempest tests (aarch64)Cristina Pauna1-2/+2
The following tests fail on armband because the VM cannot boot. tempest.api.compute.servers.test_server_actions. ServerActionsTestJSON.test_reboot_server_hard tempest.scenario.test_network_basic_ops. TestNetworkBasicOps.test_network_basic_ops tempest.scenario.test_volume_boot_pattern. TestVolumeBootPattern.test_volume_boot_pattern tempest.scenario.test_volume_boot_pattern. TestVolumeBootPatternV2.test_volume_boot_pattern The reason for the failure is that the 128 ram is insufficient for the image to boot. The fix consists in increasing the ram to 256 JIRA: ARMBAND-61 Change-Id: I5be1a44a8038b4952cca100511e8d08b7a37681c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-04-05Add case_name as args in all featuresCédric Ollivier18-27/+28
Now run_tests.py forces case_name as arg of every TestCase or Feature. It also updates the related unit tests. Change-Id: I4d70005b53730f36785f0ac95f4f0f6a04455794 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-05Merge "refstack client: improvement and fix of TestCase usage"Cedric Ollivier2-13/+11
2017-04-05Merge "Bugfix: Add case_name as constructor arg for snaps and rally"Cedric Ollivier6-19/+14
2017-04-05Bugfix: Add case_name as constructor arg for snaps and rallyLinda Wang6-19/+14
When running healthcheck tier and rally, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I078094921f08b457b88beabee60eabf40b657411 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-04Fix VIM onboarding and ims deploymentMichael Pauls2-12/+52
VIM onboarding: check for API version of OpenStack -> support of v2 and v3 ims deployment: fix userdata in order to wait for EMS registration Change-Id: Id0932232ddb1f1163ef3c37460bc88b71b9c0bdd Signed-off-by: Michael Pauls <michael.pauls@fokus.fraunhofer.de>
2017-04-04refstack client: improvement and fix of TestCase usageMatthewLi2-13/+11
JIRA: FUNCTEST-772 1, RefstackClientParser should not be a subclass of TestCase 2, tempest_conf.py used for generating reference tempest.conf file not related to functest cmd, use logger is enough Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-04Add unit tests for featureCédric Ollivier2-1/+109
They partially cover feature but already highlight bugs. Several tests are skipped to allow merging. Their decorators could be removed as soon as feature is fixed. I think bad-continuation is false positive so it's disabled (pep8 and flake8 return ok). JIRA: FUNCTEST-779 Change-Id: I89b9e2ec0388eea2471d941b2c653deca7fbddf6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for security_scanCédric Ollivier1-0/+42
Change-Id: Idda799c01408aa9afd09d573e23f42e011f3fafb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for sdnvpnCédric Ollivier1-0/+39
Change-Id: Ie4ebc4e2bc6f2e66f5f567f45f44c073cd9d313d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for promiseCédric Ollivier1-0/+39
Change-Id: I538fcedbfbef46ae36b8eff5a20acaa28a8bfb85 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for odl_sfcCédric Ollivier1-0/+39
Change-Id: I8eb037a8c2427695d42207897064b79cb2b03a5d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for netreadyCédric Ollivier1-0/+39
Change-Id: I45f9209c55bd65c9538fc3b1181ccbcfbdd23a40 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for dominoCédric Ollivier1-0/+38
Change-Id: Ie6671080a3d38a17da0ee608a362605a6d9df9db Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for doctorCédric Ollivier1-0/+38
Change-Id: Iba3c63592623623507e009b0b9f514792c82d25e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for copperCédric Ollivier1-0/+38
Change-Id: Ia4e53e2aee5b93071b3acd3d75c7e42841321a0a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Add unit tests for barometerCédric Ollivier3-0/+55
2 tests are skipped to allow merging [1] [1] https://jira.opnfv.org/browse/FUNCTEST-777 Change-Id: Ida376a03266489e252f7ef8de1ff40f1474c500a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Merge "Add case_name as constructor arg"valentin boucher27-77/+64
2017-04-04Add case_name as constructor argCédric Ollivier27-77/+64
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-04Merge "modify old naming testcase_base to testcase"Morgan Richomme1-214/+335
2017-03-31Merge "[Clearwater Test] Fix bug in error message"Morgan Richomme1-2/+1
2017-03-31Backup of reporting status for Danube 1.0Morgan Richomme13-0/+4387
- reporting html pages for apex, compass, fuel and joid - text file with history of Danube scenarios - text file of validated Danube scenarios (100% in functest) Change-Id: If5585acc5bf56406c0c92e8b132157ed742244f1 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-03-31[Clearwater Test] Fix bug in error messageboucherv1-2/+1
Change-Id: I5d1a3f44915821fcf778c4bcecb32d2aaf475262 Signed-off-by: boucherv <valentin.boucher@orange.com>
2017-03-31Enable the deployment info print for compasshelenyao1-4/+4
Change-Id: Ifcd81ac4694df46109a78e522da2e399b166c867 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-31Merge "Adding label for userguide"Jose Lausuch1-0/+2