summaryrefslogtreecommitdiffstats
path: root/utils
AgeCommit message (Collapse)AuthorFilesLines
2016-11-09Repo structure modificationMorgan Richomme8-2583/+0
- create functest subdirectory - rename unit tests - adapt path in exec and config files JIRA: FUNCTEST-525 Change-Id: Ifd5c6edfb5bda1b09f82848e2269ad5fbeb84d0a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-10-19Merge "Add wrappers for Tacker Python client"Jose Lausuch2-2/+250
2016-10-19Add wrappers for Tacker Python clientGeorge Paraskevopoulos2-2/+250
New module: functest.utils.openstack_tacker Change-Id: Ie02b72d53c824eeff944bc76e4cae58c8de9044a Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-10-18Use importlib to load testcasesCédric Ollivier1-2/+9
It modifies run_tests.py to dynamically execute testcases and then removes the test condition about odl. It also induces that the modules and the related classes must be defined in ci/testcases.yaml. JIRA: FUNCTEST-353 Change-Id: I6ad67b70624aac6bf805c9bde4dfef7c9fbd5c00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-10-18Remove exits in OpenStack client utilsCédric Ollivier1-2/+10
It prevents openstack_utils from exiting when the mandatory env vars are unset. Every testcase is now in charge of handling the exception MissingEnvVar. JIRA: FUNCTEST-438 Change-Id: I0e321b544a470c1f2f2fa62b3e061fe5f938e112 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-10-12Remove exit() in ft_utils.execute_commandCédric Ollivier1-3/+1
It simply removes the exit call in ft_utils.execute_command which is quite safe as every testcase sets exit_on_error to False JIRA: FUNCTEST-438 Change-Id: Ia273de0955cc3ea65a150c626638400ce614da00 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-09-27Move sfc custom flavor creationGeorge Paraskevopoulos1-4/+6
The custom flavor that is needed for the sfc test case is created in the tacker deployment phase. The result of this is that when we use alternative methods of deploying tacker (i.e. the tacker fuel plugin) the test fails. Changes: - Move the flavor creation inside the test case code - Add an optional public parameter in the [get_or_]create_flavor utility functions. Change-Id: Iea13f172076770dde3876b7e27edc9b7ca9b28db Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-09-16Fix formatting errorcristinapauna1-1/+1
This is a fix for https://jira.opnfv.org/browse/FUNCTEST-477 The script terminated due to incomplete formatting Change-Id: I580750e2fe6b1b8957ab017c64d44b9693760860 Signed-off-by: cristinapauna <cristina.pauna@enea.com>
2016-09-15Added support for custom images and flavors in tempestjuraj.linkes1-18/+39
Change-Id: I9335ed1517097e83175a265b603a6707adf476b6 Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2016-09-15fixed updating of hugepage flavorsjuraj.linkes1-1/+1
Change-Id: I5719aef5d5334584337858cf5fee3ef024c0eaac Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2016-09-14Add utils for getting bgpvpn informationRomanos Skiadas1-0/+12
Change-Id: I86f9e2afa6578dc60ea82fd163427a4f6e2f8526 Signed-off-by: Romanos Skiadas <rski@intracom-telecom.com> Co-Authored-By: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-09-13Refactored support for flavor and image hugepages based on Morgan's suggestinsjuraj.linkes1-8/+15
Change-Id: I414338616aecda161a51a780abb24c9e3a8f5c54 Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2016-09-12Added support for creating images and flavors with hugepages for fdio scenariosjuraj.linkes1-0/+10
Change-Id: Idb1cb3a6b71e6de9343a07b14731ae506a44567e Signed-off-by: juraj.linkes <jlinkes@cisco.com>
2016-09-08make use of functest_utils.get_parameter_from_yamlSerenaFeng3-17/+16
JIRA: FUNCTEST-463 Change-Id: I1d54a65c5bfa2542f2fd3a2e408967641e6e4ac9 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-05Merge "solve bidirectional dependencies between ci and utils modules"Morgan Richomme1-15/+14
2016-09-05Merge "Switch print to logging.info"Morgan Richomme1-1/+1
2016-09-05solve bidirectional dependencies between ci and utils modulesSerenaFeng1-15/+14
Ci module's run_tests.py references utils module's functest_utils, and functest_utils references ci module's tier_handler. Form a bidirectional dependencies between two packages. JIRA: FUNCTEST-456 Change-Id: Idbdd4896fb1ec786fcfd656832bfe2d4048a8278 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-02Merge "Add print-to-a-file option when executing a command in functest_utils"jose.lausuch1-4/+11
2016-09-01Fixes cleaning up HA Neutron objectsTim Rozet1-0/+11
This fixes a race condition where the cleanup method is trying to remove HA networks, while Neutron is also trying to remove the network - after the HA router is removed. This only applies to installations where Neutron L3 HA is enabled (nosdn cases only). JIRA: FUNCTEST-454 Change-Id: If06b6f6297e99dcce4b0f2aff8ec80b47488ee90 Signed-off-by: Tim Rozet <trozet@redhat.com>
2016-09-01Add router association utility functionGeorge Paraskevopoulos1-0/+5
Add function to create an association between a router and a bgpvpn Change-Id: I23449a0363f9d8f3c77ea3be1e104586d3c111d1 Signed-off-by: George Paraskevopoulos <geopar@intracom-telecom.com>
2016-09-01Add print-to-a-file option when executing a command in functest_utilsjose.lausuch1-4/+11
Change-Id: I8b91979380d0f4794d5ceaf8edb2a9d80cd7170f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-09-01Fix some bugsboucherv1-1/+1
Change-Id: Iaf0859775933ba09cbbe170af3ce4ed1e6d3e9a1 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-09-01Switch print to logging.infoCédric Ollivier1-1/+1
It follows the recommendations described in the next review [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/19795/ Change-Id: Ie7ce28451122c554f135caad068844c0303deaeb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-09-01stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng2-7/+1
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-01Merge "unify functest_yaml obtain process"Jose Lausuch1-6/+9
2016-08-31unify functest_yaml obtain processSerenaFeng1-6/+9
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-31Remove all logers as utils method args.Cédric Ollivier1-32/+29
As it modifies method params, it could break the testcases. JIRA: FUNCTEST-428 Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-31Use a global logger instead of method argsCédric Ollivier1-74/+44
It's the first step to safely remove all logers as method args. Outputs printed by bash scripts called by execute_command are no longer written in functest.log. Else logs printed by python scripts will be duplicated in it. JIRA: FUNCTEST-428 Change-Id: I60702f3b62121f731cd6845c335e227f97df37c9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-31unify testcases.yaml obtain processSerenaFeng1-1/+5
hardcoded "''FUNCTEST_REPO + "/ci/testcases.yaml"''' appears wherever testcases.yaml is needed, abstract a method to provide unified interface JIRA: FUNCTEST-449 Change-Id: Ida8e3d90926d3e2245883a29f577ecb121bd5d6c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-30Flush stdout as it can be redirected to logCédric Ollivier1-0/+1
It avoids mixed logs in Jenkins' console by flushing every message printed by the forked programs as logger.info() does. It must be complete by refactoring logger management in util functions [1] and by preventing output buffering in forked programs. [1] https://jira.opnfv.org/browse/FUNCTEST-428 JIRA: FUNCTEST-441 Change-Id: Id8da814d79ea6b1e6b91b49e23a85c3802e11515 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-26Set env vars as mandatory to push to DBCédric Ollivier1-5/+24
Now env vars are mandatory in push_results_to_db. It avoids testing programs to check them even if they are useless from their points of view. The related getters aren't removed to help debugging via logger_test_results which could be run without report. Change-Id: Iadb94319529f5ec4230fb62042511948183b93ed Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-26refactor create shared network process to eliminate reduplicateSerenaFeng1-0/+22
Some places shared network is created through create_network_full first, then update it to shared, abstract a uniformed method to eliminate reduplicate JIRA: FUNCTEST-437 Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-26refactor create or get image process to eliminate reduplicateSerenaFeng1-0/+20
Some places when create image is referred, they check if image exist, if exist use it directly, else create a new one. Abstract a method to integrate the process JIRA: FUNCTEST-432 Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23Merge "Avoid duplicating logs in run_tests.py"valentin boucher1-1/+2
2016-08-23Merge "when create/get/update failed return None rather than False"Morgan Richomme1-21/+21
2016-08-23Avoid duplicating logs in run_tests.pyCédric Ollivier1-1/+2
When run_tests.py sets logger as execute_command arg, logs are duplicated in functest.log and not shown in console (as every DEBUG message). As logger is mainly managed by the python scripts in charge of testing, it can be safely removed here. stderr is also redirected to stdout in execute_command to print possible relevant data. JIRA: FUNCTEST-431 Change-Id: Ie77544b4679e12e0a0ac7f5e5989d86862fe106b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-23when create/get/update failed return None rather than FalseSerenaFeng1-21/+21
In openstack_util.py, when create/get/update network or other resources failed, False is returned, which is incompatible with success return value such as id, network_nic. JIRA: FUNCTEST-427 Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23refactor push_result_to_db print thingSerenaFeng1-11/+38
when Exceptions happen, the print code is too difficult to understand and maintain, modify to make it clear jira: FUNCTEST-425 Change-Id: Ie12af989e711df3791167955642f2edf1164b146 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-22bugfix: push_result_to_db exception showSerenaFeng1-0/+5
When pod is not exist in DB, exception will be shown as 'Error pushing results into Database '<type 'exceptions.TypeError'>'', very unclear, make it very difficult to fix the problem. Modify it to show as the testapi returned 'HTTPError: HTTP 404: Not Found (Could not find pod [zte-no])' JIRA: FUNCTEST-424 Change-Id: I55fc4639d745b84f6d32a148bd13793d236e2a09 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-19Fix print when push_results_to_db failsCédric Ollivier1-2/+2
Change-Id: I82741a8727fc17bc6648e1b1e92511b3efd93b8a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-17Check the response status codeCédric Ollivier1-0/+1
Now an HTTPError exception is raised in case of a 4XX or 5XX error response. Change-Id: Idd91c1d2b2a1b81a1cf7d075527cb302099cdb4e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-17Add reporting flag to push reuslts only from CIMorgan Richomme1-3/+12
JIRA: FUNCTEST-416 Change-Id: I1a5800be0dcf75573f44e6214b23917aadc1cbf7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-08-10Create config_functest patch to update the conf with scenarioboucherv1-4/+17
Adding support of LXD scenario JIRA: FUNCTEST-268 Change-Id: I5891ff9de674d99d32d8db747be501ee8a2e6609 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-04Merge "unify test result check for feature project and apply to parser"valentin boucher1-2/+19
2016-08-04unify test result check for feature project and apply to parserSerenaFeng1-2/+19
add check_test_result() method to unify test result process JIRA: FUNCTEST-405 Change-Id: Iee4d2876cbbf372f8c3e3bf94448036669bc7f7e Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-03functest utils - get_resolvconf_ns() Ensure that dns works with dns name ↵boucherv1-5/+9
resolution JIRA: FUNCTEST-402 Change-Id: I5fa9204aafb13330eb810950aa7bc728f1a69162 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-29correct rally criteria checkSerenaFeng1-0/+19
add method check_success_rate() to unify criteria check by success_rate JIRA: FUNCTEST-398 Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-29unify test results logger and apply to parserSerenaFeng1-0/+21
refine a unified method to log the test results and use it to parser. JIRA: FUNCTEST-397 Change-Id: I5ed6b04107be5590b1d9d5683c8f1846fef5a4d4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Add region name to OpenStack credentialsDimitri Mazmanov1-0/+4
Currently functest doesn't account for regions when it tries to instantieate OpenStack clients. As a result, the code fails when functest is used in a multi-region environment. The fix forces functest account for region name. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: Iebbd20042548c02da9d5ed7e58a454347a555778
2016-07-28Add endpoint type support on functestboucherv1-6/+31
By default public endpoint was used but now you can use internal or admin JIRA: FUNCTEST-387 Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9 Signed-off-by: boucherv <valentin.boucher@orange.com>