summaryrefslogtreecommitdiffstats
path: root/functest/tests/unit/ci
AgeCommit message (Collapse)AuthorFilesLines
2018-02-28Rename all Functest refs to XtestingCédric Ollivier4-499/+0
It mainly renames python modules and then the related documentation config files. Change-Id: I186010bb88d3d39afe7b8fd1ebcef9c690cc1282 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-27Clean all OpenStack related modulesCédric Ollivier1-286/+0
Xtesting is only focused on the framework and entry points. Change-Id: I1a4146ed8519438b13810a20ddf1140c35bb6ecd Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-24Print env vars and env_fileCédric Ollivier1-2/+1
It simply eases detecting wrong inputs [1]. [1] https://build.opnfv.org/ci/view/functest/job/functest-apex-baremetal-daily-master/796/console Change-Id: I0784c29265c69a6ba4a049226196bcdd70b0a572 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Read the env file only if existsCédric Ollivier1-1/+2
Change-Id: I8e718e583a5a47a089755c31e623a44732e5ba1e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Unlink run_tests from constantsCédric Ollivier1-7/+5
run_tests.py doesn't read any functest config file what is mandatory for xtesting. Change-Id: I49f672c54a606acead75f573d1ce496c81fb235a Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-09Move get_dict_by_test() into run_tests.pyCédric Ollivier1-4/+17
It also removes functest_utils.get_criteria_by_test() Change-Id: I3f265642acd053755e32f8e92f1086b93517c247 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-08Move source_credentials() into run_tests.pyCédric Ollivier1-5/+34
It's also renamed source_envfile(). Change-Id: I0e7c38c2def125961f86dc2bc9a63cfb6ad87c03 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-02-01Rename a common credential file for OS and K8SLinda Wang1-24/+10
Change-Id: Ib8d24be4b29ab1de00d5dd5e3442146b2437cb94 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-29Fix the connect issue when checking deploymentLinda Wang1-4/+4
Socket.connect() requires only one param with type tuple. Change-Id: I63aa4633e80bde3ad5e1b5af9d67d8f46eb84571 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2018-01-21Partially rewrite test_run_tests.pyCédric Ollivier1-75/+72
It mainly fixes pylint issues and leverages on decorators. It should be noted that run_tests.py is not fully covered (see xtesting requirements). Change-Id: I114b67c3c5bfe61d72d004829af513e2014ad8b8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2018-01-21Fully test and cover functest/ci/tier_*Cédric Ollivier4-226/+305
It also fixes check_deployment.py and ci unit tests which were wrong when testing exceptions. Now ci modules are rated 10/10 and fully covered. Change-Id: I30dca491b44cc54aa1abc0d0433c00b4dcabfdc4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-20Get auth token when checking deploymentLinda Wang1-1/+4
JIRA: FUNCTEST-900 Change-Id: Ie313d273a357a35b176b3918de108d85164776fa Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-14Improve the pylint score of functest-coreLinda Wang4-18/+23
It also modifies the file list to ensure the rating of ci modules. Change-Id: Ia1e414be5364cb3da3d54882db428024ed6bd99f Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-12-12All patching config files in memoryLinda Wang1-50/+0
It adds the yaml content as Config attribute and allow patching it without modifying the file (and reimport constants or config). It also removes obsolete data in config_patch.yaml and moves several functions in the right modules (Config) JIRA: ARMBAND-334 Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I5c9a574d3283828063154c977cdfbc2abfdc6777 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-12-11Add Python3 support in functest/ciCédric Ollivier2-3/+3
Change-Id: If13bfaa196b8dfab1e83feb28c5a4719c7acd8c7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-11-30Stop updating test_db_url in config file by env varLinda Wang1-32/+2
If TEST_DB_URL is declared in env variable, use it before considering the var in config file. Change-Id: I656ad8765287c48d60af7ab88b421805d76fb231 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-22Remove prepare_envJose Lausuch1-0/+80
After moving the rally installation out of prepare_env It doesn't much sense to keep this script as it doesn't do useful things any more. Change-Id: I9ab3b2dd30c8ec0fbb825ee4302a83cce80f1cbe Signed-off-by: Jose Lausuch <jalausuch@suse.com>
2017-11-17Check external networkLinda Wang1-0/+17
Change-Id: I1ff199fcad99aefccb92807c8f416d4f32ec91a6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-15Remove opnfv module from functest-coreLinda Wang1-389/+0
The releng/opnfv git repo is still kept in upper-constraints as it is required by sfc. And also delete the functions of check_env_variables, get_deployment_handler and create_directories. Change-Id: If498e68f0f94d6ebde1be55f5e3a17d06becaea4 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-11-13Move rally and tempest out of functest-coreLinda Wang1-82/+1
JIRA: FUNCTEST-889 Change-Id: I96776da7af50b2c33c34dd731b5500b891d263d6 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-09-18Return Functest status to JenkinsCédric Ollivier1-2/+8
It avoids mixing Functest and Features CI issues by simply exiting the status of Functest testcases. The result of third-party testcases are printed into console but are no longer taken into account into the global status. Change-Id: I040ff54780db2ddb6d81993839fee09f5e472323 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-08-16Clean run_tests.py and the related utCédric Ollivier2-98/+76
It enhances run_tests.py as proposed in [1]. It also prints all skipped tests in summary and fixes copyright headers. All the related unit tests have been updated too. [1] https://jira.opnfv.org/browse/FUNCTEST-832 JIRA: FUNCTEST-832 Change-Id: I59b96422bc7942ecd6270c45ab7a3fb603c13ccb Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-07-12Switch to check_deployment instead of check_os.shjose.lausuch1-14/+10
Change-Id: Idcc67643f813068c3cd06f4c0dfd3289bb7df138 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-07-11New python script to check openstack deploymentjose.lausuch1-0/+176
This is a crucial part of functest env prepare. The former check_os.sh is missing some error control and is sometimes trying to connect to an empty endpoint if the sed/awk commands were wrong. This python script is more robust in that sense. You can see an example of execution in [1]. [1] http://paste.openstack.org/raw/614852/ Change-Id: I622befa13b58d2d31a08d307befb12a2be28fe4d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-06-30Define console_scriptsCédric Ollivier1-3/+3
Only prepare_env.py and run_tests.py remain executable to avoid breaking the gate. As soon as the jenkins jobs are updated to run them from $PATH, tox will be updated to protect against chmod a+x py files. Dockerfile will be simplified as well. Change-Id: Iac1a7ceb6b344e800177226ea39919826f6d3735 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-06-22Remove calls to deployment handler in prepare envjose.lausuch1-6/+2
The reason is that some installers have changed the mechanism and the adapters are not valid any more and the method to access the deployment information fails Fuel -> MCP Compass -> Containers This shall be deactivated to avoid errors in CI until the new installer adapters are implememnted. Change-Id: I995b914bf55d5da76f27e715d170dd22e84d677c Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-06-06Merge "Remove call to fetch_os_creds.sh"Jose Lausuch1-10/+5
2017-06-06Remove call to fetch_os_creds.shjose.lausuch1-10/+5
After [1], the openstack credentials are provided to Functest as a volume directly from CI. The same has to be done manually. Functest doesn't need the script fetch_os_creds.sh any longer. [1] https://gerrit.opnfv.org/gerrit/#/c/35199/ Change-Id: I0883ad7b248526cfe9df3fde984345bd41869e82 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-06-01Use CONST to retrieve db_url rather than getter functionLinda Wang1-3/+20
1. Remove get_db_url() 2. If TEST_DB_URL declared in env, update test_db_url in config_functest.yaml file during env preparation 3. No matter TEST_DB_URL declared in env or not, Result_DB = CONST.__getattribute__("results_test_db_url") JIRA: FUNCTEST-763 Change-Id: I20da7ef98bbcc56731e0ff7061b05c1dde6cbfc3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier3-19/+10
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Merge "Define Runner class"Jose Lausuch1-73/+98
2017-05-19Merge "Modify how to disable logging in unit test."Jose Lausuch4-8/+4
2017-05-18Modify how to disable logging in unit test.Cédric Ollivier4-8/+4
Logs are only disabled when the unit tests are run from cmdline. It allows running them via pytest_suite_runner.py and printing their results to functest.log. You should notice that the unit test must disable the logger of the tested TestCase (e.g. testcase.TestCase.logger.disabled = 1). Otherwise false logs will be printed in console. Change-Id: Ic171e4575c8bab2e52db1897ae026b61a03b6247 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Add a new directory to hold pre-downloaded imageshelenyao1-0/+8
Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-16Define Runner classCédric Ollivier1-73/+98
It simply converts run_tests.py's functions to Runner's methods. This proposal could be enhanced in a second step to fully leverage on object programming. It defines as instance variables the former static variables to allow multiple runs (it's mandatory for unit testing). All false positives in unit tests are fixed but run_tests.py is still not fully covered. Change-Id: I8f91c132aa8b2248041f31e46238dd5598344d34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Add enabled flag in testcases.yamljose.lausuch2-0/+6
This will allow enable/disable test cases directly using true/false. Change-Id: Iaa7d051ebb8dd9e5a6f835a823f58f1e17a87b8d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-16Switch from generate_report to PrettyTableCédric Ollivier2-155/+5
run_tests.py now relies on PrettyTable as most of the openstack clients. generate_report.py and its related unit tests are simply removed. It sets padding_width=5 in testcase.py too to conform with run_tests.py. Now report is printed in every case. Change-Id: Id9ce93f984503f25d6a2150482f397853fa3dd64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Fix how to get tier_nameCédric Ollivier1-0/+7
The tier name was incorrect when passing a test case as run_test.py arg. Change-Id: I6f439fc7b90facb3f0553798bd1fe06ac9f09475 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Remove the former results in DB urlCédric Ollivier1-4/+4
It conforms generate_report.py with the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/33511/ Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Replace CONST.* by getattribute/setattrjose.lausuch3-54/+62
Directories affected: - ci - core and respective unit tests Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier1-1/+1
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27More Unit Tests for ci directoryashishk19943-5/+199
This patch adds more unit tests for ci/prepare_env, ci/run_tests and ci/tier_handler to reach the coverage more than 80% Change-Id: Ia3b7105542105bf8c5e3db58c898ba0569190a80 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-16Merge "Added Unit Tests for ci/generate_report with argument refactoring for ↵Morgan Richomme1-0/+129
main and init functions in generate_reports"
2017-03-16Merge "Added Unit Tests for ci/run_tests"Morgan Richomme1-0/+192
2017-03-16Merge "Added Unit Tests for ci/tier_handler"Morgan Richomme1-0/+128
2017-03-15Added Unit Tests for ci/tier_builderashishk19941-0/+83
Change-Id: I66f43fb09472948bc71178cd8aeb14dc1ab5fa55 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-15Added Unit Tests for ci/tier_handlerashishk19941-0/+128
Change-Id: I0b1d7efcf44c0ad2c1e8d3163fe72a61883eb86a Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-15Added Unit Tests for ci/run_testsashishk19941-0/+192
Change-Id: I5cd900cee809b8fd935a5c8b862a9ecd6278bdf5 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-15Added Unit Tests for ci/generate_report withashishk19941-0/+129
argument refactoring for main and init functions in generate_reports Change-Id: I291d04a9c0ed381f4b92e989270c0b9a37c15264 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-08Bugfix: modify test_prepare_env to make verify job successfulLinda Wang1-3/+5
Functest verify job failed due to that test_prepare_env.py mistook one function of ft_utils.execute_command_raise. Change-Id: Ib3b8ca807308bf5c6d250e7debb4c9e1e106e3d1 Signed-off-by: Linda Wang <wangwulin@huawei.com>