aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2017-06-06Merge "Remove call to fetch_os_creds.sh"Jose Lausuch1-34/+10
2017-06-06Merge "Make tempest user_password more complicated"Jose Lausuch1-1/+1
2017-06-06Remove call to fetch_os_creds.shjose.lausuch1-34/+10
After [1], the openstack credentials are provided to Functest as a volume directly from CI. The same has to be done manually. Functest doesn't need the script fetch_os_creds.sh any longer. [1] https://gerrit.opnfv.org/gerrit/#/c/35199/ Change-Id: I0883ad7b248526cfe9df3fde984345bd41869e82 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-06-06Merge "Enable tempest offline by use_custom_images=True"valentin boucher3-4/+4
2017-06-02Make tempest user_password more complicatedLinda Wang1-1/+1
For some SUTs, the password for creating user is required to contain at least 8 characters and three types of characters for security. Change-Id: Iea770397fc6781d24fbfd0798e2da6bd65293866 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-06-01Use CONST to retrieve db_url rather than getter functionLinda Wang1-3/+14
1. Remove get_db_url() 2. If TEST_DB_URL declared in env, update test_db_url in config_functest.yaml file during env preparation 3. No matter TEST_DB_URL declared in env or not, Result_DB = CONST.__getattribute__("results_test_db_url") JIRA: FUNCTEST-763 Change-Id: I20da7ef98bbcc56731e0ff7061b05c1dde6cbfc3 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-31Enable tempest offline by use_custom_images=TrueLinda Wang3-4/+4
1. The image cirros or testvm is required for tempest.conf to run tempest testcases. 2. If no images are created in openstack, which just match the img_name_regex (default="^.*(cirros|testvm).*$"), it is needed to download cirros image online. Change-Id: Ib5a38a0135b3dd80ad685e33ed35b7b6135b9c87 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-30Merge "Define create_snapshot() and clean() in TestCase"Cedric Ollivier4-66/+23
2017-05-30Define create_snapshot() and clean() in TestCaseCédric Ollivier4-66/+23
They replace the former calls in run_tests which are not suitable for all test cases. Now any test case can define how to clean its resources. If the snapshot cannot be created, the test case is considered as failed. Only a message is printed if any failure during cleaning. It also defines a new class called OSGCTestCase useful for test cases which don't clean their OpenStack resources. All test cases located in opnfv_tests/openstack inherit from it to keep the global behavior unchanged. It also deletes exit instructions in openstack_clean and openstack_snapshot, removes clean flags in testcases.yaml and updates the related utils. All Docs are modified as well. JIRA: FUNCTEST-438 Change-Id: I8938e6255708012380389763a24059ace4ce45d8 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-30Merge "Chmod 755 functest/ci/download_images.sh"Cedric Ollivier1-0/+0
2017-05-30Merge "Switch shebangs to /usr/bin/env python"Cedric Ollivier1-1/+1
2017-05-29Chmod 755 functest/ci/download_images.shCédric Ollivier1-0/+0
It's designed to be called via Jenkins and was fixed by the next rule: $ find ${FUNCTEST_REPO_DIR} -name "*.sh" \ |xargs grep \#\! |cut -d\: -f 1 |xargs chmod -c 755 Change-Id: I186aa9c3227dbac4e80f9a463632efdb2512020e Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-29Merge "Re-Enable Promise testcases"Morgan Richomme1-1/+0
2017-05-28Switch shebangs to /usr/bin/env pythonCédric Ollivier1-1/+1
It modified the shebang to /usr/bin/env which is considered as more flexible. Change-Id: I9c8cdb4243d41a83d524499cc91060d3700e008b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-23Bugfix: fix two typosLinda Wang1-1/+1
1. In run_tests.py, test case name is shown before running: logger.error(kwargs['test']) -> logger.info(kwargs['test']) 2. In tempest.py, Verication -> Verification Change-Id: I117838cdb4b0f920c4cf855645d910e623e06868 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-22Merge "Delete line breaks before binary operator"valentin boucher1-2/+3
2017-05-22Merge "Print stack when catching exceptions in run_tests.py"valentin boucher1-7/+8
2017-05-21Delete line breaks before binary operatorCédric Ollivier1-2/+3
They are considered as warnings by flake8. Change-Id: I84ffedc41c24133aa0d45e312bb095526aa1095b Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-19Activating SDNVPN test cases for master.Tim Irnich1-1/+0
Change-Id: I4ba995d412bfeadc708d5a3c643576097867d1ac Signed-off-by: Tim Irnich <tim.irnich@ericsson.com>
2017-05-19Re-Enable Promise testcasesGerald Kunzmann1-1/+0
Change-Id: I438c8f5ad9a517a19b675205964a427e8b57ac44 Signed-off-by: Gerald Kunzmann <kunzmann@docomolab-euro.com>
2017-05-19Merge "Define Runner class"Jose Lausuch1-202/+202
2017-05-19Merge "Move few local ODL SFC confs to global functest confs"Morgan Richomme2-0/+14
2017-05-19Print stack when catching exceptions in run_tests.pyCédric Ollivier1-7/+8
Change-Id: Id94475dd519ce04b87da470f6e6bb5a1c1aa2d75 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-18Add a new directory to hold pre-downloaded imageshelenyao3-2/+41
Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-16Converted vPing to leverage the object-oriented SNAPS library.spisarski1-6/+25
JIRA: FUNCTEST-577 1. Replaced procedural openstack_utils with the object-oriented SNAPS library 2. Tests now clean themselves up. 3. Improved code documentation. 4. Removed dependency on file-based Cirros image and now leveraging the download URL. 5. Removed hardcoded location to the testcases.yaml file to leverage the value in config_functest.yaml 6. Included optional flavor metadata based on the scenario being tested 7. Included support for multi-part images. 8. Added enhanced support for configurable images. see SNAPS-76 Fixed line length verification problem with the previous submission Fixed retrieval of external network name to be dynamic. Changed external network name retrieval to leverage the newly merged snap_util.get_ext_net_name() function Added the creation and deletion of flavors. SNAPS now has the ability to add/remove security groups from running instances. Changed VMInstance constructor by moving userdata to configuration object. Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-16Define Runner classCédric Ollivier1-202/+202
It simply converts run_tests.py's functions to Runner's methods. This proposal could be enhanced in a second step to fully leverage on object programming. It defines as instance variables the former static variables to allow multiple runs (it's mandatory for unit testing). All false positives in unit tests are fixed but run_tests.py is still not fully covered. Change-Id: I8f91c132aa8b2248041f31e46238dd5598344d34 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Add enabled flag in testcases.yamljose.lausuch4-17/+59
This will allow enable/disable test cases directly using true/false. Change-Id: Iaa7d051ebb8dd9e5a6f835a823f58f1e17a87b8d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-16Switch from generate_report to PrettyTableCédric Ollivier2-175/+24
run_tests.py now relies on PrettyTable as most of the openstack clients. generate_report.py and its related unit tests are simply removed. It sets padding_width=5 in testcase.py too to conform with run_tests.py. Now report is printed in every case. Change-Id: Id9ce93f984503f25d6a2150482f397853fa3dd64 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-16Fix how to get tier_nameCédric Ollivier2-1/+7
The tier name was incorrect when passing a test case as run_test.py arg. Change-Id: I6f439fc7b90facb3f0553798bd1fe06ac9f09475 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-12Merge "Add Energy recording support"Morgan Richomme2-1/+11
2017-05-09Remove the former results in DB urlCédric Ollivier1-3/+3
It conforms generate_report.py with the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/33511/ Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Add Energy recording supportBenoit HERARD2-1/+11
It adds helpers to send notifications to Energy recording API and related unit tests. It requires a dedicated section in functest config file to set connectivity parameters to Energy recording API. It is using shared API Recording at http://161.105.253.100:8888 Change-Id: Idcb74d1bf7341ccce7cc1c3926f22338ce24f714 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-05-06Implement TestCase __str__()Cédric Ollivier1-2/+1
It's designed to be called by run_tests.py when printing the results of test cases and when generating the global report. Change-Id: If4a6f023ef2344bbc4f940d07dde4b776dce5d68 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Merge "Print the real testcase duration"Jose Lausuch1-11/+7
2017-05-05Print the real testcase durationCédric Ollivier1-11/+7
TestCase offers a new public method to calculate and print the duration. It also adds the related unit tests and adapts run_tests.py. Change-Id: Ib6a7e637dafacb9027146199aeb033c2dcb986c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Replace CONST.* by getattribute/setattrjose.lausuch3-94/+110
Directories affected: - ci - core and respective unit tests Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-05Merge "Forbid calling generate_report from cmdline"Jose Lausuch1-6/+0
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch6-39/+86
2017-05-04Forbid calling generate_report from cmdlineCédric Ollivier1-6/+0
Change-Id: Ic9ea7507dc5f1f781b57c4573e971a2c8a8ca9ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier6-39/+86
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Merge "Add the choice of interface for keystoneclient"Jose Lausuch1-24/+0
2017-05-04Move few local ODL SFC confs to global functest confsVijayendra Radhakrishna2-0/+14
- Currently ODL SFC maitains image url, name, format in its local config.yaml - This makes it complicated to override some of the params for other architecture - like aarch64. This should help overriding some params during functest env prepare - based on arch Change-Id: I81a62566634e0bd87a53f5d0431492468a5f478c Signed-off-by: Vijayendra Radhakrishna <vradhakrishna@mvista.com>
2017-05-03Merge "Updated basic attributes for opera testcase"Jose Lausuch1-3/+3
2017-05-03Updated basic attributes for opera testcasehelenyao1-3/+3
The original value as unknown is not reasonable. Change-Id: I23672ea70fff9b3badb2d2cf4f32dc3e038d7bb3 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-02Merge "rename tempest.conf to refstack_tempest.conf"Jose Lausuch1-1/+1
2017-05-02Add the choice of interface for keystoneclientLinda Wang1-24/+0
1. When functest is running on external host not jumpserver, keystoneclient is used to retrieve or create projects/tenants and users, which would fail to establish connection to the admin endpoint. 2. Keystoneclient will connect to the public endpoint by setting the env OS_INTERFACE to be public. 3. Remove the admin endpoint check in check_os.sh. JIRA: FUNCTEST-801 Change-Id: I324f5c8fdf61447319070a23f6b6bc6b1bbc1d48 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-26Manage criteria in TestCaseCédric Ollivier2-34/+34
It converts all criteria values to the corresponding percent in functest/ci/testcases.yaml. Result is expected to be equal or greater than criteria. If both are 0, result is considered as false. It is compatible with the old behavior but warns to update. It will allow a safer remove. It also fixes a bug in test_tempest to allow merging [1] and tier_handler.py which required that type criteria was str. [1] https://gerrit.opnfv.org/gerrit/#/c/27949/ Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier1-1/+1
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-22rename tempest.conf to refstack_tempest.confMatthewLi1-1/+1
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-21Merge "Remove exec right for ci config files"Cedric Ollivier3-0/+0