aboutsummaryrefslogtreecommitdiffstats
path: root/functest/ci
AgeCommit message (Collapse)AuthorFilesLines
2017-05-12Merge "Add Energy recording support"Morgan Richomme2-1/+11
2017-05-09Remove the former results in DB urlCédric Ollivier1-3/+3
It conforms generate_report.py with the previous change [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/33511/ Change-Id: I677ebd416f462a591439fc7b637c02d7964e6173 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-09Add Energy recording supportBenoit HERARD2-1/+11
It adds helpers to send notifications to Energy recording API and related unit tests. It requires a dedicated section in functest config file to set connectivity parameters to Energy recording API. It is using shared API Recording at http://161.105.253.100:8888 Change-Id: Idcb74d1bf7341ccce7cc1c3926f22338ce24f714 Signed-off-by: Benoit HERARD <benoit.herard@orange.com>
2017-05-06Implement TestCase __str__()Cédric Ollivier1-2/+1
It's designed to be called by run_tests.py when printing the results of test cases and when generating the global report. Change-Id: If4a6f023ef2344bbc4f940d07dde4b776dce5d68 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Merge "Print the real testcase duration"Jose Lausuch1-11/+7
2017-05-05Print the real testcase durationCédric Ollivier1-11/+7
TestCase offers a new public method to calculate and print the duration. It also adds the related unit tests and adapts run_tests.py. Change-Id: Ib6a7e637dafacb9027146199aeb033c2dcb986c6 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-05Replace CONST.* by getattribute/setattrjose.lausuch3-94/+110
Directories affected: - ci - core and respective unit tests Change-Id: I6a3d5aa68de29fc5a37ae543a067ff797eba33e6 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-05Merge "Forbid calling generate_report from cmdline"Jose Lausuch1-6/+0
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch6-39/+86
2017-05-04Forbid calling generate_report from cmdlineCédric Ollivier1-6/+0
Change-Id: Ic9ea7507dc5f1f781b57c4573e971a2c8a8ca9ef Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier6-39/+86
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Merge "Add the choice of interface for keystoneclient"Jose Lausuch1-24/+0
2017-05-03Merge "Updated basic attributes for opera testcase"Jose Lausuch1-3/+3
2017-05-03Updated basic attributes for opera testcasehelenyao1-3/+3
The original value as unknown is not reasonable. Change-Id: I23672ea70fff9b3badb2d2cf4f32dc3e038d7bb3 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-02Merge "rename tempest.conf to refstack_tempest.conf"Jose Lausuch1-1/+1
2017-05-02Add the choice of interface for keystoneclientLinda Wang1-24/+0
1. When functest is running on external host not jumpserver, keystoneclient is used to retrieve or create projects/tenants and users, which would fail to establish connection to the admin endpoint. 2. Keystoneclient will connect to the public endpoint by setting the env OS_INTERFACE to be public. 3. Remove the admin endpoint check in check_os.sh. JIRA: FUNCTEST-801 Change-Id: I324f5c8fdf61447319070a23f6b6bc6b1bbc1d48 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-26Manage criteria in TestCaseCédric Ollivier2-34/+34
It converts all criteria values to the corresponding percent in functest/ci/testcases.yaml. Result is expected to be equal or greater than criteria. If both are 0, result is considered as false. It is compatible with the old behavior but warns to update. It will allow a safer remove. It also fixes a bug in test_tempest to allow merging [1] and tier_handler.py which required that type criteria was str. [1] https://gerrit.opnfv.org/gerrit/#/c/27949/ Change-Id: Ib6edcfa3103b7d51b0bdc83119f1cea2a8be9fbc Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier1-1/+1
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-22rename tempest.conf to refstack_tempest.confMatthewLi1-1/+1
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-21Merge "Remove exec right for ci config files"Cedric Ollivier3-0/+0
2017-04-20Remove exec right for ci config filesCédric Ollivier3-0/+0
Change-Id: Ibf7e549252234fb69dd6e0cc7920b66759469aea Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-19Stop hardcoding results suffix in push_to_dbMatthewLi1-3/+3
Adding results in url is useless as it is defined in results section in config_functest.yaml. It allows defining the full name in case of dumping to file (see decorator.py). The commented local file is the value required by dovetail. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> Change-Id: I35ba9b34d99e138292f099934e28585ee8b85604 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-15Merge "Add copper section in testcases.yaml"Jose Lausuch1-0/+17
2017-04-14Merge "Set image and flavor id in tempest config file"Cedric Ollivier1-0/+4
2017-04-14Add copper section in testcases.yamlAimee Ukasick1-0/+17
JIRA: COPPER-34 Change-Id: I7301745718b9c035493c2e5c162e2a4e117982db Signed-off-by: Aimee Ukasick <aimeeu.opensource@gmail.com>
2017-04-14Remove deprecated feature modulesCédric Ollivier1-16/+32
All features running bash programs are now simply defined in testcases.yaml. All deprecated modules and unit tests are removed. Change-Id: I7047b6f7a1e43cb8ed5ba2d569d5dcecae68fb86 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-13Merge "update check_os.sh admin port seds to match public"Cedric Ollivier1-2/+2
2017-04-13update check_os.sh admin port seds to match publicDan Radez1-2/+2
If there's not a / on the end of the admin url then port is not found public already handled this correctly. updating admin to match public JIRA: FUNCTEST-793 Change-Id: I01d654dfe247c6102a90ba7ea3921a9f15991789 Signed-off-by: Dan Radez <dradez@redhat.com>
2017-04-13Set image and flavor id in tempest config fileJuha Kosonen1-0/+4
Kingbird tests require that image and flavor are defined in tempest configuration file. JIRA: FUNCTEST-783 Change-Id: If96ef8e38e3f1a5946b687f1e5c8c0a6c3a90d54 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier3-34/+67
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Write feature case names in testcases.yamlLinda Wang1-5/+5
It replaces some project names by the corresponding case names. Else some feature projects results failed to be pushed to DB. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-792 Change-Id: Id81644406bafb361da46e397a92e60b4da2ec068 Signed-off-by: Linda Wang <wangwulin@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-08Add unit tests for parserCédric Ollivier1-1/+1
It also fixes the corresponding case name in testcases.yaml. Change-Id: I2b93323a18bb192d9ad35823dc48b236cb6841b1 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-07Merge "Enable the deployment info print for compass"Helen Yao1-4/+4
2017-04-05Increase ram for tempest tests (aarch64)Cristina Pauna1-2/+2
The following tests fail on armband because the VM cannot boot. tempest.api.compute.servers.test_server_actions. ServerActionsTestJSON.test_reboot_server_hard tempest.scenario.test_network_basic_ops. TestNetworkBasicOps.test_network_basic_ops tempest.scenario.test_volume_boot_pattern. TestVolumeBootPattern.test_volume_boot_pattern tempest.scenario.test_volume_boot_pattern. TestVolumeBootPatternV2.test_volume_boot_pattern The reason for the failure is that the 128 ram is insufficient for the image to boot. The fix consists in increasing the ram to 256 JIRA: ARMBAND-61 Change-Id: I5be1a44a8038b4952cca100511e8d08b7a37681c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-04-04Merge "Add case_name as constructor arg"valentin boucher1-1/+1
2017-04-04Add case_name as constructor argCédric Ollivier1-1/+1
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-31Enable the deployment info print for compasshelenyao1-4/+4
Change-Id: Ifcd81ac4694df46109a78e522da2e399b166c867 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-31Make tempest cleanup resources after runningLinda Wang1-4/+4
JIRA: FUNCTEST-773 1. When running refstack_defcore, create tenant and user failed due to conflict with those created when runnning tempest_smoke_serial. 2. Clean all resources created for tempest_smoke_serial. Change-Id: Icf8ec95f6db0b2f93bf6c56ec10a6e8ea1a91ab1 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-30Re-enable rally and tempest full for weeklyjose.lausuch1-43/+31
Change-Id: I640531ebcc471adebe780c75627d822cf8fd956d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-29Added test case for opera vimshelenyao2-4/+5
1. Created a ImsOnBoardingBase to wrap up all common ims operations 2. Created test case to test opera vims onboarding Change-Id: Idf3a82e10661271ad413f4dd5795c80ca4421d73 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-03-28Merge "Rename testcase_base to testcase"Cedric Ollivier1-3/+3
2017-03-28Merge "Switch TestcaseBase to TestCase"Cedric Ollivier1-2/+2
2017-03-28Remove vping_ssh from bgpvpn and gluon scenarioNikolas Hermanns1-1/+1
Cause of the bug: https://bugs.opendaylight.org/show_bug.cgi?id=5586 Floating ip is not working at the moment for us. We don't want to remove the vping_ssh test from fuel. the scenarios are called different in fuel and in apex. odl-bgpvpn in apex. odl_l2-bgpvpn in fuel. Change-Id: Iaa2e6cea8a4fdb8635f018427aaf30634fd8d2d5 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-03-27Rename testcase_base to testcaseCédric Ollivier1-3/+3
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27Switch TestcaseBase to TestCaseCédric Ollivier1-2/+2
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and removes the useless suffix too. [1] https://gerrit.opnfv.org/gerrit/#/c/25391/ Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-23Merge "Enable functest offline by installing tempest system wide"Jose Lausuch1-1/+1
2017-03-23Merge "Switch test_db_url to a directory"Morgan Richomme1-0/+2
2017-03-23Merge "Support running on openstack which enabled https"Jose Lausuch1-6/+23
2017-03-22Disable blocking status for odl_netvirtJamo Luhrsen1-1/+1
Change-Id: I4a3f10a82d3109a44f8db237cbd7beda06a361da Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
2017-03-22Switch test_db_url to a directoryxudan1-0/+2
We must now set a dir (e.g. /home/opnfv/db) to dump results. It avoids replacing "results" and prevent from limiting the use of this decorator. All data will be dumped into url/dump.txt As also proposed in FUNCTEST-729, missing directories are created too. The decorator will raise exceptions if dir exists or if target is not a directory. Co-Authored-By: Cédric Ollivier <cedric.ollivier@orange.com> JIRA: FUNCTEST-729 Change-Id: I9650c72493043539f17725f5c328c12639ecc059 Signed-off-by: xudan <xudan16@huawei.com> Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>