aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2017-05-19Merge "Add a new directory to hold pre-downloaded images"Helen Yao2-2/+2
2017-05-18Remove check_success_ratejose.lausuch3-22/+34
After the introduction of is_successful method in TestCase class, this is not needed anymore. Change-Id: I70f6f9e10495601cd5443467347b97efe27b81a3 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-18Add a new directory to hold pre-downloaded imageshelenyao2-2/+2
Put all images in the new direcotry. If users want to use the local image, map the local directory to the ${HOME}/functest/images Change-Id: I0d309b93f52b3da23d6130056f1a19907313ef68 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-05-17Update self.result value to INTjose.lausuch1-1/+3
So far, the test cases are storing a string "PASS" "FAIL" in the self.result variable. The way the new framework works is with INT Values. Change-Id: I45e8693327740faadd8254b21569adfb2cefa6c8 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-16Converted vPing to leverage the object-oriented SNAPS library.spisarski6-397/+445
JIRA: FUNCTEST-577 1. Replaced procedural openstack_utils with the object-oriented SNAPS library 2. Tests now clean themselves up. 3. Improved code documentation. 4. Removed dependency on file-based Cirros image and now leveraging the download URL. 5. Removed hardcoded location to the testcases.yaml file to leverage the value in config_functest.yaml 6. Included optional flavor metadata based on the scenario being tested 7. Included support for multi-part images. 8. Added enhanced support for configurable images. see SNAPS-76 Fixed line length verification problem with the previous submission Fixed retrieval of external network name to be dynamic. Changed external network name retrieval to leverage the newly merged snap_util.get_ext_net_name() function Added the creation and deletion of flavors. SNAPS now has the ability to add/remove security groups from running instances. Changed VMInstance constructor by moving userdata to configuration object. Change-Id: I0ef5e268eb153d696bb4d9a7533f780e5c603d26 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-05-09Bugfix: initialize the logger for snapsLinda Wang1-0/+3
Testcases about snaps failed due to the absence of attribute 'logger'. Change-Id: I78c85e51f63afa767fa73aa12faea066ad432371 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-05Merge "Delete functest.utils.functest_logger"Jose Lausuch7-14/+18
2017-05-04Delete functest.utils.functest_loggerCédric Ollivier7-14/+18
It deletes functest.utils.functest_logger and the related unit tests. Then it modifies all functest modules to get all loggers via logging.getLogger(). __name__ is mainly used as getLogger arg as proposed by logging [1]. All loggers and handlers are now defined via functest/ci/logging.ini instead of a dict loaded by an external json file. Now only warn messages and info messages from ci and core packages are printed in console. [1] https://docs.python.org/2/library/logging.html Change-Id: Ic192855e0f9bf94825d8f7ec73549a0f3b8d44c5 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-05-04Merge "Update tempest.conf to enable tempest from external server"Jose Lausuch1-1/+8
2017-05-04Merge changes from topic 'remove_openstack_dir'Morgan Richomme1-128/+0
* changes: Remove openstack directory Remove create_instance_and_ip.py
2017-05-04Merge "refstack-client userguide"Morgan Richomme1-1/+8
2017-05-03Update tempest.conf to enable tempest from external serverLinda Wang1-1/+8
1. The endpoint type to use for OpenStack Identity API v3 "v3_endpoint_type" is set to be "adminURL" by default, which should be updated to the env OS_ENDPOINT_TYPE with the value "publicURL" 2. Reset the identity region name to "RegionOne" 3. For keystone api v3 in Newton, 5 testcases aimming at identity admin v2 test should be omitted. JIRA: FUNCTEST-801 Change-Id: I47ae41a80de0a52d32d25c9783860955f465099c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-05-03refstack-client userguideMatthewLi1-1/+8
JIRA: FUNCTEST-758 container setup steps are skipped, since they already included in the functest userguide documents. Change-Id: I729d4c3174b03706624a7235da24cb3043b28c2c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-02Merge "Fix pylint warnings in snaps"Jose Lausuch3-9/+9
2017-05-02Remove create_instance_and_ip.pyjose.lausuch1-128/+0
JIRA: FUNCTEST-817 Change-Id: Ib297ec656a19c9ea4e06c6f2e133ed514a1dbf35 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-05-02Merge "rename tempest.conf to refstack_tempest.conf"Jose Lausuch1-2/+2
2017-04-30Fix pylint warnings in snapsCédric Ollivier3-9/+9
Pylint only warns about missing module docstrings now. Change-Id: I989ff800cd2628fed80a2d3510ef37ce2876cbd4 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Catch os.makedirs() exceptions in tempest.pyCédric Ollivier1-4/+2
It can raise an error exception if the leaf directory already exists or cannot be created [1]. [1] https://docs.python.org/2/library/os.html JIRA: FUNCTEST-804 Change-Id: Ie410bccf1bb2dfd36df6e918c152ecf94844b5d7 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-26Switch TestCase attribute criteria to resultCédric Ollivier4-7/+7
It mainly avoids mixing input and output. Criteria is now an input set in functest/ci/testcases.yaml and then must be passed as __init__() args (which will be proposed in an additional change). Then it also renames the related TestCase method to check_result(). Change-Id: Ifc3c8e3ea6cde7e3edf7174bed4bf2bf0894e8e3 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-22rename tempest.conf to refstack_tempest.confMatthewLi1-2/+2
since for tempest smoke/full, etc, will also use a file named tempest.conf this wil cover the refstack tempest.conf, rename it to refstack_tempest.conf, then easily for users to debug to check if the configure file is correct or not. Change-Id: Ic2f93fb05effb1a61276cb6ba755076a0404caad Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-13Updated method calls to SNAPS tests.spisarski6-28/+28
Due to the refactoring performed in gerrit patch 31435, the calls to the SNAPS tests needed to be updated. JIRA: SNAPS-23 Change-Id: I9069ea61b1d15b52a081501b03ae8bf73da10f29 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-04-11Modify TestCase constructor attributesCédric Ollivier11-38/+68
Every feature/testcase now allows receiving the data defined in testcases.yaml as args (name is renamed to case_name). From the time being, only project and case names are handled. Next pending patches will add criteria, cmd and repo to this list. It keeps the default values for case names except for features which will be aggregated into Feature. Change-Id: Id742d100b8183d7f10894c24ae6879d1b2b60ac9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-04-07Bugfixing the testcases execusionNikolas Hermanns1-2/+1
tempest.api.compute.servers.test_server_actions\ .ServerActionsTestJSON.test_reboot_server_hard is working in fuel so do test it. The "-" was missing so tempest.scenario.test_server_basic_ops .TestServerBasicOps.test_server_basic_ops was executed on fuel which is known to be not working since metadata service is not available. That was added already long ago but through the not adding of the "-" it got added again. Change-Id: I6808ce9283271e2d2f8acf7c2587aed006d1cbc2 Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-04-06Bugfix: Add case_name as constructor arg for snaps_smokeLinda Wang1-3/+2
JIRA: FUNCTEST-791 When running snaps_smoke, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I4a59828ba735ba14a286d000d1d061be14878d1c Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-05Merge "refstack client: improvement and fix of TestCase usage"Cedric Ollivier2-13/+11
2017-04-05Bugfix: Add case_name as constructor arg for snaps and rallyLinda Wang5-17/+12
When running healthcheck tier and rally, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I078094921f08b457b88beabee60eabf40b657411 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-04refstack client: improvement and fix of TestCase usageMatthewLi2-13/+11
JIRA: FUNCTEST-772 1, RefstackClientParser should not be a subclass of TestCase 2, tempest_conf.py used for generating reference tempest.conf file not related to functest cmd, use logger is enough Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-04Merge "Add case_name as constructor arg"valentin boucher6-35/+26
2017-04-04Add case_name as constructor argCédric Ollivier6-35/+26
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-30Merge "Clean up Tempest blacklist"Jose Lausuch1-20/+0
2017-03-30Clean up Tempest blacklistjose.lausuch1-20/+0
This list has been generated in Colorado and there are some scenarios that are deprecated and there is no need to list them here. Change-Id: I62a30b5026ed1df65ebdb7a68a6acf3364469865 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-29Disable tempest server reboot test for SDNVPN and GluonGeorg Kunz1-0/+12
Bug report: https://bugs.opendaylight.org/show_bug.cgi?id=5586 As a result, floating IPs are not working in Apex at the moment. Change-Id: I437c10b53dc01810ed757f040d3378c92320274b Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-03-28refstack: bugfix of name TestCaseMatthewLi2-4/+4
JIRA: FUNCTEST-758 Change-Id: I1b90597c9745faa67afa58e5653f72411a95aa3d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-28refstack client: manually running improvementMatthewLi2-28/+78
JIRA: FUNCTEST-758 1.python tempest_conf.py can generate a reference tempest.conf under /hom/opnfv/.../refstack_client this is based on "rally verify configure-verifier" surely, user can define his/her own tempest.conf by not using this 2.python refstack_client.py -c <tempest_conf_path> --testlist <testlist_file_path> if not given, will use default path, if file not exists, will have error Change-Id: I1ceecbe8fe86fbe0d53b736a0f3b9a9ae01f262f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-27Rename testcase_base to testcaseCédric Ollivier5-34/+34
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27Switch TestcaseBase to TestCaseCédric Ollivier5-29/+29
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and removes the useless suffix too. [1] https://gerrit.opnfv.org/gerrit/#/c/25391/ Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-25Merge "Printing the flavor_metadata for SnapsTestRunner"Jose Lausuch1-1/+4
2017-03-25Merge "Change api version"Helen Yao1-2/+2
2017-03-24Printing the flavor_metadata for SnapsTestRunnerrandyl1-1/+4
Need to print what is being tested to debug and verify results. JIRA : FUNCTEST-768 This is needed by the Apex team for the danube release. Change-Id: Ie7400af14f7e54d1deb5b2b5d2fc91eb5b14ca91 Signed-off-by: randyl <r.levensalor@cablelabs.com>
2017-03-24Change api versionDimitri Mazmanov1-2/+2
The api_version had full API url instead of just the version. Change-Id: I78b39ea5d39e1ffab54d2bca41df96aadd47ac86 Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2017-03-24Merge "Clean redundant error logs of refstack_defcore in the console"Jose Lausuch2-15/+16
2017-03-23Merge "Replace domain name from Default to default"Jose Lausuch1-1/+5
2017-03-23Merge "[fuel] Skip test_server_basic_ops tempest test"Jose Lausuch1-0/+16
2017-03-23Clean redundant error logs of refstack_defcore in the consoleLinda Wang2-15/+16
1. Remove the file "refstack-error.log", and all the stderr and stdout will be stored in refstack.log 2. Clean redundant error logs in the console and all the detailed error logs will be found in refstack.log. Change-Id: I7e71567c98dc89c529421eccbf1b497962b07405 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-23Replace domain name from Default to defaultDimitri Mazmanov1-1/+5
The tests don't pass if the domain name is Default. Instead the domain id 'default' should be used. Change-Id: Ife919f79f007ab3fea3d53744634a92ddb172c23 Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2017-03-22Merge "refstack: bugfix of testcase failure"Jose Lausuch1-1/+1
2017-03-22refstack: bugfix of testcase failureMatthewLi1-1/+1
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-22Merge "Update keys of details dic for refstack_defcore"Morgan Richomme1-3/+3
2017-03-21Change execute bitsCédric Ollivier1-0/+0
It applies the rules proposed by "Improve unix permissions fixes" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/31171/ Change-Id: If5142befb74165a982f9281e8770289b303d483d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-21Update keys of details dic for refstack_defcoreLinda Wang1-3/+3
Update the keys of details in refstack_defcore ("num_tests", "num_failures", and "failed") to "tests", "failures" and "errors", in order to be consistent with those in tempest. Change-Id: I24f8a23548ffa253621083bbf6eb988306fd6edb Signed-off-by: Linda Wang <wangwulin@huawei.com>