aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2017-04-05Merge "refstack client: improvement and fix of TestCase usage"Cedric Ollivier2-13/+11
2017-04-05Bugfix: Add case_name as constructor arg for snaps and rallyLinda Wang5-17/+12
When running healthcheck tier and rally, it complains " __init__() got an unexpected keyword argument 'case_name'" Change-Id: I078094921f08b457b88beabee60eabf40b657411 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-04-04refstack client: improvement and fix of TestCase usageMatthewLi2-13/+11
JIRA: FUNCTEST-772 1, RefstackClientParser should not be a subclass of TestCase 2, tempest_conf.py used for generating reference tempest.conf file not related to functest cmd, use logger is enough Change-Id: If9c37331a5a7687e5704e546efcdea8175b1529c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-04Merge "Add case_name as constructor arg"valentin boucher6-35/+26
2017-04-04Add case_name as constructor argCédric Ollivier6-35/+26
It allows managing multiple TestCase names with only one TestCase module. It is mainly required by odl which implements: - odl, - odl_netvirt, - fds. It also renames case to case_name in Features to conform with TestCases. JIRA: FUNCTEST-762 Change-Id: Ie254f754a0ea3077a8afda1c470528d38c79478f Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-30Merge "Clean up Tempest blacklist"Jose Lausuch1-20/+0
2017-03-30Clean up Tempest blacklistjose.lausuch1-20/+0
This list has been generated in Colorado and there are some scenarios that are deprecated and there is no need to list them here. Change-Id: I62a30b5026ed1df65ebdb7a68a6acf3364469865 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-03-29Disable tempest server reboot test for SDNVPN and GluonGeorg Kunz1-0/+12
Bug report: https://bugs.opendaylight.org/show_bug.cgi?id=5586 As a result, floating IPs are not working in Apex at the moment. Change-Id: I437c10b53dc01810ed757f040d3378c92320274b Signed-off-by: Georg Kunz <georg.kunz@ericsson.com> Signed-off-by: Nikolas Hermanns <nikolas.hermanns@ericsson.com>
2017-03-28refstack: bugfix of name TestCaseMatthewLi2-4/+4
JIRA: FUNCTEST-758 Change-Id: I1b90597c9745faa67afa58e5653f72411a95aa3d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-28refstack client: manually running improvementMatthewLi2-28/+78
JIRA: FUNCTEST-758 1.python tempest_conf.py can generate a reference tempest.conf under /hom/opnfv/.../refstack_client this is based on "rally verify configure-verifier" surely, user can define his/her own tempest.conf by not using this 2.python refstack_client.py -c <tempest_conf_path> --testlist <testlist_file_path> if not given, will use default path, if file not exists, will have error Change-Id: I1ceecbe8fe86fbe0d53b736a0f3b9a9ae01f262f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-27Rename testcase_base to testcaseCédric Ollivier5-34/+34
It simply removes the useless suffix. Change-Id: Ib9a682b57d8f33518359d817a593bb3786577390 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-27Switch TestcaseBase to TestCaseCédric Ollivier5-29/+29
It partially reverts "Rename TestCasesBase into TestcaseBase" [1] and removes the useless suffix too. [1] https://gerrit.opnfv.org/gerrit/#/c/25391/ Change-Id: Iddf2ec8d6c1dafe6e4c6713c2e69969613317471 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-25Merge "Printing the flavor_metadata for SnapsTestRunner"Jose Lausuch1-1/+4
2017-03-25Merge "Change api version"Helen Yao1-2/+2
2017-03-24Printing the flavor_metadata for SnapsTestRunnerrandyl1-1/+4
Need to print what is being tested to debug and verify results. JIRA : FUNCTEST-768 This is needed by the Apex team for the danube release. Change-Id: Ie7400af14f7e54d1deb5b2b5d2fc91eb5b14ca91 Signed-off-by: randyl <r.levensalor@cablelabs.com>
2017-03-24Change api versionDimitri Mazmanov1-2/+2
The api_version had full API url instead of just the version. Change-Id: I78b39ea5d39e1ffab54d2bca41df96aadd47ac86 Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2017-03-24Merge "Clean redundant error logs of refstack_defcore in the console"Jose Lausuch2-15/+16
2017-03-23Merge "Replace domain name from Default to default"Jose Lausuch1-1/+5
2017-03-23Merge "[fuel] Skip test_server_basic_ops tempest test"Jose Lausuch1-0/+16
2017-03-23Clean redundant error logs of refstack_defcore in the consoleLinda Wang2-15/+16
1. Remove the file "refstack-error.log", and all the stderr and stdout will be stored in refstack.log 2. Clean redundant error logs in the console and all the detailed error logs will be found in refstack.log. Change-Id: I7e71567c98dc89c529421eccbf1b497962b07405 Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-23Replace domain name from Default to defaultDimitri Mazmanov1-1/+5
The tests don't pass if the domain name is Default. Instead the domain id 'default' should be used. Change-Id: Ife919f79f007ab3fea3d53744634a92ddb172c23 Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2017-03-22Merge "refstack: bugfix of testcase failure"Jose Lausuch1-1/+1
2017-03-22refstack: bugfix of testcase failureMatthewLi1-1/+1
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-22Merge "Update keys of details dic for refstack_defcore"Morgan Richomme1-3/+3
2017-03-21Change execute bitsCédric Ollivier1-0/+0
It applies the rules proposed by "Improve unix permissions fixes" [1]. [1] https://gerrit.opnfv.org/gerrit/#/c/31171/ Change-Id: If5142befb74165a982f9281e8770289b303d483d Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-03-21Update keys of details dic for refstack_defcoreLinda Wang1-3/+3
Update the keys of details in refstack_defcore ("num_tests", "num_failures", and "failed") to "tests", "failures" and "errors", in order to be consistent with those in tempest. Change-Id: I24f8a23548ffa253621083bbf6eb988306fd6edb Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-15Parse refstack_defcore resultsLinda Wang2-1/+87
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 Parse refstack_defcore results, including: 1. show number of tests passed, skipped and failed 2. record the detailed info about testcases passed, skipped and failed. Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a Signed-off-by: Linda Wang <wangwulin@huawei.com>
2017-03-15[fuel] Skip test_server_basic_ops tempest testMichael Polenchuk1-0/+16
Tempest ssh client is hanging on opendaylight enabled envs (getting deadlock in paramiko recv_exit_status method) while trying to execute a command on a vm. Change-Id: I6660cebc6bc44a5f02e6a1e83ee9a61bae141746 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-03-15Merge "refstack client integration"Morgan Richomme5-57/+512
2017-03-15refstack client integrationMatthewLi5-57/+512
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-14[snaps] Pass flavor metadata to smoke testsMichael Polenchuk1-0/+1
Change-Id: I774d3625d35e3d264d609ba9aa7538a723923bcf Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-03-14[tempest/defcore] Configure volume device nameMichael Polenchuk2-2/+5
Actually attach_detach_volume must be skipped because the device name ain't reliable and that's using a hard-coded device name in config. This test should just get the device info after the attach and use that rather than the hard-coded config option in Tempest that ain't likely to work - the test should have been written more dynamically. However, set volume device name to "vdc" since "vdb" is used for config drive when force_config_drive=True is in action. Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-03-10Merge "Unit tests added for openstack/tempest"Morgan Richomme1-5/+0
2017-03-09Show verification details in tempest logJuha Kosonen1-1/+2
JIRA: FUNCTEST-747 Change-Id: I85f15188315136cc44876914325e3693f7973af8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-09Install kingbird verifier extension for tempestJuha Kosonen2-0/+25
JIRA: FUNCTEST-742 Change-Id: I5de8ed22932250c542751e38eae3185c4a263cd0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-08Aarch64 adaption in functest for snaps smokeCristina Pauna1-0/+7
This commit sends the aarch64 custom config to the snaps integration tests. Since these are the same as the snaps healthcheck, no additional values were added to config_aarch64_patch.yaml Change-Id: I5f2302a3c65d47ec8fca661888268489e2c6ba35 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-08Added support for scenario-based flavor creation.spisarski5-22/+49
As certain scenarios such as, DPDK, FDIO, and OVS use cases require special 'hw:' settings to flavors, SNAPS-OO has just implemented the ability to take in these configuration values to apply to its integration tests. This change checks the scenario and should be configuring the flavor metadata accordingly. Also see SNAPS-38 Used this as an opportunity to refactor the SNAPS test classes as well... JIRA: FUNCTEST-746 Change-Id: I63535776acde088a7461f602966a324b6207592d Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-03-06Aarch64 adaption in functest for snaps healthcheckCristina Pauna1-1/+6
This commit is half of the fix for adapting the snaps healthcheck to run on an aarch64 POD. The fix consists in reading the custom parameters and passing them to the snaps test The snaps part that uses this info is https://gerrit.opnfv.org/gerrit/29853 JIRA: ARMBAND-222 Change-Id: I2027f2ef3afe0caddef781771f2190fc173aff8c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-01Unit tests added for openstack/tempestashishk19941-5/+0
_parse_verification_id method is removed as it is not used anywhere Change-Id: Ia2bc75ffbc2527b04cbe2428e2a3822803bde215 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-01Merge "Re-enable the tests for bgpvpn scenario wich use floating ips"Jose Lausuch1-19/+0
2017-03-01Merge "Update cirros image to latest version"Morgan Richomme2-2/+2
2017-02-28Update cirros image to latest versionMichael Polenchuk2-2/+2
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-25Re-enable the tests for bgpvpn scenario wich use floating ipsjose.lausuch1-19/+0
Change-Id: Ia468b9c9ab9f74a3255aa3647916d1018cef2902 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-25Add custom tempest test.jose.lausuch2-3/+7
Some users need to run a specific list of tempest test cases. This patch allows them to do that by running the command: functest testcase run tempest_custom Change-Id: If8e7726b98c3a71398c7abdf80aea79f10653ebf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Merge "Add Tempest Defcore test case"Jose Lausuch2-80/+215
2017-02-24Add Tempest Defcore test casejose.lausuch2-80/+215
Refstack is the OpenStack project that provides the tooling to run the approved specific tempest test cases (Defcore guidelines) by the Interop working group and by the OpenStack board for OpenStack certification purposes. For more info: https://refstack.openstack.org/ This adds the possibility for a Functest user to run this list of tempest test cases by just issuing the command: functest testcase run tempest_defcore The test will be run on daily loops with the scenario nosdn-nofeature on any installer. Change-Id: I920b2a44cff418116008fdf514425e69dc959412 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-23WIP: Cirros TestVM: Allow config of username/passwordAlexandru Avadanii2-4/+4
With the recent changes in Cirros image default password, we need to support configuring these credentials. JIRA: ARMBAND-218 Change-Id: I5962ec2aeee4ffecefdd8b7e70bdb7ed88457553 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-02-15Fix tempest multisite configJuha Kosonen2-27/+24
Add multisite parameters into tempest config file after the file have been (re)configured by rally verifier. JIRA: FUNCTEST-721 Change-Id: I95fd7e29b5a7d1d9f82e84e383eb23e8fa813d19 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-14Merge "Fix config file name setting"Morgan Richomme1-2/+4
2017-02-14Merge changes from topic 'revert_write_to_file'Jose Lausuch1-1/+1
* changes: Add can_dump_request_to_file decorator Revert "write test results to a local file"