summaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2017-03-25Printing the flavor_metadata for SnapsTestRunnerrandyl1-1/+4
Need to print what is being tested to debug and verify results. JIRA : FUNCTEST-768 This is needed by the Apex team for the danube release. Change-Id: Ie7400af14f7e54d1deb5b2b5d2fc91eb5b14ca91 Signed-off-by: randyl <r.levensalor@cablelabs.com> (cherry picked from commit 16cda37220675370bb18ab06079d829fcd9f6050)
2017-03-24Clean redundant error logs of refstack_defcore in the consoleLinda Wang2-15/+16
1. Remove the file "refstack-error.log", and all the stderr and stdout will be stored in refstack.log 2. Clean redundant error logs in the console and all the detailed error logs will be found in refstack.log. Change-Id: I7e71567c98dc89c529421eccbf1b497962b07405 Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 0a07e0f686d9aaaa12b6445e99a67e0a7f7dbbd0)
2017-03-23Replace domain name from Default to defaultDimitri Mazmanov1-1/+5
The tests don't pass if the domain name is Default. Instead the domain id 'default' should be used. Change-Id: Ife919f79f007ab3fea3d53744634a92ddb172c23 Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> (cherry picked from commit d832b215a844cc2e0008eb0a86b689830e0277bb)
2017-03-23[fuel] Skip test_server_basic_ops tempest testMichael Polenchuk1-0/+16
Tempest ssh client is hanging on opendaylight enabled envs (getting deadlock in paramiko recv_exit_status method) while trying to execute a command on a vm. Change-Id: I6660cebc6bc44a5f02e6a1e83ee9a61bae141746 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 1b2db725757ef1c444e094db45287b291ad9f3a6)
2017-03-23refstack: bugfix of testcase failureMatthewLi1-1/+1
JIRA: DOVETAIL-366 JIRA: DOVETAIL-758 1)for compass, joid, failure log https://build.opnfv.org/ci/view/functest/job/functest-joid-baremetal-daily-master/1062/consoleFull https://build.opnfv.org/ci/view/functest/job/functest-compass-baremetal-daily-master/936/consoleFull volume_device_name should be set vdb. for fuel, "vdb" is used for config, drive when force_config_drive=True is in action, so set to vdc testcase test_attach_detach_volume is not dynamic enough, to skip temporarily. 2)rename defcore_201608.txt to defcore.txt since this file is the default running file, can be changed as version changes. and will be easy for dovetail to consume with a general name rather than a special name. then dovetail can define the testcases to replace this file when running. Change-Id: I58f89095721a7bdb15230b9af2b96234c3c7dcb9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 9ae14f931da5baf42a3b62eef49c644e762405fc)
2017-03-22Update keys of details dic for refstack_defcoreLinda Wang1-3/+3
Update the keys of details in refstack_defcore ("num_tests", "num_failures", and "failed") to "tests", "failures" and "errors", in order to be consistent with those in tempest. Change-Id: I24f8a23548ffa253621083bbf6eb988306fd6edb Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 93d5bf2ad47f431bfab173ed718bb7469b67514f)
2017-03-16Parse refstack_defcore resultsLinda Wang2-1/+87
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 Parse refstack_defcore results, including: 1. show number of tests passed, skipped and failed 2. record the detailed info about testcases passed, skipped and failed. Change-Id: I355a907c5c9ea2739f845447144c62613ec3bb6a Signed-off-by: Linda Wang <wangwulin@huawei.com> (cherry picked from commit 2223051412c8855afebb7a9d657c90e9f235f78a)
2017-03-16refstack client integrationMatthewLi5-57/+512
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com> (cherry picked from commit 99f308dc9b11e8f99d928840de576af274229331)
2017-03-14[snaps] Pass flavor metadata to smoke testsMichael Polenchuk1-0/+1
Change-Id: I774d3625d35e3d264d609ba9aa7538a723923bcf Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 1ee860c3f5391234e5424b49e5e9cba9cdebf593)
2017-03-14[tempest/defcore] Configure volume device nameMichael Polenchuk2-2/+5
Actually attach_detach_volume must be skipped because the device name ain't reliable and that's using a hard-coded device name in config. This test should just get the device info after the attach and use that rather than the hard-coded config option in Tempest that ain't likely to work - the test should have been written more dynamically. However, set volume device name to "vdc" since "vdb" is used for config drive when force_config_drive=True is in action. Change-Id: Ic70de93a609df932c7749a94f71505e927df1b79 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 3b006a6a3742325c0fe4ccc557b7a8e140f2cab2)
2017-03-10Merge "Unit tests added for openstack/tempest"Morgan Richomme1-5/+0
2017-03-09Show verification details in tempest logJuha Kosonen1-1/+2
JIRA: FUNCTEST-747 Change-Id: I85f15188315136cc44876914325e3693f7973af8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-09Install kingbird verifier extension for tempestJuha Kosonen2-0/+25
JIRA: FUNCTEST-742 Change-Id: I5de8ed22932250c542751e38eae3185c4a263cd0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-08Aarch64 adaption in functest for snaps smokeCristina Pauna1-0/+7
This commit sends the aarch64 custom config to the snaps integration tests. Since these are the same as the snaps healthcheck, no additional values were added to config_aarch64_patch.yaml Change-Id: I5f2302a3c65d47ec8fca661888268489e2c6ba35 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-08Added support for scenario-based flavor creation.spisarski5-22/+49
As certain scenarios such as, DPDK, FDIO, and OVS use cases require special 'hw:' settings to flavors, SNAPS-OO has just implemented the ability to take in these configuration values to apply to its integration tests. This change checks the scenario and should be configuring the flavor metadata accordingly. Also see SNAPS-38 Used this as an opportunity to refactor the SNAPS test classes as well... JIRA: FUNCTEST-746 Change-Id: I63535776acde088a7461f602966a324b6207592d Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-03-06Aarch64 adaption in functest for snaps healthcheckCristina Pauna1-1/+6
This commit is half of the fix for adapting the snaps healthcheck to run on an aarch64 POD. The fix consists in reading the custom parameters and passing them to the snaps test The snaps part that uses this info is https://gerrit.opnfv.org/gerrit/29853 JIRA: ARMBAND-222 Change-Id: I2027f2ef3afe0caddef781771f2190fc173aff8c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-01Unit tests added for openstack/tempestashishk19941-5/+0
_parse_verification_id method is removed as it is not used anywhere Change-Id: Ia2bc75ffbc2527b04cbe2428e2a3822803bde215 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-01Merge "Re-enable the tests for bgpvpn scenario wich use floating ips"Jose Lausuch1-19/+0
2017-03-01Merge "Update cirros image to latest version"Morgan Richomme2-2/+2
2017-02-28Update cirros image to latest versionMichael Polenchuk2-2/+2
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-25Re-enable the tests for bgpvpn scenario wich use floating ipsjose.lausuch1-19/+0
Change-Id: Ia468b9c9ab9f74a3255aa3647916d1018cef2902 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-25Add custom tempest test.jose.lausuch2-3/+7
Some users need to run a specific list of tempest test cases. This patch allows them to do that by running the command: functest testcase run tempest_custom Change-Id: If8e7726b98c3a71398c7abdf80aea79f10653ebf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Merge "Add Tempest Defcore test case"Jose Lausuch2-80/+215
2017-02-24Add Tempest Defcore test casejose.lausuch2-80/+215
Refstack is the OpenStack project that provides the tooling to run the approved specific tempest test cases (Defcore guidelines) by the Interop working group and by the OpenStack board for OpenStack certification purposes. For more info: https://refstack.openstack.org/ This adds the possibility for a Functest user to run this list of tempest test cases by just issuing the command: functest testcase run tempest_defcore The test will be run on daily loops with the scenario nosdn-nofeature on any installer. Change-Id: I920b2a44cff418116008fdf514425e69dc959412 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-23WIP: Cirros TestVM: Allow config of username/passwordAlexandru Avadanii2-4/+4
With the recent changes in Cirros image default password, we need to support configuring these credentials. JIRA: ARMBAND-218 Change-Id: I5962ec2aeee4ffecefdd8b7e70bdb7ed88457553 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-02-15Fix tempest multisite configJuha Kosonen2-27/+24
Add multisite parameters into tempest config file after the file have been (re)configured by rally verifier. JIRA: FUNCTEST-721 Change-Id: I95fd7e29b5a7d1d9f82e84e383eb23e8fa813d19 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-14Merge "Fix config file name setting"Morgan Richomme1-2/+4
2017-02-14Merge changes from topic 'revert_write_to_file'Jose Lausuch1-1/+1
* changes: Add can_dump_request_to_file decorator Revert "write test results to a local file"
2017-02-14Fix config file name settingJuha Kosonen1-2/+4
JIRA: FUNCTEST-725 Change-Id: Ic1e6a54c2dbfb1dee5f8f6e6afd60382749bcd09 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-13Revert "write test results to a local file"Cédric Ollivier1-1/+1
This reverts commit ee21af78fbfc93e888acda121f08d2b216dd0159. Change-Id: If7c8d3b645073574862eb67225b1e11b0dd7a021 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-02-13Use Exception instead of return codehelenyao3-65/+36
Checking Return status code after each step can be wrapped by Exception catching Also, the return code is not as informative as exception Change-Id: Ic15791d1b8ee47e10cbae8bad46a2cb90ac2b46e Signed-off-by: helenyao <yaohelan@huawei.com>
2017-02-10Merge "Refactor configure_tempest() function"Jose Lausuch1-15/+36
2017-02-08Refactor configure_tempest() functiontomsou1-15/+36
Create two new functions: configure_tempest_update_params and configure_verifier, distinguishing between tempest.conf configure verification and add/updating parameters into it this update is useful and it will be used by sdnvpn/tempest Change-Id: I76e0bc00e33492252cdecab224380ecca2ce275a Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-02-07Integrating PyTest contained in SNAPS as a replacement to the oldspisarski1-0/+34
bash healthcheck. JIRA: FUNCTEST-570 Change-Id: Ia90dc152d48144c9c53967d5c30256389793ce91 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-02-07Merge "bugfix for finding tempest failed testcase"Morgan Richomme1-2/+6
2017-02-06Change endpoint type for KingbirdDimitri Mazmanov1-1/+1
Replaced 'kingbird' with 'multisite' as kingbird installation scripts register 'multisite'. JIRA: MULTISITE-720 Change-Id: Ib53bab46a1fa225e371912d74eecb929d84dff3a Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2017-02-06Merge "Unit tests for openstack/rally."Morgan Richomme1-1/+2
2017-02-04bugfix for finding tempest failed testcaseMatthewLi1-2/+6
JIRA: FUNCTEST-719 1.in new tempest version, FAILED-->fail see log https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-debug-master/163/artifact/results/tempest/tempest.log 2.there is a need to show the skipped testcase in tempest Change-Id: If753c59971362625ae0797a0161e07b1e4ff94c8 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-02Migrates glance commands to OSCLITim Rozet1-8/+8
There is currently a bug with glance in newton which is causing Apex healthchecks to fail: https://bugs.launchpad.net/python-glanceclient/+bug/1661089 I have created a fix and tested it upstream: https://review.openstack.org/#/c/427929/ That fix should eventually end up in functest, but in addition it is a good idea to move to the universal CLI (this patch). Change-Id: Ie71b301ff856f2d50fd889ff36f634911e616b38 Signed-off-by: Tim Rozet <trozet@redhat.com>
2017-02-03Unit tests for openstack/rally.ashishk19941-1/+2
Few bug fix in rally code along with unit tests. Change-Id: Id39a5089ca6fce8aac5ba89eb61d31b02a5e9a98 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-02-02Bugfix: multisite test case failsJuha Kosonen1-0/+3
Ensure the target directory for tempest config file exists. JIRA: FUNCTEST-715 Change-Id: I7bfaab1faa3e664d84813cdbf9a830b0b56a1f60 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-02Add tempest test details to results reportJuha Kosonen1-0/+13
JIRA: FUNCTEST-711 Change-Id: Ib89ad63f0f97ff27e62fd6af200a15b9eed646c6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-02bug fix: no status returned at the end of a Tempest/Rally runMorgan Richomme2-0/+8
the return shall only deal with test executed or not it shall not return the criteria through a return statement the criteria is managed with the criteria field previous patch https://gerrit.opnfv.org/gerrit/#/c/27807 corrected the fact that we should not return the status of the test which was preventing Failed results to be pushed but it removed the return needed statement JIRA: FUNCTEST-714 Change-Id: I3d4c609467837e4ce2353c67c0b8ea95e21ebd84 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-01[rally] Get keystone auth endpoint as request_urlMichael Polenchuk1-5/+2
JIRA: FUNCTEST-685 Change-Id: Id0d0bcf55451832d9aeb22c3e6b9c21aea4e0911 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-01Merge "Extract util functions from tempest.py to conf_utils"Jose Lausuch2-71/+79
2017-01-31Extract util functions from tempest.py to conf_utilsjose.lausuch2-71/+79
These functions are useful for other test cases trying to run tempest. For example BGPVPN tests cases located in SDNVPN repo. Change-Id: I67e671f4e9b0a2d81a3ab0d1957ce144fb1a0432 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-01-31Tempest and SNAPS not pushing results to DB in case of FAILMorgan Richomme2-10/+0
this problem was due to the fact that we add exit condition EX_ERROR when the result was FAIL EX_ERROR shall be used as exit condition when there is an execution error, i.e the test case cannot be run if it can be run, there is no execution error the result can be PASS or FAIL, but from the CI, execution is OK JIRA: FUNCTEST-714 Change-Id: Id434bb9aa88b50277c40c717259304f26f7b3966 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-30Support newton in tempestMichael Polenchuk2-20/+2
* newton release support is started from 13.0.0 * set swift operator role to existing one * unblacklist server_basic_ops test JIRA: FUNCTEST-712 Change-Id: Ieb3d9477db3dfa98f940c3732b64f6eb7515f6e6 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-01-25Merge "Refactor Rally to adopt OO"Morgan Richomme3-613/+559
2017-01-25Refactor Rally to adopt OOhelenyao3-613/+559
JIRA: FUNCTEST-541 Change-Id: Ife04f58dc31ca9ba6316cc31577f81a6bf0e0405 Signed-off-by: helenyao <yaohelan@huawei.com>