aboutsummaryrefslogtreecommitdiffstats
path: root/functest/opnfv_tests/openstack
AgeCommit message (Collapse)AuthorFilesLines
2017-03-15refstack client integrationMatthewLi5-57/+512
JIRA: DOVETAIL-366 JIRA: FUNCTEST-758 usage: 1,functest testcase run refstack_defcore, will run the default testcases in defcore_201608.txt 2,cd <path>/functest/functest/opnfv_tests/openstack/refstack_client python refstack_client.py -c <tempest-conf-file-path> --testlist <testlist-path> this has been worked with openstack-refstack experts, etc. tested workedi. result see http://paste.openstack.org/show/602173/ Change-Id: I1aaffea01dec9dc8d1c572885bdf516614a16894 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-10Merge "Unit tests added for openstack/tempest"Morgan Richomme1-5/+0
2017-03-09Show verification details in tempest logJuha Kosonen1-1/+2
JIRA: FUNCTEST-747 Change-Id: I85f15188315136cc44876914325e3693f7973af8 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-09Install kingbird verifier extension for tempestJuha Kosonen2-0/+25
JIRA: FUNCTEST-742 Change-Id: I5de8ed22932250c542751e38eae3185c4a263cd0 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-03-08Aarch64 adaption in functest for snaps smokeCristina Pauna1-0/+7
This commit sends the aarch64 custom config to the snaps integration tests. Since these are the same as the snaps healthcheck, no additional values were added to config_aarch64_patch.yaml Change-Id: I5f2302a3c65d47ec8fca661888268489e2c6ba35 Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-08Added support for scenario-based flavor creation.spisarski5-22/+49
As certain scenarios such as, DPDK, FDIO, and OVS use cases require special 'hw:' settings to flavors, SNAPS-OO has just implemented the ability to take in these configuration values to apply to its integration tests. This change checks the scenario and should be configuring the flavor metadata accordingly. Also see SNAPS-38 Used this as an opportunity to refactor the SNAPS test classes as well... JIRA: FUNCTEST-746 Change-Id: I63535776acde088a7461f602966a324b6207592d Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-03-06Aarch64 adaption in functest for snaps healthcheckCristina Pauna1-1/+6
This commit is half of the fix for adapting the snaps healthcheck to run on an aarch64 POD. The fix consists in reading the custom parameters and passing them to the snaps test The snaps part that uses this info is https://gerrit.opnfv.org/gerrit/29853 JIRA: ARMBAND-222 Change-Id: I2027f2ef3afe0caddef781771f2190fc173aff8c Signed-off-by: Cristina Pauna <cristina.pauna@enea.com>
2017-03-01Unit tests added for openstack/tempestashishk19941-5/+0
_parse_verification_id method is removed as it is not used anywhere Change-Id: Ia2bc75ffbc2527b04cbe2428e2a3822803bde215 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-03-01Merge "Re-enable the tests for bgpvpn scenario wich use floating ips"Jose Lausuch1-19/+0
2017-03-01Merge "Update cirros image to latest version"Morgan Richomme2-2/+2
2017-02-28Update cirros image to latest versionMichael Polenchuk2-2/+2
Change-Id: I81424c3670b6a6e03a38da83dc93c998bf8c2f5e Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-25Re-enable the tests for bgpvpn scenario wich use floating ipsjose.lausuch1-19/+0
Change-Id: Ia468b9c9ab9f74a3255aa3647916d1018cef2902 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-25Add custom tempest test.jose.lausuch2-3/+7
Some users need to run a specific list of tempest test cases. This patch allows them to do that by running the command: functest testcase run tempest_custom Change-Id: If8e7726b98c3a71398c7abdf80aea79f10653ebf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-24Merge "Add Tempest Defcore test case"Jose Lausuch2-80/+215
2017-02-24Add Tempest Defcore test casejose.lausuch2-80/+215
Refstack is the OpenStack project that provides the tooling to run the approved specific tempest test cases (Defcore guidelines) by the Interop working group and by the OpenStack board for OpenStack certification purposes. For more info: https://refstack.openstack.org/ This adds the possibility for a Functest user to run this list of tempest test cases by just issuing the command: functest testcase run tempest_defcore The test will be run on daily loops with the scenario nosdn-nofeature on any installer. Change-Id: I920b2a44cff418116008fdf514425e69dc959412 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-02-23WIP: Cirros TestVM: Allow config of username/passwordAlexandru Avadanii2-4/+4
With the recent changes in Cirros image default password, we need to support configuring these credentials. JIRA: ARMBAND-218 Change-Id: I5962ec2aeee4ffecefdd8b7e70bdb7ed88457553 Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
2017-02-15Fix tempest multisite configJuha Kosonen2-27/+24
Add multisite parameters into tempest config file after the file have been (re)configured by rally verifier. JIRA: FUNCTEST-721 Change-Id: I95fd7e29b5a7d1d9f82e84e383eb23e8fa813d19 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-14Merge "Fix config file name setting"Morgan Richomme1-2/+4
2017-02-14Merge changes from topic 'revert_write_to_file'Jose Lausuch1-1/+1
* changes: Add can_dump_request_to_file decorator Revert "write test results to a local file"
2017-02-14Fix config file name settingJuha Kosonen1-2/+4
JIRA: FUNCTEST-725 Change-Id: Ic1e6a54c2dbfb1dee5f8f6e6afd60382749bcd09 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-13Revert "write test results to a local file"Cédric Ollivier1-1/+1
This reverts commit ee21af78fbfc93e888acda121f08d2b216dd0159. Change-Id: If7c8d3b645073574862eb67225b1e11b0dd7a021 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2017-02-13Use Exception instead of return codehelenyao3-65/+36
Checking Return status code after each step can be wrapped by Exception catching Also, the return code is not as informative as exception Change-Id: Ic15791d1b8ee47e10cbae8bad46a2cb90ac2b46e Signed-off-by: helenyao <yaohelan@huawei.com>
2017-02-10Merge "Refactor configure_tempest() function"Jose Lausuch1-15/+36
2017-02-08Refactor configure_tempest() functiontomsou1-15/+36
Create two new functions: configure_tempest_update_params and configure_verifier, distinguishing between tempest.conf configure verification and add/updating parameters into it this update is useful and it will be used by sdnvpn/tempest Change-Id: I76e0bc00e33492252cdecab224380ecca2ce275a Signed-off-by: tomsou <soth@intracom-telecom.com>
2017-02-07Integrating PyTest contained in SNAPS as a replacement to the oldspisarski1-0/+34
bash healthcheck. JIRA: FUNCTEST-570 Change-Id: Ia90dc152d48144c9c53967d5c30256389793ce91 Signed-off-by: spisarski <s.pisarski@cablelabs.com>
2017-02-07Merge "bugfix for finding tempest failed testcase"Morgan Richomme1-2/+6
2017-02-06Change endpoint type for KingbirdDimitri Mazmanov1-1/+1
Replaced 'kingbird' with 'multisite' as kingbird installation scripts register 'multisite'. JIRA: MULTISITE-720 Change-Id: Ib53bab46a1fa225e371912d74eecb929d84dff3a Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2017-02-06Merge "Unit tests for openstack/rally."Morgan Richomme1-1/+2
2017-02-04bugfix for finding tempest failed testcaseMatthewLi1-2/+6
JIRA: FUNCTEST-719 1.in new tempest version, FAILED-->fail see log https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-virtual-debug-master/163/artifact/results/tempest/tempest.log 2.there is a need to show the skipped testcase in tempest Change-Id: If753c59971362625ae0797a0161e07b1e4ff94c8 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-02-02Migrates glance commands to OSCLITim Rozet1-8/+8
There is currently a bug with glance in newton which is causing Apex healthchecks to fail: https://bugs.launchpad.net/python-glanceclient/+bug/1661089 I have created a fix and tested it upstream: https://review.openstack.org/#/c/427929/ That fix should eventually end up in functest, but in addition it is a good idea to move to the universal CLI (this patch). Change-Id: Ie71b301ff856f2d50fd889ff36f634911e616b38 Signed-off-by: Tim Rozet <trozet@redhat.com>
2017-02-03Unit tests for openstack/rally.ashishk19941-1/+2
Few bug fix in rally code along with unit tests. Change-Id: Id39a5089ca6fce8aac5ba89eb61d31b02a5e9a98 Signed-off-by: ashishk1994 <ashishk.iiit@gmail.com>
2017-02-02Bugfix: multisite test case failsJuha Kosonen1-0/+3
Ensure the target directory for tempest config file exists. JIRA: FUNCTEST-715 Change-Id: I7bfaab1faa3e664d84813cdbf9a830b0b56a1f60 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-02Add tempest test details to results reportJuha Kosonen1-0/+13
JIRA: FUNCTEST-711 Change-Id: Ib89ad63f0f97ff27e62fd6af200a15b9eed646c6 Signed-off-by: Juha Kosonen <juha.kosonen@nokia.com>
2017-02-02bug fix: no status returned at the end of a Tempest/Rally runMorgan Richomme2-0/+8
the return shall only deal with test executed or not it shall not return the criteria through a return statement the criteria is managed with the criteria field previous patch https://gerrit.opnfv.org/gerrit/#/c/27807 corrected the fact that we should not return the status of the test which was preventing Failed results to be pushed but it removed the return needed statement JIRA: FUNCTEST-714 Change-Id: I3d4c609467837e4ce2353c67c0b8ea95e21ebd84 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-02-01[rally] Get keystone auth endpoint as request_urlMichael Polenchuk1-5/+2
JIRA: FUNCTEST-685 Change-Id: Id0d0bcf55451832d9aeb22c3e6b9c21aea4e0911 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-01Merge "Extract util functions from tempest.py to conf_utils"Jose Lausuch2-71/+79
2017-01-31Extract util functions from tempest.py to conf_utilsjose.lausuch2-71/+79
These functions are useful for other test cases trying to run tempest. For example BGPVPN tests cases located in SDNVPN repo. Change-Id: I67e671f4e9b0a2d81a3ab0d1957ce144fb1a0432 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2017-01-31Tempest and SNAPS not pushing results to DB in case of FAILMorgan Richomme2-10/+0
this problem was due to the fact that we add exit condition EX_ERROR when the result was FAIL EX_ERROR shall be used as exit condition when there is an execution error, i.e the test case cannot be run if it can be run, there is no execution error the result can be PASS or FAIL, but from the CI, execution is OK JIRA: FUNCTEST-714 Change-Id: Id434bb9aa88b50277c40c717259304f26f7b3966 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-30Support newton in tempestMichael Polenchuk2-20/+2
* newton release support is started from 13.0.0 * set swift operator role to existing one * unblacklist server_basic_ops test JIRA: FUNCTEST-712 Change-Id: Ieb3d9477db3dfa98f940c3732b64f6eb7515f6e6 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-01-25Merge "Refactor Rally to adopt OO"Morgan Richomme3-613/+559
2017-01-25Refactor Rally to adopt OOhelenyao3-613/+559
JIRA: FUNCTEST-541 Change-Id: Ife04f58dc31ca9ba6316cc31577f81a6bf0e0405 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-01-22Merge "Reverted the file permission"Helen Yao1-0/+0
2017-01-19Merge "write test results to a local file"Morgan Richomme1-1/+1
2017-01-17write test results to a local filewu.zhihui1-1/+1
Write test result to a file or push it to DB depends on the value format of test_db_url which is defined in config_functest.yaml. Meanwhile, test_db_url can be set by os envrion value "RESULT_STORE". If test_db_url is a url, e.g. http:// or https://, then push result to DB. If test_db_url is a file location, e.g. file:///, then write results to a file with json data. One result record, one line. JIRA: FUNCTEST-657 Change-Id: I579087cd2c24d61a79142b5d67003fb486b6c723 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-01-16Rally keystone test scenarios for v3helenyao3-109/+167
JIRA: FUNCTEST-652 1. Updated the Rally repository to master the keystone test scenarios of TAG= 0.7.0 cannot run on Newton also, 0.7.0 is the last tag that exists 2. Update the Tempest installation with updated rally command Rally team said "there was no possibility to do it in backward compatible way(rally verify re-design)" 3. The `rally show` was deprecated[1] in the master and corresponding logic is updated 4. Update rally commands [1] https://github.com/openstack/rally/commit/f2fc3015beb4cfd8053db728765714500db6eeb2 Change-Id: Ief9e36a16dd92e4449c0f76579e7191a93aa3e21 Signed-off-by: helenyao <yaohelan@huawei.com>
2017-01-12Merge "Remove cmd to OpenStack, use python client"Morgan Richomme1-6/+10
2017-01-10Remove cmd to OpenStack, use python clientMorgan Richomme1-6/+10
JIRA: FUNCTEST-503 Change-Id: Ie92051ec128ad4857862e6125628dac24ce99a2a Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2017-01-04Reverted the file permissionhelenyao1-0/+0
There are some files whose permissions are changed unintendedly. Revert all of them. mode change 100644 <= 100755 functest/core/pytest_suite_runner.py mode change 100644 <= 100755 functest/opnfv_tests/openstack/vping/vping_base.py mode change 100644 <= 100755 functest/utils/openstack_tacker.py mode change 100644 <= 100755 functest/tests/unit/odl/test_odl.py mode change 100644 <= 100755 requirements.txt mode change 100644 <= 100755 test-requirements.txt Historical comments that changed the permission for reference changeID: Ia02760fd98aaab59a6cf0a90a2020b76e0c92df6 changeID: Id6815f96a11f2918bc2c7bc1c33f38c3f5754e11 changeID: Ic8c01b9b7ed86d3bdd9f5125504bc47f46a37700 changeID: I9f1a408f0e43bff4499575fa57cabd1a83d99b3a Change-Id: I1deadd77cc78f2186f82de79233aabe97ac21b26 Signed-off-by: helenyao <yaohelan@huawei.com>
2016-12-27Set flavor's page size to support dpdk enabled vmsMichael Polenchuk1-2/+3
Set flavor's page size to ANY so libvirt driver might try to find large pages for guest RAM (either 2Mb or 1Gb), otherwise fallback to small pages. JIRA: FUNCTEST-684 Change-Id: I40f415ca9487c4f20416d45462eddc769df0cb9c Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-12-26Merge "refactor rally using new constants provider"Serena Feng1-17/+16