summaryrefslogtreecommitdiffstats
path: root/testcases/OpenStack/tempest/run_tempest.py
AgeCommit message (Collapse)AuthorFilesLines
2016-09-07remove imported FUNCTEST_REPO objectSerenaFeng1-3/+3
According to openstack style guidelines in http://docs.openstack.org/developer/hacking/ **** Do not import objects, only modules (*) **** so direct FUNCTEST_REPO import should be avoided from functest.utils.functest_utils import FUNCTEST_REPO as FUNCTEST_REPO JIRA: FUNCTEST-459 Change-Id: Iac0d07a54957cd7419391de183660ac1ce0efd49 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-01stop hardcoded FUNCTEST_REPO path everywhereSerenaFeng1-4/+3
functest repo is used by almost every testcase, each place we get it like: REPOS_DIR = os.getenv('repos_dir') FUNCTEST_REPO = ("%s/functest" % REPOS_DIR) provide a common interface in functest_util.py JIRA: FUNCTEST-453 Change-Id: Ie0635dacc761ed2d05b7e606530368844f32ebaf Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-09-01Merge "unify functest_yaml obtain process"Jose Lausuch1-3/+1
2016-08-31unify functest_yaml obtain processSerenaFeng1-3/+1
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-31Remove all logers as utils method args.Cédric Ollivier1-4/+3
As it modifies method params, it could break the testcases. JIRA: FUNCTEST-428 Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-26refactor create shared network process to eliminate reduplicateSerenaFeng1-17/+6
Some places shared network is created through create_network_full first, then update it to shared, abstract a uniformed method to eliminate reduplicate JIRA: FUNCTEST-437 Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-26refactor create or get image process to eliminate reduplicateSerenaFeng1-17/+5
Some places when create image is referred, they check if image exist, if exist use it directly, else create a new one. Abstract a method to integrate the process JIRA: FUNCTEST-432 Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23Merge "when create/get/update failed return None rather than False"Morgan Richomme1-2/+2
2016-08-23when create/get/update failed return None rather than FalseSerenaFeng1-2/+2
In openstack_util.py, when create/get/update network or other resources failed, False is returned, which is incompatible with success return value such as id, network_nic. JIRA: FUNCTEST-427 Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23Create tempest resources before generating tempest.confvitikkan1-1/+1
During generating tempest.conf file rally tries to download cirros image from the internet if no suitable images exist in the configuration. This change ensures that cirros image is created before generating tempest.conf file. JIRA: FUNCTEST-195 Change-Id: I9e2df8af40bd02db9b78b8b6b730b4f4168a8b2d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-16[multisite]push result to dbmeimei1-0/+2
Change-Id: Idda3a3a5c8fb20f6894675eb087417e150f8646d Signed-off-by: meimei <meimei@huawei.com>
2016-08-12[bugfix] pass the wrong argument to rallymeimei1-1/+2
Change-Id: I23ff06b53e45e9aa226f430e7d2fb75025281b9e Signed-off-by: meimei <meimei@huawei.com>
2016-08-11Merge "Create config_functest patch to update the conf with scenario"boucherv1-1/+2
2016-08-11[multisite] refactor the scripts of multistemeimei1-86/+10
Change-Id: I07f0f5e253b04c9ac70e6dc4ea210e7cecf22c6a Signed-off-by: meimei <meimei@huawei.com>
2016-08-10Create config_functest patch to update the conf with scenarioboucherv1-1/+2
Adding support of LXD scenario JIRA: FUNCTEST-268 Change-Id: I5891ff9de674d99d32d8db747be501ee8a2e6609 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-08Use Kingbird Bind host URL for TempestAshish Singh1-5/+49
Earlier, there was external URL for accessing KB services in tempest.conf which is not accessible from functest docker. Use bind host URL for KB service to access from the docker. Change-Id: I147ffc2cd9883a6913080f9e1ab245807e0ca707 Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
2016-08-05Reduced timeout for SSH connection attempt in tempest.confvitikkan1-0/+3
Some tempest test cases try to establish SSH connection to Cirros VMs using default 300s timeout. Since Cirros VMs send only three DHCP requests with 1 minute interval, future SSH connection attempts will most probably fail if DHCP response will not be received right after third request. For that reason the optimal timeout is slightly above 2 minutes. JIRA: FUNCTEST-378 Change-Id: I57415ad37a85cd84887d3cac4f7a44f7e145d820 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-04Re-generating tempest.conf file before starting testsvitikkan1-2/+6
"rally verify genconfig" command doesn't generate tempest.conf file if it already exists in the used deployment. This can cause troubles if some resources (images, flavors etc.) change between consecutive runs of tempest. The change ensures that tempest.conf is deleted before executing "rally verify genconfig". JIRA: FUNCTEST-403 Change-Id: Icf5e380da3cb8757f4177b49028937355e2cf1d7 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-03Shorter test case names are accepted for tempest blacklist filevitikkan1-3/+6
Blacklist file handling is changed so that also partial test case names are accepted. For example, "tempest.api.object_storage" entry will exclude all the test cases containing this string. JIRA: FUNCTEST-401 Change-Id: I620be7dfd5d980a343d2f7cc7c0dbe40598bf65c Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-03Merge "Fix for the endpoint URL for kingbird"mei mei1-52/+7
2016-08-02Fix for the endpoint URL for kingbirdAshish Singh1-52/+7
Currently, there is internal IP address which is getting populated in tempest.conf. Since the tempest are run inside functest docker container we need to use public IP address for accessing Kingbird services. Now, there will not be any installer specific endpoints as we had earlier. All should communicate with public endpoints. Change-Id: Id22e7e4d9ece9a0000a1186113627b82d6ba400a Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
2016-08-02use configured success_rate to check tempest test statusSerenaFeng1-21/+7
when checking tempest test results using success_rate configured in testcases.yaml rather than written it in the code JIRA: FUNCTEST-400 Change-Id: I2a34e3e032a0d94c6a4605fcf09a66c8f8f9b78c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-01Fix missing directory when calling bgpvpn testsjose.lausuch1-2/+2
Change-Id: Ic9f6b9592202c3bed9d6835eeea7c14971e1c01f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch1-4/+22
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Add endpoint type support on functestboucherv1-0/+11
By default public endpoint was used but now you can use internal or admin JIRA: FUNCTEST-387 Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-28Merge "[bugfix] issures in multisite testcase"meimei1-5/+2
2016-07-27Fix the proper version output for kingbird.Dimitri Mazmanov1-1/+1
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2016-07-27Return -1 in Tempest if the success criteria is not passed.jose.lausuch1-17/+40
JIRA: FUNCTEST-381 Change-Id: I533bb50e26a3b97da9fd3bfa007f8ac7ce752a5b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27[bugfix] issures in multisite testcasemeimei1-5/+2
Change-Id: I351311688742c04c2c2b7278015e221178267fda Signed-off-by: meimei <meimei@huawei.com>
2016-07-20Merge "Add kingbird endpoint information to functest."Jose Lausuch1-7/+52
2016-07-20Remove logger as input parameter of functions in openstack_utilsjose.lausuch1-2/+1
JIRA: FUNCTEST-376 Also some fixes to get rid of flake8 violations in onos-sfc Change-Id: I52c2fd30a6b81af20ea779db2d73b9386524f7ce Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-20Add kingbird endpoint information to functest.Dimitri Mazmanov1-7/+52
The patch multihops to the fuel node and dynamically retrieves kingbird endpoint information. It also resolves the controller ip instead of using the hardcoded value from the config ONLY if the installer type is Fuel. Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com> Change-Id: I5161df5df3da7283f6374efa6bd1108246c1095a
2016-07-19Show real time tempest test executionjose.lausuch1-4/+21
JIRA: FUNCTEST-375 Change-Id: I4f0cb68639b927f2980389d9331ec260605c8caf Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14Use common way to get the openstack clientsjose.lausuch1-17/+11
Instead of repeating the code in all the scripts and importing the openstack libraries, the clients shall be given by openstack utils, which is its purpose JIRA: FUNCTEST-163 Change-Id: I1ccc05a3af44ee1ab5938ea9e4e01dbe55f4816d Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-14[multisite] integrate kingbird tempest testcasesmeimei1-1/+43
JIRA: FUNCTEST-179 Change-Id: I4a8ae43e2814b3d859c32a6278671f87155aa855 Signed-off-by: meimei <meimei@huawei.com>
2016-07-12Chmod 755 all py files which can be executedCédric Ollivier1-0/+0
All files where __main__ is checked can now be executed by everyone. It results from [1]. [1] find . -name "*.py" |xargs grep __main__ |cut -d\: -f 1 |xargs chmod 755 Change-Id: I9ad153cfdde0447213e35dac102e668d9e754cf9 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-06-16Align test names in DB and config fileMorgan Richomme1-3/+8
JIRA: FUNCTEST-304 Change-Id: I98d3155beb1c5e49eda84b443df603c2630b4823 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-06-13Creating Glance image for Tempest suitevitikkan1-0/+30
If not yet existing, Cirros-0.3.4 image is created before running Tempest test suite. Source file for the image is included into opnfv/functest Docker container. JIRA: FUNCTEST-195 Change-Id: I980193c4207c1301ca4e3b6e850b4056e6aa0130 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-06-08Adapt functest testcase to APi refactoringMorgan Richomme1-29/+19
JIRA: FUNCTEST-303 Change-Id: Ia276d9ca6e8d62b496c3b5f81561b14b02c43fd7 Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-31Remove unused CI_DEBUGCédric Ollivier1-1/+0
Change-Id: I78028dd7694f90f7cf81fc58f48b8afb713b5e12 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-05-30Bugfix: can not find tempest.logSerenaFeng1-24/+21
JIRA: FUNCTEST-269 Remove dependency on CI_DEBUG and use subprocess.call to redirect stdout to tempest.log in any case. Change-Id: Ibac68bec7f98007d24def25fd609051b5c528fc7 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-05-26Add simple error logs in result DBMorgan Richomme1-16/+28
Used afterwards for the reporting to identify quickly which case(s) are failing Change-Id: I0030c69000ec36e42f7791630639fce5bc4b0f1e Signed-off-by: Morgan Richomme <morgan.richomme@orange.com>
2016-05-17Change 'testcases' directory structurejose.lausuch1-0/+347
JIRA: FUNCTEST-226 - Remove all 'CI' subdirs - Remove VIM dir and have OpenStack dir within /testcases/ - Split rally and tempest in 2 different dirs Change-Id: Icfc76d18a84f7a18d93ae1a5ec7dc7a560bb7ce9 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>