summaryrefslogtreecommitdiffstats
path: root/testcases/OpenStack
AgeCommit message (Collapse)AuthorFilesLines
2016-09-01Merge "unify functest_yaml obtain process"Jose Lausuch3-14/+6
2016-08-31unify functest_yaml obtain processSerenaFeng3-14/+6
functest_yaml is needed in almost all of the testcases, the obtain process is the same: with open(os.environ["CONFIG_FUNCTEST_YAML"]) as f: functest_yaml = yaml.safe_load(f) f.close() abstract a method to unify the process, and provide the interface JIRA: FUNCTEST-447 Change-Id: I96a9a9962d7b466f10bbd3b5ab2495957524e22a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-31Remove all logers as utils method args.Cédric Ollivier4-8/+4
As it modifies method params, it could break the testcases. JIRA: FUNCTEST-428 Change-Id: I4263d9bd812f1803e513464e3c321cc4a7281958 Signed-off-by: Cédric Ollivier <cedric.ollivier@orange.com>
2016-08-30disable test case does not make sense for LXD.Narinder Gupta1-0/+11
This patch will disable the test cases which does not make sense to run on LXD deployments. Change-Id: I683b3714aa5af3c750ca57fab9fceff907b7d646 Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com>
2016-08-30Exclude floating-ip related tempest tests to blacklist for bgpvpn scenariojose.lausuch1-0/+2
Change-Id: I7115018e64a2413209313b9a432d3d1b59e841d1 Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-08-26refactor create shared network process to eliminate reduplicateSerenaFeng2-32/+11
Some places shared network is created through create_network_full first, then update it to shared, abstract a uniformed method to eliminate reduplicate JIRA: FUNCTEST-437 Change-Id: I13c20ab061323188c5eb3b8c861674df38083c62 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-26Merge "refactor create or get image process to eliminate reduplicate"Morgan Richomme3-56/+15
2016-08-26Merge "[Fuel] Skip test_server_basic_ops tempest test"Morgan Richomme1-0/+14
2016-08-26refactor create or get image process to eliminate reduplicateSerenaFeng3-56/+15
Some places when create image is referred, they check if image exist, if exist use it directly, else create a new one. Abstract a method to integrate the process JIRA: FUNCTEST-432 Change-Id: I83d1112aa5cb0d3cdfab92fd49cd5f2c1cceff82 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23Merge "when create/get/update failed return None rather than False"Morgan Richomme1-2/+2
2016-08-23Merge "delete useless image_exists in vping"Morgan Richomme2-7/+2
2016-08-23when create/get/update failed return None rather than FalseSerenaFeng1-2/+2
In openstack_util.py, when create/get/update network or other resources failed, False is returned, which is incompatible with success return value such as id, network_nic. JIRA: FUNCTEST-427 Change-Id: Id2f55d8524e5aff150ba6bfb799085377a63baa4 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-23[Fuel] Skip test_server_basic_ops tempest testMichael Polenchuk1-0/+14
Skip TestServerBasicOps which fails when deleting server and floating ip almost at the same time. JIRA: FUEL-173 JIRA: FUEL-176 Change-Id: I24f3397096757028bed9d32d6353aa689e8eaa9a Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-08-23Create tempest resources before generating tempest.confvitikkan1-1/+1
During generating tempest.conf file rally tries to download cirros image from the internet if no suitable images exist in the configuration. This change ensures that cirros image is created before generating tempest.conf file. JIRA: FUNCTEST-195 Change-Id: I9e2df8af40bd02db9b78b8b6b730b4f4168a8b2d Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-23delete useless image_exists in vpingSerenaFeng2-7/+2
In rally, image_exists is used to decide whether the image resource should be cleaned or not. But unlike rally, image_exists in vping is only assigned but not never be actually used. JIRA: FUNCTEST-426 Change-Id: Id2089dd2a9734ba957cc1c80d4dc31bc27907b0a Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-22Mend create_image() functionMichael Polenchuk1-0/+2
Change-Id: I91681736817f881ca53e5124328bd4399aa54740 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2016-08-22refactor vpingSerenaFeng3-542/+320
There are lots of common processes in vPing_userdata.py and vPing_ssh.py, abstract and refactor them. JIRA: FUNCTEST-414 Change-Id: I4cd2c635318c063319d2a3c31f9a1e512eeea6c8 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-17Modify joid tempest list for onoswuwb19891-5/+16
Change-Id: I0ae03b1f13bbc8801d8c14fa6ff1b93117c80e91 Signed-off-by: wuwb1989 <wuwenbin2@huawei.com>
2016-08-17blacklist.txt file format correctedvitikkan1-0/+2
Only last part of blacklist.txt file was loaded by yaml.safe_load() function. File format is corrected. JIRA: FUNCTEST-418 Change-Id: I9c922b1a7b739e7d0c0d5afa3e0ea700749f9d50 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-16Add onos blacklist for tempestCNlucius1-0/+17
Change-Id: If722e0d3376b8d04766b1eb871caadc5bc6e7c18 Signed-off-by: CNlucius <lukai1@huawei.com>
2016-08-16[multisite]push result to dbmeimei1-0/+2
Change-Id: Idda3a3a5c8fb20f6894675eb087417e150f8646d Signed-off-by: meimei <meimei@huawei.com>
2016-08-12Merge "Improve LXD scenario support"Morgan Richomme1-2/+3
2016-08-12Improve LXD scenario supportboucherv1-2/+3
JIRA: FUNCTEST-268 Change-Id: I8c8a3eff4a7e94b963c0307010a60723dc13a537 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-12[bugfix] should create result folder for multisitemeimei1-0/+4
Change-Id: I004225131de57f1597edc62558a3a3e42f31b504 Signed-off-by: meimei <meimei@huawei.com>
2016-08-12[bugfix] pass the wrong argument to rallymeimei1-1/+2
Change-Id: I23ff06b53e45e9aa226f430e7d2fb75025281b9e Signed-off-by: meimei <meimei@huawei.com>
2016-08-11Merge "Create config_functest patch to update the conf with scenario"boucherv4-4/+8
2016-08-11[multisite] refactor the scripts of multistemeimei2-86/+130
Change-Id: I07f0f5e253b04c9ac70e6dc4ea210e7cecf22c6a Signed-off-by: meimei <meimei@huawei.com>
2016-08-10Create config_functest patch to update the conf with scenarioboucherv4-4/+8
Adding support of LXD scenario JIRA: FUNCTEST-268 Change-Id: I5891ff9de674d99d32d8db747be501ee8a2e6609 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-08-08Use Kingbird Bind host URL for TempestAshish Singh1-5/+49
Earlier, there was external URL for accessing KB services in tempest.conf which is not accessible from functest docker. Use bind host URL for KB service to access from the docker. Change-Id: I147ffc2cd9883a6913080f9e1ab245807e0ca707 Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
2016-08-05Reduced timeout for SSH connection attempt in tempest.confvitikkan1-0/+3
Some tempest test cases try to establish SSH connection to Cirros VMs using default 300s timeout. Since Cirros VMs send only three DHCP requests with 1 minute interval, future SSH connection attempts will most probably fail if DHCP response will not be received right after third request. For that reason the optimal timeout is slightly above 2 minutes. JIRA: FUNCTEST-378 Change-Id: I57415ad37a85cd84887d3cac4f7a44f7e145d820 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-04Re-generating tempest.conf file before starting testsvitikkan1-2/+6
"rally verify genconfig" command doesn't generate tempest.conf file if it already exists in the used deployment. This can cause troubles if some resources (images, flavors etc.) change between consecutive runs of tempest. The change ensures that tempest.conf is deleted before executing "rally verify genconfig". JIRA: FUNCTEST-403 Change-Id: Icf5e380da3cb8757f4177b49028937355e2cf1d7 Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-03Shorter test case names are accepted for tempest blacklist filevitikkan2-20/+16
Blacklist file handling is changed so that also partial test case names are accepted. For example, "tempest.api.object_storage" entry will exclude all the test cases containing this string. JIRA: FUNCTEST-401 Change-Id: I620be7dfd5d980a343d2f7cc7c0dbe40598bf65c Signed-off-by: vitikkan <viktor.tikkanen@nokia.com>
2016-08-03Merge "Fix for the endpoint URL for kingbird"mei mei1-52/+7
2016-08-02Merge "modfied to mute object storage test on joid."valentin boucher1-0/+23
2016-08-02Fix for the endpoint URL for kingbirdAshish Singh1-52/+7
Currently, there is internal IP address which is getting populated in tempest.conf. Since the tempest are run inside functest docker container we need to use public IP address for accessing Kingbird services. Now, there will not be any installer specific endpoints as we had earlier. All should communicate with public endpoints. Change-Id: Id22e7e4d9ece9a0000a1186113627b82d6ba400a Signed-off-by: ashish singh <ashishsingh2k8@gmail.com>
2016-08-02use configured success_rate to check tempest test statusSerenaFeng1-21/+7
when checking tempest test results using success_rate configured in testcases.yaml rather than written it in the code JIRA: FUNCTEST-400 Change-Id: I2a34e3e032a0d94c6a4605fcf09a66c8f8f9b78c Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-08-01Fix missing directory when calling bgpvpn testsjose.lausuch1-2/+2
Change-Id: Ic9f6b9592202c3bed9d6835eeea7c14971e1c01f Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-31modfied to mute object storage test on joid.Narinder Gupta1-0/+23
In case of joid we implement ceph-radosgw for object storage which creates swift api for object storage. Manually i can verify we can upload the object. But functest is failing other installer removed the API but we need in JOID for juju based deployment on Openstack. So this patch will mute the object storage test cases for functest. Change-Id: I21d2bdc665a9589630cfcacb278cfb65a1c15f11 Signed-off-by: Narinder Gupta <narinder.gupta@canonical.com>
2016-07-29Return -1 in Rally if the success criteria is not metMarkus Kullberg1-1/+7
JIRA: FUNCTEST-382 Change-Id: Iaf475ecd3dbfcf6fb639ff146fe96e54c5393a1e Signed-off-by: Markus Kullberg <markus.kullberg@nokia.com>
2016-07-29Merge "Select test cases in tempest to be blacklisted per each scenario"jose.lausuch2-4/+39
2016-07-29correct rally criteria checkSerenaFeng1-12/+3
add method check_success_rate() to unify criteria check by success_rate JIRA: FUNCTEST-398 Change-Id: I1b3f0ccd7061b80ac88356206f29844e31e4101b Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Select test cases in tempest to be blacklisted per each scenariojose.lausuch2-4/+39
JIRA: FUNCTEST-396 Added example for SDNVPN test cases Change-Id: I623130fc330c95239d982097552ca09f2a7ea34a Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-28Add configure options for healthcheckCiprian Barbu1-3/+39
The healthcheck tier used hard-coded x86 image for testing glance and nova. This breaks functest for ARM based pods, because x86 instances cannot run on ARM and even more, if healthcheck fails no other testcases are executed. Change-Id: I8a4cc754569a26d98bff57470574ed28eebbf2da Signed-off-by: Ciprian Barbu <ciprian.barbu@enea.com>
2016-07-28Add endpoint type support on functestboucherv1-0/+11
By default public endpoint was used but now you can use internal or admin JIRA: FUNCTEST-387 Change-Id: If1adaa88248d379ad6d74b20f2dffd76278b67b9 Signed-off-by: boucherv <valentin.boucher@orange.com>
2016-07-28logger the push result of rally testSerenaFeng1-1/+1
JIRA: FUNCTEST-393 Change-Id: I94158531739e1e05c694a785a8bbca7f80684af5 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-07-28Merge "[bugfix] issures in multisite testcase"meimei1-5/+2
2016-07-27Fix the proper version output for kingbird.Dimitri Mazmanov1-1/+1
Signed-off-by: Dimitri Mazmanov <dimitri.mazmanov@ericsson.com>
2016-07-27Return -1 in Tempest if the success criteria is not passed.jose.lausuch1-17/+40
JIRA: FUNCTEST-381 Change-Id: I533bb50e26a3b97da9fd3bfa007f8ac7ce752a5b Signed-off-by: jose.lausuch <jose.lausuch@ericsson.com>
2016-07-27[bugfix] issures in multisite testcasemeimei1-5/+2
Change-Id: I351311688742c04c2c2b7278015e221178267fda Signed-off-by: meimei <meimei@huawei.com>
2016-07-27substitue misused variable 'total_success' with 'success_rate'SerenaFeng1-5/+5
JIRA: FUNCTEST-390 Change-Id: I35a2f72016573fc9e0a8403e436d5568937c5b14 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>