summaryrefslogtreecommitdiffstats
path: root/testsuites
AgeCommit message (Collapse)AuthorFilesLines
2016-09-22Add Factor Testcase System_Bandwidthyuyang1-0/+123
JIRA: BOTTLENECK-94 Add factor test to find the bottleneck of system bandwidth. A separate logic is provided to determine what is throughput for a deployed system. Changes: 1. Add testcase script 2. Delete whitespaces 3. Logic fix Change-Id: I37ab9d40d90c585191619d4753eca285fee64dd4 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-09-22Adding Posca Testsuite in Bottlenecksyuyang4-0/+59
JIRA: BOTTLENECK-92 The POSCA (Parametric Bottlenecks Testing Catalogue) testsuite classifies the bottlenecks test cases and results into 5 categories. Then the results will be analyzed and decoupled bottlenecks will be searched among these categories. The POSCA testsuite aims to locate the bottlenecks in parmetric manner and to decouple the bottlenecks regarding the deployment requirements. The POSCA testsuite provides an user friendly way to profile and understand the E2E system behavior and deployment requirements. Goals of the POSCA testsuite: a) Automatically locate the bottlenecks in a iterative manner. b) Automatically generate the testing report for bottlenecks in different categories. c) Implementing Automated Staging. Scopes of the POSCA testsuite: a) Modeling, Testing and Test Result analysis. b) Parameters choosing and Algorithms Test stories of the POSCA testsuite: a) Factor test: base test cases that Feature test and Optimization will be dependant on b) Feature test: test cases for features/scenarios c) Optimization test: test to tune the system parameter For more details of the proposal, please refer to https://jira.opnfv.org/secure/attachment/11479/ POSCA%20Testsuite%20Proposal%20in%20Bottlenecks.pdf Changes: 1. Add Posca testsuite directories and files to Bottleneks, leaving adding test cases for latter commits. 2. Fix file appd issue. 3. Delete the un-used packages in testsuites/posca/run_posca.py 4. Add testcase processing logic to run_posca.py 5. Add config dimensions 6. Add scripts directory Change-Id: I54d9b51381a804b76a83680912227e058da3165e Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-09-07delete unnecessary file headMatthewLi1-33/+0
JIRA: BOTTLENECK-87 Change-Id: I67786b0481d734d09422fe5b757380cdd94d762d Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-13bugfix for image cleanup and python script calling by subprocess shellMatthewLi3-6/+67
JIRA: BOTTLENECK-70 log is shown in https://build.opnfv.org/ci/view/bottlenecks/job/bottlenecks-compass-vstf-virtual-daily-master/9/console and https://build.opnfv.org/ci/view/bottlenecks/job/bottlenecks-compass-vstf-virtual-daily-master/10/console for image names, we use bottlenecks_<suite name>_<option> for vstf_collector.py, it is used for transfer test result to community dashboard, it works for B release, for C release, we should adapt it later, now we only fix its path error. Change-Id: Iad2bf39837d02aa1e5ea8a323411d98082135882 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-12bugfix for vstf stack nameMatthewLi1-1/+2
JIRA: BOTTLENECK-70 Change-Id: I768be0a0b30df266f6f130bf616d6d808cf1849c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-06bugfix for vstf runningMatthewLi1-3/+7
Change-Id: I9777e84b9be905c484a7d86be2287cde27ae33fe Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-06bugfix for missing python packageMatthewLi1-0/+1
Change-Id: I2a8ab6fbbeff407713eea71ebf504a2ce2dbb342 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-06Merge "config info for different testcase in vstf"yaoguang wang10-0/+56
2016-06-03run vstf test caseMatthewLi2-4/+16
JIRA: BOTTLENECK-70 Change-Id: Iade7d7a97f3b0ba54be33b37cf80c1530c410b95 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-01config info for different testcase in vstfMatthewLi10-0/+56
JIRA: BOTTLENECK-70 Change-Id: I21cf538b7984cbc5036fc6fe897d0c90eec19e55 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-01bugfix for dpkg lockMatthewLi1-0/+2
Change-Id: Icd024d990635b5a52385f11e7b458e18a8f186f1 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-01bugfix for download image function return valueMatthewLi2-2/+2
JIRA: BOTTLENECK-86 Change-Id: Ia76b833bdec7554468ce081d3d572e87cea2d9f7 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-01file download separated from image creation progressMatthewLi4-21/+33
JIRA: BOTTLENECK-86 Change-Id: I1603d8121d58ea36d6bd2aa241590fddd70c2e6f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-01vstf instance creationMatthewLi2-1/+498
JIRA: BOTTLENECK-70 the instance creation process is added here, as for the config info parsing, it will be added in next patches in prepare_env func in run_vstf.py. the images used by vstf should be changed next time, temporarily, the rubbos image is used. Change-Id: I2ffe03dc64ec4f315e4383c59831cfbdfbebdcfb Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-01Merge "debug: git installation errors"MatthewLi1-1/+2
2016-05-31debug: git installation errorsMatthewLi1-1/+2
Change-Id: I36b03085030284a951fc35c3b898ceeb245390a6 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-06-01Merge "omit the instance reboot temporarily"MatthewLi1-2/+2
2016-05-31omit the instance reboot temporarilyMatthewLi1-2/+2
Change-Id: Ic73b953cc7b63e4629ba7ad9c673196528891c4f Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-05-31Merge "extend time after instance creation"MatthewLi1-2/+2
2016-05-31extend time after instance creationMatthewLi1-2/+2
Change-Id: I996944eacb7c2f57784aec50df75047d9780a1dc Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-05-31Merge "extend the sleep time after instance reboot"MatthewLi1-1/+3
2016-05-31extend the sleep time after instance rebootMatthewLi1-1/+3
Change-Id: I47b471be9d74bce5cef35f1d4f447900e54b7210 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-05-20Merge "add test case 1-1-0-1 with 10 clients"yaoguang wang1-0/+470
2016-05-20add test case 1-1-0-1 with 10 clientsMatthewLi1-0/+470
JIRA: BOTTLENECK-84 Change-Id: I4de0971b6d4ba60f3a0261e303fa194495c033c4 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-05-20add test case 1-3-0-1MatthewLi1-0/+374
JIRA: BOTTLENECK-83 Change-Id: I1d4d4b4f53cedc6aa987f7842016099725aad516 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-05-20Add a test case for rubboswangyaoguang1-0/+398
The resources for this test case is 1-4-0-1 configuration. JIRA: BOTTLENECK-80 Change-Id: I1eb013bc6b3fd0e988c809fcb068aa999cd9a73e Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-20Add a fundamental rubbos test case with minimum resourceswangyaoguang2-1/+228
This is a fundamental test case with minimum resource for rubbos test. The benefits are two-fold. One is as daily test case since its bring-up time is fastest. Another is as a baseline. JIRA: BOTTLENECK-79 Change-Id: Ia4ffa5f2631da69ca5c6fc52558d3cf063d1b893 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-17add one test case for rubboswangyaoguang1-0/+350
This test case takes 1-2-0-1 configuration in rubbos. JIRA: BOTTLENECK-78 Change-Id: I0a3c551d44ce2fadb2c42fac25426d07fad8aa95 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-11bugfix: dpkg was interrupted in one ubuntu instancewangyaoguang1-0/+1
dpkg issue, ref:https://build.opnfv.org/ci/view/bottlenecks/job/bottlenecks-fuel-rubbos-opnfv-jump-2-daily-master/2/console JIRA: BOTTLENECK-77 Change-Id: Ie6fdc849d056b93e5ef41ac15375d4e9b83e2330 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-11change remote git repository urlwangyaoguang1-1/+2
The old domain git.opnfv.org is not accessible. JIRA: BOTTLENECK-74 Change-Id: I8e498e0432bacbd5ed83af4ed07ddb4e76e93ee8 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-10Merge "Replace puppet node definition with regular expression"Jun Li2-8/+8
2016-05-10bugfix: fix ssh issue between puppet master and agentswangyaoguang2-54/+77
JIRA: BOTTLENECK-75 Change-Id: If15aa3da04d650fb26ce099adbe37ac3c98c638b Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-10Replace puppet node definition with regular expressionwangyaoguang2-8/+8
The old method of node definition is a hostname string. It is not generic and problematic in OpenStack. Puppet agents send FQDN instead of hostname during catalog execution. JIRA: BOTTLENECK-76 Change-Id: Icd004d0450ff84fc890e7962f8767cfbde90a9ad Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-09fix hostname of rubbos control instancewangyaoguang1-1/+1
JIRA: BOTTLENECK-75 Change-Id: Ic84c4a231dfbc6ae3f28393d52b273fa6d533c7b Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-05bugfix: Correct instance's hostname and nameserverswangyaoguang2-18/+17
JIRA: BOTTLENECK-75 Change-Id: Ib6db60956285e172c93411e23454a7c5240eacde Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-05-03bugfix: ssh to one OS instance via floating ipwangyaoguang1-0/+17
JIRA: BOTTLENECK-74 Change-Id: I857547f035c262dbc29ca8774a2fc42ab2a991a6 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-29bugfix: use B-rls bottlenecks image filewangyaoguang1-2/+3
JIRA: BOTTLENECK-74 Change-Id: I4cb84756d207be1f3917b2e730150b26d253e27e Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-29bugfix: integrate rubbos to ciwangyaoguang2-3/+21
JIRA: BOTTLENECK-74 Change-Id: Idbcbe3c51b361d11b16ab7a0de8b12fa347f9186 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-29Integrate rubbos internal control into ci flowwangyaoguang2-55/+98
JIRA: BOTTLENECK-74 Change-Id: I3634cc2f4896a426990814911fcba0f99927be2a Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-28install puppet service when creating OS instanceswangyaoguang1-7/+33
JIRA: BOTTLENECKS-73 Change-Id: I2500c6c81aa154cb8b025e3b425c4362fa798a18 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-28add httpd info in rubbos.conf fileMatthewLi1-1/+8
JIRA: BOTTLENECK-72 Change-Id: Ic1889c5b82bb74cbf919ec98cd16fa4a04c758ef Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-04-28bugfix for braces and testcase nameMatthewLi4-4/+4
Change-Id: Ic8731de1f9c62465a28225df4dd5b4b079cb6f49 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-04-28make all instances ssh accessiblewangyaoguang1-12/+50
1. add ssh access 2. for catalog execution, start first and clean in the end JIRA: BOTTLENECK-68 Change-Id: I208d8b0a48843c7f19cfcefb10aad87ef4c9424d Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-26read rubbos parameters from a config filewangyaoguang2-7/+51
JIRA: BOTTLENECK-68 Change-Id: I0387532f2e8f1d4f03689a42efa7fe745a303eb8 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-25Merge "obtain rubbos instance info and write them into conf file"yaoguang wang2-2/+62
2016-04-25obtain rubbos instance info and write them into conf fileMatthewLi2-2/+62
JIRA: BOTTLENECK-46 Change-Id: Ib519df7c3b532f7ae55847dc2f4cfd605ca0a24c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-04-23add a config file for rubbos test suitewangyaoguang1-0/+45
JIRA: BOTTLENECK-42 Change-Id: I8e61751479c8b8d58a756e38f695a018b1ccc036 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>
2016-04-22define the vstf test running workflow and add vstf into unified test entranceMatthewLi9-2/+14
JIRA: BOTTLENECK-47 the run_vstf.py file will be completed later which mainly focuses on instances creation and vstf configuration info for each testcase, the configuration info for each testcase in define under /vstf/testcase_cfg directory Change-Id: I2dc5615e2f377202fadaf351ac9d31ec93d8598a Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-04-22bugfix of run_rubbos.py in CI jobMatthewLi3-60/+312
JIRA: BOTTLENECKS-46 Change-Id: Iecdef87b1e158fad0168a91c5458bc618f62cad1 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-04-21Add main script for managing all puppet agents inside the controllerwangyaoguang1-0/+296
JIRA: BOTTLENECK-68 Change-Id: Ia1286dfb274851a8e242eb1dd687e93cf29eff28 Signed-off-by: wangyaoguang <sunshine.wang@huawei.com>