summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-08-11system bandwidth testcase frame rebuildstable/danubeliyin11-92/+151
JIRA: BOTTLENECK-177 This patch will debug some error in system bandwidth testcase. use the new docker way to test this testcase. Bug fix about dashboard and test framework. Change-Id: I7167ffd75efab9a7780407aa5b9a4337ebb9b4c7 Signed-off-by: liyin <liyin11@huawei.com> (cherry picked from commit 205156554daf981d01c4f43c6a79f6519525916e)
2017-08-03Change path to reporting dbYang Yu1-3/+5
JIRA: BOTTLENECK-158 Change the path env to align with CI pipeline Change-Id: Ib5a7799c3eb3e5ba9056aa738c4c3b15995e3c11 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com> (cherry picked from commit b20de06b02a6eec449e5ac1e99226f35728b248d)
2017-08-02Add modify output file functionliyin2-8/+8
JIRA: BOTTLENECK-176 Add function which could modify outfile name. Also a bug fix about yardstick docker version should be danube.3.1 Change-Id: I0e0bb5b26cae44358311d17932c698505560974c Signed-off-by: liyin <liyin11@huawei.com>
2017-08-02Add yardstick danube3.1 support.Ace Lee2-8/+6
JIRA: BOTTLENECK-173 This patch will add a result handle for Yardstick danube This is only for bottlenecks danube to use. This will change time to 2 min to wait for Yardstick result back Change-Id: Icbd9d89f3e3816df947eaf6f70a12c86f74a2812 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-08-02Bottlenecks testcase rebuildAce Lee3-12/+23
JIRA: BOTTLENECK-175 After this patch, Bottlenecks will try to find the stress of the openstack system. we try to create 20 stacks one time. And 20 stacks the other time. we will try to find if openstack will pass threshhold twice. This patch only affact latest version Change-Id: I6146cf5c6fe0ac4968337cc36e07f715b64191d0 Signed-off-by: Ace Lee <liyin11@huawei.com> (cherry picked from commit 904396874f08208bde66c953fcfe31906a6588d1)
2017-08-02Add support for arbitary DB reportingYang Yu1-1/+3
JIRA: BOTTLENECK-158 Support for arbitary DB reporting. TestperfDB and Dovetail DB are within currently consideration. Change-Id: I4373e5f295d26155e2b4fda59044cc4e922c3557 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com> (cherry picked from commit fd66a0466e931e28ebd1f0925e9c9a0c28912a02)
2017-08-01Bottlenecks Https supportAce Lee1-15/+8
JIRA: BOTTLENECK-174 Bottlenecks Https Support After this patch, you could use https method to run Bottlenecks Motion that if you want to use https, you need to write down the cacert at Bottlenecks /tmp/ dir Change-Id: I86fda57c76179d52e7d4c06c7289e2fcc15a4bc0 Signed-off-by: Ace Lee <liyin11@huawei.com> (cherry picked from commit 0b47f013a0af6549cee590762bbd979729de0ead)
2017-07-24Bug fix: Bottlenecks sometimes deadlockdanube.3.1Ace Lee2-12/+23
JIRA: BOTTLENECK-173 This patch will change the way to call multithreading. And change some encoding error about Yardstick config Change-Id: I04803bff6acaad1089d180b104652049f1f0a485 Signed-off-by: Ace Lee <liyin11@huawei.com> (cherry picked from commit fe6c624370552e141cc80d1b697de7d9717763c9)
2017-07-18Bug fix: fit Yardstick 3.1 version.liyin1-1/+11
JIRA: BOTTLENECK-173 This patch will add a file to create some yardstick conf, Yardstick will use this file to manage output file type. Change-Id: I1d265af9f0b9b5132dc63c4d6d95d5bc194c7ff6 Signed-off-by: liyin <liyin11@huawei.com> (cherry picked from commit 962b6269fdee0991251304a2b16cba78961d4b42)
2017-07-18Add docker container manage functionliyin1-0/+91
JIRA: BOTTLENECK-171 This patch will add a file to create some function, Bottlenecks will use those function to manage docker. for example: docker ip address , create docker ,remove docker. Change-Id: I60e70ed9c6c7805e85b183ea3b19295fce68f657 Signed-off-by: liyin <liyin11@huawei.com> (cherry picked from commit c821b792db011dbbe1c70d256fadbe9c745570ff)
2017-07-18Bug fix of Bottlenecks can't use CLIliyin9-160/+5
JIRA: BOTTLENECK-171 Bug fix of Bottlenecks can't use CLI to start test. Some docker-compose function delete to fit elk docker support. After this patch you could use bottlenecks testcase run posca_factor_ping to start this test. you also need to put the rc file to bottlenecks docker. Change-Id: I340e31185a499c81f9595a902df89d8f0ddf0cd3 Signed-off-by: liyin <liyin11@huawei.com> (cherry picked from commit 75f99aaeadada56dfc974746cd83fec275133a3c)
2017-07-18Add frame support of elk one docker supportliyin9-52/+235
JIRA: BOTTLENECK-171 Add support of Bottlenecks docker frame refact, After this patch we will provide the ability of several installer. Add Yardstick_TAG to adjust yardstick docker version Change-Id: Ib431f8acf4a76b59f9d5e8783bcc7d2e5be208ae Signed-off-by: liyin <liyin11@huawei.com> (cherry picked from commit bde702f95563cf953c32f9bfd0587083a3fea26d)
2017-06-21Docs for Danube 3danube.3.0yuyang5-81/+110
JIRA: BOTTLENECKS-137 Documentation for Danube 3 Change-Id: Ic4b2611028fa45c0b731e998296e5000e35a33f6 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 38074a81bcb2a97bd59f274815dbfa67ab487c59)
2017-06-19Remove redundant print functionsyuyang1-3/+0
JIRA: BOTTLENECK-158 Remove redundant print functions for report log Change-Id: I35c43fd3e30090bc296823faca55b49c0431a1fb Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 6de46e9144ee0bc2962460c600e4b3a888d934ef)
2017-06-05Merge "Bugfix: json format transform for report" into stable/danubeYu Yang (Gabriel)1-6/+5
2017-06-05Bugfix: json format transform for reportyuyang1-6/+5
JIRA: BOTTLENECK-158 The details part of report is not json formatted. This patch is to fix it. Change-Id: I089dae0c12e14935e4b7a5e7bdbe69f00e003f98 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit e4a17446f0f02d6ea950278074d88db6c09c5bb6)
2017-06-05Bugfix: dockerfile does not support basenameyuyang1-1/+1
JIRA: BOTTLENECK-158 Remove basename commond in docker-compose file Change-Id: If06bac1903b2b830f9e5e4133f3315fb9f424c18 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit fd9ae2109a6202c17a89cd544a3b74747c3b729b)
2017-06-05Add reporting to MongoDByuyang5-13/+72
JIRA: BOTTLENECK-158 Add reporting function to community MongoDB Change-Id: Idebc191b20ad238dbdd129ce38131b79e7133e35 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 8fd28cfeaca4ac29f4357c51eb0c0374d0d0a409)
2017-06-02Add test name check function and cleanupyuyang5-95/+76
JIRA: BOTTLENECK-158 Add test case/story name check and cleanup environment option. Change-Id: I07609c089ca78b0d2760c09c0312d7d1106c815a Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 95748aca5de2e906b0f555e7dbf3829e397d6415)
2017-05-19Delete testcase of rubbos and vstf.liyin367-27333/+0
JIRA:BOTTLENECK-167 This patch will delete vstf and rubbos testcase code. Include some testcase config file, if there will be someone who want to use this testcase maybe B or C version code will contain those testcase. if you use the D version code to run this two testcase we will info you that: Rubbos testsuite is not updating anymore. This entrance for running Rubbos within Bottlenecks is no longer supported. Change-Id: I04e4042ff3998b3696df2ed47a9ffab6f1620ec3 Signed-off-by: liyin <liyin11@huawei.com> (cherry picked from commit 6a8257127b3dce1f18a650afe6921a34b6c6f5b8)
2017-05-04Merge "Add description of environment clean-up" into stable/danubedanube.2.0Yu Yang (Gabriel)1-0/+20
2017-05-04Change PTL informatin in INFOyuyang1-2/+2
Due to recent email voting results, change the PTL promotion result in INFO. Detailed information could be found below. https://lists.opnfv.org/pipermail/opnfv-tsc/2017-April/003422.html Change-Id: I5c942668cbe03e697bd0865cc8aee1980afed104 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 1a3307f228055404930a7d53dc225270a70a174a)
2017-05-04Add description of environment clean-upyuyang1-0/+20
JIRA: BOTTLENECK-165 More details of the environment clean-up for ping test case Change-Id: I4b12a219155400235ae2bcb970efb3ba237153d9 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 15355fd57080a7ac625549e9e9b98237164e46d2)
2017-04-28Docs for Danube 2.0yuyang5-35/+58
JIRA: BOTTLENECK-165 Documents adapted to Danube 2.0 Change-Id: Ic46cc0ad2f2706986b294f539bba1264ec6f8b0b Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit e2fd28497f0083099181a9b65696e5ea8c422007)
2017-04-22Add more information to Table for stress pingyuyang1-1/+1
JIRA: BOTTLENECK-164 Table for stress ping is showing results categories for different number of users. It does not show the results for every testing round, just show uniquely testing round with different success rates. This patch is to make sure showing every results. Change-Id: I3a33164024e3da23de31d546767f0fb29952983d Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-04-22Bugfix of docker-compose file for privilegedyuyang1-0/+3
JIRA: BOTTLENECK-163 privileged option in docker-compose file should be true to avoid "permission deny" error when accessing directories Change-Id: I1a57146236efb5fe71405c5b7682af706a8814bf Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit c988d5fa114a659f19f0db1fd0db9f6abc5247dd)
2017-04-11Fix code style issues for specificed pathyuyang4-4/+20
JIRA: BOTTLENECK-100 Fix code syle issues for the path flake8 specified before flake8 check merged into CI pipeline. Change-Id: Iee59bada206fafd4740023e90d08a4b4a7a030db Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit fc30c5208a680d0059cfa48891a1d97747f7f778)
2017-03-31Finalize docs for Danube 1.0danube.1.RC1danube.1.0yuyang3-26/+75
JIRA: BOTTLENECK-145 Polishing docs and finalizing docs for Danube 1.0. Change-Id: Iea5490785bce802aff37b7f52172d7f14ea358e0 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 529508e4be82ef3e329e9ca3bec6210fb5ef90e6)
2017-03-29bugfix: bottlenecks devguide in docs.opnfv.orgyuyang7-0/+0
JIRA: BOTTLENECK-149 Adjust the directory structure to make Bottlenecks devguide on docs.opnfv.org. Change-Id: Ib773a26ca5f4eaee94834ff641ec45531ef3025c Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 3480c32bb5113a8a5f56b7e1db82c3a9236418fb)
2017-03-29bugfix: fix bugs for running 'teststory run'yuyang4-8/+3
JIRA: BOTTLENECK-144 utils/parser.py:56 has incorrect var:cls which cause pass more var to testcase_read function. Change-Id: I2d4b93f95d19a205e537515529746f6d9e13fe2c Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 1760c89637ac71b877a17896e5768640a20360c3)
2017-03-29Add docker clean-up for run testyuyang2-1/+119
JIRA: BOTTLENECK-148 Currently, only OPNFV CI includes env-cleanup for Bottlenecks. It is preferable to also include the operation locally for test automation and repeatability. Changes: 1. Translate tab into 4 spaces Change-Id: I9f4efb95c155e442afd3141c00f707421c61b2da Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit fe83578bd2fe1a09f8334f85e30a0afbb68cc5cc)
2017-03-27CLI acommadation to the current test case calling methodyuyang4-33/+26
JIRA: BOTTLENECK-144 Calling method of POSCA test case has changed. CLI for calling the run test case script should also adjust. Change-Id: Ia007b658903c8133c824358943f325b070d1e195 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 2bf5dbd9b63288e8ce77c7c4e42df8b1e4deb2ce)
2017-03-27Add task selection to test suite entrance fileyuyang4-37/+68
JIRA: BOTTLENECK-143 Add task selection to test suite entrance file Change-Id: Ia21b3121d104a457a66e2c77e3caf091e102f388 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 15c3931fd723f565e847033bc6c1df818a761b4a)
2017-03-27Update document according to Danube release planyuyang9-85/+163
JIRA: BOTTLENECK-145 Currently, the docs of Bottlenecks still follow the format from Colorado. Some work need to be done regarding reorganizing the contents according to the Danube release. Change-Id: I4ece51abc558bb7128565125224b5e8579a198f7 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 566a7246d6a8e9451be511ddae84f7067bf013ea)
2017-03-23Bugfix: set docker api version to 1.24yuyang1-1/+1
JIRA: BOTTLENECK-146 Set docker api version to 1.24 Change-Id: Id05527e628c7fa6ff3382bd68741bd36fc706fe6 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 4b36a57727cad302976ee38ad0046a7595339849)
2017-03-23Bugfix: fix docker version to 2.1.0yuyang1-1/+1
JIRA: BOTTLENECK-146 Fix the docker API library to 2.1.0 Change-Id: I4cf2801db2adc28325a587411f802515176e8d03 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 3a3bb4df2db4f58d3e76dcdd41b3327bd2094eb3)
2017-03-23Bugfix: fix docker version instead of API versionyuyang1-1/+1
JIRA: BOTTLENECK-146 In 31527, API version is 1.24, docker version should be 1.12 Change-Id: I529f16372aaa00b4fc802344b559453677b7b560 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 2f1f35479f0449d4b91eb5c28e94a50af202e18f)
2017-03-23bugfix: docker client version newer than docker serveryuyang1-1/+1
JIRA: BOTTLENECK-146 Docker client is needed in Bottlenecks docker for the purpose to use docker command within docker. The inconsistence of docker client version with docker server version causing building falure. Change-Id: Ib4ecf9c40db5492438b27550636413e5f3a69ea3 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 136b188b4713f4ec2a20d6a09b4284a02f520aa3)
2017-03-23Update docs structure according to Danube agreementyuyang17-0/+0
JIRA: BOTTLENECK-141 docs.opnfv.org has trouble indexing all the testing docs. So testing projects have to adjust the docs structure. Change-Id: I586b2c1626ca4fb8e1980130e132e6079a0977a7 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit 3bc1b97e2a594959a9966c6f967e50fa33d2893b)
2017-03-23Update test suite running entranceyuyang1-70/+14
JIRA: BOTTLENECK-142 Update the entrance for POSCA test suite.Currently, test case selection for POSCA is not support for this entrance. The function will be added later. For Rubbos and VSTF, after OPNFV Colorado release, they are not updating anymore. This entrance for running them within Bottlenecks is no longer supported. These testsuites are also not in the release plan with Bottlenecks since then. If you want to run Rubbos and VSTF, please refer to ealier releases. Change-Id: Idaf7da147489c6371e46ac3234179133762a05cd Signed-off-by: yuyang <Gabriel.yuyang@huawei.com> (cherry picked from commit fc9a89857e121c2015a34e49c441cb234fa10c13)
2017-03-10Merge "Add liscense to file headers"Yu Yang (Gabriel)62-5442/+172
2017-03-09Add liscense to file headersyuyang62-5442/+172
JIRA: BOTTLENECK-133 Some Yaml, XML and __init__.py file do not have liscense headers. This patch is to add headers to those files or delete those are deprecated. Change-Id: Ie059b1f1879eb420eec171f96985247510c74642 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-03-09Apply docs strucutre to Danube agreementyuyang28-15/+12
JIRA: BOTTLENECK-137 According to the agreement in Testperf meeting. Change the structure of docs. Change-Id: Ie370de1e7a24c918aedc8a2cdb2cca0508ef4257 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-03-01Merge "Add Danube Document Framework"Yu Yang (Gabriel)32-144/+492
2017-02-23Add Danube Document Frameworkyuyang32-144/+492
JIRA: BOTTLENECK-137 Bottlenecks document framwork meeting Danube document requirement. Changes: 1. Add POSCA testsuite document 2. Combine configuration and installation directory 2.1 https://wiki.opnfv.org/display/DEV/Documentation+Toolchain 3. Change file names in /user_guide 4. Add requirements notes to release notes 5. Add stress test configuartion details Change-Id: I8d9055097ddae280d985120d4501819d20ad1dcb Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-02-21quota limit for posca_stress_pingliyin5-5/+88
JIRA:BOTTLENECK-140 Those code will update an action of quota. Before out test begin we will make quota no limit. so we could do stress test. Those quota limit will change openstack forever. maybe will create damage for openstack. Change-Id: I0a6a06c6c303589881cb2ab7b754213ecf1a845f Signed-off-by: liyin <liyin11@huawei.com>
2017-02-20stress_test_dashboard_codeliyin8-5/+236
JIRA:BOTTLENECK-138 Those codes will create dashboard for stress test. And we have fixed a bug, that we will increace env prepare in this patch besides: we also add some code of how to yardstick api. Change-Id: I64bb249ee0df9fe37e998a784ba346719bf25197 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-17stress test of ping testcaseliyin9-8/+139
JIRA:BOTTLENECK-136 those code will add a new testcase: posca_stress_ping This will use docker python client to realize the fountion of calling yardstick to test. And yardstick will create several VM pairs to test. Because of the limites of quotas, we now create 2,5,10 VM pairs. Change-Id: I096250c547cd598c7c632a884b31d81c2be125f8 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-14Dashboard and output file code reconstructionliyin5-108/+158
JIRA:BOTTLENECK-134 Those code will change the way to create dashboard. And dashboard as a spare function to show data. And we add log system to dashboard creation. The output file is created anyway. Change-Id: Ia3c4d5a8ada27005702e3eed08757f61610da22f Signed-off-by: liyin <liyin11@huawei.com>
2017-02-13Merge "Bug fix: yardstick result return no content"Yu Yang (Gabriel)1-1/+5