summaryrefslogtreecommitdiffstats
path: root/testsuites
AgeCommit message (Collapse)AuthorFilesLines
2017-09-29fix bug in reporting.liyin1-1/+4
JIRA: BOTTLENECK-206 Bug fix in reporting. Change-Id: I2d2269e9d35b279b3aa3b08d497d6e6bda2a5704 Signed-off-by: liyin <liyin11@huawei.com>
2017-08-10Merge "VNF characterizaion scale_out test, untested"Yu Yang (Gabriel)2-0/+143
2017-08-10Merge "VNF characterization scale_up test, untested"Yu Yang (Gabriel)2-0/+161
2017-08-09VNF characterizaion scale_out test, untestedRoss Brattain2-0/+143
The purpose of this test is to increase the number of VNFs being tested while monitoring aggregate performance scaling. requires https://gerrit.opnfv.org/gerrit/#/c/37993 Change-Id: I0015ef0326859512c7b9ab4c57ef9b5a710ca852 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-09VNF characterization scale_up test, untestedRoss Brattain2-0/+161
The purpose of this test is to increase the amount of resources provided to the VNF and monitor the ablilty of the VNF to scale requires https://gerrit.opnfv.org/gerrit/#/c/37991/ Change-Id: I4e2384ef120dea2348a623acc1d439696d95e73b Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-07system bandwidth testcase frame rebuildliyin9-92/+149
JIRA: BOTTLENECK-177 This patch will debug some error in system bandwidth testcase. use the new docker way to test this testcase. Bug fix about dashboard and test framework. Change-Id: I7167ffd75efab9a7780407aa5b9a4337ebb9b4c7 Signed-off-by: liyin <liyin11@huawei.com>
2017-08-03Merge "Change path to reporting db"Yu Yang (Gabriel)1-3/+5
2017-08-02Change path to reporting dbYang Yu1-3/+5
JIRA: BOTTLENECK-158 Change the path env to align with CI pipeline Change-Id: Ib5a7799c3eb3e5ba9056aa738c4c3b15995e3c11 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2017-08-02Merge "Add yardstick danube3.1 support."Yu Yang (Gabriel)1-7/+5
2017-08-02Merge "Bottlenecks testcase rebuild"Yu Yang (Gabriel)2-10/+15
2017-08-02Add yardstick danube3.1 support.Ace Lee1-7/+5
JIRA: BOTTLENECK-173 This patch will add a result handle for Yardstick danube This is only for bottlenecks danube to use. This will change time to 2 min to wait for Yardstick result back Change-Id: Icbd9d89f3e3816df947eaf6f70a12c86f74a2812 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-08-02Bottlenecks testcase rebuildAce Lee2-10/+15
JIRA: BOTTLENECK-175 After this patch, Bottlenecks will try to find the stress of the openstack system. we try to create 20 stacks one time. And 20 stacks the other time. we will try to find if openstack will pass threshhold twice. This patch only affact latest version Change-Id: I6146cf5c6fe0ac4968337cc36e07f715b64191d0 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-08-01Add support for arbitary DB reportingYang Yu1-1/+3
JIRA: BOTTLENECK-158 Support for arbitary DB reporting. TestperfDB and Dovetail DB are within currently consideration. Change-Id: I4373e5f295d26155e2b4fda59044cc4e922c3557 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2017-07-20Bug fix: Bottlenecks sometimes deadlockAce Lee1-11/+22
JIRA: BOTTLENECK-173 This patch will change the way to call multithreading. And change some encoding error about Yardstick config Change-Id: I04803bff6acaad1089d180b104652049f1f0a485 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-07-17Bug fix of Bottlenecks can't use CLIliyin2-1/+3
JIRA: BOTTLENECK-171 Bug fix of Bottlenecks can't use CLI to start test. Some docker-compose function delete to fit elk docker support. After this patch you could use bottlenecks testcase run posca_factor_ping to start this test. you also need to put the rc file to bottlenecks docker. Change-Id: I340e31185a499c81f9595a902df89d8f0ddf0cd3 Signed-off-by: liyin <liyin11@huawei.com>
2017-07-14Add frame support of elk one docker supportliyin3-43/+75
JIRA: BOTTLENECK-171 Add support of Bottlenecks docker frame refact, After this patch we will provide the ability of several installer. Add Yardstick_TAG to adjust yardstick docker version Change-Id: Ib431f8acf4a76b59f9d5e8783bcc7d2e5be208ae Signed-off-by: liyin <liyin11@huawei.com>
2017-06-05Remove redundant print functionsyuyang1-3/+0
JIRA: BOTTLENECK-158 Remove redundant print functions for report log Change-Id: I35c43fd3e30090bc296823faca55b49c0431a1fb Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-26Bugfix: json format transform for reportyuyang1-6/+5
JIRA: BOTTLENECK-158 The details part of report is not json formatted. This patch is to fix it. Change-Id: I089dae0c12e14935e4b7a5e7bdbe69f00e003f98 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-25Add reporting to MongoDByuyang1-2/+58
JIRA: BOTTLENECK-158 Add reporting function to community MongoDB Change-Id: Idebc191b20ad238dbdd129ce38131b79e7133e35 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-23Add test name check function and cleanupyuyang1-0/+0
JIRA: BOTTLENECK-158 Add test case/story name check and cleanup environment option. Change-Id: I07609c089ca78b0d2760c09c0312d7d1106c815a Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-10Delete testcase of rubbos and vstf.liyin344-26290/+0
JIRA:BOTTLENECK-167 This patch will delete vstf and rubbos testcase code. Include some testcase config file, if there will be someone who want to use this testcase maybe B or C version code will contain those testcase. if you use the D version code to run this two testcase we will info you that: Rubbos testsuite is not updating anymore. This entrance for running Rubbos within Bottlenecks is no longer supported. Change-Id: I04e4042ff3998b3696df2ed47a9ffab6f1620ec3 Signed-off-by: liyin <liyin11@huawei.com>
2017-04-21Add more information to Table for stress pingyuyang1-1/+1
JIRA: BOTTLENECK-164 Table for stress ping is showing results categories for different number of users. It does not show the results for every testing round, just show uniquely testing round with different success rates. This patch is to make sure showing every results. Change-Id: I3a33164024e3da23de31d546767f0fb29952983d Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-03-25Add task selection to test suite entrance fileyuyang3-1/+4
JIRA: BOTTLENECK-143 Add task selection to test suite entrance file Change-Id: Ia21b3121d104a457a66e2c77e3caf091e102f388 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-03-09Add liscense to file headersyuyang36-3324/+145
JIRA: BOTTLENECK-133 Some Yaml, XML and __init__.py file do not have liscense headers. This patch is to add headers to those files or delete those are deprecated. Change-Id: Ie059b1f1879eb420eec171f96985247510c74642 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-02-21quota limit for posca_stress_pingliyin2-3/+9
JIRA:BOTTLENECK-140 Those code will update an action of quota. Before out test begin we will make quota no limit. so we could do stress test. Those quota limit will change openstack forever. maybe will create damage for openstack. Change-Id: I0a6a06c6c303589881cb2ab7b754213ecf1a845f Signed-off-by: liyin <liyin11@huawei.com>
2017-02-20stress_test_dashboard_codeliyin7-3/+217
JIRA:BOTTLENECK-138 Those codes will create dashboard for stress test. And we have fixed a bug, that we will increace env prepare in this patch besides: we also add some code of how to yardstick api. Change-Id: I64bb249ee0df9fe37e998a784ba346719bf25197 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-17stress test of ping testcaseliyin4-5/+123
JIRA:BOTTLENECK-136 those code will add a new testcase: posca_stress_ping This will use docker python client to realize the fountion of calling yardstick to test. And yardstick will create several VM pairs to test. Because of the limites of quotas, we now create 2,5,10 VM pairs. Change-Id: I096250c547cd598c7c632a884b31d81c2be125f8 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-14Dashboard and output file code reconstructionliyin4-108/+143
JIRA:BOTTLENECK-134 Those code will change the way to create dashboard. And dashboard as a spare function to show data. And we add log system to dashboard creation. The output file is created anyway. Change-Id: Ia3c4d5a8ada27005702e3eed08757f61610da22f Signed-off-by: liyin <liyin11@huawei.com>
2017-02-13Merge "Bug fix: yardstick result return no content"Yu Yang (Gabriel)1-1/+5
2017-02-09Bug fix: yardstick result return no contentliyin1-1/+5
JIRA:BOTTLENECK-130 this patch will fix this bug: we try to expect this error, And we try to run it again. if failed, then yardstick RestAPI or have some error. Change-Id: I9fa63da637456a16c151f4fe7c566b3f5ff0e01d Signed-off-by: liyin <liyin11@huawei.com>
2017-02-09Add POSCA jenkins job supportyuyang2-5/+6
JIRA: BOTTLENECK-128 This patch is to make the POSCA testsuite could be built automatically for OPNFV CI job. Change-Id: I21d7fd553ce3591aea3391a33fe0a7b8579b57d4 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-02-09Log_dir bug fix&Add function of test_ip initliyin3-21/+8
JIRA:BOTTLENECK-129 This patch fix the error of log_dir can't be found. And change several thing: 1.Add if config don't have test_ip, it will use local:8888 as test ip. 2.Fix the bug in setup.py. 3.Add parser init to logger file. Change-Id: I808c69e2b2ff3c04f271cc7f3e14e1ab406a4d1b Signed-off-by: liyin <liyin11@huawei.com>
2017-02-07Bottlenecks stack config parser.liyin4-0/+36
JIRA:BOTTLENECK-126 realize the function of parsering stack config. include the function all the jira mationed. it's important for stack creating. this patch also include manager.py. This file modify some file such like template intial. Change-Id: Iaa6fdbde6bf9cb1ff9875d47268440dfe70ecc49 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-07Bottlenecks POSCA testing code reconstructionliyin3-146/+120
JIRA:BOTTLENECK-103 This is the foundation of adding stack samples. This code change a lot code. but it's a basic. Those code will be changed in the furture. Change-Id: I8d5bbb9cc401b1aaac54ec4dffc4c005a42d17ac Signed-off-by: liyin <liyin11@huawei.com>
2016-12-27bugfix: remove timeField for Kibana index-patternyuyang1-1/+0
JIRA: BOTTLENECK-121 Remove timeField item in index-pattern which causes kibana no reading test results. Change-Id: I855dba186cc0e0db8e5c9dbd7aa21df80722d70e Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-12-21Add flake8 style config and for POSCAyuyang15-155/+197
JIRA: BOTTLENECK-100 Adding flake8 configuration and fix for POSCA Change-Id: Ib822d5abde535263a4473d67c15cc17995f1417b Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-12-07cpu_burden script&configureliyin2-86/+82
JIRA: BOTTLENECK-118 This patch add a new function cpu_burden. there are two things: 1.add configure file of cpu_burden, this default file could run test case 2.add script of cpu_burden, this script use the configure file could use yardstick restful api call date. Change-Id: Icd88b317fb97d8f12d81279eaffc2d3effc8ab65 Signed-off-by: liyin <liyin11@huawei.com>
2016-12-02dashboard log info checkliyin1-1/+6
JIRA: BOTTLENECK-115 This patch change an error that last patch haven't covered. so i need to correct it. Change-Id: I1ab1fbe4e60463482728ec3ab58ec71c4e1d7049 Signed-off-by: liyin <liyin11@huawei.com>
2016-12-02dashboard bug: can't deploy dashboardliyin2-8/+33
JIRA: BOTTLENECK-116 This patch fix the bug that bottlenecks project can't establish dashboard, error message is elasticsearch is not install. after install elasticsearch, the error message is can't get ip. to fix this bug, change file requriment.txt and dashboard file. Change-Id: Ibad0dc46ab44d500b799bbf67e169d76c59e7199 Signed-off-by: liyin <liyin11@huawei.com>
2016-12-02add more debug infoliyin2-7/+9
JIRA: BOTTLENECK-115 This patch add some debug info to screen. so test situation will be displayed to every one. And it's could be easier to understand Change-Id: Iecf767eedf42825a13dae59235ab99d1767e744e Signed-off-by: liyin <liyin11@huawei.com>
2016-12-02bug fix patchliyin1-0/+2
JIRA: BOTTLENECK-114 this patch fix a problem that docker can't run because of lacking pyroute2. the way to solve it is add return value judgement to avoid circle return value error, is return relue when get into circle function Change-Id: I3af9abdb417abc5cf04c0e4db7eed576222bb1ea Signed-off-by: liyin <liyin11@huawei.com>
2016-12-01bug fix patchliyin2-3/+4
JIRA: BOTTLENECK-113 this patch fix a problem that docker can't run because of lacking pyroute2. the next is docker-compose file have some error that yardstick can't pull inluxdb container. the next is fix some bug incode. Change-Id: I238b69b456d2810e84bae5c134e6b05a8fc5da63 Signed-off-by: liyin <liyin11@huawei.com>
2016-12-01posca test suite urls changeliyin2-13/+15
JIRA: BOTTLENECK-111 This patch add two functions to bottlenecks project: 1.change yardstick urls and some return value. 2.bottlenecks project wait time change. Change-Id: I1a7f98f69676cda8cb0dc62276704c2cfcf240d8 Signed-off-by: liyin <liyin11@huawei.com>
2016-11-30posca test suite support influxDB containerliyin2-0/+10
JIRA: BOTTLENECK-110 This patch support bottlenecks testsuites posca support use yardstick rest api to pull InfluxDB container. the yardstick use this container to store its test result. Change-Id: I6ad6b5d7a9748c385787567b3d6d1dfe4cee167f Signed-off-by: liyin <liyin11@huawei.com>
2016-11-30posca system bandwidth dashboardliyin2-0/+103
JIRA: BOTTLENECK-109 this patch provide a dashboard of system_bandwidth test case when the test over this script would be run. and you could login host:5601 to see the view of dashboard. Change-Id: Ifb9717baa56a16fb2231a4e20d5688e34647d45b Signed-off-by: liyin <liyin11@huawei.com>
2016-11-30POSCA test case completeliyin3-95/+213
JIRA: BOTTLENECK-107 JIRA: BOTTLENECK-106 This patch has done the flowings: 1.Using the RESTful API form yardstick 2.Common function reuse. 3.If there is no test_ip it would use host ip and port as test_ip. 4.A little demo of dashboard. Now is can't work Change-Id: I1063176c762c40238019c73f5359f23bc5aab19c Signed-off-by: liyin <liyin11@huawei.com>
2016-11-05Add stack created judging logicyuyang1-4/+8
JIRA: BOTTLENECK-103 The stack created judging logic in Rubbos testsuite is optimized by replacing the wating method with judging from the stack created return value. Change-Id: Ie96476fbfb8baf995237f71b993cf9d381b94217 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-11-03Bugfix for random key generationyuyang2-1/+6
JIRA: BOTTLENECK-103 Fixing the bug when key generation within rubbos controller Change-Id: Ib444b3a8fab14217bda75bee307ea18652e8b4e4 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-10-25Modify POSCA code into PEP8 styleliyin7-299/+450
JIRA: BOTTLENECK-102 Modify all the code in the testcase POSCA into PEP8 style. Using more standard way to realize our function. Change-Id: Ic014678db454b8a36b36395c32b4769f6cf700be Signed-off-by: liyin <liyin11@huawei.com>
2016-10-08Merge "Add Factor Testcase CPU_Burden"Jun Li2-0/+132