summaryrefslogtreecommitdiffstats
path: root/testsuites
AgeCommit message (Collapse)AuthorFilesLines
2018-07-18Delete unmaintained/useless testsYang (Gabriel) Yu10-812/+0
Change-Id: I0c0606befb4e53fb503d9e5fcbf7d3bdf2237824 Signed-off-by: Yang (Gabriel) Yu <Gabriel.yuyang@huawei.com> (cherry picked from commit 857d64c56d918f7925e65cfc7e49dbe391454864)
2018-06-29Modify ping test thresholdopnfv-6.2.0Yang (Gabriel) Yu1-2/+2
Change the threshold to 5 VM pairs for basic common OPNFV verification requirements from Dovetail. Currently, offline test over apex pass: 1. ping subtest1: https://gist.github.com/gabrielyuyang/764b7ee636ac5502d5e561a348ae909b 2. ping subtest2: https://gist.github.com/gabrielyuyang/af17905a7e2379e870f492ea393c54c0 Working on testig over compass, trying to deploy a compass first. We could also see the result from compass on CI after this patch be merged. Results in Dovetial CI will also be updated then. Change-Id: If2cfe9988c046d733b30a23de3cd569ed06496e6 Signed-off-by: Yang (Gabriel) Yu <Gabriel.yuyang@huawei.com> (cherry picked from commit 62feef57918f110d423961a3989f77cf815058c6)
2018-05-11bug-fix: fix key error in soak throughputs CIYang Yu1-2/+2
In the redundant information deleting patch, results of each thread running is removed from message Queue resulting in counting the overall success threads in error status Change-Id: I3d12ddcc3ef996fca509741544a0f088428e948e Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com> (cherry picked from commit 68b91c0679550efe005278f8689b57bf14092ee1)
2018-05-03Some informations are redundantYang Yu1-2/+2
This patch is to remove the redundant results in Soak throughputs reports to TestDB Change-Id: Ib7e95df8353f3aa7b28187d352d5a6a213af2727 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com> (cherry picked from commit 2833e627cbf31eb89f313ec167f215c48fa70217)
2018-04-25Lazy creation of VM pairs for soak throuputs testsYang Yu2-19/+79
Add the lazy creation progress of VM pairs while testing dataplane traffic using netperf Change-Id: I3228ff444ea074b99cb1afaec138191358064e40 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com> (cherry picked from commit 61aafcb0ca6cab9c25d2df7d409f4fa8716ebe5f)
2018-03-16Add life-cycle throughputs testcaseGabriel Yu3-2/+169
JIRA: BOTTLENECK-186 Add skeleton of this test case: 1. Quotas modification 2. Call Yardstick to run test Change-Id: I02726bbfb2104151e5ef3c52a214775d30f9e743 Signed-off-by: Gabriel Yu <Gabriel.yuyang@huawei.com>
2018-03-16bugfix: copy hosts fileYang Yu1-2/+3
JIRA: BOTTLENECK-227 Operation of copying hosts file should follow the building of Yardstick docker Change-Id: I4d66efe8b823876a733d1877c26d1e0e263ca4da Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2018-03-15Merge "support hosts file copy"Yu Yang (Gabriel)1-0/+9
2018-03-14support hosts file copyYang Yu1-0/+9
JIRA: BOTTLENECK-227 Dovetail needs to regulate the hosts file of each docker to adapt SUTs. This patch is to make hosts file consistant in Bottlenecks-Yarstick docker. Change-Id: I93a57a5cac9c8d8c0a8b6660e84b8b351c455786 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2018-03-14bugfix: stress ping for offline supportYang Yu1-1/+1
JIRA: BOTTLENECK-226 See above Change-Id: Iba5d21348355a80d6c17deb1a12114d1d07e5c15 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2018-03-12bottlenecks offiline supportliyin8-40/+34
JIRA: BOTTLENECK-224 This patch for bottlenecks support offiline. By use some offiline image rather than yardstick env prepare. This will solve some problem happened in yardstick image builder. Change-Id: I62b6606570c2ea6ce365212c79777af01c47c9a6 Signed-off-by: liyin <liyin11@huawei.com>
2018-02-26Moon testcase bug fixAce Lee12-104/+372
JIRA: BOTTLENECK-220 The JIRA ticket is to suit moon version 4.3. There are some bugs to fix. Change-Id: Idf8b9a2b4dea6508738283e76457b8d1d25ceae9 Signed-off-by: Ace Lee <liyin11@huawei.com>
2018-02-26Merge "Testcase to find multi-stack storage bottlenecks"Ace Lee2-0/+270
2018-02-09Testcase to find multi-stack storage bottlenecksShubham Agarwal2-0/+270
JIRA: BOTTLENECK-203 This patch is used for multistack storage performance bottlenecks using yardstick as runner. Change-Id: I99f5b3caa3e454d75e293de2ad7dccbe6ce13887 Signed-off-by: Shubham Agarwal <shubham.agarwal.coder@gmail.com>
2018-02-09Testcase to find storage bottlenecks using Yardstick for MultistackShubham Agarwal2-0/+196
JIRA: BOTTLENECK-217 This patch is used to find storage bottlenecks while using yardstick for multistack. Change-Id: I8e64ff4145244a4aa822cf63c82d3a90a6579486 Signed-off-by: Shubham Agarwal <shubham.agarwal.coder@gmail.com>
2017-12-21bug-fix: fix neutron quota settingYang Yu4-4/+4
JIRA: BOTTLENECK-215 also fix the bug for type error: converted string Change-Id: Ic56b5ab5c49d8fdbcf49ba4571c2286d5f7bc422 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2017-12-15Merge "VNF scale-out testcase"Yu Yang (Gabriel)4-134/+202
2017-12-15VNF scale-out testcaseAce Lee4-134/+202
JIRA: BOTTLENECK-214 Bottlenecks VNF scale out testcase Change-Id: I05c4dec483062dd59c4b062516c8a6c1bc83ad6e Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-10-17Add moon feature tenant testcaseliyin2-0/+201
JIRA: BOTTLENECKS-212 Add moon feature tenant testcase to Bottlenecks Change-Id: I3795470fa5fab1866da346ec376dbd8f00f8205b Signed-off-by: liyin <liyin11@huawei.com>
2017-10-12Add moon feature resource testcaseliyin2-0/+163
JIRA: BOTTLENECKS-212 Add moon feature resource testcase to Bottlenecks Change-Id: Ib9bddfcd980e38c40d4a76b6cfd48bb9a656c81e Signed-off-by: liyin <liyin11@huawei.com>
2017-10-11Merge "Bottlenecks testpmd scale-up testcase."Ace Lee3-0/+181
2017-10-10Remove 'stable' from version for results pushed to DBGabriel Yu1-1/+1
JIRA: BOTTLENECK-210 RT. Change-Id: I5861f971e8afd69430bf5e322a566b27ce1eb2b7 Signed-off-by: Gabriel Yu <Gabriel.yuyang@huawei.com>
2017-10-10Bottlenecks testpmd scale-up testcase.liyin3-0/+181
JIRA: BOTTLENECK-205 This is the script of testpmd scale-up feature testcase. we will debug the dashboard. Change-Id: I4a6de0e7e1ea7c04639ece78a7b11b75128d8d2f Signed-off-by: liyin <liyin11@huawei.com>
2017-09-29fix bug in reporting.liyin1-1/+4
JIRA: BOTTLENECK-206 Bug fix in reporting. Change-Id: I2d2269e9d35b279b3aa3b08d497d6e6bda2a5704 Signed-off-by: liyin <liyin11@huawei.com>
2017-08-10Merge "VNF characterizaion scale_out test, untested"Yu Yang (Gabriel)2-0/+143
2017-08-10Merge "VNF characterization scale_up test, untested"Yu Yang (Gabriel)2-0/+161
2017-08-09VNF characterizaion scale_out test, untestedRoss Brattain2-0/+143
The purpose of this test is to increase the number of VNFs being tested while monitoring aggregate performance scaling. requires https://gerrit.opnfv.org/gerrit/#/c/37993 Change-Id: I0015ef0326859512c7b9ab4c57ef9b5a710ca852 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-09VNF characterization scale_up test, untestedRoss Brattain2-0/+161
The purpose of this test is to increase the amount of resources provided to the VNF and monitor the ablilty of the VNF to scale requires https://gerrit.opnfv.org/gerrit/#/c/37991/ Change-Id: I4e2384ef120dea2348a623acc1d439696d95e73b Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-07system bandwidth testcase frame rebuildliyin9-92/+149
JIRA: BOTTLENECK-177 This patch will debug some error in system bandwidth testcase. use the new docker way to test this testcase. Bug fix about dashboard and test framework. Change-Id: I7167ffd75efab9a7780407aa5b9a4337ebb9b4c7 Signed-off-by: liyin <liyin11@huawei.com>
2017-08-03Merge "Change path to reporting db"Yu Yang (Gabriel)1-3/+5
2017-08-02Change path to reporting dbYang Yu1-3/+5
JIRA: BOTTLENECK-158 Change the path env to align with CI pipeline Change-Id: Ib5a7799c3eb3e5ba9056aa738c4c3b15995e3c11 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2017-08-02Merge "Add yardstick danube3.1 support."Yu Yang (Gabriel)1-7/+5
2017-08-02Merge "Bottlenecks testcase rebuild"Yu Yang (Gabriel)2-10/+15
2017-08-02Add yardstick danube3.1 support.Ace Lee1-7/+5
JIRA: BOTTLENECK-173 This patch will add a result handle for Yardstick danube This is only for bottlenecks danube to use. This will change time to 2 min to wait for Yardstick result back Change-Id: Icbd9d89f3e3816df947eaf6f70a12c86f74a2812 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-08-02Bottlenecks testcase rebuildAce Lee2-10/+15
JIRA: BOTTLENECK-175 After this patch, Bottlenecks will try to find the stress of the openstack system. we try to create 20 stacks one time. And 20 stacks the other time. we will try to find if openstack will pass threshhold twice. This patch only affact latest version Change-Id: I6146cf5c6fe0ac4968337cc36e07f715b64191d0 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-08-01Add support for arbitary DB reportingYang Yu1-1/+3
JIRA: BOTTLENECK-158 Support for arbitary DB reporting. TestperfDB and Dovetail DB are within currently consideration. Change-Id: I4373e5f295d26155e2b4fda59044cc4e922c3557 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2017-07-20Bug fix: Bottlenecks sometimes deadlockAce Lee1-11/+22
JIRA: BOTTLENECK-173 This patch will change the way to call multithreading. And change some encoding error about Yardstick config Change-Id: I04803bff6acaad1089d180b104652049f1f0a485 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-07-17Bug fix of Bottlenecks can't use CLIliyin2-1/+3
JIRA: BOTTLENECK-171 Bug fix of Bottlenecks can't use CLI to start test. Some docker-compose function delete to fit elk docker support. After this patch you could use bottlenecks testcase run posca_factor_ping to start this test. you also need to put the rc file to bottlenecks docker. Change-Id: I340e31185a499c81f9595a902df89d8f0ddf0cd3 Signed-off-by: liyin <liyin11@huawei.com>
2017-07-14Add frame support of elk one docker supportliyin3-43/+75
JIRA: BOTTLENECK-171 Add support of Bottlenecks docker frame refact, After this patch we will provide the ability of several installer. Add Yardstick_TAG to adjust yardstick docker version Change-Id: Ib431f8acf4a76b59f9d5e8783bcc7d2e5be208ae Signed-off-by: liyin <liyin11@huawei.com>
2017-06-05Remove redundant print functionsyuyang1-3/+0
JIRA: BOTTLENECK-158 Remove redundant print functions for report log Change-Id: I35c43fd3e30090bc296823faca55b49c0431a1fb Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-26Bugfix: json format transform for reportyuyang1-6/+5
JIRA: BOTTLENECK-158 The details part of report is not json formatted. This patch is to fix it. Change-Id: I089dae0c12e14935e4b7a5e7bdbe69f00e003f98 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-25Add reporting to MongoDByuyang1-2/+58
JIRA: BOTTLENECK-158 Add reporting function to community MongoDB Change-Id: Idebc191b20ad238dbdd129ce38131b79e7133e35 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-23Add test name check function and cleanupyuyang1-0/+0
JIRA: BOTTLENECK-158 Add test case/story name check and cleanup environment option. Change-Id: I07609c089ca78b0d2760c09c0312d7d1106c815a Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-05-10Delete testcase of rubbos and vstf.liyin344-26290/+0
JIRA:BOTTLENECK-167 This patch will delete vstf and rubbos testcase code. Include some testcase config file, if there will be someone who want to use this testcase maybe B or C version code will contain those testcase. if you use the D version code to run this two testcase we will info you that: Rubbos testsuite is not updating anymore. This entrance for running Rubbos within Bottlenecks is no longer supported. Change-Id: I04e4042ff3998b3696df2ed47a9ffab6f1620ec3 Signed-off-by: liyin <liyin11@huawei.com>
2017-04-21Add more information to Table for stress pingyuyang1-1/+1
JIRA: BOTTLENECK-164 Table for stress ping is showing results categories for different number of users. It does not show the results for every testing round, just show uniquely testing round with different success rates. This patch is to make sure showing every results. Change-Id: I3a33164024e3da23de31d546767f0fb29952983d Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-03-25Add task selection to test suite entrance fileyuyang3-1/+4
JIRA: BOTTLENECK-143 Add task selection to test suite entrance file Change-Id: Ia21b3121d104a457a66e2c77e3caf091e102f388 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-03-09Add liscense to file headersyuyang36-3324/+145
JIRA: BOTTLENECK-133 Some Yaml, XML and __init__.py file do not have liscense headers. This patch is to add headers to those files or delete those are deprecated. Change-Id: Ie059b1f1879eb420eec171f96985247510c74642 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-02-21quota limit for posca_stress_pingliyin2-3/+9
JIRA:BOTTLENECK-140 Those code will update an action of quota. Before out test begin we will make quota no limit. so we could do stress test. Those quota limit will change openstack forever. maybe will create damage for openstack. Change-Id: I0a6a06c6c303589881cb2ab7b754213ecf1a845f Signed-off-by: liyin <liyin11@huawei.com>
2017-02-20stress_test_dashboard_codeliyin7-3/+217
JIRA:BOTTLENECK-138 Those codes will create dashboard for stress test. And we have fixed a bug, that we will increace env prepare in this patch besides: we also add some code of how to yardstick api. Change-Id: I64bb249ee0df9fe37e998a784ba346719bf25197 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-17stress test of ping testcaseliyin4-5/+123
JIRA:BOTTLENECK-136 those code will add a new testcase: posca_stress_ping This will use docker python client to realize the fountion of calling yardstick to test. And yardstick will create several VM pairs to test. Because of the limites of quotas, we now create 2,5,10 VM pairs. Change-Id: I096250c547cd598c7c632a884b31d81c2be125f8 Signed-off-by: liyin <liyin11@huawei.com>