summaryrefslogtreecommitdiffstats
path: root/testsuites/posca/testcase_cfg
AgeCommit message (Collapse)AuthorFilesLines
2018-07-18disable elk in CI pipelineYang (Gabriel) Yu10-10/+10
Change-Id: Iedcfcf52fb348c6a3f1ca01d6d9a7e09ff654162 Signed-off-by: Yang (Gabriel) Yu <Gabriel.yuyang@huawei.com>
2018-07-18Delete unmaintained/useless testsYang (Gabriel) Yu5-108/+0
Change-Id: I0c0606befb4e53fb503d9e5fcbf7d3bdf2237824 Signed-off-by: Yang (Gabriel) Yu <Gabriel.yuyang@huawei.com>
2018-06-29Modify ping test thresholdYang (Gabriel) Yu1-2/+2
Change the threshold to 5 VM pairs for basic common OPNFV verification requirements from Dovetail. Currently, offline test over apex pass: 1. ping subtest1: https://gist.github.com/gabrielyuyang/764b7ee636ac5502d5e561a348ae909b 2. ping subtest2: https://gist.github.com/gabrielyuyang/af17905a7e2379e870f492ea393c54c0 Working on testig over compass, trying to deploy a compass first. We could also see the result from compass on CI after this patch be merged. Results in Dovetial CI will also be updated then. Change-Id: If2cfe9988c046d733b30a23de3cd569ed06496e6 Signed-off-by: Yang (Gabriel) Yu <Gabriel.yuyang@huawei.com>
2018-04-21Lazy creation of VM pairs for soak throuputs testsYang Yu1-3/+3
Add the lazy creation progress of VM pairs while testing dataplane traffic using netperf Change-Id: I3228ff444ea074b99cb1afaec138191358064e40 Signed-off-by: Yang Yu <Gabriel.yuyang@huawei.com>
2018-03-16Add life-cycle throughputs testcaseGabriel Yu1-0/+35
JIRA: BOTTLENECK-186 Add skeleton of this test case: 1. Quotas modification 2. Call Yardstick to run test Change-Id: I02726bbfb2104151e5ef3c52a214775d30f9e743 Signed-off-by: Gabriel Yu <Gabriel.yuyang@huawei.com>
2018-03-12bottlenecks offiline supportliyin2-3/+5
JIRA: BOTTLENECK-224 This patch for bottlenecks support offiline. By use some offiline image rather than yardstick env prepare. This will solve some problem happened in yardstick image builder. Change-Id: I62b6606570c2ea6ce365212c79777af01c47c9a6 Signed-off-by: liyin <liyin11@huawei.com>
2018-02-26Moon testcase bug fixAce Lee2-19/+31
JIRA: BOTTLENECK-220 The JIRA ticket is to suit moon version 4.3. There are some bugs to fix. Change-Id: Idf8b9a2b4dea6508738283e76457b8d1d25ceae9 Signed-off-by: Ace Lee <liyin11@huawei.com>
2018-02-26Merge "Testcase to find multi-stack storage bottlenecks"Ace Lee1-0/+34
2018-02-09Testcase to find multi-stack storage bottlenecksShubham Agarwal1-0/+34
JIRA: BOTTLENECK-203 This patch is used for multistack storage performance bottlenecks using yardstick as runner. Change-Id: I99f5b3caa3e454d75e293de2ad7dccbe6ce13887 Signed-off-by: Shubham Agarwal <shubham.agarwal.coder@gmail.com>
2018-02-09Testcase to find storage bottlenecks using Yardstick for MultistackShubham Agarwal1-0/+32
JIRA: BOTTLENECK-217 This patch is used to find storage bottlenecks while using yardstick for multistack. Change-Id: I8e64ff4145244a4aa822cf63c82d3a90a6579486 Signed-off-by: Shubham Agarwal <shubham.agarwal.coder@gmail.com>
2017-12-15Merge "VNF scale-out testcase"Yu Yang (Gabriel)1-9/+16
2017-12-15VNF scale-out testcaseAce Lee1-9/+16
JIRA: BOTTLENECK-214 Bottlenecks VNF scale out testcase Change-Id: I05c4dec483062dd59c4b062516c8a6c1bc83ad6e Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-10-17Add moon feature tenant testcaseliyin1-0/+35
JIRA: BOTTLENECKS-212 Add moon feature tenant testcase to Bottlenecks Change-Id: I3795470fa5fab1866da346ec376dbd8f00f8205b Signed-off-by: liyin <liyin11@huawei.com>
2017-10-12Add moon feature resource testcaseliyin1-0/+30
JIRA: BOTTLENECKS-212 Add moon feature resource testcase to Bottlenecks Change-Id: Ib9bddfcd980e38c40d4a76b6cfd48bb9a656c81e Signed-off-by: liyin <liyin11@huawei.com>
2017-10-10Bottlenecks testpmd scale-up testcase.liyin1-0/+39
JIRA: BOTTLENECK-205 This is the script of testpmd scale-up feature testcase. we will debug the dashboard. Change-Id: I4a6de0e7e1ea7c04639ece78a7b11b75128d8d2f Signed-off-by: liyin <liyin11@huawei.com>
2017-08-10Merge "VNF characterizaion scale_out test, untested"Yu Yang (Gabriel)1-0/+18
2017-08-10Merge "VNF characterization scale_up test, untested"Yu Yang (Gabriel)1-0/+29
2017-08-09VNF characterizaion scale_out test, untestedRoss Brattain1-0/+18
The purpose of this test is to increase the number of VNFs being tested while monitoring aggregate performance scaling. requires https://gerrit.opnfv.org/gerrit/#/c/37993 Change-Id: I0015ef0326859512c7b9ab4c57ef9b5a710ca852 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-09VNF characterization scale_up test, untestedRoss Brattain1-0/+29
The purpose of this test is to increase the amount of resources provided to the VNF and monitor the ablilty of the VNF to scale requires https://gerrit.opnfv.org/gerrit/#/c/37991/ Change-Id: I4e2384ef120dea2348a623acc1d439696d95e73b Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-08-07system bandwidth testcase frame rebuildliyin1-15/+19
JIRA: BOTTLENECK-177 This patch will debug some error in system bandwidth testcase. use the new docker way to test this testcase. Bug fix about dashboard and test framework. Change-Id: I7167ffd75efab9a7780407aa5b9a4337ebb9b4c7 Signed-off-by: liyin <liyin11@huawei.com>
2017-08-02Bottlenecks testcase rebuildAce Lee1-2/+3
JIRA: BOTTLENECK-175 After this patch, Bottlenecks will try to find the stress of the openstack system. we try to create 20 stacks one time. And 20 stacks the other time. we will try to find if openstack will pass threshhold twice. This patch only affact latest version Change-Id: I6146cf5c6fe0ac4968337cc36e07f715b64191d0 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-07-14Add frame support of elk one docker supportliyin1-5/+5
JIRA: BOTTLENECK-171 Add support of Bottlenecks docker frame refact, After this patch we will provide the ability of several installer. Add Yardstick_TAG to adjust yardstick docker version Change-Id: Ib431f8acf4a76b59f9d5e8783bcc7d2e5be208ae Signed-off-by: liyin <liyin11@huawei.com>
2017-03-25Add task selection to test suite entrance fileyuyang1-0/+0
JIRA: BOTTLENECK-143 Add task selection to test suite entrance file Change-Id: Ia21b3121d104a457a66e2c77e3caf091e102f388 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-03-09Add liscense to file headersyuyang8-9/+63
JIRA: BOTTLENECK-133 Some Yaml, XML and __init__.py file do not have liscense headers. This patch is to add headers to those files or delete those are deprecated. Change-Id: Ie059b1f1879eb420eec171f96985247510c74642 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-02-21quota limit for posca_stress_pingliyin1-1/+1
JIRA:BOTTLENECK-140 Those code will update an action of quota. Before out test begin we will make quota no limit. so we could do stress test. Those quota limit will change openstack forever. maybe will create damage for openstack. Change-Id: I0a6a06c6c303589881cb2ab7b754213ecf1a845f Signed-off-by: liyin <liyin11@huawei.com>
2017-02-17stress test of ping testcaseliyin1-0/+22
JIRA:BOTTLENECK-136 those code will add a new testcase: posca_stress_ping This will use docker python client to realize the fountion of calling yardstick to test. And yardstick will create several VM pairs to test. Because of the limites of quotas, we now create 2,5,10 VM pairs. Change-Id: I096250c547cd598c7c632a884b31d81c2be125f8 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-14Dashboard and output file code reconstructionliyin1-1/+1
JIRA:BOTTLENECK-134 Those code will change the way to create dashboard. And dashboard as a spare function to show data. And we add log system to dashboard creation. The output file is created anyway. Change-Id: Ia3c4d5a8ada27005702e3eed08757f61610da22f Signed-off-by: liyin <liyin11@huawei.com>
2017-02-09Add POSCA jenkins job supportyuyang1-3/+3
JIRA: BOTTLENECK-128 This patch is to make the POSCA testsuite could be built automatically for OPNFV CI job. Change-Id: I21d7fd553ce3591aea3391a33fe0a7b8579b57d4 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2017-02-07Bottlenecks stack config parser.liyin1-0/+9
JIRA:BOTTLENECK-126 realize the function of parsering stack config. include the function all the jira mationed. it's important for stack creating. this patch also include manager.py. This file modify some file such like template intial. Change-Id: Iaa6fdbde6bf9cb1ff9875d47268440dfe70ecc49 Signed-off-by: liyin <liyin11@huawei.com>
2017-02-07Bottlenecks POSCA testing code reconstructionliyin1-11/+15
JIRA:BOTTLENECK-103 This is the foundation of adding stack samples. This code change a lot code. but it's a basic. Those code will be changed in the furture. Change-Id: I8d5bbb9cc401b1aaac54ec4dffc4c005a42d17ac Signed-off-by: liyin <liyin11@huawei.com>
2016-12-07cpu_burden script&configureliyin1-8/+10
JIRA: BOTTLENECK-118 This patch add a new function cpu_burden. there are two things: 1.add configure file of cpu_burden, this default file could run test case 2.add script of cpu_burden, this script use the configure file could use yardstick restful api call date. Change-Id: Icd88b317fb97d8f12d81279eaffc2d3effc8ab65 Signed-off-by: liyin <liyin11@huawei.com>
2016-12-01posca test suite urls changeliyin1-7/+7
JIRA: BOTTLENECK-111 This patch add two functions to bottlenecks project: 1.change yardstick urls and some return value. 2.bottlenecks project wait time change. Change-Id: I1a7f98f69676cda8cb0dc62276704c2cfcf240d8 Signed-off-by: liyin <liyin11@huawei.com>
2016-10-08Merge "Add Factor Testcase CPU_Burden"Jun Li1-0/+15
2016-10-08Merge "Add Factor Testcase RX_Cache_Size"Jun Li1-0/+11
2016-10-08Merge "Add Factor Testcase RX_PKT_Size"Jun Li1-0/+12
2016-10-08Merge "Add Factor Testcase TX_Cache_Size"Jun Li1-0/+11
2016-09-22Add Factor Testcase TX PKT Sizeyuyang1-0/+12
JIRA: BOTTLENECK-99 Add factor testcase to locate the bottleneck of tx pkt size. A separated logic for determine if the tx pkt size is the system bottleneck is provided. Change-Id: I9ccbe19c88a72170b66fffd7f1bd7e5a45dbdc27 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-09-22Add Factor Testcase TX_Cache_Sizeyuyang1-0/+11
JIRA: BOTTLENECK-98 Add factor testcase for locating tx cache size bottleneck. A separate logic for determine if the bottlenecks is tx cache size is provided. Change-Id: Ie3e8a79bf55d6b3223b45c52fb4fbc9b047d38cb Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-09-22Add Factor Testcase RX_PKT_Sizeyuyang1-0/+12
JIRA: BOTTLENECK-97 Add factor testcase to locate bottleneck for rx pkt size. A separated logic for determine if the system bottleneck is rx pkt size is provided. Change-Id: I478b4cf94b07eeb56e87a4825ff0a62367c05175 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-09-22Add Factor Testcase RX_Cache_Sizeyuyang1-0/+11
JIRA: BOTTLENECK-96 Add factor testcase for locating bottleneck of rx cache size. A separate logic is provided to deterine if it is the bottleneck of rx cache size. Change-Id: I52652f73c512a829a3dde85e4cb36073327773e8 Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-09-22Add Factor Testcase CPU_Burdenyuyang1-0/+15
JIRA: BOTTLENECK-95 Add cpu burden factor testcase to locate cpu bottlneck for system. A separated logic is provided to determine if the bottleneck is the CPU capability in the system. Changes: 1. Add testcase script 2. Delete whitespaces Change-Id: I37017d5a0378450b07286ba36f9976d92f504eeb Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>
2016-09-22Adding Posca Testsuite in Bottlenecksyuyang1-0/+11
JIRA: BOTTLENECK-92 The POSCA (Parametric Bottlenecks Testing Catalogue) testsuite classifies the bottlenecks test cases and results into 5 categories. Then the results will be analyzed and decoupled bottlenecks will be searched among these categories. The POSCA testsuite aims to locate the bottlenecks in parmetric manner and to decouple the bottlenecks regarding the deployment requirements. The POSCA testsuite provides an user friendly way to profile and understand the E2E system behavior and deployment requirements. Goals of the POSCA testsuite: a) Automatically locate the bottlenecks in a iterative manner. b) Automatically generate the testing report for bottlenecks in different categories. c) Implementing Automated Staging. Scopes of the POSCA testsuite: a) Modeling, Testing and Test Result analysis. b) Parameters choosing and Algorithms Test stories of the POSCA testsuite: a) Factor test: base test cases that Feature test and Optimization will be dependant on b) Feature test: test cases for features/scenarios c) Optimization test: test to tune the system parameter For more details of the proposal, please refer to https://jira.opnfv.org/secure/attachment/11479/ POSCA%20Testsuite%20Proposal%20in%20Bottlenecks.pdf Changes: 1. Add Posca testsuite directories and files to Bottleneks, leaving adding test cases for latter commits. 2. Fix file appd issue. 3. Delete the un-used packages in testsuites/posca/run_posca.py 4. Add testcase processing logic to run_posca.py 5. Add config dimensions 6. Add scripts directory Change-Id: I54d9b51381a804b76a83680912227e058da3165e Signed-off-by: yuyang <Gabriel.yuyang@huawei.com>