aboutsummaryrefslogtreecommitdiffstats
path: root/benchmarks
AgeCommit message (Collapse)AuthorFilesLines
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang1-6/+6
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-16Minor fix of compute QPI specYujun Zhang1-10/+10
- align terminology with project FAQ[1] - use different weight in sections [1]: https://wiki.opnfv.org/display/qtip/FAQ#FAQ-Algorithm Change-Id: I1161c333584952dfa9d23be3010f572d4b315b60 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-16create a new suite file for compute QPIwu.zhihui1-0/+46
- use yaml format to describe suite - define the details of compute QPI suite Change-Id: I2d8793a4e4c1b690210e63954199c6c2c18f8c48 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-12-02Merge "Remove dell's directories under testplan/"Yujun Zhang32-1274/+0
2016-12-01Remove dell's directories under testplan/wu.zhihui32-1274/+0
Since dell's pod is offline for a long time, dell's directories are removed. JIRA: QTIP-174 Change-Id: I5c93edd2f182b87cf6f7ea6d5713483d316c7fe9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-29correct the path of transform/ in ansible scriptswu.zhihui7-13/+13
Due to reorganize qtip directory, it need to correct the path of transform/ in ansible scripts Change-Id: I9eb9cb194419b9eeb71ece6764335ee238db1481 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-25Fix test failingYujun Zhang47-0/+0
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-10Adjust folder structureYujun Zhang47-0/+1864
Note: this patchset may break existing features, but it will help to accelerate the refactoring work. JIRA: QTIP-131 Change-Id: Ie0cd9d185e6b02316878daef905e26f4e533a66b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-05Remove results directory out of reposwu.zhihui7-61/+57
Delete results directory from qtip repos. And the results files will be stored under /home/opnfv/qtip/results. Change-Id: Ie1091e60eb77068c20a9095f0f85454f18173872 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-03Merge "Fix typo and bugs in perftest"zhihui wu8-47/+47
2016-11-03Merge "Remove playbooks directory"Yujun Zhang22-1483/+0
2016-11-03Remove directory fio_jobswu.zhihui1-13/+0
This file is copied to benchmarks/perftest/etc/fio_test_job. So remove it. JIRA: QTIP-131 Change-Id: I542bb6e10179599ac1c8f6f0a6103dc0ce5abe8c Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-03Remove playbooks directorywu.zhihui22-1483/+0
Qtip will use benchmarks/perftest/. JIRA: QTIP-131 Change-Id: Icef41b6bcdcb835d76e8e412dd865d1f156f1455 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-03Fix typo and bugs in perftestwu.zhihui8-47/+47
Change-Id: I36dfb9c2d69cd071cfb8567c5c965144288b3407 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-31Cli list option for perftestlinux_geek1-0/+23
JIRA: QTIP-141 Change-Id: I07e67396b894353a1047471aaae62d64365d51f3 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-10-25bugfix on perftestwu.zhihui7-80/+109
1. Correct path of common directory 2. cleanup the directories qtip creates on host 3. typo 4. use module file instead of shell command to create/cleanup directory Change-Id: I85960998c15d2a1934e8ae5047b71fc91c936a46 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-21reorganize playbooks directorywu.zhihui13-0/+1050
In this patch, playbooks will not be deleted temporarily.Diectory playbooks will be reorganized like this benchmarks/ ├── fio_jobs │   └── test_job ├── perftest    ├── common    │   ├── git_proxy_pbook.yaml    │   ├── sys_info_pbook.yaml    │   └── sys_proxy_pbook.yaml    ├── dhrystone.yaml    ├── dpi.yaml    ├── etc    │   ├── dpi_average.sh    │   ├── info_collect.py    │   └── test_job    ├── fio.yaml    ├── iperf.yaml    ├── ramspeed.yaml    ├── ssl.yaml    └── whetstone.yaml utils/ └── transform ├── dpi_transform.py ├── final_report.py ├── fio_transform.py ├── __init__.py ├── iperf_transform.py ├── ramspeed_transform.py ├── ssl_transform.py └── ubench_transform.py JIRA: QTIP-131 Change-Id: I41003f2f1935efd15b6221ac05200f391fa8a6a9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-21Add directory suite under benchmarks/wu.zhihui3-0/+33
Directory suite is renamed from directory test_list. In this patch, test_list will be not deleted temporarily. JIRA: QTIP-131 Change-Id: I1b2d7e522f94441c53b894564718d3cb749ea428 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-25Change result keys to lower-case and remove ' .'zhifeng.jiang9-136/+79
QTIP-93 Change-Id: I125163e05b49d9631838e89571d59a967252292e Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-20Merge "Remove cpu limit patch for byte-unixbench"Yujun Zhang2-12/+0
2016-09-20Remove cpu limit patch for byte-unixbenchYujun Zhang2-12/+0
The patch[1] is no longer required since it has been merged to upstream[2] [1] https://www.dropbox.com/s/11z85gfu0trkhus/fix-limitation.patch [2] https://github.com/kdlucas/byte-unixbench/commit/910276909baacebea038750aecec32c9a32eddd4 Change-Id: I1e81a93a51f78b36109ca76a56ef9bc8a1fc44ad Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-09-19bugfix dpi.yamlwu.zhihui1-2/+2
1. correct the git directory of nDPI 2. change the url of fetching test.pcap for pods which are restrict access google. Change-Id: I4fb642fbc0ccd8d11cc8ff2477d490838308bb9c Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-11ansible playbook bugfixwu.zhihui12-67/+162
According the qtip ci results, make these bugfixs. 1. skipping: no hosts matched This used to work in Ansible 1.9.x with 127.0.0.1;But does not work in Asible 2.x solved: add 127.0.0.1 as localhost in ./data/hosts 2. Using bare variables is deprecated. solved: update playbook 3. use git module 4. To save time, turning Off Facts on localhost. Since https://gerrit.opnfv.org/gerrit/#/c/20661/ is under codereview, for qtip ci job, I temporarily modify function write_to_file() in env_setup.py. Change-Id: I71a08ebf87cd8c8d851a3f8f760e29e8725f0e0f Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-07-16Fix pep8 errors for all the others python files.zhifeng.jiang1-67/+60
JIRA:QTIP-89 Change-Id: Ida1936dea3bcab6137d039fc2d21dc4df60d9f77 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-07-13Fix pep8 errors for python files in benchmarks,data,dashboardzhifeng.jiang6-88/+59
JIRA:QTIP-89 Change-Id: I3465221f0bdc9a8eb7c4e26069f7367fb1add729 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-06-02Add zte-pod1 test cases and include proxy in playbooks.zhifeng.jiang7-1/+19
JIRA:QTIP-75 Change-Id: I20cd348c292db9f2d7478d46183229544a604bbb Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-06-01Merge "This change fix the iperf server port 5201 dropped by iptables problem."Nauman Ahad1-9/+5
2016-05-27This change fix the iperf server port 5201 dropped by iptables problem.zhifeng.jiang1-9/+5
modification: - Delete "Getting Firewall entry number" - Delete "Removing entry number" - Add "Allow iperf port in iptables input" QTIP-77 Change-Id: If124d747468831218645920c31cb76463d1d17e2 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-05-23Read the proxy info from testcase, and set it to hosts when dhrystone ↵zhifeng.jiang3-0/+68
benchmarks test. modification: Write the git_proxy_pbook.yaml to set git proxy info in hosts or vms. Write the sys_proxy_pbook.yaml to set yum apt wget env proxy info in hosts or vms. Change the dhrystone.yaml to include proxy and add the zte-pod1 /compute/dhrystone_bm.yaml.Tested and passed.Other playbooks did not include the proxy yet. I will test and push lately. QTIP-74 Change-Id: Ia820bc32798b9f1f6f4165a111524e04c129a5df Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-02-24Changed upstream links for playbooksNauman_Ahad2-2/+2
Upsream links such as OpenSSL may break. Changed these links to links hosted at artifacts.opnfv.org so that links don't break for B release branch Change-Id: I9ca5cacf27030446dfa59717855f60dc1544b422 Signed-off-by: Nauman_Ahad <nauman.ahad@xflowresearch.com>
2016-02-15qtip: add user name in case of apex and make the changes in ansibleMofassirArif8-9/+12
playbooks to cater for apex. Also reduce the verbosity for runnning ansbile plays. Change-Id: Id3a6da7bea3ede99f8a23e5fd0a2801987f9565b Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-02-02Fixed issue with SSL and IPERFNauman_Ahad2-4/+4
Recent patches incorporating sudo led to an error Change-Id: If0e3316fbebce774db43f5fdcb3ea5e322a28222 Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-02-01add sudo changes for joidMofassirArif7-109/+249
Change-Id: Id31e687779be159cd3ad83cb3df2289054927074 Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-02-01Corrected the openssl linkNauman_Ahad1-7/+7
SSL playbooks failed, as openssl link became obsolete. Updated the link in the ssl playbook Change-Id: I8be4d4fd34656a44df718854a6a219084c2231e7 Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-02-01Fixed RAMSPEED and Whetstone bugsNauman_Ahad2-3/+2
After changes to incorporate "ubuntu" users for joid, minor bugs in whetsotne and ramspeed playbooks. These bugs were fixed. Change-Id: I072b0b8390ad9e161e3ec2d1c9ff51e949f06cbb Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-01-29Test_case name included in final json result fileNauman Ahad8-11/+13
Change-Id: Ic4059dd58d2c5c4e9f8a00a1c419dce0994bc1bc Signed-off-by: Nauman Ahad <nauman.ahad@xflowresearch.com>
2016-01-29qtip: compass dependenciesMofassirArif2-8/+27
Change-Id: Id4be468c5a1cef6d9b887f1114eab5af808455af Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-01-28qtip bug: storage playbook, update --become-userMofassirArif1-1/+1
Change-Id: I3de6f779dabef546e313f8264ceeb993f4220f46 Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-01-28qtip: add condition for switching user to joid.MofassirArif7-11/+16
Change-Id: I9898a4eb21fb197a59fc72686d156eb4ef115388 Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-21bug fix: result collection bug fix for docker imagesMofassirArif10-108/+110
Change-Id: Ia4ea09b90c7a4f4e3699af456c6d66e85661cc0b Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-20Resolving bug for result collectionNauman_Ahad7-16/+16
For all benchmarks, the final ansible play to consolidate json was failing in docker containers Change-Id: I3611d74b7dbd38eccd46f9dcc982473f96b16157 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-18bug fix: make installer specific changes for baremetal. caterMofassirArif1-1/+5
for fuel Change-Id: Ie8c233873041238e3fc1aaaa653653552c7c7428 Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-12Patch for fixing ramspeed result_transform bugNauman_Ahad1-1/+1
Inserted space in ramspd_transform.py file to overcome key error while calculating result_index Change-Id: I3f6d1295b9297aa5d9935f58b04703602a1c4b92 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-12error handling for the files being input to the framework.MofassirArif1-2/+8
iperf bug fix for the bare metal testing, renamed all the iperf config files. added more detail to the help. Change-Id: I16cfb1c05599cd0b803e735e6a75083e3e6733ec Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-12Include Ramspeed Index calulcationNauman_Ahad1-10/+10
Ramspeed Index calculation included. Additionally, error handling for suite indices calulcation to ignore absent result files Change-Id: I8b2360b0f16b6d3b7d8485e88a0c1f7f0787ad5a Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-11Changed name for lab of dell-us-deploying-bm-3Nauman_Ahad2-44/+1
Changed name from dell-us-deploying-bm-3 to dell-us-deploying-bm3 in testcases. Removed duplicate ramspeed playbook file "ramspeedbench.yaml" Change-Id: Ieb49a0466e6f86bb02990962b382696cc7ae3e31 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-05QTIP Index calculation along with a script to run qtip from dockerNauman_Ahad3-14/+14
Calculation of Result Indices for 1. Compute suite 2. Storage suite 3. Network suite A script to run qtip from inside the docker container (for Jenkins Jobs) Resolved bugs with ssl_trasform.py, sys info collection on ubuntu and system information collection script Change-Id: Ic5abb3dbd0012cd2257b588b1b3067a6677b1f5d Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-01Storage Result Transformation scriptNauman_Ahad1-0/+57
Missed the Storage Result transformation script in earlier submit. Submitted now Change-Id: Ie33ee80529c816f16371fff5163784e42f6dba85 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-31Resolved bug in sys_info_collection playbookNauman_Ahad1-4/+4
Change-Id: I2e1844a153af46b8837b266d92dd7a8183321ec2 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-31Storage Benchmarks testcases along with result transformation scriptNauman_Ahad2-95/+75
JIRA QTIP-63 Testcases revised for the storage suite. Result transformation script for Storage testcases addedx System Information script modified to check for network testcases. Change-Id: I6c2fe641432b7bd45097495051e41bab05b8979c Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>