summaryrefslogtreecommitdiffstats
path: root/benchmarks
AgeCommit message (Collapse)AuthorFilesLines
2016-12-16create a new suite file for compute QPIwu.zhihui1-0/+46
- use yaml format to describe suite - define the details of compute QPI suite Change-Id: I2d8793a4e4c1b690210e63954199c6c2c18f8c48 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-12-02Merge "Remove dell's directories under testplan/"Yujun Zhang32-1274/+0
2016-12-01Remove dell's directories under testplan/wu.zhihui32-1274/+0
Since dell's pod is offline for a long time, dell's directories are removed. JIRA: QTIP-174 Change-Id: I5c93edd2f182b87cf6f7ea6d5713483d316c7fe9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-29correct the path of transform/ in ansible scriptswu.zhihui7-13/+13
Due to reorganize qtip directory, it need to correct the path of transform/ in ansible scripts Change-Id: I9eb9cb194419b9eeb71ece6764335ee238db1481 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-25Fix test failingYujun Zhang47-0/+0
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-10Adjust folder structureYujun Zhang47-0/+1864
Note: this patchset may break existing features, but it will help to accelerate the refactoring work. JIRA: QTIP-131 Change-Id: Ie0cd9d185e6b02316878daef905e26f4e533a66b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-05Remove results directory out of reposwu.zhihui7-61/+57
Delete results directory from qtip repos. And the results files will be stored under /home/opnfv/qtip/results. Change-Id: Ie1091e60eb77068c20a9095f0f85454f18173872 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-03Merge "Fix typo and bugs in perftest"zhihui wu8-47/+47
2016-11-03Merge "Remove playbooks directory"Yujun Zhang22-1483/+0
2016-11-03Remove directory fio_jobswu.zhihui1-13/+0
This file is copied to benchmarks/perftest/etc/fio_test_job. So remove it. JIRA: QTIP-131 Change-Id: I542bb6e10179599ac1c8f6f0a6103dc0ce5abe8c Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-03Remove playbooks directorywu.zhihui22-1483/+0
Qtip will use benchmarks/perftest/. JIRA: QTIP-131 Change-Id: Icef41b6bcdcb835d76e8e412dd865d1f156f1455 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-03Fix typo and bugs in perftestwu.zhihui8-47/+47
Change-Id: I36dfb9c2d69cd071cfb8567c5c965144288b3407 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-31Cli list option for perftestlinux_geek1-0/+23
JIRA: QTIP-141 Change-Id: I07e67396b894353a1047471aaae62d64365d51f3 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-10-25bugfix on perftestwu.zhihui7-80/+109
1. Correct path of common directory 2. cleanup the directories qtip creates on host 3. typo 4. use module file instead of shell command to create/cleanup directory Change-Id: I85960998c15d2a1934e8ae5047b71fc91c936a46 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-21reorganize playbooks directorywu.zhihui13-0/+1050
In this patch, playbooks will not be deleted temporarily.Diectory playbooks will be reorganized like this benchmarks/ ├── fio_jobs │   └── test_job ├── perftest    ├── common    │   ├── git_proxy_pbook.yaml    │   ├── sys_info_pbook.yaml    │   └── sys_proxy_pbook.yaml    ├── dhrystone.yaml    ├── dpi.yaml    ├── etc    │   ├── dpi_average.sh    │   ├── info_collect.py    │   └── test_job    ├── fio.yaml    ├── iperf.yaml    ├── ramspeed.yaml    ├── ssl.yaml    └── whetstone.yaml utils/ └── transform ├── dpi_transform.py ├── final_report.py ├── fio_transform.py ├── __init__.py ├── iperf_transform.py ├── ramspeed_transform.py ├── ssl_transform.py └── ubench_transform.py JIRA: QTIP-131 Change-Id: I41003f2f1935efd15b6221ac05200f391fa8a6a9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-21Add directory suite under benchmarks/wu.zhihui3-0/+33
Directory suite is renamed from directory test_list. In this patch, test_list will be not deleted temporarily. JIRA: QTIP-131 Change-Id: I1b2d7e522f94441c53b894564718d3cb749ea428 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-25Change result keys to lower-case and remove ' .'zhifeng.jiang9-136/+79
QTIP-93 Change-Id: I125163e05b49d9631838e89571d59a967252292e Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-20Merge "Remove cpu limit patch for byte-unixbench"Yujun Zhang2-12/+0
2016-09-20Remove cpu limit patch for byte-unixbenchYujun Zhang2-12/+0
The patch[1] is no longer required since it has been merged to upstream[2] [1] https://www.dropbox.com/s/11z85gfu0trkhus/fix-limitation.patch [2] https://github.com/kdlucas/byte-unixbench/commit/910276909baacebea038750aecec32c9a32eddd4 Change-Id: I1e81a93a51f78b36109ca76a56ef9bc8a1fc44ad Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-09-19bugfix dpi.yamlwu.zhihui1-2/+2
1. correct the git directory of nDPI 2. change the url of fetching test.pcap for pods which are restrict access google. Change-Id: I4fb642fbc0ccd8d11cc8ff2477d490838308bb9c Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-11ansible playbook bugfixwu.zhihui12-67/+162
According the qtip ci results, make these bugfixs. 1. skipping: no hosts matched This used to work in Ansible 1.9.x with 127.0.0.1;But does not work in Asible 2.x solved: add 127.0.0.1 as localhost in ./data/hosts 2. Using bare variables is deprecated. solved: update playbook 3. use git module 4. To save time, turning Off Facts on localhost. Since https://gerrit.opnfv.org/gerrit/#/c/20661/ is under codereview, for qtip ci job, I temporarily modify function write_to_file() in env_setup.py. Change-Id: I71a08ebf87cd8c8d851a3f8f760e29e8725f0e0f Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-07-16Fix pep8 errors for all the others python files.zhifeng.jiang1-67/+60
JIRA:QTIP-89 Change-Id: Ida1936dea3bcab6137d039fc2d21dc4df60d9f77 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-07-13Fix pep8 errors for python files in benchmarks,data,dashboardzhifeng.jiang6-88/+59
JIRA:QTIP-89 Change-Id: I3465221f0bdc9a8eb7c4e26069f7367fb1add729 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-06-02Add zte-pod1 test cases and include proxy in playbooks.zhifeng.jiang7-1/+19
JIRA:QTIP-75 Change-Id: I20cd348c292db9f2d7478d46183229544a604bbb Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-06-01Merge "This change fix the iperf server port 5201 dropped by iptables problem."Nauman Ahad1-9/+5
2016-05-27This change fix the iperf server port 5201 dropped by iptables problem.zhifeng.jiang1-9/+5
modification: - Delete "Getting Firewall entry number" - Delete "Removing entry number" - Add "Allow iperf port in iptables input" QTIP-77 Change-Id: If124d747468831218645920c31cb76463d1d17e2 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-05-23Read the proxy info from testcase, and set it to hosts when dhrystone ↵zhifeng.jiang3-0/+68
benchmarks test. modification: Write the git_proxy_pbook.yaml to set git proxy info in hosts or vms. Write the sys_proxy_pbook.yaml to set yum apt wget env proxy info in hosts or vms. Change the dhrystone.yaml to include proxy and add the zte-pod1 /compute/dhrystone_bm.yaml.Tested and passed.Other playbooks did not include the proxy yet. I will test and push lately. QTIP-74 Change-Id: Ia820bc32798b9f1f6f4165a111524e04c129a5df Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-02-24Changed upstream links for playbooksNauman_Ahad2-2/+2
Upsream links such as OpenSSL may break. Changed these links to links hosted at artifacts.opnfv.org so that links don't break for B release branch Change-Id: I9ca5cacf27030446dfa59717855f60dc1544b422 Signed-off-by: Nauman_Ahad <nauman.ahad@xflowresearch.com>
2016-02-15qtip: add user name in case of apex and make the changes in ansibleMofassirArif8-9/+12
playbooks to cater for apex. Also reduce the verbosity for runnning ansbile plays. Change-Id: Id3a6da7bea3ede99f8a23e5fd0a2801987f9565b Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-02-02Fixed issue with SSL and IPERFNauman_Ahad2-4/+4
Recent patches incorporating sudo led to an error Change-Id: If0e3316fbebce774db43f5fdcb3ea5e322a28222 Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-02-01add sudo changes for joidMofassirArif7-109/+249
Change-Id: Id31e687779be159cd3ad83cb3df2289054927074 Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-02-01Corrected the openssl linkNauman_Ahad1-7/+7
SSL playbooks failed, as openssl link became obsolete. Updated the link in the ssl playbook Change-Id: I8be4d4fd34656a44df718854a6a219084c2231e7 Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-02-01Fixed RAMSPEED and Whetstone bugsNauman_Ahad2-3/+2
After changes to incorporate "ubuntu" users for joid, minor bugs in whetsotne and ramspeed playbooks. These bugs were fixed. Change-Id: I072b0b8390ad9e161e3ec2d1c9ff51e949f06cbb Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-01-29Test_case name included in final json result fileNauman Ahad8-11/+13
Change-Id: Ic4059dd58d2c5c4e9f8a00a1c419dce0994bc1bc Signed-off-by: Nauman Ahad <nauman.ahad@xflowresearch.com>
2016-01-29qtip: compass dependenciesMofassirArif2-8/+27
Change-Id: Id4be468c5a1cef6d9b887f1114eab5af808455af Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-01-28qtip bug: storage playbook, update --become-userMofassirArif1-1/+1
Change-Id: I3de6f779dabef546e313f8264ceeb993f4220f46 Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-01-28qtip: add condition for switching user to joid.MofassirArif7-11/+16
Change-Id: I9898a4eb21fb197a59fc72686d156eb4ef115388 Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-21bug fix: result collection bug fix for docker imagesMofassirArif10-108/+110
Change-Id: Ia4ea09b90c7a4f4e3699af456c6d66e85661cc0b Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-20Resolving bug for result collectionNauman_Ahad7-16/+16
For all benchmarks, the final ansible play to consolidate json was failing in docker containers Change-Id: I3611d74b7dbd38eccd46f9dcc982473f96b16157 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-18bug fix: make installer specific changes for baremetal. caterMofassirArif1-1/+5
for fuel Change-Id: Ie8c233873041238e3fc1aaaa653653552c7c7428 Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-12Patch for fixing ramspeed result_transform bugNauman_Ahad1-1/+1
Inserted space in ramspd_transform.py file to overcome key error while calculating result_index Change-Id: I3f6d1295b9297aa5d9935f58b04703602a1c4b92 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-12error handling for the files being input to the framework.MofassirArif1-2/+8
iperf bug fix for the bare metal testing, renamed all the iperf config files. added more detail to the help. Change-Id: I16cfb1c05599cd0b803e735e6a75083e3e6733ec Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-12Include Ramspeed Index calulcationNauman_Ahad1-10/+10
Ramspeed Index calculation included. Additionally, error handling for suite indices calulcation to ignore absent result files Change-Id: I8b2360b0f16b6d3b7d8485e88a0c1f7f0787ad5a Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-11Changed name for lab of dell-us-deploying-bm-3Nauman_Ahad2-44/+1
Changed name from dell-us-deploying-bm-3 to dell-us-deploying-bm3 in testcases. Removed duplicate ramspeed playbook file "ramspeedbench.yaml" Change-Id: Ieb49a0466e6f86bb02990962b382696cc7ae3e31 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-05QTIP Index calculation along with a script to run qtip from dockerNauman_Ahad3-14/+14
Calculation of Result Indices for 1. Compute suite 2. Storage suite 3. Network suite A script to run qtip from inside the docker container (for Jenkins Jobs) Resolved bugs with ssl_trasform.py, sys info collection on ubuntu and system information collection script Change-Id: Ic5abb3dbd0012cd2257b588b1b3067a6677b1f5d Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-01Storage Result Transformation scriptNauman_Ahad1-0/+57
Missed the Storage Result transformation script in earlier submit. Submitted now Change-Id: Ie33ee80529c816f16371fff5163784e42f6dba85 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-31Resolved bug in sys_info_collection playbookNauman_Ahad1-4/+4
Change-Id: I2e1844a153af46b8837b266d92dd7a8183321ec2 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-31Storage Benchmarks testcases along with result transformation scriptNauman_Ahad2-95/+75
JIRA QTIP-63 Testcases revised for the storage suite. Result transformation script for Storage testcases addedx System Information script modified to check for network testcases. Change-Id: I6c2fe641432b7bd45097495051e41bab05b8979c Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-30Minor changes to the code, to prep for code freeze.Mofassir4-19/+77
the result format of iperf has been made consistent Change-Id: Iede4b381ca2e5d7643bf6420f17684bbf2cc2921 Signed-off-by: Mofassir <Mofassir_arif@Dellteam.com>
2015-12-22Restructured QTIP directories and CLIMofassir Arif2-9/+9
I have changed the arguments for the CLI and now QTIP takes a file along withthe name of the lab to run on Right now only the config files for the dell lab have been added, These will increase when we make QTIP available for other labs. I have also added the provision of changing the public network from the config file and some leftover files from previous verisons have been remove Change-Id: Ifeb01d80099eab06dc77a7b2e07097ebb17a13a2 Signed-off-by: Mofassir Arif <Mofassir_arif@dellteam.com>