aboutsummaryrefslogtreecommitdiffstats
path: root/benchmarks
AgeCommit message (Collapse)AuthorFilesLines
2016-11-03Remove playbooks directorywu.zhihui22-1483/+0
Qtip will use benchmarks/perftest/. JIRA: QTIP-131 Change-Id: Icef41b6bcdcb835d76e8e412dd865d1f156f1455 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-31Cli list option for perftestlinux_geek1-0/+23
JIRA: QTIP-141 Change-Id: I07e67396b894353a1047471aaae62d64365d51f3 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-10-25bugfix on perftestwu.zhihui7-80/+109
1. Correct path of common directory 2. cleanup the directories qtip creates on host 3. typo 4. use module file instead of shell command to create/cleanup directory Change-Id: I85960998c15d2a1934e8ae5047b71fc91c936a46 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-21reorganize playbooks directorywu.zhihui13-0/+1050
In this patch, playbooks will not be deleted temporarily.Diectory playbooks will be reorganized like this benchmarks/ ├── fio_jobs │   └── test_job ├── perftest    ├── common    │   ├── git_proxy_pbook.yaml    │   ├── sys_info_pbook.yaml    │   └── sys_proxy_pbook.yaml    ├── dhrystone.yaml    ├── dpi.yaml    ├── etc    │   ├── dpi_average.sh    │   ├── info_collect.py    │   └── test_job    ├── fio.yaml    ├── iperf.yaml    ├── ramspeed.yaml    ├── ssl.yaml    └── whetstone.yaml utils/ └── transform ├── dpi_transform.py ├── final_report.py ├── fio_transform.py ├── __init__.py ├── iperf_transform.py ├── ramspeed_transform.py ├── ssl_transform.py └── ubench_transform.py JIRA: QTIP-131 Change-Id: I41003f2f1935efd15b6221ac05200f391fa8a6a9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-21Add directory suite under benchmarks/wu.zhihui3-0/+33
Directory suite is renamed from directory test_list. In this patch, test_list will be not deleted temporarily. JIRA: QTIP-131 Change-Id: I1b2d7e522f94441c53b894564718d3cb749ea428 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-25Change result keys to lower-case and remove ' .'zhifeng.jiang9-136/+79
QTIP-93 Change-Id: I125163e05b49d9631838e89571d59a967252292e Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-20Merge "Remove cpu limit patch for byte-unixbench"Yujun Zhang2-12/+0
2016-09-20Remove cpu limit patch for byte-unixbenchYujun Zhang2-12/+0
The patch[1] is no longer required since it has been merged to upstream[2] [1] https://www.dropbox.com/s/11z85gfu0trkhus/fix-limitation.patch [2] https://github.com/kdlucas/byte-unixbench/commit/910276909baacebea038750aecec32c9a32eddd4 Change-Id: I1e81a93a51f78b36109ca76a56ef9bc8a1fc44ad Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-09-19bugfix dpi.yamlwu.zhihui1-2/+2
1. correct the git directory of nDPI 2. change the url of fetching test.pcap for pods which are restrict access google. Change-Id: I4fb642fbc0ccd8d11cc8ff2477d490838308bb9c Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-11ansible playbook bugfixwu.zhihui12-67/+162
According the qtip ci results, make these bugfixs. 1. skipping: no hosts matched This used to work in Ansible 1.9.x with 127.0.0.1;But does not work in Asible 2.x solved: add 127.0.0.1 as localhost in ./data/hosts 2. Using bare variables is deprecated. solved: update playbook 3. use git module 4. To save time, turning Off Facts on localhost. Since https://gerrit.opnfv.org/gerrit/#/c/20661/ is under codereview, for qtip ci job, I temporarily modify function write_to_file() in env_setup.py. Change-Id: I71a08ebf87cd8c8d851a3f8f760e29e8725f0e0f Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-07-16Fix pep8 errors for all the others python files.zhifeng.jiang1-67/+60
JIRA:QTIP-89 Change-Id: Ida1936dea3bcab6137d039fc2d21dc4df60d9f77 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-07-13Fix pep8 errors for python files in benchmarks,data,dashboardzhifeng.jiang6-88/+59
JIRA:QTIP-89 Change-Id: I3465221f0bdc9a8eb7c4e26069f7367fb1add729 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-06-02Add zte-pod1 test cases and include proxy in playbooks.zhifeng.jiang7-1/+19
JIRA:QTIP-75 Change-Id: I20cd348c292db9f2d7478d46183229544a604bbb Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-06-01Merge "This change fix the iperf server port 5201 dropped by iptables problem."Nauman Ahad1-9/+5
2016-05-27This change fix the iperf server port 5201 dropped by iptables problem.zhifeng.jiang1-9/+5
modification: - Delete "Getting Firewall entry number" - Delete "Removing entry number" - Add "Allow iperf port in iptables input" QTIP-77 Change-Id: If124d747468831218645920c31cb76463d1d17e2 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-05-23Read the proxy info from testcase, and set it to hosts when dhrystone ↵zhifeng.jiang3-0/+68
benchmarks test. modification: Write the git_proxy_pbook.yaml to set git proxy info in hosts or vms. Write the sys_proxy_pbook.yaml to set yum apt wget env proxy info in hosts or vms. Change the dhrystone.yaml to include proxy and add the zte-pod1 /compute/dhrystone_bm.yaml.Tested and passed.Other playbooks did not include the proxy yet. I will test and push lately. QTIP-74 Change-Id: Ia820bc32798b9f1f6f4165a111524e04c129a5df Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-02-24Changed upstream links for playbooksNauman_Ahad2-2/+2
Upsream links such as OpenSSL may break. Changed these links to links hosted at artifacts.opnfv.org so that links don't break for B release branch Change-Id: I9ca5cacf27030446dfa59717855f60dc1544b422 Signed-off-by: Nauman_Ahad <nauman.ahad@xflowresearch.com>
2016-02-15qtip: add user name in case of apex and make the changes in ansibleMofassirArif8-9/+12
playbooks to cater for apex. Also reduce the verbosity for runnning ansbile plays. Change-Id: Id3a6da7bea3ede99f8a23e5fd0a2801987f9565b Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-02-02Fixed issue with SSL and IPERFNauman_Ahad2-4/+4
Recent patches incorporating sudo led to an error Change-Id: If0e3316fbebce774db43f5fdcb3ea5e322a28222 Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-02-01add sudo changes for joidMofassirArif7-109/+249
Change-Id: Id31e687779be159cd3ad83cb3df2289054927074 Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-02-01Corrected the openssl linkNauman_Ahad1-7/+7
SSL playbooks failed, as openssl link became obsolete. Updated the link in the ssl playbook Change-Id: I8be4d4fd34656a44df718854a6a219084c2231e7 Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-02-01Fixed RAMSPEED and Whetstone bugsNauman_Ahad2-3/+2
After changes to incorporate "ubuntu" users for joid, minor bugs in whetsotne and ramspeed playbooks. These bugs were fixed. Change-Id: I072b0b8390ad9e161e3ec2d1c9ff51e949f06cbb Signed-off-by: Nauman_Ahad <nauman_ahad@xflowresearch.com>
2016-01-29Test_case name included in final json result fileNauman Ahad8-11/+13
Change-Id: Ic4059dd58d2c5c4e9f8a00a1c419dce0994bc1bc Signed-off-by: Nauman Ahad <nauman.ahad@xflowresearch.com>
2016-01-29qtip: compass dependenciesMofassirArif2-8/+27
Change-Id: Id4be468c5a1cef6d9b887f1114eab5af808455af Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-01-28qtip bug: storage playbook, update --become-userMofassirArif1-1/+1
Change-Id: I3de6f779dabef546e313f8264ceeb993f4220f46 Signed-off-by: MofassirArif <mofassir.arif@xflowresearch.com>
2016-01-28qtip: add condition for switching user to joid.MofassirArif7-11/+16
Change-Id: I9898a4eb21fb197a59fc72686d156eb4ef115388 Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-21bug fix: result collection bug fix for docker imagesMofassirArif10-108/+110
Change-Id: Ia4ea09b90c7a4f4e3699af456c6d66e85661cc0b Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-20Resolving bug for result collectionNauman_Ahad7-16/+16
For all benchmarks, the final ansible play to consolidate json was failing in docker containers Change-Id: I3611d74b7dbd38eccd46f9dcc982473f96b16157 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-18bug fix: make installer specific changes for baremetal. caterMofassirArif1-1/+5
for fuel Change-Id: Ie8c233873041238e3fc1aaaa653653552c7c7428 Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-12Patch for fixing ramspeed result_transform bugNauman_Ahad1-1/+1
Inserted space in ramspd_transform.py file to overcome key error while calculating result_index Change-Id: I3f6d1295b9297aa5d9935f58b04703602a1c4b92 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-12error handling for the files being input to the framework.MofassirArif1-2/+8
iperf bug fix for the bare metal testing, renamed all the iperf config files. added more detail to the help. Change-Id: I16cfb1c05599cd0b803e735e6a75083e3e6733ec Signed-off-by: MofassirArif <Mofassir_Arif@dellteam.com>
2016-01-12Include Ramspeed Index calulcationNauman_Ahad1-10/+10
Ramspeed Index calculation included. Additionally, error handling for suite indices calulcation to ignore absent result files Change-Id: I8b2360b0f16b6d3b7d8485e88a0c1f7f0787ad5a Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-11Changed name for lab of dell-us-deploying-bm-3Nauman_Ahad2-44/+1
Changed name from dell-us-deploying-bm-3 to dell-us-deploying-bm3 in testcases. Removed duplicate ramspeed playbook file "ramspeedbench.yaml" Change-Id: Ieb49a0466e6f86bb02990962b382696cc7ae3e31 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-05QTIP Index calculation along with a script to run qtip from dockerNauman_Ahad3-14/+14
Calculation of Result Indices for 1. Compute suite 2. Storage suite 3. Network suite A script to run qtip from inside the docker container (for Jenkins Jobs) Resolved bugs with ssl_trasform.py, sys info collection on ubuntu and system information collection script Change-Id: Ic5abb3dbd0012cd2257b588b1b3067a6677b1f5d Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2016-01-01Storage Result Transformation scriptNauman_Ahad1-0/+57
Missed the Storage Result transformation script in earlier submit. Submitted now Change-Id: Ie33ee80529c816f16371fff5163784e42f6dba85 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-31Resolved bug in sys_info_collection playbookNauman_Ahad1-4/+4
Change-Id: I2e1844a153af46b8837b266d92dd7a8183321ec2 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-31Storage Benchmarks testcases along with result transformation scriptNauman_Ahad2-95/+75
JIRA QTIP-63 Testcases revised for the storage suite. Result transformation script for Storage testcases addedx System Information script modified to check for network testcases. Change-Id: I6c2fe641432b7bd45097495051e41bab05b8979c Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-30Minor changes to the code, to prep for code freeze.Mofassir4-19/+77
the result format of iperf has been made consistent Change-Id: Iede4b381ca2e5d7643bf6420f17684bbf2cc2921 Signed-off-by: Mofassir <Mofassir_arif@Dellteam.com>
2015-12-22Restructured QTIP directories and CLIMofassir Arif2-9/+9
I have changed the arguments for the CLI and now QTIP takes a file along withthe name of the lab to run on Right now only the config files for the dell lab have been added, These will increase when we make QTIP available for other labs. I have also added the provision of changing the public network from the config file and some leftover files from previous verisons have been remove Change-Id: Ifeb01d80099eab06dc77a7b2e07097ebb17a13a2 Signed-off-by: Mofassir Arif <Mofassir_arif@dellteam.com>
2015-12-22Storage benchmarsk for QTIPNauman_Ahad2-0/+95
Inclusion of Fio filesystem benchmarks Includes a fio.yaml playbook A FIO job folder that contains information for the fio job Additionally testcases for storage benchmarks can be found in "test case" directory JIRA: QTIP-46 Change-Id: Icb4a429f8754c9ed4ceec548d8ddc6062992c85d Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-18Patch for SSH issues after introducing qtip keyNauman_Ahad1-1/+6
Ansible issues for ssh for ssl Made modifications to the ansible playbook file Disabled sudo on the commands to be run on the local machine Explicitly introduced the remote_user in the playbook Change-Id: I547f48ac4a6f1dd4c0996bddda516896a8c3afb6 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-12-17Script to modify key file permissionsMofassir Arif3-7/+6
I have added a script to change the file permissions of the key files to 600 so that they can be used by the ssh agent The duration of the sshtest has also been reduced to allow the Jenkins Job to run/fail in a reasonable amount of time Change-Id: I5446896619dfba3f3efb600b64628343d6378164 Signed-off-by: Mofassir Arif <Mofassir_arif@dellteam.com>
2015-12-16Removed Root previlagesMofassir Arif10-188/+39
QTIP now uses a key of its own to ssh into VMs The ssh for the baremetal servers still needs work Change-Id: I1aa37e07c4f9b3f7f4902d16cdbf74f39eb6c698 Signed-off-by: Mofassir Arif <Mofassir_arif@dellteam.com> Conflicts: .gitignore
2015-12-16Networking Testcase: Iperf ImplementedMofassir Arif13-0/+416
The ansible playbooks as well as the config files for the iperf throughput testing have been implemented. Some changes have been made to the driver function for the benchmarks. ansible now gets passed a json file. Change-Id: Ibf4c0210ab9f6cbf9896ca69bf2fb6bda8a9925d Signed-off-by: Mofassir Arif <mofassir@gmail.com>
2015-11-19RAMSpeed Benchmarks Included along with Sys Info for Net testcasesNauman_Ahad9-127/+233
RAMSpeed benchmark playbooks, result transformation scripts included. System Information also included for Network Testcases System Information Playbook checks for the type of testcase, and gathers benchmark relevant information only (No Network Info for Compute TestCase) JIRA: QTIP-54 JIRA: QTIP-38 Change-Id: I8612f06fedfaf7314552c06f388ea6c0cd23f1ee Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-11-09Ansible compute benchmarks playbooks with system Info & result transformNauman_Ahad14-0/+720
Updated playbooks for SSL,DPI,Dhrystone,Whetstone Also included python scripts for system information collection(compute benchmarks) and result transformation into JSON files for the aforementioned compute benchmarks JIRA:QTIP-20 JIRA:QTIP-36 JIRA:QTIP-37 JIRA:QTIP-39 JIRA:QTIP-40 JIRA:QTIP-52 Change-Id: I3c099d71d8316c15f0619313bd4f9829a58f6e33 Signed-off-by: Nauman_Ahad <Nauman_Ahad@dell.com>
2015-11-05Python Framework for QTIPMofassir Arif5-138/+0
Dhrystone Whetstone and DPI benchmarks have been implemented CLI arguments have been implemented test case are sorted based on category such as compute,network and storage glance and heat client have been used to generate the stack. automatic upload of QTIP image and delete function for existing stack before creating new stack has been implemented system information collecton and result generation has been implemented JIRA: QTIP-17 Signed-off-by: Mofassir Arif <mofassir_arif@dell.com> Change-Id: I4b7b134017723c30c771cc14d2edce33fcb8ba00
2015-08-14Added automation script, 2 test cases, Heat template for test case, Project ↵Nauman Ahad4-0/+138
INFO files Structured existing playbooks into directories, added automations scripts and test cases which were demonstrated in demo1. Basic Directoy structure also introduced. All hard coded values removed. JIRA: QTIP-3 Change-Id: Icdceb0f125a5275d3dee7845a403e567d729dc26 Signed-off-by: Nauman Ahad <Nauman_Ahad@dell.com>