summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-03-15Merge "Implement the workflow of compute qpi" into stable/danubezhihui wu2-18/+137
2017-03-15Merge "parse benchmark result from logfile" into stable/danubezhihui wu3-2/+195
2017-03-15Merge "Remove legacy code from stable branch" into stable/danubezhihui wu118-5813/+0
2017-03-15Merge "env cleanup" into stable/danubezhihui wu2-0/+28
2017-03-14Implement the workflow of compute qpiwu.zhihui2-18/+137
Local test is ok. The result will be written to report.json. usage: runner.py [-h] -d DEST -b BENCHMARK optional arguments: -d DEST, --dest DEST the destination where results will be stored. -b BENCHMARK, --benchmark BENCHMARK the benchmark you want to execute. Change-Id: Ic3a70c65a5aa045bf9df34ce4d14957a7a1b3dcf Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn> (cherry picked from commit 478cd02a9219f7c8b49d8529d1f809a04399ad0d)
2017-03-14parse benchmark result from logfilewu.zhihui3-2/+195
- Put all the regex rules in regex.yaml. - According to benchmark name, we can find related regexes. Change-Id: Ic15bd1c77b525be3751011fa94d582da077b0345 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn> (cherry picked from commit dc92e5ae19dd026bf6a14c1e0d2b9c50497845d5)
2017-03-14Some modifications for ansible playbookwu.zhihui3-5/+13
- typo in ramspeed/run.yaml - fix result logfile name for dhrystone and whetstone Change-Id: Ic8456174a14d04c2207990eccb16601762c5a880 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn> (cherry picked from commit 764c2d3916f1390e2ee2ca3b3efbcc33050fd525)
2017-03-14Remove legacy code from stable branchYujun Zhang118-5813/+0
Change-Id: I283f84dfcb3cd029739caaefb33ed5431114fae9 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-03-13Merge "Implement 'list' command." into stable/danubezhihui wu8-14/+48
2017-03-11env cleanupwu.zhihui2-0/+28
If IF_DEBUG is True, there is not cleanup step. If IF_DEBUG is False, host file and keypair will be deleted on local and public key will be removed from remote nodes in the end of test. Change-Id: I4a88acc2d428e41e4abaedacb011e27468b2cb57 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn> (cherry picked from commit d37dad746e504e833abcf2ae058f2b81e2a9d365)
2017-03-11Implement Retrieval of plans, QPIs, and metricsakhilbatra8985-31/+173
- All specs can be listed - All specs can be individually retrieved - API can be installed alongside qtip - API can be hosted using command `qtip-api` JIRA: QTIP-221 JIRA: QTIP-222 Change-Id: I1e80e6609cae1252cb2fcdc38c71b4bf6d02e8c9 Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in> (cherry picked from commit 15fceada86ad0d5dabe26365451aae9c95b36be1)
2017-03-11Implement 'list' command.Taseer8-14/+48
- Loads Qtip components from the default path. JIRA: QTIP-205 Change-Id: Id87993d65c5cd6a23c199cf1049d75a0971b6354 Signed-off-by: Taseer Ahmed <taseer94@gmail.com> (cherry picked from commit 0bd051505c2851d61356e7c448d7802913ab785f)
2017-03-10Merge "fill benchmarks"zhihui wu7-0/+231
2017-03-10Merge "bugfix benchmarks cannot be found"zhihui wu1-0/+4
2017-03-10fill benchmarksSerenaFeng7-0/+231
Change-Id: I7ad5f504058b20db72c0878cf9618e6bff186b33 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-10bugfix benchmarks cannot be foundSerenaFeng1-0/+4
OSError: [Errno 2] No such file or directory: '/Users/fengxiaowei/opnfv/qtip/.venv/lib/python2.7/ site-packages/qtip/cli/../../tests/data/benchmarks/plan' Change-Id: I510a2beb215b3e5c93cfa5870fd892b0c7720f01 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2017-03-10Merge "Add missing softwares"zhihui wu1-0/+2
2017-03-10Merge "modify logfile directory structure"zhihui wu13-72/+54
2017-03-10Add missing softwareswu.zhihui1-0/+2
Install iputils-ping for ping and rsync for synchronizing files and directories. Change-Id: I93ba44bcb04948bbe846fb179dc673aa86a6a92a Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-10Merge "Add basic swagger specifications and corresponding controllers"Yujun Zhang6-3/+279
2017-03-10Merge "Adding Labels"Yujun Zhang1-0/+2
2017-03-10modify logfile directory structurewu.zhihui13-72/+54
After one qtip test execution, the logfiles will be stored like this: `-- 2017-03-09-17-40 `-- node-41 |-- dhrystone | |-- inxi.log | |-- node-41.zte.com.cn-2017-03-09-01 | |-- node-41.zte.com.cn-2017-03-09-01.html | |-- node-41.zte.com.cn-2017-03-09-01.log | `-- top.log |-- dpi | |-- dpi_dump.txt | |-- inxi.log | `-- top.log |-- ramspeed | |-- Floatmem | |-- Intmem | |-- inxi.log | `-- top.log |-- ssl | |-- AES-128-CBC_dump | |-- RSA_dump | |-- inxi.log | `-- top.log `-- whetstone |-- inxi.log |-- node-41.zte.com.cn-2017-03-09-01 |-- node-41.zte.com.cn-2017-03-09-01.html |-- node-41.zte.com.cn-2017-03-09-01.log `-- top.log Change-Id: I5889a0e5dbe99f28212d6e0cdf69b9c03d89a9fe Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-09Add basic swagger specifications and corresponding controllersakhilbatra8986-3/+279
- Update specifications as per requirements - map specifications with controllers - make api installable JIRA: QTIP-220 Change-Id: Id149fdcf68e869e31a00cf16d7e725e368d2b25f Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>
2017-03-09Merge "Implement ansible driver"zhihui wu3-14/+143
2017-03-09Merge "Playbooks for unixbench"zhihui wu6-81/+118
2017-03-09regexes for dpi/ramspeed/sslwu.zhihui6-0/+1003
- Add dpi/ramspeed/ssl logfiles - update regexes for dpi/ramspeed/ssl result sample: dpi: { "bps": "4.57", "pps": "1.55" } ramspeed:{ "float_add": "9967.13", "float_copy": "7908.64", "float_scale": "7870.16", "float_triad": "10073.43", "float_average": "8954.84", "integer_add": "11649.55", "integer_copy": "11562.63", "integer_scale": "11563.77", "integer_triad": "11671.22", "integer_average": "11611.79" } ssl:{ "aes_128_cbc_1024_bytes": "584568.83k", "aes_128_cbc_16_bytes": "533103.05k", "aes_128_cbc_256_bytes": "580021.25k", "aes_128_cbc_64_bytes": "570042.22k", "aes_128_cbc_8192_bytes": "599470.83k" "rsa_sign_1024": "3.9", "rsa_sign_2048": "1.4", "rsa_sign_4096": "0.8", "rsa_sign_512": "8.4", "rsa_verify_1024": "88397.9", "rsa_verify_2048": "26951.3", "rsa_verify_4096": "7633.7", "rsa_verify_512": "222903.5" } Change-Id: I6db22a699111dd55d9dc48c6e8c2cf148b345563 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-09Merge "playbook for ramspeed"zhihui wu3-0/+137
2017-03-09Merge "Refactor openssl playbook"zhihui wu3-0/+159
2017-03-08Merge "Remove hardcode from some playbooks"zhihui wu3-3/+9
2017-03-08Merge "Refactor dpi playbook"zhihui wu5-14/+172
2017-03-08Implement ansible driverwu.zhihui3-14/+143
- According to inputs parameters, setup test environment. If failed during setupping, qtip will exited. If successful, execute metric tests. - Parameters(optional): * keypair: the keypair to login/execute commands to the remote hosts. They can be automatically generated. * hostfile: a inventory file. If not give, it can be automatically generated via installer. * args: the parameters passed to playbook - Use ansible python api to trigger ansible-playbook. Unit test will be in a new patch. Change-Id: I7470d348308f7cb6cb669bcc49063cf0f4da2111 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-08Refactor openssl playbookwu.zhihui3-0/+159
Local test is ok. Change-Id: I2800e364320697d436ed7b9202cc1baa3a893503 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-08Playbooks for unixbenchwu.zhihui6-81/+118
Actually, both dhrystone and whether use unixbench tool to get metric. Their playbook are too smiliar. The playbooks under /unixbench can be used to measure both of them. Change-Id: I26e31c2b4ac4de35ff8b7ec6dea26b676d5078de Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-08Adding LabelsShubhamRathi1-0/+2
Labels serve as anchors/ refs when referenced from other documents This patch adds labels to docs/*/*/index.rst Change-Id: Id23477c82231a1d02463802d60ee9d88a7fabc41 Signed-off-by: ShubhamRathi <shubhamiiitbackup@gmail.com>
2017-03-08playbook for ramspeedwu.zhihui3-0/+137
These playbooks are successfully executed on Local. Change-Id: Ie22ecb9b66364e6edf6ae0f59d0524603c4d46a9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-08Refactor dpi playbookwu.zhihui5-14/+172
Local test is ok. Change-Id: I22a333eae940433a1ca228e6ee7f570b8d0c0fc9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-08Remove hardcode from some playbookswu.zhihui3-3/+9
Remove hardcode ($HOME/qtip_result) from these three playbooks. Change-Id: Iefcf0d4c6caf6be6b6888ff6abe4c36621666129 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-07Merge "rework env.py"zhihui wu3-79/+396
2017-03-07Merge "Add `subrepo` basic usage in developer guide."Yujun Zhang1-0/+57
2017-03-07Merge "Qtip command completion."Yujun Zhang1-1/+17
2017-03-07Merge "Implement debug option"Yujun Zhang2-25/+13
2017-03-07Merge "Implement reporter module."Yujun Zhang6-11/+81
2017-03-07Merge "Create draft of report template in console"Yujun Zhang1-0/+22
2017-03-07Add `subrepo` basic usage in developer guide.Yujun Zhang1-0/+57
Change-Id: I4e066d91c9d0775ba698584f561cce997d60ad6b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-03-07Merge "Switch License tool to develop branch"Yujun Zhang2-5/+6
2017-03-04rework env.pywu.zhihui3-79/+396
Create a new class AnsibleEnvSetup for setuping test environment for ansible driver. Change-Id: I5d2385b33e5666acb7bbac1a6d960a805d846a32 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-04Merge "bugfix on bash scripts"zhihui wu2-21/+18
2017-03-04Merge "Refactor dhrystone playbook"zhihui wu9-1/+169
2017-03-04Implement debug optionTaseer Ahmed2-25/+13
Show traceback only when debug flag specified. JIRA: QTIP-201 Change-Id: I9cc4b4ed5a2cb2d2efabd9c0eb3aac216321ebac Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-03-04Merge "Add missing license headers"Yujun Zhang3-0/+27