aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-04-27bugfix: regex node rolezhihui wu1-1/+1
In NEC pod based with apex, node role is incorrectly regexed. Change-Id: I90d5eb92e6eec4abf850137f50ffc4df02257615 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-04-26Add developer guide for frameworkYujun Zhang2-0/+82
Change-Id: Iff4a45847ef12320afd3e64acfe32152e6ca0595 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-26Add user guide for using ansible-playbook to run QTIP benchmarksYujun Zhang3-6/+158
Change-Id: Ic04f83d91447944ed0fa507d6fffeed0a18b65fe Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-26Add support for reporting to testapiYujun Zhang1-2/+3
Change-Id: If363e7e5d14bdd6a1a12a553a2f162be3c23f530 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-26Add support for result aggregationYujun Zhang7-7/+62
Change-Id: I678b765f3f430cb6a5d130d94960273b8eea85e7 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-26Include memory metrics to calculationYujun Zhang3-0/+28
Change-Id: Iaf67cc53d7c95a4f3527000e479936a57a4c41cc Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Merge workspace files into one folderYujun Zhang15-6/+11
Change-Id: Ie8d0e8fdd6d6c212701ba1ee10b1d05da1ccca22 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Add dpi metrics to calculationYujun Zhang3-2/+13
Change-Id: I4ae05af6e8c29d94b2b3f3b4dd748c4325dfa410 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Organize common tasks under qtip-common roleYujun Zhang13-42/+113
Change-Id: I8592efdac7e6c2161eb7cb1b36d023697ebe7ad4 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Rewrite `export_to_file` as decoratorYujun Zhang3-15/+16
Change-Id: Ibf852038fac986801a3fc2c608a0ddb1572abbde Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Add ssl aes metrics in qpi calculationYujun Zhang8-11/+72
Change-Id: Id568aa3942849e105ca24892babff2acaec21121 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Prompt for variables required for creating workspaceYujun Zhang1-2/+28
Change-Id: I9fa48ebcb8433cbc2f8101e59a285d50b0497273 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Export collected metrics to json as inputs for calculatingYujun Zhang4-1/+6
Change-Id: Id2dce1e750f646aeb972221229556fcd647a3637 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Support running collect stage onlyYujun Zhang5-17/+40
- add `always` tag to tasks required for all stages - apply `setup`, `collect` and `run` tag to each stage Change-Id: I806ec1add08bb18cb5b2848c78a039ed8a38c8ff Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Fix package missing on debian hostsYujun Zhang1-1/+2
Change-Id: I4cc5c78f1b33f17234bbcf4864b01c550dc0e487 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Collect arithmetic metrics from unixbenchYujun Zhang5-22/+36
Change-Id: I3e9ca649f3b35908c162d5036dcde3a333278f6d Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Save logs before collectingYujun Zhang5-40/+70
Change-Id: I0e39103ef917fa7ea86d5c47de0cc71c37fca74c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Unify workdirYujun Zhang13-51/+110
- use role variable `workdir` - download dependencies to remote workdir with checksum Change-Id: I2a7991e014e365fec532520c2b57a3fe480914d8 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Cleanup metrics reportYujun Zhang7-20/+24
Change-Id: I79b56d7490930db171fe93e314be4f6d73b0063b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Add support for render a justified output from list and dictYujun Zhang2-5/+20
Change-Id: I4411e62b3d1a067cfa8ae1296cf521877aedb830 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Organize **all** tasks into ansible role `qtip`Yujun Zhang16-102/+174
Change-Id: I5d3852d2a31e9c4043191377e5cb7d539d222a8c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-22Organize results in folder named with pod and current dateYujun Zhang7-10/+20
Change-Id: I0882fb4548c3c3a6a72c6f752f8074e553ee3748 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-22Rename foldersYujun Zhang36-6/+6
* copy -> defaults * render -> custom * roles -> ansible_roles Change-Id: Ia96214691873f3bd8e6c5f9f433292fd912ac46e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-22Fix bug on apexYujun Zhang8-42/+63
missing repository configuration and packages Change-Id: I929e3bafced56b2ab8fd90edc21421bd7bde2073 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21correct document of module apex_generate_inventoryzhihui wu1-14/+11
Change-Id: I10bfd526e377ae02d2f6cf6d60d82fbb175ac431 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-04-21Dump unixbench results without top folderYujun Zhang1-1/+1
Change-Id: Ic86e03643c7d6720d6de13e8749ebe0208ab9391 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Fix issues when running qtip first timeYujun Zhang3-2/+9
- results folder not created - hostkey check should be skipped Change-Id: I658f5c459617d1651eec360edd53a8766f7387c1 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Add AES testing in SSL metricsYujun Zhang3-18/+44
Change-Id: Iee1b1711d9ce07c468bc390966c55bd49abea228 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Set default folder for dump dataYujun Zhang1-6/+8
Change-Id: I2b96bcf369b13a679a417d78ebca19b3e63155e2 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Organize testapi tasks into ansible rolesYujun Zhang5-44/+76
Change-Id: If073401b94e7146521fb54a85470b931e458de3c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Cleanup customizable variables of workspaceYujun Zhang7-20/+31
Change-Id: I00185b7c73692e2aeafb1307cea81f4f2d149c74 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Group test results and report under nodeYujun Zhang17-79/+78
Change-Id: I66286787d06c5012c6dcf516cffb9f6fd76522c5 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Add comments about workspace parametersYujun Zhang1-6/+16
Change-Id: I45f7547a15b66b6901cb5a298e3f097cd6d2257d Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Reorganize benchmarking tasks into ansible roles which helps toYujun Zhang24-24/+54
- group task with related templates and variables - simplify the main playbook to improve readability See: http://docs.ansible.com/ansible/playbooks_roles.html Change-Id: I9d3180edaac83ee9dba85ce5ac14ff574af7a905 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Merge "Fix workspace creator"Yujun Zhang18-54/+97
2017-04-20Merge "Set default width to 80 for justify filter"Yujun Zhang4-114/+26
2017-04-20Fix workspace creatorYujun Zhang18-54/+97
- handle relative path in workspace - handle differences between installers - create working directories Change-Id: I5fbe66c1218c29db0fafd87085a6cf5c15a91dc5 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Merge "Automate QTIP upload to PyPI."zhihui wu1-0/+6
2017-04-20Automate QTIP upload to PyPI.Taseer1-0/+6
Change-Id: I3be05a75551ca8648f6ea7dea35f1180178e5b7d Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-04-20Restore default content of ansible.cfgYujun Zhang1-3/+417
The comments are very helpful when updating configuration Change-Id: If04bc2d784981991a5bb0e5b7599280180b44704 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Create workspace by ansible playbookYujun Zhang17-41/+117
Change-Id: Ia79353e686240c5915e40b8202d3fdc289df2158 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Merge "Add UnixBench benchmarking role"Yujun Zhang6-1/+70
2017-04-20Merge "Use ansible roles to setup development tools"Yujun Zhang4-20/+33
2017-04-20Merge "Use different folder for cached data"Yujun Zhang3-4/+6
2017-04-20Merge "Fix error in details"Yujun Zhang1-1/+1
2017-04-20Merge "fix apex integration"Yujun Zhang3-36/+33
2017-04-20Add UnixBench benchmarking roleYujun Zhang6-1/+70
Change-Id: I14e1630ff67bf4dff0998456e57fee2b1656f585 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Use ansible roles to setup development toolsYujun Zhang4-20/+33
Change-Id: I897773edf8dcacf08e67fa3eb999c4c10ba22805 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Use different folder for cached dataYujun Zhang3-4/+6
- `dump` is for raw testing data and logs from remote - `cache` for temporary data required for testing Change-Id: I540338eae2dd7bbd14b359e1a0dbce186ada902b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Fix error in detailsYujun Zhang1-1/+1
The leading space causes `details` value to be string, not dict Change-Id: Ie2acfd91f2ec9280c0a24e2459229a72f45350af Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>