aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-06-28Fix bug in aggregationYujun Zhang1-1/+1
Change-Id: Ic6613a9ab585894984e1cdab6ead3a84d1c4af9c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-06-26Refactor output formatTaseer1-13/+15
- Merge scores and results in qpi.json - metrics: {} will be completely removed as a consequence - Make baseline the same format as spec Change-Id: Id0cc487002a38c51736de07f3759fd78d42a0b9c Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-06-06add system_info and condition to qpi reportzhihui wu1-3/+18
According to the part "system_info" and "condition" in spec, gather these data and add them to qpi report. Change-Id: I5efc996c2bfb34452e9aa323d8288c1dd2d8d276 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-06-06Merge "Beautify the argument names"Yujun Zhang1-2/+2
2017-06-06Merge "Pass on unhandled options."zhihui wu1-0/+18
2017-06-05Beautify the argument namesYujun Zhang1-2/+2
- keep the argument consisten with OPNFV convention - installer-ip is not used because in fact we use host address instead - remove optional argurment from prompt Change-Id: I3db3cf53b62cc86e143bc59a7dd8bb83d0f74b7d Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-06-02Pass on unhandled options.Taseer1-0/+18
- More robust testing Change-Id: Iaef21e9e244e1b5112ea5faa630e04424dc0b264 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-06-02Refactor CliTaseer1-4/+0
- Remove reduntant contexts - Remove verbose option - Use builtin help and version options Change-Id: Ifb66009b5f9ab95428ce87c90f739b5221ccdd6f Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-06-02Merge "metrics baseline in compute-baseline.json"zhihui wu1-7/+50
2017-06-01metrics baseline in compute-baseline.jsonzhihui wu1-7/+50
- Previously, metrics baseline are defined in the spec file. In this patch, move metrics baseline to compute-baseline.json. - you can get qpi based with baseline file given in calculate.yml - you can generate a customized baseline file when baseline file is not given in calculate.yml And baseline will be removed from the spec file. Change-Id: I123d28e28543cb153b60120b5076306fa2fa3873 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-05-31Merge "Pass on all unhandled options"Yujun Zhang1-0/+37
2017-05-29Pass on all unhandled optionsTaseer Ahmed1-0/+37
Change-Id: Ic86002732c87d3b4ac5b5b3b664f116354d4bf9d Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-05-25Add support for create new project from different templatesYujun Zhang1-1/+1
Change-Id: Ic260c59b12eb9882406d6172311f2e401963c64b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-05-23use the git link to replace qtip_speczhihui wu1-2/+2
Change-Id: Iaee076c06d54754f2d761dd85eab58353ee32ae4 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-05-23update run_ci.shzhihui wu1-1/+3
- change "qtip workspace create" to "qtip create" - set pod_name and scenario from env if not provided by user as options Change-Id: I0a7e1923c6e45a263147dd2f87a6a75c3751c65c Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-05-19Merge "Remove "plan" module. Replaced by "project""zhihui wu1-43/+0
2017-05-19Merge "Implement sunburst badge for QPI"Yujun Zhang2-12/+26
2017-05-18Remove "plan" module. Replaced by "project"Charlie Root1-43/+0
Change-Id: I5da2a3cf366e4e5a67b68e34db62219587d923e5 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-05-17Merge "delete unuse code in directory /qtip"zhihui wu2-323/+0
2017-05-16delete unuse code in directory /qtipzhihui wu2-323/+0
Change-Id: I6732c7cf572d5b744c3a176ce266b9739e9233fd Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-05-16Implement sunburst badge for QPIYujun Zhang2-12/+26
Change-Id: Iccdec7b0ac223a38c846f73adc6bd0e53db3723b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-05-16Switch to qtip-cli for ci jobYujun Zhang1-3/+3
Change-Id: Id485803a56a89ef1dd80d3597bcc10e7d70cd87a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-05-13Merge "The script for CI"Yujun Zhang1-0/+91
2017-05-11The script for CIzhihui wu1-0/+91
- The script includes all steps to trigger QTIP test On CI. - Add a dependency iputils-ping for command "ping" Change-Id: Ia7712cc9eedf227686896e2a38f3b8baf03d7397 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-05-11delete test scripts which are copied from releng/jjb/qtipzhihui wu3-107/+0
It is not suitable to copy these test scripts to QTIP. Change-Id: I64df9f0b7b6886ccdef89e28db26cfc1f83df6d8 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-05-07Implement qtip workspace createTaseer3-83/+0
Change-Id: Ibd4213a6c4c86a7f4e8f99b16cba5055a3abba39 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-04-30Copy integration test scripts from releng/jjb/qtipYujun Zhang3-0/+107
- it is better to manage these builder scripts in project instead of releng - releng shall keep only the job scheduler and publisher Change-Id: Idf8685427d8d24b1da83f31afdc7c640c0af2e5f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-26Add user guide for using ansible-playbook to run QTIP benchmarksYujun Zhang1-6/+6
Change-Id: Ic04f83d91447944ed0fa507d6fffeed0a18b65fe Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-26Add support for result aggregationYujun Zhang4-0/+37
Change-Id: I678b765f3f430cb6a5d130d94960273b8eea85e7 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Add ssl aes metrics in qpi calculationYujun Zhang1-0/+7
Change-Id: Id568aa3942849e105ca24892babff2acaec21121 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-25Prompt for variables required for creating workspaceYujun Zhang1-2/+28
Change-Id: I9fa48ebcb8433cbc2f8101e59a285d50b0497273 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-24Add support for render a justified output from list and dictYujun Zhang1-4/+10
Change-Id: I4411e62b3d1a067cfa8ae1296cf521877aedb830 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-22Rename foldersYujun Zhang1-1/+1
* copy -> defaults * render -> custom * roles -> ansible_roles Change-Id: Ia96214691873f3bd8e6c5f9f433292fd912ac46e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-22Fix bug on apexYujun Zhang1-2/+2
missing repository configuration and packages Change-Id: I929e3bafced56b2ab8fd90edc21421bd7bde2073 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Cleanup customizable variables of workspaceYujun Zhang1-6/+17
Change-Id: I00185b7c73692e2aeafb1307cea81f4f2d149c74 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Add comments about workspace parametersYujun Zhang1-6/+16
Change-Id: I45f7547a15b66b6901cb5a298e3f097cd6d2257d Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Reorganize benchmarking tasks into ansible roles which helps toYujun Zhang1-1/+1
- group task with related templates and variables - simplify the main playbook to improve readability See: http://docs.ansible.com/ansible/playbooks_roles.html Change-Id: I9d3180edaac83ee9dba85ce5ac14ff574af7a905 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Merge "Fix workspace creator"Yujun Zhang2-2/+8
2017-04-20Merge "Set default width to 80 for justify filter"Yujun Zhang2-110/+22
2017-04-20Fix workspace creatorYujun Zhang2-2/+8
- handle relative path in workspace - handle differences between installers - create working directories Change-Id: I5fbe66c1218c29db0fafd87085a6cf5c15a91dc5 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Create workspace by ansible playbookYujun Zhang11-234/+16
Change-Id: Ia79353e686240c5915e40b8202d3fdc289df2158 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Merge "Add UnixBench benchmarking role"Yujun Zhang2-0/+9
2017-04-20Merge "Use ansible roles to setup development tools"Yujun Zhang2-0/+10
2017-04-20Merge "Use different folder for cached data"Yujun Zhang1-0/+1
2017-04-20Merge "Fix error in details"Yujun Zhang1-1/+1
2017-04-20Merge "fix apex integration"Yujun Zhang2-2/+23
2017-04-20Add UnixBench benchmarking roleYujun Zhang2-0/+9
Change-Id: I14e1630ff67bf4dff0998456e57fee2b1656f585 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Use ansible roles to setup development toolsYujun Zhang2-0/+10
Change-Id: I897773edf8dcacf08e67fa3eb999c4c10ba22805 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Use different folder for cached dataYujun Zhang1-0/+1
- `dump` is for raw testing data and logs from remote - `cache` for temporary data required for testing Change-Id: I540338eae2dd7bbd14b359e1a0dbce186ada902b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Fix error in detailsYujun Zhang1-1/+1
The leading space causes `details` value to be string, not dict Change-Id: Ie2acfd91f2ec9280c0a24e2459229a72f45350af Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>