Age | Commit message (Collapse) | Author | Files | Lines |
|
|
|
|
|
Local test is ok.
The result will be written to report.json.
usage: runner.py [-h] -d DEST -b BENCHMARK
optional arguments:
-d DEST, --dest DEST the destination where results will be stored.
-b BENCHMARK, --benchmark BENCHMARK
the benchmark you want to execute.
Change-Id: Ic3a70c65a5aa045bf9df34ce4d14957a7a1b3dcf
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
- Put all the regex rules in regex.yaml.
- According to benchmark name, we can find related regexes.
Change-Id: Ic15bd1c77b525be3751011fa94d582da077b0345
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
|
|
|
|
|
|
If IF_DEBUG is True, there is not cleanup step.
If IF_DEBUG is False, host file and keypair will be
deleted on local and public key will be removed from
remote nodes in the end of test.
Change-Id: I4a88acc2d428e41e4abaedacb011e27468b2cb57
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
- typo in ramspeed/run.yaml
- fix result logfile name for dhrystone and whetstone
Change-Id: Ic8456174a14d04c2207990eccb16601762c5a880
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
- Loads Qtip components from the default path.
JIRA: QTIP-205
Change-Id: Id87993d65c5cd6a23c199cf1049d75a0971b6354
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
- All specs can be listed
- All specs can be individually retrieved
- API can be installed alongside qtip
- API can be hosted using command `qtip-api`
JIRA: QTIP-221
JIRA: QTIP-222
Change-Id: I1e80e6609cae1252cb2fcdc38c71b4bf6d02e8c9
Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>
|
|
|
|
|
|
After one qtip test execution, the logfiles will be stored like this:
`-- 2017-03-09-17-40
`-- node-41
|-- dhrystone
| |-- inxi.log
| |-- node-41.zte.com.cn-2017-03-09-01
| |-- node-41.zte.com.cn-2017-03-09-01.html
| |-- node-41.zte.com.cn-2017-03-09-01.log
| `-- top.log
|-- dpi
| |-- dpi_dump.txt
| |-- inxi.log
| `-- top.log
|-- ramspeed
| |-- Floatmem
| |-- Intmem
| |-- inxi.log
| `-- top.log
|-- ssl
| |-- AES-128-CBC_dump
| |-- RSA_dump
| |-- inxi.log
| `-- top.log
`-- whetstone
|-- inxi.log
|-- node-41.zte.com.cn-2017-03-09-01
|-- node-41.zte.com.cn-2017-03-09-01.html
|-- node-41.zte.com.cn-2017-03-09-01.log
`-- top.log
Change-Id: I5889a0e5dbe99f28212d6e0cdf69b9c03d89a9fe
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
- Update specifications as per requirements
- map specifications with controllers
- make api installable
JIRA: QTIP-220
Change-Id: Id149fdcf68e869e31a00cf16d7e725e368d2b25f
Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
- According to inputs parameters, setup test environment. If failed
during setupping, qtip will exited. If successful, execute metric
tests.
- Parameters(optional):
* keypair: the keypair to login/execute commands to the remote
hosts. They can be automatically generated.
* hostfile: a inventory file. If not give, it can be
automatically generated via installer.
* args: the parameters passed to playbook
- Use ansible python api to trigger ansible-playbook.
Unit test will be in a new patch.
Change-Id: I7470d348308f7cb6cb669bcc49063cf0f4da2111
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Local test is ok.
Change-Id: I2800e364320697d436ed7b9202cc1baa3a893503
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Actually, both dhrystone and whether use unixbench tool
to get metric. Their playbook are too smiliar.
The playbooks under /unixbench can be used to measure
both of them.
Change-Id: I26e31c2b4ac4de35ff8b7ec6dea26b676d5078de
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
These playbooks are successfully executed on Local.
Change-Id: Ie22ecb9b66364e6edf6ae0f59d0524603c4d46a9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Local test is ok.
Change-Id: I22a333eae940433a1ca228e6ee7f570b8d0c0fc9
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Remove hardcode ($HOME/qtip_result) from these three
playbooks.
Change-Id: Iefcf0d4c6caf6be6b6888ff6abe4c36621666129
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
|
|
|
|
|
|
|
|
Create a new class AnsibleEnvSetup for setuping
test environment for ansible driver.
Change-Id: I5d2385b33e5666acb7bbac1a6d960a805d846a32
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
|
|
|
|
Show traceback only when debug flag specified.
JIRA: QTIP-201
Change-Id: I9cc4b4ed5a2cb2d2efabd9c0eb3aac216321ebac
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
- Add cli module
- Implement timeline outline
JIRA: QTIP-199
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
Change-Id: I487b76123a785731c356143d1ae7f3123c11f398
|
|
Change-Id: I33cdd3b1304c695b81d2e23434a70acfcc9a21f8
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
When debugging on real environment, I found these two bugs.
Local test is ok.
Change-Id: I799afe6a4c24fcdf370d761c83376ca3f2ce43d2
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Change-Id: Ie6e626753c6562c361542c45e8504d177d624d2a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- Break previous one playbook into three playbooks:
setup.yaml: setup test environment.
run.yaml: execute test steps
clean.yaml: cleanup test environment to restore
environment
The advantage is cleaning part will never be blocked by another.
- Just do testing on remote hosts, parse logfile on localhost.
- Use ansible module instead of shell command.
- Move up all files under /ansible and remove ansible directory.
Under /ansible, ansible package cann't be imported.
Change-Id: I43c65be23869b7d42ca769994d4decb9a012d196
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
|
|
- modify env.py and scripts
- add unit test
Change-Id: I416cd517bdddfeb907675705009d83ecada7f87c
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
- yardstick driver will not be implemented in Danube release
- sample driver is no longer continued
Change-Id: I22a86fe22b08c85b2a18ef70443d725bc4a25246
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
|
|
|
|
|
|
FileLoader was trying to initialize abspath by finding a matched
name from abspath which will lead to an exception. Use default
paths of class instead.
Change-Id: I8ca2122e97edd734aa68b4c6b12196960842313b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
|
|
|
|
Change-Id: Ibb630ea34701e454aabf78821f4c40781d2607ed
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|