summaryrefslogtreecommitdiffstats
path: root/qtip/runner
AgeCommit message (Collapse)AuthorFilesLines
2017-03-24Integrate cli, runner and reporter.Taseer1-1/+1
- Execute runner via a shell command - Change format of qtip result directory to qtip-timestamp - Add path option in reporter to match with runner JIRA: QTIP-229 Change-Id: I7d8562fd7100b1f40cdc8d53b0daa6a06a55b495 Signed-off-by: Taseer Ahmed <taseer94@gmail.com> (cherry picked from commit c2bb13c460566a18e61a3c840bf12f7f717940c2)
2017-03-15add the cleanup step in runner.pywu.zhihui1-1/+3
Add the cleanup step in runner.py Change-Id: I0016986485eab5d7ab45d4a7a393bea5fb6f96b5 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn> (cherry picked from commit 57ec2e7a9757cbb1da8a1f73f0c55e8a5cb67bec)
2017-03-14Implement the workflow of compute qpiwu.zhihui1-0/+105
Local test is ok. The result will be written to report.json. usage: runner.py [-h] -d DEST -b BENCHMARK optional arguments: -d DEST, --dest DEST the destination where results will be stored. -b BENCHMARK, --benchmark BENCHMARK the benchmark you want to execute. Change-Id: Ic3a70c65a5aa045bf9df34ce4d14957a7a1b3dcf Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn> (cherry picked from commit 478cd02a9219f7c8b49d8529d1f809a04399ad0d)
2017-02-22Refactoring qtip.runnerYujun Zhang2-43/+12
- deprecate current PoC - cover it with test Change-Id: Ia1a43c195781fdd09e7d925ed3bf4509f226916f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-21Refactoring qtip.base.errorYujun Zhang1-6/+6
- move method make_tbd to qtip.util.dev - add suffix Error to follow the Python naming convention - rename arguments of NotFoundError to make it generic Change-Id: I81e406b7fa10c3b40004434f6a9c2e7bbf7603ee Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-15Implement logfile collector and grep parserYujun Zhang1-3/+3
JIRA: QTIP-207 JIRA: QTIP-208 Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-23Formalize constants for property namesYujun Zhang1-5/+5
Change-Id: I68560b2299c2a815219bc0d0399124e0c269a2c0 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang3-70/+43
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Add module skeletonsYujun Zhang4-50/+55
- Remove `suite` and `case` which seems redundant at the moment - Rename `qtip.spec` to `qtip.loader` since the class loads spec - Add driver `sample` which will generate random performance data - Add collector `logfile` which will collect result from log files - Add reporter `console` which will print report to console - Add exception classes See updated class diagram in https://wiki.opnfv.org/display/qtip/Design JIRA: QTIP-148 JIRA: QTIP-193 Change-Id: Idf751d33428176a26224e4443100a142feda6f32 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-27Implment https://wiki.opnfv.org/display/qtip/DesignYujun Zhang5-94/+43
Note that some obsolete test cases are marked expected failure, will be deprecated after architecture evolution. JIRA: QTIP-148 Change-Id: I52bc9391569d516e298d9e659517161b4dce794a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-13Add more comments to clarify runner prototypeYujun Zhang3-3/+10
Change-Id: I25540985f425ee4ebd209c1708b5d25be582e746 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Fix bugs in `runner/benchmark`Yujun Zhang1-2/+2
- should inherit `object` for common methods - should use instance class in abstract method Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Implement PerfTest prototypeYujun Zhang2-19/+7
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement TestPlan prototypeYujun Zhang3-63/+65
Refactor common part of Suite to Benchmark since both TestPlan and Suite are organized by files Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang1-8/+44
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-25Fix test failingYujun Zhang1-0/+0
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-21Architecture evolution skeletonYujun Zhang4-0/+83
- benchmarks will be driven by qtip.runner - qtip.runner is used by both qtip.cli and qtip.api - unit test for each module will be placed under tests/unit - functional tests will be moved to tests/functional - data as testing sample will be moved to tests/data NOTE: this patch moves files only, it may fails many tests. To be followed up in next step. JIRA: QTIP-148 Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>