aboutsummaryrefslogtreecommitdiffstats
path: root/tests/unit/runner
AgeCommit message (Collapse)AuthorFilesLines
2017-02-22Refactoring qtip.runnerYujun Zhang1-0/+16
- deprecate current PoC - cover it with test Change-Id: Ia1a43c195781fdd09e7d925ed3bf4509f226916f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-19Clean up tests folderYujun Zhang1-0/+0
- remove __init__.py as recommended in pytest docs[1] - rename cli test files for a consistent naming style - remove empty test files [1]: http://docs.pytest.org/en/latest/goodpractices.html#choosing-a-test-layout-import-rules Change-Id: Idfb5d8a8fb7a590ef988a761991b8e313089e9bc Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang1-38/+0
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Add module skeletonsYujun Zhang4-81/+9
- Remove `suite` and `case` which seems redundant at the moment - Rename `qtip.spec` to `qtip.loader` since the class loads spec - Add driver `sample` which will generate random performance data - Add collector `logfile` which will collect result from log files - Add reporter `console` which will print report to console - Add exception classes See updated class diagram in https://wiki.opnfv.org/display/qtip/Design JIRA: QTIP-148 JIRA: QTIP-193 Change-Id: Idf751d33428176a26224e4443100a142feda6f32 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-27Implment https://wiki.opnfv.org/display/qtip/DesignYujun Zhang6-129/+95
Note that some obsolete test cases are marked expected failure, will be deprecated after architecture evolution. JIRA: QTIP-148 Change-Id: I52bc9391569d516e298d9e659517161b4dce794a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-13Add unit test for `describe` methodYujun Zhang3-0/+18
Change-Id: I6d37ab283d7fcfb0c15dd8065121b706dd80392b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Fix bugs in `runner/benchmark`Yujun Zhang3-0/+3
- should inherit `object` for common methods - should use instance class in abstract method Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Implement PerfTest prototypeYujun Zhang1-2/+30
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement TestPlan prototypeYujun Zhang3-17/+45
Refactor common part of Suite to Benchmark since both TestPlan and Suite are organized by files Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang1-1/+29
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-21Architecture evolution skeletonYujun Zhang4-0/+39
- benchmarks will be driven by qtip.runner - qtip.runner is used by both qtip.cli and qtip.api - unit test for each module will be placed under tests/unit - functional tests will be moved to tests/functional - data as testing sample will be moved to tests/data NOTE: this patch moves files only, it may fails many tests. To be followed up in next step. JIRA: QTIP-148 Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>