Age | Commit message (Collapse) | Author | Files | Lines |
|
- More robust testing
Change-Id: Iaef21e9e244e1b5112ea5faa630e04424dc0b264
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
Change-Id: Ic86002732c87d3b4ac5b5b3b664f116354d4bf9d
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
Change-Id: I6732c7cf572d5b744c3a176ce266b9739e9233fd
Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
|
|
- renamed `workspace` to `project`, which is more accurate
- group create/setup/run/teardown into `project`
- shortcut for project commands, e.g. `qtip create` <=> `qtip project create`
- even shorter command alias, e.g. `qtip s` => `qtip setup`
Change-Id: I69ba5aa571bccc1cc4687481189c329b099bee91
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- Execute runner via a shell command
- Change format of qtip result directory to qtip-timestamp
- Add path option in reporter to match with runner
JIRA: QTIP-229
Change-Id: I7d8562fd7100b1f40cdc8d53b0daa6a06a55b495
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
Add the cleanup step in runner.py
Change-Id: I0016986485eab5d7ab45d4a7a393bea5fb6f96b5
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Local test is ok.
The result will be written to report.json.
usage: runner.py [-h] -d DEST -b BENCHMARK
optional arguments:
-d DEST, --dest DEST the destination where results will be stored.
-b BENCHMARK, --benchmark BENCHMARK
the benchmark you want to execute.
Change-Id: Ic3a70c65a5aa045bf9df34ce4d14957a7a1b3dcf
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
- deprecate current PoC
- cover it with test
Change-Id: Ia1a43c195781fdd09e7d925ed3bf4509f226916f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- move method make_tbd to qtip.util.dev
- add suffix Error to follow the Python naming convention
- rename arguments of NotFoundError to make it generic
Change-Id: I81e406b7fa10c3b40004434f6a9c2e7bbf7603ee
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-207
JIRA: QTIP-208
Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I68560b2299c2a815219bc0d0399124e0c269a2c0
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- separate runner from `plan` and move `plan` to `loader`
- rename `algorithm` to `formula`
- use `numpy` for formulas
- update sample qpi and metrics
Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- Remove `suite` and `case` which seems redundant at the moment
- Rename `qtip.spec` to `qtip.loader` since the class loads spec
- Add driver `sample` which will generate random performance data
- Add collector `logfile` which will collect result from log files
- Add reporter `console` which will print report to console
- Add exception classes
See updated class diagram in https://wiki.opnfv.org/display/qtip/Design
JIRA: QTIP-148
JIRA: QTIP-193
Change-Id: Idf751d33428176a26224e4443100a142feda6f32
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Note that some obsolete test cases are marked expected failure, will
be deprecated after architecture evolution.
JIRA: QTIP-148
Change-Id: I52bc9391569d516e298d9e659517161b4dce794a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I25540985f425ee4ebd209c1708b5d25be582e746
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- should inherit `object` for common methods
- should use instance class in abstract method
Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Refactor common part of Suite to Benchmark since both TestPlan
and Suite are organized by files
Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- skip several failure cases, to be fixed in future
- rename `test_plan` to hide from test discovering
- add pep8 check by default
- fix errors in pep8 check
Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- benchmarks will be driven by qtip.runner
- qtip.runner is used by both qtip.cli and qtip.api
- unit test for each module will be placed under tests/unit
- functional tests will be moved to tests/functional
- data as testing sample will be moved to tests/data
NOTE: this patch moves files only, it may fails many tests. To be
followed up in next step.
JIRA: QTIP-148
Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|