Age | Commit message (Collapse) | Author | Files | Lines |
|
- remove __init__.py as recommended in pytest docs[1]
- rename cli test files for a consistent naming style
- remove empty test files
[1]: http://docs.pytest.org/en/latest/goodpractices.html#choosing-a-test-layout-import-rules
Change-Id: Idfb5d8a8fb7a590ef988a761991b8e313089e9bc
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-207
JIRA: QTIP-208
Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- move ClassProps to module
- collectors should be array in plan definition
Change-Id: I37d85dbc977c91aa1bb81de45b5e1c41660e6d1f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I997ceeed17bd35889f6b0f3465bbe75df256b71e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: Ia379af759d9442f5b53f5052682e6218acef8a1b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I2e05891a89745712274757ba9af928b03fb5edf6
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- rename BaseLoader to YamlFileLoader as base class of QTIP specs loader
- create an abstract BaseLoader
- create FileLoader for logfile collector
Change-Id: I0c992cd847fc0dce4fdd73a13c1cdbc406c84532
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
|
|
|
|
|
|
|
|
Change-Id: I62ffde066fe2fcb5be7af9a29686a7d380353670
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
|
|
Change-Id: I68560b2299c2a815219bc0d0399124e0c269a2c0
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-188
Change-Id: I5820403527fe4df5e23472923e34660c72195d50
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
JIRA: QTIP-205
JIRA: QTIP-188
Change-Id: Ia871191851d25e1986834f8a7efdbeb8a8d87ec3
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
Change-Id: I19b666dfdb3e3c10622397bda00460d6fb5c269d
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
|
|
Change-Id: Id95b07f1c0821ae0883c761fdf8f507afba4e5c0
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
Code from Brahmaputra is no longer maintained, including:
- docker
- playbooks
- scripts
- utils
They are moved to legacy folder to avoid unnecessary confusion to new developers.
Change-Id: Ia50383ca5c3bd82571eb7b2184e7f83e264ff8a7
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
|
|
|
|
Allows global arguments to be passed to each group.
References:
https://github.com/pallets/click/blob/master/examples/complex/complex/cli.py
Change-Id: Ifed191add867b35ddfff92de0c7db4a03d67d091
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
- separate runner from `plan` and move `plan` to `loader`
- rename `algorithm` to `formula`
- use `numpy` for formulas
- update sample qpi and metrics
Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- Remove `suite` and `case` which seems redundant at the moment
- Rename `qtip.spec` to `qtip.loader` since the class loads spec
- Add driver `sample` which will generate random performance data
- Add collector `logfile` which will collect result from log files
- Add reporter `console` which will print report to console
- Add exception classes
See updated class diagram in https://wiki.opnfv.org/display/qtip/Design
JIRA: QTIP-148
JIRA: QTIP-193
Change-Id: Idf751d33428176a26224e4443100a142feda6f32
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-150
Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
|
|
Note that some obsolete test cases are marked expected failure, will
be deprecated after architecture evolution.
JIRA: QTIP-148
Change-Id: I52bc9391569d516e298d9e659517161b4dce794a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-184
Change-Id: I577b8df85d2be63f9195ed2bb3c6bf497ce1fd96
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
|
|
|
|
JIRA: QTIP-188
Change-Id: I10b3fb979f52d10e8dedf956831f8320c04a36ea
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
Change-Id: I6d37ab283d7fcfb0c15dd8065121b706dd80392b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-186
Change-Id: I4ecdcdc2869de0ef717ebf4bd1346e7c428b5b19
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
Use abspath for fixture files to make tests independent from cwd
Change-Id: Ie965899c5311e26ad708f44463b1992d9b8e697b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- should inherit `object` for common methods
- should use instance class in abstract method
Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Refactor common part of Suite to Benchmark since both TestPlan
and Suite are organized by files
Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-175
Change-Id: Ib4891c8f37445285f2ea414d5988e55ca71cf10f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- `test_ping` in `env_setup_test` still halts
- `test_prepare_and_run_benchmark_successful` in `args_handler_test` fails
- excluded `pep8` since already coverred by opnfv-lint task
Change-Id: Ib5ea20c37a27e356aea6d8eed3750b3269bd67f4
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- skip several failure cases, to be fixed in future
- rename `test_plan` to hide from test discovering
- add pep8 check by default
- fix errors in pep8 check
Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- benchmarks will be driven by qtip.runner
- qtip.runner is used by both qtip.cli and qtip.api
- unit test for each module will be placed under tests/unit
- functional tests will be moved to tests/functional
- data as testing sample will be moved to tests/data
NOTE: this patch moves files only, it may fails many tests. To be
followed up in next step.
JIRA: QTIP-148
Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|