aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-02-19Clean up tests folderYujun Zhang10-18/+0
- remove __init__.py as recommended in pytest docs[1] - rename cli test files for a consistent naming style - remove empty test files [1]: http://docs.pytest.org/en/latest/goodpractices.html#choosing-a-test-layout-import-rules Change-Id: Idfb5d8a8fb7a590ef988a761991b8e313089e9bc Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-15Implement logfile collector and grep parserYujun Zhang10-37/+136
JIRA: QTIP-207 JIRA: QTIP-208 Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-15Refactoring collector initialization in plan loaderYujun Zhang3-5/+6
- move ClassProps to module - collectors should be array in plan definition Change-Id: I37d85dbc977c91aa1bb81de45b5e1c41660e6d1f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-15Add test for yaml_file loaderYujun Zhang4-0/+36
Change-Id: I997ceeed17bd35889f6b0f3465bbe75df256b71e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-07Add unit test for BaseTransformerYujun Zhang2-0/+15
Change-Id: Ia379af759d9442f5b53f5052682e6218acef8a1b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-05Fix bug that metric test is not collectedYujun Zhang1-4/+4
Change-Id: I2e05891a89745712274757ba9af928b03fb5edf6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-29Refactor loader classesYujun Zhang2-9/+9
- rename BaseLoader to YamlFileLoader as base class of QTIP specs loader - create an abstract BaseLoader - create FileLoader for logfile collector Change-Id: I0c992cd847fc0dce4fdd73a13c1cdbc406c84532 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-26Merge "Code refactoring about doctor QPI"Yujun Zhang13-0/+502
2017-01-25Merge "Click's built in support for version option"zhihui wu1-1/+1
2017-01-25Merge "Small corrections"zhihui wu1-3/+6
2017-01-25Merge "Plan module draft"zhihui wu1-0/+31
2017-01-25Merge "Formalize constants for property names"zhihui wu3-29/+29
2017-01-23Click's built in support for version optionTaseer Ahmed1-1/+1
Change-Id: I62ffde066fe2fcb5be7af9a29686a7d380353670 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-23Merge "QPI Module Outline"Yujun Zhang1-0/+31
2017-01-23Code refactoring about doctor QPIYujun Zhang13-0/+502
- Move sample log files to test data - Move configuration from plugin to plan Change-Id: Iaaf36ab3ce29c2eafe2d75f3524e7a302cc3836d Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-23Formalize constants for property namesYujun Zhang3-29/+29
Change-Id: I68560b2299c2a815219bc0d0399124e0c269a2c0 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-22Small correctionsTaseer Ahmed1-3/+6
JIRA: QTIP-188 Change-Id: I5820403527fe4df5e23472923e34660c72195d50 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-22Plan module draftTaseer Ahmed1-0/+31
JIRA: QTIP-205 JIRA: QTIP-188 Change-Id: Ia871191851d25e1986834f8a7efdbeb8a8d87ec3 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-21QPI Module OutlineTaseer Ahmed1-0/+31
Change-Id: I19b666dfdb3e3c10622397bda00460d6fb5c269d Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-20Merge "Metric module outline"zhihui wu1-0/+28
2017-01-17Metric module outlineTaseer Ahmed1-0/+28
Change-Id: Id95b07f1c0821ae0883c761fdf8f507afba4e5c0 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-12Move redundant files to legacyTaseer Ahmed3-23/+0
Change-Id: Iede9d0f72f857b48e8fe5b48c9ae6169870e0b7a Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-11Reorganize the project foldersYujun Zhang23-979/+0
Code from Brahmaputra is no longer maintained, including: - docker - playbooks - scripts - utils They are moved to legacy folder to avoid unnecessary confusion to new developers. Change-Id: Ia50383ca5c3bd82571eb7b2184e7f83e264ff8a7 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-11Merge "Implement plan, qpi and metric constructors"Yujun Zhang7-38/+36
2017-01-11Merge "Add module skeletons"zhihui wu16-128/+68
2017-01-06Rework Cli.Taseer Ahmed2-31/+32
Allows global arguments to be passed to each group. References: https://github.com/pallets/click/blob/master/examples/complex/complex/cli.py Change-Id: Ifed191add867b35ddfff92de0c7db4a03d67d091 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang7-38/+36
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Add module skeletonsYujun Zhang16-128/+68
- Remove `suite` and `case` which seems redundant at the moment - Rename `qtip.spec` to `qtip.loader` since the class loads spec - Add driver `sample` which will generate random performance data - Add collector `logfile` which will collect result from log files - Add reporter `console` which will print report to console - Add exception classes See updated class diagram in https://wiki.opnfv.org/display/qtip/Design JIRA: QTIP-148 JIRA: QTIP-193 Change-Id: Idf751d33428176a26224e4443100a142feda6f32 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-28Delete Ansible module. No longer required.Taseer Ahmed2-13/+2
JIRA: QTIP-150 Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-27Merge "Implment https://wiki.opnfv.org/display/qtip/Design"Yujun Zhang24-132/+309
2016-12-27Implment https://wiki.opnfv.org/display/qtip/DesignYujun Zhang24-132/+309
Note that some obsolete test cases are marked expected failure, will be deprecated after architecture evolution. JIRA: QTIP-148 Change-Id: I52bc9391569d516e298d9e659517161b4dce794a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-20All unit tests.Taseer6-31/+65
JIRA: QTIP-184 Change-Id: I577b8df85d2be63f9195ed2bb3c6bf497ce1fd96 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-19Merge "Unit Test for Ansible Module"zhihui wu1-0/+31
2016-12-16Merge "Add unit test for `describe` method"zhihui wu3-0/+18
2016-12-15Unit Test for Ansible ModuleTaseer1-0/+31
JIRA: QTIP-188 Change-Id: I10b3fb979f52d10e8dedf956831f8320c04a36ea Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-13Add unit test for `describe` methodYujun Zhang3-0/+18
Change-Id: I6d37ab283d7fcfb0c15dd8065121b706dd80392b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-13refactor qtip-server structureSerenaFeng1-5/+11
JIRA: QTIP-186 Change-Id: I4ecdcdc2869de0ef717ebf4bd1346e7c428b5b19 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-08Fix relative path in test caseYujun Zhang2-4/+25
Use abspath for fixture files to make tests independent from cwd Change-Id: Ie965899c5311e26ad708f44463b1992d9b8e697b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Fix bugs in `runner/benchmark`Yujun Zhang3-0/+3
- should inherit `object` for common methods - should use instance class in abstract method Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Implement PerfTest prototypeYujun Zhang2-2/+30
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement TestPlan prototypeYujun Zhang3-17/+45
Refactor common part of Suite to Benchmark since both TestPlan and Suite are organized by files Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang4-1/+29
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-05Skip unstable test `tests.unit.utils.create_zones_test`Yujun Zhang1-0/+1
JIRA: QTIP-175 Change-Id: Ib4891c8f37445285f2ea414d5988e55ca71cf10f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-29Enable all unit tests except two failed casesYujun Zhang5-6/+2
- `test_ping` in `env_setup_test` still halts - `test_prepare_and_run_benchmark_successful` in `args_handler_test` fails - excluded `pep8` since already coverred by opnfv-lint task Change-Id: Ib5ea20c37a27e356aea6d8eed3750b3269bd67f4 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-25Fix test failingYujun Zhang11-30/+49
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-21Architecture evolution skeletonYujun Zhang27-0/+39
- benchmarks will be driven by qtip.runner - qtip.runner is used by both qtip.cli and qtip.api - unit test for each module will be placed under tests/unit - functional tests will be moved to tests/functional - data as testing sample will be moved to tests/data NOTE: this patch moves files only, it may fails many tests. To be followed up in next step. JIRA: QTIP-148 Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-16Bugfix: Correct the path in unit test.zhifeng.jiang8-32/+32
Change-Id: I2e019230bc50222222c5df4c0d18640616fff074 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-11-14bugfix: correct the path of test_planwu.zhihui2-3/+3
JIRA: QTIP-161 Change-Id: If591c6b6d6ca1d4d7b721115c93c7b58ff7d819b Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-09Merge func to utilswu.zhihui7-28/+27
Local test is ok. JIRA: QTIP-131 Change-Id: I7009337903c7ded90dda47a05d6c1c95aa96815d Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-08Bugfix: cli.py and its unit test casewu.zhihui1-4/+6
since qtip use log instead of print, assert sentence need to modify. Change-Id: I8d19d0e50c4c70f34c7e916c7828984163586260 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>