summaryrefslogtreecommitdiffstats
path: root/qtip
AgeCommit message (Collapse)AuthorFilesLines
2017-01-29Refactor loader classesYujun Zhang9-60/+123
- rename BaseLoader to YamlFileLoader as base class of QTIP specs loader - create an abstract BaseLoader - create FileLoader for logfile collector Change-Id: I0c992cd847fc0dce4fdd73a13c1cdbc406c84532 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-25Merge "refactor useful legacy code about preparing test enviroment"Yujun Zhang3-0/+284
2017-01-25Merge "Click's built in support for version option"zhihui wu1-7/+2
2017-01-25Merge "Small corrections"zhihui wu1-1/+2
2017-01-25Merge "Plan module draft"zhihui wu1-22/+23
2017-01-25Merge "Formalize constants for property names"zhihui wu5-24/+49
2017-01-23Click's built in support for version optionTaseer Ahmed1-7/+2
Change-Id: I62ffde066fe2fcb5be7af9a29686a7d380353670 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-23Merge "QPI Module Outline"Yujun Zhang2-54/+35
2017-01-23Formalize constants for property namesYujun Zhang5-24/+49
Change-Id: I68560b2299c2a815219bc0d0399124e0c269a2c0 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-23refactor useful legacy code about preparing test enviromentwu.zhihui3-0/+284
- move useful scripts to qtip/scripts - refactor some functions which belong to env_setup.py and add them to qtip/runner/env.py Change-Id: Ibf6c27103dfc45016920f4b602cd72d703c1f636 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-01-22Small correctionsTaseer Ahmed1-1/+2
JIRA: QTIP-188 Change-Id: I5820403527fe4df5e23472923e34660c72195d50 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-22Plan module draftTaseer Ahmed1-22/+23
JIRA: QTIP-205 JIRA: QTIP-188 Change-Id: Ia871191851d25e1986834f8a7efdbeb8a8d87ec3 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-21QPI Module OutlineTaseer Ahmed2-54/+35
Change-Id: I19b666dfdb3e3c10622397bda00460d6fb5c269d Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-20Merge "Metric module outline"zhihui wu2-58/+33
2017-01-17Metric module outlineTaseer Ahmed2-58/+33
Change-Id: Id95b07f1c0821ae0883c761fdf8f507afba4e5c0 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-12Move redundant files to legacyTaseer Ahmed1-14/+0
Change-Id: Iede9d0f72f857b48e8fe5b48c9ae6169870e0b7a Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-11Reorganize the project foldersYujun Zhang37-1711/+3
Code from Brahmaputra is no longer maintained, including: - docker - playbooks - scripts - utils They are moved to legacy folder to avoid unnecessary confusion to new developers. Change-Id: Ia50383ca5c3bd82571eb7b2184e7f83e264ff8a7 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-11sample QPI for doctor performance measured in verification jobYujun Zhang6-4/+40
The doctor benchmark plan produces a performance profile consist of timestamp at each checkpoint and time cost of each phase.[1] It collects data from log files and render a timeline diagram in console Current progress - skeleton created - method to be implemented [1]: http://artifacts.opnfv.org/doctor/docs/design/index.html#document-performance-profiler JIRA: QTIP-199 Change-Id: I60fbbd37d04a5724841bd85cb3bfed9eabd3741a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-11Merge "Implement plan, qpi and metric constructors"Yujun Zhang10-60/+122
2017-01-11Merge "Add module skeletons"zhihui wu20-103/+199
2017-01-09Merge "Rework Cli."zhihui wu1-5/+64
2017-01-07modify deprecated importsAkhil Batra3-5/+5
Add description for the api specs flask.ext.xx is deprecated. need to use flask_xx instead https://github.com/pallets/flask/issues/1135 Change-Id: I9960dd44d03243bde73df8633c45ec3a1f437cea Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>
2017-01-06Rework Cli.Taseer Ahmed1-5/+64
Allows global arguments to be passed to each group. References: https://github.com/pallets/click/blob/master/examples/complex/complex/cli.py Change-Id: Ifed191add867b35ddfff92de0c7db4a03d67d091 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang10-60/+122
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Add module skeletonsYujun Zhang20-103/+199
- Remove `suite` and `case` which seems redundant at the moment - Rename `qtip.spec` to `qtip.loader` since the class loads spec - Add driver `sample` which will generate random performance data - Add collector `logfile` which will collect result from log files - Add reporter `console` which will print report to console - Add exception classes See updated class diagram in https://wiki.opnfv.org/display/qtip/Design JIRA: QTIP-148 JIRA: QTIP-193 Change-Id: Idf751d33428176a26224e4443100a142feda6f32 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-28Delete Ansible module. No longer required.Taseer Ahmed2-64/+1
JIRA: QTIP-150 Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-27Implment https://wiki.opnfv.org/display/qtip/DesignYujun Zhang10-103/+175
Note that some obsolete test cases are marked expected failure, will be deprecated after architecture evolution. JIRA: QTIP-148 Change-Id: I52bc9391569d516e298d9e659517161b4dce794a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-21Merge "Add skeletons of drivers, collector and reporter"Yujun Zhang7-0/+66
2016-12-20Exception handling for wrong testplanTaseer1-5/+11
JIRA: QTIP-184 Signed-off-by: Taseer Ahmed <taseer94@gmail.com> Change-Id: I0b989b52561526963c127fc03818cf41d67af35f
2016-12-20Add skeletons of drivers, collector and reporterYujun Zhang7-0/+66
Change-Id: I22a021800bbc813d7c5309d075fcbb8a19946e3f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-19Merge "Basic testplan layout JIRA: QTIP-184"zhihui wu1-0/+43
2016-12-15Merge "Add more comments to clarify runner prototype"Yujun Zhang3-3/+10
2016-12-14make qtip-server installableSerenaFeng1-2/+38
JIRA: QTIP-189 Change-Id: I8de0fa1ff3033fd37c499e75f35a5387f5345f8f Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-13Basic testplan layoutTaseer1-0/+43
JIRA: QTIP-184 Change-Id: I605f81fce9c4c59b75d286a6262995ea2fa2e21e Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-13Add more comments to clarify runner prototypeYujun Zhang3-3/+10
Change-Id: I25540985f425ee4ebd209c1708b5d25be582e746 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-13refactor qtip-server structureSerenaFeng10-46/+68
JIRA: QTIP-186 Change-Id: I4ecdcdc2869de0ef717ebf4bd1346e7c428b5b19 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-07Fix bugs in `runner/benchmark`Yujun Zhang1-2/+2
- should inherit `object` for common methods - should use instance class in abstract method Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Implement PerfTest prototypeYujun Zhang2-19/+7
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement TestPlan prototypeYujun Zhang3-63/+65
Refactor common part of Suite to Benchmark since both TestPlan and Suite are organized by files Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang1-8/+44
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-29correct module path in qtip.pywu.zhihui1-1/+1
See https://build.opnfv.org/ci/job/qtip-fuel-zte-pod3-daily-master/43/console for details. Change-Id: Ic12c4143bd29e7d56ac68e8a3317c8b3f36a274f Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-28Merge "bugfix: recovery qtip CI"Yujun Zhang1-0/+18
2016-11-26Merge "Fix test failing"Yujun Zhang8-6/+11
2016-11-26Merge "Bugfix: fix the qtip restful server unit test problem."Yujun Zhang1-1/+1
2016-11-26bugfix: recovery qtip CIwu.zhihui1-0/+18
https://build.opnfv.org/ci/job/qtip-fuel-zte-pod3-daily-master/40/console - move qtip.py to qtip/ - modifity docker/run_qtip.sh Change-Id: I9ec155c125f4be41e794142d0545d5cc54a1c6b3 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-25Bugfix: fix the qtip restful server unit test problem.zhifeng.jiang1-1/+1
JIRA:QTIP-158 Change-Id: I0ed1d3eb6959bb36615734ef757fa95560cb3baf Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-11-25Fix test failingYujun Zhang8-6/+11
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-25Fix exception caused by missing log folderYujun Zhang1-0/+3
Change-Id: I3a73cc0366e2c1a9c5965367ea68138f36ff1d63 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-24Use `pbr` for setup configurationYujun Zhang1-0/+14
- `pbr` does a bunch of things[1] and is used widely in OpenStack - moved legacy `qtip.py` to scripts in order to keep the project folder clean [1]: http://docs.openstack.org/developer/pbr/#what-it-does Change-Id: I6a9b83883283eaa527e2c3d4cd8d221ee6efca41 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-23Merge "Architecture evolution skeleton"Yujun Zhang4-0/+83