summaryrefslogtreecommitdiffstats
path: root/qtip
AgeCommit message (Collapse)AuthorFilesLines
2017-01-20Merge "Metric module outline"zhihui wu2-58/+33
2017-01-17Metric module outlineTaseer Ahmed2-58/+33
Change-Id: Id95b07f1c0821ae0883c761fdf8f507afba4e5c0 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-12Move redundant files to legacyTaseer Ahmed1-14/+0
Change-Id: Iede9d0f72f857b48e8fe5b48c9ae6169870e0b7a Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-11Reorganize the project foldersYujun Zhang37-1711/+3
Code from Brahmaputra is no longer maintained, including: - docker - playbooks - scripts - utils They are moved to legacy folder to avoid unnecessary confusion to new developers. Change-Id: Ia50383ca5c3bd82571eb7b2184e7f83e264ff8a7 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-11sample QPI for doctor performance measured in verification jobYujun Zhang6-4/+40
The doctor benchmark plan produces a performance profile consist of timestamp at each checkpoint and time cost of each phase.[1] It collects data from log files and render a timeline diagram in console Current progress - skeleton created - method to be implemented [1]: http://artifacts.opnfv.org/doctor/docs/design/index.html#document-performance-profiler JIRA: QTIP-199 Change-Id: I60fbbd37d04a5724841bd85cb3bfed9eabd3741a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-11Merge "Implement plan, qpi and metric constructors"Yujun Zhang10-60/+122
2017-01-11Merge "Add module skeletons"zhihui wu20-103/+199
2017-01-09Merge "Rework Cli."zhihui wu1-5/+64
2017-01-07modify deprecated importsAkhil Batra3-5/+5
Add description for the api specs flask.ext.xx is deprecated. need to use flask_xx instead https://github.com/pallets/flask/issues/1135 Change-Id: I9960dd44d03243bde73df8633c45ec3a1f437cea Signed-off-by: Akhil Batra <akhil.batra@research.iiit.ac.in>
2017-01-06Rework Cli.Taseer Ahmed1-5/+64
Allows global arguments to be passed to each group. References: https://github.com/pallets/click/blob/master/examples/complex/complex/cli.py Change-Id: Ifed191add867b35ddfff92de0c7db4a03d67d091 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang10-60/+122
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Add module skeletonsYujun Zhang20-103/+199
- Remove `suite` and `case` which seems redundant at the moment - Rename `qtip.spec` to `qtip.loader` since the class loads spec - Add driver `sample` which will generate random performance data - Add collector `logfile` which will collect result from log files - Add reporter `console` which will print report to console - Add exception classes See updated class diagram in https://wiki.opnfv.org/display/qtip/Design JIRA: QTIP-148 JIRA: QTIP-193 Change-Id: Idf751d33428176a26224e4443100a142feda6f32 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-28Delete Ansible module. No longer required.Taseer Ahmed2-64/+1
JIRA: QTIP-150 Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-27Implment https://wiki.opnfv.org/display/qtip/DesignYujun Zhang10-103/+175
Note that some obsolete test cases are marked expected failure, will be deprecated after architecture evolution. JIRA: QTIP-148 Change-Id: I52bc9391569d516e298d9e659517161b4dce794a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-21Merge "Add skeletons of drivers, collector and reporter"Yujun Zhang7-0/+66
2016-12-20Exception handling for wrong testplanTaseer1-5/+11
JIRA: QTIP-184 Signed-off-by: Taseer Ahmed <taseer94@gmail.com> Change-Id: I0b989b52561526963c127fc03818cf41d67af35f
2016-12-20Add skeletons of drivers, collector and reporterYujun Zhang7-0/+66
Change-Id: I22a021800bbc813d7c5309d075fcbb8a19946e3f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-19Merge "Basic testplan layout JIRA: QTIP-184"zhihui wu1-0/+43
2016-12-15Merge "Add more comments to clarify runner prototype"Yujun Zhang3-3/+10
2016-12-14make qtip-server installableSerenaFeng1-2/+38
JIRA: QTIP-189 Change-Id: I8de0fa1ff3033fd37c499e75f35a5387f5345f8f Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-13Basic testplan layoutTaseer1-0/+43
JIRA: QTIP-184 Change-Id: I605f81fce9c4c59b75d286a6262995ea2fa2e21e Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-13Add more comments to clarify runner prototypeYujun Zhang3-3/+10
Change-Id: I25540985f425ee4ebd209c1708b5d25be582e746 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-13refactor qtip-server structureSerenaFeng10-46/+68
JIRA: QTIP-186 Change-Id: I4ecdcdc2869de0ef717ebf4bd1346e7c428b5b19 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-07Fix bugs in `runner/benchmark`Yujun Zhang1-2/+2
- should inherit `object` for common methods - should use instance class in abstract method Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Implement PerfTest prototypeYujun Zhang2-19/+7
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement TestPlan prototypeYujun Zhang3-63/+65
Refactor common part of Suite to Benchmark since both TestPlan and Suite are organized by files Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang1-8/+44
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-29correct module path in qtip.pywu.zhihui1-1/+1
See https://build.opnfv.org/ci/job/qtip-fuel-zte-pod3-daily-master/43/console for details. Change-Id: Ic12c4143bd29e7d56ac68e8a3317c8b3f36a274f Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-28Merge "bugfix: recovery qtip CI"Yujun Zhang1-0/+18
2016-11-26Merge "Fix test failing"Yujun Zhang8-6/+11
2016-11-26Merge "Bugfix: fix the qtip restful server unit test problem."Yujun Zhang1-1/+1
2016-11-26bugfix: recovery qtip CIwu.zhihui1-0/+18
https://build.opnfv.org/ci/job/qtip-fuel-zte-pod3-daily-master/40/console - move qtip.py to qtip/ - modifity docker/run_qtip.sh Change-Id: I9ec155c125f4be41e794142d0545d5cc54a1c6b3 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-25Bugfix: fix the qtip restful server unit test problem.zhifeng.jiang1-1/+1
JIRA:QTIP-158 Change-Id: I0ed1d3eb6959bb36615734ef757fa95560cb3baf Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-11-25Fix test failingYujun Zhang8-6/+11
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-25Fix exception caused by missing log folderYujun Zhang1-0/+3
Change-Id: I3a73cc0366e2c1a9c5965367ea68138f36ff1d63 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-24Use `pbr` for setup configurationYujun Zhang1-0/+14
- `pbr` does a bunch of things[1] and is used widely in OpenStack - moved legacy `qtip.py` to scripts in order to keep the project folder clean [1]: http://docs.openstack.org/developer/pbr/#what-it-does Change-Id: I6a9b83883283eaa527e2c3d4cd8d221ee6efca41 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-23Merge "Architecture evolution skeleton"Yujun Zhang4-0/+83
2016-11-23Merge "push test results to qtip dashboard server"zhihui wu1-0/+8
2016-11-21Cli list related fixeslinux_geek2-2/+3
JIRA: QTIP-154 Change-Id: I95ab04fab35ff599c338ce07870602b58635e833 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-11-21push test results to qtip dashboard serverSerenaFeng1-0/+8
JIRA: QTIP-166 Change-Id: Ic9b06c5dc0065850f8d766ecb66b74835b8677df Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-11-21Architecture evolution skeletonYujun Zhang4-0/+83
- benchmarks will be driven by qtip.runner - qtip.runner is used by both qtip.cli and qtip.api - unit test for each module will be placed under tests/unit - functional tests will be moved to tests/functional - data as testing sample will be moved to tests/data NOTE: this patch moves files only, it may fails many tests. To be followed up in next step. JIRA: QTIP-148 Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-18Merge changes from topics 'fix', 'cli'zhihui wu2-30/+35
* changes: Bugfix: Correct the path in setup and entry points Ansible related commands in its own module.
2016-11-17Merge "Need to go one level up to reach project/root directory for listing ↵Yujun Zhang1-1/+1
purposes."
2016-11-17Bugfix: Correct the path in setup and entry pointslinux_geek1-30/+6
JIRA: QTIP-154 Change-Id: I00320818e2d2e633c901b126775cbeb5a721f6fd Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-11-17Ansible related commands in its own module.linux_geek1-0/+29
JIRA: QTIP-154 JIRA: QTIP-150 Change-Id: I1bdd8d74d8978fd86ea659dae914f12874b6687d Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-11-16Bugfix:Correct the import path in qtip_server.zhifeng.jiang3-4/+4
JIRA:QTIP-158 Change-Id: I962b01496346dc2257b069b4feffaef6dd094322 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-11-16Merge "CLI-Installation Frame work."Yujun Zhang1-0/+54
2016-11-16Merge "Rename command files."zhihui wu3-0/+0
2016-11-16CLI-Installation Frame work.linux_geek1-0/+54
JIRA: QTIP-151 Change-Id: I7ab5240e2d5b85bd98e6059717d20a812b466e4d Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-11-15Merge "bugfix: correct the path of test_plan"zhihui wu2-6/+6