summaryrefslogtreecommitdiffstats
path: root/tests/data
AgeCommit message (Collapse)AuthorFilesLines
2017-03-24Integrate cli, runner and reporter.Taseer1-0/+265
- Execute runner via a shell command - Change format of qtip result directory to qtip-timestamp - Add path option in reporter to match with runner JIRA: QTIP-229 Change-Id: I7d8562fd7100b1f40cdc8d53b0daa6a06a55b495 Signed-off-by: Taseer Ahmed <taseer94@gmail.com> (cherry picked from commit c2bb13c460566a18e61a3c840bf12f7f717940c2)
2017-03-21Refactor reporter moduleTaseer1-3/+0
- Create templates for report format specific to each metric. - Outputs the details of the specified metric across all the nodes in cluster. - Timeline to be covered in a separate patch JIRA: QTIP-199 Change-Id: Ic83749725b0c9cc5bd9a7f24f21b2cd113abe0e1 Signed-off-by: Taseer Ahmed <taseer94@gmail.com> (cherry picked from commit 04e50e57819bdf40a2fd7abdd3fc7be798771e0b)
2017-03-09regexes for dpi/ramspeed/sslwu.zhihui6-0/+1003
- Add dpi/ramspeed/ssl logfiles - update regexes for dpi/ramspeed/ssl result sample: dpi: { "bps": "4.57", "pps": "1.55" } ramspeed:{ "float_add": "9967.13", "float_copy": "7908.64", "float_scale": "7870.16", "float_triad": "10073.43", "float_average": "8954.84", "integer_add": "11649.55", "integer_copy": "11562.63", "integer_scale": "11563.77", "integer_triad": "11671.22", "integer_average": "11611.79" } ssl:{ "aes_128_cbc_1024_bytes": "584568.83k", "aes_128_cbc_16_bytes": "533103.05k", "aes_128_cbc_256_bytes": "580021.25k", "aes_128_cbc_64_bytes": "570042.22k", "aes_128_cbc_8192_bytes": "599470.83k" "rsa_sign_1024": "3.9", "rsa_sign_2048": "1.4", "rsa_sign_4096": "0.8", "rsa_sign_512": "8.4", "rsa_verify_1024": "88397.9", "rsa_verify_2048": "26951.3", "rsa_verify_4096": "7633.7", "rsa_verify_512": "222903.5" } Change-Id: I6db22a699111dd55d9dc48c6e8c2cf148b345563 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-03Implement reporter module.Taseer Ahmed1-0/+3
- Add cli module - Implement timeline outline JIRA: QTIP-199 Signed-off-by: Taseer Ahmed <taseer94@gmail.com> Change-Id: I487b76123a785731c356143d1ae7f3123c11f398
2017-02-24Fix bug when no paths is given for Plan constructorYujun Zhang1-0/+14
FileLoader was trying to initialize abspath by finding a matched name from abspath which will lead to an exception. Use default paths of class instead. Change-Id: I8ca2122e97edd734aa68b4c6b12196960842313b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-21Implement the collector regex for system info logfile.wu.zhihui1-0/+46
I commented sone lines. Because these part can't be supported well by grep_in_file(). Change-Id: Ifc0ab1b6f40180e40c150b2c80eeaa6c72274ac9 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-02-21Add licence header according to OPNFV contribution guidelines[1] by script[2]Yujun Zhang12-0/+96
[1]: https://wiki.opnfv.org/display/DEV/Contribution+Guidelines [2]: https://github.com/Justin-chi/Lab/blob/master/add_license.sh Change-Id: I5b77394a104857bb4ee9addbe973ed239b7a59f3 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-20Merge "code refactor: ansible playbook about system info"zhihui wu3-0/+496
2017-02-20code refactor: ansible playbook about system infowu.zhihui3-0/+496
- use module yum and apt instead of shell command - break sys_info_pbook.yaml into some small playbooks Change-Id: I33b36fa826c0e668e4a74846ad4da7f4a245a33f Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-02-15Implement logfile collector and grep parserYujun Zhang4-34/+29
JIRA: QTIP-207 JIRA: QTIP-208 Change-Id: Icc14d3097fb305e59df716636ef87504490c9d1b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-15Refactoring collector initialization in plan loaderYujun Zhang2-3/+3
- move ClassProps to module - collectors should be array in plan definition Change-Id: I37d85dbc977c91aa1bb81de45b5e1c41660e6d1f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-02-15Add test for yaml_file loaderYujun Zhang3-0/+3
Change-Id: I997ceeed17bd35889f6b0f3465bbe75df256b71e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-29Refactor loader classesYujun Zhang1-8/+8
- rename BaseLoader to YamlFileLoader as base class of QTIP specs loader - create an abstract BaseLoader - create FileLoader for logfile collector Change-Id: I0c992cd847fc0dce4fdd73a13c1cdbc406c84532 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-23Code refactoring about doctor QPIYujun Zhang13-0/+502
- Move sample log files to test data - Move configuration from plugin to plan Change-Id: Iaaf36ab3ce29c2eafe2d75f3524e7a302cc3836d Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-12Move redundant files to legacyTaseer Ahmed3-23/+0
Change-Id: Iede9d0f72f857b48e8fe5b48c9ae6169870e0b7a Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-01-11Reorganize the project foldersYujun Zhang11-357/+0
Code from Brahmaputra is no longer maintained, including: - docker - playbooks - scripts - utils They are moved to legacy folder to avoid unnecessary confusion to new developers. Change-Id: Ia50383ca5c3bd82571eb7b2184e7f83e264ff8a7 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang4-33/+25
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Add module skeletonsYujun Zhang9-21/+26
- Remove `suite` and `case` which seems redundant at the moment - Rename `qtip.spec` to `qtip.loader` since the class loads spec - Add driver `sample` which will generate random performance data - Add collector `logfile` which will collect result from log files - Add reporter `console` which will print report to console - Add exception classes See updated class diagram in https://wiki.opnfv.org/display/qtip/Design JIRA: QTIP-148 JIRA: QTIP-193 Change-Id: Idf751d33428176a26224e4443100a142feda6f32 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-28Delete Ansible module. No longer required.Taseer Ahmed1-12/+0
JIRA: QTIP-150 Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-27Merge "Implment https://wiki.opnfv.org/display/qtip/Design"Yujun Zhang11-0/+92
2016-12-27Implment https://wiki.opnfv.org/display/qtip/DesignYujun Zhang11-0/+92
Note that some obsolete test cases are marked expected failure, will be deprecated after architecture evolution. JIRA: QTIP-148 Change-Id: I52bc9391569d516e298d9e659517161b4dce794a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-20All unit tests.Taseer4-0/+35
JIRA: QTIP-184 Change-Id: I577b8df85d2be63f9195ed2bb3c6bf497ce1fd96 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-07Implement PerfTest prototypeYujun Zhang1-0/+0
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang3-0/+0
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-25Fix test failingYujun Zhang5-0/+0
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-21Architecture evolution skeletonYujun Zhang8-0/+350
- benchmarks will be driven by qtip.runner - qtip.runner is used by both qtip.cli and qtip.api - unit test for each module will be placed under tests/unit - functional tests will be moved to tests/functional - data as testing sample will be moved to tests/data NOTE: this patch moves files only, it may fails many tests. To be followed up in next step. JIRA: QTIP-148 Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-09Merge func to utilswu.zhihui1-0/+1
Local test is ok. JIRA: QTIP-131 Change-Id: I7009337903c7ded90dda47a05d6c1c95aa96815d Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-08-21Add ansible_api so that python call ansible playbook by api.zhifeng.jiang2-0/+6
modification: Add ansible_api so that we can get ansible running results easily. Add UT for ansible_api.py JIRA:QTIP-99 Change-Id: I6e7b0b97e4d9ef184978833c61c17e944c1eb20c Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>