summaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-04-19Merge "Collect dpi metrics and report"Yujun Zhang1-1/+6
2017-04-19Merge "Add nDPI tasks"Yujun Zhang2-0/+7
2017-04-19Merge "Enable task profiling"Yujun Zhang1-0/+2
2017-04-19Merge "Add unittests for testapi client"zhihui wu1-0/+116
2017-04-19Merge "Add E release development version."zhihui wu1-1/+2
2017-04-18Add unittests for testapi clientakhilbatra8981-0/+116
Change-Id: I33ffd6ca6110b5fb245a3fc31fc0c63e11588fb8 Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>
2017-04-18Collect dpi metrics and reportYujun Zhang1-1/+6
Change-Id: I0e02cff9a5bfc123b3227803289fc03abe27f112 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-18Add E release development version.Taseer1-1/+2
Change-Id: Icda9c44aa33e63d46da0c5187157132a49db0882 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-04-18Add nDPI tasksYujun Zhang2-0/+7
Change-Id: I18b797d7fb8e5ca1bfd74dbcb836ec4feb318378 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-18Merge "apex integration"zhihui wu3-0/+124
2017-04-18Enable task profilingYujun Zhang1-0/+2
Benchmark jobs takes a long time, enable task profiling to collect estimated run time so that we can set time out for async job correctly Change-Id: Ie9518380acc8da06f26f762ea016b7837a8bd2fb Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-18apex integrationzhihui wu3-0/+124
Change-Id: Ief21554dfa7cd79e7ed0cb1615f6dbf079cb6077 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-04-17push results to testapiYujun Zhang2-1/+22
Change-Id: Ie6e231690f92971b776cd41af18b21acb43bb199 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-17Add testapi setup taskYujun Zhang6-0/+54
Change-Id: I7b4d3186afd724ec5a30cf630baee79875e426bb Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-17Aggregate qpi score from all nodesYujun Zhang1-1/+8
Change-Id: Ib711a493a949b013ffe22519861f144dc47d0334 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-17Move YAML resources to /resources.Yujun Zhang16-846/+23
- replacing the content of /benchmarks will break current module like api/cli - migration required before surpressing the current benchmarks/ folder Change-Id: I8bd04eeb18aaa3c966330ff7adbe85a267680fc1 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-16Load benchmark specification from external fileYujun Zhang2-53/+25
Change-Id: If72f1d98b90f9666c17aa28b3b88f32178ee4166 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-15Merge "Dump collected facts"Yujun Zhang2-2/+6
2017-04-15Merge "rename output file to sample"Yujun Zhang2-0/+0
2017-04-14Merge "User friendly messages for exceptions"zhihui wu3-0/+9
2017-04-13User friendly messages for exceptionsTaseer3-0/+9
- Use colorama for color - Implement verbosity option in separate patch Change-Id: Ib2491d867e9bbf59cb00874d99a11f86ad7eea1b Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-04-12Dump collected factsYujun Zhang2-2/+6
Change-Id: Id0b7b2e94016a73ffcaa2d737af1ca33230b3662 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-12rename output file to sampleYujun Zhang2-0/+0
Change-Id: I9c62114ebd6c2016fa177565a4413138cafd573b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-12Refactoring connection taskYujun Zhang7-20/+195
- split `compute` playbook into `setup` and `run` - save inventory and ssh configuration after in `setup` Change-Id: I0803a954ffcd7c07861ff6bdb76acdbfaa4815bd Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Fix reporting tasksYujun Zhang1-3/+2
- no need to specify `local_action` on `local` hosts - no need to delegate to `localhost` on `local` hosts Change-Id: I9e7843ce8ba414a786784943b8c253d615271233 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Implement a sample qpi report to show how to retrieve variables from ↵Yujun Zhang3-1/+67
benchmark results Change-Id: I479e4446c18d45d69d2f88db021f7739201104d9 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Normalize system info variables and reportYujun Zhang5-18/+18
Change-Id: I5627b4e2fa2287a1880433c7f25d9a2d1874cc26 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Integrate openssl metrics for qpi calculateYujun Zhang3-8/+128
Change-Id: I7319cd9b49cb27ba4fa367e395ceb2caa543c06e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-10Implement calculator PoCYujun Zhang1-0/+85
- use `mean` as default formula Change-Id: I236b46c1e52f3535fb6e954d324790b1421126bd Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-07Add todo items for integrationYujun Zhang2-1/+34
Change-Id: I15cc5f81cc4aee27d536e8f654aa36c16c27c72b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-07Integrate reporterYujun Zhang6-5/+63
Change-Id: I7b13282dbae576e36c01c959182bc0838b36649e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-07Add integration testYujun Zhang4-0/+505
- integrate test tasks with collector - require fuel-master in `~/.ssh/config` to run TODO: - integerate calculator and reporter - generate/execute ansible playbooks from benchmark plan Change-Id: I1984e07fe620e219a9eadad4a2ec668627729d31 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-06Add ansible action plugin `collect`Yujun Zhang1-0/+36
- this plugin collects information or metrics from string - it is reworked from qtip.collector.parser.grep - the captured subgroups are always list even only one match found Change-Id: I1def3d7b40c7928b503fae1be531976a13e5d0be Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-06Add ansible module `fuel`Yujun Zhang2-0/+10289
This module will be used to generate a dynamic inventory of fuel nodes for performance testing Change-Id: Idaa491c5fc3050abfb8ba36328f2113cf2885179 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-03Beautify compute reportTaseer2-71/+48
Change-Id: I0c4faa3720d980970f923697c879627ccbf22852 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-03-29Add jinja2 filter justifyYujun Zhang1-0/+19
It will be used in report template Change-Id: I69fd891db5e69b2dec441bd296836e6806461b78 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-03-24Merge "Integrate cli, runner and reporter."zhihui wu3-24/+305
2017-03-23Integrate cli, runner and reporter.Taseer3-24/+305
- Execute runner via a shell command - Change format of qtip result directory to qtip-timestamp - Add path option in reporter to match with runner JIRA: QTIP-229 Change-Id: I7d8562fd7100b1f40cdc8d53b0daa6a06a55b495 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-03-22Add unit tests for List and get in API.akhilbatra8984-0/+151
- refactor controllers - remove abspath and other irrelvant data in response - move fixtures - refactor decorators JIRA: QTIP-226 Change-Id: I5fac5b1bc998da198098992e7ddb47ba49685f31 Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>
2017-03-20Merge "Refactor reporter module"zhihui wu4-42/+157
2017-03-18Refactor reporter moduleTaseer4-42/+157
- Create templates for report format specific to each metric. - Outputs the details of the specified metric across all the nodes in cluster. - Timeline to be covered in a separate patch JIRA: QTIP-199 Change-Id: Ic83749725b0c9cc5bd9a7f24f21b2cd113abe0e1 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-03-16Merge "Implement 'show' command."Yujun Zhang3-6/+10
2017-03-14Implement 'show' command.Taseer3-6/+10
- Render the description via templates JIRA: QTIP-205 Change-Id: I10523f85f80350e901a4a701bb65ca4833f8ff7c Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-03-13optimize console infowu.zhihui1-21/+5
- use QtipLogger instead of print - delete useless print Change-Id: I1e08382a5d78ce53cf455496363bce3762b81dd2 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-10Implement 'list' command.Taseer3-8/+10
- Loads Qtip components from the default path. JIRA: QTIP-205 Change-Id: Id87993d65c5cd6a23c199cf1049d75a0971b6354 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-03-09regexes for dpi/ramspeed/sslwu.zhihui6-0/+1003
- Add dpi/ramspeed/ssl logfiles - update regexes for dpi/ramspeed/ssl result sample: dpi: { "bps": "4.57", "pps": "1.55" } ramspeed:{ "float_add": "9967.13", "float_copy": "7908.64", "float_scale": "7870.16", "float_triad": "10073.43", "float_average": "8954.84", "integer_add": "11649.55", "integer_copy": "11562.63", "integer_scale": "11563.77", "integer_triad": "11671.22", "integer_average": "11611.79" } ssl:{ "aes_128_cbc_1024_bytes": "584568.83k", "aes_128_cbc_16_bytes": "533103.05k", "aes_128_cbc_256_bytes": "580021.25k", "aes_128_cbc_64_bytes": "570042.22k", "aes_128_cbc_8192_bytes": "599470.83k" "rsa_sign_1024": "3.9", "rsa_sign_2048": "1.4", "rsa_sign_4096": "0.8", "rsa_sign_512": "8.4", "rsa_verify_1024": "88397.9", "rsa_verify_2048": "26951.3", "rsa_verify_4096": "7633.7", "rsa_verify_512": "222903.5" } Change-Id: I6db22a699111dd55d9dc48c6e8c2cf148b345563 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2017-03-07Merge "rework env.py"zhihui wu1-34/+263
2017-03-07Merge "Implement debug option"Yujun Zhang1-4/+5
2017-03-07Merge "Implement reporter module."Yujun Zhang3-6/+42
2017-03-04rework env.pywu.zhihui1-34/+263
Create a new class AnsibleEnvSetup for setuping test environment for ansible driver. Change-Id: I5d2385b33e5666acb7bbac1a6d960a805d846a32 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>