summaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-04-21Cleanup customizable variables of workspaceYujun Zhang1-6/+17
Change-Id: I00185b7c73692e2aeafb1307cea81f4f2d149c74 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Add comments about workspace parametersYujun Zhang1-6/+16
Change-Id: I45f7547a15b66b6901cb5a298e3f097cd6d2257d Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Reorganize benchmarking tasks into ansible roles which helps toYujun Zhang1-1/+1
- group task with related templates and variables - simplify the main playbook to improve readability See: http://docs.ansible.com/ansible/playbooks_roles.html Change-Id: I9d3180edaac83ee9dba85ce5ac14ff574af7a905 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-21Merge "Fix workspace creator"Yujun Zhang2-2/+8
2017-04-20Merge "Set default width to 80 for justify filter"Yujun Zhang2-110/+22
2017-04-20Fix workspace creatorYujun Zhang2-2/+8
- handle relative path in workspace - handle differences between installers - create working directories Change-Id: I5fbe66c1218c29db0fafd87085a6cf5c15a91dc5 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Create workspace by ansible playbookYujun Zhang11-234/+16
Change-Id: Ia79353e686240c5915e40b8202d3fdc289df2158 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Merge "Add UnixBench benchmarking role"Yujun Zhang2-0/+9
2017-04-20Merge "Use ansible roles to setup development tools"Yujun Zhang2-0/+10
2017-04-20Merge "Use different folder for cached data"Yujun Zhang1-0/+1
2017-04-20Merge "Fix error in details"Yujun Zhang1-1/+1
2017-04-20Merge "fix apex integration"Yujun Zhang2-2/+23
2017-04-20Add UnixBench benchmarking roleYujun Zhang2-0/+9
Change-Id: I14e1630ff67bf4dff0998456e57fee2b1656f585 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Use ansible roles to setup development toolsYujun Zhang2-0/+10
Change-Id: I897773edf8dcacf08e67fa3eb999c4c10ba22805 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Use different folder for cached dataYujun Zhang1-0/+1
- `dump` is for raw testing data and logs from remote - `cache` for temporary data required for testing Change-Id: I540338eae2dd7bbd14b359e1a0dbce186ada902b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20Fix error in detailsYujun Zhang1-1/+1
The leading space causes `details` value to be string, not dict Change-Id: Ie2acfd91f2ec9280c0a24e2459229a72f45350af Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-20fix apex integrationzhihui wu2-2/+23
I didnot find a right way to source Openstack rc file via ansible module python api. Without openstack rc fiel, openstack cli command can not be executed. So I move this part to ansible playbook. Change-Id: I44439560f8ffa1b41890c4e94c9657ab2cc43241 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-04-20Set default width to 80 for justify filterYujun Zhang2-110/+22
- 80 default screen width for most consoles - template content should not be part of console reporter test - remove fix width splitter in console report templates Change-Id: Ib060b447bd52c211a4bf1e4ded2f898a9201b6d8 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-19Set plugfest demo site for default testapi urlYujun Zhang2-3/+3
Change-Id: I4a77e9f5ccb9c2d60343e9894e175e1f903965a8 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-19Backport ramspeed benchmarking playbook from qtip.driverYujun Zhang1-1/+5
Change-Id: I99c6bcb43074cdf7f9edd93a0fe10b401fff4374 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-19Merge "Fix warnings on same name of host and group in Ansible 2.3"Yujun Zhang3-11/+3
2017-04-19Merge "Collect dpi metrics and report"Yujun Zhang1-1/+6
2017-04-19Merge "Add nDPI tasks"Yujun Zhang2-0/+7
2017-04-19Merge "Enable task profiling"Yujun Zhang1-0/+2
2017-04-19Merge "Add unittests for testapi client"zhihui wu1-0/+116
2017-04-19Merge "Add E release development version."zhihui wu1-1/+2
2017-04-18Add unittests for testapi clientakhilbatra8981-0/+116
Change-Id: I33ffd6ca6110b5fb245a3fc31fc0c63e11588fb8 Signed-off-by: akhilbatra898 <akhil.batra@research.iiit.ac.in>
2017-04-18Fix warnings on same name of host and group in Ansible 2.3Yujun Zhang3-11/+3
Change-Id: Iedf0d609a62b956e1f0cd5e941a8fd27e1abc685 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-18Collect dpi metrics and reportYujun Zhang1-1/+6
Change-Id: I0e02cff9a5bfc123b3227803289fc03abe27f112 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-18Add E release development version.Taseer1-1/+2
Change-Id: Icda9c44aa33e63d46da0c5187157132a49db0882 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-04-18Add nDPI tasksYujun Zhang2-0/+7
Change-Id: I18b797d7fb8e5ca1bfd74dbcb836ec4feb318378 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-18Merge "apex integration"zhihui wu3-0/+124
2017-04-18Enable task profilingYujun Zhang1-0/+2
Benchmark jobs takes a long time, enable task profiling to collect estimated run time so that we can set time out for async job correctly Change-Id: Ie9518380acc8da06f26f762ea016b7837a8bd2fb Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-18apex integrationzhihui wu3-0/+124
Change-Id: Ief21554dfa7cd79e7ed0cb1615f6dbf079cb6077 Signed-off-by: zhihui wu <wu.zhihui1@zte.com.cn>
2017-04-17push results to testapiYujun Zhang2-1/+22
Change-Id: Ie6e231690f92971b776cd41af18b21acb43bb199 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-17Add testapi setup taskYujun Zhang6-0/+54
Change-Id: I7b4d3186afd724ec5a30cf630baee79875e426bb Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-17Aggregate qpi score from all nodesYujun Zhang1-1/+8
Change-Id: Ib711a493a949b013ffe22519861f144dc47d0334 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-17Move YAML resources to /resources.Yujun Zhang16-846/+23
- replacing the content of /benchmarks will break current module like api/cli - migration required before surpressing the current benchmarks/ folder Change-Id: I8bd04eeb18aaa3c966330ff7adbe85a267680fc1 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-16Load benchmark specification from external fileYujun Zhang2-53/+25
Change-Id: If72f1d98b90f9666c17aa28b3b88f32178ee4166 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-15Merge "Dump collected facts"Yujun Zhang2-2/+6
2017-04-15Merge "rename output file to sample"Yujun Zhang2-0/+0
2017-04-14Merge "User friendly messages for exceptions"zhihui wu3-0/+9
2017-04-13User friendly messages for exceptionsTaseer3-0/+9
- Use colorama for color - Implement verbosity option in separate patch Change-Id: Ib2491d867e9bbf59cb00874d99a11f86ad7eea1b Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2017-04-12Dump collected factsYujun Zhang2-2/+6
Change-Id: Id0b7b2e94016a73ffcaa2d737af1ca33230b3662 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-12rename output file to sampleYujun Zhang2-0/+0
Change-Id: I9c62114ebd6c2016fa177565a4413138cafd573b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-12Refactoring connection taskYujun Zhang7-20/+195
- split `compute` playbook into `setup` and `run` - save inventory and ssh configuration after in `setup` Change-Id: I0803a954ffcd7c07861ff6bdb76acdbfaa4815bd Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Fix reporting tasksYujun Zhang1-3/+2
- no need to specify `local_action` on `local` hosts - no need to delegate to `localhost` on `local` hosts Change-Id: I9e7843ce8ba414a786784943b8c253d615271233 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Implement a sample qpi report to show how to retrieve variables from ↵Yujun Zhang3-1/+67
benchmark results Change-Id: I479e4446c18d45d69d2f88db021f7739201104d9 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Normalize system info variables and reportYujun Zhang5-18/+18
Change-Id: I5627b4e2fa2287a1880433c7f25d9a2d1874cc26 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-04-11Integrate openssl metrics for qpi calculateYujun Zhang3-8/+128
Change-Id: I7319cd9b49cb27ba4fa367e395ceb2caa543c06e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>