summaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2017-01-03Implement plan, qpi and metric constructorsYujun Zhang7-38/+36
- separate runner from `plan` and move `plan` to `loader` - rename `algorithm` to `formula` - use `numpy` for formulas - update sample qpi and metrics Change-Id: I3131ca79907376f2de31d6cb920bd7d0230664a6 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2017-01-03Add module skeletonsYujun Zhang16-128/+68
- Remove `suite` and `case` which seems redundant at the moment - Rename `qtip.spec` to `qtip.loader` since the class loads spec - Add driver `sample` which will generate random performance data - Add collector `logfile` which will collect result from log files - Add reporter `console` which will print report to console - Add exception classes See updated class diagram in https://wiki.opnfv.org/display/qtip/Design JIRA: QTIP-148 JIRA: QTIP-193 Change-Id: Idf751d33428176a26224e4443100a142feda6f32 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-28Delete Ansible module. No longer required.Taseer Ahmed2-13/+2
JIRA: QTIP-150 Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-27Merge "Implment https://wiki.opnfv.org/display/qtip/Design"Yujun Zhang24-132/+309
2016-12-27Implment https://wiki.opnfv.org/display/qtip/DesignYujun Zhang24-132/+309
Note that some obsolete test cases are marked expected failure, will be deprecated after architecture evolution. JIRA: QTIP-148 Change-Id: I52bc9391569d516e298d9e659517161b4dce794a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-20All unit tests.Taseer6-31/+65
JIRA: QTIP-184 Change-Id: I577b8df85d2be63f9195ed2bb3c6bf497ce1fd96 Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-19Merge "Unit Test for Ansible Module"zhihui wu1-0/+31
2016-12-16Merge "Add unit test for `describe` method"zhihui wu3-0/+18
2016-12-15Unit Test for Ansible ModuleTaseer1-0/+31
JIRA: QTIP-188 Change-Id: I10b3fb979f52d10e8dedf956831f8320c04a36ea Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
2016-12-13Add unit test for `describe` methodYujun Zhang3-0/+18
Change-Id: I6d37ab283d7fcfb0c15dd8065121b706dd80392b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-13refactor qtip-server structureSerenaFeng1-5/+11
JIRA: QTIP-186 Change-Id: I4ecdcdc2869de0ef717ebf4bd1346e7c428b5b19 Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
2016-12-08Fix relative path in test caseYujun Zhang2-4/+25
Use abspath for fixture files to make tests independent from cwd Change-Id: Ie965899c5311e26ad708f44463b1992d9b8e697b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Fix bugs in `runner/benchmark`Yujun Zhang3-0/+3
- should inherit `object` for common methods - should use instance class in abstract method Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Implement PerfTest prototypeYujun Zhang2-2/+30
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement TestPlan prototypeYujun Zhang3-17/+45
Refactor common part of Suite to Benchmark since both TestPlan and Suite are organized by files Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang4-1/+29
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-05Skip unstable test `tests.unit.utils.create_zones_test`Yujun Zhang1-0/+1
JIRA: QTIP-175 Change-Id: Ib4891c8f37445285f2ea414d5988e55ca71cf10f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-29Enable all unit tests except two failed casesYujun Zhang5-6/+2
- `test_ping` in `env_setup_test` still halts - `test_prepare_and_run_benchmark_successful` in `args_handler_test` fails - excluded `pep8` since already coverred by opnfv-lint task Change-Id: Ib5ea20c37a27e356aea6d8eed3750b3269bd67f4 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-25Fix test failingYujun Zhang11-30/+49
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-21Architecture evolution skeletonYujun Zhang27-0/+39
- benchmarks will be driven by qtip.runner - qtip.runner is used by both qtip.cli and qtip.api - unit test for each module will be placed under tests/unit - functional tests will be moved to tests/functional - data as testing sample will be moved to tests/data NOTE: this patch moves files only, it may fails many tests. To be followed up in next step. JIRA: QTIP-148 Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-16Bugfix: Correct the path in unit test.zhifeng.jiang8-32/+32
Change-Id: I2e019230bc50222222c5df4c0d18640616fff074 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-11-14bugfix: correct the path of test_planwu.zhihui2-3/+3
JIRA: QTIP-161 Change-Id: If591c6b6d6ca1d4d7b721115c93c7b58ff7d819b Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-09Merge func to utilswu.zhihui7-28/+27
Local test is ok. JIRA: QTIP-131 Change-Id: I7009337903c7ded90dda47a05d6c1c95aa96815d Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-08Bugfix: cli.py and its unit test casewu.zhihui1-4/+6
since qtip use log instead of print, assert sentence need to modify. Change-Id: I8d19d0e50c4c70f34c7e916c7828984163586260 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-07rename test_cases/ to test_plan/wu.zhihui2-4/+4
JIRA: QTIP-131 Change-Id: I12c63b4f0ff0167073a0819bdb5d63ca0c6f06fb Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-05Remove results directory out of reposwu.zhihui1-3/+6
Delete results directory from qtip repos. And the results files will be stored under /home/opnfv/qtip/results. Change-Id: Ie1091e60eb77068c20a9095f0f85454f18173872 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-31Merge "Code refactor: spawn_vm.py"Yujun Zhang1-7/+4
2016-10-28Code refactor: spawn_vm.pywu.zhihui1-7/+4
1. update SampleHeat.yaml 2. No need to fetch private key file my_key.pem. 3. remove keypair value from spawn_vm_test.py 4. cleanup redundant code. Change-Id: Id7ccdbae5b88c86ebff7518710b6c91ab4281c53 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-22Remove directory test_listwu.zhihui1-1/+1
Directory benchmarks/suite will be used instead of test_list. JIRA: QTIP-131 Change-Id: I2c1f534b72361cb2e6469463ef5e43714d6dc993 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-17Merge "Adjust directory structure"Yujun Zhang2-2/+2
2016-10-14Adjust directory structurewu.zhihui2-2/+2
qtip ! +---- scripts ! ! ! +----ref_result # python scripts to generate results report ! +----fetch_compute_ips.sh ! +----fetch_os_creds.sh ! +----file_permission.sh ! +----get_env_info.sh ! +----qtip_creds.sh ! +----ssh_exch.exp ! +---- config ! ! ! +---- Qtip_key ! +---- Qtip_key.pub ! +---- SampleHeat.yaml ! +---- utils ! ! ! +---- logger_utils.py ! +---- report # generate pdf report file Change-Id: Ia908ff31494369c1a13fb88b1ff9b0e5681f8e29 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-14Unit test bugfix: Remove the zte-pod1 in unit test.zhifeng.jiang2-6/+6
Change-Id: I5e8be7d22800f67e475660fa1a557af62e8c9b1f Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-10-11Merge "Add testdb url and node_name in post parameters of restful server"Yujun Zhang1-1/+7
2016-10-11Merge "update test data in tests/args_handler_test.py"Yujun Zhang1-1/+1
2016-10-11Merge "Rename class cli to Cli"Yujun Zhang1-3/+3
2016-10-11update test data in tests/args_handler_test.pywu.zhihui1-1/+1
args_handler_test.py use the file in test_cases/zte-pod1 as test data, since this file is removed, so update it. Change-Id: I957caaeb35eab766ce2bb02c1d7a183342d5f0fb Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-10Add testdb url and node_name in post parameters of restful serverzhifeng.jiang1-1/+7
JIRA:QTIP-99 Change-Id: I67f56eafba48ca096570674f5de2ff5aeb935d16 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-10-09code refactor: create_zones.pywu.zhihui2-20/+40
1. simply the process of creating aggregates in create_zones.py. 2. before creating aggregates, it will clean all aggregates firstly. TODO: It should clean up the created aggregates. It needs a big structure modification in args_handler.py. Let's do it step by step. Change-Id: I31e09e917ba83d4676f7f95d9f5186bce8d2a449 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-08Merge "Fix unit test problem:'spawn_vm.py does not have attribute FetchImg'"Yujun Zhang1-2/+1
2016-10-08Merge "Add benchmark name in post request parameters"Yujun Zhang1-6/+3
2016-10-07Fix unit test problem:'spawn_vm.py does not have attribute FetchImg'zhifeng.jiang1-2/+1
Change-Id: I8035abfeb52515f106de4188621c207acfe54a65 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-10-07Rename 'max-minutes' to 'max_minutes'Yujun Zhang1-3/+3
The naming style of query param should be consistent Change-Id: Ifb9bb3ecfbbf8caee7a00d3968a627c35d965bcb Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-10-07Rename class cli to CliYujun Zhang1-3/+3
class name should be CamelCase Change-Id: I3b68b14483a475499baf832eb1af93ecca171b14 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-10-07Add benchmark name in post request parameterszhifeng.jiang1-6/+3
Change-Id: I53974789d59f316afa72fb753397baa45247e64c Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-30Merge "Start restful server auto in docker"zhifeng.jiang2-5/+39
2016-09-28Start restful server auto in dockerzhifeng.jiang2-5/+39
modification: Add start restful server in dockerfile Add result and detail_result in server job status Add job result assert in unit test JIRA:QTIP-99 Change-Id: I27108eb930eba1bb72c04216f468a81202179ee0 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-27Merge "code refactor: run_qtip.sh"Yujun Zhang2-46/+1
2016-09-27code refactor: run_qtip.shwu.zhihui2-46/+1
1. Add prepare_qtip_image.sh to prepare qtip image before qtip test. 2. Add cleanup_qtip_image.sh to clean up qtip image after finishing qtip test. Both of them are invoked in run_qtip.sh Change-Id: Iba892a2e02e31820ed0525f80a4e2885899557e0 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-25Bugfix: Get private ip wrong in iperf vm test.zhifeng.jiang1-3/+3
Change-Id: I92c937eaadf5adfa4a8eced5b95af26612d7c523 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-21Merge "Run benchmark test in restful server post api"Yujun Zhang1-18/+37