Age | Commit message (Collapse) | Author | Files | Lines |
|
- Remove `suite` and `case` which seems redundant at the moment
- Rename `qtip.spec` to `qtip.loader` since the class loads spec
- Add driver `sample` which will generate random performance data
- Add collector `logfile` which will collect result from log files
- Add reporter `console` which will print report to console
- Add exception classes
See updated class diagram in https://wiki.opnfv.org/display/qtip/Design
JIRA: QTIP-148
JIRA: QTIP-193
Change-Id: Idf751d33428176a26224e4443100a142feda6f32
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-150
Change-Id: Idd357af309d01e5eece22521c12cd61ffd50db85
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
|
|
Note that some obsolete test cases are marked expected failure, will
be deprecated after architecture evolution.
JIRA: QTIP-148
Change-Id: I52bc9391569d516e298d9e659517161b4dce794a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-184
Change-Id: I577b8df85d2be63f9195ed2bb3c6bf497ce1fd96
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
|
|
|
|
JIRA: QTIP-188
Change-Id: I10b3fb979f52d10e8dedf956831f8320c04a36ea
Signed-off-by: Taseer Ahmed <taseer94@gmail.com>
|
|
Change-Id: I6d37ab283d7fcfb0c15dd8065121b706dd80392b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-186
Change-Id: I4ecdcdc2869de0ef717ebf4bd1346e7c428b5b19
Signed-off-by: SerenaFeng <feng.xiaowei@zte.com.cn>
|
|
Use abspath for fixture files to make tests independent from cwd
Change-Id: Ie965899c5311e26ad708f44463b1992d9b8e697b
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- should inherit `object` for common methods
- should use instance class in abstract method
Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Refactor common part of Suite to Benchmark since both TestPlan
and Suite are organized by files
Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
JIRA: QTIP-175
Change-Id: Ib4891c8f37445285f2ea414d5988e55ca71cf10f
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- `test_ping` in `env_setup_test` still halts
- `test_prepare_and_run_benchmark_successful` in `args_handler_test` fails
- excluded `pep8` since already coverred by opnfv-lint task
Change-Id: Ib5ea20c37a27e356aea6d8eed3750b3269bd67f4
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- skip several failure cases, to be fixed in future
- rename `test_plan` to hide from test discovering
- add pep8 check by default
- fix errors in pep8 check
Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
- benchmarks will be driven by qtip.runner
- qtip.runner is used by both qtip.cli and qtip.api
- unit test for each module will be placed under tests/unit
- functional tests will be moved to tests/functional
- data as testing sample will be moved to tests/data
NOTE: this patch moves files only, it may fails many tests. To be
followed up in next step.
JIRA: QTIP-148
Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I2e019230bc50222222c5df4c0d18640616fff074
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|
|
JIRA: QTIP-161
Change-Id: If591c6b6d6ca1d4d7b721115c93c7b58ff7d819b
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Local test is ok.
JIRA: QTIP-131
Change-Id: I7009337903c7ded90dda47a05d6c1c95aa96815d
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
since qtip use log instead of print, assert sentence need
to modify.
Change-Id: I8d19d0e50c4c70f34c7e916c7828984163586260
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
JIRA: QTIP-131
Change-Id: I12c63b4f0ff0167073a0819bdb5d63ca0c6f06fb
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Delete results directory from qtip repos.
And the results files will be stored under
/home/opnfv/qtip/results.
Change-Id: Ie1091e60eb77068c20a9095f0f85454f18173872
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
|
|
1. update SampleHeat.yaml
2. No need to fetch private key file my_key.pem.
3. remove keypair value from spawn_vm_test.py
4. cleanup redundant code.
Change-Id: Id7ccdbae5b88c86ebff7518710b6c91ab4281c53
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Directory benchmarks/suite will be used instead of test_list.
JIRA: QTIP-131
Change-Id: I2c1f534b72361cb2e6469463ef5e43714d6dc993
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
|
|
qtip
!
+---- scripts
! !
! +----ref_result # python scripts to generate results report
! +----fetch_compute_ips.sh
! +----fetch_os_creds.sh
! +----file_permission.sh
! +----get_env_info.sh
! +----qtip_creds.sh
! +----ssh_exch.exp
!
+---- config
! !
! +---- Qtip_key
! +---- Qtip_key.pub
! +---- SampleHeat.yaml
!
+---- utils
! !
! +---- logger_utils.py
! +---- report # generate pdf report file
Change-Id: Ia908ff31494369c1a13fb88b1ff9b0e5681f8e29
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Change-Id: I5e8be7d22800f67e475660fa1a557af62e8c9b1f
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|
|
|
|
|
|
|
|
args_handler_test.py use the file in test_cases/zte-pod1 as
test data, since this file is removed, so update it.
Change-Id: I957caaeb35eab766ce2bb02c1d7a183342d5f0fb
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
JIRA:QTIP-99
Change-Id: I67f56eafba48ca096570674f5de2ff5aeb935d16
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|
|
1. simply the process of creating aggregates in create_zones.py.
2. before creating aggregates, it will clean all aggregates firstly.
TODO:
It should clean up the created aggregates. It needs a big structure
modification in args_handler.py. Let's do it step by step.
Change-Id: I31e09e917ba83d4676f7f95d9f5186bce8d2a449
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
|
|
|
|
Change-Id: I8035abfeb52515f106de4188621c207acfe54a65
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|
|
The naming style of query param should be consistent
Change-Id: Ifb9bb3ecfbbf8caee7a00d3968a627c35d965bcb
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
class name should be CamelCase
Change-Id: I3b68b14483a475499baf832eb1af93ecca171b14
Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
|
|
Change-Id: I53974789d59f316afa72fb753397baa45247e64c
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|
|
|
|
modification:
Add start restful server in dockerfile
Add result and detail_result in server job status
Add job result assert in unit test
JIRA:QTIP-99
Change-Id: I27108eb930eba1bb72c04216f468a81202179ee0
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|
|
|
|
1. Add prepare_qtip_image.sh to prepare qtip image before qtip test.
2. Add cleanup_qtip_image.sh to clean up qtip image after finishing
qtip test.
Both of them are invoked in run_qtip.sh
Change-Id: Iba892a2e02e31820ed0525f80a4e2885899557e0
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
Change-Id: I92c937eaadf5adfa4a8eced5b95af26612d7c523
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|
|
|
|
modification:
Call ansible async in restful server post api
Set the job state 'finished' when finish benchmark test
Terminate the next benchmark in restful server delete api
job result will be in next commit
JIRA:QTIP-97
Change-Id: I252482dddd9b35ba33f992e8ea19037d8919fad6
Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
|