aboutsummaryrefslogtreecommitdiffstats
path: root/tests
AgeCommit message (Collapse)AuthorFilesLines
2016-12-08Fix relative path in test caseYujun Zhang2-4/+25
Use abspath for fixture files to make tests independent from cwd Change-Id: Ie965899c5311e26ad708f44463b1992d9b8e697b Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Fix bugs in `runner/benchmark`Yujun Zhang3-0/+3
- should inherit `object` for common methods - should use instance class in abstract method Change-Id: I78c08476da544402851e4b53e2d45c32a7f86722 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-07Implement PerfTest prototypeYujun Zhang2-2/+30
Change-Id: I5988cb65d0e50fa88beaac8f48b5b1da70ed687a Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement TestPlan prototypeYujun Zhang3-17/+45
Refactor common part of Suite to Benchmark since both TestPlan and Suite are organized by files Change-Id: I61a97d9489096c4a6305c99e8cf7abb958faa562 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-06Implement __init__ and list_all in SuiteYujun Zhang4-1/+29
Change-Id: I97a34610d9f50d6ee81b487d0446eec3f4eea001 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-12-05Skip unstable test `tests.unit.utils.create_zones_test`Yujun Zhang1-0/+1
JIRA: QTIP-175 Change-Id: Ib4891c8f37445285f2ea414d5988e55ca71cf10f Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-29Enable all unit tests except two failed casesYujun Zhang5-6/+2
- `test_ping` in `env_setup_test` still halts - `test_prepare_and_run_benchmark_successful` in `args_handler_test` fails - excluded `pep8` since already coverred by opnfv-lint task Change-Id: Ib5ea20c37a27e356aea6d8eed3750b3269bd67f4 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-25Fix test failingYujun Zhang11-30/+49
- skip several failure cases, to be fixed in future - rename `test_plan` to hide from test discovering - add pep8 check by default - fix errors in pep8 check Change-Id: If4451999a1f4ed1339dfdf8271cc58f11de72b3e Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-21Architecture evolution skeletonYujun Zhang27-0/+39
- benchmarks will be driven by qtip.runner - qtip.runner is used by both qtip.cli and qtip.api - unit test for each module will be placed under tests/unit - functional tests will be moved to tests/functional - data as testing sample will be moved to tests/data NOTE: this patch moves files only, it may fails many tests. To be followed up in next step. JIRA: QTIP-148 Change-Id: I27e8169a74783970a1f7818456eb76a7311fb60c Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-11-16Bugfix: Correct the path in unit test.zhifeng.jiang8-32/+32
Change-Id: I2e019230bc50222222c5df4c0d18640616fff074 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-11-14bugfix: correct the path of test_planwu.zhihui2-3/+3
JIRA: QTIP-161 Change-Id: If591c6b6d6ca1d4d7b721115c93c7b58ff7d819b Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-09Merge func to utilswu.zhihui7-28/+27
Local test is ok. JIRA: QTIP-131 Change-Id: I7009337903c7ded90dda47a05d6c1c95aa96815d Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-08Bugfix: cli.py and its unit test casewu.zhihui1-4/+6
since qtip use log instead of print, assert sentence need to modify. Change-Id: I8d19d0e50c4c70f34c7e916c7828984163586260 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-07rename test_cases/ to test_plan/wu.zhihui2-4/+4
JIRA: QTIP-131 Change-Id: I12c63b4f0ff0167073a0819bdb5d63ca0c6f06fb Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-05Remove results directory out of reposwu.zhihui1-3/+6
Delete results directory from qtip repos. And the results files will be stored under /home/opnfv/qtip/results. Change-Id: Ie1091e60eb77068c20a9095f0f85454f18173872 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-31Merge "Code refactor: spawn_vm.py"Yujun Zhang1-7/+4
2016-10-28Code refactor: spawn_vm.pywu.zhihui1-7/+4
1. update SampleHeat.yaml 2. No need to fetch private key file my_key.pem. 3. remove keypair value from spawn_vm_test.py 4. cleanup redundant code. Change-Id: Id7ccdbae5b88c86ebff7518710b6c91ab4281c53 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-22Remove directory test_listwu.zhihui1-1/+1
Directory benchmarks/suite will be used instead of test_list. JIRA: QTIP-131 Change-Id: I2c1f534b72361cb2e6469463ef5e43714d6dc993 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-17Merge "Adjust directory structure"Yujun Zhang2-2/+2
2016-10-14Adjust directory structurewu.zhihui2-2/+2
qtip ! +---- scripts ! ! ! +----ref_result # python scripts to generate results report ! +----fetch_compute_ips.sh ! +----fetch_os_creds.sh ! +----file_permission.sh ! +----get_env_info.sh ! +----qtip_creds.sh ! +----ssh_exch.exp ! +---- config ! ! ! +---- Qtip_key ! +---- Qtip_key.pub ! +---- SampleHeat.yaml ! +---- utils ! ! ! +---- logger_utils.py ! +---- report # generate pdf report file Change-Id: Ia908ff31494369c1a13fb88b1ff9b0e5681f8e29 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-14Unit test bugfix: Remove the zte-pod1 in unit test.zhifeng.jiang2-6/+6
Change-Id: I5e8be7d22800f67e475660fa1a557af62e8c9b1f Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-10-11Merge "Add testdb url and node_name in post parameters of restful server"Yujun Zhang1-1/+7
2016-10-11Merge "update test data in tests/args_handler_test.py"Yujun Zhang1-1/+1
2016-10-11Merge "Rename class cli to Cli"Yujun Zhang1-3/+3
2016-10-11update test data in tests/args_handler_test.pywu.zhihui1-1/+1
args_handler_test.py use the file in test_cases/zte-pod1 as test data, since this file is removed, so update it. Change-Id: I957caaeb35eab766ce2bb02c1d7a183342d5f0fb Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-10Add testdb url and node_name in post parameters of restful serverzhifeng.jiang1-1/+7
JIRA:QTIP-99 Change-Id: I67f56eafba48ca096570674f5de2ff5aeb935d16 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-10-09code refactor: create_zones.pywu.zhihui2-20/+40
1. simply the process of creating aggregates in create_zones.py. 2. before creating aggregates, it will clean all aggregates firstly. TODO: It should clean up the created aggregates. It needs a big structure modification in args_handler.py. Let's do it step by step. Change-Id: I31e09e917ba83d4676f7f95d9f5186bce8d2a449 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-10-08Merge "Fix unit test problem:'spawn_vm.py does not have attribute FetchImg'"Yujun Zhang1-2/+1
2016-10-08Merge "Add benchmark name in post request parameters"Yujun Zhang1-6/+3
2016-10-07Fix unit test problem:'spawn_vm.py does not have attribute FetchImg'zhifeng.jiang1-2/+1
Change-Id: I8035abfeb52515f106de4188621c207acfe54a65 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-10-07Rename 'max-minutes' to 'max_minutes'Yujun Zhang1-3/+3
The naming style of query param should be consistent Change-Id: Ifb9bb3ecfbbf8caee7a00d3968a627c35d965bcb Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-10-07Rename class cli to CliYujun Zhang1-3/+3
class name should be CamelCase Change-Id: I3b68b14483a475499baf832eb1af93ecca171b14 Signed-off-by: Yujun Zhang <zhang.yujunz@zte.com.cn>
2016-10-07Add benchmark name in post request parameterszhifeng.jiang1-6/+3
Change-Id: I53974789d59f316afa72fb753397baa45247e64c Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-30Merge "Start restful server auto in docker"zhifeng.jiang2-5/+39
2016-09-28Start restful server auto in dockerzhifeng.jiang2-5/+39
modification: Add start restful server in dockerfile Add result and detail_result in server job status Add job result assert in unit test JIRA:QTIP-99 Change-Id: I27108eb930eba1bb72c04216f468a81202179ee0 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-27Merge "code refactor: run_qtip.sh"Yujun Zhang2-46/+1
2016-09-27code refactor: run_qtip.shwu.zhihui2-46/+1
1. Add prepare_qtip_image.sh to prepare qtip image before qtip test. 2. Add cleanup_qtip_image.sh to clean up qtip image after finishing qtip test. Both of them are invoked in run_qtip.sh Change-Id: Iba892a2e02e31820ed0525f80a4e2885899557e0 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-25Bugfix: Get private ip wrong in iperf vm test.zhifeng.jiang1-3/+3
Change-Id: I92c937eaadf5adfa4a8eced5b95af26612d7c523 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-21Merge "Run benchmark test in restful server post api"Yujun Zhang1-18/+37
2016-09-20Run benchmark test in restful server post apizhifeng.jiang1-18/+37
modification: Call ansible async in restful server post api Set the job state 'finished' when finish benchmark test Terminate the next benchmark in restful server delete api job result will be in next commit JIRA:QTIP-97 Change-Id: I252482dddd9b35ba33f992e8ea19037d8919fad6 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-15Bugfix:iperf benchmark run failed "privateip1 is undefined"zhifeng.jiang2-7/+6
modification: get privatedip1 var when role is '2-host' run on localhost once instead of twice Change-Id: I4155f2d0c45208c4a2a0e2844fdf87acb5c8575e Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-14Merge "Fix test cases yaml schema unit test problem,now host ip allow empty."zhifeng.jiang1-0/+1
2016-09-11ansible playbook bugfixwu.zhihui1-0/+2
According the qtip ci results, make these bugfixs. 1. skipping: no hosts matched This used to work in Ansible 1.9.x with 127.0.0.1;But does not work in Asible 2.x solved: add 127.0.0.1 as localhost in ./data/hosts 2. Using bare variables is deprecated. solved: update playbook 3. use git module 4. To save time, turning Off Facts on localhost. Since https://gerrit.opnfv.org/gerrit/#/c/20661/ is under codereview, for qtip ci job, I temporarily modify function write_to_file() in env_setup.py. Change-Id: I71a08ebf87cd8c8d851a3f8f760e29e8725f0e0f Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-09-10Fix test cases yaml schema unit test problem,now host ip allow empty.zhifeng.jiang1-0/+1
Change-Id: I71b9a76c8ec470cce2af3ae47ae1fe232d1e3a22 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-08Remove os environment in driver.py so that it can be called by restful serverzhifeng.jiang3-17/+23
modification: Change os environments to parameters in driver.py Pass the parameters in cli.py and arg_handler.py JIRA:QTIP-97 Change-Id: Id67acb7e0ac46fa9e0e32481e947055b6d37dd95 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-09-04Call ansible playbook by ansible api instead of os.systemzhifeng.jiang1-9/+6
JIRA:QTIP-99 Change-Id: Ife53a48d4af1fd3c60efc0673611321b3bc487a7 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-08-24Merge "Add some state change functions in db.py."Yujun Zhang1-3/+3
2016-08-24Merge "Add ansible_api so that python call ansible playbook by api."Yujun Zhang3-0/+25
2016-08-23Add some state change functions in db.py.zhifeng.jiang1-3/+3
modification: Add some functions in db.py Unit test will be added after functions called by restful server. Rename 'deadline' to 'max-minutes' JIRA:QTIP-99 Change-Id: I74ed93df3f2dd91fa154fa0fcb52605983ee2719 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>
2016-08-21Code refactoring cli.py so that it can be reused by restful server.zhifeng.jiang2-0/+49
modification: Move function in cli.py to args_handler.py Add unit test for args_handler.py Add unit test for cli.py Delete print in driver.py to pass unit test JIRA:QTIP-99 Change-Id: Ib670d7dff494f3e04cdbe1de5c247d382b1052c1 Signed-off-by: zhifeng.jiang <jiang.zhifeng@zte.com.cn>