Age | Commit message (Collapse) | Author | Files | Lines |
|
JIRA: DOVETAIL-170
Change-Id: Id56e30fdb3fb5b652e2145dd406b71986997f200
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|
|
1. move the common statements in prepare_cmd of class FunctestTestcase and
Testcase into parse_cmd.
JIRA: DOVETAIL-163
Change-Id: I61a0a24b47cfc9e8d49ca9c62fafbac7cce21111
Signed-off-by: xudan <xudan16@huawei.com>
|
|
|
|
|
|
JIRA: DOVETAIL-156
Change-Id: I3453571568494850049eb7956387ee7e275934af
Signed-off-by: xudan <xudan16@huawei.com>
|
|
'CON_DEBUG'"
|
|
JIRA: DOVETAIL-169
Change-Id: I7ede8713c16b084255f691505a39db122fdbe8ea
Signed-off-by: xudan <xudan16@huawei.com>
|
|
JIRA: DOVETAIL-166
Check the results of each cmds executed in test case
1. the results of pre_condition, post_condition, cmds need to be checked,
so it can get a quick fail, dont need to go through the next step
2. it's more accurate to show where error occurred as early as possible
3. get results from shell scripts
Change-Id: I5c1e59839c55b92de0e83e7e1eb552aa364b3f80
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
|
|
JIRA: DOVETAIL-165
1, fully tox supported
2, previous easy setup abandoned
3, CI verify job changed accordingly
4, unittest bug fix
this should merge after
https://gerrit.opnfv.org/gerrit/#/c/26297/
results see
https://etherpad.opnfv.org/p/dovetail_report
Change-Id: I52ce3999fcde7e817854e4a39f4111eef081bc78
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|
|
JIRA: DOVETAIL-167
Change-Id: Ieb35f6aa2a6868af7d6dad5727bb3b345709275a
Signed-off-by: xudan <xudan16@huawei.com>
|
|
|
|
JIRA: DOVETAIL-162
Change-Id: Idc78790e49ab3e3552d45b902cfdf8cc37fd2847
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|
|
|
|
JIRA: DOVETAIL-157
dovetail tool must not depend on any installers or any SUT, so openstack rc files need to be provided to eliminate this dependency.
1. input parameters "SUT_IP"/"SUT_TYPE" must be optional, may be finally will be removed
2. new parameter "creds" to specify the file used to get access to openstack of SUT
Change-Id: I877efb2a6abc198c32ed6d52b9418a35597d5867
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
|
|
separate the log expressions to other functions
removed statements that not necessary
output error detail info in exception
Change-Id: I721611d61dee83eb5f40ee954d433073114e231a
JIRA: DOVETAIL-161
Signed-off-by: Ryan.RCS <lihainong@huawei.com>
|
|
1. the utils exec_cmd() will take a long time for some cmds such as executing
test cases and pull images.
2. if the time is longer than 3 seconds, progress bar will be shown on the
screen.
JIRA: DOVETAIL-159
Change-Id: I4ae04d6e884853d843baf8f547394247f4165377
Signed-off-by: xudan <xudan16@huawei.com>
|
|
1. change the entry_points of setup.cfg into dovetail.run:main
2. after setup the command 'dovetail -d true --testsuite debug' can just be
successfully executed under folder dovetail/dovetail. That is mainly because
of the load functions of testcase.py using relative paths.
3. using absolute path instead of relative path can support the command
successfully executed under any path.
JIRA: DOVETAIL-154
Change-Id: I4a2ad39a1a60e7e63efc55515781d27b823aa894
Signed-off-by: xudan <xudan16@huawei.com>
|
|
1. use this config to support example test case
Change-Id: I3fda73c408ed4b2bfb75aac52e0292fa4de9161b
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
|
|
1. move conf/dovetail_config.py into utils/
2. change the open file path in dovetail_config.py
3. do some modification about all 'from conf.dovetail_config import ***'
JIRA: DOVETAIL-158
Change-Id: I7670e6de993899e4e2a604cbc501dc3339896ef1
Signed-off-by: xudan <xudan16@huawei.com>
|
|
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I5c049a71f11cca71a7914f8af704c1983aba3dca
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
|
|
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I60c1b54335b94e0cb150232432adb958b8f5a143
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
|
|
JIRA: DOVETAIL-46
1. for now a testcase has two kinds of validation types(functest, yardstick),
and it is not enough to check the complete funcionality
2. add new validation type(shell) for extra validation of the test case to make
result more accurate and more convincing.
Change-Id: I45dca6b8dbd888757da163189d261f6e4dba5034
Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
|
|
error log see https://build.opnfv.org/ci/view/dovetail/job/dovetail-merge-master/58/console
Change-Id: I7f5a7f290d82e79249561322259aa5e72186e126
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|
|
Migrate the custom setup.py to a more formal setup
environment using tox, in the same way that OpenStack
configures their projects.
Adds metadata to tox.ini from the setup.py file, and breaks
out the dependencies from setup.py into requirements.txt
and test-requirements.txt.
Executes flake8 testing for pep8 coverage.
Defaults to using Python 2 for the environment.
Change-Id: Ieaea7d9f3dc227febd8fb1dc9142d478ba197a92
Signed-off-by: Leif Madsen <lmadsen@redhat.com>
Signed-off-by: zshi <zshi@redhat.com>
|
|
screen"
|
|
JIRA: DOVETAIL-145
Change-Id: Ia9b3c678f1a491e5daf2d280f05904ead3b0a296
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|
|
When functest runs against Apex it needs to ssh from the container
to the undercloud to get the keystonerc file so it can authenticate
to the overcloud.
Change-Id: Iea3273d4d1611733f167ffab0b2a75330c413edc
Signed-off-by: Dan Radez <dradez@redhat.com>
|
|
1. Since JIRA: DOVETAIL-55 has been merged, unit tests can't pass without
load_config_files().
2. Fix the bug by adding load_config_files().
3. Add run_tests() into script unittest.sh to include all unit tests in
tests/unit.
JIRA: DOVETAIL-149
Change-Id: I7bdb0732fefde3a3f3b82441b4cc7e46ece66a1e
Signed-off-by: xudan <xudan16@huawei.com>
|
|
1. add debug option in cmd_config.yml for controling log showing in screen.
2. rename existent DEBUG as CON_DEBUG because it is used for functest/yardstick
container to control the log level.
3. fix the bug in function update_config_envs(). If one key is not in system's
envs, os.environ[key] get an error with ErrorKey.
JIRA: DOVETAIL-148
Change-Id: If3d75109f51e2e91743b8f1134a76da42e57383a
Signed-off-by: xudan <xudan16@huawei.com>
|
|
|
|
|
|
|
|
JIRA: DOVETAIL-49
1)details please refer to
https://wiki.opnfv.org/display/dovetail/Dovetail+Reports
2)results please refer to one example
https://etherpad.opnfv.org/p/dovetail_report
Change-Id: I63a1ba3b6aa1ffe5fa043a11cd3777dd0e8d52d9
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
JIRA: DOVETAIL-143
1) fix unittest import module path
2) add create_log in setup
Change-Id: Ic894fa971b4a5091affb36e8e6aac05e0e8623fb
Signed-off-by: zshi <zshi@redhat.com>
|
|
|
|
bugfix task DOVETAIL-144
1. If run command "python run.py" without options, e.g. --SUT_TYPE, --SUT_IP,
env values will be updated by os enviromental parameter.
2. If run command "python run.py" with options, no update from os enviromental
parameter.
JIRA: DOVETAIL-144
Change-Id: Id3bde7546722a5f4defe52d4f00609d7049a288b
Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
|
|
1. move function clean_results_dir() into run.py
2. call this function at the beginning of function main()
3. this can only work correctly after all log initializations packaged,
see JIRA: DOVETAIL-56 and gerrit https://gerrit.opnfv.org/gerrit/#/c/24059/
JIRA: DOVETAIL-80
Change-Id: I1cdda8f6d43f21c45c0537868cb7ed10d14ea9df
Signed-off-by: xudan <xudan16@huawei.com>
|
|
1. move some statements in class DovetailConfig into function
load_config_files()
2. call load_config_files() in run.py
3. this can only work correctly after moving clean_results_dir() into run.py,
see JIRA:DOVETAIL-80 and gerrit https://gerrit.opnfv.org/gerrit/#/c/24929/
JIRA: DOVETAIL-55
Change-Id: I217c1c21dc6ba8849da7c00564f62d3c22cdc391
Signed-off-by: xudan <xudan16@huawei.com>
|
|
JIRA: DOVETAIL-142
Change-Id: I1d8a444580755b4f4d9a0f7098b4b17ea66d6f58
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|
|
1. For container.py, parser.py, report.py and testcase.py, they use functions
in classes to create loggers. So each class will have its own logger.
2. run.py will create all the loggers by create_logs() function before the use
of them. So logs will not be initialized until the call of create_logs().
3. Move logger in run.py into function main().
JIRA: DOVETAIL-56
Change-Id: I53de090df270cc7a34762ff99cbc9115cfb09465
Signed-off-by: xudan <xudan16@huawei.com>
|
|
Change-Id: I74c0aefb7ada960aac55aed15aab6b7b9984154e
Signed-off-by: zshi <zshi@redhat.com>
|
|
JIRA: DOVETAIL-42
1) change 'CI_DEBUG' to 'DEBUG' in cmd_config.yml
and dovetail_logger.py
2) assign 'DEBUG' env value to 'CI_DEBUG' when
updating functest and yardstick parameter 'envs'
Change-Id: I6d6130e394fddf11d83be619f2c9684bf8c859f9
Signed-off-by: zshi <zshi@redhat.com>
|
|
JIRA: DOVETAIL-71
1) argument testarea is added
2) terminology "scenario" change to "testsuite"
3) related documents amended
4) all word "certification" changed to "compliance"
Change-Id: I038a9e04bf83cfdac20f0c59adb1841bf5470584
Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
|
|
|