summaryrefslogtreecommitdiffstats
path: root/dovetail/conf
AgeCommit message (Collapse)AuthorFilesLines
2017-03-29dovetail tool: offline supportMatthewLi1-0/+5
JIRA: DOVETAIL-164 usage: dovetail run --testsuite <testsuite> --offline 1,if --offline given, can run offline by using local docker images (if there is no images, will get an error in log, images can be pulled from dockerhub or downloaded from artifacts.opnfv.org ) 2,if --offline not given, will run online, which means pull docker image from dockerhub Change-Id: I87ab35c82e59fb13a7a88c38d233e89285efc4d3 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-25dovetail tool: Add an option cmd for pushing results into DBxudan4-6/+7
JIRA: DOVETAIL-373 1. add an option --report/-r to choose the report type. 2. "-r file" will store results with files. 3. "-r http://192.168.135.2:8000/api/v1" will push results into DB. The DB url can replaced by user's local DB or official DB. 4. Default report type is defined as "report_dest" in dovetail_config.yml. 5. Yardstick can't push results of one testcase into DB now, so both "-r file" and "-r http://..." will be regarded as "file". Change-Id: Ieaa017ab59c5b15235bf306ef57cdc56beb22af8 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-22Merge "dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵hongbo tian1-7/+7
yardstick.log"
2017-03-21dovetail tool: remove installer and CI related variablesxudan4-39/+6
JIRA: DOVETAIL-371 1. remove all the envs in functest_config.yml and yardstick_config.yml 2. remove all relative cmds in cmd_config.yml 3. remove all the envs when running a new functest/yardstick container 4. add some variables just for functest pushing results to db 5. get the external network name for yardstick 6. make --debug/-d just control the log level shown on the screen 7. set requests=2.10.0 since python-openstackclient needs 'requests!=2.12.2,!=2.13.0,>=2.10.0' Change-Id: I9f941e09d067fc95a14c3c9be1374f41df4a9a16 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-21dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵xudan1-7/+7
yardstick.log 1. For Fuel, yardstick prepare_env.sh will fail when pwd != /home/opnfv/repos/yardstick 2. Modify yardstick_config.yml in Dovetail to change pwd to that path. 3. Use log file /tmp/yardstick/yardstick.log created by cmd "yardstick task start" rather than redirecting the console output to yardstick.log. JIRA: DOVETAIL-363 Change-Id: Ie0475cfabc66e342be868f0924a5fccd6fa74b58 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-20dovetail tool: change name of credentials from creds to openrcxudan4-7/+7
1. change file name from openstack.creds to openrc.sh 2. change the cmd --creds to --openrc/-o 3. now the path of --openrc can be relative path no restrict to abspath 4. remove the useless "work_dir" in dovetail_config.yml JIRA: DOVETAIL-369 JIRA: DOVETAIL-367 Change-Id: I2592438eef060f84132ff7fa226aea93ea947362 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-21dovetail tool: Bugfix about the creds path in yardstick conf filexudan1-1/+1
JIRA: DOVETAIL-355 Change-Id: I04a74caa080e0fd2ea11648f8085947ef8d556b1 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-17dovetail tool: change the way to get the functest result filexudan1-1/+4
Functest has changed it's way to generate the local result file. see Gerrit: https://gerrit.opnfv.org/gerrit/#/c/28513/ Dovetail needs to do some adaptions to fit this change. JIRA: DOVETAIL-350 Change-Id: I681f74832f582f26c8874f7d2726c8588f430612 Signed-off-by: xudan <xudan16@huawei.com>
2017-01-25dovetail tool: functest different testsuite support and yardstick testcase addedMatthewLi2-3/+26
JIRA: DOVETAIL-186 Change-Id: Id0eec6652c9595c660436dec89a309a77b16bc03 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-16dovetail tool: format improvementMatthewLi4-1/+4
Change-Id: Ibf0bb781c0f0b6be73526bf45231040e68510f76 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-05release tag supportMatthewLi1-3/+4
JIRA: DOVETAIL-170 Change-Id: Id56e30fdb3fb5b652e2145dd406b71986997f200 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-23Merge "dovetail tool: use command 'debug' to control both 'debug' and ↵hongbo tian1-9/+4
'CON_DEBUG'"
2016-12-22[dovetail tool]check and get results for each cmdLeo Wang1-2/+2
JIRA: DOVETAIL-166 Check the results of each cmds executed in test case 1. the results of pre_condition, post_condition, cmds need to be checked, so it can get a quick fail, dont need to go through the next step 2. it's more accurate to show where error occurred as early as possible 3. get results from shell scripts Change-Id: I5c1e59839c55b92de0e83e7e1eb552aa364b3f80 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-21dovetail tool: use command 'debug' to control both 'debug' and 'CON_DEBUG'xudan1-9/+4
JIRA: DOVETAIL-167 Change-Id: Ieb35f6aa2a6868af7d6dad5727bb3b345709275a Signed-off-by: xudan <xudan16@huawei.com>
2016-12-19Merge "dovetail tool: bugfix about setup dovetail"hongbo tian1-2/+2
2016-12-19Merge "dovetail tool: move conf/dovetail_config.py into utils/"hongbo tian1-101/+0
2016-12-18[dovetail tool] fetch openstack rc files without installer infoLeo Wang4-0/+12
JIRA: DOVETAIL-157 dovetail tool must not depend on any installers or any SUT, so openstack rc files need to be provided to eliminate this dependency. 1. input parameters "SUT_IP"/"SUT_TYPE" must be optional, may be finally will be removed 2. new parameter "creds" to specify the file used to get access to openstack of SUT Change-Id: I877efb2a6abc198c32ed6d52b9418a35597d5867 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-15dovetail tool: bugfix about setup dovetailxudan1-2/+2
1. change the entry_points of setup.cfg into dovetail.run:main 2. after setup the command 'dovetail -d true --testsuite debug' can just be successfully executed under folder dovetail/dovetail. That is mainly because of the load functions of testcase.py using relative paths. 3. using absolute path instead of relative path can support the command successfully executed under any path. JIRA: DOVETAIL-154 Change-Id: I4a2ad39a1a60e7e63efc55515781d27b823aa894 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-14add example test areaLeo Wang1-0/+1
1. use this config to support example test case Change-Id: I3fda73c408ed4b2bfb75aac52e0292fa4de9161b Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-15dovetail tool: move conf/dovetail_config.py into utils/xudan1-101/+0
1. move conf/dovetail_config.py into utils/ 2. change the open file path in dovetail_config.py 3. do some modification about all 'from conf.dovetail_config import ***' JIRA: DOVETAIL-158 Change-Id: I7670e6de993899e4e2a604cbc501dc3339896ef1 Signed-off-by: xudan <xudan16@huawei.com>
2016-12-14[dovetail tool] support shell scripts for testcase validationLeo Wang4-28/+89
JIRA: DOVETAIL-46 1. for now a testcase has two kinds of validation types(functest, yardstick), and it is not enough to check the complete funcionality 2. add new validation type(shell) for extra validation of the test case to make result more accurate and more convincing. Change-Id: I5c049a71f11cca71a7914f8af704c1983aba3dca Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-13[dovetail tool] support shell scripts for testcase validationLeo Wang4-24/+18
JIRA: DOVETAIL-46 1. for now a testcase has two kinds of validation types(functest, yardstick), and it is not enough to check the complete funcionality 2. add new validation type(shell) for extra validation of the test case to make result more accurate and more convincing. Change-Id: I45dca6b8dbd888757da163189d261f6e4dba5034 Signed-off-by: Leo Wang <grakiss.wanglei@huawei.com>
2016-12-13Merge "dovetail tool: add debug option to control the log level showing in ↵hongbo tian2-16/+21
screen"
2016-12-09[dovetail tool]: move config info from .py to config .yml fileMatthewLi2-7/+12
JIRA: DOVETAIL-145 Change-Id: Ia9b3c678f1a491e5daf2d280f05904ead3b0a296 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-05dovetail tool: add debug option to control the log level showing in screenxudan2-16/+21
1. add debug option in cmd_config.yml for controling log showing in screen. 2. rename existent DEBUG as CON_DEBUG because it is used for functest/yardstick container to control the log level. 3. fix the bug in function update_config_envs(). If one key is not in system's envs, os.environ[key] get an error with ErrorKey. JIRA: DOVETAIL-148 Change-Id: If3d75109f51e2e91743b8f1134a76da42e57383a Signed-off-by: xudan <xudan16@huawei.com>
2016-12-02Merge "dovetail tool: reorganize statements in class DovetailConfig"hongbo tian1-10/+14
2016-12-02[WIP] dovetail report improvementMatthewLi2-1/+3
JIRA: DOVETAIL-49 1)details please refer to https://wiki.opnfv.org/display/dovetail/Dovetail+Reports 2)results please refer to one example https://etherpad.opnfv.org/p/dovetail_report Change-Id: I63a1ba3b6aa1ffe5fa043a11cd3777dd0e8d52d9 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-30dovetail: modify process flow in function update_envs()wu.zhihui1-3/+4
bugfix task DOVETAIL-144 1. If run command "python run.py" without options, e.g. --SUT_TYPE, --SUT_IP, env values will be updated by os enviromental parameter. 2. If run command "python run.py" with options, no update from os enviromental parameter. JIRA: DOVETAIL-144 Change-Id: Id3bde7546722a5f4defe52d4f00609d7049a288b Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2016-11-29dovetail tool: reorganize statements in class DovetailConfigxudan1-10/+14
1. move some statements in class DovetailConfig into function load_config_files() 2. call load_config_files() in run.py 3. this can only work correctly after moving clean_results_dir() into run.py, see JIRA:DOVETAIL-80 and gerrit https://gerrit.opnfv.org/gerrit/#/c/24929/ JIRA: DOVETAIL-55 Change-Id: I217c1c21dc6ba8849da7c00564f62d3c22cdc391 Signed-off-by: xudan <xudan16@huawei.com>
2016-11-29Merge "dovetail tool: change CI_DEBUG to DEBUG"hongbo tian2-3/+5
2016-11-28dovetail tool: change CI_DEBUG to DEBUGzshi2-3/+5
JIRA: DOVETAIL-42 1) change 'CI_DEBUG' to 'DEBUG' in cmd_config.yml and dovetail_logger.py 2) assign 'DEBUG' env value to 'CI_DEBUG' when updating functest and yardstick parameter 'envs' Change-Id: I6d6130e394fddf11d83be619f2c9684bf8c859f9 Signed-off-by: zshi <zshi@redhat.com>
2016-11-26dovetail tool: testarea argument addedMatthewLi2-6/+13
JIRA: DOVETAIL-71 1) argument testarea is added 2) terminology "scenario" change to "testsuite" 3) related documents amended 4) all word "certification" changed to "compliance" Change-Id: I038a9e04bf83cfdac20f0c59adb1841bf5470584 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-25Merge "dovetail tool: reorganize dovetail_config.py and modify related files"hongbo tian1-51/+48
2016-11-17dovetail tool: upstream functest env preparation and CLI adaptionxudan1-2/+2
1. Functest has changed it's directory structure, so cmds in functest_config.yml cannot run successfully. 2. Use functest CLI to prepare and run test cases instead of running prepare_env.py or run_tests.py. JIRA: DOVETAIL-40 Change-Id: I7907dd70fd671efbed5f4132c0d76d6eb90b63eb Signed-off-by: xudan <xudan16@huawei.com>
2016-11-17dovetail tool: reorganize dovetail_config.py and modify related filesxudan1-51/+48
1. move all sentencs and functions into class DovetailConfig 2. delete dict container_config for it has been replaced by dovetail_config 2. modify files that import dovetail_config, including container.py, parser.py, report.py, run.py, dovetail_logger.py and testcase.py JIRA: DOVETAIL-55 Change-Id: Ib5ca3cadd751075c879f39e8cb2eb2e0adcef6aa Signed-off-by: xudan <xudan16@huawei.com>
2016-11-15Merge "Add "docker tag" option for each testcase containers."hongbo tian1-0/+5
2016-11-10Add "docker tag" option for each testcase containers.Tomofumi Hayashi1-0/+5
JIRA: DOVETAIL-69 This commit is to add new option to specify docker tags for each test containers, such as '--TAG "functest:stable"'. Change-Id: Ica11e16abfb21649a3eea9c7d7d5cd31502d2e21 Signed-off-by: Tomofumi Hayashi <tohayash@redhat.com>
2016-11-10dovetail tool: 2 config files, compliance_set and proposed_testsMatthewLi1-1/+1
JIRA: DOVETAIL-50 1)'proposed_tests.yml' is added, which runs as the total tests run. The 'compliance_set.yml' will run as dovetail certification tests; 2)ipv6 test cases added accroding to 'docs/testsuites/ipv6/ipv6_all_testcases', tc026 missed temporarily,yardstick ipv6tc026 only supports 2 installers by now according to https://wiki.opnfv.org/display/dovetail/Dovetail+Test+Cases 3)vimops001-006 added for VIM images operation test cases 4)nfvi001-002 added for vping ssh/userdata in fucntest 5)more test cases can be added in future in proposed_tests.yml, besides, the test cases can be adjusted in future in proposed_tests.yml Change-Id: I8a8634583549a802f6f64fbea651e7be4efa361c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-11-03Merge "dovetail tool: Add cli mechanism for changing envs at run-time"hongbo tian3-0/+82
2016-11-02dovetail tool: Add cli mechanism for changing envs at run-timexudan3-0/+82
JIRA: DOVETAIL-23 1. Add file cmd_config.yml for defining arguments and options. 2. Using python click module to add and parse cmds in cmd_config.yml 3. Using envs options to update envs in yardstick/functest config file Change-Id: Ie513c0f0a1ed76f29408419a4bcbbcf21334bb3f Signed-off-by: xudan <xudan16@huawei.com>
2016-10-28dovetail tool: Cleanup functest_conf.ymlzshi1-4/+0
JIRA: DOVETAIL-43 JIRA: DOVETAIL-44 1) remove result_dir 2) remove pre_cmd, exec_cmd, post_cmd Change-Id: Iea8173026b1f467011a40c6954581f25cd5e1912 Signed-off-by: zshi <zshi@redhat.com>
2016-10-14[dovetail_tool] Fix the python style scanned by flake8xudan1-3/+3
JIRA: DOVETAIL-34 Change-Id: Ib9a6dd254f1d77b0cbbfa66e8e1e44df1ce14a4b Signed-off-by: xudan <xudan16@huawei.com>
2016-10-13dovetail tool: setup.py added and path error amendMatthewLi1-2/+3
JIRA: DOVETAIL-26 1)ez_setup.py setup.py is added 2)flake8 is there, then format check can be easily achived in CI later 3)path error amend see details in DOVETAIL-33 Change-Id: Ic19dbac852694adaeecf5cdf6c2ae7c9ea9dbb33 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-10-12preparation for setup.pyMatthewLi5-0/+103
JIRA: DOVETAIL-26 1)change the directory scripts to dovetail, to make it unified in OPNFV and for setup.py 2)change the paths accordingly 3)this should be first merged, since docker is changed, then to add setup.py and run the local test Change-Id: I65974bde17f310ebbfe3c025532b05dae8752945 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>