summaryrefslogtreecommitdiffstats
path: root/dovetail/conf
AgeCommit message (Collapse)AuthorFilesLines
2018-04-09API validaton exemption for Danube-based releaseovp.1.1.0Georg Kunz1-0/+5
This patch adds the ability to Dovetail to disable strict API response validation in Tempest-based test cases run by Functest. This is a backport of the changes from master, targeting OVP 1.0.1 Corresponding updates of the web portal will follow. JIRA: DOVETAIL-633 Change-Id: Iace99ea1b6224ea907a2c3af8676e9285e6ad3ee Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-01-27Align container tags and test suite configuration yaml for initial releasexudan3-22/+12
Change default container tag to be: 1. Functest ovp.1.0.0 2. testapi ovp.1.0.0 Add test suite ovp.1.0.0 and set it to be the default test suite. Comment out bottlenecks CLI for initial release. JIRA: DOVETAIL-580 Change-Id: I956e49e43fc7ba0176c14079b7228089db5dc108 Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit c47b8dde0e39e273372b091a3d8da1cc15b7ae9f)
2017-11-07Tag dovetail cvp.0.9.0xudan2-1/+2
JIRA: DOVETAIL-550 Change-Id: I871ec1fdf8d33efe3ed00602d0184c7b35896c17 Signed-off-by: xudan <xudan16@huawei.com>
2017-10-23Add testsuite cvp.0.8.0 for Beta testsxudan2-1/+2
1. Now there is a testsuite proposed_tests for beta tests which may cause some confusions. 2. Copy all test cases to testsuite cvp.0.8.0 for beta testers to use. 3. Update userguide with testsuite cvp.0.8.0 JIRA: DOVETAIL-528 Change-Id: I35bc7dee6e07a9125a4c1991b0049f6e2d705cc5 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-29Merge "Support to run mandatory or optional test cases separately"Leo wang2-1/+14
2017-09-26Make Yardstick log level can be set by CLIxudan1-1/+1
1. Currently, the log level of yardstick is DEBUG and cannot be modified. 2. Make it can be changed from CLI. 3. When use dovetail run --debug, can see all Yardstick logs (including DEBUG) in dovetail.log. 4. When run without debug option, cannot see Yardstick debug logs in dovetail.logs. 5. yardstick.log always doesn't include debug logs. JIRA: DOVETAIL-506 Change-Id: Iaafb61232a22e16fff2fa4605bf7e262b022085e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-25Support to run mandatory or optional test cases separatelyxudan2-1/+14
1. Currently, dovetail can run a test suite or a test area in that test suite. 2. The test areas in one test suite are not divided into optional and mandatory. 3. Split them and support to run just mandatory or optional. 4. Support to run multiple test areas. JIRA: DOVETAIL-505 Change-Id: I42cd7b4e11c3e3674c806e9bc999b782bf5c85c6 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-18Dovetail tool replaces defcore with osinteropxudan1-1/+1
Rename the "defcore" test area to "osinterop". The DefCore working group has been renamed OpenStack InterOp Working Group some time ago. JIRA: DOVETAIL-499 Change-Id: I144af767632c8fb83859e5e04b6427bb1a538348 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-08tag dovetail with 0.6.0xudan1-0/+1
docker image used opnfv/yardstick: danube.3.2 opnfv/functest: cvp.0.5.0 opnfv/bottlenecks: cvp.0.4.0 opnfv/testapi: cvp.0.6.0 opnfv/dovetail:web.cvp.0.6.0 opnfv/dovetail:api.cvp.0.6.0 opnfv/dovetail: cvp.0.6.0 main changes Merge all test specification docs about test area tempest and defcore Merge addendum doc and workflow doc Remake aarch64 patch for Dovetail container Remove some tempest test cases that are not too common Add additional Tempest API test cases into test case tempest.tc005 persist db file in host for mongo container add nginx to host static files add a sample tempest_conf.yaml file into userconfig Add a patch to set ha SLA to be 30 seconds Modify logs Bugfix: the config files in useeconfig will cover user's config Bugfix: functest only keeps the last test case's log Bugfix: pre_condition cmds is just executed once For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool JIRA: DOVETAIL-497 Change-Id: I74626bbf65ce0121cc7b53394c85694e15df8484 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Add a patch to set ha SLA to be 30 secondsxudan1-1/+7
1. According to ha test specification doc, the SLA of process recover time is 30 seconds. 2. However, the SLA in Yardstick test cases are all 20 seconds. 3. Add a patch to change the SLA in yardstick test cases. JIRA: DOVETAIL-496 Change-Id: Ib8f229fdfbb3289bf70d6ee900132b3db3a21b17 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Tag dovetail with cvp.0.5.0xudan3-3/+4
JIRA: DOVETAIL-483 1. docker image used yardstick: danube.3.2 functest: cvp.0.5.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.5.0 dovetail: cvp.0.5.0 2. main changes Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd Signed-off-by: xudan <xudan16@huawei.com>
2017-08-15Adapt Functest cvp.0.5.0 docker imagexudan2-1/+5
In order to use functest cvp.0.5.0, Dovetail tool needs some adaptions. Change-Id: I9d0a23791c246a6c4961f229eaeb1f52f9b4995a Signed-off-by: xudan <xudan16@huawei.com>
2017-08-07Add Tempest test cases to Dovetail CI daily jobsxudan1-0/+1
JIRA: DOVETAIL-478 JIRA: DOVETAIL-473 adds 6 test areas: - forwarding packets through virtual networks in data path - filtering packets based on security rules and port security in data path - dynamic network runtime operations through the life of a VNF - correct behavior after common virtual machine life cycles events - simple virtual machine resource scheduling on multiple nodes - storage security Add Tempest test cases belong to this 6 test areas to Dovetail CI daily jobs. Change-Id: I1535d96f3a85cdd8ac4f0c4375c68ce47bd9df93 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-03Add resiliency test caes into proposed_testsxudan3-2/+33
JIRA: DOVETAIL-474 Add Bottlenecks resiliency test case "posca_factor_ping" into proposed_tests. Change-Id: I76aea651014fb4722ddae07559f417d3f840eee2 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-02Merge "mandatory vping test case added to proposed_tests"hongbo tian1-2/+1
2017-07-21Tag dovetail with cvp.0.3.0xudan2-1/+3
JIRA: DOVETAIL-468 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 testapi: cvp.0.3.0 dovetail: cvp.0.3.0 2. main changes fix dovetail docker version to be 17.03.0-ce adapt yardstick danube.3.1 For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f Signed-off-by: xudan <xudan16@huawei.com>
2017-07-20mandatory vping test case added to proposed_testsMatthewLi1-2/+1
JIRA: DOVETAIL-446 1.add vping to proposed_tests 2.delete out-dated nfvi test cases Change-Id: I181b00b02abe6fed4ff51e947576c1b71321cdd2 Signed-off-by: MatthewLi <lijun_1203@126.com>
2017-07-19Adapt Yardstick to copy yardstick.conf to /etc/yardstickxudan2-1/+4
JIRA: DOVETAIL-466 1. Yardstick danube.3.1 needs a yardstick.conf file in /etc/yardstick 2. Copy the file /home/opnfv/repos/yardstick/etc/yardstick/yardstick.conf.sample to /etc/yardstick/yardstick.conf 3. If user wants to store the results in the local file, set the dispatcher to be 'file'. 4. If user wants to push the results into the DB, set the dispatcher to be 'http' and target to be the api url getting from the user. Change-Id: I39c30883b471ab7cb29ed6d63ba8c232da39c135 Signed-off-by: xudan <xudan16@huawei.com>
2017-07-03tag dovetail with 0.2.0MatthewLi3-2/+4
JIRA: DOVETAIL-447 docker images used yardstick danube.3.0 functest cvp.0.2.0 testapi cvp.0.2.0 dovetail cvp.0.2.0 main changes 1, fix yardstick HA bugs 2, fix functest sdnvpn offlinebugs 3, fix dovetail https bugs, etc. for more info, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: I4edb61b84ed80d8d7624f69db372fec60d73aa38 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-06-20branch supported in Dockerfile and use functest/yardstick danube.2.0MatthewLi2-2/+2
JIRA: DOVETAIL-447 Change-Id: Id49d6ded8188900b58349e1983ac3fc8b40b6059 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-25change the name of Yardstick results file and some log msgxudan1-1/+1
JIRA: DOVETAIL-428 1. Change the name of Yardstick result file from opnfv_yardstick_tc019.out to dovetail.ha.tc001.out. Because opnfv_yardstick_tc019 is the name defined in Yardstick and dovetail.ha.tc001 is the name defined in Dovetail. 2. Check whether the file exists before reporting the results are stored in file. 3. Delete test cases vping_ssh, vping_userdata and sdnvpn.tc003 from the testsuite proposed_tests. Change-Id: I4cb16947729479616a03abd9e91b76f9a41a949c Signed-off-by: xudan <xudan16@huawei.com>
2017-05-25Change the directories of results and some files to DOVETAIL_HOMExudan3-9/+12
JIRA: DOVETAIL-438 1. Need an env variable DOVETAIL_HOME in env_config.sh 2. env_config.sh, pod.yaml and id_rsa should be put in path DOVETAIL_HOME/pre_config 3. the results will also be put in this path 4. no need to give the path of openstack credential file while running a testsuite 5. if running with the code, source the env_config.sh file before running source $DOVETAIL_HOME/env_config.sh dovetail run --testsuite <testsuite_name> 6. if running with Dovetail docker image docker run -it --privileged=true -e DOVETAIL_HOME=<dovetail_home_path> -v <dovetail_home_path>:<dovetail_home_path> -v /var/run/docker.sock:/var/run/docker.sock opnfv/dovetail:latest /bin/bash Change-Id: Ia23078f27a34e293d0075e49c673930f41069cb6 Signed-off-by: xudan <xudan16@huawei.com>
2017-05-09Merge "vpn testcases added in proposed_tests"hongbo tian1-0/+2
2017-05-07vpn testcases added in proposed_testsMatthewLi1-0/+2
JIRA: DOVETAIL-212 after communicating with Tim/jose, help to add vpn testcase into proposed_tests reference: https://wiki.opnfv.org/display/sdnvpn/SDNVPN+Testing#SDNVPNTesting-TestcompliancetemplateforDovetail Change-Id: Id34a2cadba625abbdbc59ef11affeccba24fa10c Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-05-04Get results json data from databasexudan1-1/+2
JIRA: DOVETAIL-417 1. If report results with files, all results will be stored in local files. 2. If report to database, will get results from database and stored with file results.json Change-Id: Ic30037bd66cd37042f82b75fac2043a876e21c6f Signed-off-by: xudan <xudan16@huawei.com>
2017-04-27support HA test cases to run with keyxudan1-0/+1
JIRA: DOVETAIL-409 1. HA test cases need a file pod.yaml, in this file it can use the password or the key. 2. If use key, Dovetail need to pass the key file $DOVETAIL_HOME/dovetail/userconfig/id_rsa to yardstick Container. 3. Add a directory $DOVETAIL_HOME/dovetail/userconfig and a sample_pod.yaml 4. ha.tc001 tc003 tc005 tc006 tc009 are ready. Change-Id: I391cc211dba2cf0740dd0dcaee8a5c2d712eaee1 Signed-off-by: xudan <xudan16@huawei.com>
2017-04-25Bugfix: All HA testcases are SSH timeout in CI jobsxudan1-6/+10
JIRA: DOVETAIL-405 1. All HA test cases running in CI are SSH timeout. 2. The reason is that HA test cases need a file pod.yaml providing the info of each node of Openstack. 3. This pod.yaml should be put in $DOVETAIL_HOME/dovetail/userconfig by users. 4. Dovetail's CI jobs should also do some adaptions. JIRA: DOVETAIL-407 5. modify file .gitignore to ignore directories results/ and userconfig/. Change-Id: I5c681445ec83c9d67a0151370f5b56840ffe444c Signed-off-by: xudan <xudan16@huawei.com>
2017-04-21Merge "add defcore/ha testcases to proposed_tests"hongbo tian1-0/+1
2017-04-21use Functest tempest_custom test cases to run all Ipv6 test casesxudan2-1/+2
JIRA: DOVETAIL-401 1. modify all Ipv6 test cases, change tempest_smoke_serial/tempest_full_parallel into tempest_custom, add ID of each sub-testcases. 2. Some sub-testcases in ipv6.tc002, ipv6.tc003, ipv6.tc004 and ipv6.tc005 can not be found in the full tempest test case list. 2. disable testcases' script_result_acquired to enable tempest_custom run multiple times. 3. use build_tag-testcase_name(such as daily-master-79a6e392-28bb-4c40-9d88-a03bed99da2d-dovetail.ipv6.tc025) as the unique ID of each testcase. 4. comment out the progress bar, because it has some problems when print the report text. 5. Functest has changed the TEST_DB_URL from http://<testapi>:<port>/apv/v1 to http://<testapi>:<port>/apv/v1/results. 6. Functest has changed the TEST_DB_URL to file://<file_path>/<file_name>. see https://gerrit.opnfv.org/gerrit/#/c/33511/ Change-Id: I524f6702377f215f526158214842481eb44565be Signed-off-by: xudan <xudan16@huawei.com>
2017-04-21add defcore/ha testcases to proposed_testsMatthewLi1-0/+1
JIRA: DOVETAIL-398 JIRA: DOVETAIL-399 1. this testsuite will run in community CI, see https://gerrit.opnfv.org/gerrit/#/c/33509/ 2. HA testcases please see https://wiki.opnfv.org/pages/viewpage.action?pageId=8684344 3. vimops testcases deleted, since it's covered in defcore Change-Id: Ied9c8867e0aa99e33fd213030e6471aa5cfb86e8 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-13Merge "dovetail tool: bugfix: test cases are erroneously judged"hongbo tian2-2/+0
2017-04-12dovetail tool: bugfix: test cases are erroneously judgedxudan2-2/+0
JIRA: DOVETAIL-375 JIRA: DOVETAIL-390 1. defcore test cases are erroneously judged because of: a) defcore results json data lack some keys b) some sub-testcases' names are the same as the prefix of another sub-testcases. 2. this patch removes the extra keys and judge sub-testcases accurately. 3. remove "store_type" in functest_config.yml and yardstick_config.yml. 4. change some log levels from info to debug. Change-Id: I5f126e70309409cac66ef9a0909f1573d325098b Signed-off-by: xudan <xudan16@huawei.com>
2017-04-10refstack: add manually method to let user can set its tempest.conf and ↵MatthewLi1-0/+2
defcore.txt JIRA: DOVETAIL-394 for refstack, userguide is listed in https://gerrit.opnfv.org/gerrit/#/c/33049/ in CI, use the automate way to generate tempest.conf to let refstack run against SUT, i.e., defcore.tc001.yml will provide a way to let user can let refstack run against SUT manually, i.e. defcore.tc002.yml since the tempest.conf autometely generated may not satisfied with SUT, users can adjust its tempest.conf to let the defcore testcases pass. Change-Id: I5ed212c9c6d864d352d1c497ea039cc553461158 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-01fix yardstick openrc locationMatthewLi1-1/+1
since yardstick changes its openrc location see https://gerrit.opnfv.org/gerrit/#/c/32861/ Change-Id: Ib85910fe5521fb398c47e389e2baf127342b1c0b Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-04-01Merge "refstack result parse"hongbo tian2-5/+0
2017-04-01refstack result parseMatthewLi2-5/+0
JIRA: DOVETAIL-375 1, together with other testsuite from functest, such as tempest etc. this should merge after https://gerrit.opnfv.org/gerrit/#/c/31313/ 2, delete some unnecessary definition 3, bugfix of docker cp inside container, see https://build.opnfv.org/ci/view/dovetail/job/dovetail-compass-baremetal-debug-master/361/console 4, disable tempest testcaes since changed to refstack_defcore Change-Id: I67503e348af4a3f697f1b4106bfe81c05add8aa0 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-31dovetail tool: change results dir into $DOVETAIL_HOME/resultsxudan1-1/+0
JIRA: DOVETAIL-381 Now DoveTail's results dir is defined in $DOVETAIL_HOME/dovetail/conf/dovetail_config.yml, and its default value is /home/opnfv/dovetail/results. Since customer's jumphost may not have this dir and they don't want to create it, Dovetail needs to change this dir into $DOVETAIL_HOME/results. Change-Id: I616fb2da87bcfaabfd78d8762897e378168f694d Signed-off-by: xudan <xudan16@huawei.com>
2017-03-30dovetail tool: refstack testcase integrationMatthewLi1-7/+9
JIRA: DOVETAIL-370 Change-Id: I60c9f431358f848e24abcb865c4b2ca8c3b2d843 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-29dovetail tool: offline supportMatthewLi1-0/+5
JIRA: DOVETAIL-164 usage: dovetail run --testsuite <testsuite> --offline 1,if --offline given, can run offline by using local docker images (if there is no images, will get an error in log, images can be pulled from dockerhub or downloaded from artifacts.opnfv.org ) 2,if --offline not given, will run online, which means pull docker image from dockerhub Change-Id: I87ab35c82e59fb13a7a88c38d233e89285efc4d3 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-03-25dovetail tool: Add an option cmd for pushing results into DBxudan4-6/+7
JIRA: DOVETAIL-373 1. add an option --report/-r to choose the report type. 2. "-r file" will store results with files. 3. "-r http://192.168.135.2:8000/api/v1" will push results into DB. The DB url can replaced by user's local DB or official DB. 4. Default report type is defined as "report_dest" in dovetail_config.yml. 5. Yardstick can't push results of one testcase into DB now, so both "-r file" and "-r http://..." will be regarded as "file". Change-Id: Ieaa017ab59c5b15235bf306ef57cdc56beb22af8 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-22Merge "dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵hongbo tian1-7/+7
yardstick.log"
2017-03-21dovetail tool: remove installer and CI related variablesxudan4-39/+6
JIRA: DOVETAIL-371 1. remove all the envs in functest_config.yml and yardstick_config.yml 2. remove all relative cmds in cmd_config.yml 3. remove all the envs when running a new functest/yardstick container 4. add some variables just for functest pushing results to db 5. get the external network name for yardstick 6. make --debug/-d just control the log level shown on the screen 7. set requests=2.10.0 since python-openstackclient needs 'requests!=2.12.2,!=2.13.0,>=2.10.0' Change-Id: I9f941e09d067fc95a14c3c9be1374f41df4a9a16 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-21dovetail tool: Bugfix about the prepare_env of yardstick and get the ↵xudan1-7/+7
yardstick.log 1. For Fuel, yardstick prepare_env.sh will fail when pwd != /home/opnfv/repos/yardstick 2. Modify yardstick_config.yml in Dovetail to change pwd to that path. 3. Use log file /tmp/yardstick/yardstick.log created by cmd "yardstick task start" rather than redirecting the console output to yardstick.log. JIRA: DOVETAIL-363 Change-Id: Ie0475cfabc66e342be868f0924a5fccd6fa74b58 Signed-off-by: xudan <xudan16@huawei.com>
2017-03-20dovetail tool: change name of credentials from creds to openrcxudan4-7/+7
1. change file name from openstack.creds to openrc.sh 2. change the cmd --creds to --openrc/-o 3. now the path of --openrc can be relative path no restrict to abspath 4. remove the useless "work_dir" in dovetail_config.yml JIRA: DOVETAIL-369 JIRA: DOVETAIL-367 Change-Id: I2592438eef060f84132ff7fa226aea93ea947362 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-21dovetail tool: Bugfix about the creds path in yardstick conf filexudan1-1/+1
JIRA: DOVETAIL-355 Change-Id: I04a74caa080e0fd2ea11648f8085947ef8d556b1 Signed-off-by: xudan <xudan16@huawei.com>
2017-02-17dovetail tool: change the way to get the functest result filexudan1-1/+4
Functest has changed it's way to generate the local result file. see Gerrit: https://gerrit.opnfv.org/gerrit/#/c/28513/ Dovetail needs to do some adaptions to fit this change. JIRA: DOVETAIL-350 Change-Id: I681f74832f582f26c8874f7d2726c8588f430612 Signed-off-by: xudan <xudan16@huawei.com>
2017-01-25dovetail tool: functest different testsuite support and yardstick testcase addedMatthewLi2-3/+26
JIRA: DOVETAIL-186 Change-Id: Id0eec6652c9595c660436dec89a309a77b16bc03 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-16dovetail tool: format improvementMatthewLi4-1/+4
Change-Id: Ibf0bb781c0f0b6be73526bf45231040e68510f76 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2017-01-05release tag supportMatthewLi1-3/+4
JIRA: DOVETAIL-170 Change-Id: Id56e30fdb3fb5b652e2145dd406b71986997f200 Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-12-23Merge "dovetail tool: use command 'debug' to control both 'debug' and ↵hongbo tian1-9/+4
'CON_DEBUG'"