summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-08-31Add additional Tempest API test cases into test case tempest.tc005xudan2-2/+7
1. According to the latest dovetail test case specification document, there are 5 new Tempest api test cases. 2. Add them into tempest.tc005 so they can be tested in CI. JIRA: DOVETAIL-495 Change-Id: Ib8057d01b99472aeb91cf564d09b67407c572235 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-31Test case specification for VIM Computexudan2-36/+627
1. Add the alias VIM Compute test cases into testscope. 2. Add test case specification for VIM Compute. Change-Id: Icca09a58221511f607e43eb1d0415d9de4e452eb Signed-off-by: xudan <xudan16@huawei.com>
2017-08-31Bugfix: the config files in useeconfig will cover user's configxudan4-16/+23
1. Now there are 2 sample files tempest_conf.yaml and hosts.yaml in userconfig, and thet will cover user's tempest_conf.yaml and hosts.yaml in $DOVETAIL_HOME/pre_config. 2. Rename the files in userconfig to be tempest_conf.yaml.sample and hosts.yaml.sample. 3. Add the hosts info in file /etc/hosts in Dovetail Container. JIRA: DOVETAIL-492 Change-Id: I2b5694a8058b864b510925eec595d6f2bd1062ff Signed-off-by: xudan <xudan16@huawei.com>
2017-08-28Merge "Bugfix: functest only keeps the last test case's log"Leo wang2-0/+25
2017-08-28Bugfix: functest only keeps the last test case's logxudan2-0/+25
JIRA: DOVETAIL-490 1. Dovetail just keeps the last tempest/defcore/ipv6/bgpvpn test's log file. 2. All log files should be kept, so users and developers can know the reason of failed test cases. 3. tempest logs will be stored in directory tempest_logs/ 4. defcore logs will be stored in directory defcore_logs/ 5. IPv6 logs will be stored in directory ipv6_logs/ 6. bgpvpn logs will be stored in directory bgpvpn_logs/ 7. All vping logs are in functest.log Change-Id: I79eae79cb32d65ce1ada3dd6f4c6dfd3945fc512 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-28Merge "Bugfix: pre_condition cmds is just executed once"Leo wang1-11/+7
2017-08-25Added top-down scope analysis based on cvp objectives and end-user ↵Trevor Cooper1-0/+388
expectations. Also simplified to focus on scope only. Change-Id: Ibde9fdacfd026f7859bd6fd239d79fdbdeccad01 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-25Merge "Draft a workflow that will work with the CVP web portal and test API. ↵hongbo tian2-0/+132
Also made simplifications for the first release."
2017-08-23Bugfix: pre_condition cmds is just executed oncexudan1-11/+7
JIRA: DOVETAIL-489 1. All the cmds defined in pre_condition is just executed once for each type i.e. functest, yardstick, bottlenecks... 2. The copy cmds defined in each functest test cases are just executed for the first test case rather than all test cases. 3. Make the cmds to be executed for each test case. Change-Id: I571f0eb9dd3cab77fc8597e5a9b5246398804d3e Signed-off-by: xudan <xudan16@huawei.com>
2017-08-22Clarify criteria for testcase inclusion as running in Functest/CIBryan Sullivan1-16/+32
And additional clarifications. JIRA: DOVETAIL-477 Replace tabs. Further clarify testing programs and optionality criteria. Change-Id: I8eebdf215fb7cc75a6da9748629b1a73d0b71d19 Signed-off-by: Bryan Sullivan <bryan.sullivan@att.com>
2017-08-22persist db file in host for mongo containergrakiss1-1/+1
JIRA: DOVETAIL-488 Keep db file in host to avoid data lost Change-Id: If039789eabfb8847ea344c016cb74e226be43f73 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-18Draft a workflow that will work with the CVP web portal and test API. Also ↵Trevor Cooper2-0/+132
made simplifications for the first release. Change-Id: Ief92a7e71c546883fdf472346646a43c9ae26c94 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-18Test case specification for VIM Volumexudan2-44/+1018
1. Add the alias VIM Volume test cases into testscope. 2. Add test case specification for VIM Volume. Change-Id: I715a69aad380466659365cc554351efb4d6eb053 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-17add nginx to host static filesgrakiss5-6/+726
JIRA: DOVETAIL-485 Tornado does not support directory listing, so add nginx to host static files, and support log file browsing Change-Id: Ic1427ab9c64661b3993ac60943f470b125a0fbe7 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-16Add a sample tempest_conf.yaml file into userconfigxudan1-0/+16
1. Functest cvp.0.5.0 supports to config tempest.conf file when running tempest test cases. 2. Dovetail provides a sample tempest_conf.yaml file, and user can edit this file before running tempest test cases. 3. All the values in this file will be used to update tempest.conf file. Change-Id: I1afb50f1405c6cef992132899e0549396f587872 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Test case specification for VIM Networkxudan2-18/+343
1. Add the alias VIM Network test cases into testscope. 2. Add test case specification for VIM Network. Change-Id: I133ad13b1f926e0093d92a9a39d88947648122ea Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Tag dovetail with cvp.0.5.0xudan8-23/+24
JIRA: DOVETAIL-483 1. docker image used yardstick: danube.3.2 functest: cvp.0.5.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.5.0 dovetail: cvp.0.5.0 2. main changes Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Bugfix: wrong command in function 'check_https_enabled'xudan1-3/+4
JIRA: DOVETAIL-482 1. In function check_https_enabled, it will use cmd "openstack catalog show identity |awk '/public/ {print $4}'" to check if it is https. 2. However, this command will not work if it is https. 3. Check https via OS_AUTH_URL rather than "openstack catalog show identity". Change-Id: If40ffa8e9b33c38123ff4b834198a8eaaedc1c9c Signed-off-by: xudan <xudan16@huawei.com>
2017-08-15Adapt Functest cvp.0.5.0 docker imagexudan36-40/+115
In order to use functest cvp.0.5.0, Dovetail tool needs some adaptions. Change-Id: I9d0a23791c246a6c4961f229eaeb1f52f9b4995a Signed-off-by: xudan <xudan16@huawei.com>
2017-08-14Add test area 'filtering packets based on security rules and port security'xudan2-0/+461
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'filtering packets based on security rules and port security in data path'. Add the test specification about this test area. Change-Id: I814204f16b79bc06d9bfb54d5a90692d8b8c7bfa Signed-off-by: xudan <xudan16@huawei.com>
2017-08-11Merge "create a tar file for logs"Leo wang2-1/+1
2017-08-11Merge "Add Tempest test cases to Dovetail CI daily jobs"Leo wang8-0/+119
2017-08-10Remake aarch64 patch for Dovetail containerAlexandru Nemes1-15/+38
JIRA: ARMBAND-286 Change-Id: Ided665488c7240943f62c65df0535d8b0178459f Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com>
2017-08-10Test case specification for VIM Imagehongbotian2-17/+386
1. Adding the alias VIM image test cases into testscope. 2. Adding test case specification for VIM Image. Change-Id: Ifa7aa5ddea22d2862ee5d8ad465523d450a78fde Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-08-10create a tar file for logsgrakiss2-1/+1
JIRA: DOVETAIL-479 User may want to upload all logs along with the results, so others may check the running logs to make sure what' s going on during the test. Change-Id: Ice906264bbdf091d3353d6d2e146653aeb057f5f Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-08create a tar file for logsgrakiss1-0/+13
JIRA: DOVETAIL-479 User may want to upload all logs along with the results, so others may check the running logs to make sure what' s going on during the test. Change-Id: Ia5862f99c129b8207aa91a391567ffdd5ee0829a Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-07Add Tempest test cases to Dovetail CI daily jobsxudan8-0/+119
JIRA: DOVETAIL-478 JIRA: DOVETAIL-473 adds 6 test areas: - forwarding packets through virtual networks in data path - filtering packets based on security rules and port security in data path - dynamic network runtime operations through the life of a VNF - correct behavior after common virtual machine life cycles events - simple virtual machine resource scheduling on multiple nodes - storage security Add Tempest test cases belong to this 6 test areas to Dovetail CI daily jobs. Change-Id: I1535d96f3a85cdd8ac4f0c4375c68ce47bd9df93 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-07fix base_url for public urlgrakiss2-3/+67
Change-Id: I171e9b0bce1891594bf7ef577809e73f05556810 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-04Merge "add user guide for results operations on web"hongbo tian1-1/+32
2017-08-04Merge "Tag dovetail with cvp.0.4.0"hongbo tian5-13/+20
2017-08-04Tag dovetail with cvp.0.4.0xudan5-13/+20
JIRA: DOVETAIL-476 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.4.0 dovetail: cvp.0.4.0 2. main changes Add docs about vping test cases (test scope and test specification) Add 2 vping test cases into proposed_tests Bugfix: Build docker image failed because of lacking of packages Add resiliency.tc001 into proposed_tests 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: I5ce6bdc9a1daa957124309c9fadc532f9c7a2b1e Signed-off-by: xudan <xudan16@huawei.com>
2017-08-04add user guide for results operations on webgrakiss1-1/+32
JIRA: dovetail-471 User can access results through the web page browser the public results uploaded by others or himself upload the results, and set this results as public or private to others Change-Id: I9834a670f5dff6412a0290d9a5dd729bcece2933 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-03Add resiliency test caes into proposed_testsxudan11-13/+193
JIRA: DOVETAIL-474 Add Bottlenecks resiliency test case "posca_factor_ping" into proposed_tests. Change-Id: I76aea651014fb4722ddae07559f417d3f840eee2 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-01Bugfix: Build docker image failed because of lacking of packagesxudan1-0/+3
JIRA: DOVETAIL-475 1. Dovetail fails to build Docker image. CI Link: https://build.opnfv.org/ci/view/dovetail/job/dovetail-docker-build-push-master/162/console Traceback: Running setup.py install for cryptography c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory 2. Refer to https://cryptography.io/en/latest/installation/ For Debian and Ubuntu, the following command will ensure that the required dependencies are installed: sudo apt-get install build-essential libssl-dev libffi-dev python-dev Change-Id: Icb705823c58d8a557175d48b00745119c0a6b3b9 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-02Merge "mandatory vping test case added to proposed_tests"hongbo tian7-27/+10
2017-08-02Merge "WIP: Test case description for vping test cases"hongbo tian2-0/+287
2017-07-28WIP: Test case description for vping test casesGeorg Kunz2-0/+287
Adding test case descriptions for both vping test cases implemented in Functest. Test case 1 makes use of the config drive mechanism of Nova to pass a test script. Test case 2 uses SSH to transfer and execute a script on one VM. Change-Id: Ic8be6ad4dfd4b0e7661064506b0ae92db2fc1463 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-07-21Merge "Use uuid1 to replace uuid4"hongbo tian1-1/+1
2017-07-21Tag dovetail with cvp.0.3.0xudan8-18/+19
JIRA: DOVETAIL-468 1. docker image used yardstick: danube.3.1 functest: cvp.0.2.0 testapi: cvp.0.3.0 dovetail: cvp.0.3.0 2. main changes fix dovetail docker version to be 17.03.0-ce adapt yardstick danube.3.1 For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Ie8bb2cfbad4b416404f5aaa2c40c1d3832be676f Signed-off-by: xudan <xudan16@huawei.com>
2017-07-21Merge "Draft dovetail user guide first cut"Leo wang5-472/+498
2017-07-21Use uuid1 to replace uuid4xudan1-1/+1
JIRA: DOVETAIL-469 uuid1 is more unique than uuid4 Change-Id: Ic29ec7586ba518e67cb1750df1001cd390fcf313 Signed-off-by: xudan <xudan16@huawei.com>
2017-07-21Merge "Delete the ERROR log when it is not https"Leo wang2-5/+6
2017-07-21Merge "Adapt Yardstick to copy yardstick.conf to /etc/yardstick"Leo wang3-9/+25
2017-07-21Merge "Fix the docker version to be 17.03.0-ce rather than the latest one"Leo wang1-1/+7
2017-07-20mandatory vping test case added to proposed_testsMatthewLi7-27/+10
JIRA: DOVETAIL-446 1.add vping to proposed_tests 2.delete out-dated nfvi test cases Change-Id: I181b00b02abe6fed4ff51e947576c1b71321cdd2 Signed-off-by: MatthewLi <lijun_1203@126.com>
2017-07-19Fix the docker version to be 17.03.0-ce rather than the latest onexudan1-1/+7
JIRA: DOVETAIL-467 1. Since the script getting with "wget qO https://get.docker.com/" has been changed and it can just install docker-ce rather than docker-engine now. 2. Dovetail validates with Docker 17.03 CE, so the docker installed in the dovetail container can be 17.03.0-ce. Change-Id: If64204ba3dcf5a38d7a124a0cc716f8375808999 Signed-off-by: xudan <xudan16@huawei.com>
2017-07-19Adapt Yardstick to copy yardstick.conf to /etc/yardstickxudan3-9/+25
JIRA: DOVETAIL-466 1. Yardstick danube.3.1 needs a yardstick.conf file in /etc/yardstick 2. Copy the file /home/opnfv/repos/yardstick/etc/yardstick/yardstick.conf.sample to /etc/yardstick/yardstick.conf 3. If user wants to store the results in the local file, set the dispatcher to be 'file'. 4. If user wants to push the results into the DB, set the dispatcher to be 'http' and target to be the api url getting from the user. Change-Id: I39c30883b471ab7cb29ed6d63ba8c232da39c135 Signed-off-by: xudan <xudan16@huawei.com>
2017-07-17Delete the ERROR log when it is not httpsxudan2-5/+6
JIRA: DOVETAIL-462 1. If it is not https, Dovetail will give a error log 2017-07-13 21:58:30,409 - container.Container - ERROR - The command 'openstack catalog show identity |awk '/public/ {print $4}'| grep 'https'' failed. 2. Remove this error log becuase it is not an error. Change-Id: I5791b1925cad8606d70eefd4940dd9bf46956305 Signed-off-by: xudan <xudan16@huawei.com>
2017-07-12Update the IPv6 for the remain commentshongbotian1-110/+121
JIRA: DOVETAIL-461 1. Lincoln’s comments about tc018-tc021: change “using DHCPv6” to “using DHCPv6 stateless” 2. Update tc018-tc025: give more details and modify some misunderstanding about these test cases. For more detail, please refer to jira or this patch. Change-Id: Ieb7ee9d0b8a31826c7f2f69cb5f209055fd7b928 Signed-off-by: hongbotian <hongbo.tianhongbo@huawei.com>
2017-07-06Draft dovetail user guide first cutWenjing Chu5-472/+498
Fixing comment issues and updating to new version of dovetail. Change-Id: Iaa9243d0a835f1d050fb925fa75b2a770168a8f4 Signed-off-by: Wenjing Chu <chu.wenjing@gmail.com>