summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-09-28Merge "Make Yardstick log level can be set by CLI"Leo wang5-14/+38
2017-09-27Merge "Update the script for building local DB and testapi"Leo wang5-667/+31
2017-09-26Update the script for building local DB and testapixudan5-667/+31
1. When test dovetail, users can build local DB and testapi to store and report the results. 2. The script for building local DB and testapi needs some updates. JIRA: DOVETAIL-507 Change-Id: I8bc96bfea27f424468cafaa2e05894065ef44ad9 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-26Bugfix: tar results dir cannot be parsed by web portalxudan1-3/+9
The directory tree of results tar file is wrong, so web portal cannot parse it. Reset the tar file. JIRA: DOVETAIL-508 Change-Id: I8475323294e84ca51242b700570926d5c0177390 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-26Make Yardstick log level can be set by CLIxudan5-14/+38
1. Currently, the log level of yardstick is DEBUG and cannot be modified. 2. Make it can be changed from CLI. 3. When use dovetail run --debug, can see all Yardstick logs (including DEBUG) in dovetail.log. 4. When run without debug option, cannot see Yardstick debug logs in dovetail.logs. 5. yardstick.log always doesn't include debug logs. JIRA: DOVETAIL-506 Change-Id: Iaafb61232a22e16fff2fa4605bf7e262b022085e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-25Merge "Replacing references to "DefCore""hongbo tian6-27/+19
2017-09-18Dovetail tool replaces defcore with osinteropxudan5-16/+15
Rename the "defcore" test area to "osinterop". The DefCore working group has been renamed OpenStack InterOp Working Group some time ago. JIRA: DOVETAIL-499 Change-Id: I144af767632c8fb83859e5e04b6427bb1a538348 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-15Clearer structuring current and future test scope of CVP addendumGeorg Kunz1-101/+128
This patchset attempts to more clearly structure the outcome of the scope analysis by having dedicated "in scope" and "future scope" sections Change-Id: I6a42a8ac4495fa4e2e5e773a7f594704d9cc1e28 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-13Replacing references to "DefCore"Georg Kunz6-27/+19
This patch removes all references to the outdated term "DefCore" in the Dovetail documentation. The DefCore working group has been renamed OpenStack InterOp Working Group some time ago. This patch also proposes renaming the "defcore" test area to "osinterop". JIRA: DOVETAIL-499 Change-Id: I7bb2ca33cb1eaf17c3ca0fc79a4f923e5886ece4 Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2017-09-11Merge "Clarify criteria for testcase inclusion as running in Functest/CI And ↵hongbo tian1-16/+32
additional clarifications."
2017-09-08Merge "add more information for the Identity testcases in the refstack"hongbo tian1-8/+148
2017-09-08Merge "Doc: update user guide due to add new test cases and features"hongbo tian1-27/+118
2017-09-08tag dovetail with 0.6.0xudan5-6/+7
docker image used opnfv/yardstick: danube.3.2 opnfv/functest: cvp.0.5.0 opnfv/bottlenecks: cvp.0.4.0 opnfv/testapi: cvp.0.6.0 opnfv/dovetail:web.cvp.0.6.0 opnfv/dovetail:api.cvp.0.6.0 opnfv/dovetail: cvp.0.6.0 main changes Merge all test specification docs about test area tempest and defcore Merge addendum doc and workflow doc Remake aarch64 patch for Dovetail container Remove some tempest test cases that are not too common Add additional Tempest API test cases into test case tempest.tc005 persist db file in host for mongo container add nginx to host static files add a sample tempest_conf.yaml file into userconfig Add a patch to set ha SLA to be 30 seconds Modify logs Bugfix: the config files in useeconfig will cover user's config Bugfix: functest only keeps the last test case's log Bugfix: pre_condition cmds is just executed once For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool JIRA: DOVETAIL-497 Change-Id: I74626bbf65ce0121cc7b53394c85694e15df8484 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-08Merge "Add a patch to set ha SLA to be 30 seconds"Leo wang3-1/+139
2017-09-07Modify logsxudan2-10/+11
JIRA: DOVETAIL-498 Change-Id: Ie98fc89cc840b557aa4186c6c2bee2d610432af0 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-07Merge "Add test area 'forwarding packets through virtual networks in data path'"hongbo tian2-0/+151
2017-09-06Add a patch to set ha SLA to be 30 secondsxudan3-1/+139
1. According to ha test specification doc, the SLA of process recover time is 30 seconds. 2. However, the SLA in Yardstick test cases are all 20 seconds. 3. Add a patch to change the SLA in yardstick test cases. JIRA: DOVETAIL-496 Change-Id: Ib8f229fdfbb3289bf70d6ee900132b3db3a21b17 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-07Merge "Test case specification for VIM Network"hongbo tian2-18/+343
2017-09-06Doc: update user guide due to add new test cases and featuresxudan1-27/+118
There has been added some new test cases and features, so user guide should be updated according to the latest dovetail version. - Add introduction about https (with cacert and without cacert) - Add introduction about adding hosts' info - Add introduction about downloading cirros images - Add introduction about special configurations for running defcore and tempest test cases - Add introduction about how to check defcore and tempest failed test cases JIRA: DOVETAIL-493 Change-Id: I13aca4ee433056bd21590743a412d5d95f45fec4 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Merge "Remake aarch64 patch for Dovetail container"Leo wang1-15/+38
2017-09-06Add test area 'forwarding packets through virtual networks in data path'xudan2-0/+151
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'forwarding packets through virtual networks in data path'. Add the test specification about this test area. Change-Id: I26416ecca6b89a94cf48ba0f55308df0fa6e1677 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Add test area 'simple virtual machine resource scheduling on multiple nodes'xudan2-0/+381
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'simple virtual machine resource scheduling on multiple nodes'. Add the test specification about this test area. Change-Id: I7a5ff426442424dbc364a68296facb0bac6401ca Signed-off-by: xudan <xudan16@huawei.com>
2017-09-06Merge "Add test area 'correct behavior after common virtual machine life ↵hongbo tian2-0/+775
cycles events'"
2017-09-06Merge "Test case specification for VIM Image"hongbo tian2-17/+386
2017-09-06Merge "Bugfix: the config files in useeconfig will cover user's config"Leo wang4-16/+23
2017-09-05Add test area 'correct behavior after common virtual machine life cycles events'xudan2-0/+775
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'correct behavior after common virtual machine life cycles events'. Add the test specification about this test area. Change-Id: I051b3c5b501ed833a613ea6a6601125c4fa80c3e Signed-off-by: xudan <xudan16@huawei.com>
2017-09-05Merge "Remove some tempest test cases that are not too common"hongbo tian3-28/+0
2017-09-05Merge "Add test area 'dynamic network runtime operations'"hongbo tian2-0/+422
2017-09-04Merge "Test case specification for VIM Compute"hongbo tian2-36/+627
2017-09-03Remove some tempest test cases that are not too commonxudan3-28/+0
Change-Id: I2a19b9f3e6c44bedef5d3cb20f480405e4d6d5e2 Signed-off-by: xudan <xudan16@huawei.com>
2017-09-01Merge "Test case specification for VIM Volume"hongbo tian2-44/+1018
2017-09-01Add test area 'dynamic network runtime operations'xudan2-0/+422
JIRA: DOVETAIL-473 According to Dovetail addendum doc, add one test area about basic cloud capability 'dynamic network runtime operations through the life of a VNF'. Add the test specification about this test area. Change-Id: I59706bc4a5765cf779a03fc3c493e5a8d184c1dc Signed-off-by: xudan <xudan16@huawei.com>
2017-09-01Merge "Add test area 'filtering packets based on security rules and port ↵hongbo tian2-0/+461
security'"
2017-08-31Add additional Tempest API test cases into test case tempest.tc005xudan2-2/+7
1. According to the latest dovetail test case specification document, there are 5 new Tempest api test cases. 2. Add them into tempest.tc005 so they can be tested in CI. JIRA: DOVETAIL-495 Change-Id: Ib8057d01b99472aeb91cf564d09b67407c572235 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-31Test case specification for VIM Computexudan2-36/+627
1. Add the alias VIM Compute test cases into testscope. 2. Add test case specification for VIM Compute. Change-Id: Icca09a58221511f607e43eb1d0415d9de4e452eb Signed-off-by: xudan <xudan16@huawei.com>
2017-08-31Bugfix: the config files in useeconfig will cover user's configxudan4-16/+23
1. Now there are 2 sample files tempest_conf.yaml and hosts.yaml in userconfig, and thet will cover user's tempest_conf.yaml and hosts.yaml in $DOVETAIL_HOME/pre_config. 2. Rename the files in userconfig to be tempest_conf.yaml.sample and hosts.yaml.sample. 3. Add the hosts info in file /etc/hosts in Dovetail Container. JIRA: DOVETAIL-492 Change-Id: I2b5694a8058b864b510925eec595d6f2bd1062ff Signed-off-by: xudan <xudan16@huawei.com>
2017-08-28Merge "Bugfix: functest only keeps the last test case's log"Leo wang2-0/+25
2017-08-28Bugfix: functest only keeps the last test case's logxudan2-0/+25
JIRA: DOVETAIL-490 1. Dovetail just keeps the last tempest/defcore/ipv6/bgpvpn test's log file. 2. All log files should be kept, so users and developers can know the reason of failed test cases. 3. tempest logs will be stored in directory tempest_logs/ 4. defcore logs will be stored in directory defcore_logs/ 5. IPv6 logs will be stored in directory ipv6_logs/ 6. bgpvpn logs will be stored in directory bgpvpn_logs/ 7. All vping logs are in functest.log Change-Id: I79eae79cb32d65ce1ada3dd6f4c6dfd3945fc512 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-28Merge "Bugfix: pre_condition cmds is just executed once"Leo wang1-11/+7
2017-08-25Added top-down scope analysis based on cvp objectives and end-user ↵Trevor Cooper1-0/+388
expectations. Also simplified to focus on scope only. Change-Id: Ibde9fdacfd026f7859bd6fd239d79fdbdeccad01 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-25Merge "Draft a workflow that will work with the CVP web portal and test API. ↵hongbo tian2-0/+132
Also made simplifications for the first release."
2017-08-23Bugfix: pre_condition cmds is just executed oncexudan1-11/+7
JIRA: DOVETAIL-489 1. All the cmds defined in pre_condition is just executed once for each type i.e. functest, yardstick, bottlenecks... 2. The copy cmds defined in each functest test cases are just executed for the first test case rather than all test cases. 3. Make the cmds to be executed for each test case. Change-Id: I571f0eb9dd3cab77fc8597e5a9b5246398804d3e Signed-off-by: xudan <xudan16@huawei.com>
2017-08-22Clarify criteria for testcase inclusion as running in Functest/CIBryan Sullivan1-16/+32
And additional clarifications. JIRA: DOVETAIL-477 Replace tabs. Further clarify testing programs and optionality criteria. Change-Id: I8eebdf215fb7cc75a6da9748629b1a73d0b71d19 Signed-off-by: Bryan Sullivan <bryan.sullivan@att.com>
2017-08-22persist db file in host for mongo containergrakiss1-1/+1
JIRA: DOVETAIL-488 Keep db file in host to avoid data lost Change-Id: If039789eabfb8847ea344c016cb74e226be43f73 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-18Draft a workflow that will work with the CVP web portal and test API. Also ↵Trevor Cooper2-0/+132
made simplifications for the first release. Change-Id: Ief92a7e71c546883fdf472346646a43c9ae26c94 Signed-off-by: Trevor Cooper <trevor.cooper@intel.com>
2017-08-18Test case specification for VIM Volumexudan2-44/+1018
1. Add the alias VIM Volume test cases into testscope. 2. Add test case specification for VIM Volume. Change-Id: I715a69aad380466659365cc554351efb4d6eb053 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-17add nginx to host static filesgrakiss5-6/+726
JIRA: DOVETAIL-485 Tornado does not support directory listing, so add nginx to host static files, and support log file browsing Change-Id: Ic1427ab9c64661b3993ac60943f470b125a0fbe7 Signed-off-by: grakiss <grakiss.wanglei@huawei.com>
2017-08-16Add a sample tempest_conf.yaml file into userconfigxudan1-0/+16
1. Functest cvp.0.5.0 supports to config tempest.conf file when running tempest test cases. 2. Dovetail provides a sample tempest_conf.yaml file, and user can edit this file before running tempest test cases. 3. All the values in this file will be used to update tempest.conf file. Change-Id: I1afb50f1405c6cef992132899e0549396f587872 Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Test case specification for VIM Networkxudan2-18/+343
1. Add the alias VIM Network test cases into testscope. 2. Add test case specification for VIM Network. Change-Id: I133ad13b1f926e0093d92a9a39d88947648122ea Signed-off-by: xudan <xudan16@huawei.com>
2017-08-16Tag dovetail with cvp.0.5.0xudan8-23/+24
JIRA: DOVETAIL-483 1. docker image used yardstick: danube.3.2 functest: cvp.0.5.0 bottlenecks: cvp.0.4.0 testapi: cvp.0.5.0 dovetail: cvp.0.5.0 2. main changes Bugfix: wrong command in function 'check_https_enabled' Use opnfv/functest:cvp.0.5.0 and do some adaptions in dovetail tool Create a tar file for all logs Add tempest test cases into proposed_tests Fix testapi base_url for public_url Add user guide for results operations on web 3. For more information, refer to https://wiki.opnfv.org/display/dovetail/Running+history+for+the+dovetail+tool Change-Id: Iec548b077a704ff68d6b93de3436e109d59371cd Signed-off-by: xudan <xudan16@huawei.com>