summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-01-15Adds desription for TC024, the CPU load/mpstat test casePer Holmgren2-0/+65
Change-Id: Ifbc571e3e216349d065ac21df1a3f10fe94d4e9a JIRA: - (cherry picked from commit bb82fb8c9198d6e792b8558bf6eaf4f53710c7fe)
2016-01-15Correct some typoswym_libra1-12/+14
Change-Id: Ia9fd31580ff75663514aebbb46a8b87021cb01de Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 9028f681b95ca213f6702536cf740f07490e4b45)
2016-01-15Add test case description and task file for TC011wym_libra3-0/+128
Add test case description for Packet delay variation between VMs (TC011) and test case .yaml task file. ** Please note that the SLA value has not yet been determined. ** Change-Id: I68a374224946d46c173ad477c14cb79d573b1eee Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 09c6f91228759e22a08bd9344962d65c1818e6b3)
2016-01-15HeatContext model update to match heat code updateQiLiang29-42/+49
In Heat Liberty release OS::Nova::Server will always use the user pre-configured in the image (e.g. "fedora" for stock Fedora cloud images, "ubuntu" for stock Ubuntu cloud images, "cloud-user" for stock CentOS cloud images etc) Change all ec2-user -> ubuntu Add admin-user in Heat model for backwards compatibility. Refer below links for detalis: https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting https://github.com/openstack/heat/commit/e423bec7f10b0f5d07f05d195b3b7860f6bceb00 http://blog.scottlowe.org/2015/04/23/ubuntu-openstack-heat-cloud-init/ JIRA: - Change-Id: I6b8b2b21daf113a3a86aee1126b0c3e74737ef4f Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 9d36842e3966185e97cc5732aa7a0edd2050bfe2)
2016-01-14Update results for Test Cases 6, 7, 20, 21Vincenzo Riccobene5-21/+29
JIRA: YARDSTICK-219 Change-Id: I06143f074592e05cd17b740eb9751414a56c9fde Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit 9b8b765373abbb10289415312a24574ff122541a)
2016-01-14Add test suite for Orange POD2Jo¶rgen Karlsson1-0/+18
Change-Id: I667a54793be39c74a9f787b055b07fda9b2ba06c Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit a6415b5199936de2eb247a26f18e47a368b82afa)
2016-01-14Add template for test results reportAna C1-0/+71
This change is a proposal for a report for yardstick test case reesults. One report for all the executed tests, summarizing the results and the labs where the tests were executed. JIRA: - Change-Id: I7cdfdc82d6ee07d2b9da426f33ce34b86362b5b4 Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 3871a2c4f61b1da9a8512135bf0cf6e9e35d7e8d)
2016-01-14Fix small bugs for running Apexlake on Montreal testbeduser12-123/+125
JIRA: YARDSTICK-219 Change-Id: I5f403e6c922f5e6ea790dc9cdb589cbc98e66ded Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local> (cherry picked from commit 174560a6b7d4a23763564fcfc87c2dd7e60aa241)
2016-01-13ci: add influxdb target optionsJo¶rgen Karlsson1-5/+16
Change-Id: I50cbbf4d2fe59d688a4951cc8bec3362b098adcb JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 55f7c41c927320a3dac5a0907ebf66647aafd8a8)
2016-01-13Fix flake8 errorsJo¶rgen Karlsson16-45/+39
Change-Id: I14f21092f5e97abf0629a92a27062846a6d3130b JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 791323df72d8bf4f4f4c32a1e7273721f2adc349)
2016-01-12Fix minor format details in tc descriptionsAna C3-28/+58
This change fixes minor formating in TC025, remove one extra line in TC028 and update 03-list-of-tcs. The formating caused the pdf to fail. Change-Id: I304335277b1fbc33b10d9a07245ebeef0612fc80 Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 5c4c8667e0c0a8e039d7682f235b022f39149d56)
2016-01-12Rename tc019/tc025 & fix description for tc005QiLiang4-2/+4
Added tc019 and tc025 to index of test cases in 03-list-of-tcs. JIRA: - Change-Id: I02696dc408d2d5c20becba29c49b3cff2a7049a9 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 25095fb4e6d6a0e71581eee18f50c7d61f6a270d)
2016-01-12Add test case description for TC028-kvmQiLiang2-0/+67
JIRA: YARDSTICK-188 Change-Id: I16f8c5ac3a3997640ce96a77984c4dbe9ccb2804 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit ef353b91b2527580a642da561a387d67b71e753d)
2016-01-12Add test case description and task file for TC025wym_libra2-0/+142
Add test case description for HA of OpenStack Controll Node abnormally shutdown (TC025) and the sample .yaml task file. ** Please note that the SLA value has not yet been determined. ** JIRA: YARDSTICK-135 Change-Id: I70f1afb0c9cfa5446aac08b7b13e543a9ec20898 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 83d895e535b700790497429ac6cbd46fb0fef9e5)
2016-01-12Add test case description and task file for TC019wym_libra2-0/+167
Add test case description for Control node-OpenStack service down (TC019) and test case .yaml task file. ** Please note that the SLA value has not yet been determined. ** JIRA: YARDSTICK-135 Change-Id: Id512159034929dc197d2c7fdf6cc672ecddfb996 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 32b39d0f576dc5c71678fd0b6b8feab6f2173939)
2016-01-12Workround for openstack nova bugQiLiang1-2/+21
Notes: if placement_groups policy is "availability" and > 2 servers in this group may still have this issue. JIRA: YARDSTICK-200 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 10e55c026879912a36247f8958c954cb7521f9e5) Change-Id: I4b56ea63fc1adae6985c0d5101359299839cd86c
2016-01-12Include vTC overview in Yardstick documentationAna C10-124/+198
This change includes the vTC overview in Yardstick configguide, the original vTC/README has been renamed to 04-vTC-overview and added in the configguide. The vTC/abbreviations is deleted, all included in glossary.rst Index and 03-list-of-tcs are updated. JIRA:- Change-Id: Ifc5cf1cc258dee6743af189f347e8adbbec6a32f Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 12521edea1e40e73e2fb04f4f230760de324521b)
2016-01-11Implementation of opnfv-yardstick-tc021 in YardstickVincenzo Riccobene4-0/+319
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: I0554d0a211392902207ba9ceccf0b98dc3c2cdf1 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit e749d09788edbd1040dabb082e13bd1a1cbc3a7a)
2016-01-11Add vTC daily+weekly test suitesJo¶rgen Karlsson2-0/+32
Change-Id: Id557b5ef4d686da041b8097e390c7e5b563a0c3c JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 2b0c67e7b5984e200b92c134510e7e112cf30a35)
2016-01-11Implementation of opnfv-yardstick-tc020 in YardstickVincenzo Riccobene4-0/+299
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ibbba1d9864e788fb6c81cc00c503e9f69e885651 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit 884e58ab48d0dcdc5e57b87ea181c0a4b8151fc8)
2016-01-11Implementation of yardstick-tc007 in YardstickVincenzo Riccobene4-0/+330
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ifa2555336098e68d0fad8045e2f759aed587ad92 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit bde7eae17a1fc9ec163451b8d62825daa2fec297)
2016-01-11Add apexlake package pathJo¶rgen Karlsson2-0/+7
Workaround/hack to be able to use apexlake packages modules and run unit tests without having to install apexlake. Change-Id: Ibfa34f56bdb1cafa60d2090e16544a81badc2e85 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 5da3bbf2eb241b4550b8397b767123698bc3432a)
2016-01-11Implementation of yardstick-tc006 in YardstickVincenzo Riccobene7-0/+299
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Iabde8fa63f346cf1e4a02691f22d1761de79a239 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit 6f6ed9af46d616b073481799c157ed3bc88a8810)
2016-01-11IPv6 connectivity between nodes on the tenant networkkubi3-0/+95
Test case yaml and .rst file for ipv6 Change-Id: Ib9a554dc05445023687efb0ac608c7cbd0da4c21 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-11Test case to measure processing speed(score)kubi3-0/+102
run unixbench to get the score of processing performance This patch includes the .yaml for the test case and the .rst for test case description. JIRA:YARDSTICK-116 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Ic75119d1db19dacc57edfa4dce607e0e29ae8db4 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit db643f9a2a416c0888931a347488a51264350c8f)
2016-01-11Test Case 040 Verify Parser Yang-to-Toscakubi3-0/+83
running Parser Yang-to-Tosca module as a tool, validating output against expected outcome. this patch is about task yaml and rst for test case description. JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Id254c5cf45de33b023bef889a58044a21ed0db43 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit 45e85a7f6df63ca4ca702f519ca19e5bcbb1bc23)
2016-01-11Add missing yaml schema for TC037 and TC038Jo¶rgen Karlsson2-0/+4
Change-Id: I299eb5a94afb8a29dee89938ff1d7b1bb7f43f3b JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 7766def60d167a55e4a0fbbb3d94e5bfe6241e08)
2016-01-11Add test case description and task file for TC005QiLiang13-0/+141
JIRA: YARDSTICK-93 Change-Id: I74adef0e6bae52a7080479d7054a92342f7324a7 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 738fb0942c39e5f1ecad87ae9dd776f1019d2491)
2016-01-10Support run cyclictest on BareMetalQiLiang5-95/+227
JIRA: YARDSTICK-122 Change-Id: I8144215059a9abea08314a4c1e6a733dcdf0df53 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit a33f57371c740e0ab749bfffa4d31c08ef5c5b74)
2016-01-10The secondi HA test case-shutdown controllerwym_libra21-83/+496
1) add "attacker_baremetal.py" for fault injection 2) modify the monitor to excute on remote node after ssh connection 3) move all shell scripts together JIRA: YARDSTICK-182 Change-Id: Ibb9dc908224ddb8b99a0140b75c1a046503f6dfb Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 4f4edd840823ff6a0151e3f5220241183e27e560)
2016-01-10Rewrite the HA test case (2)wym_libra15-230/+565
idea: refact the Monitor class in old file "monitor.py" with the base class and sub-class. detail: 1) the BaseMonitor is the base class of other monitor 2) each monitor run in independent process 3) there are two monitor("openstack-cmd" and "process") for the first test case 4) MonitorMgr class used to manager monitor process JIRA: YARDSTICK-149 Change-Id: I2eede94481f740812212e6cb673d175b5f543c15 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 2733defda816a84d2b9c2e361a5970b9de4923f4)
2016-01-09running Parser Yang-to-Tosca module as a toolkubi12-1/+1078
with jnon and fatih's help, new docker image has been uploaded so this part is about parser verify validating output against expected outcome. Change-Id: If50d241a5338888f14fd11a752dc72678e0c569b JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit d93f6ca5bf0d4f22ec0fd90eac1bf8b9c09db820)
2016-01-08Add TC037 to POD test suitesJo¶rgen Karlsson10-0/+20
JIRA: YARDSTICK-213 Change-Id: I55ff36b02a0d0e0334505d68d361b8a14d36063c Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 45b1cc64209dec07475e5263469328231c524aa7)
2016-01-08support lxml for parser in docker containerkubi1-0/+2
this is part1 of patch, this part is to define dockefile,and wait a docker image to be uploaded JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Ia206c54ab2d964a94753abef0767b74d26259081 (cherry picked from commit e2027b26582a839dc5c25a54fc5621695b9026c0)
2016-01-08support for ipv6kubi11-57/+588
JIRA:YARDSTICK-187 Change-Id: I1cecd400b4449a09d22d43f4a42e889f00dd4fe7 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit cd80b44f3fd9b8c9e2afc51bc67d7a5cf34fb1c6)
2016-01-08Rename folders in yardstick/docsAna C19-0/+0
Adapt the naming of the folders under yardstick/docs to the naming adopted by the release documentation defined by opnfvdocs. JIRA: - Change-Id: Icc57720d585abbbf7252bcbf76e2f2a403cb1732 Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 463a69e878d891b897fe70af15434615baf6a2e9)
2016-01-08Fix description for TC037 and TC038Ana C3-44/+68
Update rst files for TC037 and TC038 for latest template format. Added TC037 and TC038 to index of test cases in 03-list-of-tcs. JIRA: - Change-Id: I32657b564ff1c393f8048a74e676b3f5791d6d0d Signed-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 6e0daa70bfe87253da6658433f11313475e5e204)
2016-01-08Fix glance yardstick-image cmd in installation docKristian Hunt1-1/+2
Glance image-create command should use --os-image-api-version 1 flag for the is-public argument. JIRA: YARDSTICK-68 Change-Id: I43a60a7dac186ae7c586aa98b6e5de9821caee60 Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com> (cherry picked from commit 136762959413c038d2527c11efa8904c135f9278)
2016-01-08Add test case description and task file for TC038Jo¶rgen Karlsson2-0/+171
JIRA: YARDSTICK-214 Change-Id: I3a2358e8c36755a684f09524bd6fc8af9bf43f60 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit c27b74456831c0f7c827b4840649a898d66cd52f)
2016-01-08Add test case description and task file for TC037Jo¶rgen Karlsson2-0/+171
JIRA: YARDSTICK-213 Change-Id: I3f1f521da6a824c96cbc8712a098c61ff6b0540d Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 605d252b9c72c0d41a720c45774d4481bb902c77)
2016-01-08InfluxDB dispatcher add more tagsQiLiang3-3/+29
- add runner_id tag - add test case name tag - add task_id tag JIRA: YARDSTICK-212 Change-Id: I75c27e23942a6e2189019e94bfe8026a5fd67621 Signed-off-by: QiLiang <liangqi1@huawei.com> Conflicts: yardstick/dispatcher/influxdb.py (cherry picked from commit 65e32e513544392ce84c190434d23281b5c1afd2) Change-Id: Idcd582f96f2813e04d80a8c0677d9124b373fb48
2016-01-08update docs build dir names in .gitignoreRyota MIBU1-1/+2
Change-Id: Id4b1e2e87ac51b67f392417357b2693c76def457 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-01-08Initial InfluxDB dispatcherQiLiang6-0/+431
Supports: - Basic influxDB write with timestamp - Add general result format func - Add UT TODO: - refine database schema (e.g. add more tags) plan in another patch JIRA: YARDSTICK-212 Change-Id: I1526568bbd850f1343135420ec59ed1b833bb99f Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 99ba990d4a01c0f3f4837f11a24b695f4a2393d2)
2016-01-08Structure test case descriptionsAna C14-133/+717
This commit structures the test case descriptions. The file index.rst lists the subsequent chapters. 01-introduction.rst contains an overview of the project and deliverables. 02-methodology.rst describes the methodology for the generic test cases. 03-list-of-tcs.rst contains a list of merged generic test cases and a sub-chapter for the feature test cases. Glossary extracts definitions and abbreviations. TC001, TC002, TC008, TC009, TC010, TC012 were adapted to work for pdf. Template testcase_description_v2_template.rst was adapted to work for pdf. Change-Id: Ia11e27e5d508f1a784e2a412b50739e32b13797f Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 00296cd85133d4f38a510e7ad3ecb0ff3fe4d56c)
2016-01-06Fix ApexLake setupVincenzo Riccobene3-10/+10
Changes the directories where to store apexlake data in order to allow a non super user to run the setup. JIRA: YARDSTICK-35 Change-Id: I871b2ab793183887c86666bfe2241e3c26b4f427 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-06Fix some small things in ApexLake testsVincenzo Riccobene6-213/+125
JIRA: YARDSTICK-35 Change-Id: I280365dd64d2f6c00befb984acd0d4c9ca2645bd Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-06Add yardstick daily suite config files for CI PODsFatih Degirmenci5-0/+70
opnfv-jump-1: apex stable/brahmaputra branch intel-pod5: joid stable/brahmaputra branch intel-pod2: apex master branch intel-pod6: joid master branch intel-pod8: compass master branch Change-Id: Ia659e10525863ee11854a266df58449c625c7f7c Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-01-04Remove data manager from ApexLakeVincenzo Riccobene1-10/+10
Since the InfluxBD dispatcher is used to store the data, the apexlake data manager is not required anymore JIRA: YARDSTICK-35 Change-Id: I8d85161814d83a991ee149532af0437e9c248445 Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-04Add test suite file for ZTE-NJ LAB.wu.zhihui1-0/+14
JIRA: yardstick-210 Change-Id: Ib888b654e742761a8be1b263f643950ea02380f8 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2015-12-31Add Dummy context and scenario typeQiLiang9-1/+172
Dummy Context Usage: - if no context specified in the task file then automatically use Dummy Context - or specify the context with type Dummy in the task file, like context: type: Dummy Note: context without type name default use Heat Context. (e.g. samples/fio.yaml) JIRA: - Change-Id: I7f798a7260bdd6ac24902e2c835a3b121319fd8c Signed-off-by: QiLiang <liangqi1@huawei.com>