summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-01-12Fix minor format details in tc descriptionsAna C3-28/+58
This change fixes minor formating in TC025, remove one extra line in TC028 and update 03-list-of-tcs. The formating caused the pdf to fail. Change-Id: I304335277b1fbc33b10d9a07245ebeef0612fc80 Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 5c4c8667e0c0a8e039d7682f235b022f39149d56)
2016-01-12Rename tc019/tc025 & fix description for tc005QiLiang4-2/+4
Added tc019 and tc025 to index of test cases in 03-list-of-tcs. JIRA: - Change-Id: I02696dc408d2d5c20becba29c49b3cff2a7049a9 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 25095fb4e6d6a0e71581eee18f50c7d61f6a270d)
2016-01-12Add test case description for TC028-kvmQiLiang2-0/+67
JIRA: YARDSTICK-188 Change-Id: I16f8c5ac3a3997640ce96a77984c4dbe9ccb2804 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit ef353b91b2527580a642da561a387d67b71e753d)
2016-01-12Add test case description and task file for TC025wym_libra2-0/+142
Add test case description for HA of OpenStack Controll Node abnormally shutdown (TC025) and the sample .yaml task file. ** Please note that the SLA value has not yet been determined. ** JIRA: YARDSTICK-135 Change-Id: I70f1afb0c9cfa5446aac08b7b13e543a9ec20898 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 83d895e535b700790497429ac6cbd46fb0fef9e5)
2016-01-12Add test case description and task file for TC019wym_libra2-0/+167
Add test case description for Control node-OpenStack service down (TC019) and test case .yaml task file. ** Please note that the SLA value has not yet been determined. ** JIRA: YARDSTICK-135 Change-Id: Id512159034929dc197d2c7fdf6cc672ecddfb996 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 32b39d0f576dc5c71678fd0b6b8feab6f2173939)
2016-01-12Workround for openstack nova bugQiLiang1-2/+21
Notes: if placement_groups policy is "availability" and > 2 servers in this group may still have this issue. JIRA: YARDSTICK-200 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 10e55c026879912a36247f8958c954cb7521f9e5) Change-Id: I4b56ea63fc1adae6985c0d5101359299839cd86c
2016-01-12Include vTC overview in Yardstick documentationAna C10-124/+198
This change includes the vTC overview in Yardstick configguide, the original vTC/README has been renamed to 04-vTC-overview and added in the configguide. The vTC/abbreviations is deleted, all included in glossary.rst Index and 03-list-of-tcs are updated. JIRA:- Change-Id: Ifc5cf1cc258dee6743af189f347e8adbbec6a32f Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 12521edea1e40e73e2fb04f4f230760de324521b)
2016-01-11Implementation of opnfv-yardstick-tc021 in YardstickVincenzo Riccobene4-0/+319
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: I0554d0a211392902207ba9ceccf0b98dc3c2cdf1 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit e749d09788edbd1040dabb082e13bd1a1cbc3a7a)
2016-01-11Add vTC daily+weekly test suitesJo¶rgen Karlsson2-0/+32
Change-Id: Id557b5ef4d686da041b8097e390c7e5b563a0c3c JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 2b0c67e7b5984e200b92c134510e7e112cf30a35)
2016-01-11Implementation of opnfv-yardstick-tc020 in YardstickVincenzo Riccobene4-0/+299
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ibbba1d9864e788fb6c81cc00c503e9f69e885651 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit 884e58ab48d0dcdc5e57b87ea181c0a4b8151fc8)
2016-01-11Implementation of yardstick-tc007 in YardstickVincenzo Riccobene4-0/+330
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ifa2555336098e68d0fad8045e2f759aed587ad92 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit bde7eae17a1fc9ec163451b8d62825daa2fec297)
2016-01-11Add apexlake package pathJo¶rgen Karlsson2-0/+7
Workaround/hack to be able to use apexlake packages modules and run unit tests without having to install apexlake. Change-Id: Ibfa34f56bdb1cafa60d2090e16544a81badc2e85 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 5da3bbf2eb241b4550b8397b767123698bc3432a)
2016-01-11Implementation of yardstick-tc006 in YardstickVincenzo Riccobene7-0/+299
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Iabde8fa63f346cf1e4a02691f22d1761de79a239 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit 6f6ed9af46d616b073481799c157ed3bc88a8810)
2016-01-11IPv6 connectivity between nodes on the tenant networkkubi3-0/+95
Test case yaml and .rst file for ipv6 Change-Id: Ib9a554dc05445023687efb0ac608c7cbd0da4c21 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-11Test case to measure processing speed(score)kubi3-0/+102
run unixbench to get the score of processing performance This patch includes the .yaml for the test case and the .rst for test case description. JIRA:YARDSTICK-116 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Ic75119d1db19dacc57edfa4dce607e0e29ae8db4 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit db643f9a2a416c0888931a347488a51264350c8f)
2016-01-11Test Case 040 Verify Parser Yang-to-Toscakubi3-0/+83
running Parser Yang-to-Tosca module as a tool, validating output against expected outcome. this patch is about task yaml and rst for test case description. JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Id254c5cf45de33b023bef889a58044a21ed0db43 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit 45e85a7f6df63ca4ca702f519ca19e5bcbb1bc23)
2016-01-11Add missing yaml schema for TC037 and TC038Jo¶rgen Karlsson2-0/+4
Change-Id: I299eb5a94afb8a29dee89938ff1d7b1bb7f43f3b JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 7766def60d167a55e4a0fbbb3d94e5bfe6241e08)
2016-01-11Add test case description and task file for TC005QiLiang13-0/+141
JIRA: YARDSTICK-93 Change-Id: I74adef0e6bae52a7080479d7054a92342f7324a7 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 738fb0942c39e5f1ecad87ae9dd776f1019d2491)
2016-01-10Support run cyclictest on BareMetalQiLiang5-95/+227
JIRA: YARDSTICK-122 Change-Id: I8144215059a9abea08314a4c1e6a733dcdf0df53 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit a33f57371c740e0ab749bfffa4d31c08ef5c5b74)
2016-01-10The secondi HA test case-shutdown controllerwym_libra21-83/+496
1) add "attacker_baremetal.py" for fault injection 2) modify the monitor to excute on remote node after ssh connection 3) move all shell scripts together JIRA: YARDSTICK-182 Change-Id: Ibb9dc908224ddb8b99a0140b75c1a046503f6dfb Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 4f4edd840823ff6a0151e3f5220241183e27e560)
2016-01-10Rewrite the HA test case (2)wym_libra15-230/+565
idea: refact the Monitor class in old file "monitor.py" with the base class and sub-class. detail: 1) the BaseMonitor is the base class of other monitor 2) each monitor run in independent process 3) there are two monitor("openstack-cmd" and "process") for the first test case 4) MonitorMgr class used to manager monitor process JIRA: YARDSTICK-149 Change-Id: I2eede94481f740812212e6cb673d175b5f543c15 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 2733defda816a84d2b9c2e361a5970b9de4923f4)
2016-01-09running Parser Yang-to-Tosca module as a toolkubi12-1/+1078
with jnon and fatih's help, new docker image has been uploaded so this part is about parser verify validating output against expected outcome. Change-Id: If50d241a5338888f14fd11a752dc72678e0c569b JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit d93f6ca5bf0d4f22ec0fd90eac1bf8b9c09db820)
2016-01-08Add TC037 to POD test suitesJo¶rgen Karlsson10-0/+20
JIRA: YARDSTICK-213 Change-Id: I55ff36b02a0d0e0334505d68d361b8a14d36063c Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 45b1cc64209dec07475e5263469328231c524aa7)
2016-01-08support lxml for parser in docker containerkubi1-0/+2
this is part1 of patch, this part is to define dockefile,and wait a docker image to be uploaded JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Ia206c54ab2d964a94753abef0767b74d26259081 (cherry picked from commit e2027b26582a839dc5c25a54fc5621695b9026c0)
2016-01-08support for ipv6kubi11-57/+588
JIRA:YARDSTICK-187 Change-Id: I1cecd400b4449a09d22d43f4a42e889f00dd4fe7 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit cd80b44f3fd9b8c9e2afc51bc67d7a5cf34fb1c6)
2016-01-08Rename folders in yardstick/docsAna C19-0/+0
Adapt the naming of the folders under yardstick/docs to the naming adopted by the release documentation defined by opnfvdocs. JIRA: - Change-Id: Icc57720d585abbbf7252bcbf76e2f2a403cb1732 Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 463a69e878d891b897fe70af15434615baf6a2e9)
2016-01-08Fix description for TC037 and TC038Ana C3-44/+68
Update rst files for TC037 and TC038 for latest template format. Added TC037 and TC038 to index of test cases in 03-list-of-tcs. JIRA: - Change-Id: I32657b564ff1c393f8048a74e676b3f5791d6d0d Signed-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 6e0daa70bfe87253da6658433f11313475e5e204)
2016-01-08Fix glance yardstick-image cmd in installation docKristian Hunt1-1/+2
Glance image-create command should use --os-image-api-version 1 flag for the is-public argument. JIRA: YARDSTICK-68 Change-Id: I43a60a7dac186ae7c586aa98b6e5de9821caee60 Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com> (cherry picked from commit 136762959413c038d2527c11efa8904c135f9278)
2016-01-08Add test case description and task file for TC038Jo¶rgen Karlsson2-0/+171
JIRA: YARDSTICK-214 Change-Id: I3a2358e8c36755a684f09524bd6fc8af9bf43f60 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit c27b74456831c0f7c827b4840649a898d66cd52f)
2016-01-08Add test case description and task file for TC037Jo¶rgen Karlsson2-0/+171
JIRA: YARDSTICK-213 Change-Id: I3f1f521da6a824c96cbc8712a098c61ff6b0540d Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 605d252b9c72c0d41a720c45774d4481bb902c77)
2016-01-08InfluxDB dispatcher add more tagsQiLiang3-3/+29
- add runner_id tag - add test case name tag - add task_id tag JIRA: YARDSTICK-212 Change-Id: I75c27e23942a6e2189019e94bfe8026a5fd67621 Signed-off-by: QiLiang <liangqi1@huawei.com> Conflicts: yardstick/dispatcher/influxdb.py (cherry picked from commit 65e32e513544392ce84c190434d23281b5c1afd2) Change-Id: Idcd582f96f2813e04d80a8c0677d9124b373fb48
2016-01-08update docs build dir names in .gitignoreRyota MIBU1-1/+2
Change-Id: Id4b1e2e87ac51b67f392417357b2693c76def457 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-01-08Initial InfluxDB dispatcherQiLiang6-0/+431
Supports: - Basic influxDB write with timestamp - Add general result format func - Add UT TODO: - refine database schema (e.g. add more tags) plan in another patch JIRA: YARDSTICK-212 Change-Id: I1526568bbd850f1343135420ec59ed1b833bb99f Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 99ba990d4a01c0f3f4837f11a24b695f4a2393d2)
2016-01-08Structure test case descriptionsAna C14-133/+717
This commit structures the test case descriptions. The file index.rst lists the subsequent chapters. 01-introduction.rst contains an overview of the project and deliverables. 02-methodology.rst describes the methodology for the generic test cases. 03-list-of-tcs.rst contains a list of merged generic test cases and a sub-chapter for the feature test cases. Glossary extracts definitions and abbreviations. TC001, TC002, TC008, TC009, TC010, TC012 were adapted to work for pdf. Template testcase_description_v2_template.rst was adapted to work for pdf. Change-Id: Ia11e27e5d508f1a784e2a412b50739e32b13797f Signed-off-by: Ana C <ana.cunha@ericsson.com> (cherry picked from commit 00296cd85133d4f38a510e7ad3ecb0ff3fe4d56c)
2016-01-06Fix ApexLake setupVincenzo Riccobene3-10/+10
Changes the directories where to store apexlake data in order to allow a non super user to run the setup. JIRA: YARDSTICK-35 Change-Id: I871b2ab793183887c86666bfe2241e3c26b4f427 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-06Fix some small things in ApexLake testsVincenzo Riccobene6-213/+125
JIRA: YARDSTICK-35 Change-Id: I280365dd64d2f6c00befb984acd0d4c9ca2645bd Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-06Add yardstick daily suite config files for CI PODsFatih Degirmenci5-0/+70
opnfv-jump-1: apex stable/brahmaputra branch intel-pod5: joid stable/brahmaputra branch intel-pod2: apex master branch intel-pod6: joid master branch intel-pod8: compass master branch Change-Id: Ia659e10525863ee11854a266df58449c625c7f7c Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-01-04Remove data manager from ApexLakeVincenzo Riccobene1-10/+10
Since the InfluxBD dispatcher is used to store the data, the apexlake data manager is not required anymore JIRA: YARDSTICK-35 Change-Id: I8d85161814d83a991ee149532af0437e9c248445 Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-04Add test suite file for ZTE-NJ LAB.wu.zhihui1-0/+14
JIRA: yardstick-210 Change-Id: Ib888b654e742761a8be1b263f643950ea02380f8 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2015-12-31Add Dummy context and scenario typeQiLiang9-1/+172
Dummy Context Usage: - if no context specified in the task file then automatically use Dummy Context - or specify the context with type Dummy in the task file, like context: type: Dummy Note: context without type name default use Heat Context. (e.g. samples/fio.yaml) JIRA: - Change-Id: I7f798a7260bdd6ac24902e2c835a3b121319fd8c Signed-off-by: QiLiang <liangqi1@huawei.com>
2015-12-28Fix small things for integration of ApexLake with YardstickVincenzo Riccobene21-122/+186
Changes small things required for the integration of ApexLake with Yardstick JIRA: YARDSTICK-35 Change-Id: I6f92d738cb80e34108b76f900382e9c05ecabe70 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-27Complete all the code and files required to run ApexLakeVincenzo Riccobene25-0/+2160
Inludes the last files required by ApexLake for a complete execution. JIRA: YARDSTICK-35 Change-Id: I4315b8081554c8fad98c8fa72f9e2796ecb9360b Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-26add scenario and sample file for Unixbench.kubi5-0/+413
JIRA:YARDSTICK-184 Change-Id: Iedd4a3708e08305b1c8fa7a8e1766ceef03ab8bb Signed-off-by: kubi <jean.gaoliang@huawei.com>
2015-12-23Add some other tests to ApexLakeVincenzo Riccobene4-0/+238
Include some other tests to reach the required coverage JIRA: YARDSTICK-35 Change-Id: Ie47b0ca9451d4dcc0f5e31ba98f8c38923689475 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-23Add Benchmarking Unit to ApexLakeVincenzo Riccobene2-0/+751
Includes benchmarking unit to run benchmarks in ApexLake Also includes tests. JIRA: YARDSTICK-35 Change-Id: I67c62efd6cbe0883963e8c4ddc86d003b1d355ac Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-23Add Deployment Unit to ApexLakeVincenzo Riccobene2-0/+391
Includes the deployment unit module used for deployment by Apexlake Also includes tests JIRA: YARDSTICK-35 Change-Id: Ia5c89f3cd03d53b1fc4e418215955fd91aff9d03 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-23Add API to configure and execute ApexLakeVincenzo Riccobene3-0/+284
Add python module providing API for Yardstick to configure and execute ApexLake and the test cases for the virtual Traffic Classifier. Includes documentation. JIRA: YARDSTICK-215 Change-Id: I87af59c715d789ac78c836123e9ed3d8e0036eec Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-21Add test case description and task file for TC010Kristian Hunt2-0/+103
Add test case description for Memory Latency (TC010) and test case .yaml task file. JIRA: YARDSTICK-94 Change-Id: If7fb120868c9901fe097f310aa249e1fbc8a94ee Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
2015-12-21Fix lmbench memory read latency stop sizeKristian Hunt2-5/+5
Stop size parameter's type should be float to allow for performing measurements on only L1 and L2 cache if needed. JIRA: - Change-Id: Ibc4d052c343e9dcccf6101c6c949172bb5a0f9e1 Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
2015-12-21To avoid breaking tests when monitor is setPer Holmgren2-2/+2
Two runners, Arithemic and Sequence, broke running tests even if SLA "monitor" was set. Changed these two runners to work in similar fashion as the other two, i.e. that only None can break. "assert" still asserts, and "monitor" just logs but then continues. Change-Id: Ic441761cad8747e5ecfcd0babe719c1aa23981e7 JIRA: -