aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2016-01-14Add template for test results reportAna C1-0/+71
This change is a proposal for a report for yardstick test case reesults. One report for all the executed tests, summarizing the results and the labs where the tests were executed. JIRA: - Change-Id: I7cdfdc82d6ee07d2b9da426f33ce34b86362b5b4 Signed-off-by: Ana C <ana.cunha@ericsson.com>
2016-01-14Fix small bugs for running Apexlake on Montreal testbeduser12-123/+125
JIRA: YARDSTICK-219 Change-Id: I5f403e6c922f5e6ea790dc9cdb589cbc98e66ded Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local>
2016-01-13ci: add influxdb target optionsJo¶rgen Karlsson1-5/+16
Change-Id: I50cbbf4d2fe59d688a4951cc8bec3362b098adcb JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-13Fix flake8 errorsJo¶rgen Karlsson16-45/+39
Change-Id: I14f21092f5e97abf0629a92a27062846a6d3130b JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-12Fix minor format details in tc descriptionsAna C3-28/+58
This change fixes minor formating in TC025, remove one extra line in TC028 and update 03-list-of-tcs. The formating caused the pdf to fail. Change-Id: I304335277b1fbc33b10d9a07245ebeef0612fc80 Signed-off-by: Ana C <ana.cunha@ericsson.com>
2016-01-12Rename tc019/tc025 & fix description for tc005QiLiang4-2/+4
Added tc019 and tc025 to index of test cases in 03-list-of-tcs. JIRA: - Change-Id: I02696dc408d2d5c20becba29c49b3cff2a7049a9 Signed-off-by: QiLiang <liangqi1@huawei.com>
2016-01-12Add test case description for TC028-kvmQiLiang2-0/+67
JIRA: YARDSTICK-188 Change-Id: I16f8c5ac3a3997640ce96a77984c4dbe9ccb2804 Signed-off-by: QiLiang <liangqi1@huawei.com>
2016-01-12Merge "Add test case description and task file for TC025"qi liang2-0/+142
2016-01-12Merge "Add test case description and task file for TC019"qi liang2-0/+167
2016-01-12Merge "Workround for openstack nova bug"QiLiang1-2/+21
2016-01-12Workround for openstack nova bugQiLiang1-2/+21
Notes: if placement_groups policy is "availability" and > 2 servers in this group may still have this issue. JIRA: YARDSTICK-200 Signed-off-by: QiLiang <liangqi1@huawei.com>
2016-01-12Include vTC overview in Yardstick documentationAna C10-124/+198
This change includes the vTC overview in Yardstick configguide, the original vTC/README has been renamed to 04-vTC-overview and added in the configguide. The vTC/abbreviations is deleted, all included in glossary.rst Index and 03-list-of-tcs are updated. JIRA:- Change-Id: Ifc5cf1cc258dee6743af189f347e8adbbec6a32f Signed-off-by: Ana C <ana.cunha@ericsson.com>
2016-01-11Implementation of opnfv-yardstick-tc021 in YardstickVincenzo Riccobene4-0/+319
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: I0554d0a211392902207ba9ceccf0b98dc3c2cdf1 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-11Add vTC daily+weekly test suitesJo¶rgen Karlsson2-0/+32
Change-Id: Id557b5ef4d686da041b8097e390c7e5b563a0c3c JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-11Implementation of opnfv-yardstick-tc020 in YardstickVincenzo Riccobene4-0/+299
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ibbba1d9864e788fb6c81cc00c503e9f69e885651 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-11Implementation of yardstick-tc007 in YardstickVincenzo Riccobene4-0/+330
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ifa2555336098e68d0fad8045e2f759aed587ad92 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-11Add apexlake package pathJo¶rgen Karlsson2-0/+7
Workaround/hack to be able to use apexlake packages modules and run unit tests without having to install apexlake. Change-Id: Ibfa34f56bdb1cafa60d2090e16544a81badc2e85 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-11IPv6 connectivity between nodes on the tenant networkkubi3-0/+95
Test case yaml and .rst file for ipv6 Change-Id: Ib9a554dc05445023687efb0ac608c7cbd0da4c21 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-11Test case to measure processing speed(score)kubi3-0/+102
run unixbench to get the score of processing performance This patch includes the .yaml for the test case and the .rst for test case description. JIRA:YARDSTICK-116 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Ic75119d1db19dacc57edfa4dce607e0e29ae8db4 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-11Implementation of yardstick-tc006 in YardstickVincenzo Riccobene7-0/+299
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Iabde8fa63f346cf1e4a02691f22d1761de79a239 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-11Test Case 040 Verify Parser Yang-to-Toscakubi3-0/+83
running Parser Yang-to-Tosca module as a tool, validating output against expected outcome. this patch is about task yaml and rst for test case description. JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Id254c5cf45de33b023bef889a58044a21ed0db43 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-11Add missing yaml schema for TC037 and TC038Jo¶rgen Karlsson2-0/+4
Change-Id: I299eb5a94afb8a29dee89938ff1d7b1bb7f43f3b JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-11Add test case description and task file for TC005QiLiang13-0/+141
JIRA: YARDSTICK-93 Change-Id: I74adef0e6bae52a7080479d7054a92342f7324a7 Signed-off-by: QiLiang <liangqi1@huawei.com>
2016-01-10Support run cyclictest on BareMetalQiLiang5-95/+227
JIRA: YARDSTICK-122 Change-Id: I8144215059a9abea08314a4c1e6a733dcdf0df53 Signed-off-by: QiLiang <liangqi1@huawei.com>
2016-01-10The secondi HA test case-shutdown controllerwym_libra21-83/+496
1) add "attacker_baremetal.py" for fault injection 2) modify the monitor to excute on remote node after ssh connection 3) move all shell scripts together JIRA: YARDSTICK-182 Change-Id: Ibb9dc908224ddb8b99a0140b75c1a046503f6dfb Signed-off-by: wym_libra <yimin.wang@huawei.com>
2016-01-10Rewrite the HA test case (2)wym_libra15-230/+565
idea: refact the Monitor class in old file "monitor.py" with the base class and sub-class. detail: 1) the BaseMonitor is the base class of other monitor 2) each monitor run in independent process 3) there are two monitor("openstack-cmd" and "process") for the first test case 4) MonitorMgr class used to manager monitor process JIRA: YARDSTICK-149 Change-Id: I2eede94481f740812212e6cb673d175b5f543c15 Signed-off-by: wym_libra <yimin.wang@huawei.com>
2016-01-09running Parser Yang-to-Tosca module as a toolkubi12-1/+1078
with jnon and fatih's help, new docker image has been uploaded so this part is about parser verify validating output against expected outcome. Change-Id: If50d241a5338888f14fd11a752dc72678e0c569b JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-08Add TC037 to POD test suitesJo¶rgen Karlsson10-0/+20
JIRA: YARDSTICK-213 Change-Id: I55ff36b02a0d0e0334505d68d361b8a14d36063c Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-08support for ipv6kubi11-57/+588
JIRA:YARDSTICK-187 Change-Id: I1cecd400b4449a09d22d43f4a42e889f00dd4fe7 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-08support lxml for parser in docker containerkubi1-0/+2
this is part1 of patch, this part is to define dockefile,and wait a docker image to be uploaded JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Ia206c54ab2d964a94753abef0767b74d26259081
2016-01-08update docs build dir names in .gitignoreRyota MIBU1-1/+2
Change-Id: Id4b1e2e87ac51b67f392417357b2693c76def457 Signed-off-by: Ryota MIBU <r-mibu@cq.jp.nec.com>
2016-01-07Rename folders in yardstick/docsAna C19-0/+0
Adapt the naming of the folders under yardstick/docs to the naming adopted by the release documentation defined by opnfvdocs. JIRA: - Change-Id: Icc57720d585abbbf7252bcbf76e2f2a403cb1732 Signed-off-by: Ana C <ana.cunha@ericsson.com>
2016-01-07Fix description for TC037 and TC038Ana C3-44/+68
Update rst files for TC037 and TC038 for latest template format. Added TC037 and TC038 to index of test cases in 03-list-of-tcs. JIRA: - Change-Id: I32657b564ff1c393f8048a74e676b3f5791d6d0d Signed-by: Ana C <ana.cunha@ericsson.com>
2016-01-07Fix glance yardstick-image cmd in installation docKristian Hunt1-1/+2
Glance image-create command should use --os-image-api-version 1 flag for the is-public argument. JIRA: YARDSTICK-68 Change-Id: I43a60a7dac186ae7c586aa98b6e5de9821caee60 Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
2016-01-07Add test case description and task file for TC038Jo¶rgen Karlsson2-0/+171
JIRA: YARDSTICK-214 Change-Id: I3a2358e8c36755a684f09524bd6fc8af9bf43f60 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-07Add test case description and task file for TC037Jo¶rgen Karlsson2-0/+171
JIRA: YARDSTICK-213 Change-Id: I3f1f521da6a824c96cbc8712a098c61ff6b0540d Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2016-01-07Structure test case descriptionsAna C14-133/+717
This commit structures the test case descriptions. The file index.rst lists the subsequent chapters. 01-introduction.rst contains an overview of the project and deliverables. 02-methodology.rst describes the methodology for the generic test cases. 03-list-of-tcs.rst contains a list of merged generic test cases and a sub-chapter for the feature test cases. Glossary extracts definitions and abbreviations. TC001, TC002, TC008, TC009, TC010, TC012 were adapted to work for pdf. Template testcase_description_v2_template.rst was adapted to work for pdf. Change-Id: Ia11e27e5d508f1a784e2a412b50739e32b13797f Signed-off-by: Ana C <ana.cunha@ericsson.com>
2016-01-07InfluxDB dispatcher add more tagsQiLiang3-3/+29
- add runner_id tag - add test case name tag - add task_id tag JIRA: YARDSTICK-212 Change-Id: I75c27e23942a6e2189019e94bfe8026a5fd67621 Signed-off-by: QiLiang <liangqi1@huawei.com> Conflicts: yardstick/dispatcher/influxdb.py
2016-01-07Initial InfluxDB dispatcherQiLiang6-0/+431
Supports: - Basic influxDB write with timestamp - Add general result format func - Add UT TODO: - refine database schema (e.g. add more tags) plan in another patch JIRA: YARDSTICK-212 Change-Id: I1526568bbd850f1343135420ec59ed1b833bb99f Signed-off-by: QiLiang <liangqi1@huawei.com>
2016-01-06Fix ApexLake setupVincenzo Riccobene3-10/+10
Changes the directories where to store apexlake data in order to allow a non super user to run the setup. JIRA: YARDSTICK-35 Change-Id: I871b2ab793183887c86666bfe2241e3c26b4f427 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-06Fix some small things in ApexLake testsVincenzo Riccobene6-213/+125
JIRA: YARDSTICK-35 Change-Id: I280365dd64d2f6c00befb984acd0d4c9ca2645bd Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-06Add yardstick daily suite config files for CI PODsFatih Degirmenci5-0/+70
opnfv-jump-1: apex stable/brahmaputra branch intel-pod5: joid stable/brahmaputra branch intel-pod2: apex master branch intel-pod6: joid master branch intel-pod8: compass master branch Change-Id: Ia659e10525863ee11854a266df58449c625c7f7c Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-01-05Add test case description and task file for TC019wym_libra2-0/+167
Add test case description for Control node-OpenStack service down (TC019) and test case .yaml task file. ** Please note that the SLA value has not yet been determined. ** JIRA: YARDSTICK-135 Change-Id: Id512159034929dc197d2c7fdf6cc672ecddfb996 Signed-off-by: wym_libra <yimin.wang@huawei.com>
2016-01-04Remove data manager from ApexLakeVincenzo Riccobene1-10/+10
Since the InfluxBD dispatcher is used to store the data, the apexlake data manager is not required anymore JIRA: YARDSTICK-35 Change-Id: I8d85161814d83a991ee149532af0437e9c248445 Signed-off-by: Vincenzo Riccobene <vincenzo.m.riccobene@intel.com> Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2016-01-04Add test suite file for ZTE-NJ LAB.wu.zhihui1-0/+14
JIRA: yardstick-210 Change-Id: Ib888b654e742761a8be1b263f643950ea02380f8 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2015-12-31Add Dummy context and scenario typeQiLiang9-1/+172
Dummy Context Usage: - if no context specified in the task file then automatically use Dummy Context - or specify the context with type Dummy in the task file, like context: type: Dummy Note: context without type name default use Heat Context. (e.g. samples/fio.yaml) JIRA: - Change-Id: I7f798a7260bdd6ac24902e2c835a3b121319fd8c Signed-off-by: QiLiang <liangqi1@huawei.com>
2015-12-28Fix small things for integration of ApexLake with YardstickVincenzo Riccobene21-122/+186
Changes small things required for the integration of ApexLake with Yardstick JIRA: YARDSTICK-35 Change-Id: I6f92d738cb80e34108b76f900382e9c05ecabe70 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-27Complete all the code and files required to run ApexLakeVincenzo Riccobene25-0/+2160
Inludes the last files required by ApexLake for a complete execution. JIRA: YARDSTICK-35 Change-Id: I4315b8081554c8fad98c8fa72f9e2796ecb9360b Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>
2015-12-26add scenario and sample file for Unixbench.kubi5-0/+413
JIRA:YARDSTICK-184 Change-Id: Iedd4a3708e08305b1c8fa7a8e1766ceef03ab8bb Signed-off-by: kubi <jean.gaoliang@huawei.com>
2015-12-23Add some other tests to ApexLakeVincenzo Riccobene4-0/+238
Include some other tests to reach the required coverage JIRA: YARDSTICK-35 Change-Id: Ie47b0ca9451d4dcc0f5e31ba98f8c38923689475 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com>