summaryrefslogtreecommitdiffstats
path: root/tests/opnfv
AgeCommit message (Collapse)AuthorFilesLines
2016-03-23Fix configuration files according to the last working configuration in ↵user4-35/+35
Montreal testbed Change-Id: Icd4d56de8bd60b2b4333459ce8669363ba54a33b Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local> (cherry picked from commit cd5baa32609687c3ae8acd4b19dbb10cd0bd47ff)
2016-03-23Added a Yardstick test scenario for the OPNFV-Playground development CI pipelineJonas Bjurel1-0/+22
Change-Id: I6d2e825c1080bb91c8b0f91ab0f37ce66462bcb9 Signed-off-by: Jonas Bjurel <jonas.bjurel@ericsson.com> (cherry picked from commit 3780f6898ddb91928d4a7c15b8bd032da17822f3)
2016-02-23ipv6-bug-fix: update physical pod yaml configurekubi1-2/+3
due to the configure of huawei sc physical pod has been changed, ipv6 testing failed, so i update the pod.yaml in yardstick to make it run successfully again JIRA: YARDSTICK-186 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit 790e54ca0806f4b826fbe77f260f1b3127324507) Change-Id: I883608e49aec5805a41ce20085504aebb0999eb9
2016-02-16Add test suite for ericsson-virtual1 bladeFatih Degirmenci1-0/+22
Change-Id: I6c22a32fd3197a5475ee4f41db946bd78b08dfa0 Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com> (cherry picked from commit 2fb2e9e9dc63707fa714af5bea6dce8e829cad9b)
2016-02-08bug fix: huawei sc lab virtual pod task failkubi4-8/+0
opnfv_yardstick_tc027.yaml 's configure file is written for physical pod it shouldn't be added into virtual pod task, so remove it. otherwise, task will failed Change-Id: Ic2f03c6522cace32426a7aade1da56ed2c1766d1 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit ab99b83b03f3583c51c03fc821d48b77e2bd2273)
2016-02-08add precondition checkkubi1-0/+3
as we discussed yersterday, for daily jenkins task, i have a new idea, i add a precondition check and a key parameter in test case, if environment info(eg. "DEPLOY_SCENARIO") meet the preconditon which was defined in test case , this test case will run, if not meet, this test case will skip. and default is allow all test case to run, so this patch will not influence existing test case. any comments are welcomed Change-Id: I4300ac58994d51c0ddb4dd6d58b7191f796ddcee Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit ff5cb9501b155e07fe75f03062217270b9745131)
2016-01-30Add test suites for huawei lab virtual deployQiLiang3-0/+72
JIRA: - Change-Id: Ibc44bf11fb8bef4878ec57187877624a557f9937 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 556a2f2226391043eee47acb5163adfc8342e157)
2016-01-28Add test suite for huawei lab virtual deployQiLiang1-0/+24
JIRA: - Change-Id: I0cd58a2acb0a2a55431eebd6b4adcde95d50d7bc Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 22e55a637eb9fe70fbb378494242f5f6f196f3c0)
2016-01-19Move the test case of TC025 to the test cases folderwym_libra1-0/+43
Change-Id: Ia3760a4fcc17f810940240d1778939333e8ffdc6 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit c8ea364de2f2d7bb4703f4beb86897c23dc88c39)
2016-01-18Create weekly Jenkins Job for Yardstick run in Huawei lab in Santa Clarakubi1-0/+26
Test Case 040 :parser is added into weekly yaml Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: I0cb4a9e273b5cac55b9a7a278ea17b1ad78d1ac6
2016-01-16modify sc lab pod yaml as real configurekubi1-2/+1
Change-Id: I6587794b7206cb3d5f13b6c448670d1c97ecd596 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit cfbefd9ad48e07a1890e022e94cbae117e04f87a)
2016-01-16enable ipv6 test case in sc labkubi2-1/+3
Change-Id: I4609fcb4427413fd6cde435f7bd062c9dde61949 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-15Update test suite files.Jo¶rgen Karlsson10-20/+60
Added TC 10, 11 and 14. Removed TC 1 as it is already included in TC 37 Change-Id: Iea483c4a26c657984769400f2949ca300c2504bd Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 2a2ebe6b1ea2ff317f4a3ca6a8e8fab811350eae)
2016-01-15fix some bug in ipv6 to make it run in cikubi1-3/+10
JIRA:YARDSTICK-187 Change-Id: Ia15d17afdef145f7b230a8a4d25a61eed5cdfd76 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-15Add test case description and task file for TC011wym_libra1-0/+44
Add test case description for Packet delay variation between VMs (TC011) and test case .yaml task file. ** Please note that the SLA value has not yet been determined. ** Change-Id: I68a374224946d46c173ad477c14cb79d573b1eee Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 09c6f91228759e22a08bd9344962d65c1818e6b3)
2016-01-15HeatContext model update to match heat code updateQiLiang9-10/+10
In Heat Liberty release OS::Nova::Server will always use the user pre-configured in the image (e.g. "fedora" for stock Fedora cloud images, "ubuntu" for stock Ubuntu cloud images, "cloud-user" for stock CentOS cloud images etc) Change all ec2-user -> ubuntu Add admin-user in Heat model for backwards compatibility. Refer below links for detalis: https://etherpad.opnfv.org/p/yardstick_release_b_troubleshooting https://github.com/openstack/heat/commit/e423bec7f10b0f5d07f05d195b3b7860f6bceb00 http://blog.scottlowe.org/2015/04/23/ubuntu-openstack-heat-cloud-init/ JIRA: - Change-Id: I6b8b2b21daf113a3a86aee1126b0c3e74737ef4f Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 9d36842e3966185e97cc5732aa7a0edd2050bfe2)
2016-01-14Add test suite for Orange POD2Jo¶rgen Karlsson1-0/+18
Change-Id: I667a54793be39c74a9f787b055b07fda9b2ba06c Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit a6415b5199936de2eb247a26f18e47a368b82afa)
2016-01-14Fix small bugs for running Apexlake on Montreal testbeduser4-40/+34
JIRA: YARDSTICK-219 Change-Id: I5f403e6c922f5e6ea790dc9cdb589cbc98e66ded Signed-off-by: user <user@TRAFCLASS-PACKET1.fuel.local> (cherry picked from commit 174560a6b7d4a23763564fcfc87c2dd7e60aa241)
2016-01-12Add test case description and task file for TC019wym_libra1-0/+38
Add test case description for Control node-OpenStack service down (TC019) and test case .yaml task file. ** Please note that the SLA value has not yet been determined. ** JIRA: YARDSTICK-135 Change-Id: Id512159034929dc197d2c7fdf6cc672ecddfb996 Signed-off-by: wym_libra <yimin.wang@huawei.com> (cherry picked from commit 32b39d0f576dc5c71678fd0b6b8feab6f2173939)
2016-01-11Implementation of opnfv-yardstick-tc021 in YardstickVincenzo Riccobene1-0/+28
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: I0554d0a211392902207ba9ceccf0b98dc3c2cdf1 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit e749d09788edbd1040dabb082e13bd1a1cbc3a7a)
2016-01-11Add vTC daily+weekly test suitesJo¶rgen Karlsson2-0/+32
Change-Id: Id557b5ef4d686da041b8097e390c7e5b563a0c3c JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 2b0c67e7b5984e200b92c134510e7e112cf30a35)
2016-01-11Implementation of opnfv-yardstick-tc020 in YardstickVincenzo Riccobene1-0/+31
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ibbba1d9864e788fb6c81cc00c503e9f69e885651 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit 884e58ab48d0dcdc5e57b87ea181c0a4b8151fc8)
2016-01-11Implementation of yardstick-tc007 in YardstickVincenzo Riccobene1-0/+32
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Ifa2555336098e68d0fad8045e2f759aed587ad92 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit bde7eae17a1fc9ec163451b8d62825daa2fec297)
2016-01-11Implementation of yardstick-tc006 in YardstickVincenzo Riccobene1-0/+26
Includes - Yardstick Scenario for integration with ApexLake - Yardstick Task .yaml file - Documentation JIRA: YARDSTICK-219 Change-Id: Iabde8fa63f346cf1e4a02691f22d1761de79a239 Signed-off-by: Vincenzo Riccobene <vincenzox.m.riccobene@intel.com> (cherry picked from commit 6f6ed9af46d616b073481799c157ed3bc88a8810)
2016-01-11IPv6 connectivity between nodes on the tenant networkkubi1-0/+27
Test case yaml and .rst file for ipv6 Change-Id: Ib9a554dc05445023687efb0ac608c7cbd0da4c21 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2016-01-11Test case to measure processing speed(score)kubi1-0/+32
run unixbench to get the score of processing performance This patch includes the .yaml for the test case and the .rst for test case description. JIRA:YARDSTICK-116 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Ic75119d1db19dacc57edfa4dce607e0e29ae8db4 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit db643f9a2a416c0888931a347488a51264350c8f)
2016-01-11Test Case 040 Verify Parser Yang-to-Toscakubi1-0/+22
running Parser Yang-to-Tosca module as a tool, validating output against expected outcome. this patch is about task yaml and rst for test case description. JIRA:YARDSTICK-224 Signed-off-by: kubi <jean.gaoliang@huawei.com> Change-Id: Id254c5cf45de33b023bef889a58044a21ed0db43 Signed-off-by: kubi <jean.gaoliang@huawei.com> (cherry picked from commit 45e85a7f6df63ca4ca702f519ca19e5bcbb1bc23)
2016-01-11Add missing yaml schema for TC037 and TC038Jo¶rgen Karlsson2-0/+4
Change-Id: I299eb5a94afb8a29dee89938ff1d7b1bb7f43f3b JIRA:- Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 7766def60d167a55e4a0fbbb3d94e5bfe6241e08)
2016-01-11Add test case description and task file for TC005QiLiang11-0/+68
JIRA: YARDSTICK-93 Change-Id: I74adef0e6bae52a7080479d7054a92342f7324a7 Signed-off-by: QiLiang <liangqi1@huawei.com> (cherry picked from commit 738fb0942c39e5f1ecad87ae9dd776f1019d2491)
2016-01-08Add TC037 to POD test suitesJo¶rgen Karlsson10-0/+20
JIRA: YARDSTICK-213 Change-Id: I55ff36b02a0d0e0334505d68d361b8a14d36063c Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 45b1cc64209dec07475e5263469328231c524aa7)
2016-01-08Add test case description and task file for TC038Jo¶rgen Karlsson1-0/+83
JIRA: YARDSTICK-214 Change-Id: I3a2358e8c36755a684f09524bd6fc8af9bf43f60 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit c27b74456831c0f7c827b4840649a898d66cd52f)
2016-01-08Add test case description and task file for TC037Jo¶rgen Karlsson1-0/+83
JIRA: YARDSTICK-213 Change-Id: I3f1f521da6a824c96cbc8712a098c61ff6b0540d Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com> (cherry picked from commit 605d252b9c72c0d41a720c45774d4481bb902c77)
2016-01-06Add yardstick daily suite config files for CI PODsFatih Degirmenci5-0/+70
opnfv-jump-1: apex stable/brahmaputra branch intel-pod5: joid stable/brahmaputra branch intel-pod2: apex master branch intel-pod6: joid master branch intel-pod8: compass master branch Change-Id: Ia659e10525863ee11854a266df58449c625c7f7c Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2016-01-04Add test suite file for ZTE-NJ LAB.wu.zhihui1-0/+14
JIRA: yardstick-210 Change-Id: Ib888b654e742761a8be1b263f643950ea02380f8 Signed-off-by: wu.zhihui <wu.zhihui1@zte.com.cn>
2015-12-21Add test case description and task file for TC010Kristian Hunt1-0/+38
Add test case description for Memory Latency (TC010) and test case .yaml task file. JIRA: YARDSTICK-94 Change-Id: If7fb120868c9901fe097f310aa249e1fbc8a94ee Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
2015-12-21Add yardstick daily task suite for Ericsson POD2Fatih Degirmenci1-0/+14
Change-Id: Ic0f7261dc07eb38d014a8790ac13e5310ec4ef8a Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2015-12-18Adds new Yardstick test case TC009, Network Performance, Packet LossPer Holmgren1-0/+53
Similar to Yardstick TC001. Main difference is that each packet size is run 10 times before next packet size. JIRA: YARDSTICK-87 Change-Id: If0f59590dff9c8e5b86760667f01a373afe8aff0
2015-12-18Adds Yardstick test case TC008, Network Performance Extended TestsPer Holmgren1-0/+58
New test case using pktgen tool. Based on TC001, but with additional packet sizes and more repetitions of each test combination, respectively. Test case takes approx.3 hours to complete. Change-Id: Iba2de5efa33d6e2c960772fa5345595f6d7ab4e6 JIRA: YARDSTICK-80
2015-12-17Add TC001 and TC012 to POD test suitesJo¶rgen Karlsson3-1/+13
Change-Id: I39d589bfc0652d51b7e6d9e139b83160bf7f3692 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2015-12-15Add test case description and task file for TC012Kristian Hunt1-0/+41
Add test case description for Memory Bandwidth (TC012) and test case .yaml task file. JIRA: YARDSTICK-113 Change-Id: I6f2b0bb8c920f3ece3a41bac744cc1ec1fd35cbc Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>
2015-12-15Adds new test case 001 for network performancePer Holmgren1-0/+52
This commit contains almost all of Jira #79. Misses still to collect all results in one single .json file, now everything is written to /tmp/yardstick.out. However, this may not be needed at all once the database for test result collection is in place. Change-Id: I210a477c3b5a110e97a6220e68d3ddc31ccce93a JIRA: YARDSTICK-79
2015-12-15add test suite for huawei us bare labkubi1-0/+10
JIRA:YARDSTICK- Change-Id: I6e43383c1eafa13314ab7678d0e1d42ed063c57f Signed-off-by: kubi <jean.gaoliang@huawei.com>
2015-12-11Rename daily test suite files to match slave names on JenkinsFatih Degirmenci2-0/+0
Change-Id: Ic4ee5d21f09fd324583f8a2c55e99684fbddd70b Signed-off-by: Fatih Degirmenci <fatih.degirmenci@ericsson.com>
2015-12-08Docker image cleanupJo¶rgen Karlsson2-1/+11
- Renamed docker image 'opnfv/yardstick-ci' -> 'opnfv/yardstick' as recommended by project. - Added cirros image and releng repo to docker image in order to make it more usable in offline mode. - Renamed run_benchmarks to run_tests.sh - Moved some environment setups to a new file prepare_env.sh - Added daily test suites file for ericsson and LF pods. Docker image is now built and pushed by releng script: https://gerrit.opnfv.org/gerrit/gitweb?p=releng.git;a=blob;f=jjb/opnfv/opnfv-docker.sh The ci/docker/Makefile file is not used by releng to build yardstick image but the makefile can still be used to build and test docker images locally. Change-Id: If9d6740b39e91d145c587d8d5e2bd372d09a46a9 Signed-off-by: Jo¶rgen Karlsson <jorgen.w.karlsson@ericsson.com>
2015-10-13Add test suite functionality to task commandsKristian Hunt2-0/+53
This patch proposes a more permanent solution to replace the already existing one (YARDSTICK-106). A test suite is a .yaml file which consists of multiple task files which are meant to run as a one set. Each test case in the test suite has to specify the location of the test .yaml task file and can specify additional task arguments or a task arguments file. It is possible to specify the directory where the task files are located in the suite file. If it is left unspecified then it defaults to tests/opnfv/test_cases according to https://etherpad.opnfv.org/p/yardstick_folders A Command line argument --suite is added to the task command. This argument indicates that the intention is to run a test suite. JIRA: YARDSTICK-107 Change-Id: I69508b3b536dd592b6240a2a32dd5d665e0ac4b4 Signed-off-by: Kristian Hunt <kristian.hunt@gmail.com>