aboutsummaryrefslogtreecommitdiffstats
path: root/tests/opnfv
AgeCommit message (Collapse)AuthorFilesLines
2017-06-28Add SRIOV supportJing Zhang1-0/+3
A generic provider network solution is introduced. To identify whether a network specified in the test case is a provider network new attributes are introduced in the test case network section: networks: test-net: cidr: '192.168.1.0/24' provider: "sriov" physical_network: 'physnet1' If the "provider" attribute is present, the network is an existing provider network. If the value is "sriov", binding:vnic_type=direct is added to the interface in the heat deployment template. In orchestrator/heat.py, the interface creating functions are given a new parameter that tells if the network in use is a provider network. The benchmark/contexts/model.py is changed to store the value of the provider attribute from the test case and function calls to port creation is updated with the provider parameter. The same change is made in contexts/heat.py as well. Also calls for creating a new tenant network is replaced for creating a new provider network if the provider attribute is present. Update-1: Change test_model.py Update-2: Per comment, change comment style to """" Update-3: Change test_heat.py Update-4: Add unit test cases to pass coverage test Update-5: Add SRIOV provider network example in opnfv_yardstick_tc008.yaml Update-6: Per comment, remove empty line in orchestrator/test_heat.py Update-7: Per comment, change comment lines in orchestrator/test_heat.py Update-8: Add more unit test cases to pass coverage test Update-9: Change to create SRIOV provider network on the fly so as to support co-current test runs Update-10: Per comment, init physical_network to 'physnet1' Change-Id: I76004c4fcc9bffcfd8ed021fd647e0cecb346ef4 JIRA: YARDSTICK-612 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com> (cherry picked from commit f51ba41255d6ab2c03fd62a044d372b73b496459)
2017-06-20Fix configuration error in TC025tjuyinkanglin1-1/+8
JIRA: YARDSTICK-647 Change-Id: Idc2a87d20a631c37f151cc945de155ef8855e9c3 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn> (cherry picked from commit c076c8372f32a88059783fbc993ab2ebb8967e2e)
2017-06-01Merge "increase monitor number in cases." into stable/danubeJing Lu12-0/+32
2017-06-01Bugfix: change monitor command in tc019JingLu51-1/+1
JIRA: YARDSTICK-655 The original openstack command used for monitoring high availability openstack nova-api service in tc019 is "nova image-list", the "openstack image list" command used in tc019 now may not correctly show the nova-api service status. This is patch swtich the monitor command to "openstack server list". Change-Id: I8810f28b4328ceb4d911a3041a24774ae9cae8f0 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit a5e13df9381c531716b1e41e7a9dedb130fc6e35)
2017-06-01increase monitor number in cases.HuanLi12-0/+32
change cases to multi-monitor mode and improve monitor accuracy. JIRA: YARDSTICK-397 Change-Id: I6840423dd83899b769df76fbee808f9bf5dc4cfd Signed-off-by: HuanLi <lihuansse@tongji.edu.cn> (cherry picked from commit ab7292a8e3060bf6feaa830b156089fa70854664)
2017-05-06Bugfix: Support HA test cases in TripleOJingLu51-1/+1
Change-Id: Ib1f6f45677e66ca88fb546ea0662f52588e9d336 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 67da8f2ddb5cbf14bbf0df48b10240ba6ebadbe9)
2017-05-04Bugfix: Local Openstack Operation in HA test frameworksdanube.2.RC1danube.2.0tjuyinkanglin1-2/+0
JIRA: YARDSTICK-635 Change-Id: Ic27517714db9325e7a3b1ef623c49af61c36b2b5 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn> (cherry picked from commit 2fb95fbb9380ea7ce92dcb32cd2f0789b9f91bdc)
2017-05-04Modify HA test cases and HA test script to support other installerstjuyinkanglin2-12/+20
JIRA: YARDSTICK-633 Change-Id: I65fd1ba11504dc61485f83c3bcc93bec4d41883b Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn> (cherry picked from commit 27cc0643cf93f4b44c12fbdfcc3e0841d46214c4)
2017-05-04run ha test case in compass podrexlee87761-4/+28
JIRA: YARDSTICK-634 Change-Id: I586d5177598efeda8ac3937d1eb04cd5b97b6ec6 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 5c4b29189bd69912c9bc356a15a46db764045537)
2017-05-04bugfix: fix HA testcasesJingLu51-1/+1
Change-Id: Ib38e94610a108ff7195cefdfaf048e0f4fd894e8 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 6604cb5f2d6e3c819cb8488f1ad3468184822cf9)
2017-04-25Bugfix: Make tc019 abd tc025 accept --task-args options to change pod.yamlxudan2-2/+6
JIRA: YARDSTICK-628 Change-Id: I7d1b84232a7477a2854ef1625cc63521999eff65 Signed-off-by: xudan <xudan16@huawei.com> (cherry picked from commit 3f7829f0f28ce4d517ea8654122ee0d686fddf3e)
2017-04-06Bugfix: fix query job status in TC074JingLu51-1/+1
JIRA: YARDSTICK-621 The storperf job status query in TC074 didn' work properly. The cause is the "type: status" is not passed in the URL. This patch also update storperf VM image to xenial. Change-Id: Idd9f501416b24612f6045a57ba2a95e2ed3a9572 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit b2fb23ca8ccc1acedaa9156552af4ba347f24103)
2017-04-05Add opnfv_os-ovn-nofeature-noha_daily test suiteJingLu51-0/+62
JIRA: YARDSTICK-624 Change-Id: Ia783bec53e4d889736db7e510d28c32377d4f9b2 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit da47f4de9d57f40ecc7cedeac18c0d061bd21c84)
2017-03-30Bugfix: Add test suite for opnfv_os-odl_l3-ovs-ha_daily scenarioJingLu51-0/+62
JIRA: YARDSTICK-617 Apex has a new scenario 'opnfv_os-odl_l3-ovs-ha_daily' in CI. This patch add yardstick test suite for this scenario. Change-Id: I50eb84fb506e7cf87cbd6bcb67f3df6d185d8b6b Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 0e930373273dc76db929e8e885beb97e04636ad2)
2017-03-30Update cirros image to latest versionMichael Polenchuk1-1/+1
Change-Id: Iffa1e4529e5b6e9664ac503a5815ea9a034d7515 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com> (cherry picked from commit 043727feabaf7cabb719dbd3d52274bcd0dbea66)
2017-03-27Bugfix:HA test cases rely on dynamic ip addresses in fuel podsJingLu510-10/+30
JIRA: YARDSTICK-602 change HA test cases to rely on dynamical generated pod.yaml in fuel pods Change-Id: I0efb01489eb2dd94babf1a45bff2fbf6adef5f6e Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 6c414e6f46861f71aa68db43ffabcad2305f3f32)
2017-03-21add missing test suite files for new scenariosJingLu52-0/+76
JIRA: YARDSTICK-589 Change-Id: I1690d4e2bd741fe1514c8496ee6ff10b72158859 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit f7371c36ff26ae9a8f526d0b76d13020a2239a23)
2017-03-18add missing test suite files for new scenariosJingLu52-0/+178
JIRA: YARDSTICK-589 Some new scenarios, e.g, opnfv_k8-nosdn-nofeature-noha_daily, have been added in the Danube release, test suite files for these scenarios should be added. Change-Id: If3f4ef233b7b1516e182ed28f15feece1728e6d9 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 94d0c6200c8f39988911eedffea703f8b4737fcf)
2017-02-28Re-enable floating IP tests for bgpvpnRomanos Skiadas2-0/+8
Change-Id: I46e4e21787a9b0a3104b2a684d62f50681258205 Signed-off-by: Romanos Skiadas <rski@intracom-telecom.com>
2017-02-23Merge "Update missing license headers"Rex Lee80-0/+680
2017-02-17Update missing license headersDeepak S80-0/+680
Change-Id: I063fd37fe25754c94d164ae5a209d15b69322093 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-02-17Merge " add scenario to solve apex ci fail"Kubi1-0/+21
2017-02-17 add scenario to solve apex ci failrexlee87761-0/+21
due to https://gerrit.opnfv.org/gerrit/#/c/27605/ os-odl_l2-bgpvpn-ha in apex has already been renamed to be os-odl-bgpvpn-ha, so add a new one. Change-Id: I167bf295b67b2dddbd3da2aa5a2dca666b3fa152 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-02-17solve apex ci problem (new scenario)rexlee87761-0/+21
new scenario os-odl-gluon-noha in apex pod Change-Id: I0151ce227e2a3ff476044f0b5c8d4ed61d20b21a Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-02-16Merge "New reliability/availability testcase - IP datagram error rate and etc."Rex Lee1-0/+56
2017-02-14Update Openstack CLI Command in yardstick ha test framework configuration ↵tjuyinkanglin1-1/+1
files and TC052 JIRA: YARDSTICK-547 Change-Id: Idde2dc56436c9cf4b8696bfd0056ab4e47c97c9a Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-02-14Merge "Update Openstack CLI Command for Scenario-based HA Testcases which ↵Kubi5-15/+15
have multiple commands: yardstick tc025, tc050 ,tc051, tc053, tc054"
2017-02-14Update Openstack CLI Command for Scenario-based HA Testcases which have ↵tjuyinkanglin5-15/+15
multiple commands: yardstick tc025, tc050 ,tc051, tc053, tc054 JIRA: YARDSTICK-546 Change-Id: Id94b32f5e053f3f6a7c78980dce22b3aab7bbd13 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-02-13Update CLI Command in yardstick TC019, TC045~TC048tjuyinkanglin5-6/+6
JIRA: YARDSTICK-545 Change-Id: Ifd3348e029f0ddbfa0117b4eef4493d443a4de4d Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-02-13New reliability/availability testcase - IP datagram error rate and etc.JingLu51-0/+56
JIRA: YARDSTICK-534 This test case uses nstat to monitor network metrics provided by the kernel in a host and calculate IP datagram error rate, ICMP message error rate, TCP segment error rate and UDP datagram error rate. Change-Id: I2fe6457bb5c95d0446c1463991ae31cc664b09f8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-02-10KVMFORNFV: Implementing test suites for kvmfornfv ovs+dpdk+barometer scenarios.Navya2-0/+100
This patch implements test suites for kvmfornfv os-nosdn-kvm_ovs_dpdk_bar-ha and os-nosdn-kvm_ovs_dpdk_bar-noha scenarios. Change-Id: Idb7d360aa5b91a15d1c69566418a9da4b68db7ab Signed-off-by: Navya Bathula <navyax.bathula@intel.com>
2017-02-06KVMFORNFV: Implementing test suites for kvmfornfv ovs+dpdk scenarios.KalyanReddy2-0/+100
This patch implements test suites for kvmfornfv os-nosdn-kvm_ovs_dpdk-ha and os-nosdn-kvm_ovs_dpdk-noha scenarios. Change-Id: Ia7b17dda262df5d81cac87372b70510192044a40 Co-Authored-By: Navya <b.navya4@tcs.com> Signed-off-by: KalyanReddy <reddyx.gundarapu@intel.com>
2017-01-20Create API to get a list of all test caseschenjiankun40-128/+182
JIRA: YARDSTICK-456 Currently we do not have a API to get a list of all test cases; Currently the test case info is from the comment; So I create a API to get a list of all test cases; And create a 'description' attribute to record info of a test case; And use the CLI call this API; Change-Id: Ife800600446683664097835c7b9f11899c85771d Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-12-22Merge "Add smoke, components, features and performance test suite for Yatdstick"Rex Lee4-0/+144
2016-12-19change m1.* flavor to "yardstick-flavor"JingLu57-7/+7
JIRA: YARDSTICK-485 In OpenStack Newton, the 'm1.tiny', 'm1.small', 'm1.medium' and 'm1.large' will not be automatic created. This may cause errors as some Yardstick testcases are using one of these flavor. Therefore, it's better change all the flavor option in task configuration file to 'yardstick-flavor'. Change-Id: Ibb29a77ef331bbf728dec9894a2e9f17c19d5ebd Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-12-16Add smoke, components, features and performance test suite for YatdstickJingLu54-0/+144
JIRA: YARDSTICK-417 This patch adds a smoke test suite for Yardstick. The smoke test suite consists of 3 test cases: TC002 Ping, TC005 Fio, TC012 LMbench. 3 test suites for components, features and performance tiers are also provided. Change-Id: Ic5223c1401270d126aabb4bf062e40da9464e18f Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-11-24Merge "Upgrade yardstick VM image from Ubuntu 14.04 to 16.04"Jing Lu14-15/+15
2016-11-16Merge "Add os-odl_l2-fdio-ha scenario support"Kubi1-0/+30
2016-11-09Upgrade yardstick VM image from Ubuntu 14.04 to 16.04JingLu514-15/+15
JIRA: YARDSTICK-365 This patch upgrades the base Ubuntu version of Yardstick VM image from trusty(14.04) to xenial(16.04). If you still want to use Ubuntu 14.04 to build Yardstick custom image you can use command: sudo ./tools/yardstick-img-modify tools/ubuntu-server-cloudimg-modify.sh trusty And now the "yardstick-trusty-server" is rename as "yardstick-image". Change-Id: I0765f3aee2d17eea1ad2257d0f576cdb9ef2b18d Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-11-04bugfix: tc027 results in tc037 time outrexlee87761-10/+10
JIRA: YARDSTICK-363 Change-Id: Ic0186cd0678277b0b1b04a57a322f6193c1cf52e Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-11-01Add os-odl_l2-fdio-ha scenario supportchenjiankun1-0/+30
JIRA: YARDSTICK-373 Change-Id: Ia06ec788c50098cec0c22c6fb1eec97d7a4c9031 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-10-14Merge "run ipv6 test case on more pods"liang gao1-1/+3
2016-10-11run ipv6 test case on more podsrexlee87761-1/+3
JIRA: YARDSTICK-363 Change-Id: I5f1c8b1f0038619102aa6e446853988093172d9c Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-10-11Provide yardstick-trusty-server.tar.gz for lxd scenarioJingLu54-49/+13
JIRA: YARDSTICK-325 This patch removes ping_lxd_test.yaml and changes vm image used for lxd senarios. In the *-lxd-* scenariois, Cirros LXC 0.3 image will be used for Ping test case. For yardstick generic test, a dedicated yardstick vm image will be used. Change-Id: I5f9e7a92e3e5dded0014baec77085d80cc904b52 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-10-08Add raw image support for lxd scenarioJingLu52-0/+49
JIRA: YARDSTICK-325 This patch adds a ping_lxd_test TC. ping_lxd_test is a dedicated ping test case for lxd scenarios. It uses Cirros LXC 0.3 image to test the image requirement of lxd. Change-Id: I11dce7ee884cfb0f151d3a60daf7ac82226956a3 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-09-29ipv6 testcase to support fuelrexlee87761-2/+3
JIRA: YARDSTICK-363 1. fuel pod.yaml node id update according to the real environment 2. add constaints to run ipv6 on one fuel physical pod(lf-pod2) Change-Id: I5b91f1bea84f2c79e0b9c3195028e38ddad55363 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-09-28ipv6 test case to de-coupling to fuel/compassrexlee87761-5/+5
JIRA: YARDSTICK-358 1. plan to support fuel first 2. apex/joid situation will be taken care of in another patch Change-Id: Ia9293a2e925d874cc6182e975f563d92fb91a2c7 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-09-20Merge "compute capacity description adjustment and HT check added"liang gao1-2/+8
2016-09-20Merge "Added opnfv_os-odl_l2-fdio-noha_daily.yaml and ↵liang gao2-0/+60
opnfv_os-nosdn-fdio-noha_daily.yaml scenarios along with support for hugepages which is needed for these scenarios"
2016-09-19Added opnfv_os-odl_l2-fdio-noha_daily.yaml and ↵juraj.linkes2-0/+60
opnfv_os-nosdn-fdio-noha_daily.yaml scenarios along with support for hugepages which is needed for these scenarios JIRA: YARDSTICK-347 Change-Id: Ie4840b328393488fb8e118c3f2cd610d61fdc283 Signed-off-by: juraj.linkes <jlinkes@cisco.com>