summaryrefslogtreecommitdiffstats
path: root/tests/opnfv/test_cases
AgeCommit message (Collapse)AuthorFilesLines
2017-08-01Merge "bugfix: enable vlan and physical netwok able to set"Jing Lu17-1/+188
2017-07-31Add more parameters in iperf3 tamlAce Lee1-0/+2
JIRA: YARDSTICK-755 The parameters that iperf3 testcase support now maybe insufficient in some usecase. The test case should support parameters such as: windows size and length of buffer. This work is about adding more parameters in testcase yaml file Change-Id: I8c900a4a8909d97543cf837a02c76a6aee19f439 Signed-off-by: Ace Lee <liyin11@huawei.com>
2017-07-29bugfix: enable vlan and physical netwok able to setrexlee877617-1/+188
Enable vlan and physical netwok able to set by parameters for heat context. It won't affect the original test case, but enable vlan to be set directly by pass task-args to command: yardstick -d task start samples/ping.yaml --task-args '{"provider": "vlan"}' JIRA: YARDSTICK-763 Change-Id: I96f96a61991cceb1506d055867a006d56689a008 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-07-28Merge "Test Case: OPNFV_YARDSTICK_TC023: VM availability during live migration"Rex Lee1-0/+176
2017-07-26Test Case: OPNFV_YARDSTICK_TC023: VM availability during live migrationchenjiankun1-0/+176
JIRA: YARDSTICK-174 This live migration test case is based on share storage, default share storage is enabled. This test case will do some config work. And do live migration and calculate the migration time and downtime. Change-Id: I6601601edebdd0ac6434ba632b1eba9e9bd4fda0 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-07-25Merge "Add multiqueue support"Ross Brattain1-0/+9
2017-07-20Add multiqueue supportJing Zhang1-0/+9
Problem: Neither OVS nor SRIOV multi-queue is not supported. Guest VM lacks tuning to reach high throughput. Solution: (1) Build SRIOV multi-queue capable guest image by recompiling the igxbevf driver (make CFLAGS_EXTRA=-DIXGBE_ENABLE_VF_MQ install). (2) Change pktgen to send on multiple queues. (3) Add tuning in guest VM (Disable irqbalance and setup vNIC interrupt affinity to vCPUs) Update 1: Takes care comments plus adds unit test cases Update 2: Jenkins reports code coverage 81%, local reports 96%, add more unit test cases Update 3: Manually rebased to adapt to SSH.from_node() Update 4: Takes care comments for vnic_type, vnic_name Change-Id: Ieb15381c653b13697487d095efa4be6c3c49fa42 JIRA: YARDSTICK-619 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-07-17Open storperf testcase to huawei-pod2JingLu51-1/+2
JIRA: YARDSTICK-712 Change-Id: If91c936a3a59580a987cb6762db5d063edf6c9d7 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-07-10Change storperf target IPJingLu51-1/+1
As compass in master use OpenStack Ansible, the former IP "192.168.200.1" for Huawei pod-1 has been deprecated. Change-Id: Ia60885b36abec3455db2aa2939afbe2ef8bd79f5 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-06-30unify pod keywork so api can easily usedrexlee877618-24/+24
JIRA: YARDSTICK-695 Change-Id: I826cb2ea07949b1eaae4df4cb77175ec8f5df89b Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-06-07Fix configuration error in TC025tjuyinkanglin1-1/+8
JIRA: YARDSTICK-647 Change-Id: Idc2a87d20a631c37f151cc945de155ef8855e9c3 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-05-18increase monitor number in cases.HuanLi12-0/+32
change cases to multi-monitor mode and improve monitor accuracy. JIRA: YARDSTICK-397 Change-Id: I6840423dd83899b769df76fbee808f9bf5dc4cfd Signed-off-by: HuanLi <lihuansse@tongji.edu.cn>
2017-05-16Bugfix: change monitor command in tc019JingLu51-1/+1
JIRA: YARDSTICK-655 The original openstack command used for monitoring high availability openstack nova-api service in tc019 is "nova image-list", the "openstack image list" command used in tc019 now may not correctly show the nova-api service status. This is patch swtich the monitor command to "openstack server list". Change-Id: I8810f28b4328ceb4d911a3041a24774ae9cae8f0 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-11Merge "Extend TC008 to run pktgen-dpdk inside VM Need a fast path inside VM ↵Rex Lee1-0/+63
to verify full throughput of SRIOV and OVS-dpdk."
2017-05-06Bugfix: Support HA test cases in TripleOJingLu51-1/+1
Change-Id: Ib1f6f45677e66ca88fb546ea0662f52588e9d336 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-04Merge "Bugfix: Local Openstack Operation in HA test frameworks"Jing Lu1-2/+0
2017-05-04Bugfix: Local Openstack Operation in HA test frameworkstjuyinkanglin1-2/+0
JIRA: YARDSTICK-635 Change-Id: Ic27517714db9325e7a3b1ef623c49af61c36b2b5 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-05-04Modify HA test cases and HA test script to support other installerstjuyinkanglin2-12/+20
JIRA: YARDSTICK-633 Change-Id: I65fd1ba11504dc61485f83c3bcc93bec4d41883b Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-05-01Extend TC008 to run pktgen-dpdk inside VMJing Zhang1-0/+63
Need a fast path inside VM to verify full throughput of SRIOV and OVS-dpdk. Update 1: Change newly added file names to avoid conflict Update 2: Add more unit test cases Update 3: Fix default parameter typo for testpmd Update 4: Adapted to the pktgen-dpdk prompt change from "Pktgen>" to "Pktgen:/>", now just expect "Pktgen" Update 5: Per comment, merge common functions between latency and throughput tests to utils.py Update 6: Per comment, seperate the test case from TC008 to a new test case TC077 Change-Id: I1f7471d4ba77636a3a66c79c2652578321312185 JIRA: YARDSTICK-614 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-04-27bugfix: fix HA testcasesJingLu51-1/+1
Change-Id: Ib38e94610a108ff7195cefdfaf048e0f4fd894e8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-04-25Bugfix: Make tc019 abd tc025 accept --task-args options to change pod.yamlxudan2-2/+6
JIRA: YARDSTICK-628 Change-Id: I7d1b84232a7477a2854ef1625cc63521999eff65 Signed-off-by: xudan <xudan16@huawei.com>
2017-04-23Merge "Add SRIOV support"Kubi1-0/+3
2017-04-18Add SRIOV supportJing Zhang1-0/+3
A generic provider network solution is introduced. To identify whether a network specified in the test case is a provider network new attributes are introduced in the test case network section: networks: test-net: cidr: '192.168.1.0/24' provider: "sriov" physical_network: 'physnet1' If the "provider" attribute is present, the network is an existing provider network. If the value is "sriov", binding:vnic_type=direct is added to the interface in the heat deployment template. In orchestrator/heat.py, the interface creating functions are given a new parameter that tells if the network in use is a provider network. The benchmark/contexts/model.py is changed to store the value of the provider attribute from the test case and function calls to port creation is updated with the provider parameter. The same change is made in contexts/heat.py as well. Also calls for creating a new tenant network is replaced for creating a new provider network if the provider attribute is present. Update-1: Change test_model.py Update-2: Per comment, change comment style to """" Update-3: Change test_heat.py Update-4: Add unit test cases to pass coverage test Update-5: Add SRIOV provider network example in opnfv_yardstick_tc008.yaml Update-6: Per comment, remove empty line in orchestrator/test_heat.py Update-7: Per comment, change comment lines in orchestrator/test_heat.py Update-8: Add more unit test cases to pass coverage test Update-9: Change to create SRIOV provider network on the fly so as to support co-current test runs Update-10: Per comment, init physical_network to 'physnet1' Change-Id: I76004c4fcc9bffcfd8ed021fd647e0cecb346ef4 JIRA: YARDSTICK-612 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-04-05Bugfix: fix query job status in TC074JingLu51-1/+1
JIRA: YARDSTICK-621 The storperf job status query in TC074 didn' work properly. The cause is the "type: status" is not passed in the URL. This patch also update storperf VM image to xenial. Change-Id: Idd9f501416b24612f6045a57ba2a95e2ed3a9572 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-27Merge "Bugfix:HA test cases rely on dynamic ip addresses in fuel pods"Jing Lu10-10/+30
2017-03-25Bugfix:HA test cases rely on dynamic ip addresses in fuel podsJingLu510-10/+30
JIRA: YARDSTICK-602 change HA test cases to rely on dynamical generated pod.yaml in fuel pods Change-Id: I0efb01489eb2dd94babf1a45bff2fbf6adef5f6e Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-03-24Update cirros image to latest versionMichael Polenchuk1-1/+1
Change-Id: Iffa1e4529e5b6e9664ac503a5815ea9a034d7515 Signed-off-by: Michael Polenchuk <mpolenchuk@mirantis.com>
2017-02-17Update missing license headersDeepak S40-0/+340
Change-Id: I063fd37fe25754c94d164ae5a209d15b69322093 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-02-16Merge "New reliability/availability testcase - IP datagram error rate and etc."Rex Lee1-0/+56
2017-02-14Update Openstack CLI Command in yardstick ha test framework configuration ↵tjuyinkanglin1-1/+1
files and TC052 JIRA: YARDSTICK-547 Change-Id: Idde2dc56436c9cf4b8696bfd0056ab4e47c97c9a Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-02-14Merge "Update Openstack CLI Command for Scenario-based HA Testcases which ↵Kubi5-15/+15
have multiple commands: yardstick tc025, tc050 ,tc051, tc053, tc054"
2017-02-14Update Openstack CLI Command for Scenario-based HA Testcases which have ↵tjuyinkanglin5-15/+15
multiple commands: yardstick tc025, tc050 ,tc051, tc053, tc054 JIRA: YARDSTICK-546 Change-Id: Id94b32f5e053f3f6a7c78980dce22b3aab7bbd13 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-02-13Update CLI Command in yardstick TC019, TC045~TC048tjuyinkanglin5-6/+6
JIRA: YARDSTICK-545 Change-Id: Ifd3348e029f0ddbfa0117b4eef4493d443a4de4d Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-02-13New reliability/availability testcase - IP datagram error rate and etc.JingLu51-0/+56
JIRA: YARDSTICK-534 This test case uses nstat to monitor network metrics provided by the kernel in a host and calculate IP datagram error rate, ICMP message error rate, TCP segment error rate and UDP datagram error rate. Change-Id: I2fe6457bb5c95d0446c1463991ae31cc664b09f8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-01-20Create API to get a list of all test caseschenjiankun40-128/+182
JIRA: YARDSTICK-456 Currently we do not have a API to get a list of all test cases; Currently the test case info is from the comment; So I create a API to get a list of all test cases; And create a 'description' attribute to record info of a test case; And use the CLI call this API; Change-Id: Ife800600446683664097835c7b9f11899c85771d Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-12-19change m1.* flavor to "yardstick-flavor"JingLu57-7/+7
JIRA: YARDSTICK-485 In OpenStack Newton, the 'm1.tiny', 'm1.small', 'm1.medium' and 'm1.large' will not be automatic created. This may cause errors as some Yardstick testcases are using one of these flavor. Therefore, it's better change all the flavor option in task configuration file to 'yardstick-flavor'. Change-Id: Ibb29a77ef331bbf728dec9894a2e9f17c19d5ebd Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-11-09Upgrade yardstick VM image from Ubuntu 14.04 to 16.04JingLu514-15/+15
JIRA: YARDSTICK-365 This patch upgrades the base Ubuntu version of Yardstick VM image from trusty(14.04) to xenial(16.04). If you still want to use Ubuntu 14.04 to build Yardstick custom image you can use command: sudo ./tools/yardstick-img-modify tools/ubuntu-server-cloudimg-modify.sh trusty And now the "yardstick-trusty-server" is rename as "yardstick-image". Change-Id: I0765f3aee2d17eea1ad2257d0f576cdb9ef2b18d Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-10-11Provide yardstick-trusty-server.tar.gz for lxd scenarioJingLu52-45/+2
JIRA: YARDSTICK-325 This patch removes ping_lxd_test.yaml and changes vm image used for lxd senarios. In the *-lxd-* scenariois, Cirros LXC 0.3 image will be used for Ping test case. For yardstick generic test, a dedicated yardstick vm image will be used. Change-Id: I5f9e7a92e3e5dded0014baec77085d80cc904b52 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-10-08Add raw image support for lxd scenarioJingLu51-0/+44
JIRA: YARDSTICK-325 This patch adds a ping_lxd_test TC. ping_lxd_test is a dedicated ping test case for lxd scenarios. It uses Cirros LXC 0.3 image to test the image requirement of lxd. Change-Id: I11dce7ee884cfb0f151d3a60daf7ac82226956a3 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-09-28ipv6 test case to de-coupling to fuel/compassrexlee87761-5/+5
JIRA: YARDSTICK-358 1. plan to support fuel first 2. apex/joid situation will be taken care of in another patch Change-Id: Ia9293a2e925d874cc6182e975f563d92fb91a2c7 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-09-17compute capacity description adjustment and HT check addedMatthewLi1-2/+8
JIRA: YARDSTICK-270 1)description info amended according to really tested 2)hyper-thread status check added Change-Id: I813a41ff1e55c2d816fa55b773cf6c4bdd2af2bd Signed-off-by: MatthewLi <matthew.lijun@huawei.com>
2016-09-13Merge "Adjust flavor parameter in TC002"liang gao1-1/+1
2016-09-12Adjust flavor parameter in TC002JingLu51-1/+1
JIRA: YARDSTICK-344 In some cases, m1.tiny is too small to boot a VM instance. So this patch changes m1.tiny to yardstick-flavor. Change-Id: I2970717d934adcf764aea576087c1aed55e377fe Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-09-11Bugfix: modify comment bugs in TC055 and TC075chenjiankun2-3/+3
JIRA: YARDSTICK-342 Change-Id: I5341f377425042b459bd15d623903c8674a3075a Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2016-08-30Bugfix: Add missing dasheswangwulin1-0/+1
Change-Id: I4dee79252f909a0c201834ae9b05c9af98213ad7 Signed-off-by: wangwulin <wangwulin@huawei.com>
2016-08-17reduce ping case time for daily cirexlee87761-1/+1
Change-Id: I9d62fc93bb37c58e374a93081a338b00ddd1305a Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-08-17BugFix: fix storperf deployment location errorJingLu51-1/+1
Change-Id: Ib8329f6feeadacb312171782730ef2807eda5455 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2016-08-15Merge "Add testcase tc0075 and mofify testcsuite"liang gao1-0/+23
2016-08-15Add testcase tc0075 and mofify testcsuiterexlee87761-0/+23
Change-Id: Icbe2815c0fd0890c579d49a4180854ceb7487ecf Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2016-08-12Increase recovery SLA of HA test cases and fix tc019tjuyinkanglin6-10/+16
JIRA: YARDSTICK-287 Change-Id: I676c4401406503a016f829ec3691a006d329f941 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>