aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-07-15Danube 3.1 release notesRoss Brattain1-11/+55
Change-Id: I7032dd2348dd7212484a4a3cbd40e1d7698c8668 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 9449bbf4608d74da8cf61cb4178c844a0095f78f)
2017-07-14yardstick env influxdb/grafana cmd support centoschenjiankun3-17/+43
JIRA: YARDSTICK-714 Currently yardstick env influxdb/grafana command do not support centos. Because we use the gateway ip to get the service of influxdb and grafana. But in centos, we can not access influxdb/grafana service via gateway ip. In this patch, I use docker inspect to get the ip of influxdb and grafana. So these command can support centos. Change-Id: I4599cbbd0fe43de9cf08e5d9e74d31edbb742998 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-07-05Use "OS_INSECURE" variable as the insecure mode indicatorJingLu57-8/+9
Now we use "OS_CACERT" as the insecure mode indicator, it is better to use "OS_INSECURE". Change-Id: I1406193e27510390b4b8fd8f4751d8361560172f Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit a2176af5514fc55ad8421635ad70ce4f26890ed6)
2017-07-03Bugfix: amend the CLI to build yardstick-image manuallyJingLu51-0/+2
Change-Id: I8fbf0d6383375660c05e55d36fb0d2f91e1d8de8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-07-03Set TEST_DB_URL for storperfJingLu52-1/+14
JIRA: YARDSTICK-692 add the URL for the test results DB to the storperd_admin-rc TEST_DB_URL=http://testresults.opnfv.org/test/api/v1 Also, add metadata JSON to the POST to /job API when creating the job: Change-Id: Ib950f759d80e707bc49d9015bc120d985051f131 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 1c69f20b0f681ea66d68d077c7f85466363fee4d)
2017-07-03increase line length to 99Ross Brattain1-0/+1
When line length is 79 I have to spend too much time manually wrapping my code into unreadable junk I can't use expressive tuple unpacking and I start shortening variables and other bad tricks to decrease the line length. We have too many levels of indent to manage with 79 class: def: if: for: etc. Change-Id: Ib2ce9cf887f9880c46815822c8d0e1a7806e53ca Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 98fdb2810a7010edf0f12af0ed5d706df2af615c)
2017-06-30Bugfix: remove test.dbf file in recovery scriptzshi1-1/+1
JIRA: YARDSTICK-696 Change-Id: I09b73079ff828c43040723794115bb07f74242e8 Signed-off-by: zshi <zshi@redhat.com> (cherry picked from commit d578927cd63784616f11c4d669815192fd5fa336)
2017-06-28Add SRIOV supportJing Zhang8-13/+124
A generic provider network solution is introduced. To identify whether a network specified in the test case is a provider network new attributes are introduced in the test case network section: networks: test-net: cidr: '192.168.1.0/24' provider: "sriov" physical_network: 'physnet1' If the "provider" attribute is present, the network is an existing provider network. If the value is "sriov", binding:vnic_type=direct is added to the interface in the heat deployment template. In orchestrator/heat.py, the interface creating functions are given a new parameter that tells if the network in use is a provider network. The benchmark/contexts/model.py is changed to store the value of the provider attribute from the test case and function calls to port creation is updated with the provider parameter. The same change is made in contexts/heat.py as well. Also calls for creating a new tenant network is replaced for creating a new provider network if the provider attribute is present. Update-1: Change test_model.py Update-2: Per comment, change comment style to """" Update-3: Change test_heat.py Update-4: Add unit test cases to pass coverage test Update-5: Add SRIOV provider network example in opnfv_yardstick_tc008.yaml Update-6: Per comment, remove empty line in orchestrator/test_heat.py Update-7: Per comment, change comment lines in orchestrator/test_heat.py Update-8: Add more unit test cases to pass coverage test Update-9: Change to create SRIOV provider network on the fly so as to support co-current test runs Update-10: Per comment, init physical_network to 'physnet1' Change-Id: I76004c4fcc9bffcfd8ed021fd647e0cecb346ef4 JIRA: YARDSTICK-612 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com> (cherry picked from commit f51ba41255d6ab2c03fd62a044d372b73b496459)
2017-06-28Bugfix: cacert should suppot insecure mode if neededrexlee87761-0/+1
currently, we use env variable "OS_CACERT" to specify the location of cert file. but if there's no cacert and use for personal verification, it's better to also support insecure mode by set OS_CACERT=False JIRA: YARDSTICK-616 Change-Id: I73b0860863bf6386f9114328c52594ef87e02fa3 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit aa477334a3cb2e49c4343f66bff44c89d7edcf24)
2017-06-26Bugfix: remove double quote around SECURE variableJingLu52-17/+17
JIRA: YARDSTICK-689 This patch remove the double quote around the SECURE varibale as it may cause the fowllowing error: $ openstack "${SECURE}" image list openstack: ' image list' is not an openstack command. See 'openstack --help'. Did you mean one of these? access token create address scope create address scope delete address scope list address scope set address scope show aggregate add host aggregate create ... Change-Id: Ibb22e85b3dd89b0e3b62821bd5ebe4f155886ffc Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit b04755b5148daf36db436dc066e1bef2c93f1879)
2017-06-23Improve Yardstick user-guideJingLu51-1/+7
This patch adds a short description on how to use the "yardstick env prepare" command in a Non-OPNFV installer environtment. Change-Id: Idf54bf5318499d2b129a1445e0758e351945e755 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-06-23Merge "HA testcase improvement" into stable/danubeJing Lu11-25/+83
2017-06-22Merge "temp freeze releng version for stable/danube workaround" into ↵Ross Brattain1-1/+1
stable/danube
2017-06-22temp freeze releng version for stable/danube workaroundRoss Brattain1-1/+1
releng doesn't have a branch, so we need to freeze the releng version. There is an issue with releng fetch_os_creds.sh change /home/opnfv/repos/releng/utils/fetch_os_creds.sh: line 75: BRANCH: unbound variable So we need to revert back to commit before this change Change-Id: Ie8b0f68879a873aab584aa32b576d8b5ba602a13 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-06-22HA testcase improvementJingLu511-25/+83
This patch improve HA test case in the following aspects: 1. the "GeneralHA" type now will check if the target service process in the controller node. 2. support ignore server certificate 3. add debug log for recovering service failed 4. improve method to kill keystone process Change-Id: I9ae7ab54391fe41d5d7f3e4951a7ac2e3ba75968 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 5b99f1532ec4d15258ec86e970acd2904954b3bc)
2017-06-22bugfix: storperf timeout in cirexlee87762-1/+7
JIRA: YARDSTICK-680 Change-Id: Ie405187b8ab085a9e4f40a7e7e7e661c94e83630 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 6552d3b7b08c3b9dcaa8f44adc31d5028c00e863)
2017-06-22Merge "Adapt lmbench scripts for aarch64 nodes" into stable/danubeRex Lee3-3/+25
2017-06-22Merge "improve git code with devstack functions" into stable/danubeRoss Brattain1-18/+66
2017-06-22improve git code with devstack functionsRoss Brattain1-18/+66
if we aren't re-cloning we still need to make sure we update the branch/tag/commit to the version from the remote so we need to fetch and then checkout again it is more complicated. Dockerfile does a shallow clone, so we don't get all the remote ref information. To clone a random remote commit id we have to unshallow Change-Id: If15f504b6ff2cfdfc8894fd3b37e687a19616714 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-06-22Adapt lmbench scripts for aarch64 nodesAlexandru Nemes3-3/+25
LMBench shell scripts were invoking x86_64 executables. This made them fail when executed on aarch64 nodes. Added architecture detection and proper command call. JIRA: ARMBAND-268 Change-Id: I8c9e87158631f7f5479adc2fda9558f9f7e54406 Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com> (cherry picked from commit fd2b3173d21d34720f714e7e6358dafe7d1ada12)
2017-06-22ping: don't split if target_vm is a dictRoss Brattain1-1/+4
If we run sample/ping-hot.yaml, it will encounter an AttributeError, log see below: Traceback (most recent call last): File "/usr/local/lib/python2.7/dist-packages/yardstick/benchmark/runners/duration.py", line 69, in _worker_process method(data) File "/usr/local/lib/python2.7/dist-packages/yardstick/benchmark/scenarios/networking/ping.py", line 94, in run target_vm_name = target_vm.split('.')[0] AttributeError: 'dict' object has no attribute 'split' Because here host and target will be a dict JIRA: YARDSTICK-561 Change-Id: I4b7628bf20050d6d516a80efe3785f750d27c05e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit eb142a953a59f447f1c186d2f58004fe354e4c4b)
2017-06-21Configure Yardstick flavor to give more RAM to ARM instancesAlexandru Nemes1-1/+1
Yardstick TC005 fails with errors that indicate low memory conditions: "fio: error while loading shared libraries: librbd.so.1: cannot map zero-fill pages" Changing the yardstick flavor to give 1024MB of RAM instead of 512MB made this test case work. JIRA: ARMBAND-275 Change-Id: I2193802082c28edb20004964d2df3780eb5eccb7 Signed-off-by: Alexandru Nemes <alexandru.nemes@enea.com> (cherry picked from commit 5c8e38667e17059db1c62dd21f868966a6b2a519)
2017-06-20Merge "Terminate openstack service process using kill command in HA test ↵Jing Lu1-2/+5
cases" into stable/danube
2017-06-20Fix configuration error in TC025tjuyinkanglin2-1/+58
JIRA: YARDSTICK-647 Change-Id: Idc2a87d20a631c37f151cc945de155ef8855e9c3 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn> (cherry picked from commit c076c8372f32a88059783fbc993ab2ebb8967e2e)
2017-06-20Terminate openstack service process using kill command in HA test casesJingLu51-2/+5
JIRA: YARDSTICK-659 In some openstack environment, the service process cannot be killed by killall command but can be terminate by kill command. This patch is about to switch to use kill command in the fault_process_kill.bash to kill processes. Change-Id: Iec455ee56d3f31fb5c16de5994870d1acd33f41a Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit dd42ba3cafb908246da5b90c8bbbc2c7d0beb801)
2017-06-02Merge "fix bug: multi monitor" into stable/danubedanube.3.0Jing Lu1-6/+15
2017-06-01Imporve monitor_process pass criteriaJingLu513-32/+54
JIRA: YARDSTICK-660 The monitor func()'s criteria in the monitor_process.py now is whether at least one process of the specific controller node service is recovered. But in reality is more resonable to use whether processes have been recoverd to it's original amount. This patch is aiming at improving the isssue Change-Id: I950ce2a89555801b96092735b0d670e892049927 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 37921fcd232cd2fbba9f45ef9fa5d8c912f54af6)
2017-06-01fix multi-monitor unitest hangRoss Brattain1-8/+8
need to mock SSH.from_node().execute.return_value because we switch most SSH calls to use from_node() factory function Change-Id: Ibea525c2fcc243d41de8ccbcd40bc98532d69006 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 5271e612d427b29c2da84f8417f4192427ae3977)
2017-06-01Merge "increase monitor number in cases." into stable/danubeJing Lu12-0/+32
2017-06-01fix bug: multi monitorHuanLi1-6/+15
JIRA: YARDSTICK-657 Change-Id: I77223cc43d529828cf3f763529019590c35b2fcb Signed-off-by: HuanLi <lihuansse@tongji.edu.cn> (cherry picked from commit 67b56f734f1d2bb77601c2e75e29fd351f70498e)
2017-06-01Merge "Add a new monitor type: MultiMonitor that can run any number of other ↵Jing Lu3-0/+139
monitors at the same time." into stable/danube
2017-06-01Add a new monitor type: MultiMonitor that can run any number of other ↵LiHuan3-0/+139
monitors at the same time. JIRA: YARDSTICK-397 Change-Id: Ic5cb79f0820029e306373abead1ea43fac9abee2 Signed-off-by: LiHuan <lihuanwk@126.com> (cherry picked from commit 747a3260fef52fb5f7da337bc149ec202a05be6e)
2017-06-01Bugfix: change monitor command in tc019JingLu52-9/+9
JIRA: YARDSTICK-655 The original openstack command used for monitoring high availability openstack nova-api service in tc019 is "nova image-list", the "openstack image list" command used in tc019 now may not correctly show the nova-api service status. This is patch swtich the monitor command to "openstack server list". Change-Id: I8810f28b4328ceb4d911a3041a24774ae9cae8f0 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit a5e13df9381c531716b1e41e7a9dedb130fc6e35)
2017-06-01increase monitor number in cases.HuanLi12-0/+32
change cases to multi-monitor mode and improve monitor accuracy. JIRA: YARDSTICK-397 Change-Id: I6840423dd83899b769df76fbee808f9bf5dc4cfd Signed-off-by: HuanLi <lihuansse@tongji.edu.cn> (cherry picked from commit ab7292a8e3060bf6feaa830b156089fa70854664)
2017-05-06Bugfix: Support HA test cases in TripleOJingLu510-24/+49
Change-Id: Ib1f6f45677e66ca88fb546ea0662f52588e9d336 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 67da8f2ddb5cbf14bbf0df48b10240ba6ebadbe9)
2017-05-04Bugfix: Local Openstack Operation in HA test frameworksdanube.2.RC1danube.2.0tjuyinkanglin5-42/+136
JIRA: YARDSTICK-635 Change-Id: Ic27517714db9325e7a3b1ef623c49af61c36b2b5 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn> (cherry picked from commit 2fb95fbb9380ea7ce92dcb32cd2f0789b9f91bdc)
2017-05-04Merge "standardize ssh auth" into stable/danubeJing Lu88-796/+809
2017-05-04Update release note for Danube.2.0JingLu51-29/+60
Change-Id: I573c156e86ce92eb82179a81d8106752e6421183 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-04standardize ssh authRoss Brattain88-796/+809
we need to be following defautl paramiko rules, first use pkey, then key_filenames (autodetecting ~/.ssh/ keys), then password We have too much boilerplate redudant code everywhere, we need to standardize on a factory function that takes a node dict. Using Python3 ChainMap we can layer overrides and defaults. VNF descriptors have to default key_filename, password to Python None. The only way to do this is to omit key values if the variable is not defined, this way the dict will not have the value and it will default to Python None Add python2 chainmap backport Updated unittest mocking to use ssh.SSH.from_node Change-Id: I80b0cb606e593b33e317c9e5e8ed0b74da591514 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 99abbb424007da2e01762f3c040a39c0157cbe1f)
2017-05-04Store packetsize in influxdbJing Zhang2-3/+4
This allows calculating throughput in Gbps. Add: test_pktgen.py Change-Id: I7e2132ec71985c14570ef18b952b2264ebf7abbc JIRA: YARKSTICK-611 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com> (cherry picked from commit 639450d91ab409f70b6f119291197da40b1d5f0b)
2017-05-04cyclictest: use raw strings to escape \[8Ross Brattain1-4/+6
Change-Id: I36d93eacab2470f90af5653104ad5c07853411bf Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 4a16c5c592f48953d0b6678376f540b54135d51c)
2017-05-04Merge "KVMFORNFV:Passing breaktrace option to cyclictest." into stable/danubeJing Lu1-2/+4
2017-05-04attacker_general: fix logging to use %sRoss Brattain1-11/+10
Change-Id: Ib451d7883eb5df13cfe95477cea43c076ac0452a Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit 45f46d5220cbfa89224d55caf94a079fccd2679f)
2017-05-04KVMFORNFV:Passing breaktrace option to cyclictest.kalyanreddy1-2/+4
This patch is used to add breaktrace option to monitor the latency values while executing cyclictest test cases as a part of kvmfornfv verify and daily jobs. Change-Id: I035ea72a8946a9d3db37a6ee33ffbf3ca67834a2 Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com> (cherry picked from commit 97c39be854022146b1c27fa2932bdc88a8781cf9)
2017-05-04Modify HA test cases and HA test script to support other installerstjuyinkanglin5-18/+20
JIRA: YARDSTICK-633 Change-Id: I65fd1ba11504dc61485f83c3bcc93bec4d41883b Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn> (cherry picked from commit 27cc0643cf93f4b44c12fbdfcc3e0841d46214c4)
2017-05-04Merge "fix ha issue when run tc050~tc054 in ci" into stable/danubeJing Lu3-12/+15
2017-05-04Merge "run ha test case in compass pod" into stable/danubeJing Lu1-4/+28
2017-05-04fix ha issue when run tc050~tc054 in cirexlee87763-12/+15
JIRA: YARDSTICK-634 Change-Id: I46681c7e8afe391eef9c5309470028167e911950 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 71bbbdb18b5f8621b8b4ed9aa0e4fcc1e8882085)
2017-05-04run ha test case in compass podrexlee87761-4/+28
JIRA: YARDSTICK-634 Change-Id: I586d5177598efeda8ac3937d1eb04cd5b97b6ec6 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 5c4b29189bd69912c9bc356a15a46db764045537)
2017-05-04Bugfix: fix HA test case tc046JingLu53-3/+11
The original way to kill keystone service didn't work anymore. this patch uses killall -u to kill keystone processes. Change-Id: I553b716f17a5ab7e57630468517642a92f06dd27 Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 909606466c50aab19017b6e6cedd3e213aff7c27)