summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2017-06-20Acquire NSB specific data from Heat.Edward MacGillivray11-162/+798
First we add mac_address, subnet_cidr to Heat template outputs Then we convert those into a form for NSB and add vld_id. NSB also requires PCI Bus ID, kernel driver and dpdk_port_num. We get this by ssh-ing into instance and dumping sysfs We also need to fix allow for ssh key auth, and implement relative path file loading so NSB can find all its YAML files JIRA: YARDSTICK-580 Change history: don't hide heat create tracebacks we need tracebacks for debug vnf_generic: add task_path to scenario so we can load relative paths for vnf_generic we want to be able to load yaml relative to the task path For example: traffic_profile: ../../traffic_profiles/fixed.yaml topology: ping_tg_topology.yaml # TODO: look in relative path where the tc.yaml is found These need to be relative to samples/vnf_samples/nsut/ping/tc_ping_heat_context.yaml Add a scenario["task_path"] entry heat: log actual exception vnf_generic: replace list with set and iterate over values() some general refactors to remove redundact lookups and type conversions heat: provide mac_address, device_id and network_id from outputs We may need more information to dynamically determine test topology. Towards this end return more info in the heat template. We can return mac_address, device_id and network_id. Once we have this info we can add it to the context_cfg as an interfaces dict. add sample vnf ping multi-network test this test requires 3 network, one for mgmt and the other two for NSB traffic tests We have to make sure we don't use DPDK on mgmt interface because DPDK unbinds the driver heat: convert networks to OrderedDict so we can lookups networks as well as iterate over them in consisitent order heat: and vld_id to networks for vnf_generic vnf_generic uses vld_id Virtual Link Descriptor ID to identify interfaces Add the key to the networks dict and store in Networks object implement relative path file loading in vnf_generic in multiple places we need to load a file relative to the task path, so add open_relative_file_path and modify load_vnf_model to include the scenario_cfg parameter so we have access to task_path DRAFT: heat timeout support Heat stack in CI job failed due to some Nova issue. But then apparently yardstick kept running and took 180mins to timeout https://build.opnfv.org/ci/view/bottlenecks/job/bottlenecks-compass-posca_stress_ping-baremetal-daily-master/16/console We can add a Heat create timeout and fail faster if there is an error. The question is how long should we wait for a Heat stack to deploy. We can set a default and allow override in the heat context config, if users make complicated stacks heat: get netmask and gateway from heat outputs we have do some tricky business with finding the subnet cidr and converting it into netmask vnf_generic: get vpci, driver and dpdk_port_num use a big old find command to dump all the sysfs netdev info nicely. This was re-used from autotest FCoE tests. r"""find /sys/devices/pci* -type d -name net -exec sh -c '{ grep -sH ^ \ +$1/ifindex $1/address $1/operstate $1/device/vendor $1/device/device \ +$1/device/subsystem_vendor $1/device/subsystem_device ; \ +printf "%s/driver:" $1 ; basename $(readlink -s $1/device/driver); } \ +' sh \{\}/* \; This finds all PCI devices that are network devices, then dumps all the relevant info using /bin/sh. Then we parse this into a 'netdevs' dict inside the node_dict and also convert into VNF fields we need. vnf_generic: set node name for kpis node is a dict, so we have to use node_name vnfdgen: we CANNOT use TaskTemplate.render because it does not allow for missing variables, we need to allow password for key_filename to be undefined remove default ssh password hack, once rendering is fixed add new example tc_external_ping_heat_context Change-Id: If1fe0c1a2ab0a5be17e40790a66f28f706fa44d6 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> Signed-off-by: Edward MacGillivray <edward.s.macgillivray@intel.com>
2017-05-27Imporve monitor_process pass criteriaJingLu513-32/+54
JIRA: YARDSTICK-660 The monitor func()'s criteria in the monitor_process.py now is whether at least one process of the specific controller node service is recovered. But in reality is more resonable to use whether processes have been recoverd to it's original amount. This patch is aiming at improving the isssue Change-Id: I950ce2a89555801b96092735b0d670e892049927 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-27Merge "This is the vote for yardstick new PTL"Kubi1-2/+2
2017-05-25Terminate openstack service process using kill command in HA test casesJingLu51-2/+5
JIRA: YARDSTICK-659 In some openstack environment, the service process cannot be killed by killall command but can be terminate by kill command. This patch is about to switch to use kill command in the fault_process_kill.bash to kill processes. Change-Id: Iec455ee56d3f31fb5c16de5994870d1acd33f41a Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-24fix bug: multi monitorHuanLi1-6/+15
JIRA: YARDSTICK-657 Change-Id: I77223cc43d529828cf3f763529019590c35b2fcb Signed-off-by: HuanLi <lihuansse@tongji.edu.cn>
2017-05-22This is the vote for yardstick new PTLkubi1-2/+2
Ross Brattain who is yardstick commtter has been nominated as new PTL candidate before the nomination end date. As we only have one candidate, we will use gerrit to vote instead of civs all yardstick committers, please vote +2 or -2 before this friday the vote will be closed at that time Reference: https://wiki.opnfv.org/display/yardstick/Yardstick+PTL+Election Change-Id: I561f70051ed2593581ab909f08bd8be88c5b0e77 Signed-off-by: kubi <jean.gaoliang@huawei.com>
2017-05-22Merge "Added PyCharms files to gitignore."Rex Lee1-0/+2
2017-05-20Merge "increase monitor number in cases."Rex Lee12-0/+32
2017-05-18increase monitor number in cases.HuanLi12-0/+32
change cases to multi-monitor mode and improve monitor accuracy. JIRA: YARDSTICK-397 Change-Id: I6840423dd83899b769df76fbee808f9bf5dc4cfd Signed-off-by: HuanLi <lihuansse@tongji.edu.cn>
2017-05-16Added PyCharms files to gitignore.Maciej Skrocki1-0/+2
Change-Id: I09e9aedd80262cf75b0c0549552fc90517a24bf0 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-05-16Bumped ansible version to 2.2.2.Maciej Skrocki1-1/+1
Change-Id: Ibdf633bd475cc295f53e8236b1938a3354cb4f99 Signed-off-by: Maciej Skrocki <maciej.skrocki@intel.com>
2017-05-16fix multi-monitor unitest hangRoss Brattain1-8/+8
need to mock SSH.from_node().execute.return_value because we switch most SSH calls to use from_node() factory function Change-Id: Ibea525c2fcc243d41de8ccbcd40bc98532d69006 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-05-16Bugfix: change monitor command in tc019JingLu52-9/+9
JIRA: YARDSTICK-655 The original openstack command used for monitoring high availability openstack nova-api service in tc019 is "nova image-list", the "openstack image list" command used in tc019 now may not correctly show the nova-api service status. This is patch swtich the monitor command to "openstack server list". Change-Id: I8810f28b4328ceb4d911a3041a24774ae9cae8f0 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-16Merge "Add a new monitor type: MultiMonitor that can run any number of other ↵Ross Brattain3-0/+139
monitors at the same time."
2017-05-12Create flavor from heat contextDanielMartinBuckley6-20/+266
JIRA: YARDSTICK-582 Create a customizable flavor via heat context. All heat parameters are configurable including Core Affinity. The default flavor name is XXXX-flavor where XXXX is stackname. Flavor attributes are taken from the heat context file. If a flavor attribute is not used it takes default attribute value. If flavor name is not specified it uses the server name + "-flavor" or stack-name + "-flavor". Compute node specific attributes are configurable via "extra_specs" attribute. See https://docs.openstack.org/admin-guide/compute-flavors.html for details. Change-Id: If4015970b889b0b95bfa8eba9491ebf31e92f2c7 Signed-off-by: DanielMartinBuckley <daniel.m.buckley@intel.com>
2017-05-11Merge "Extend TC008 to run pktgen-dpdk inside VM Need a fast path inside VM ↵Rex Lee8-34/+772
to verify full throughput of SRIOV and OVS-dpdk."
2017-05-11Merge "KVMFORNFV: Suppress tracing with breaktrace option "Jing Lu1-1/+1
2017-05-10Merge "pass user_data to heat template"Ross Brattain2-0/+25
2017-05-09KVMFORNFV: Suppress tracing with breaktrace option kalyanreddy1-1/+1
This patch is used to suppress tracing while executing cyclictest with breaktrace option as breaktrace parameter will enable the ftrace by default. Change-Id: I776953d8cd56722b7c0f697b12b09051021334fb Signed-off-by: Gundarapu Kalyan Reddy <reddyx.gundarapu@intel.com>
2017-05-06Bugfix: Support HA test cases in TripleOJingLu510-24/+49
Change-Id: Ib1f6f45677e66ca88fb546ea0662f52588e9d336 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-04Merge "Update release note for Danube.2.0"Jing Lu1-29/+60
2017-05-04Merge "Bugfix: Local Openstack Operation in HA test frameworks"Jing Lu5-42/+136
2017-05-04Update release note for Danube.2.0JingLu51-29/+60
Change-Id: I573c156e86ce92eb82179a81d8106752e6421183 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-04Bugfix: Local Openstack Operation in HA test frameworkstjuyinkanglin5-42/+136
JIRA: YARDSTICK-635 Change-Id: Ic27517714db9325e7a3b1ef623c49af61c36b2b5 Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-05-04Merge "Bugfix: fix HA test case tc046"Jing Lu3-3/+11
2017-05-04Merge "Modify HA test cases and HA test script to support other installers"Jing Lu5-18/+20
2017-05-04Modify HA test cases and HA test script to support other installerstjuyinkanglin5-18/+20
JIRA: YARDSTICK-633 Change-Id: I65fd1ba11504dc61485f83c3bcc93bec4d41883b Signed-off-by: tjuyinkanglin <14_ykl@tongji.edu.cn>
2017-05-04Bugfix: fix HA test case tc046JingLu53-3/+11
The original way to kill keystone service didn't work anymore. this patch uses killall -u to kill keystone processes. Change-Id: I553b716f17a5ab7e57630468517642a92f06dd27 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-05-04Merge "Bugfix: KeyError when using http dispatcher"Jing Lu2-4/+10
2017-05-03Merge "run ha test case in compass pod"Jing Lu1-4/+28
2017-05-03Merge "fix ha issue when run tc050~tc054 in ci"Jing Lu3-12/+15
2017-05-03fix ha issue when run tc050~tc054 in cirexlee87763-12/+15
JIRA: YARDSTICK-634 Change-Id: I46681c7e8afe391eef9c5309470028167e911950 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-05-03Merge "Point to user guide to get started on VNF testing"Ross Brattain1-1/+1
2017-05-03run ha test case in compass podrexlee87761-4/+28
JIRA: YARDSTICK-634 Change-Id: I586d5177598efeda8ac3937d1eb04cd5b97b6ec6 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2017-05-03Merge "cachestat: use raw strings to escape \d"Rex Lee1-1/+1
2017-05-03Bugfix: KeyError when using http dispatcherchenjiankun2-4/+10
JIRA: YARDSTICK-632 When we use http dispatcher to output yardstick result. It can upload data, but when we query the data, it get a KeyError. Change-Id: I5410c207c68cff2621ff8184ae17daa4c286cea5 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-05-01Extend TC008 to run pktgen-dpdk inside VMJing Zhang8-34/+772
Need a fast path inside VM to verify full throughput of SRIOV and OVS-dpdk. Update 1: Change newly added file names to avoid conflict Update 2: Add more unit test cases Update 3: Fix default parameter typo for testpmd Update 4: Adapted to the pktgen-dpdk prompt change from "Pktgen>" to "Pktgen:/>", now just expect "Pktgen" Update 5: Per comment, merge common functions between latency and throughput tests to utils.py Update 6: Per comment, seperate the test case from TC008 to a new test case TC077 Change-Id: I1f7471d4ba77636a3a66c79c2652578321312185 JIRA: YARDSTICK-614 Signed-off-by: Jing Zhang <jing.c.zhang@nokia.com>
2017-04-27Merge "bugfix: fix HA testcases"Jing Lu2-2/+2
2017-04-27bugfix: fix HA testcasesJingLu52-2/+2
Change-Id: Ib38e94610a108ff7195cefdfaf048e0f4fd894e8 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-04-27Merge "Bugfix: fix HA testcases"Rex Lee3-11/+3
2017-04-27Bugfix: fix HA testcasesJingLu53-11/+3
Change-Id: Ic930c59fcf3d7e53d385016051596b6563dca0d7 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2017-04-27Merge "Bugfix: yardstick env prepare cmd do not support other installer"Jing Lu1-23/+7
2017-04-27Bugfix: yardstick env prepare cmd do not support other installerchenjiankun1-23/+7
JIRA: YARDSTICK-629 Currently yardstick env prepare do not support other installer. I will add follow support: 1. Environment variable already exists: then do not fetch openrc file and do not add EXTERNAL_NETWORK variable. 2. Already have openrc file in /etc/yardstick/openstack.creds: only source this file in API. 3.Environment variable not exists and openrc file not in /etc/yardstick/openstack.creds: fetch openrc file and append EXTERNAL_NETWORK variable. Change-Id: I4ce98f2e17ef8e0a0a1c33c3862ca301c53bb6c2 Signed-off-by: chenjiankun <chenjiankun1@huawei.com>
2017-04-26Point to user guide to get started on VNF testingDeepak S1-1/+1
Change-Id: Id050d06deff665e6eaa97876d50e1698697e61e5 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2017-04-26Bugfix: fix multi-region supportRoss Brattain1-1/+5
When running with multiple regions we need to specify the region when we select the endpoint. the region is specified in the OS_REGION_NAME env variable Change-Id: I37853dd42f6d9013d4475b5e3b2b9f97b6bdc8d0 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2017-04-25Merge "Update virtualenv installation step in userguide"Kubi1-1/+19
2017-04-25Bugfix: Make tc019 abd tc025 accept --task-args options to change pod.yamlxudan2-2/+6
JIRA: YARDSTICK-628 Change-Id: I7d1b84232a7477a2854ef1625cc63521999eff65 Signed-off-by: xudan <xudan16@huawei.com>
2017-04-24Merge "operation_general: fix logging to use %s"Rex Lee1-1/+1
2017-04-24Merge "standardize ssh auth"Rex Lee88-796/+809
2017-04-24Merge "Add a new runner to test end-to-end fast data path"Rex Lee1-0/+8