aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-02-14constants: fix pylint warnings for OSErrorRoss Brattain1-6/+4
IOError and OSError are the same in Python 3? Anyway we want to ignore ENOENT, not EEXIST JIRA: YARDSTICK-1012 Change-Id: Ia75e41fecce505685745e0099669e45f3e82a1be Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-02-13Merge "Move tests: unit/benchmark"Rodolfo Alonso Hernandez146-928/+832
2018-02-12Move tests: unit/benchmarkEmma Foley146-928/+832
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. Change-Id: I30eb4b0aafe0575d0cddbc946108291f21a98ed8 Jira: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-02-12Merge "Create host VMs configuration"Emma Foley5-2/+438
2018-02-12Merge "Heatstack create: fix str/bytes error in NamedTemporaryFile.write()"Emma Foley2-2/+2
2018-02-12Merge "Replace neutron get network id with shade."Emma Foley4-115/+142
2018-02-12Heatstack create: fix str/bytes error in NamedTemporaryFile.write()Ross Brattain2-2/+2
we need to use jsonutils.dump_as_bytes for NamedTemporaryFile.write() 2018-02-11 19:15:01,366 [INFO] yardstick.orchestrator.heat heat.py:563 Creating stack 'yardstick-4359f33e' START 2018-02-11 19:15:01,935 [ERROR] yardstick.benchmark.contexts.heat heat.py:317 stack failed Traceback (most recent call last): File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/benchmark/contexts/heat.py", line 313, in deploy timeout=self.heat_timeout) File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/orchestrator/heat.py", line 567, in create stack.create(self._template, self.heat_parameters, block, timeout) File "/home/rbbratta/yardstick-upstream/yardstick/yardstick/orchestrator/heat.py", line 56, in create template_file.write(jsonutils.dumps(template)) File "/home/rbbratta/yardstick_venv3/lib/python3.5/tempfile.py", line 622, in func_wrapper return func(*args, **kwargs) TypeError: a bytes-like object is required, not 'str' JIRA: YARDSTICK-1005 Change-Id: I504f23b86119b62f3aea5b83a445b97bf810220c Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-02-12Create host VMs configurationJohn O Loughlin5-2/+438
Using xml files deploy the VM's using the virt plugin. This code generates the user-data network-config meta-data and the vm's xml. It also deploys the vm JIRA: YARDSTICK-963 Change-Id: I97f2d20d0ab75a4444b8b8e6fb65e9e463870af7 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-02-12Merge "Create host networking configuration"Emma Foley4-1/+131
2018-02-12Merge "vpe: convert DPKD_PORT to LINK ID"Emma Foley2-10/+34
2018-02-12Create host networking configurationJohn O Loughlin4-1/+131
Create host networking configuration based on the input configuration file. To define the networks using libvirt, a temporary XML file is generated for each network. JIRA: YARDSTICK-962 Change-Id: I24d1c4d2f2e62884675599deb7db255862283ea4 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-02-12Merge "cleanup: rm node_ID from yardstick prepare_env file"Ross Brattain1-14/+13
2018-02-11Merge "Remove references to "dpdk_nic_bind" utility"Emma Foley11-90/+34
2018-02-11Merge "BugFIX: NSB-setup build script fix for BM"Emma Foley1-12/+12
2018-02-11Merge "Replace "python-heatclient" with "shade" client"Rodolfo Alonso Hernandez5-545/+248
2018-02-09Merge "Prox vnf descriptor cleanup"Rodolfo Alonso Hernandez9-195/+6
2018-02-09Replace neutron get network id with shade.Shobhi Jain4-115/+142
Function get_network_id now uses shade client instead of shade client. Removed redundant function: get_port_id. JIRA: YARDSTICK-890 Change-Id: I6081477fee39fa78131187e65daf3d7d3a9e439f Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
2018-02-09Merge "Make 'Scenario' classes plugable"Emma Foley3-13/+77
2018-02-09Merge "Change nsb_setup.sh to use NSB image instead of raw"Emma Foley1-1/+1
2018-02-09Merge "Delete any previous configuration"Emma Foley4-1/+97
2018-02-09Replace "python-heatclient" with "shade" clientRodolfo Alonso Hernandez5-545/+248
Replaced "python-heatclient" with "shade" client. The "python-heatclient" library is removed from requirements file. "shade" client version 1.22.2 is the required one for OpenStack Pike release. shade is the recommended client to interact with OpenStack clouds [1] [1] https://github.com/openstack-infra/shade JIRA: YARDSTICK-880 Change-Id: Ibbdfc42a543d2d9ed4cf70d78de3de8cbecd0076 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-02-09Delete any previous configurationJohn O Loughlin4-1/+97
Delete any previous configuration using the virsh module in ansible: Networks, VMs and local IPs. JIRA: YARDSTICK-950 Change-Id: Ie4963ab8210ce50ba2e9fa22642ec27a3b2031e1 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-02-08Prox vnf descriptor cleanupAbhijit Sinha9-195/+6
JIRA: YARDSTICK-1003 - There are redundant files for Prox vnf descriptors tg and vnf for 1, 2 and 4 port set-up. - We can use one vnf descriptor file per prox tg and prox vnf, reducing the number of redundant files. - Tested on Prox BM L2fwd 2 and 4 port test case. Change-Id: I4c61fd11725121f19392443460ac2ad39c934e2d Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-02-08Change nsb_setup.sh to use NSB image instead of rawMytnyk, Volodymyr1-1/+1
The `ansible/roles/create_samplevnfs_image/tasks/main.yml` ansible role uses raw NSB image (yardstick-xenial-server.raw) to upload it to OpenStack instead QCOW2 NSB converted image (yardstick-nsb-image.img which is converted from the raw). Changed the create_samplevnfs_image role to to use NSB image. JIRA: YARDSTICK-1000 Change-Id: Ieda9f14e6882ca854331b4eccc9a4cb390b6a475 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-02-07Merge "Improve ovs_deploy.bash script"Ross Brattain1-16/+7
2018-02-07Merge "Auto Generated INFO.yaml file"Ross Brattain1-0/+80
2018-02-07Add a missing colon in the sample configRodolfo Alonso Hernandez1-1/+1
Just in case anyone uses this file for testing. Change-Id: Iff0489f839f3985e43ac31d2a89147e5f16c59e9 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-02-06vpe: convert DPKD_PORT to LINK IDRoss Brattain2-10/+34
http://dpdk.org/doc/guides/sample_app_ug/ip_pipeline.html#application-resources-present-in-the-configuration-file LINK instances are created implicitly based on the PORT_MASK application startup argument. LINK0 is the first port enabled in the PORT_MASK, port 1 is the next one, etc. The LINK ID is different than the DPDK PMD-level NIC port ID, which is the actual position in the bitmask mentioned above. For example, if bit 5 is the first bit set in the bitmask, then LINK0 is having the PMD ID of 5. This mechanism creates a contiguous LINK ID space and isolates the configuration file against changes in the board PCIe slots where NICs are plugged in. Change-Id: I6e449272cfcfb2b2a75c246f7f569e3f923da245 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-02-06Merge "Adding three missing test case descriptions"Rodolfo Alonso Hernandez2-1/+4
2018-02-06Auto Generated INFO.yaml fileagardner1-0/+80
INFO.yaml meant to be machine readable. This file was auto generated from an ldap lookup and your projects INFO file. Meeting times are not currently filled out. please ammend this patchset to complete Going forward comitter promotions should be done against this file. PTLs: Must be merged for you to gain delete access on testresults.opnfv.org If project_lead: is missing (my script could not parse) please amend with same from commiters section eg: project_lead: &opnfv_$project_ptl name: 'Lead Name' email: 'lead email' id: 'lead lfid' company: 'lead company' Change-Id: I241279fba0d9acf69d38242a30541ddb90d22d67 Signed-off-by: agardner <agardner@linuxfoundation.org> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-02-05cleanup: rm node_ID from yardstick prepare_env fileting wu1-14/+13
There is some redundant code in prepare_env.sh script for the fuel installer, the changes are to: 1. Remove variabls 'node_ID' and 'node_line_num'; 2. Rewrite section that replace ip address of controller/compute; 3 Add $YARDSTICK_REPO_DIR in front of variable 'pod_yaml'; JIRA: YARDSTICK-991 Change-Id: I4fbd2c2ba2e6109cc04dc452202fbed701d79b2b Signed-off-by: ting wu <ting.wu@enea.com>
2018-02-05Remove references to "dpdk_nic_bind" utilityRodolfo Alonso Hernandez11-90/+34
In DPDK 16.07 [1], "dpdk_nic_bind" utility was renamed to "dpdk-devbind". This patch removes all references to this previous naming to avoid confusions. [1] https://dpdk-guide.gitlab.io/dpdk-guide/setup/binding.html JIRA: YARDSTICK-995 Change-Id: I827c4c11c9e9e519f33f21b80459e7d65e51545e Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-02-05BugFIX: NSB-setup build script fix for BMAbhijit Sinha1-12/+12
JIRA: YARDSTICK-994 The NSB set-up script for baremetal is broken. In nsb_setp.yml file, "Prepare baremetal machine" is commented due to which the ubuntu_server_baremetal_deploy_samplevnfs.yml file is never called. Change-Id: Icc95018ba746d6efa5baf09322b3255806da8952 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-02-03Merge "Fix i40vf driver download URL"Emma Foley1-1/+1
2018-02-02Fix i40vf driver download URLRodolfo Alonso Hernandez1-1/+1
Fix the download URL of i40vf driver introduced in 15e122a770d6349c84801dd05891e21661cbad2c. In order to avoid the redirection, the URL should be: https://netix.dl.sourceforge.net/project/e1000/ i40evf%20stable/{{ i40evf_version }}/{{ i40evf_gzfile }} JIRA: YARDSTICK-993 Change-Id: Ie19d11d36417914e823b81867046123204111d76 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-02-02Removed zero from tc numberMika Rautakumpu1-1/+1
Originally tc number was TC0042, after fix TC042. Change-Id: I3c36e39a141ec8eb74f9f00d7218bd511a56fbc9 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-02-01Merge "Adding new vFirewall Test cases based on Concurrency, Connections per ↵Ross Brattain59-0/+2980
second, Throughput and Transactions per second for various http locator image sizes including 1b, 4k, 64k, 256k, 1024k"
2018-02-01Merge "Add "img_property" when building Yardstick image"Ross Brattain2-39/+7
2018-02-01Adding three missing test case descriptionsMika Rautakumpu2-1/+4
HA tests TC056, TC057 and TC058 are missing from Yardstick test case list. Missing white space added to tc056.rst. Change-Id: Id56a22ad96af8c3d05d95fb58259e9683ce9fab0 Signed-off-by: Mika Rautakumpu <mika.rautakumpu@nokia.com>
2018-01-31Merge "Modify fuel_baremetal pod config file"Ross Brattain2-10/+15
2018-01-30Add sample OpenStack/SRIOV RFC2544 based TCMytnyk, Volodymyr1-0/+88
Add sample OpenStack/SRIOV RFC2544 based test case which can be run using external Trex. Console log: http://paste.openstack.org/show/658002/ Result output: http://paste.openstack.org/show/658004/ JIRA: YARDSTICK-967 Change-Id: Id0e2d6d47f459c7e6a3370735bab74f7ce502b24 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-01-30Make 'Scenario' classes plugableRodolfo Alonso Hernandez3-13/+77
This patch makes yardstick.benchmark.scenario.base:Scenario classes plugable. A new entry point is added to the setup. This entry point could be extended in other plugin projects to add new Scenario classes. E.g.: take a look at [1]. This is a Yardstick plugin example project. Clone the project and execute, from the project directory: $ sudo -EH python setup.py install This will add a new module to python ('yardstick-new-plugin') and a new Scenario class. Now list the scenarios in Yardstick: $ yardstick scenario list ... | SpecCPU2006_for_VM | Spec CPU2006 benchmark for Virtual Machine | | SpecCPU2006 | Spec CPU2006 benchmark | | Dummy2 | Execute Dummy (v2!) echo | +-----------------------+--------------------------------------------+ [1] https://github.com/ralonsoh/yardstick_new_plugin JIRA: YARDSTICK-910 Change-Id: Ib70ee9bf4dc7ff91d1dd6377317b313288e36bff Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-29Merge "Add Intel Fortville 40G VF driver to sample VNF image"Rodolfo Alonso Hernandez8-0/+165
2018-01-29Merge "Change CivetWeb download URL"Ross Brattain1-2/+2
2018-01-29Merge "Fix up tests for Parser scenario"Ross Brattain2-28/+45
2018-01-29Merge "Move tests: unit/cmd/"Ross Brattain5-1/+1
2018-01-29Add Intel Fortville 40G VF driver to sample VNF imageMytnyk, Volodymyr8-0/+165
1) Add common YAML config file to add kernel drivers to sample VNF image. 2) Add Intel Fortville 40G VF driverto sample VNF image using common YAML config file for drivers. 3) Configure i40evf driver to load on boot JIRA: YARDSTICK-968 Change-Id: I223c8a10d77352baf4f41a481f465970655ba251 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-01-29Merge "Adding support to pull docker images behind proxy"Emma Foley1-0/+10
2018-01-29Improve ovs_deploy.bash scriptRodolfo Alonso Hernandez1-16/+7
Improved ovs_deploy.bash script [1]: - Check if there is an error during the execution. - Removed "prerequisites" function because is not called. - Modified DPDK package installation: execute "make config" and then "make" - Added comments. [1]https://github.com/opnfv/yardstick/blob/master/yardstick/resources/scripts/install/ovs_deploy.bash JIRA: YARDSTICK-916 Change-Id: I3029f983dde72aa46f6fdd61dd64d086ab3c2af6 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-27Fix up tests for Parser scenarioEmma Foley2-28/+45
* Check the results at the test methods * Remove print statement from Parser scenario * Replace assertEquals(x, True) with assertTrue(x) Change-Id: I5c2612692e625fc888c7ce7637b9e1625440724a Signed-off-by: Emma Foley <emma.l.foley@intel.com>