aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-01-30Make 'Scenario' classes plugableRodolfo Alonso Hernandez3-13/+77
This patch makes yardstick.benchmark.scenario.base:Scenario classes plugable. A new entry point is added to the setup. This entry point could be extended in other plugin projects to add new Scenario classes. E.g.: take a look at [1]. This is a Yardstick plugin example project. Clone the project and execute, from the project directory: $ sudo -EH python setup.py install This will add a new module to python ('yardstick-new-plugin') and a new Scenario class. Now list the scenarios in Yardstick: $ yardstick scenario list ... | SpecCPU2006_for_VM | Spec CPU2006 benchmark for Virtual Machine | | SpecCPU2006 | Spec CPU2006 benchmark | | Dummy2 | Execute Dummy (v2!) echo | +-----------------------+--------------------------------------------+ [1] https://github.com/ralonsoh/yardstick_new_plugin JIRA: YARDSTICK-910 Change-Id: Ib70ee9bf4dc7ff91d1dd6377317b313288e36bff Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-29Merge "Add Intel Fortville 40G VF driver to sample VNF image"Rodolfo Alonso Hernandez8-0/+165
2018-01-29Merge "Change CivetWeb download URL"Ross Brattain1-2/+2
2018-01-29Merge "Fix up tests for Parser scenario"Ross Brattain2-28/+45
2018-01-29Merge "Move tests: unit/cmd/"Ross Brattain5-1/+1
2018-01-29Add Intel Fortville 40G VF driver to sample VNF imageMytnyk, Volodymyr8-0/+165
1) Add common YAML config file to add kernel drivers to sample VNF image. 2) Add Intel Fortville 40G VF driverto sample VNF image using common YAML config file for drivers. 3) Configure i40evf driver to load on boot JIRA: YARDSTICK-968 Change-Id: I223c8a10d77352baf4f41a481f465970655ba251 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-01-29Merge "Adding support to pull docker images behind proxy"Emma Foley1-0/+10
2018-01-27Fix up tests for Parser scenarioEmma Foley2-28/+45
* Check the results at the test methods * Remove print statement from Parser scenario * Replace assertEquals(x, True) with assertTrue(x) Change-Id: I5c2612692e625fc888c7ce7637b9e1625440724a Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-27Adding support to pull docker images behind proxyDeepak S1-0/+10
This patch creates a http_proxy.conf in docker service, to enable docker commands behind the proxy Change-Id: Iac38a086026c11e89e534728467dc7da0e01ba59 Signed-off-by: Deepak S <deepak.s@linux.intel.com>
2018-01-26Merge "Add python-openstackclient in docker image"Ross Brattain1-1/+1
2018-01-26Merge "Replace assertEqual(x, True|False) with assert[True|False](x)"Ross Brattain22-48/+48
2018-01-26Merge changes from topic 'bug/yardstick-864'Ross Brattain17-170/+206
* changes: Replace assertEquals with assertEqual Make files pep8 compliant before using assertTrue|False
2018-01-26Merge "Remove generated file in 'test_build_vm_xml'"Rodolfo Alonso Hernandez1-3/+3
2018-01-26Add python-openstackclient in docker imageAlex Yang1-1/+1
"openstack: command not found" error occurred in [1]. The version of python-openstackclient is listed in [2]. This program should be installed in the container image to make CI work for now. [1]: https://build.opnfv.org/ci/job/yardstick-daisy-baremetal-daily-master/114/ [2]: https://github.com/openstack/requirements/blob/stable/pike/global-requirements.txt Change-Id: Idb50e26bb2ca36f2dd6b6dddf94680d479cb9c9f Signed-off-by: Alex Yang <yangyang1@zte.com.cn>
2018-01-25Replace assertEqual(x, True|False) with assert[True|False](x)Emma Foley22-48/+48
Change-Id: Id19df79b4d27aab1a83d8350ce6395e87c13472b JIRA: YARDSTICK-903 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-25Replace assertEquals with assertEqualEmma Foley6-18/+17
unittest.assertEquals is deprecated[1], and has been replaced with unittest.assertEqual. [1] https://docs.python.org/2/library/unittest.html#deprecated-aliases Change-Id: I9c6320e3a9ec5528036b529a9c32fc48b0bcfd62 JIRA: YARDSTICK-864 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-25Make files pep8 compliant before using assertTrue|FalseEmma Foley13-152/+189
JIRA: YARDSTICK-903 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Id7912b5ddee36e7366bcfa824379853efd0a89f1
2018-01-25Move tests: unit/cmd/Emma Foley5-1/+1
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. Change-Id: I505d72e1c646fea1976a0bf854369c6b6308bbb1 Jira: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-25Remove img_modify_playbook from nsb_setup.sh scriptMytnyk, Volodymyr2-2/+2
The `img_modify_playbook` variable is not used anymore by the build_yardstick_image.yml. The `img_property` variable is used instead. The `img_modify_playbook` usage has been removed and the `img_property` has been introduced in YARDSTICK-879 JIRA story. JIRA: YARDSTICK-964 Change-Id: I0239544c4f4078de7a4817292ab6bd789c21e944 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> Signed-off-by: Alonso Hernandez, Rodolfo <rodolfo.alonso.hernandez@intel.com>
2018-01-24Remove generated file in 'test_build_vm_xml'Rodolfo Alonso Hernandez1-3/+3
Change I22e95c488e27d6e2a8fdf6c1a07faab275fa6bba introduced a change in test case 'test_build_vm_xml' [1]. This test case generates a file which is stored locally but never removed. [1]https://github.com/opnfv/yardstick/blob/80dc9034edeb05f66bfa6264ae0adf0f6aea60da/tests/unit/benchmark/contexts/standalone/test_model.py JIRA: YARDSTICK-918 Change-Id: I91d39bb37c3d8a273fe68155bb308c5a3bc1ca9d Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-24Merge "'libvirt' guest console in Standalone model"Ross Brattain2-24/+31
2018-01-24Merge "Check RS for virtualized OpenStack/Yardstick"Ross Brattain5-0/+133
2018-01-24Merge "Cleanup of redundant files from Prox directory"Rodolfo Alonso Hernandez15-631/+0
2018-01-24Check RS for virtualized OpenStack/YardstickStepan Andrushko5-0/+133
Draft for env requirements reading and validation Script can be run from tools/virt_ci_rampup.sh. First requirement file is parsed/stored. This file must be created in ahead and named as 'infra_deploy.yaml'. Then separate ansible role is used to validate resources. Ansible-role fails if there is not enough resources on the host for cpu, ram, disk space. JIRA: YARDSTICK-945 Change-Id: I86cd4bdc963de3aa51392fc73a239cbd426bc64a Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-01-23Merge "Use assertIn(x, y) instead of other variations"Rodolfo Alonso Hernandez2-16/+22
2018-01-23Cleanup of redundant files from Prox directoryAbhijit Sinha15-631/+0
JIRA: YARDSTICK-965 Removed the redundant files and directory from Prox test folder. Change-Id: I6167f0a4ccdd581153dad3ec9f5eaaf2619aacbd Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-01-23Merge "Enable iommu support in grub"Ross Brattain3-0/+123
2018-01-23Rename ResourceProfile.check_if_sa_running()Emma Foley7-55/+53
* Update log message and rename method to make debugging easier * Fix pep8 violations in touched files JIRA: YARDSTICK-859 Change-Id: Id138d72cd8557ffacd5dcc81d06feeb484e13625 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-22Enable iommu support in grubJan Malanik3-0/+123
JIRA: YARDSTICK-895 It's required for sriov standalone yardstick tests. This part of commit message will be deleted: This code will be enabled when https://gerrit.opnfv.org/gerrit/#/c/47957/ will be merged, because it requires host reboot. Change-Id: I0ec9cbf90a9d83d54e545fcf421b8baf206601a4 Signed-off-by: Jan Malanik <janx.malanik@intel.com> Signed-off-by: Malanik Jan <janx.malanik@intel.com>
2018-01-22Merge "Clean unit tests in "benchmark.scenarios.lib.test_create_volume.py"Ross Brattain2-21/+71
2018-01-22Merge "Move tests: unit/dispatcher"Ross Brattain3-9/+3
2018-01-22Merge "Move tests: unit/orchestrator/"Ross Brattain3-84/+231
2018-01-22Merge "Replace "oslo_utils.importutils" with standard library "importlib""Ross Brattain6-29/+73
2018-01-22Clean unit tests in "benchmark.scenarios.lib.test_create_volume.pyEmma Foley2-21/+71
* Use mock_object.assert_called_with instead of self.assertTrue(mock_object.called) * Remove an unneeded if clause in CreateVolume * Add individual tests for each method in CreateVolume Change-Id: I54cc56434d316f059b3822879145e6a299866fcb Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-01-20Merge "update docs for procedure after host reboot"Ross Brattain1-6/+10
2018-01-19Merge "Vincenzo stepping down as Yardstick committer"Ross Brattain1-1/+0
2018-01-19Change ansible version to 2.4.2John O Loughlin1-1/+1
Modified requirements.txt to update ansible version to 2.4.2 For the ansible virt module [1] XML templates are required. To edit, the XML templates the XML module is required. This is new in ansible 2.4 [2] There is no max version restriction for ansible in OpenStack [3]. [1] http://docs.ansible.com/ansible/latest/virt_module.html [2] https://docs.ansible.com/ansible/2.4/xml_module.html [3] https://github.com/openstack/kolla-ansible/blob/stable/pike/doc/source/user/quickstart.rst JIRA: YARDSTICK-948 Change-Id: I19b178f695f7381a3ecfbdb74f953a1276250958 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-01-19Replace "oslo_utils.importutils" with standard library "importlib"Rodolfo Alonso Hernandez6-29/+73
The current implementation of dynamic library importation is prone to failure [1]: - "sys.modules" is modified manually, which is something not recommended [2]. - When a module is imported is added to "sys.modules"; that means there is no need to manually create an entry in this object. - "importlib" library is part of the standard library and is now available in PY3 and PY2 (backported). This library contains a function called "import_module" to import a module in runtime. [1]https://github.com/opnfv/yardstick/blob/d2c7cc4e9768ed003257a95c92cdb278d516761b/yardstick/common/utils.py#L72-L93 [2]http://justus.science/blog/2015/04/19/sys.modules-is-dangerous.html JIRA: YARDSTICK-949 Change-Id: Ide3b74f98858d06fa275fb6c9b78ceeaa64feed5 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-18Vincenzo stepping down as Yardstick committerRoss Brattain1-1/+0
From: opnfv-tech-discuss-bounces@lists.opnfv.org [mailto:opnfv-tech-discuss-bounces@lists.opnfv.org] On Behalf Of Riccobene, Vincenzo M Sent: Thursday, January 18, 2018 2:35 AM To: opnfv-tech-discuss@lists.opnfv.org Subject: [opnfv-tech-discuss] Stepping down as Yardstick committer Hello, I am currently a committer for the OPNFV Yardstick project, but as I see unfortunately in the last months I have been absent from the project since other commitments took higher priorities and all my time, resulting in no major contributions to Yardstick, and I consequently decided to step down from the positon of committer. It has been a great pleasure to contribute to the community and I hope I will be able to contribute again in the future. Thank you very much all! Best Regards. Vince Change-Id: I809021b4081caddb60549204a742b93134190a87 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-17Merge "Fix Cirros image name in CI script"Ross Brattain1-1/+1
2018-01-17Move tests: unit/orchestrator/Emma Foley3-84/+231
* Fix pylint errors * Add notes where additional action is needed. Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged for follow-up, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Idbf56d0cd3b29b70691acd6af4d5ac3c400d2ccc
2018-01-16Proposing Emma Foley as a committer in YardstickRoss Brattain1-0/+1
Emma has contributed to Yardstick in many ways Achievement/Contributions include: - Provided high-quality code review comments. - Tox improvements - Refactored unittest to OpenStack conventions - Improved unittest code coverage - Improved code quality by fixing warnings and errors - Documentation review and update - Split out test-requirements.txt - Attending OPNFV Euphrates Plugfest Portland - Starting Traffic-Generator-as-a-service initiative with NFVBench and VSPerf - Contributions: https://gerrit.opnfv.org/gerrit/#/q/owner:emma.l.foley%2540intel.com Change-Id: I639fa27a7271bf9996b2ee0e19a689644af54afe Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-16Proposing Rodolfo Alonso Hernandez as a committer in YardstickRodolfo Alonso Hernandez1-0/+1
Rodolfo has contributed to Yardstick in many ways Achievement/Contributions include: - Userguide review and update - Provided high-quality code review comments. - Improved unittest code coverage - Improved code quality by fixing warnings and errors - Jenkins gate check improvements - Pip requirements checking and updating - Migration to Shade removing OpenStack project clients. - Regularly attending Yardstick meetings - JIRA personal dashboard: https://jira.opnfv.org/secure/Dashboard.jspa?selectPageId=11400 - Contributions: https://gerrit.opnfv.org/gerrit/#/q/owner:rodolfo.alonso.hernandez%2540intel.com Change-Id: I3e5f14a3f99fffcd4bd4973aedc44ce4beeb22be Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-01-17Merge "Proposing Jack Chan as a committer in Yardstick"Ross Brattain1-0/+1
2018-01-16Fix Cirros image name in CI scriptRodolfo Alonso Hernandez1-1/+1
Fixed the name of Cirros image used in OpenStack. The image name is written in lowercase letters. JIRA: YARDSTICK-842 Change-Id: Iff0b494125be61a055da753eaf57903b64f18509 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-01-16Merge "bugfix: Fix duplicate 'address' in standlone SRIOV"Ross Brattain2-5/+25
2018-01-16bugfix: Fix duplicate 'address' in standlone SRIOVDino Madarang2-5/+25
* Add unit test per Rodolfo's comment Creating a VM using generted xml file /tmp/vm_sriov_0.xml returns an XML error: missing source address type. This fix modifies generted xml from: <source> <address> <address bus="0x1a" domain="0x0000" function="0x0" slot="0x10" type="pci" /> </address> </source> to: <source> <address bus="0x1a" domain="0x0000" function="0x0" slot="0x10" type="pci" /> </source> Change-Id: I694153e7468986bacb19ba3e09e761993aad7184 Signed-off-by: Dino Simeon Madarang <dinox.madarang@intel.com> Reviewed-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> Reviewed-by: Ross Brattain <ross.b.brattain@intel.com> Reviewed-by: Alain Jebara <alain.jebara@intel.com> Reviewed-by: Emma Foley <emma.l.foley@intel.com>
2018-01-16Merge "bugfix:Incorrect title for testcase 081"Jing Lu1-2/+2
2018-01-16Merge "Update Dockerfile.aarch64.patch"Ross Brattain1-9/+21
2018-01-15update docs for procedure after host rebootJohn O Loughlin1-6/+10
Added instructions to restart nginx and uwsgi after the host is rebooted. Added instructions to start yardstick container if the host is rebooted. Removed section on virtual python environment as it is not needed. JIRA: YARDSTICK-919 Change-Id: I6e8bd1d52954c2aa138ce7879211b91b3644ecb2 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>