aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-06-21Merge "Convert SSH custom exceptions to Yardstick exceptions" into stable/fraserRodolfo Alonso Hernandez6-56/+53
2018-06-21Merge "Remove AnsibleCommon class method mock" into stable/fraserRodolfo Alonso Hernandez1-12/+8
2018-06-21Merge "Error when adding SR-IOV interfaces in SR-IOV context" into stable/fraserRodolfo Alonso Hernandez2-12/+18
2018-06-21Merge "Remove __init__ method overriding in HeatContextTestCase" into ↵Rodolfo Alonso Hernandez1-7/+4
stable/fraser
2018-06-21Merge "Bump oslo.messaging version to 5.36.0" into stable/fraserRodolfo Alonso Hernandez1-0/+1
2018-06-21Merge "Set "cmd2" library to version 0.8.6" into stable/fraserRodolfo Alonso Hernandez1-0/+1
2018-06-21Error when adding SR-IOV interfaces in SR-IOV contextRodolfo Alonso Hernandez2-12/+18
Method "add_sriov_interfaces" in Libvirt class throws an error when trying to add SR-IOV interfaces in the XML file. Function "setup_sriov_context" in SriovContext if passing to "_enable_interfaces" method the XML file name instead of passing the XML string. JIRA: YARDSTICK-1189 Change-Id: If021c102311ecb98cb26934f78067dfc720e4291 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit 72df0eaac4a2a1f23439af7f249c2b5d18d1b819)
2018-06-21Remove __init__ method overriding in HeatContextTestCaseRodolfo Alonso Hernandez1-7/+4
Unit test case clases should implement setUp() method instead of overriding __init__() method. JIRA: YARDSTICK-1210 Change-Id: I0f9a10575f9aeebf76dfa84619e59589b3ea83f6 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit 619bed631f064a94ab20ac296802d467ebe32318)
2018-06-21Correctly set PYTHONPATH in DockerfileJohn O Loughlin1-2/+2
JIRA: YARDSTICK-1144 Change-Id: I8c0fe229ed620417a85356e017b171260373c43f Signed-off-by: John O Loughlin <john.oloughlin@intel.com> (cherry picked from commit a114dc39f003beb1bb1ed12ed17fd3a6d0e7deaa)
2018-06-20Convert SSH custom exceptions to Yardstick exceptionsRodolfo Alonso Hernandez6-56/+53
JIRA: YARDSTICK-1215 Change-Id: I5ecfd3dccd91b07cd8de5309dfa1a372eff16ed0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit dde8fa628483deec352e176cea8decdbf6bed7e8)
2018-06-20Bump oslo.messaging version to 5.36.0Rodolfo Alonso Hernandez1-0/+1
A decoding error was introduced in the AMQP libraries installed by oslo.messaging version 5.30.2. Error example: File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/ .tox/functional/local/lib/python2.7/site-packages/amqp/utils.py", line 89, in str_to_bytes return s.encode('utf-8') UnicodeDecodeError: 'ascii' codec can't decode byte 0xd2 in position 3: ordinal not in range(128) This problem is fixed in the library versions installed in version 5.36.0. JIRA: YARDSTICK-1204 Change-Id: I4719d8e0a0891ebbb3b87c31d593d15f897ef53a Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry-picked from commit bcc841699c8072a74378774593729931e81b4398)
2018-06-20Set "cmd2" library to version 0.8.6Rodolfo Alonso Hernandez1-0/+1
Last "cmd2" version, 0.9.0, removed Python 2+ support [1]. In order to support Python 2.7, version 0.8.6 (or earlier) must be installed. [1] https://github.com/python-cmd2/cmd2/commit/e54e5a5b891548df4df0acb04b6e607ad8f871b1 JIRA: YARDSTICK-1205 Change-Id: Ic2fe57438720de5b21c75f9456e653c6facf3ae9 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit c4d821c58858418ce8dfec95426f06ae11b25c7b)
2018-06-20Remove AnsibleCommon class method mockRodolfo Alonso Hernandez1-12/+8
In [1], several methods in "AnsibleCommon" class are mocked, but those mocks are not removed after the test execution. Depending on the test execution order, this affects other results. [1] https://github.com/opnfv/yardstick/blob/stable/fraser/yardstick/tests/unit/service/test_environment.py#L20 JIRA: YARDSTICK-1214 Change-Id: I85ef702b3b5b2fda5cf453a21b9f0bec61b155f0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit e204c5063ab86d4ed2bff296959afae43866890f)
2018-06-20Move tests: unit/network_services/{lib/,collector/,*.py}Emma Foley9-26/+8
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Idc2e70291b6d9b4cf7e7249a10c4a290b999206c (cherry picked from commit 2e75e6d27240945ec985998bbe9ec6241d11626a)
2018-06-19Update pmd/lcore mask for OVS-DPDK contextStepan Andrushko2-3/+41
Added default values for pmd/lcore mask to the SampleVNF test case for Trex TG. lcore mask - specifies the CPU cores used for non-datapath OVS-DPDK threads. pmd mask - specifies the CPU cores used for data path packet processing. Updated documentation for Standalone OVS-DPDK context. JIRA: YARDSTICK-1246 Change-Id: I8d008a185c94d2047ffa4769d7974bc4d283fd7f Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com> (cherry picked from commit 779a868348c3361f2a3054f06002807fd69a6549)
2018-06-14Merge "Bugfix: openrc api dump should be safe_dump" into stable/fraserAbhijit Sinha4-6/+36
2018-05-25Merge "[release] Yardstick release note 6.1.0" into stable/fraseropnfv-6.1.0Ross Brattain1-6/+35
2018-05-25Merge "Get HA test case results on failure" into stable/fraserRoss Brattain5-76/+56
2018-05-25Merge "Bugfix: Yardstick GUI build fails on Fraser 6.1.0" into stable/fraserRoss Brattain1-1/+1
2018-05-25Merge "update docker image tag to 6.1.0" into stable/fraserRoss Brattain1-1/+1
2018-05-25[release] Yardstick release note 6.1.0rexlee87761-6/+35
JIRA: YARDSTICK-1182 Change-Id: I3baca52e9bc0360b43f2ce61ea2f166a70e8c90a Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 23d911a604f5686ade4fbbf80e0e046a2160dc8c)
2018-05-25Bugfix: Yardstick GUI build fails on Fraser 6.1.0rexlee87761-1/+1
Yardstick web GUI build fails due to angular version JIRA: YARDSTICK-1202 Change-Id: Ie075d18cb2eac2070267759978cbdb7c784599ef Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 81059ba8c7293a50aee72251afee89eb65547562)
2018-05-24update docker image tag to 6.1.0Ross Brattain1-1/+1
Change-Id: Ia7a0668c1c2461fceb97425bcb6ade5bdb105c79 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-05-24Dockerfile: add ping for prepare_env.shRoss Brattain2-3/+3
INFO: Creating openstack credentials .. Verifying connectivity to 10.20.0.2... /home/opnfv/repos/yardstick//tests/ci/prepare_env.sh: line 56: ping: command not found /home/opnfv/repos/yardstick//tests/ci/prepare_env.sh: line 56: ping: command not found https://build.opnfv.org/ci/view/yardstick/job/yardstick-fuel-baremetal-daily-master/2400/console JIRA: YARDSTICK-1201 Change-Id: Ib9e139046724ece4be7a85cc1ae74cbb0ec8e203 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-05-23Get HA test case results on failureMiikka Koistinen5-76/+56
Now, yardstick HA test cases (which have 'sla action: monitor') do not output results if the test case SLA validation fails. This patch modifies the task runner and the serviceHA scenario so that during an SLA validation failure the test result data is captured correctly. Do similar changes in the general scenario. fix missing variable k s/envrioment/environment JIRA: YARDSTICK-1115 Change-Id: I648a8b229600c0ad089320ac3f803698f73aa800 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com> (cherry picked from commit dd87e15c9c4f0aff3577c1bcd68bd86dd2d64898) Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-05-24Test case spec for SDN controller resilience in HA configGeorg Kunz2-0/+197
This is the test case specification for verifying the HA capabilities of a SDN controller running in a HA configuration. JIRA: HA-33 JIRA: YARDSTICK-955 Change-Id: I016ec1ef7bb51b79f8c21440abf8f04c923ef9dc Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-23Bugfix: openrc api dump should be safe_dumprexlee87764-6/+36
1. fix safe_dump 2. fix pep8 problem, use flask_restapi custom error handling [1] [1] https://flask-restful.readthedocs.io/en/latest/extending.html#custom-error-handlers JIRA: YARDSTICK-1165 RestApi openrc dump clouds.yaml error it now use yarml.dump, should be yaml.safe_dump. dump would gererate !!python/unicode and cause error when upload openrc file in gui Change-Id: Id3e85f7ba7d4967277ef79109b07d7552179e5db Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit f1a71b2889da3b49358b10b9a12ea5a512dd2743)
2018-05-20Test case spec for SDN Virtual Switch resilience.Dimitrios Markou2-0/+185
This is a test case for verifying the proper functionality of SDN Vswitches which are located in the Compute nodes of an OpenStack environment. This test case is unaware of the configuration (non-HA,HA) JIRA: HA-34 JIRA: YARDSTICK-955 Change-Id: I701bf1f9527b1a31b9cb52e102734e10c4162766 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit 4cc2882c73a64e243f98c0448ca2d1f9a677953c)
2018-05-17Merge "Update samples/test_suite.yaml" into stable/fraserRodolfo Alonso Hernandez1-1/+2
2018-05-17Merge "Fix log typos in benchmark/scenarios/availability" into stable/fraserRodolfo Alonso Hernandez8-41/+37
2018-05-17Merge "Remove unused methods in SampleVNF" into stable/fraserRex Lee2-90/+0
2018-05-16Fix log typos in benchmark/scenarios/availabilityMiikka Koistinen8-41/+37
This commit fixes multiple log message typos and all the emerged pylint errors. MonitorProcess/MonitorOpenstackCmd.verify_SLA() repeat already logged information, so these prints are removed. JIRA: YARDSTICK-1145 Change-Id: Ifef26e4b4ff7766089caec24785511969c2d663e Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com> (cherry picked from commit 6fa51bdcc7ad7e4d407f2803fc05b1cfaf66c115)
2018-05-16Merge "Update the dummy-scenario-heat-context testcase" into stable/fraserRodolfo Alonso Hernandez1-3/+4
2018-05-16Merge "Document for Euphrates test case results" into stable/fraserJing Lu36-2886/+2086
2018-05-15Document for Euphrates test case resultsJingLu536-2886/+2086
JIRA: YARDSTICK-1132 In B and C releases, Yardstick provides an overview of the results of test cases developed by Yardstick, executed on OPNFV community labs. This work has not been done for the D and E releases, although result analysis for Euphrates is available at (https://wiki.opnfv.org/display/yardstick/Euphrates+release+test+results+analysis). We plan to restart to provide a basic test case results analysis for Fraser and compare performance data with Euphrates. This JIRA ticket will be resolved into 3 commits: 1. Document for E release test case data; 2. Document for F release test case data; 3. Document for results analysis. Change-Id: I372a60807ac3dfaab87e70cdb956c1059b019f7a Signed-off-by: JingLu5 <lvjing5@huawei.com> (cherry picked from commit 4c20fb57684bc21e7ae0461341088100e518307d)
2018-05-10Update samples/test_suite.yamlEmma Foley1-1/+2
The sample test suite at sample/test_suite.yaml contained incorrect syntax. It has been updated to add the "default" parameter to "task_args" when running a testcase. JIRA: YARDSTICK-1125 Change-Id: I53409168e47d969317145623df1e2c789396cc32 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 7b00d64494bdd61f2ab37005de76fa5f6496d45d)
2018-05-08Implement Virtual Switch resilience test caseDimitrios Markou3-0/+329
This testcase tests the resilience of the Virtual Switch in an OpenStack environment. It can only run in a non Ubuntu distro because it is limited by this bug [0] [0]: JIRA: YARDSTICK-1140 Change-Id: Ia1480fba9f3549d1144c80699056b501d3b07a0f Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit 53f5951a47fcaa5a3f8bcd6ea1020e54a1b285d3)
2018-05-08Bug Fix: Start openvswitch service in Centos distroDimitrios Markou1-4/+2
JIRA: YARDSTICK-1142 Change-Id: I82c479c95e10de37416081eacf2d8bee396e50dc Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit d00660e583ef89fe07149c7f0cffcced7cd72133)
2018-05-08Add support for restarting a serviceDimitrios Markou1-3/+4
JIRA: YARDSTICK-1138 Change-Id: Id57defb574eb7e0f5be81b52803cdb05f46796ab Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit 131b9f04a360ccc894510a275bd33c57634608fc)
2018-05-08Add ODL HA testcaseDimitrios Markou2-0/+283
This testcase confirms the resiliency of Opendaylight in a HA deployment SPEC: https://gerrit.opnfv.org/gerrit/#/c/50991 JIRA: HA-33 JIRA: YARSTICK-955 Change-Id: I4cb39d1970ed0333a43fbb58f8c7138908379dcb Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit d16b2e14fe420a646d4399986bd9f4d1ae3a606d)
2018-05-08Add pod.yaml files for ApexDimitrios Markou3-0/+153
JIRA: YARDSTICK-1097 Change-Id: If116174c562bc08c0b7602324599bc85d8c60be0 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit 6f374141466640655cc57277b4b49d6deffa9092)
2018-05-04Update the dummy-scenario-heat-context testcaseEmma Foley1-3/+4
The testcase is included in the docs to demonstrate definining a heat context. It previously used cirros, but this is not included by default. Set-up instructions/scripts add yardstick-image and yardstick-flavor, so these have been added to the testcase instead. A default value for context_name was also added. Change-Id: I5f642086971487b334ae48a5cf5c9b71e9b99e2e Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit f37e4dcf771caec3be52e95047997aa22cbd7a88)
2018-05-03Remove unused methods in SampleVNFEmma Foley2-90/+0
The following private methods are unused in yardstick/network_services/vnf_generic/vnf/sample_vnf.py:SampleVNF * _build_ports(self) * _get_route_data(self, route_index, route_type) * _get_port0localip6(self) * _get_port1localip6(self) * _get_port0prefixlen6(self) * _get_port1prefixlen6(self) * _get_port0gateway6(self) * _get_port1gateway6(self) They are being removed as: * _get_port* functions are already implemented and used in MultiPortConfig * _get_route_data is an auxillary functions used by the previous ones * _build_ports is implemented in the helpers JIRA: YARDSTICK-1122 Change-Id: Ie7a706cd87b610ea56f89214118a02e612a70dc0 Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 50bcd3e477bc29abb43ed73643d551ff55a73403)
2018-04-26[release] Yardstick Fraser 6.0.0 Release notesopnfv-6.0.0rexlee87761-305/+209
JIRA: YARDSTICK-1129 Change-Id: I5adb2e9547c58b90d3eafb0e2b90015ce5472cfa Signed-off-by: rexlee8776 <limingjiang@huawei.com> Signed-off-by: Ross Brattain <ross.b.brattain@intel.com> (cherry picked from commit a324c1b922ae2598dbe25e9b2885620ef09f4901)
2018-04-26Bugfix: ansible can't not run without configchenjiankun1-1/+1
JIRA: YARDSTICK-1135 Ansible need ansible.cfg when run in the remote node. However the file name is wrong. Need: setup.cfg -> ansible.cfg Change-Id: Ifa674fb624ca83d90c3ac9ad3bfe148013bf8bfd Signed-off-by: chenjiankun <chenjiankun1@huawei.com> (cherry picked from commit 170842f20426ad244f3e49b3780b0256302b0be3)
2018-04-25nsb_setup: pin docker image version to release tagRoss Brattain1-1/+1
The install scripts pull tags for stable releases. We need to temporarily pin the image tag to the unreleased tag because we have to update the code before we actually tag the image. Or maybe we should make this a parameter to the script JIRA: YARDSTICK-1137 Change-Id: I2e5f13ffe19d1c19fd7b8e071df28fd225be3d79 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-04-24Merge "extra loopback cleanup" into stable/fraserRoss Brattain2-6/+15
2018-04-24Merge "[docs] Updated baremetal instalation instructions" into stable/fraserRoss Brattain1-0/+9
2018-04-24Merge "Bugfix: Can't get image list in API" into stable/fraserJack Chan6-47/+105
2018-04-23remove more old apexlake testcasesRoss Brattain2-8/+0
fix fraser failures Change-Id: I8bb12a762054a4c3274cc6e0297e948b92700e7e Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>