aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-06-06Merge "Add NSB PROX Baremetal dashboard for L3"Abhijit Sinha2-1151/+9973
2018-06-06Merge "Fix NSB NFVi metrics accuracy"Abhijit Sinha6-62/+82
2018-06-05Merge "Bump oslo.messaging version to 5.36.0"Rodolfo Alonso Hernandez1-1/+1
2018-06-05Fix NSB NFVi metrics accuracyXavier Simonart6-62/+82
JIRA: YARDSTICK-1212 Change-Id: Ic4d4a3c00e4e278f4de06cc176ff663892895569 Signed-off-by: Xavier Simonart <xavier.simonart@intel.com>
2018-06-01Move IncorrectConfig, IncorrectSetup and IncorrectNodeSetup to exceptionsRodolfo Alonso Hernandez7-67/+50
JIRA: YARDSTICK-1218 Change-Id: I804065e9bce3e728f5bf9e756a78df8fd28f74ac Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-01Move ErrorClass definition to exceptions moduleRodolfo Alonso Hernandez6-39/+46
JIRA: YARDSTICK-1216 Change-Id: I82556e1d1b0c723221a58e188067cbce560b8338 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-01Convert SSH custom exceptions to Yardstick exceptionsRodolfo Alonso Hernandez7-62/+59
JIRA: YARDSTICK-1215 Change-Id: I5ecfd3dccd91b07cd8de5309dfa1a372eff16ed0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-01Remove AnsibleCommon class method mockRodolfo Alonso Hernandez1-12/+8
In [1], several methods in "AnsibleCommon" class are mocked, but those mocks are not removed after the test execution. Depending on the test execution order, this affects other results. [1] https://github.com/opnfv/yardstick/blob/stable/fraser/yardstick/tests/unit/service/test_environment.py#L20 JIRA: YARDSTICK-1214 Change-Id: I85ef702b3b5b2fda5cf453a21b9f0bec61b155f0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-01Add NSB PROX Baremetal dashboard for L3Xavier Simonart2-1151/+9973
JIRA: YARDSTICK-1213 Change-Id: Id96edc5d23d3530110466e1cf69327c3e267e4c0 Signed-off-by: Xavier Simonart <xavier.simonart@intel.com>
2018-06-01Remove __init__ method overriding in HeatContextTestCaseRodolfo Alonso Hernandez1-7/+4
Unit test case clases should implement setUp() method instead of overriding __init__() method. JIRA: YARDSTICK-1210 Change-Id: I0f9a10575f9aeebf76dfa84619e59589b3ea83f6 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-31Remove instantiated contexts in "test_task"Rodolfo Alonso Hernandez1-0/+9
During unit testing, all contexts instantiated must be deleted at the end of the test to avoid clashes with other tests. JIRA: YARDSTICK-1209 Change-Id: I1994b915001b4a518e096833a0c5d33febbd8de6 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-31Replace glance delete image with shade client.Shobhi Jain5-44/+93
Remove get_image_id function. Function delete_image now uses shade client. JIRA: YARDSTICK-892 Change-Id: I6e8510dfa49aa14786ed7ac3382b85c4e699fb9e Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
2018-05-31Merge "Replace glance create image with shade client."Rodolfo Alonso Hernandez5-78/+171
2018-05-30Merge "Set "cmd2" library to version 0.8.6"Rodolfo Alonso Hernandez1-0/+1
2018-05-29Replace glance create image with shade client.Shobhi Jain5-78/+171
Function create_image now uses shade client. JIRA: YARDSTICK-892 Change-Id: Ia41d9ce702a1f24031080f8a365c1b2bd9ac9faa Signed-off-by: Shobhi Jain <shobhi.jain@intel.com>
2018-05-28PTL change from Ross Brattain to Mingjiang Li (Rex)Ross Brattain2-14/+14
results of Yardstick PTL election https://civs.cs.cornell.edu/cgi-bin/results.pl?id=E_b99c79421ce70058&rkey=c39fb1d5405efc15 Change-Id: I1a71f4415a737baec4bd44085ac3115fb86bd560 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-05-28Bump oslo.messaging version to 5.36.0Rodolfo Alonso Hernandez1-1/+1
A decoding error was introduced in the AMQP libraries installed by oslo.messaging version 5.30.2. Error example: File "/home/jenkins/opnfv/slave_root/workspace/yardstick-verify-master/ .tox/functional/local/lib/python2.7/site-packages/amqp/utils.py", line 89, in str_to_bytes return s.encode('utf-8') UnicodeDecodeError: 'ascii' codec can't decode byte 0xd2 in position 3: ordinal not in range(128) This problem is fixed in the library versions installed in version 5.36.0. JIRA: YARDSTICK-1204 Change-Id: I4719d8e0a0891ebbb3b87c31d593d15f897ef53a Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-28Set "cmd2" library to version 0.8.6Rodolfo Alonso Hernandez1-0/+1
Last "cmd2" version, 0.9.0, removed Python 2+ support [1]. In order to support Python 2.7, version 0.8.6 (or earlier) must be installed. [1] https://github.com/python-cmd2/cmd2/commit/e54e5a5b891548df4df0acb04b6e607ad8f871b1 JIRA: YARDSTICK-1205 Change-Id: Ic2fe57438720de5b21c75f9456e653c6facf3ae9 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-28Merge "PROX: [WIP] Added scale up TCs."Rodolfo Alonso Hernandez10-0/+810
2018-05-25Merge "[release] Yardstick release note 6.1.0"Ross Brattain1-6/+35
2018-05-25Add scale out TCs with availability zone supportMytnyk, Volodymyr6-1/+546
Add PROX and vFW scale out TCs with availability zone configuration. To be able to specify the availability zone for specific VNF or TG the following example of command line option shoud be used: yardstick -d task start --task-args='{ "num_vnfs": 2, "availability_zone": { "vnf_0": "az_0", "tg_0": "az_0", "vnf_1": "az_1", "tg_1": "az_1", ... }}' <SCALE-OUT-TC-FILE> The steps to run new scale-out TCs is documented in the userguide. JIRA: YARDSTICK-1203 Change-Id: Ib3878485c5483981fe9b48ab02995712bcc31ae5 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-05-25Bugfix: Yardstick GUI build fails on Fraser 6.1.0rexlee87761-1/+1
Yardstick web GUI build fails due to angular version JIRA: YARDSTICK-1202 Change-Id: Ie075d18cb2eac2070267759978cbdb7c784599ef Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-05-24Dockerfile: add ping for prepare_env.shRoss Brattain2-3/+3
INFO: Creating openstack credentials .. Verifying connectivity to 10.20.0.2... /home/opnfv/repos/yardstick//tests/ci/prepare_env.sh: line 56: ping: command not found /home/opnfv/repos/yardstick//tests/ci/prepare_env.sh: line 56: ping: command not found https://build.opnfv.org/ci/view/yardstick/job/yardstick-fuel-baremetal-daily-master/2400/console JIRA: YARDSTICK-1201 Change-Id: Ib9e139046724ece4be7a85cc1ae74cbb0ec8e203 Signed-off-by: Ross Brattain <ross.b.brattain@intel.com>
2018-05-24Use TRex release v2.41 to support both x86 and aarch64trevortao2-2/+3
Currently Yardstick uses Cisco's TRex release v2.28 which can only support x86, for the consideration of multi-arch support of Yardstick, the trex release v2.41 is now available and it can support multi-arch(both x86 and aarch64) now. For the external lib of v2.41, for x86_64, it looks like: external_libs/pyzmq-14.5.0/python2/intel/ucs4/64bit/zmq for arm64, it looks like: external_libs/pyzmq-14.5.0/python2/arm/ucs4/64bit/zmq So replace the trex release v2.28 with v2.41. JIRA: YARDSTICK-1191 Change-Id: I22dc3499283d48a89da1145cc480fd7d2a93a1cc Signed-off-by: trevortao <trevor.tao@arm.com>
2018-05-23Test case spec for SDN controller resilience in HA configGeorg Kunz2-0/+197
This is the test case specification for verifying the HA capabilities of a SDN controller running in a HA configuration. JIRA: HA-33 JIRA: YARDSTICK-955 Change-Id: I016ec1ef7bb51b79f8c21440abf8f04c923ef9dc Signed-off-by: Georg Kunz <georg.kunz@ericsson.com>
2018-05-23[release] Yardstick release note 6.1.0rexlee87761-6/+35
JIRA: YARDSTICK-1182 Change-Id: I3baca52e9bc0360b43f2ce61ea2f166a70e8c90a Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-05-22Standalone XML machine type is not longer validRodolfo Alonso Hernandez1-1/+1
Current XML machine type definition [1] is not longer valid. According to [2], the default machine type should be "pc-i440fx-xenial". NOTE: StandAlone physical nodes are deployed using Ubuntu OS. [1]https://github.com/opnfv/yardstick/blob/master/yardstick/benchmark/contexts/standalone/model.py#L48 [2]https://wiki.ubuntu.com/QemuKVMMigration#Upgrade_machine_type JIRA: YARDSTICK-1192 Change-Id: I77b1379aaf416b1225e91af2c3ac746cb101f774 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-22Error when adding SR-IOV interfaces in SR-IOV contextRodolfo Alonso Hernandez2-12/+18
Method "add_sriov_interfaces" in Libvirt class throws an error when trying to add SR-IOV interfaces in the XML file. Function "setup_sriov_context" in SriovContext if passing to "_enable_interfaces" method the XML file name instead of passing the XML string. JIRA: YARDSTICK-1189 Change-Id: If021c102311ecb98cb26934f78067dfc720e4291 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-22Bugfix: openrc api dump should be safe_dumprexlee87764-6/+36
1. fix safe_dump 2. fix pep8 problem, use flask_restapi custom error handling [1] [1] https://flask-restful.readthedocs.io/en/latest/extending.html#custom-error-handlers JIRA: YARDSTICK-1165 RestApi openrc dump clouds.yaml error it now use yarml.dump, should be yaml.safe_dump. dump would gererate !!python/unicode and cause error when upload openrc file in gui Change-Id: Id3e85f7ba7d4967277ef79109b07d7552179e5db Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-05-21Add "host_name_separator" variable to Context classRodolfo Alonso Hernandez9-39/+78
This feature will provide Kubernetes context the ability to handle the context name inside the class itself, providing to the developer an abstraction of the possible naming limitations in Kubernetes. E.g.: "dot" character in Pod names is no allowed [1]. [1] https://github.com/fabric8io/fluent-plugin-kubernetes_metadata_filter/issues/58 JIRA: YARDSTICK-1188 Change-Id: I82121f970b550170357a443b6340be7900602a57 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-05-20Merge "Test case spec for SDN Virtual Switch resilience."Emma Foley2-0/+185
2018-05-17Merge changes from topics 'YARDSTICK-1154', 'YARDSTICK-1160'Rodolfo Alonso Hernandez6-10/+21
* changes: Kubernetes API "delete_service" missing parameter Bump Kubernetes Python client to version 6.0.0 Avoid "volumeMounts" with "configMap" fixed permissions
2018-05-17Merge "Parse "dispatcher" options correctly from InfluxDB client"Rodolfo Alonso Hernandez5-39/+89
2018-05-17Merge "Fix PEP8 errors in prox_binseach"Abhijit Sinha1-5/+5
2018-05-17Document for Fraser test case resultsJingLu526-17/+1962
JIRA: YARDSTICK-1132 In B and C releases, Yardstick provides an overview of the results of test cases developed by Yardstick, executed on OPNFV community labs. This work has not been done for the D and E releases, although result analysis for Euphrates is available at (https://wiki.opnfv.org/display/yardstick/Euphrates+release+test+results+analysis). We plan to restart to provide a basic test case results analysis for Fraser and compare performance data with Euphrates. This JIRA ticket will be resolved into 3 commits: 1. Document for E release test case data; 2. Document for F release test case data; 3. Document for results analysis. Change-Id: I3c59851c8878ba37145e6ad6958272a62bad3f52 Signed-off-by: JingLu5 <lvjing5@huawei.com>
2018-05-16Merge "Add --hwlb options as a command line argument for SampleVNF"Rodolfo Alonso Hernandez10-8/+96
2018-05-16Add --hwlb options as a command line argument for SampleVNFChornyi, TarasX10-8/+96
To enable HWLB queues in samplevnf on supported hardware (e.g Intel Fortville) --hwlb option needs to be passed as a VNF command line argument. JIRA: YARDSTICK-1159 Change-Id: I6e5c098dc71a711252b545c7622ee52085fa81f0 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-05-16Merge "Move tests: unit/network_services/helpers"Rodolfo Alonso Hernandez6-22/+23
2018-05-16Merge "Move tests: unit/network_services/nfvi"Rodolfo Alonso Hernandez3-1/+0
2018-05-16Merge "Move tests: unit/network_services/traffic_profile"Rodolfo Alonso Hernandez12-94/+95
2018-05-16Merge "Test case description and configuration file for yardstick_tc088"Jing Lu2-0/+209
2018-05-16Merge "Test case description and configuration file for yardstick_tc089"Jing Lu2-0/+209
2018-05-15Move tests: unit/network_services/helpersEmma Foley6-22/+23
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: If0b77a6e0b102071ecfb212362647c62a621e4f9
2018-05-15Move tests: unit/network_services/nfviEmma Foley3-1/+0
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Id330ee1c89d54ef487edb7fe160e5a31d9a3094f
2018-05-15Move tests: unit/network_services/traffic_profileEmma Foley12-94/+95
* Fix pylint errors * Add TODOs Some errors are ignored locally, as they were a symptom of other problems. These issues have been flagged with a TODO, and should be fixed later. JIRA: YARDSTICK-837 Signed-off-by: Emma Foley <emma.l.foley@intel.com> Change-Id: Id983a2e415d66633331e7fea96a377e2a7589980
2018-05-15Merge "Start nginx and uwsgi servicies only in not container mode"Rodolfo Alonso Hernandez1-0/+2
2018-05-15Start nginx and uwsgi servicies only in not container modeStepan Andrushko1-0/+2
No need to execute nginx and uwsgi when running in container mode. JIRA: YARDSTICK-1179 Change-Id: I253f3adab388a14886b70e6589936f6eb27ac4c0 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-05-15Merge "Fix PROX throughput result calculation"Abhijit Sinha2-2/+1
2018-05-15Fix PEP8 errors in prox_binseachAbhijit Sinha1-5/+5
There were some pep8 errors in the prox_binsearch.py file. These are fixed here. JIRA: YARDSTICK-1173 Change-Id: I817bba89c6ba298bb0f27b2538aa7585cb286754 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-05-15Fix PROX throughput result calculationAbhijit Sinha2-2/+1
The success criteria needed a fix for throughput calculation. The results on success criteria were muliplied by 1000*1000 which is not correct and not needed as this was leading to false results in grafana. JIRA: YARDSTICK-1172 Change-Id: I56b24a700f8a565db80897aeab796e7039cae5c9 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>