summaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2018-08-29Merge "Make security group configurable - dovetail" into stable/fraserRex Lee4-58/+91
2018-08-27Merge "Decrease Sampling interval - Invalid Port results" into stable/fraserAbhijit Sinha1-10/+17
2018-08-27Make security group configurable - dovetailrexlee87764-58/+91
Make sercurity group can be configured via the context. The format would be: context: name: demo image: yardstick-image flavor: yardstick-flavor user: ubuntu security_group: rules: - remote_ip_prefix: "0.0.0.0/0" protocol: "tcp" port_range_min: 1 port_range_max: 65535 - remote_ip_prefix: "0.0.0.0/0" protocol: "udp" port_range_min: 1 port_range_max: 65535 - remote_ip_prefix: "0.0.0.0/0" protocol: "icmp" JIRA: YARDSTICK-1360 Change-Id: I00c45767ee2d70b790590e824599d5a4c274bced Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit cea576574ac0554c1320179bffe6965ac1333972)
2018-08-27Merge "the recovery action of "baremetal down" should be triggered ↵Jing Lu5-3/+59
mandatory" into stable/fraser
2018-08-21Decrease Sampling interval - Invalid Port resultsPatrice Buriez1-10/+17
JIRA: YARDSTICK-1219 The computed in/fwd throughputs displayed on the L2FWD, L3FWD and VPE dashboards. The computed value is likely 4x the expected value. It is required to return sampling information form Generator AND VNF at least every 1 second. Change-Id: I4435fd05ba3116ead836843a4c2fce133b767a28 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 2d10b0bf7238f5417d46f89c76b856f7e345f738) Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (also picking from commit 68aaa8ce8b20ba39040aa2469b384f59709620a7)
2018-08-21the recovery action of "baremetal down" should be triggered mandatoryrexlee87765-4/+60
YARDSTICK-1222 has made attacker recover only when the sla not pass. But for baremetal down test case, the node need to power on even the sla pass. TODO: Make attacker can support mandatory recover in some situation. JIRA: YARDSTICK-1337 Change-Id: Ib567b9b9025e5ee421ea47140c468537ad16f090 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 5f11cb9f55aa0529fddfe916a2976a9aa5b4c08f)
2018-08-21Bugfix: HA test case baremetal down ipmi power off failed - dovetailrexlee87762-29/+5
Test case tc025 baremetal down failed to ipmi power off the node. This patch target to solve: ipmi_password is not correctly fetched JIRA: YARDSTICK-1326 Change-Id: Ia915cd07cba420643fa9a679975178328be55700 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit fb895253e4ceeff2df53043b5b994f63c740b1f6)
2018-07-06[Bug fix] Execute teardown if SLA is set to "assert"Dimitrios Markou1-0/+1
In Duration runner if SLA is set to "assert" and a SLAValidationError happens then a teardown is needed to avoid garbages in the environment. JIRA: YARDSTICK-1291 Change-Id: I9056b0da3e7e496171ed42430ffc340b5c68f108 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com> (cherry picked from commit 30fc9f545d526fdbd69af483b0bad0ea781d648c)
2018-06-29NFVI support for standalone, baremetal and heat contextsChornyi, TarasX26-280/+553
JIRA: YARDSTICK-1257 Change-Id: I6733bd49ac91985e8f3d7722e6990e8733bb430e Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit 005358a39a87e42061dd5b344916c2ffe0475961)
2018-06-29Fix NSB NfVi support for 25 and 40GbpsXavier Simonart1-4/+27
When setting interface_speed option in the test case, NSB/PROX was still considering 100% as 10 Gbps. With this fix, when interface_speed is set to for instance 25 Gbps then NSB/PROX will start generate at 25 Gbps. Yardstick logging info printed on the screen will show performance result as percentage of interface_speed (e.g. 100% will be 25 Gbps). This is done by sending the command "speed 250" to PROX (PROX cannot know the underlying interface speed in all cases e.g. in virtio, and hence considers 100% as 10Gbps). JIRA: YARDSTICK-1217 Change-Id: I4989161b04a7afa5e347935ee7ccef7dfe5a504d Signed-off-by: Xavier Simonart <xavier.simonart@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 1d61af34eb7b35b912d124768ad26eb5f0cd03a8)
2018-06-29Merge "NSB NFVi BNG test fails to run - stops after one step" into stable/fraserEmma Foley1-4/+16
2018-06-29Merge changes from topic 'prox-stable/fraser' into stable/fraserEmma Foley10-89/+794
* changes: NSB NFVi PROX BNG losing many packets NSB NFVi PROX VPE losing many packets Decrease Sampling interval Addition of Configurable Sampling and Configurable Confirmation Retry
2018-06-29Merge "Convert SLA asserts to raises" into stable/fraserEmma Foley46-156/+219
2018-06-28Merge "Extended Context class with get_physical_nodes functionality" into ↵Rodolfo Alonso Hernandez20-77/+473
stable/fraser
2018-06-28Merge "Add "os_cloud_config" as a new context flag parameter" into stable/fraserRodolfo Alonso Hernandez9-27/+101
2018-06-28Merge "Stop running tests from tests/unit" into stable/fraserRodolfo Alonso Hernandez2-12/+6
2018-06-28Extended Context class with get_physical_nodes functionalityChornyi, TarasX20-77/+473
JIRA: YARDSTICK-1255 Change-Id: I446d715dc6cf716a4fcbc1b809c1b1d6303071e0 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit 595212edf5ccd71af1bf7ef57a8d260fb1ec0c9e)
2018-06-28NSB NFVi BNG test fails to run - stops after one stepDanielMartinBuckley1-4/+16
JIRA: YARDSTICK-1244 When sending the start or stop command to PROX. We sould not send the same core. We should not send "start 1,1" instead we should send "start 1" Change-Id: Ie600dc3ed808fd00341e92f13bd52199e68dc51f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit e219f22429ad2e6e6060c5c3440df72e014be273)
2018-06-28NSB NFVi PROX VPE losing many packetsDanielMartinBuckley1-0/+4
JIRA: YARDSTICK-1105 Running a vPE test ends up with up to 25% drooped packets. This is due to tolerated loss being incorrectly configured, test duration was too short and test interval was too short. Note This is due to the fact that vPE use case have by default a tolerated loss of 100%, Now changed to 0.001, same as L2FWD Also: Grafan dashboard has been updated to show all SUT CPUS Utilization in 1 panel. And LINE rate MIN, MAX & TEST Rate have been added Change-Id: I7adae2199b3f656fe460705b6aeb3aa69c767d50 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 39b3d9ae8ff19a0d64bff0e874f05b6dbcc30b01)
2018-06-28Convert SLA asserts to raisesMiikka Koistinen46-156/+219
This commit converts Python assertions to a custom exception in all places where SLA validation is checked with an assertion. This commit also fixes all emerged pylint errors. JIRA: YARDSTICK-966 Change-Id: If771ed03b2cbc0a43a57fcfb9293f18740b3ff80 Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com> (cherry picked from 39f80e9b06395ae1515cfcf08508504ad4dd978a)
2018-06-28Decrease Sampling intervalDanielMartinBuckley4-40/+126
JIRA: YARDSTICK-1219 Currently NSB for NFVI using PROX returns sampling information every 13 seconds. This is too slow. It is required to return sampling information form Generator AND VNF at least every 1 second. This change is depandant on JIRA: YARDSTICK-1212 and YARDSTICK-1220 Change-Id: Ica7ab795a2919d191d8cd846d028e15739e33fb7 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit f8b45aca386ed5852d9568c531ba4595c68cc0e2)
2018-06-28Addition of Configurable Sampling and Configurable Confirmation RetryDanielMartinBuckley6-48/+663
JIRA: YARDSTICK-1221 In order to increase accuracy of result the following are done :- - Improve Measurement Accuracy (YARDSTICK-1212) - Improve Sampling Interval (YARDSTICK-1219) - Allow 4 PROX ports to be read simultaneously (YARDSTICK-1220) This change does the following :- - Stores LINE Rate statistics of Sample - Requires a confirmation retry before deciding to increase or decrease this is configurable. - Allows the user to disable Sampling or specify a sample interval - Added Code Coverage of ProxDurationRunner based on YARDSTICK-1199 Change-Id: I27242ac1849c9a2712866385b5fbc05977c71516 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 2e447af9a5a54355aa20028813660d07d1bd2e18)
2018-06-28Add "os_cloud_config" as a new context flag parameterRodolfo Alonso Hernandez9-27/+101
This new parameter will contain the OpenStack cloud specific configuration used by Shade client. This new flag is used only in Heat context. By default, this new parameter (dict) will contain this content: 'os_cloud_config': {'verify': False} This field will be used by HeatStack [1] to create a Shade cloud. Shade retrieves, if not defined, the OpenStack configuration from "os_client_config". This configuration is used to generate the cloud configuration, which is the description of the OpenStackCloud returned. The default parameter defined, "verify", refers to the related bug. By default, in case of using SSL certificate it will not be verified. [1] https://github.com/opnfv/yardstick/blob/b338d3091bb0beb89d4ad9f7c144f43a31a19a74/yardstick/orchestrator/heat.py#L47 JIRA: YARDSTICK-1139 Change-Id: I875a7018401b84e51dab775b8194174645d27e06 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com> (cherry picked from commit 9ae331e1aa1081c3e821512d1940846dfb4063ec)
2018-06-28Merge "Bugfix: HA kill process recovery has a conflict" into stable/fraserJing Lu2-6/+31
2018-06-28Merge "Replace glance delete image with shade client." into stable/fraserRodolfo Alonso Hernandez5-44/+93
2018-06-28Merge "Replace glance create image with shade client." into stable/fraserRodolfo Alonso Hernandez5-78/+171
2018-06-28Merge "Replace cinder detach volume with shade client." into stable/fraserRodolfo Alonso Hernandez5-30/+109
2018-06-28Merge "Replace cinder delete volume with shade client." into stable/fraserRodolfo Alonso Hernandez5-44/+98
2018-06-28Merge "Replace cinder create volume with shade client." into stable/fraserRodolfo Alonso Hernandez5-119/+143
2018-06-28Merge "Replace cinder get_volume_id with shade client." into stable/fraserRodolfo Alonso Hernandez2-3/+24
2018-06-28Merge "Replace nova get flavor with shade client." into stable/fraserRodolfo Alonso Hernandez5-31/+104
2018-06-28Merge "Replace nova get server with shade client." into stable/fraserRodolfo Alonso Hernandez5-78/+125
2018-06-28Merge "Replace nova attach volume to server with shade client." into ↵Rodolfo Alonso Hernandez5-35/+115
stable/fraser
2018-06-28Merge "Replace nova delete keypair with shade client." into stable/fraserRodolfo Alonso Hernandez5-32/+92
2018-06-28Merge "Replace nova client create keypair with shade." into stable/fraserRodolfo Alonso Hernandez5-51/+102
2018-06-28Merge "Remove unused nova client functions." into stable/fraserRodolfo Alonso Hernandez1-136/+0
2018-06-28Merge "Replace nova delete instance with shade client." into stable/fraserRodolfo Alonso Hernandez5-32/+111
2018-06-28Merge "Replace nova create instance with shade client." into stable/fraserRodolfo Alonso Hernandez5-90/+202
2018-06-28Merge "Update neutron delete_neutron_net function." into stable/fraserRodolfo Alonso Hernandez4-24/+34
2018-06-28Merge "Replace neutron create security group full with shade." into ↵Rodolfo Alonso Hernandez5-110/+170
stable/fraser
2018-06-27Merge "Change IxNextgen library load" into stable/fraserRodolfo Alonso Hernandez2-23/+8
2018-06-27Replace glance delete image with shade client.Shobhi Jain5-44/+93
Remove get_image_id function. Function delete_image now uses shade client. JIRA: YARDSTICK-892 Change-Id: I6e8510dfa49aa14786ed7ac3382b85c4e699fb9e Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit d6c1b8b7bfd257efd5fe2df30dd450bdb2c57c7d)
2018-06-27Replace glance create image with shade client.Shobhi Jain5-78/+171
Function create_image now uses shade client. JIRA: YARDSTICK-892 Change-Id: Ia41d9ce702a1f24031080f8a365c1b2bd9ac9faa Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit c31edc5ab9013d93ffd32ed72adb14740e43b24a)
2018-06-27Replace cinder detach volume with shade client.Shobhi Jain5-30/+109
Function detach volume now uses shade client. JIRA: YARDSTICK-891 Change-Id: Ie437ccf1172cb82dc869963f0d62e31a5ab23ebb Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit f6cca46f6b1aa6134a0e634a3a9e524cdbbfa729)
2018-06-27Replace cinder delete volume with shade client.Shobhi Jain5-44/+98
Function delete volume now uses shade client. JIRA: YARDSTICK-891 Change-Id: I016e1d3bf5972879cad176b56c7282e35413945e Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit 4c672aa7012a530806a2f8ff2d45a8badb7f7b21)
2018-06-27Replace cinder create volume with shade client.Shobhi Jain5-119/+143
Adds get_volume function. Function create volume now uses shade client. JIRA: YARDSTICK-891 Change-Id: I0b2fae5f2cf52eaf2e4a0062c858d49bc4ce9ccd Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit 2d33d0f289f3dd3864fe57289e953b876f362c06)
2018-06-27Replace cinder get_volume_id with shade client.Shobhi Jain2-3/+24
Function get_volume_id now uses shade client. JIRA: YARDSTICK-891 Change-Id: I45ae40982a64f677dbbdeb6c9510a0ec9ac973f1 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit be197a6197e803b6334f2ccf72f561245ef7aac7)
2018-06-27Replace nova get flavor with shade client.Shobhi Jain5-31/+104
Rename get_flavor_by_name with get_flavor. Function get_flavor now uses shade client. JIRA: YARDSTICK-1088 Change-Id: Ic82127e475baf39643be0a254b177f3058b85748 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit 35bbd618b1e69a5b5edbd64a333720bfa5a92400)
2018-06-27Replace nova get server with shade client.Shobhi Jain5-78/+125
Rename get_server_by_name with get_server. Function get_server now uses shade client. JIRA: YARDSTICK-1088 Change-Id: I69c59145cefdb565f3ece27baaaf932905e1b757 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit d75a91ebf2937e5cfe5cf2aa5a90db9121f73967)
2018-06-27Replace nova attach volume to server with shade client.Shobhi Jain5-35/+115
Function attach_volume_to_server now uses shade client instead of nova client. JIRA: YARDSTICK-1088 Change-Id: Id00df672c2c195b5c338cbbc30ddf2742a4e4d29 Signed-off-by: Shobhi Jain <shobhi.jain@intel.com> (cherry picked from commit 8fd82cd8d0146d8cebbc32ed7cbb6fb9d1861297)