summaryrefslogtreecommitdiffstats
path: root/yardstick
AgeCommit message (Collapse)AuthorFilesLines
2019-01-24[dovetail] split the sla check results into process recovery and servicerexlee87764-20/+52
recovery for HA tcs make sla check for process recovery optional: only check when sla is set. JIRA: YARDSTICK-1512 Change-Id: I717d39614a1af2ee9e62dec3b8a32d7d611f557e Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit 39d89761aca4aaf724010a9f8cac73725b798b33)
2018-11-30Merge "Run testcase 074 result overridden by job status" into stable/gambiaRex Lee1-2/+2
2018-11-28NSB NFVi PROX Should report realtime port activity notDanielMartinBuckley5-10/+303
historical data JIRA: YARDSTICK-1458 The TG is only sampled at the end of every test interval. This is incorrect. It should be sampled every interval. Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit bf507da25ad1e6adc6a5c162a4d0de325baef888)
2018-11-18Run testcase 074 result overridden by job statusAmeed Ashour1-2/+2
Change-Id: Icb24727fd7ca8a340ea424284b510b007055ec9c JIRA: YARDSTICK-1526 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-11-09[docs] Update broken and redirected linksEmma Foley1-1/+1
A number of links were broken, or permenently redirected. Some literal include directives pointed to the wrong location. These have been updated, so the links are valid. JIRA: YARDSTICK-1416 Change-Id: Icd20113e0ab099850fa58fa41bb27a00670f57ca Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 44a507c5aa92d4f4a518983bd4b6ecc244e7a66c)
2018-11-09Merge "add error logs to storperf" into stable/gambiaRex Lee1-16/+21
2018-11-09Merge "Fix python lib path for ixload control subprocess" into stable/gambiaRex Lee1-1/+9
2018-11-08Cleanup of ixia_profile attribute for IxNetwork TGOrest Voznyy1-3/+2
Remove obsolete attribute "ixia_profile" from - test cases using IxNetwork as a TG - from unit tests related to IxNetwork Remove ixncfg files from repo. Remove mention of ixncfg files from test case files JIRA: YARDSTICK-1506 Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit fff1e25f3a882739b94458c741a5f86645f1210c)
2018-11-08Merge "Make OvS max_idle & queues configuration optional" into stable/gambiaRex Lee4-7/+16
2018-11-08add error logs to storperfAmeed Ashour1-16/+21
add error logs to storperf.py in order to show the errors in task log API JIRA: YARDSTICK-1407 Change-Id: I7cefd09cbd7bdefca98c9220f886675b6a5b02a4 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com>
2018-11-07Merge "Allow to see steady state status in the yardstick logs" into ↵Abhijit Sinha1-3/+12
stable/gambia
2018-11-07Make OvS max_idle & queues configuration optionalMytnyk, Volodymyr4-7/+16
Remove hardcoded rx queue value JIRA: YARDSTICK-1493 Change-Id: Ia4944db21d94399c724bcabf4e0eae809518e7e9 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 68c127e17028e9961abcbd1c9a72fe2b878c427b)
2018-11-06Merge "Update Multi Port Stats reading for PROX" into stable/gambiaAbhijit Sinha6-116/+395
2018-11-06Test case override of traffic profile settings.DanielMartinBuckley3-8/+49
JIRA: YARDSTICK-1298 Allow the test case file e.g. "tc_prox_baremetal_l2fwd-4.yaml" settings to override the values in the traffic_profile file e.g. "prox_binsearch.yaml" This is done by adding the "traffic_config" section to the "options" section in the "test case file". See below :- options: interface_speed_gbps: 10 traffic_config: tolerated_loss: 0.001 test_precision: 0.1 packet_sizes: [64] duration: 30 lower_bound: 0.0 upper_bound: 100.0 vnf__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/handle_l2fwd-4.cfg" prox_args: "-t": "" tg__0: prox_path: /opt/nsb_bin/prox prox_config: "configs/gen_l2fwd-4.cfg" prox_args: "-e": "" "-t": "" Precedence of the traffic settings. 1. Values provided in the "traffic_config" section, inside the "options" section, of the test case file 2. values provided in the "traffic_profile" section of the traffic_profile file Change-Id: I6b4e123e865c9dab548f9ad28647f95b53410e8f Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 383c438cda94a1004bc9552a5993fe3ff3e6da8f)
2018-11-06Update Multi Port Stats reading for PROXDanielMartinBuckley6-116/+395
JIRA: YARDSTICK-1458 Removed excessive jitter by removing extra sleeps in start/stop/reset ssh Removed extra retries when bad data returned Added a slep at end of test to give runner a chance to empty the queue on shutdown Added a timeout on port retry attempts Change-Id: Ica60b11c7af242817a83c154157827581f60d16a Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit b2fd601c33e3322ccc9e675242f091dba2eeb644)
2018-11-05Fix python lib path for ixload control subprocessChornyi, TarasX1-1/+9
JIRA: YARDSTICK-1390 Change-Id: I3ef5242862c98d3b389ba127f909f47e26c0711d Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com> (cherry picked from commit 376720a9ff56a9e71b6bc63b1d621f0c600088e1)
2018-11-01Make OvS to listen on TCP by defaultMytnyk, Volodymyr1-2/+2
JIRA: YARDSTICK-1492 Change-Id: I81c682d473ffe3d70ecbb42cce40c2d16e608b41 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-31Fix default IPv4 mask for IxNetwork traffic configSerhiy Pshyk1-5/+4
IP mask is set depending on the IP range provided by the user in the traffic profile. In case of single IP in range, IPV4LENGTH value is used as mask should cover all address bits. JIRA: YARDSTICK-1478 Change-Id: I5ad40d1f3def52ebcda4400b708b71faf11e12ab Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-31Merge "Adds option parameters to TC074" into stable/gambiaRex Lee1-1/+3
2018-10-31Merge "Add RFC2544 iteration status field" into stable/gambiaAbhijit Sinha5-10/+36
2018-10-30Merge "Add test library name update in DMF and mainflows" into stable/gambiaEmma Foley2-10/+54
2018-10-30Add RFC2544 iteration status fieldMytnyk, Volodymyr5-10/+36
Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit 0ff5b131fa3f93f8d47b46c2f13661c5b88d37a1)
2018-10-30Merge "Add traffic duration support in test case" into stable/gambiaAbhijit Sinha2-3/+25
2018-10-30Allow to see steady state status in the yardstick logsAmeed Ashour1-3/+12
Change-Id: Ic2281b300ed1de6ecd3daf14b5273db22688de8d JIRA: YARDSTICK-1454 Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit ad08f101fa3a23e9a35fa9ba3e28dd22a054ef52)
2018-10-30Merge "Add OvS 2.8.1 support into SA context" into stable/gambiaEmma Foley1-1/+2
2018-10-30Adds option parameters to TC074Ameed Ashour1-1/+3
Add option parameters to TC074 to allow the user to specify volume type, volume count, availability zone, stack name, and subnet cidr. JIRA:YARDSTICK-1294 Change-Id: I161f44b5f2c7e70fcfb80a3b916efc34bd06824c Signed-off-by: Ameed Ashour <Ameed.Ashour.Ext@nokia.com> (cherry picked from commit 43c28852a9c9abfe7fc66fca0dcc703b468db0cf)
2018-10-30Configure n_rxq DPDK port option when adding the portMytnyk, Volodymyr1-7/+5
On some platform, setting n_rxq option on port separately does not work well and causes issues like port link down, so changed the logic to set n_rxq DPDK port option during adding the port to the bridge which help to resolve the problem. JIRA: YARDSTICK-1463 Change-Id: Icdb064153a38afd53b835de8742e6fcef08f66bb Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit adcc29e56130f0f047b99528ce72b6f149643da7)
2018-10-30Add OvS 2.8.1 support into SA contextMytnyk, Volodymyr1-1/+2
JIRA: YARDSTICK-1462 Change-Id: I001a173fc728be6e88f5ae6d38c64b740e536ff2 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> (cherry picked from commit ad63af7f42d07cffde73c32727f170973ce5ba46)
2018-10-30Add test library name update in DMF and mainflowsOrest Voznyy2-10/+54
Add automatic update of traffic profile items library name update, as well as update of session profile Dmf library name, to avoid the need of user changing it in template files. Update affected unit tests. JIRA: YARDSTICK-1474 Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit 1fd3806d6a6bac19f3173da4d6cb94cef81fd7f5)
2018-10-30Add traffic duration support in test caseOrest Voznyy2-3/+25
Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit ae2ceba66519555749c67eefe2170ea716a1411b)
2018-10-26fix yardstick verify jobrexlee87761-2/+7
The regex is not compatible with pip version 18. JIRA: INFRA-310 Change-Id: I6eaf1e3fac183f85c277934929e9065efa88d877 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit a4084d27de22c64ecb690369c7bed49175703adf)
2018-10-05Update Ixia tg to use new API for traffic model creationSerhiy Pshyk1-1/+4
JIRA: YARDSTICK-1464 Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> (cherry picked from commit 81ed5cdea4c36d45c6463523c6a0bc38495e544a)
2018-10-04Merge "Fix influxdb "field type conflict" error" into stable/gambiaAbhijit Sinha1-3/+3
2018-10-04Merge "NSB PROX NFVi Test does not stop after reaching expected precision" ↵Emma Foley12-19/+36
into stable/gambia
2018-10-03Fix influxdb "field type conflict" errorPatrice Buriez1-3/+3
JIRA: YARDSTICK-1457 Field types must be consistent across points in a measurement, otherwise influxdb rejects newer points with "field type conflict" error. This error was faced when "theor_max_throughput" field, meant to be assigned as a float from "TxThroughput" sample, was instead assigned as an int from initial value of theor_max_thruput variable. This especially occured for subsequent packet sizes, when theor_max_thruput variable was reset to its default int value. This fix changes the default value of theor_max_thruput variable to 0.0, and also makes sure that the default value for "Actual_throughput" field is consistently a float. Change-Id: If8d4f1297094709fe9657ab3e2b8adaad09815b2 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 2f4418798a3cf245f863a617410403f226062ac8)
2018-10-03NSB PROX NFVi Test does not stop after reaching expected precisionDanielMartinBuckley12-19/+36
JIRA: YARDSTICK-1419 When using prox_binsearch algorithm, a binary search is performed, increasing lower bound when step was successful and decreasing upper bound when the step was a failure. This runs until the test_precision (as specified in the traffic profile) is reached. When the test precision is reached, the test is not completed until the runner duration is reached. As runner duration is usually high (e.g. 1800sec), the tests take much too long to execute. This makes it difficult to create test suites. Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com> (cherry picked from commit 7d5ff45a3b793f5e50b4a32b2438ab11fed6c899)
2018-10-03Modify IxNextgen API for traffic model configurationSerhiy Pshyk2-31/+97
Changes to IxNextgen API: - modify API for traffic model configuration so that it can be used to create/configure different models - add methods to start and stop protocols on IxNetwork - add method for getting assigned ports JIRA: YARDSTICK-1455 Change-Id: I43c10fea9ba83994caf373ceff8b0252a45439b3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> (cherry picked from commit 7237241a396871d637f9906c1fc93a8587a7b726)
2018-09-21Merge "SA: Fix private key file name generation issue"Abhijit Sinha1-1/+1
2018-09-21Merge "[NSB] Adds support for running "black box" test cases for VNFs"Abhijit Sinha2-0/+116
2018-09-21[NSB] Adds support for running "black box" test cases for VNFsChornyi, TarasX2-0/+116
Using AgnosticVNF is now possible to create a "black box" testcase for any VNF. Example rfc2544 test with TRex as trafficgen samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml and Ixia samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml NOTE: Yardstick will not interact with VNF. No KPIs from VNF will be collected JIRA: YARDSTICK-1438 Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-09-20Merge changes from topics 'YARDSTICK-1354', 'YARDSTICK-1348', ↵Abhijit Sinha9-0/+3460
'YARDSTICK-1359', 'YARDSTICK-1356' * changes: Add vEPC service request test cases Add network initiated dedicated bearers creation Add UE initiated dedicated bearer creation test Add vEPC infrastructure for Landslide TG Add vEPC default bearers relocation test case Add vEPC default bearers create/delete test case Add Spirent Landslide traffic profile templates Update LSResourceHelper unittests Add Spirent Landslide TG API Added Landslide Resource Helper implementation Add TclClients for Spirent Landslide TG
2018-09-20SA: Fix private key file name generation issueMytnyk, Volodymyr1-1/+1
In current implementation of Yardstick, SA context uses the same SSH key file name for each VM created. E.g. the Yardstick overrides the key file context each time the new VM is created. As a result, the key file is valid only for last VM created by Yardstick causing the connection problem for other VMs. Solution is to generate different key file name for each VM name separately. JIRA: YARDSTICK-1436 Change-Id: I22ae2874695736255aa3314654a2cced9338b53d Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-09-18Add IxNextgen API for creating Vlans configurationsSerhiy Pshyk2-0/+109
New IxNextgen API allows to configure Vlans(vlan id, priority, tp id) to Ethernet layer of device group. JIRA: YARDSTICK-1420 Change-Id: I1c5fe37b5beb11daf1c539933fcad60832553bb9 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-09-15Add vEPC infrastructure for Landslide TGOrest Voznyy2-0/+147
1. Add yardstick topology and model for fully emulated environment. 2. Add support for black-box testing of real vEPC VNF vs Spirent Landslide traffic generator: - vEPC VNF pod file - topology and model files aware of vEPC VNF connection to Spirent Landslide TG - stub class for vEPC VNF, and related unit tests JIRA: YARDSTICK-1424 Change-Id: If7b6d19919679347c4360f4a0f2e420716e7fd2d Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-13Merge "Cleanup unittests for test_lmbench"Abhijit Sinha1-29/+27
2018-09-13Assign IXIA ports in one call instead of one by oneMytnyk, Volodymyr2-6/+11
Assigning IXIA ports one by one takes more time than assign all ports by once. Also, assigning ports in one call resolves the assign port issues caused on some IXIA chassis versions. JIRA: YARDSTICK-1425 Change-Id: Ibb08e40ee1a8762573f6752bdd1f583c5a1d9d2a Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-09-13Update LSResourceHelper unittestsEmma Foley2-11/+201
New unit tests have been added to make sure the right commands are sent to Spirent LS. This helps to ensure that the correct commands are sent to Spirent, so that potentially breaking changes can be flagged. JIRA: YARDSTICK-1356 Change-Id: I23f452355afcec2705da7d4665a34b178e2ba729 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-09-13Merge "Add UT: ArithmeticRunner exception handling"Emma Foley1-1/+227
2018-09-13IXIA traffic mac address is set incorrectlyMytnyk, Volodymyr1-2/+2
IXIA API sets the src/dst mac of the traffic always into default value. The `srcmac`/`dstmac` is never set in `traffic_param` map [1]. Instead the src/dst mac is stored in traffic_param[`outer_l2`]. [1] https://gerrit.opnfv.org/gerrit/gitweb?p=yardstick.git;a=blob;f=yardstick/network_services/traffic_profile/ixia_rfc2544.py;h=44bf2eafc7f8cf03ebd2c8520d316358fe1e5fc2;hb=HEAD#l92 JIRA: YARDSTICK-1423 Change-Id: Iabab7a54404b284d3b95bbea6c8624233c138351 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-09-13Merge "tc046 kill keystone process condition incorrect - dovetail"Rex Lee1-2/+2