aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick/tests
AgeCommit message (Collapse)AuthorFilesLines
2018-10-26fix yardstick verify jobrexlee87761-2/+7
The regex is not compatible with pip version 18. JIRA: INFRA-310 Change-Id: I6eaf1e3fac183f85c277934929e9065efa88d877 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-10-17Merge "Added traffic update capability to Ixload TG"Abhijit Sinha3-1/+155
2018-10-12Merge "Modify handling Ixia traffic profile parameters"Abhijit Sinha1-0/+3
2018-10-11Added traffic update capability to Ixload TGMyron Sosyak3-1/+155
Allow yardstick to update IP/MAX of Net traffic - Implemented functionality for updating traffics IP/MAC address in ixloadconfiguration. - Extended http_ixload.py with functions for update IP/MAC address of netTraffic. - In HTTP-vFW_IPv4_2Ports_Concurrency.rxf changed name's of networks from "client network" to "uplink_0 and the same for server JIRA: YARDSTICK-1418 Change-Id: I28ef68b77466fff15af589954e3ef63e8099428f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>
2018-10-10Modify handling Ixia traffic profile parametersOleksandr Naumets1-0/+3
Modified Ixia traffic profile class to handle all traffic parameters as optional. JIRA: YARDSTICK-1456 Change-Id: Ib7ee1728baad0f271dd6a923b94bc686bc9bffc6 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-10Add IxNextgen API for creating BGP protocol layerOleksandr Naumets1-0/+15
Added functionality to create BGP protocol layer for device group JIRA: YARDSTICK-1465 Change-Id: Ib18b979ce09589b5eda438f01f4f8845295e4c71 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-10-03Merge "NSB PROX NFVi Test does not stop after reaching expected precision"Abhijit Sinha4-14/+16
2018-10-02Modify IxNextgen API for traffic model configurationSerhiy Pshyk1-10/+49
Changes to IxNextgen API: - modify API for traffic model configuration so that it can be used to create/configure different models - add methods to start and stop protocols on IxNetwork - add method for getting assigned ports JIRA: YARDSTICK-1455 Change-Id: I43c10fea9ba83994caf373ceff8b0252a45439b3 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-02NSB PROX NFVi Test does not stop after reaching expected precisionDanielMartinBuckley4-14/+16
JIRA: YARDSTICK-1419 When using prox_binsearch algorithm, a binary search is performed, increasing lower bound when step was successful and decreasing upper bound when the step was a failure. This runs until the test_precision (as specified in the traffic profile) is reached. When the test precision is reached, the test is not completed until the runner duration is reached. As runner duration is usually high (e.g. 1800sec), the tests take much too long to execute. This makes it difficult to create test suites. Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-09-21Merge "[NSB] Adds support for running "black box" test cases for VNFs"Abhijit Sinha1-0/+70
2018-09-21[NSB] Adds support for running "black box" test cases for VNFsChornyi, TarasX1-0/+70
Using AgnosticVNF is now possible to create a "black box" testcase for any VNF. Example rfc2544 test with TRex as trafficgen samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml and Ixia samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml NOTE: Yardstick will not interact with VNF. No KPIs from VNF will be collected JIRA: YARDSTICK-1438 Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-09-20Merge changes from topics 'YARDSTICK-1354', 'YARDSTICK-1348', ↵Abhijit Sinha3-0/+2141
'YARDSTICK-1359', 'YARDSTICK-1356' * changes: Add vEPC service request test cases Add network initiated dedicated bearers creation Add UE initiated dedicated bearer creation test Add vEPC infrastructure for Landslide TG Add vEPC default bearers relocation test case Add vEPC default bearers create/delete test case Add Spirent Landslide traffic profile templates Update LSResourceHelper unittests Add Spirent Landslide TG API Added Landslide Resource Helper implementation Add TclClients for Spirent Landslide TG
2018-09-18Add IxNextgen API for creating Vlans configurationsSerhiy Pshyk1-0/+41
New IxNextgen API allows to configure Vlans(vlan id, priority, tp id) to Ethernet layer of device group. JIRA: YARDSTICK-1420 Change-Id: I1c5fe37b5beb11daf1c539933fcad60832553bb9 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-09-15Add vEPC infrastructure for Landslide TGOrest Voznyy1-0/+94
1. Add yardstick topology and model for fully emulated environment. 2. Add support for black-box testing of real vEPC VNF vs Spirent Landslide traffic generator: - vEPC VNF pod file - topology and model files aware of vEPC VNF connection to Spirent Landslide TG - stub class for vEPC VNF, and related unit tests JIRA: YARDSTICK-1424 Change-Id: If7b6d19919679347c4360f4a0f2e420716e7fd2d Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-13Merge "Cleanup unittests for test_lmbench"Abhijit Sinha1-29/+27
2018-09-13Assign IXIA ports in one call instead of one by oneMytnyk, Volodymyr1-2/+2
Assigning IXIA ports one by one takes more time than assign all ports by once. Also, assigning ports in one call resolves the assign port issues caused on some IXIA chassis versions. JIRA: YARDSTICK-1425 Change-Id: Ibb08e40ee1a8762573f6752bdd1f583c5a1d9d2a Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com> Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-09-13Update LSResourceHelper unittestsEmma Foley1-10/+200
New unit tests have been added to make sure the right commands are sent to Spirent LS. This helps to ensure that the correct commands are sent to Spirent, so that potentially breaking changes can be flagged. JIRA: YARDSTICK-1356 Change-Id: I23f452355afcec2705da7d4665a34b178e2ba729 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-09-13Merge "Add UT: ArithmeticRunner exception handling"Emma Foley1-1/+227
2018-09-12Add Spirent Landslide TG APIEmma Foley1-37/+368
New TG class "LandslideTrafficGen" represents an interface to use Spirent Landslide API to configure and execute vEPC test cases on hardware/software Spirent environment. For that purpose this class and its helper classes use Spirent Landslide REST API calls and Landslide TCL API calls via library module lsapi.py. Change-Id: Ib6560d5cd2483c6c9f5c95568345ac39bfebbd4d Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-08Added Landslide Resource Helper implementationEmma Foley1-33/+701
Class "LandslideResourceHelper" provides API for operations needed - to configure Landslide test session - manage test session execution (start/stop/abort) - collect measurements during test run This helper class API is responsible to for configure Landslide test runs: - create test user - create test servers (for emulation of specific vEPC blocks) - create SUTs (actual tested VNFs performing specific vEPC roles) - create test session (contains actual test cases) - create DMFs (pre-defined traffic flows in traffic profile) - operate traffic run execution (start, stop, abort) - monitor test run status - collect KPIs on TG side Some of these features use Landslide REST API. Other ones use Landslide TCL API. JIRA: YARDSTICK-1356 Change-Id: I8fc8a7d85301121da465d054b8d38ae09a541c36 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-07Add IxNextgen API for creating PPPoX configurationsSerhiy Pshyk1-0/+107
New IxNextgen API allows to perform the following configurations on IxNetwork: - add topology - add device group to topology - add ethernet protocol layer to device group - add ipv4 protocol layer to device group - add pppox protocol layer to device group JIRA: YARDSTICK-1408 Change-Id: Icf5bb5f24784cf2c167c515b04c81471ac425e38 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-09-05Add TclClients for Spirent Landslide TGOrest Voznyy2-0/+858
Add class "LandslideTclClient" which holds TCL calls wrappers for operations on the LandSlide TG. It also introduces several new parameters in - test case YAML file structure: * session_profile: YAML file holding a template of Landslide test session for specific vEPC test scenario * dmf: test case options member holding traffic flow specific parameters for designated test scenario, that override ones in traffic_profile YAML file * test_cases: test case options member holding parameters specific to designated vEPC test case, overriding those in session_profile template file - pod YAML file structure: * tas_manager: holds parameters used to connect to Spirent Landslide TAS * config: list of entries describing Landslide test servers access, their network interfaces configuration, information of vEPC elements emulated by specific test server Class "LandslideProfile" implements access to traffic profile template from "LandslideResourceHelper" class. JIRA: YARDSTICK-1356 Change-Id: Ia6428072b1e72025be17c94e5141bd23f7993247 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-04Add UT: ArithmeticRunner exception handlingMiikka Koistinen1-1/+227
* Use time.sleep to avoid multiprocessing.Queue broken pipe error. JIRA: YARDSTICK-1245 Change-Id: I1ef1f8e68a553278996b38c226314c13dd974faa Signed-off-by: Miikka Koistinen <miikka.koistinen@nokia.com>
2018-08-31TRex IMIX data must return percentage valueRodolfo Alonso Hernandez1-2/+9
Function "_create_imix_data" must return the weight in percentage, not in absolute value. JIRA: YARDSTICK-1406 Change-Id: I3bc409bab17ae5778a6783f4319699009a5437fa Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-30Merge "Add source and destination seed value in IXIA RFC2544"Rodolfo Alonso Hernandez1-2/+4
2018-08-29Assign static IP to VM for standalone contextStepan Andrushko3-10/+27
During VM spawning IP address should be assigned by DHCP server in the local network. Sometimes DHCP server is not capable to assign IP address. So, need to add static IP address. JIRA: YARDSTICK-1402 Change-Id: Ie59c340eb88eddcaff043496fc20aa48b49205ec Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-27Add source and destination seed value in IXIA RFC2544Rodolfo Alonso Hernandez1-2/+4
Add source and destination seed value in IXIA RFC2544 traffic profile. The default value for both parameters is 1. JIRA: YARDSTICK-1401 Change-Id: I3351194c8be9ac42cbf5655996d50b9b69884c72 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-27Merge "Make TRex IMIX traffic mode configurable"Rodolfo Alonso Hernandez1-6/+29
2018-08-27Merge "Make security group configurable - dovetail"Jing Lu2-1/+21
2018-08-23Make TRex IMIX traffic mode configurableRodolfo Alonso Hernandez1-6/+29
Enable TRex IMIX generation using two modes: - Distribution in packages. - Distribution in byes. The default one will be distribution in packages, like the default one in IxNetwork. JIRA: YARDSTICK-1397 Change-Id: I86b2527968496218b0515349fc0a2680a84261e5 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-23Merge "Fix setting `flow` configuration in TC yaml"Rodolfo Alonso Hernandez1-6/+4
2018-08-23Merge "Fix issues with 'Success_' stats reported by ProxBinSearchProfile"Abhijit Sinha1-61/+70
2018-08-23Merge "Runners crash on test startup."Abhijit Sinha1-0/+1
2018-08-23Merge "Provide access to VM in Standalone context"Rodolfo Alonso Hernandez3-35/+127
2018-08-23Runners crash on test startup.DanielMartinBuckley1-0/+1
JIRA: YARDSTICK-1393 The problem resides in this traffic generator class: this class is inheriting from SampleVNFTrafficGen and overriding the __init__ method but is NOT calling the parent class __init__ one. Change-Id: I206a66e361a3e2eb50bb5fa01ddadae25b4a9f54 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-23Provide access to VM in Standalone contextStepan Andrushko3-35/+127
Add possibility to access VM with SampleVNF image, which is spawned on baremetal server using password or key pairs (provided or generated). Changes provided for OVS-DPDK and SRIOV cases. JIRA: YARDSTICK-1260 Change-Id: I89cf17dc83f02abe23d206b24b9d0ec1298d3231 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-23Fix issues with 'Success_' stats reported by ProxBinSearchProfileSerhiy Pshyk1-61/+70
List of changes: - Added 'Status' field to indicate status of each search iteration. Possible values are 'Success', 'Failure', 'Result'. - Removed reporting of duplicated stats with 'Success_' prefix. Instead 'Status' field is set to 'Success' - Removed reporting of duplicated stats with 'Result_' prefix. Instead 'Status' field is set to 'Result' - Updated Prox_BM_L2FWD-4Port_MultiSize-1518452496550.json dashboard to query success and result status by 'Status' field value. JIRA: YARDSTICK-1386 Change-Id: I9a21a102af6cb4db137e805011b5d81c4943d77b Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-08-22Provide average latency results in IXIA KPIsRodolfo Alonso Hernandez1-10/+43
IXIA KPIs will provide an average value of all port latency values: max, min and avg. JIRA: YARDSTICK-1394 Change-Id: Ib7c7b5300e8343a1af0a20cb4e49c0bd669c1143 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-21Merge "Improvie TRex RFC2544 throughput calculation"Rodolfo Alonso Hernandez1-19/+24
2018-08-21Merge "Convert IXIA latency statistics to integer"Rodolfo Alonso Hernandez1-0/+16
2018-08-21Convert IXIA latency statistics to integerRodolfo Alonso Hernandez1-0/+16
JIRA: YARDSTICK-1385 Change-Id: Id50c393da7ded4b3c8e127f7d7a6501832a68446 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-21Merge "Make TRex latency statistics optional"Rodolfo Alonso Hernandez1-7/+8
2018-08-21Merge "the recovery action of "baremetal down" should be triggered mandatory"Rex Lee2-0/+53
2018-08-20Make TRex latency statistics optionalRodolfo Alonso Hernandez1-7/+8
Because of performance issues in TRex due to the extra power needed to retrieve the latency statistics, this parameter will be optional and disabled by default. JIRA: YARDSTICK-1388 Change-Id: I07c0ec7bef86fd438d078cbd6748b98bc8cc0b37 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-20Improvie TRex RFC2544 throughput calculationRodolfo Alonso Hernandez1-19/+24
Improve TRex RFC2544 throughput calculation by using the in/out packets instead of using the throughput samples. JIRA: YARDSTICK-1387 Change-Id: I877e901c3226d31c6435a877a2924bb95deb1cf0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-20Make security group configurable - dovetailrexlee87762-1/+21
Make sercurity group can be configured via the context. The format would be: context: name: demo image: yardstick-image flavor: yardstick-flavor user: ubuntu security_group: rules: - remote_ip_prefix: "0.0.0.0/0" protocol: "tcp" port_range_min: 1 port_range_max: 65535 - remote_ip_prefix: "0.0.0.0/0" protocol: "udp" port_range_min: 1 port_range_max: 65535 - remote_ip_prefix: "0.0.0.0/0" protocol: "icmp" JIRA: YARDSTICK-1360 Change-Id: I00c45767ee2d70b790590e824599d5a4c274bced Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-17Merge "Improve IXIA TG Rx/TX throughput calculation"Rodolfo Alonso Hernandez1-30/+20
2018-08-16Cleanup unittests for test_lmbenchEmma Foley1-29/+27
unused-arg check was re-enabled after being disabled at a file level. Changes were made so that the file conforms to our testing conventions. Change-Id: Ie34a0088258c1aaff6cb0fdf0b86b37920d35bd6 JIRA: YARDSTICK-1384 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-08-16Merge "IXIA traffic stops running after first iteration"Emma Foley1-1/+4
2018-08-16Merge "Disk Initialization and Custom Workload"Rex Lee1-30/+310