aboutsummaryrefslogtreecommitdiffstats
path: root/yardstick/network_services/vnf_generic
AgeCommit message (Collapse)AuthorFilesLines
2019-02-11Merge "Debugging information when dpdk bind fails should be improved"Abhijit Sinha1-0/+3
2019-02-08Merge "Fix QnQ issue"Volodymyr Mytnyk1-1/+1
2019-02-08Migrate Trex TG to use new NSPerf-RFC2544 scenarioMytnyk, Volodymyr3-42/+89
JIRA: YARDSTICK-1592 Change-Id: Ic51a52385ac53df9b5f56387af4f1b661bb0d86f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-02-07Update Intel Copyright for files edited in 2019John O Loughlin18-18/+18
JIRA: YARDSTICK-1591 Change-Id: I3ea9039d25bfce578681adb9e27e1598e84a1f56 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-07Merge "Add Warning for key issue ixload"Volodymyr Mytnyk1-1/+6
2019-02-07Add Warning for key issue ixloadJohn O Loughlin1-1/+6
Currently there is a section of code that assigns a gateway links[name]["ip"]["gateway"] = gateway If the ip field has not already been defined a key error is thrown and not handled. This error is then suppressed so the program fails silently and thus causes the test case to hang. JIRA: YARDSTICK-1586 Change-Id: I94a1081a2038fb58989b3033444ea5f3a6e178f0 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-06Debugging information when dpdk bind fails should be improvedDanielMartinBuckley1-0/+3
JIRA: YARDSTICK-1585 When dpdk-devbind.py is failing, the information provided is poor, making it difficult to debug. At least the exact command used should be printed, ideally with the returned error. As of today, the more interesting line is DpdkBindHelperException: /opt/nsb_bin/dpdk-devbind.py command failed with rc=1 Change-Id: I7831c81ffa9e1f4695480eb140fa97a58ff88f8c Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-06Extend IXIA RFC2544 test case collected statsOleksandr Naumets1-0/+1
Added new fields into Yardstick NSB IXIA RFC2544 test case results: - Iteration (only for NSPerf-RFC2544 scenario) - Rate (for NSPerf and NSPerf-RFC2544 scenarios) - PktSize (for NSPerf and NSPerf-RFC2544 scenarios) JIRA: YARDSTICK-1596 Change-Id: I3bbf4aabf8b57580ebe644e967a5dab69e3a7c8d Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-05Fix QnQ issueJohn O Loughlin1-1/+1
Currently if multiple tests are run with a QnQ section defined the QnQ segment gets appended to the frame. This leads to invalid frames when the test is run for more than 1 iteration. With this patch the QnQ is updated if the QnQ segment has already been created. JIRA: YARDSTICK-1513 Change-Id: I4ba6ef89380ccf1cb8a132ff5bf048935a87f0c9 Signed-off-by: John O Loughlin <john.oloughlin@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-05Merge "Add vBNG test cases stats processing functionality"Volodymyr Mytnyk1-54/+223
2019-02-04Trex client not starting in 4 port baremetalDanielMartinBuckley1-3/+19
JIRA: YARDSTICK-1589 After calling STLclient.connect() there is no check if connection was sucessfull or not. Added a check for success on connect, retry if failure and disconnect and connect on timeout. If still connect failed then do not resume .. end with LOG.critial and exit. Change-Id: Ifd306b7920d9acbc16681cf79bf952d5af31eb64 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-01Add vBNG test cases stats processing functionalityOleksandr Naumets1-54/+223
JIRA: YARDSTICK-1546 Change-Id: I3575223ef8231fb4d574e961360b0f2d90a71749 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-01Refactor SampleVNF wait methodMytnyk, Volodymyr4-1/+60
JIRA: YARDSTICK-1439 Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-31Add rate 'resolution' option for IXIA rfc2544 testSerhiy Pshyk2-11/+23
Rate resolution value is compared with the difference between the rates in two consecutive iterations. If the difference is smaller than the resolution, the test stops. JIRA: YYARDSTICK-1592 Change-Id: I3f203d33d1688734a59a8f62f31e3ad238bc63b0 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-31Add new scenario NSPerf-RFC2544Serhiy Pshyk1-0/+108
List of changes: - Added new scenario NSPerf-RFC2544 that runs complete test per runner's iteration - NSPerf is still present for backward compatibility - Added ScenarioOutput class which allows scenario to report data (kpi,...) at any moment of time (not only once per run) - New output mechanism is used only by new NSPerf-RFC2544 scenario JIRA: YARDSTICK-1592 Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-30Merge "NSB sync: clean-up draft IPC implementation (part 1)"Volodymyr Mytnyk21-195/+81
2019-01-29Update Intel CopyrightJohn O Loughlin1-1/+1
JIRA: YARDSTICK-1591 Change-Id: I5130602e767009d83f7b39801006d68bcc126ba6 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-29NSB sync: clean-up draft IPC implementation (part 1)Mytnyk, Volodymyr21-195/+81
The existing implementation of IPC is not finished and isn't used by any of the VNFs/TG implementation. It is used in the code but does nothing from functionality perspective. New syncronization mechanism is going to be implemented by using different approach than it was designed before. Thus, the current IPC mechanism is not going to be re-used. So, removing it. The IPC consumer/producer implementation is left as it may be required for other purposes. - Remove SampleVNF MQ consumer class - Remove IterationIPC MQ producer for VNF control messages - Remove MQ producer from SampleVNFTrafficGen class - Remove TrafficGeneratorProducer class - Remove IterationIPC runner - Remove unused task_id form VNF Generic initialization as it is not required for synchronization of VNFs/TGs anymore. - Fix UT JIRA: YARDSTICK-1592 Change-Id: I65fe51bcbd1bfeea0c43eb79ca6fb2aab5b65ae7 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-15Fix minor issues with IxNet L3 rfc2544Chornyi, TarasX1-2/+2
Changed default rate from 100pps to 100%. Set Ip mask to 32 JIRA: YARDSTICK-1566 Change-Id: I4c0245297b2d6b254c06155047c3499f6572e9c5 Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2019-01-10Merge "Add IxNetwork L3 scenario implementation"Volodymyr Mytnyk1-5/+85
2018-12-27Add IxNetwork L3 scenario implementationMyron Sosyak1-5/+85
Protocol interfaces are creating with config from pod file Static IP configuration are creating from testcase flow options JIRA: YARDSTICK-1570 Change-Id: I74cde67b5084d5b65d09934fe8fce7760b5ea461 Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
2018-12-27NSB support for [core x-y] NSB PROX NFVI configurationDanielMartinBuckley1-0/+36
JIRA: YARDSTICK-1571 Cores in PROX support multiple configurations NSB supports today the more basic one, i.e. [core x] When one wants to use multiple cores sharing the same configuration, instead of copying the whole [core] section, PROX support the following syntax [core x-y] where x is the 1st core and y the last one or (for instance) [core x,y,z] NSB Now supports [core a,b,c,d] [core a-d] [core a,c-d] Change-Id: I34cd107143c89e16d58e7a99e1887ffbf720a5d1 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-12-20Merge "Addition of IRQ Mode to NSB NFVI (PROX)"Abhijit Sinha2-1/+247
2018-12-11Extend vBNG PPPoE test cases functionalityOleksandr Naumets1-7/+156
Extended Ixia traffic generator with functionality to create traffic flows between device groups. JIRA: YARDSTICK-1521 Change-Id: Iaaa822f2f3da876629576d4101be29c9a65296d0 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-12-11Merge "Add option to allow user to pass vpe_script"Volodymyr Mytnyk2-6/+14
2018-12-07Add vBNG PPPoE test cases functionalitySerhiy Pshyk2-4/+210
Added vBNG PPPoE test cases functionality which allows to: - create and configure access network connections (PPPoE subscribers); - create and configure core network connections; - configure and run traffic between access and core network topologies. JIRA: YARDSTICK-1508 Change-Id: I90975505fe7318227a837d97e8db4a06712de7eb Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2018-11-28Addition of IRQ Mode to NSB NFVI (PROX)DanielMartinBuckley2-1/+247
JIRA: YARDSTICK-1524 Add dashboard, Traffic Profile support, PROX IRQ support, topology Change-Id: I0c0cde66f4f4d3d25aa77c502bd4349cc1b3eca2 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-27NSB NFVi PROX Should report realtime port activity notDanielMartinBuckley1-0/+124
historical data JIRA: YARDSTICK-1458 The TG is only sampled at the end of every test interval. This is incorrect. It should be sampled every interval. Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-11-27Add option to allow user to pass vpe_scriptJohn O Loughlin2-6/+14
Add option to allow user to pass their own vpe_script vpe_script will be auto-generated by default. To use your own config file use the 'script' parameter in the config file vnf_config: { file: './vpe_config/vpe_config_2_ports', action_bulk_file: './vpe_config/action_bulk_512.txt', full_tm_profile_file: './vpe_config/full_tm_profile_10G.cfg', script_file: './vpe_config/vpe_script_sample } JIRA: YARDSTICK-1525 Change-Id: Ie23e5705f4c0475e858be73b8a504a7df8898828 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-14Remove unused functions vpeJohn O Loughlin1-151/+0
JIRA: YARDSTICK-1473 Change-Id: Ib9d3eb01f3fd900cbb08d55fc21fb95beceec941 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-14Add option to pass config file to vPEJohn O Loughlin2-16/+26
Yardstick should not generate config files for vPE. The current autogenerated configfile is incorrect. Therefore this patch is removing the auto-generation functionality. JIRA: YARDSTICK-1473 Change-Id: I9d909fcd0ac517d5ccdefb024c89b6bf979ef9c0 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2018-11-07Merge "Setup hugepages on SA host(sriov, ovs_dpdk)"Abhijit Sinha1-15/+2
2018-11-05Update Multi Port Stats reading for PROXDanielMartinBuckley2-59/+114
JIRA: YARDSTICK-1458 Removed excessive jitter by removing extra sleeps in start/stop/reset ssh Removed extra retries when bad data returned Added a slep at end of test to give runner a chance to empty the queue on shutdown Added a timeout on port retry attempts Change-Id: Ica60b11c7af242817a83c154157827581f60d16a Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-10-30Add RFC2544 iteration status fieldMytnyk, Volodymyr2-4/+17
Added new RFC2544 iteration status field into the testcase result to be able to exctract the best RX/TX throughput value from each iteration. The field equal "Success" if the trhoughput value is in the given drop percentage range and "Failure" otherwise. JIRA: YARDSTICK-1389 Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-10-30Merge "Add test library name update in DMF and mainflows"Abhijit Sinha1-5/+21
2018-10-27Setup hugepages on SA host(sriov, ovs_dpdk)Serhiy Pshyk1-15/+2
JIRA: YARDSTICK-1461 Change-Id: Ia1f5026eee989672aac57775ec9dd182df658fa4 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-26Add traffic duration support in test caseOrest Voznyy1-0/+7
Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-26Add test library name update in DMF and mainflowsOrest Voznyy1-5/+21
Add automatic update of traffic profile items library name update, as well as update of session profile Dmf library name, to avoid the need of user changing it in template files. Update affected unit tests. JIRA: YARDSTICK-1474 Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-10-17Merge "Added traffic update capability to Ixload TG"Abhijit Sinha1-6/+29
2018-10-11Added traffic update capability to Ixload TGMyron Sosyak1-6/+29
Allow yardstick to update IP/MAX of Net traffic - Implemented functionality for updating traffics IP/MAC address in ixloadconfiguration. - Extended http_ixload.py with functions for update IP/MAC address of netTraffic. - In HTTP-vFW_IPv4_2Ports_Concurrency.rxf changed name's of networks from "client network" to "uplink_0 and the same for server JIRA: YARDSTICK-1418 Change-Id: I28ef68b77466fff15af589954e3ef63e8099428f Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com> Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>
2018-10-05Update Ixia tg to use new API for traffic model creationSerhiy Pshyk1-1/+4
JIRA: YARDSTICK-1464 Change-Id: Ibbced9e0e04e077ec5c23fc15e97308dd11b7004 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-10-02NSB PROX NFVi Test does not stop after reaching expected precisionDanielMartinBuckley1-1/+1
JIRA: YARDSTICK-1419 When using prox_binsearch algorithm, a binary search is performed, increasing lower bound when step was successful and decreasing upper bound when the step was a failure. This runs until the test_precision (as specified in the traffic profile) is reached. When the test precision is reached, the test is not completed until the runner duration is reached. As runner duration is usually high (e.g. 1800sec), the tests take much too long to execute. This makes it difficult to create test suites. Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-09-21Merge "[NSB] Adds support for running "black box" test cases for VNFs"Abhijit Sinha1-0/+46
2018-09-21[NSB] Adds support for running "black box" test cases for VNFsChornyi, TarasX1-0/+46
Using AgnosticVNF is now possible to create a "black box" testcase for any VNF. Example rfc2544 test with TRex as trafficgen samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml and Ixia samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml NOTE: Yardstick will not interact with VNF. No KPIs from VNF will be collected JIRA: YARDSTICK-1438 Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-09-15Add vEPC infrastructure for Landslide TGOrest Voznyy1-0/+53
1. Add yardstick topology and model for fully emulated environment. 2. Add support for black-box testing of real vEPC VNF vs Spirent Landslide traffic generator: - vEPC VNF pod file - topology and model files aware of vEPC VNF connection to Spirent Landslide TG - stub class for vEPC VNF, and related unit tests JIRA: YARDSTICK-1424 Change-Id: If7b6d19919679347c4360f4a0f2e420716e7fd2d Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-13Update LSResourceHelper unittestsEmma Foley1-1/+1
New unit tests have been added to make sure the right commands are sent to Spirent LS. This helps to ensure that the correct commands are sent to Spirent, so that potentially breaking changes can be flagged. JIRA: YARDSTICK-1356 Change-Id: I23f452355afcec2705da7d4665a34b178e2ba729 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-09-12Add Spirent Landslide TG APIEmma Foley1-3/+179
New TG class "LandslideTrafficGen" represents an interface to use Spirent Landslide API to configure and execute vEPC test cases on hardware/software Spirent environment. For that purpose this class and its helper classes use Spirent Landslide REST API calls and Landslide TCL API calls via library module lsapi.py. Change-Id: Ib6560d5cd2483c6c9f5c95568345ac39bfebbd4d Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-08Added Landslide Resource Helper implementationEmma Foley1-5/+511
Class "LandslideResourceHelper" provides API for operations needed - to configure Landslide test session - manage test session execution (start/stop/abort) - collect measurements during test run This helper class API is responsible to for configure Landslide test runs: - create test user - create test servers (for emulation of specific vEPC blocks) - create SUTs (actual tested VNFs performing specific vEPC roles) - create test session (contains actual test cases) - create DMFs (pre-defined traffic flows in traffic profile) - operate traffic run execution (start, stop, abort) - monitor test run status - collect KPIs on TG side Some of these features use Landslide REST API. Other ones use Landslide TCL API. JIRA: YARDSTICK-1356 Change-Id: I8fc8a7d85301121da465d054b8d38ae09a541c36 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-05Add TclClients for Spirent Landslide TGOrest Voznyy1-0/+521
Add class "LandslideTclClient" which holds TCL calls wrappers for operations on the LandSlide TG. It also introduces several new parameters in - test case YAML file structure: * session_profile: YAML file holding a template of Landslide test session for specific vEPC test scenario * dmf: test case options member holding traffic flow specific parameters for designated test scenario, that override ones in traffic_profile YAML file * test_cases: test case options member holding parameters specific to designated vEPC test case, overriding those in session_profile template file - pod YAML file structure: * tas_manager: holds parameters used to connect to Spirent Landslide TAS * config: list of entries describing Landslide test servers access, their network interfaces configuration, information of vEPC elements emulated by specific test server Class "LandslideProfile" implements access to traffic profile template from "LandslideResourceHelper" class. JIRA: YARDSTICK-1356 Change-Id: Ia6428072b1e72025be17c94e5141bd23f7993247 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-08-23Merge "Runners crash on test startup."Abhijit Sinha1-3/+4