summaryrefslogtreecommitdiffstats
path: root/samples/vnf_samples/nsut
AgeCommit message (Collapse)AuthorFilesLines
2018-12-07Merge "Prox standalone test case changes:" into stable/gambiaAbhijit Sinha5-5/+321
2018-12-07Merge "Adding scale up test case for l3fwd OvS-DPDK." into stable/gambiaAbhijit Sinha1-0/+107
2018-12-06Prox standalone test case changes:Carey, Alan5-5/+321
Files renamed to include dpdk in name. User/Password fields not needed in standalone context. Fix with OvS test case file dpdk port number added. JIRA: YARDSTICK-1500 JIRA: YARDSTICK-1475 JIRA: YARDSTICK-1471 Change-Id: I0422b5341172f098b1ff95b51b6fbc71b1b049f0 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit fe1abfff948e66cfc3a897cb6a69dde9c4196780)
2018-12-06Adding scale up test case for l3fwd OvS-DPDK.Carey, Alan1-0/+107
JIRA: YARDSTICK-1547 Change-Id: I5915c0e8df343e2c21396a9892d4728377e333bc Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit fa73f65df5b53b07ffe345e4586b5d0e96dd42e7)
2018-12-06Adding scale up test case for l3fwd SRIOV.Carey, Alan3-23/+154
Topology file changed as original did not work. Added 'standalone-args.yaml' file for context information/details JIRA: YARDSTICK-1547 Change-Id: I76dc782dac14db50dc8802f4f69cf077da0257a2 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit fb8066f72e3cb67a1c3c88b7c26779e61a247bc3)
2018-11-28Prox L2FWD multiflow test fixAbhijit Sinha2-23/+70
Corrected the generator config file by adding the latency position validated the test case with it. JIRA: YARDSTICK-1530 Change-Id: I18dd1c7add8fc77bb59354fa96540ba8690057a4 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 10ea31ed7973e3e8893345e972f5bdef75657cf3)
2018-11-09Merge "Cleanup of ixia_profile attribute for IxNetwork TG" into stable/gambiaRex Lee51-105/+51
2018-11-08Cleanup of ixia_profile attribute for IxNetwork TGOrest Voznyy51-105/+51
Remove obsolete attribute "ixia_profile" from - test cases using IxNetwork as a TG - from unit tests related to IxNetwork Remove ixncfg files from repo. Remove mention of ixncfg files from test case files JIRA: YARDSTICK-1506 Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit fff1e25f3a882739b94458c741a5f86645f1210c)
2018-11-08Adding new test case for prox Standalone L3FWD.Carey, Alan2-0/+189
This contains two files: 2 & 4 port test cases. JIRA: YARDSTICK-1515 Change-Id: I9b6b5fd47a854571bc4e9f67c570b183e65245db Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 6d68fedcff4f4cc3ff9d1a44ae2f57fe0ad10eab)
2018-11-07Merge "Add Testcase for Prox Standalone SRIOV." into stable/gambiaAbhijit Sinha2-0/+123
2018-11-06Merge "Add Testcase for Prox Standalone OvS-DPDK." into stable/gambiaAbhijit Sinha1-0/+97
2018-11-06Add Testcase for Prox Standalone SRIOV.Carey, Alan2-0/+123
No sample testcase for prox SRIOV standalone. Renamed pod file so that other prox testcases can use this file JIRA: YARDSTICK-1471 Change-Id: Icc20e395a3fb4c9d1398f85198d64682b2a9ee33 Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit 0eaa53d46f1f2ced9a1d40ebf820580bf314b4a1)
2018-10-30Merge "Pod file fix for Prox 2 port" into stable/gambiaAbhijit Sinha1-2/+0
2018-10-30Add Testcase for Prox Standalone OvS-DPDK.Carey, Alan1-0/+97
No sample testcase for prox OvS-DPDK standalone. JIRA: YARDSTICK-1475 Change-Id: Ide65444d08d6c90e7e98d59b7d1f4cba8ca7397f Signed-off-by: Carey, Alan <alan.carey@intel.com> (cherry picked from commit b0e92a357658f4ece21e356653e8eb52d7ab8d98)
2018-10-30Merge "Fix latency for ACL test cases" into stable/gambiaAbhijit Sinha2-8/+18
2018-10-30Pod file fix for Prox 2 portAbhijit Sinha1-2/+0
Removing the "keyfile" from the pod file to align with other pod files for 1 and 4 port. The file when used as such currently gives an error. This change will fix that. JIRA:YARDSTICK-1477 Change-Id: Ibfa9387d068a0098ea0eb0b31ad96108d0602abc Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com> (cherry picked from commit 31eac948bba5cf442981fdc7b1392992aaef1f15)
2018-10-30Fix latency for ACL test casesPatrice Buriez2-8/+18
JIRA: YARDSTICK-1460 Cores running "mode=lat" must be properly configured with a correct "lat pos" parameter. When this parameter is missing, PROX exits with an error message. When the "lat pos" parameter is missing for cores running "mode=gen", latency values are not written into the packets. Also fixed some typos, packet inline format, IP len and UDP len. Change-Id: Ice06c5d74686c80f09bc60f568993dbf3165b338 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 7bc7bfb1b43e6329bbfc0ed7a7c5554ebcf10c2b)
2018-10-30Add traffic duration support in test caseOrest Voznyy1-0/+1
Implement code to support traffic_duration field in test case options. This updates the 'duration' in Landslide session profile. traffic_duration should always be much less than runner duration/timeout. JIRA: YARDSTICK-1427 Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> (cherry picked from commit ae2ceba66519555749c67eefe2170ea716a1411b)
2018-10-04Fix NSB PROX L3FWD dropping packetsPatrice Buriez2-2/+14
JIRA: YARDSTICK-1037 Adjusted number of RX/TX descriptors to 2048, instead of default 256, in order to cope with interrupts during which no packets are received by the core, which results in the NIC dropping packets when it gets out of available descriptors to buffer them. Also adjusted mempool size, because more descriptors need more mbufs. This change aligns L3FWD test case with other test cases, for which number of RX/TX descriptors is already set to 2048. Change-Id: I11378c078398aca799295b619bb3d14dbee04ca3 Signed-off-by: Patrice Buriez <patrice.buriez@intel.com> (cherry picked from commit 3adfba6bac0133bdbaa3db62e16f662e11d84fb8)
2018-09-21Merge "[NSB] Adds support for running "black box" test cases for VNFs"Abhijit Sinha4-0/+188
2018-09-21[NSB] Adds support for running "black box" test cases for VNFsChornyi, TarasX4-0/+188
Using AgnosticVNF is now possible to create a "black box" testcase for any VNF. Example rfc2544 test with TRex as trafficgen samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml and Ixia samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml NOTE: Yardstick will not interact with VNF. No KPIs from VNF will be collected JIRA: YARDSTICK-1438 Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-09-20Merge changes from topics 'YARDSTICK-1354', 'YARDSTICK-1348', ↵Abhijit Sinha9-0/+809
'YARDSTICK-1359', 'YARDSTICK-1356' * changes: Add vEPC service request test cases Add network initiated dedicated bearers creation Add UE initiated dedicated bearer creation test Add vEPC infrastructure for Landslide TG Add vEPC default bearers relocation test case Add vEPC default bearers create/delete test case Add Spirent Landslide traffic profile templates Update LSResourceHelper unittests Add Spirent Landslide TG API Added Landslide Resource Helper implementation Add TclClients for Spirent Landslide TG
2018-09-15Add vEPC service request test casesOrest Voznyy2-0/+295
Add UE and network initiated testcase and related session profiles. JIRA: YARDSTICK-1429 Change-Id: I16d6c065cf346db31e235ac5add57509cfbc8009 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-15Add network initiated dedicated bearers creationOrest Voznyy1-0/+164
Adding related pod file, session profile and testcase file. JIRA: YARDSTICK-1355 Change-Id: Ic97d59ef3a36ac05c6c369c36f917ae95d18d863 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-15Add UE initiated dedicated bearer creation testOrest Voznyy1-0/+74
Adding session profile and test case file. JIRA: YARDSTICK-1353 Change-Id: Iaa98fd8cb3ed243f9ac157089de32fa23ec0e6b4 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-15Add vEPC infrastructure for Landslide TGOrest Voznyy2-0/+100
1. Add yardstick topology and model for fully emulated environment. 2. Add support for black-box testing of real vEPC VNF vs Spirent Landslide traffic generator: - vEPC VNF pod file - topology and model files aware of vEPC VNF connection to Spirent Landslide TG - stub class for vEPC VNF, and related unit tests JIRA: YARDSTICK-1424 Change-Id: If7b6d19919679347c4360f4a0f2e420716e7fd2d Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-15Add vEPC default bearers relocation test caseOrest Voznyy1-0/+62
This test case runs on Spirent Landslide TG. All vEPC entities are emulated on Landslide test servers. Test case actions sequence: - create default bearers - start sending traffic - partial/full bearers relocation between two ENodeB's, Intra-MME - disconnect all bearers JIRA: YARDSTICK-1354 Change-Id: I95c7b0001ddb363402013d83ae8617b88b2a4bd9 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-15Add vEPC default bearers create/delete test caseOrest Voznyy2-0/+114
This test case runs on Spirent Landslide TG. All vEPC entities are emulated on Landslide test server. Test run configuration is performed in following files: 1. test case file 2. pod file 3. session profile file (landslide_session_default_bearer*.yaml) The structure of these files represents configuration of different parts of test cases in this test session. The order of test cases should always match. Spirent Landslide test types involved: "SGW_Node", "SGW_Nodal". Test case actions sequence: - create default bearers (as per value of "Sessions" key) with specified rate (session profile key "StartRate") - send traffic flow(s) (pre-configured in traffic profile) for a number of seconds (specified in session profile key "duration") - remove N default bearers with specified rate (session profile key "DisconnectRate") Parameters with ALL_CAPS values are placeholders. User should replace them with their own condifuration. Session profile file placeholders do not need to be replaced as long as these parameters are overriden in other files (e.g. pod, test case). Test results are dispatched according to runner configuration options. For fully emulated test runs like this one, best suited runner is "Search" type. In case of testing against real EPC VNFs, user could prefer different runner type. JIRA: YARDSTICK-1348 Change-Id: I5caf4878fb212b38d4148a297c5dba03b8ab98a8 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-04NSB NFVi PROX Missing VNF Statistics for CPU UtilizationDanielMartinBuckley37-0/+149
JIRA: YARDSTICK-1404 The test scripts require an extra argument to support collectd. Also the CPU utilization is a different variable name structure in the JSON file. Change-Id: I127b7e86c0f93f7743331a2d71eb81d690e42471 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-27Merge "Change tc_trex files to execute standalone tests"Rodolfo Alonso Hernandez9-53/+53
2018-08-14Change tc_trex files to execute standalone testsStepan Andrushko9-53/+53
Changes made in test cases for trex TG files to be able to run tests for standalone setup (OVS-DPDK/SRIOV). - tg__0: trafficgen_1 Changes to improve templates for tc_trex: - flavor: images: changed to default name: yardstick-nsb-image.img - default path for files under contexts section - RAM size JIRA: YARDSTICK-1368 Change-Id: Ida85de219acd566840de1a94975b8050c7f59b9b Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-02NSB NFVi PROX BNG and vPE losing many packetsDanielMartinBuckley9-10/+109
JIRA: YARDSTICK-1101 The traffic generated by the generator in bng-4 result in non-symmetrical use of the cores on the SUT, as a whole range of IP addresses is skipped. Update cpe0 and cpe1 in gen files. In addition, for the routing table (ipv4.lua) for the BNG should be slighly different: while the BNG is a 4 ports test, only 2 of the ports are used as outgoing routing ports (the inet ports). Hence, the routing table should only use the mac of those two ports. The bad configuration (using 4 ports) result in an issue when BNG SUT and GEN are connected through a switch, packets are sent by the BNG SUT through the INET interfaces, but sometimes with the MAC of the CPE interface... Hence, packets are received on the wrong interface on the Gen site (resulting in some interfaces, the CPE ones, being overloaded) Created ipv4_bng.lua and remove mac 0 and 2 Change-Id: I97019f0415d2f58d50ec855d04800eb705f41541 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-07-23Add pktgen test case base filesRodolfo Alonso Hernandez2-0/+210
Added pktgen VNF topology, VNF descriptor and traffic profile files. JIRA: YARDSTICK-1346 Change-Id: Ifb1824edb2dc8db1afa83a53573fb2ed1c2a79ea Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-07-11Add ACL sample config fileMytnyk, Volodymyr1-1/+9
The acl_rules.yaml is unused, so renamed it to sample config. Updated the config with example of possible ACL configuration. JIRA: YARDSTICK-1304 Change-Id: If0537cf55f4c96f57844caed5bf1c9050647e0d5 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-07-05Enable traffic generator PID in "NSPerf" scenario setupRodolfo Alonso Hernandez1-0/+96
Now "NSPerf" scenario will inform about the traffic generator PIDs after setup process. With this information, IterationIPC runner will be able to receive the messages sent by those traffic generators and control the main iteration loop. The following example, using vFW as VNF and OpenStack as context, makes use of this new runner implementation: /samples/vnf_samples/nsut/vfw/ tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex_iterationipc.yaml JIRA: YARDSTICK-1127 Change-Id: I46b1368bc209680b88ff9fb5c3b9beadf6271ac9 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-27NSB NFVi PROX BNG losing many packetsDanielMartinBuckley8-22/+44
JIRA: YARDSTICK-1101 Problem was incorrect generator and changed the traffic profile to allow a tolerated loss of 5%. ARP packets are not managed (just passed thru the system) therefor the tolerated loss must be higehr than normal. Change-Id: I03bd62b397a66b50961e810d033c6894d0b3e9a6 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-27NSB NFVi PROX VPE losing many packetsDanielMartinBuckley2-3/+6
JIRA: YARDSTICK-1105 Running a vPE test ends up with up to 25% drooped packets. This is due to tolerated loss being incorrectly configured, test duration was too short and test interval was too short. Note This is due to the fact that vPE use case have by default a tolerated loss of 100%, Now changed to 0.001, same as L2FWD Also: Grafan dashboard has been updated to show all SUT CPUS Utilization in 1 panel. And LINE rate MIN, MAX & TEST Rate have been added Change-Id: I7adae2199b3f656fe460705b6aeb3aa69c767d50 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-26Merge "Addition of Configurable Sampling and Configurable Confirmation Retry"Abhijit Sinha1-2/+8
2018-06-26Addition of Configurable Sampling and Configurable Confirmation RetryDanielMartinBuckley1-2/+8
JIRA: YARDSTICK-1221 In order to increase accuracy of result the following are done :- - Improve Measurement Accuracy (YARDSTICK-1212) - Improve Sampling Interval (YARDSTICK-1219) - Allow 4 PROX ports to be read simultaneously (YARDSTICK-1220) This change does the following :- - Stores LINE Rate statistics of Sample - Requires a confirmation retry before deciding to increase or decrease this is configurable. - Allows the user to disable Sampling or specify a sample interval - Added Code Coverage of ProxDurationRunner based on YARDSTICK-1199 Change-Id: I27242ac1849c9a2712866385b5fbc05977c71516 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-26NSB Topology fix for Prox 4 port test caseAbhijit Sinha14-47/+52
The uplink and downlink interfaces for the 4 port test cases were inconsistent and fixed in this commit. This affects all the 4 port PROX test cases. Tested on: Heat L2fwd-4 and L3fwd-4 test case. JIRA: YARDSTICK-1185 Change-Id: Ia2ce7ed0dc395b812f84ede94e259b42dc833579 Signed-off-by:Abhijit Sinha <abhijit.sinha@intel.com>
2018-06-22Merge "Configure ACL via static file"Abhijit Sinha4-136/+108
2018-06-21Configure ACL via static fileMytnyk, Volodymyr4-136/+108
This patch allows user to configure ACL/vFW SampleVNF ACL via configuration file provided in TC definition. The Yardstick applies the rules to SampleVNF from specified config file + rules generated by Yardstick (default rules). The example of SampleVNF ACL CLI commands generated/applied by Yardstick can be found at (using default ACL config file): ACL VNF ACL CLI commands: acl/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml http://paste.openstack.org/show/723303/ vFW VNF ACL CLI commands: vfw/tc_heat_rfc2544_ipv4_1rule_1flow_64B_trex.yaml http://paste.openstack.org/show/723304/ Change-Id: I76a630261a982083b628e3985fc3bec14ca495db Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-06-21Merge "Add scale out TCs with availability zone support"Rodolfo Alonso Hernandez4-0/+333
2018-06-18Update pmd/lcore mask for OVS-DPDK contextStepan Andrushko1-3/+5
Added default values for pmd/lcore mask to the SampleVNF test case for Trex TG. lcore mask - specifies the CPU cores used for non-datapath OVS-DPDK threads. pmd mask - specifies the CPU cores used for data path packet processing. Updated documentation for Standalone OVS-DPDK context. JIRA: YARDSTICK-1246 Change-Id: I8d008a185c94d2047ffa4769d7974bc4d283fd7f Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-06-07Fix latency in l2 and l3 PROX generator config filesXavier Simonart4-20/+85
JIRA: YARDSTICK-1211 Change-Id: I0899d470ca5a0ec7d42d36a9ff9c39cc7369310c Signed-off-by: Xavier Simonart <xavier.simonart@intel.com>
2018-05-28Merge "PROX: [WIP] Added scale up TCs."Rodolfo Alonso Hernandez10-0/+810
2018-05-25Add scale out TCs with availability zone supportMytnyk, Volodymyr4-0/+333
Add PROX and vFW scale out TCs with availability zone configuration. To be able to specify the availability zone for specific VNF or TG the following example of command line option shoud be used: yardstick -d task start --task-args='{ "num_vnfs": 2, "availability_zone": { "vnf_0": "az_0", "tg_0": "az_0", "vnf_1": "az_1", "tg_1": "az_1", ... }}' <SCALE-OUT-TC-FILE> The steps to run new scale-out TCs is documented in the userguide. JIRA: YARDSTICK-1203 Change-Id: Ib3878485c5483981fe9b48ab02995712bcc31ae5 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-05-09Fix Prox L2fwd generator packetAbhijit Sinha2-12/+7
The Prox L2-fwd test case has a bad packet, which fails the test case to run in OpenStack context as it's dropped by the neutron. This fix is needed to successfully run the L2fwd 2 and 4 port test cases in heat based test cases. Change-Id: I86df31a6df1eaa6f968e46af159ac6a0157f402c JIRA: YARDSTICK-1164 Signed-off-by: Abhijit Sinha <abhijit.sinha@intel.com>
2018-03-21Offline support for bottlenecks projectliyin1-0/+123
JIRA: YARDSTICK-1053 Those three yaml files are for bottlenecks support offiline flavor The ssh time out problem will fix in changing the duration time Change-Id: Ifd317404a820d0446ffab5070211e48def1a0d2f Signed-off-by: liyin <liyin11@huawei.com>
2018-03-16Merge "NSB PROX L3FWD Dropping packets"Abhijit Sinha10-97/+207