summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-09-15Add vEPC default bearers create/delete test caseOrest Voznyy5-0/+541
This test case runs on Spirent Landslide TG. All vEPC entities are emulated on Landslide test server. Test run configuration is performed in following files: 1. test case file 2. pod file 3. session profile file (landslide_session_default_bearer*.yaml) The structure of these files represents configuration of different parts of test cases in this test session. The order of test cases should always match. Spirent Landslide test types involved: "SGW_Node", "SGW_Nodal". Test case actions sequence: - create default bearers (as per value of "Sessions" key) with specified rate (session profile key "StartRate") - send traffic flow(s) (pre-configured in traffic profile) for a number of seconds (specified in session profile key "duration") - remove N default bearers with specified rate (session profile key "DisconnectRate") Parameters with ALL_CAPS values are placeholders. User should replace them with their own condifuration. Session profile file placeholders do not need to be replaced as long as these parameters are overriden in other files (e.g. pod, test case). Test results are dispatched according to runner configuration options. For fully emulated test runs like this one, best suited runner is "Search" type. In case of testing against real EPC VNFs, user could prefer different runner type. JIRA: YARDSTICK-1348 Change-Id: I5caf4878fb212b38d4148a297c5dba03b8ab98a8 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-15Add Spirent Landslide traffic profile templatesOrest Voznyy4-0/+430
These files are templates of Spirent Landslide data message flow (DMF) representing traffic profile of one or multiple traffic flows. Template files should not be edited directly. Instead, their parameters could be overriden in test case YAML file, in section "dmf". JIRA: YARDSTICK-1359 Change-Id: I4980a784a78ca870c18457227248e6e2ac0b8eda Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-13Update LSResourceHelper unittestsEmma Foley2-11/+201
New unit tests have been added to make sure the right commands are sent to Spirent LS. This helps to ensure that the correct commands are sent to Spirent, so that potentially breaking changes can be flagged. JIRA: YARDSTICK-1356 Change-Id: I23f452355afcec2705da7d4665a34b178e2ba729 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-09-12Add Spirent Landslide TG APIEmma Foley2-40/+547
New TG class "LandslideTrafficGen" represents an interface to use Spirent Landslide API to configure and execute vEPC test cases on hardware/software Spirent environment. For that purpose this class and its helper classes use Spirent Landslide REST API calls and Landslide TCL API calls via library module lsapi.py. Change-Id: Ib6560d5cd2483c6c9f5c95568345ac39bfebbd4d Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-08Added Landslide Resource Helper implementationEmma Foley3-38/+1218
Class "LandslideResourceHelper" provides API for operations needed - to configure Landslide test session - manage test session execution (start/stop/abort) - collect measurements during test run This helper class API is responsible to for configure Landslide test runs: - create test user - create test servers (for emulation of specific vEPC blocks) - create SUTs (actual tested VNFs performing specific vEPC roles) - create test session (contains actual test cases) - create DMFs (pre-defined traffic flows in traffic profile) - operate traffic run execution (start, stop, abort) - monitor test run status - collect KPIs on TG side Some of these features use Landslide REST API. Other ones use Landslide TCL API. JIRA: YARDSTICK-1356 Change-Id: I8fc8a7d85301121da465d054b8d38ae09a541c36 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-09-05Add TclClients for Spirent Landslide TGOrest Voznyy8-0/+1438
Add class "LandslideTclClient" which holds TCL calls wrappers for operations on the LandSlide TG. It also introduces several new parameters in - test case YAML file structure: * session_profile: YAML file holding a template of Landslide test session for specific vEPC test scenario * dmf: test case options member holding traffic flow specific parameters for designated test scenario, that override ones in traffic_profile YAML file * test_cases: test case options member holding parameters specific to designated vEPC test case, overriding those in session_profile template file - pod YAML file structure: * tas_manager: holds parameters used to connect to Spirent Landslide TAS * config: list of entries describing Landslide test servers access, their network interfaces configuration, information of vEPC elements emulated by specific test server Class "LandslideProfile" implements access to traffic profile template from "LandslideResourceHelper" class. JIRA: YARDSTICK-1356 Change-Id: Ia6428072b1e72025be17c94e5141bd23f7993247 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com> Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2018-08-30Merge "Adopt infra_deploy to spawn VM on LTS Ubuntu 18"Rodolfo Alonso Hernandez4-2/+61
2018-08-30Merge "Add source and destination seed value in IXIA RFC2544"Rodolfo Alonso Hernandez7-20/+39
2018-08-30Adopt infra_deploy to spawn VM on LTS Ubuntu 18Stepan Andrushko4-2/+61
Add possibility ro reuse infra_deploy.yaml to spawn VMs on jump host, depending on jump host Ubuntu version: either 16 or 18. JIRA: YARDSTICK-1396 Change-Id: Id0682c03098e611fe3a51cbd24d8ff2dda7c552a Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-30Merge "Assign static IP to VM for standalone context"Rodolfo Alonso Hernandez6-23/+62
2018-08-29Updated documentation for stanalone contextStepan Andrushko1-15/+85
Added details about hosts configurations in order to run tests for standalone context. Changes made to '13-nsb-installation.rst'. JIRA: YARDSTICK-1402 Change-Id: I4e3304065343014a80b85fc712cdde3ca62d8b2e Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-29Assign static IP to VM for standalone contextStepan Andrushko6-23/+62
During VM spawning IP address should be assigned by DHCP server in the local network. Sometimes DHCP server is not capable to assign IP address. So, need to add static IP address. JIRA: YARDSTICK-1402 Change-Id: Ie59c340eb88eddcaff043496fc20aa48b49205ec Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-29Bugfix: ansible version should be the same both in Dockerfile and ↵rexlee87762-2/+2
requirements.txt Because Dockerfile is using ansible script to install yardstick requirements. Or it may lead to exception when installing Yardstick. Change-Id: Ia83cf76675a7f3f1d0aa5c311e7b72be5c7ca5c3 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-28Merge "Bugfix: openstack router list broken in Yardstick container - dovetail"Rex Lee2-2/+2
2018-08-27Merge "Change tc_trex files to execute standalone tests"Rodolfo Alonso Hernandez9-53/+53
2018-08-27Add source and destination seed value in IXIA RFC2544Rodolfo Alonso Hernandez7-20/+39
Add source and destination seed value in IXIA RFC2544 traffic profile. The default value for both parameters is 1. JIRA: YARDSTICK-1401 Change-Id: I3351194c8be9ac42cbf5655996d50b9b69884c72 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-27Merge "Make TRex IMIX traffic mode configurable"Rodolfo Alonso Hernandez3-9/+60
2018-08-27ping bottlenecks failed when security group rule do not support ipv6 - dovetailrexlee87761-0/+12
JIRA: YARDSTICK-1380 Change-Id: I2163eeb9ab17e4f0216ddaed688e78acdf51a1ff Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-27Merge "Make security group configurable - dovetail"Jing Lu5-58/+165
2018-08-24Bugfix: openstack router list broken in Yardstick container - dovetailrexlee87762-2/+2
Dependancy of python-openstackclient is not constrained. This patch specify openstacksdk and openstackclient's version according to [1]. This patch apply for bugfix and need to backported to fraser stable branch. Continual work need to be done in Gambia according to YARDSTICK-1398. [1] https://github.com/openstack/requirements/blob/stable/pike/upper-constraints.txt JIRA: DOVETAIL-728 Change-Id: I57c718e192699ac322150458d18508b06c93d22b Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-23Make TRex IMIX traffic mode configurableRodolfo Alonso Hernandez3-9/+60
Enable TRex IMIX generation using two modes: - Distribution in packages. - Distribution in byes. The default one will be distribution in packages, like the default one in IxNetwork. JIRA: YARDSTICK-1397 Change-Id: I86b2527968496218b0515349fc0a2680a84261e5 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-23Merge "Fix setting `flow` configuration in TC yaml"Rodolfo Alonso Hernandez3-10/+12
2018-08-23Merge "Fix issues with 'Success_' stats reported by ProxBinSearchProfile"Abhijit Sinha3-200/+243
2018-08-23Merge "Runners crash on test startup."Abhijit Sinha2-3/+5
2018-08-23Merge "Provide access to VM in Standalone context"Rodolfo Alonso Hernandez6-52/+261
2018-08-23Merge "Provide average latency results in IXIA KPIs"Rodolfo Alonso Hernandez2-14/+60
2018-08-23Runners crash on test startup.DanielMartinBuckley2-3/+5
JIRA: YARDSTICK-1393 The problem resides in this traffic generator class: this class is inheriting from SampleVNFTrafficGen and overriding the __init__ method but is NOT calling the parent class __init__ one. Change-Id: I206a66e361a3e2eb50bb5fa01ddadae25b4a9f54 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-08-23Provide access to VM in Standalone contextStepan Andrushko6-52/+261
Add possibility to access VM with SampleVNF image, which is spawned on baremetal server using password or key pairs (provided or generated). Changes provided for OVS-DPDK and SRIOV cases. JIRA: YARDSTICK-1260 Change-Id: I89cf17dc83f02abe23d206b24b9d0ec1298d3231 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-23Fix issues with 'Success_' stats reported by ProxBinSearchProfileSerhiy Pshyk3-200/+243
List of changes: - Added 'Status' field to indicate status of each search iteration. Possible values are 'Success', 'Failure', 'Result'. - Removed reporting of duplicated stats with 'Success_' prefix. Instead 'Status' field is set to 'Success' - Removed reporting of duplicated stats with 'Result_' prefix. Instead 'Status' field is set to 'Result' - Updated Prox_BM_L2FWD-4Port_MultiSize-1518452496550.json dashboard to query success and result status by 'Status' field value. JIRA: YARDSTICK-1386 Change-Id: I9a21a102af6cb4db137e805011b5d81c4943d77b Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2018-08-22Provide average latency results in IXIA KPIsRodolfo Alonso Hernandez2-14/+60
IXIA KPIs will provide an average value of all port latency values: max, min and avg. JIRA: YARDSTICK-1394 Change-Id: Ib7c7b5300e8343a1af0a20cb4e49c0bd669c1143 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-21Merge "Add virtual image generation to install script"Rodolfo Alonso Hernandez13-26/+513
2018-08-21Merge "Improvie TRex RFC2544 throughput calculation"Rodolfo Alonso Hernandez3-33/+37
2018-08-21Merge "Convert IXIA latency statistics to integer"Rodolfo Alonso Hernandez4-3/+45
2018-08-21Convert IXIA latency statistics to integerRodolfo Alonso Hernandez4-3/+45
JIRA: YARDSTICK-1385 Change-Id: Id50c393da7ded4b3c8e127f7d7a6501832a68446 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-21Merge "Make TRex latency statistics optional"Rodolfo Alonso Hernandez11-12/+25
2018-08-21Merge "NSB NFVi PROX BNG and vPE losing many packets"Abhijit Sinha9-10/+109
2018-08-21Merge "the recovery action of "baremetal down" should be triggered mandatory"Rex Lee5-3/+59
2018-08-20Make TRex latency statistics optionalRodolfo Alonso Hernandez11-12/+25
Because of performance issues in TRex due to the extra power needed to retrieve the latency statistics, this parameter will be optional and disabled by default. JIRA: YARDSTICK-1388 Change-Id: I07c0ec7bef86fd438d078cbd6748b98bc8cc0b37 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-20Improvie TRex RFC2544 throughput calculationRodolfo Alonso Hernandez3-33/+37
Improve TRex RFC2544 throughput calculation by using the in/out packets instead of using the throughput samples. JIRA: YARDSTICK-1387 Change-Id: I877e901c3226d31c6435a877a2924bb95deb1cf0 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-20Fix RFC2544 IXIA latency informationRodolfo Alonso Hernandez1-16/+15
Do not overwrite the samples information with the latency parameters. JIRA: YARDSTICK-1385 Change-Id: I2f144800ad19d7736eedf5c7b6783731031c4bf4 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-20Make security group configurable - dovetailrexlee87765-58/+165
Make sercurity group can be configured via the context. The format would be: context: name: demo image: yardstick-image flavor: yardstick-flavor user: ubuntu security_group: rules: - remote_ip_prefix: "0.0.0.0/0" protocol: "tcp" port_range_min: 1 port_range_max: 65535 - remote_ip_prefix: "0.0.0.0/0" protocol: "udp" port_range_min: 1 port_range_max: 65535 - remote_ip_prefix: "0.0.0.0/0" protocol: "icmp" JIRA: YARDSTICK-1360 Change-Id: I00c45767ee2d70b790590e824599d5a4c274bced Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-08-17Merge "Improve IXIA TG Rx/TX throughput calculation"Rodolfo Alonso Hernandez3-38/+24
2018-08-17Add RFC2544 IXIA latency informationRodolfo Alonso Hernandez1-9/+8
JIRA: YARDSTICK-1385 Change-Id: Icecceaabc0389279a3a7154884c50259f794eb76 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-08-16Merge "IXIA traffic stops running after first iteration"Emma Foley2-12/+11
2018-08-16Merge "Disk Initialization and Custom Workload"Rex Lee4-81/+441
2018-08-16Improve IXIA TG Rx/TX throughput calculationMytnyk, Volodymyr3-38/+24
Use float instead of integer to convert TG throughtput IXIA statistic. JIRA: YARDSTICK-1378 Change-Id: I39bd143adc4b10035c6f0986a06d407a18aa0887 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-16Fix setting `flow` configuration in TC yamlMytnyk, Volodymyr3-10/+12
The `flow` configuration is not applied to the traffic profile if `seed` or `count` option is missing in the TC definition. - Fix `seed` backward compatibility. JIRA: YARDSTICK-1383 Change-Id: Ic874fb2be1c13009f94eb3a80194bfe81d7a923b Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-08-15Add virtual image generation to install scriptStepan Andrushko13-26/+513
Update install.yaml with image generation: nsb and normal. JIRA: YARDSTICK-1198 Change-Id: I3b8773e9b3b9890ae8623bb6536d05f1151d84a8 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2018-08-15Merge "[docs] Remove the VTC chapter in the userguide"Abhijit Sinha7-139/+1
2018-08-15Merge "Fix KPI data reported by ProxBinSearchProfile"Abhijit Sinha1-10/+6