Age | Commit message (Collapse) | Author | Files | Lines |
|
* changes:
Rework TestScenarioHelper
Rework TestSampleVNFDeployHelper
Rework TestResourceHelper
Rework TestDpdkVnfSetupEnvHelper
|
|
|
|
|
|
Add IXIA "Bytes Rx" and "Bytes Tx" ports stats into collected
results. This stats allows to calculate the throughput when
running IMIX traffic.
JIRA: YARDSTICK-1592
Change-Id: I1db678d410b37e7a0f64dc743e6e620e495115ed
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
|
|
Update network_services/vnf_generic/vnf/test_sample_vnf.py
JIRA: YARDSTICK-1434
Change-Id: I1bbf2bc139f3302d9882b28f9883e64fa595eb46
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
|
|
Update network_services/vnf_generic/vnf/test_sample_vnf.py
JIRA: YARDSTICK-1434
Change-Id: Ib15e37987ec336f611b27ea71cbc3005311e5d27
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
|
|
Update network_services/vnf_generic/vnf/test_sample_vnf.py
JIRA: YARDSTICK-1434
Change-Id: I56e14a2557554e1c461447f0567b5e028198b553
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
|
|
Update network_services/vnf_generic/vnf/test_sample_vnf.py
JIRA: YARDSTICK-1434
Change-Id: I5b3ef90909949882cec1c32b1f86c3aedbc950d8
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
|
|
JIRA: YARDSTICK-1591
Change-Id: I3ea9039d25bfce578681adb9e27e1598e84a1f56
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
|
|
|
|
|
|
Added new fields into Yardstick NSB IXIA RFC2544 test case results:
- Iteration (only for NSPerf-RFC2544 scenario)
- Rate (for NSPerf and NSPerf-RFC2544 scenarios)
- PktSize (for NSPerf and NSPerf-RFC2544 scenarios)
JIRA: YARDSTICK-1596
Change-Id: I3bbf4aabf8b57580ebe644e967a5dab69e3a7c8d
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
|
|
Currently if multiple tests are run with a QnQ section defined the QnQ
segment gets appended to the frame. This leads to invalid frames when
the test is run for more than 1 iteration. With this patch the QnQ is
updated if the QnQ segment has already been created.
JIRA: YARDSTICK-1513
Change-Id: I4ba6ef89380ccf1cb8a132ff5bf048935a87f0c9
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
|
|
JIRA: YARDSTICK-1546
Change-Id: I3575223ef8231fb4d574e961360b0f2d90a71749
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
|
|
JIRA: YARDSTICK-1439
Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
|
|
time.sleep was called in a number of classes which wasn't
mocked in the tests.
This accounted for 2.5 minutes of UT execution time.
The calls to time.sleep() have been mocked, and the test
execution time has been reduced.
JIRA: YARDSTICK-1595
Change-Id: I0a4f4962513cf8845471b074347601e33b35ef25
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
|
|
List of changes:
- Added new scenario NSPerf-RFC2544 that runs complete test per
runner's iteration
- NSPerf is still present for backward compatibility
- Added ScenarioOutput class which allows scenario to report
data (kpi,...) at any moment of time (not only once per run)
- New output mechanism is used only by new NSPerf-RFC2544 scenario
JIRA: YARDSTICK-1592
Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
|
|
|
|
JIRA: YARDSTICK-1591
Change-Id: I5130602e767009d83f7b39801006d68bcc126ba6
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
|
|
The existing implementation of IPC is not finished and isn't used
by any of the VNFs/TG implementation. It is used in the code but does
nothing from functionality perspective.
New syncronization mechanism is going to be implemented by using
different approach than it was designed before. Thus, the current
IPC mechanism is not going to be re-used. So, removing it.
The IPC consumer/producer implementation is left as it may be
required for other purposes.
- Remove SampleVNF MQ consumer class
- Remove IterationIPC MQ producer for VNF control messages
- Remove MQ producer from SampleVNFTrafficGen class
- Remove TrafficGeneratorProducer class
- Remove IterationIPC runner
- Remove unused task_id form VNF Generic initialization as it is not
required for synchronization of VNFs/TGs anymore.
- Fix UT
JIRA: YARDSTICK-1592
Change-Id: I65fe51bcbd1bfeea0c43eb79ca6fb2aab5b65ae7
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
|
|
Changed default rate from 100pps to 100%.
Set Ip mask to 32
JIRA: YARDSTICK-1566
Change-Id: I4c0245297b2d6b254c06155047c3499f6572e9c5
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
|
|
network_services/vnf_generic/vnf/test_sample_vnf.py:TestVnfSshHelper"
|
|
|
|
Protocol interfaces are creating with config from pod file
Static IP configuration are creating from testcase flow options
JIRA: YARDSTICK-1570
Change-Id: I74cde67b5084d5b65d09934fe8fce7760b5ea461
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
|
|
JIRA: YARDSTICK-1571
Cores in PROX support multiple configurations
NSB supports today the more basic one, i.e. [core x]
When one wants to use multiple cores sharing the same
configuration, instead of copying the whole [core]
section, PROX support the following syntax
[core x-y]
where x is the 1st core and y the last one
or (for instance) [core x,y,z]
NSB Now supports
[core a,b,c,d]
[core a-d]
[core a,c-d]
Change-Id: I34cd107143c89e16d58e7a99e1887ffbf720a5d1
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
|
|
|
|
JIRA: YARDSTICK-1434
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Change-Id: Ieabcdf401d608a3a5f0a0bd9fbbe754591878bd5
|
|
Extended Ixia traffic generator with functionality to
create traffic flows between device groups.
JIRA: YARDSTICK-1521
Change-Id: Iaaa822f2f3da876629576d4101be29c9a65296d0
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
|
|
Added vBNG PPPoE test cases functionality which allows to:
- create and configure access network connections (PPPoE subscribers);
- create and configure core network connections;
- configure and run traffic between access and core network
topologies.
JIRA: YARDSTICK-1508
Change-Id: I90975505fe7318227a837d97e8db4a06712de7eb
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
|
|
JIRA: YARDSTICK-1524
Add dashboard, Traffic Profile support, PROX IRQ support, topology
Change-Id: I0c0cde66f4f4d3d25aa77c502bd4349cc1b3eca2
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
|
|
historical data
JIRA: YARDSTICK-1458
The TG is only sampled at the end of every test interval.
This is incorrect. It should be sampled every interval.
Change-Id: I612ead8a243a7d9930874d02adc9b959b843b99b
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
|
|
JIRA: YARDSTICK-1473
Change-Id: Ib9d3eb01f3fd900cbb08d55fc21fb95beceec941
Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
|
|
Remove obsolete attribute "ixia_profile" from
- test cases using IxNetwork as a TG
- from unit tests related to IxNetwork
Remove ixncfg files from repo.
Remove mention of ixncfg files from test case files
JIRA: YARDSTICK-1506
Change-Id: I5f8087cef74ac80ced0cfa310fdb5f91550d08f5
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
|
|
|
|
JIRA: YARDSTICK-1458
Removed excessive jitter by removing extra sleeps in start/stop/reset
ssh
Removed extra retries when bad data returned
Added a slep at end of test to give runner a chance to empty the queue
on shutdown
Added a timeout on port retry attempts
Change-Id: Ica60b11c7af242817a83c154157827581f60d16a
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
|
|
Added new RFC2544 iteration status field into the
testcase result to be able to exctract the best
RX/TX throughput value from each iteration.
The field equal "Success" if the trhoughput value is in the
given drop percentage range and "Failure" otherwise.
JIRA: YARDSTICK-1389
Change-Id: I2fb2ef036b63a0e7bbf3d6c6568d3bdffa488e1f
Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
|
|
|
|
JIRA: YARDSTICK-1461
Change-Id: Ia1f5026eee989672aac57775ec9dd182df658fa4
Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
|
|
Implement code to support traffic_duration field in test case options.
This updates the 'duration' in Landslide session profile.
traffic_duration should always be much less than runner duration/timeout.
JIRA: YARDSTICK-1427
Change-Id: I51094bade683ca8758136ccb619e8894a2ecef72
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
|
|
Add automatic update of traffic profile items library name update, as well
as update of session profile Dmf library name, to avoid the need of user
changing it in template files.
Update affected unit tests.
JIRA: YARDSTICK-1474
Change-Id: I18cc8ca99a47da862753329c87d1a560a97f76fa
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
|
|
|
|
Allow yardstick to update IP/MAX of Net traffic
- Implemented functionality for updating traffics IP/MAC address
in ixloadconfiguration.
- Extended http_ixload.py with functions for update IP/MAC
address of netTraffic.
- In HTTP-vFW_IPv4_2Ports_Concurrency.rxf changed name's of
networks from "client network" to "uplink_0 and the same for
server
JIRA: YARDSTICK-1418
Change-Id: I28ef68b77466fff15af589954e3ef63e8099428f
Signed-off-by: Myron Sosyak <myronx.sosyak@intel.com>
Signed-off-by: Taras Chornyi <tarasx.chornyi@intel.com>
|
|
JIRA: YARDSTICK-1419
When using prox_binsearch algorithm, a binary search is
performed, increasing lower bound when step was successful
and decreasing upper bound when the step was a failure.
This runs until the test_precision (as specified in the
traffic profile) is reached. When the test precision
is reached, the test is not completed until the
runner duration is reached.
As runner duration is usually high (e.g. 1800sec), the
tests take much too long to execute.
This makes it difficult to create test suites.
Change-Id: I6cc503a09fb534a556c61c805e6df4786bb8cc4b
Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
|
|
|
|
Using AgnosticVNF is now possible to create a "black box"
testcase for any VNF.
Example rfc2544 test with TRex as trafficgen
samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_ipv4_64B_trex.yaml
and Ixia
samples/vnf_samples/nsut/agnostic/tc_baremetal_rfc2544_latency_ipv4_64B_ixia.yaml
NOTE:
Yardstick will not interact with VNF.
No KPIs from VNF will be collected
JIRA: YARDSTICK-1438
Change-Id: I408b3dcb90f29c7b41fcf8f883b5abfc4e9c3dbc
Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
|
|
1. Add yardstick topology and model for fully emulated environment.
2. Add support for black-box testing of real vEPC VNF vs Spirent Landslide
traffic generator:
- vEPC VNF pod file
- topology and model files aware of vEPC VNF connection to Spirent
Landslide TG
- stub class for vEPC VNF, and related unit tests
JIRA: YARDSTICK-1424
Change-Id: If7b6d19919679347c4360f4a0f2e420716e7fd2d
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
|
|
New unit tests have been added to make sure the right
commands are sent to Spirent LS.
This helps to ensure that the correct commands are sent
to Spirent, so that potentially breaking changes can be
flagged.
JIRA: YARDSTICK-1356
Change-Id: I23f452355afcec2705da7d4665a34b178e2ba729
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
|
|
New TG class "LandslideTrafficGen" represents an interface to use Spirent
Landslide API to configure and execute vEPC test cases on
hardware/software Spirent environment. For that purpose this class and its
helper classes use Spirent Landslide REST API calls and Landslide TCL API
calls via library module lsapi.py.
Change-Id: Ib6560d5cd2483c6c9f5c95568345ac39bfebbd4d
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
|
|
Class "LandslideResourceHelper" provides API for operations needed
- to configure Landslide test session
- manage test session execution (start/stop/abort)
- collect measurements during test run
This helper class API is responsible to for configure Landslide test runs:
- create test user
- create test servers (for emulation of specific vEPC blocks)
- create SUTs (actual tested VNFs performing specific vEPC roles)
- create test session (contains actual test cases)
- create DMFs (pre-defined traffic flows in traffic profile)
- operate traffic run execution (start, stop, abort)
- monitor test run status
- collect KPIs on TG side
Some of these features use Landslide REST API.
Other ones use Landslide TCL API.
JIRA: YARDSTICK-1356
Change-Id: I8fc8a7d85301121da465d054b8d38ae09a541c36
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
|
|
Add class "LandslideTclClient" which holds TCL calls wrappers for
operations on the LandSlide TG.
It also introduces several new parameters in
- test case YAML file structure:
* session_profile: YAML file holding a template of Landslide test
session for specific vEPC test scenario
* dmf: test case options member holding traffic flow specific parameters
for designated test scenario, that override ones in traffic_profile
YAML file
* test_cases: test case options member holding parameters specific to
designated vEPC test case, overriding those in session_profile
template file
- pod YAML file structure:
* tas_manager: holds parameters used to connect to Spirent Landslide TAS
* config: list of entries describing Landslide test servers access,
their network interfaces configuration, information of vEPC elements
emulated by specific test server
Class "LandslideProfile" implements access to traffic profile template
from "LandslideResourceHelper" class.
JIRA: YARDSTICK-1356
Change-Id: Ia6428072b1e72025be17c94e5141bd23f7993247
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
Signed-off-by: Emma Foley <emma.l.foley@intel.com>
Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
|