aboutsummaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2019-04-25Add a document describing vIMS testcasetreyad2-0/+97
Create a test case description file for NSB vIMS JIRA: YARDSTICK-1441 Change-Id: Ib51839093dd90e0b70eac4030948985c2145f35e Signed-off-by: treyad <treyad@viosoft.com> (cherry picked from commit 41aaaad757eb399fac5c3c5c30cc41f5f4b5b405)
2019-04-25Add a document describing vIPSEC testcasetreyad3-4/+152
Create a test case description file for NSB vIPSEC JIRA: YARDSTICK-1450 Change-Id: Iebaca9535e0ebc9f597d8e3c82c4339637eb3180 Signed-off-by: treyad <treyad@viosoft.com> (cherry picked from commit ebd3b805b14a3f85c8db8b8ca9cd619abf0cde25)
2019-04-25[docs][nsb][install] Update source for sample pod filesEmma Foley1-15/+15
The command for copying the sample pod files was incorrect in one instance (baremetal config) and inconsistent in other instances (using ./etc vs <yardstick>/etc vs <repo>/etc) This updates 13-nsb-installation.rst for consistency. Paths within the yardstick repo are preface with ``./``, as initially, the user was instructed to ``cd yardstick``. JIRA: YARDSTICK-1335 Change-Id: Ia5d5fae29373a177f775ea433c56f38bdeca536e Signed-off-by: Emma Foley <emma.l.foley@intel.com> (cherry picked from commit 93d78694924c6fe51cc6b4e05bab97af05fc002d)
2019-04-18[bugfix] docker build failed in hunter due to storperf versionrexlee87762-2/+2
storperf do not have hunter branch, so it need to be set as stable/gambia JIRA: YARDSTICK-1610 Change-Id: I818396c46ce165019159b9852abb02f176507ac0 Signed-off-by: rexlee8776 <limingjiang@huawei.com> (cherry picked from commit e6d688c6585e976010dc9c5b3a051613171a8ddc)
2019-02-12Yardstick verify job could base on the filetype to run the testrexlee87761-8/+13
run the unit test, coverage test, functional test when the change includes postfix py change. could add yaml/yml to run yamlint JIRA: YARDSTICK-1598 Change-Id: I7d9199ec20575fc91cf0f38d84a05b02d63e316c Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2019-02-08Merge "Fix QnQ issue"Volodymyr Mytnyk4-15/+135
2019-02-08Migrate Trex TG to use new NSPerf-RFC2544 scenarioMytnyk, Volodymyr10-51/+278
JIRA: YARDSTICK-1592 Change-Id: Ic51a52385ac53df9b5f56387af4f1b661bb0d86f Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-02-07Update Intel Copyright for files edited in 2019John O Loughlin59-59/+59
JIRA: YARDSTICK-1591 Change-Id: I3ea9039d25bfce578681adb9e27e1598e84a1f56 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-07Merge "Add Warning for key issue ixload"Volodymyr Mytnyk1-1/+6
2019-02-07Add Warning for key issue ixloadJohn O Loughlin1-1/+6
Currently there is a section of code that assigns a gateway links[name]["ip"]["gateway"] = gateway If the ip field has not already been defined a key error is thrown and not handled. This error is then suppressed so the program fails silently and thus causes the test case to hang. JIRA: YARDSTICK-1586 Change-Id: I94a1081a2038fb58989b3033444ea5f3a6e178f0 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-02-07Merge "Extend IXIA RFC2544 test case collected stats"Volodymyr Mytnyk4-3/+79
2019-02-07Merge "Add CPU isolation support for Yardstick NSB setup"Volodymyr Mytnyk5-1/+88
2019-02-07Merge "Add NSB test descriptors for vIPSEC testcase"Volodymyr Mytnyk5-0/+361
2019-02-06Add CPU isolation support for Yardstick NSB setupStepan Andrushko5-1/+88
Add support to define CPU isolation in grub by using NSB setup script. List of CPU's to be isolated is not used by default and is defined in install-inventory.ini. Warning: reboot is required to apply CPU isolation to grub. JIRA: YARDSTICK-1467 Change-Id: I54ffa925a8f3059180d17ff4f1c41ff6e0f12066 Signed-off-by: Stepan Andrushko <stepanx.andrushko@intel.com>
2019-02-06Merge "Mock time.sleep in slow tests"Volodymyr Mytnyk4-4/+14
2019-02-06Merge "Unify different VNF testcases TG and VNF names"Volodymyr Mytnyk25-90/+89
2019-02-06Merge "Unify ACL testcases TG and VNF names"Volodymyr Mytnyk27-78/+75
2019-02-06Merge "Unify CGNAPT testcases TG and VNF names"Volodymyr Mytnyk22-62/+62
2019-02-06Merge "Unify Firewall testcases TG and VNF names"Volodymyr Mytnyk28-82/+82
2019-02-06Merge "Unify Router testcases TG and VNF names"Volodymyr Mytnyk17-53/+53
2019-02-06Merge "Unify PROX testcases TG and VNF names"Volodymyr Mytnyk75-210/+191
2019-02-06Merge "Unify vFW testcases TG and VNF names"Volodymyr Mytnyk48-141/+139
2019-02-06Extend IXIA RFC2544 test case collected statsOleksandr Naumets4-3/+79
Added new fields into Yardstick NSB IXIA RFC2544 test case results: - Iteration (only for NSPerf-RFC2544 scenario) - Rate (for NSPerf and NSPerf-RFC2544 scenarios) - PktSize (for NSPerf and NSPerf-RFC2544 scenarios) JIRA: YARDSTICK-1596 Change-Id: I3bbf4aabf8b57580ebe644e967a5dab69e3a7c8d Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-06Merge "Improve SSH to Open/Close interactive terminal"Volodymyr Mytnyk2-0/+122
2019-02-06Merge "Update Sequence runner to use ScenarioOutput class"Volodymyr Mytnyk2-19/+61
2019-02-06Unify different VNF testcases TG and VNF namesOrest Voznyy25-90/+89
Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: I233b1ba24c85c2e93b831eefbcfe6757f5edf5ca Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-06Unify ACL testcases TG and VNF namesOrest Voznyy27-78/+75
Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: Ic5c8121828505dabdedf0b1cf559a5aebff7124c Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-06Unify CGNAPT testcases TG and VNF namesOrest Voznyy22-62/+62
Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: Iab61828f6e80c65330ee133b7f674457c091de94 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-06Unify Firewall testcases TG and VNF namesOrest Voznyy28-82/+82
Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: I70ebfb3598febd02b089b4fb653ee81d1147edd7 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-06Unify Router testcases TG and VNF namesOrest Voznyy17-53/+53
Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: Ifd876811683675c38ee71187213fe6377cbb4eda Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-06Unify PROX testcases TG and VNF namesOrest Voznyy75-210/+191
Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: Ic36a1f379422e5823db604ade84ea1d58b6df5a5 Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-06Unify vFW testcases TG and VNF namesOrest Voznyy48-141/+139
Rename TGs and VNFs to follow a single naming convention, for all VNFs: name: trafficgen_0 role: tg__0 name: vnf_0 role: vnf__0 JIRA: YARDSTICK-1578 Change-Id: I03438d1b9484df759fe0129bdb050ff88f02563f Signed-off-by: Orest Voznyy <orestx.voznyy@intel.com>
2019-02-05Fix QnQ issueJohn O Loughlin4-15/+135
Currently if multiple tests are run with a QnQ section defined the QnQ segment gets appended to the frame. This leads to invalid frames when the test is run for more than 1 iteration. With this patch the QnQ is updated if the QnQ segment has already been created. JIRA: YARDSTICK-1513 Change-Id: I4ba6ef89380ccf1cb8a132ff5bf048935a87f0c9 Signed-off-by: John O Loughlin <john.oloughlin@intel.com> Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-05Merge "Add vBNG test cases stats processing functionality"Volodymyr Mytnyk12-251/+1116
2019-02-05Update Sequence runner to use ScenarioOutput classSerhiy Pshyk2-19/+61
List of changes: - update Sequence runner to use new mechanism for reporting data (kpi) - add new rfc2544 example test case that executes the same test with different framesizes sequentially JIRA: YARDSTICK-1592 Change-Id: I731cf1ca40f7232b26ea68f81d22248ebc53eb62 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-02-04Trex client not starting in 4 port baremetalDanielMartinBuckley1-3/+19
JIRA: YARDSTICK-1589 After calling STLclient.connect() there is no check if connection was sucessfull or not. Added a check for success on connect, retry if failure and disconnect and connect on timeout. If still connect failed then do not resume .. end with LOG.critial and exit. Change-Id: Ifd306b7920d9acbc16681cf79bf952d5af31eb64 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-04Support NSB NFVi buffering and Load Balance on 2 and 4 portsDanielMartinBuckley22-35/+1505
JIRA: YARDSTICK-1582 Most use cases support 4 ports. Buffering support only 1 core. Request is about supporting buffering & Load balance for 2 and 4 ports Change-Id: I734f9d6702825b31253a21092c86fc72e367586b Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2019-02-04Merge "Replace script to install.yaml in nsb_setup.sh"Volodymyr Mytnyk4-20/+48
2019-02-01Add vBNG test cases stats processing functionalityOleksandr Naumets12-251/+1116
JIRA: YARDSTICK-1546 Change-Id: I3575223ef8231fb4d574e961360b0f2d90a71749 Signed-off-by: Oleksandr Naumets <oleksandrx.naumets@intel.com>
2019-02-01Refactor SampleVNF wait methodMytnyk, Volodymyr5-1/+94
JIRA: YARDSTICK-1439 Change-Id: I26441fe1f6e34a867c1f19d60d2247e888af6c54 Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2019-01-31Add rate 'resolution' option for IXIA rfc2544 testSerhiy Pshyk4-20/+83
Rate resolution value is compared with the difference between the rates in two consecutive iterations. If the difference is smaller than the resolution, the test stops. JIRA: YYARDSTICK-1592 Change-Id: I3f203d33d1688734a59a8f62f31e3ad238bc63b0 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-31Merge "Fix exception handling ixload"Volodymyr Mytnyk3-28/+27
2019-01-31Merge "Refactor: add _get_timestamps()"Volodymyr Mytnyk2-11/+30
2019-01-31Merge "Add new scenario NSPerf-RFC2544"Volodymyr Mytnyk8-52/+473
2019-01-31Mock time.sleep in slow testsEmma Foley4-4/+14
time.sleep was called in a number of classes which wasn't mocked in the tests. This accounted for 2.5 minutes of UT execution time. The calls to time.sleep() have been mocked, and the test execution time has been reduced. JIRA: YARDSTICK-1595 Change-Id: I0a4f4962513cf8845471b074347601e33b35ef25 Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2019-01-31Fix exception handling ixloadJohn O Loughlin3-28/+27
Ixload uses its own version of python By default it will fail to import yardstick.common exceptions. For this reason for this reason ixload exceptions should be kept in http_ixload.py JIRA: YARDSTICK-1587 Change-Id: I5673fb5b89bbcdf4d3c60c283231d44d770999ec Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-31Add new scenario NSPerf-RFC2544Serhiy Pshyk8-52/+473
List of changes: - Added new scenario NSPerf-RFC2544 that runs complete test per runner's iteration - NSPerf is still present for backward compatibility - Added ScenarioOutput class which allows scenario to report data (kpi,...) at any moment of time (not only once per run) - New output mechanism is used only by new NSPerf-RFC2544 scenario JIRA: YARDSTICK-1592 Change-Id: Ica8078f61d895f74df90e8eaad7a675b28bd19c6 Signed-off-by: Serhiy Pshyk <serhiyx.pshyk@intel.com>
2019-01-30Add cli option framesize for routerJohn O Loughlin58-5583/+40
Remove any duplicated testcases Default framesize to 64B: 100 JIRA: YARDSTICK-1554 Change-Id: I793cead17bc98c2487ca010a6639850bea5d7991 Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-30Add cli option framesize for cgnaptJohn O Loughlin18-72/+72
Remove any duplicated testcases Default framesize to 64B: 100 JIRA: YARDSTICK-1554 Change-Id: I2fd7caba9565ba16b2d6494f71ad9b9d476e398b Signed-off-by: John O Loughlin <john.oloughlin@intel.com>
2019-01-30Add cli option framesize for acl vnfJohn O Loughlin20-80/+80
Remove any duplicated testcases Default framesize to 64B: 100 JIRA: YARDSTICK-1554 Change-Id: I61bbf2e7f0c4bd8c1b8e55769cae092e50140f6a Signed-off-by: John O Loughlin <john.oloughlin@intel.com>