summaryrefslogtreecommitdiffstats
AgeCommit message (Collapse)AuthorFilesLines
2018-07-11Change "monitor" to "assert" in SLADimitrios Markou3-9/+9
Change "monitor" to "assert" in SLA to make an Overall testcase to fail if a subtest Scenario fails JIRA: YARDSTICK-1305 Change-Id: I90f5c95f0ddace160d751a435d60ae09a42101f2 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-07-05[Bug fix] Execute teardown if SLA is set to "assert"Dimitrios Markou1-0/+1
In Duration runner if SLA is set to "assert" and a SLAValidationError happens then a teardown is needed to avoid garbages in the environment. JIRA: YARDSTICK-1291 Change-Id: I9056b0da3e7e496171ed42430ffc340b5c68f108 Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
2018-07-04Merge "Sample VNF version need to be updated to Fraser"Rodolfo Alonso Hernandez1-1/+1
2018-07-03Merge changes from topics 'YARDSTICK-1250', 'YARDSTICK-1249'Rodolfo Alonso Hernandez7-56/+37
* changes: Fix pip install issues in install.yaml script Bump ansible version to 2.5.5
2018-07-03Merge "Cleanup Iperf3 unit tests"Rodolfo Alonso Hernandez1-13/+9
2018-07-03Merge "Cleanup Plugin unit tests"Rodolfo Alonso Hernandez1-2/+8
2018-07-03Merge "Cleanup NodeContextTestCase unit tests"Rodolfo Alonso Hernandez1-2/+2
2018-07-03Merge "Cleanup vPE VNF unit tests"Rodolfo Alonso Hernandez1-84/+92
2018-07-03Merge "Cleanup TestIxLoadTrafficGen unit tests"Rodolfo Alonso Hernandez2-143/+93
2018-07-03Merge "Cleanup GetDataDbClientTestCase unit tests"Rodolfo Alonso Hernandez1-3/+5
2018-07-03Merge "Cleanup VsperfDPDKTestCase unit tests"Rodolfo Alonso Hernandez1-4/+5
2018-07-03Sample VNF version need to be updated to FraserRodolfo Alonso Hernandez1-1/+1
JIRA: YARDSTICK-1289 Change-Id: Ib150fafdfcc7a7aa09e4ed9c683fc3013676dac4 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-07-02Merge "Cleanup TestProxBinSearchProfile unit tests"Rodolfo Alonso Hernandez1-13/+13
2018-07-02Merge "Cleanup ProxDuration unit tests"Rodolfo Alonso Hernandez1-142/+133
2018-07-01Merge "Yardstick Fraser Release notes - 6.2.1"Rex Lee1-0/+17
2018-07-01Yardstick Fraser Release notes - 6.2.1rexlee87761-0/+17
JIRA: YARDSTICK-1278 Change-Id: I96d54b06f0ef794c9c0ec26d78eb54ebcc6462ed Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-07-01Merge "Bugfix: ansible install.yaml missing configure_gui step"Rex Lee1-0/+1
2018-07-01Bugfix: ansible install.yaml missing configure_gui steprexlee87761-0/+1
JIRA: YARDSTICK-1279 Change-Id: I7df97479e2e17495668ef4982de4aec13d04c25c Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-07-01Bugfix: uwsgi config file yardstick.ini output errorrexlee87761-2/+2
JIRA: YARDSTICK-1280 Change-Id: I45b4b781cee21035897ba0c34dc740af6365e918 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-06-30Bugfix: docker build failedrexlee87761-1/+1
Due to no inventory.ini specified in Dockerfile, which resulsts in ansible-playbook run fail JIRA: YARDSTICK-1277 Change-Id: Iaf689b71b8c86b54b2451d8a8c480f7d94d53561 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-06-29Cleanup Iperf3 unit testsRodolfo Alonso Hernandez1-13/+9
Removed unneeded output. JIRA: YARDSTICK-1275 Change-Id: I75fe1f7f048714ba5d2fdfa586ad69ebb7b56c88 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29Cleanup Plugin unit testsRodolfo Alonso Hernandez1-2/+8
Removed unneeded output (LOG.info and print functions). JIRA: YARDSTICK-1274 Change-Id: Ida3b62ce28e27058a8b4a3a9e6fa16f041a1f99c Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29Cleanup NodeContextTestCase unit testsRodolfo Alonso Hernandez1-2/+2
Removed deprecated functions. JIRA: YARDSTICK-1273 Change-Id: I055b8393e6b25eb08f718cd8a915c6ea684786d8 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29Merge "Update PROX_NSB_DEVGUIDE for F Release"Rodolfo Alonso Hernandez10-25/+119
2018-06-29Merge "Yardstick Fraser Release notes - 6.2.0"Rex Lee1-5/+98
2018-06-29Cleanup vPE VNF unit testsRodolfo Alonso Hernandez1-84/+92
Removed unneeded output and stopped access to file system. JIRA: YARDSTICK-1271 Change-Id: I15a58eb7bb81b69fe156433055f59a54372fa0a8 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29Cleanup TestIxLoadTrafficGen unit testsRodolfo Alonso Hernandez2-143/+93
Removed unneeded output and mock system calls. JIRA: YARDSTICK-1270 Change-Id: I0e04a67cab592216280481c7145188c4f9045466 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29Cleanup GetDataDbClientTestCase unit testsRodolfo Alonso Hernandez1-3/+5
Removed unneeded output. JIRA: YARDSTICK-1268 Change-Id: I2e9130e863ba915feeb52f54fc901898b1c8f792 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29Cleanup VsperfDPDKTestCase unit testsRodolfo Alonso Hernandez1-4/+5
Removed unneeded output. JIRA: YARDSTICK-1267 Change-Id: I0a3f25db2c5ef8ed71fd087b6b35641075c121e7 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29Cleanup TestProxBinSearchProfile unit testsRodolfo Alonso Hernandez1-13/+13
Removed unneeded output and mocks. JIRA: YARDSTICK-1266 Change-Id: I04fd1ba32ea46c7896548faebc5af1a43b0f750e Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-29NFVI support for standalone, baremetal and heat contextsChornyi, TarasX26-151/+474
JIRA: YARDSTICK-1257 Change-Id: I6733bd49ac91985e8f3d7722e6990e8733bb430e Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-06-29Update PROX_NSB_DEVGUIDE for F ReleaseDanielMartinBuckley10-25/+119
Contains Updates :- New Description of Grafana output New Description of ProxDuration Runner Update Description of Openstack Network Change-Id: I861bb7eab4aeed207c0151be6766c48c5f10c6ef Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-29Merge "Removed unused ACL config file."Rodolfo Alonso Hernandez1-47/+0
2018-06-29Yardstick Fraser Release notes - 6.2.0rexlee87761-5/+98
JIRA: YARDSTICK-1261 Change-Id: I61adeaea8a727605481ffce9dae9646f160bf401 Signed-off-by: rexlee8776 <limingjiang@huawei.com>
2018-06-29Merge "Add testsuite "os-odl-ovs-noha""Rex Lee1-0/+64
2018-06-28Merge "Cleanup process test cases"Rodolfo Alonso Hernandez1-4/+6
2018-06-28Merge "Cleanup OpenStack utils test cases"Rodolfo Alonso Hernandez1-32/+35
2018-06-28Decrease Sampling interval - Invalid Port resultsDanielMartinBuckley1-4/+6
JIRA: YARDSTICK-1219 The computed in/fwd throughputs displayed on the L2FWD, L3FWD and VPE dashboards. The computed value is likely 4x the expected value. It is required to return sampling information form Generator AND VNF at least every 1 second. Change-Id: I4435fd05ba3116ead836843a4c2fce133b767a28 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-28Cleanup ProxDuration unit testsRodolfo Alonso Hernandez1-142/+133
Removed unneeded output, removed access to files, fixed indentation, bumped deprecated asserts, reduced time execution and fixed file header. JIRA: YARDSTICK-1262 Change-Id: I4803980748d4731cc27608e386707a858e1a8630 Signed-off-by: Rodolfo Alonso Hernandez <rodolfo.alonso.hernandez@intel.com>
2018-06-27Removed unused ACL config file.Mytnyk, Volodymyr1-47/+0
Change-Id: Ibdb1dd12587df0182b5e8d3b7bc6901be0aac3ec Signed-off-by: Mytnyk, Volodymyr <volodymyrx.mytnyk@intel.com>
2018-06-27Merge "Update to Grafana Dashboard for NSB PROX NFVI"Abhijit Sinha3-9973/+12737
2018-06-27Merge "NSB NFVi PROX BNG losing many packets"Abhijit Sinha9-23/+45
2018-06-27NSB NFVi PROX BNG losing many packetsDanielMartinBuckley9-23/+45
JIRA: YARDSTICK-1101 Problem was incorrect generator and changed the traffic profile to allow a tolerated loss of 5%. ARP packets are not managed (just passed thru the system) therefor the tolerated loss must be higehr than normal. Change-Id: I03bd62b397a66b50961e810d033c6894d0b3e9a6 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-27Update to Grafana Dashboard for NSB PROX NFVIDanielMartinBuckley3-9973/+12737
JIRA: YARDSTICK-1252 CPU grouping in grafana for better representation Throughput table is difficult to read as the tests run longer the values can overlap Default time in dashboard should be always last 1hour in dashboard (auto refresh can be also checked) Add one column in table with Gbps throughput (Rx Throughput) plus code change in yardstick Boxes are not aligned and big and small, need to be fixed boxes are now aligned, Added Seperate graphe for LINE Rate Change-Id: Ief31777c2e7a18aab4bf21fb6ccc0e93a3bb9178 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-27Merge "Fix NSB NfVi support for 25 and 40Gbps"Abhijit Sinha1-4/+27
2018-06-27Corrected scale-up command line argumentsChornyi, TarasX1-1/+1
Change-Id: If308fde797dcb01e58f37ad81bb116fde542366a Signed-off-by: Chornyi, TarasX <tarasx.chornyi@intel.com>
2018-06-27Fix NSB NfVi support for 25 and 40GbpsXavier Simonart1-4/+27
When setting interface_speed option in the test case, NSB/PROX was still considering 100% as 10 Gbps. With this fix, when interface_speed is set to for instance 25 Gbps then NSB/PROX will start generate at 25 Gbps. Yardstick logging info printed on the screen will show performance result as percentage of interface_speed (e.g. 100% will be 25 Gbps). This is done by sending the command "speed 250" to PROX (PROX cannot know the underlying interface speed in all cases e.g. in virtio, and hence considers 100% as 10Gbps). JIRA: YARDSTICK-1217 Change-Id: I4989161b04a7afa5e347935ee7ccef7dfe5a504d Signed-off-by: Xavier Simonart <xavier.simonart@intel.com> Signed-off-by: Emma Foley <emma.l.foley@intel.com>
2018-06-27Merge "Resolve NameError in test_utils.py"Rodolfo Alonso Hernandez0-0/+0
2018-06-27NSB NFVi PROX VPE losing many packetsDanielMartinBuckley6-1169/+10165
JIRA: YARDSTICK-1105 Running a vPE test ends up with up to 25% drooped packets. This is due to tolerated loss being incorrectly configured, test duration was too short and test interval was too short. Note This is due to the fact that vPE use case have by default a tolerated loss of 100%, Now changed to 0.001, same as L2FWD Also: Grafan dashboard has been updated to show all SUT CPUS Utilization in 1 panel. And LINE rate MIN, MAX & TEST Rate have been added Change-Id: I7adae2199b3f656fe460705b6aeb3aa69c767d50 Signed-off-by: Daniel Martin Buckley <daniel.m.buckley@intel.com>
2018-06-27Add testsuite "os-odl-ovs-noha"ting wu1-0/+64
Add testsuite yaml file for scenario "os-odl-ovs-noha" JIRA: YARDSTICK-1208 Change-Id: I2671df847332379afed8c6481e54eb25dcba5e48 Signed-off-by: ting wu <ting.wu@enea.com>