.. This work is licensed under a Creative Commons Attribution 4.0 International .. License. .. http://creativecommons.org/licenses/by/4.0 ======================================== Test Results for os-nosdn-nofeature-noha ======================================== .. toctree:: :maxdepth: 2 Joid ===== .. _Grafana: http://testresults.opnfv.org/grafana/dashboard/db/yardstick-main .. _POD5: https://wiki.opnfv.org/pharos?&#community_test_labs Overview of test results ------------------------ See Grafana_ for viewing test result metrics for each respective test case. It is possible to chose which specific scenarios to look at, and then to zoom in on the details of each run test scenario as well. All of the test case results below are based on 4 scenario test runs, each run on the Intel POD5_ between September 12 and 15 in 2016. TC002 ----- The round-trip-time (RTT) between 2 VMs on different blades is measured using ping. Most test run measurements result on average between 1.50 and 1.68 ms. Only one test run has reached greatest RTT spike of 2.92 ms, which has the smallest RTT of 1.06 ms. The other three runs have no similar spike at all, the minimum and average RTTs of which are approx. 1.50 ms and 1.68 ms. SLA set to be 10 ms. The SLA value is used as a reference, it has not been defined by OPNFV. TC005 ----- The IO read bandwidth actually refers to the storage throughput, which is measured by fio and the greatest IO read bandwidth of the four runs is 177.5 MB/s. The IO read bandwidth of the four runs looks similar on different four days, with an average between 46.7 and 62.5 MB/s. One of the runs has a minimum BW of 680 KM/s and other has a maximum BW of 177.5 MB/s. The SLA of read bandwidth sets to be 400 MB/s, which is used as a reference, and it has not been defined by OPNFV. The results of storage IOPS for the four runs look similar with each other. The test runs all have an approx. 1.55 K/s for IO reading with an minimum value of less than 60 times per second. TC010 ----- The tool we use to measure memory read latency is lmbench, which is a series of micro benchmarks intended to measure basic operating system and hardware system metrics. The memory read latency of the four runs is between 1.134 ns and 1.227 ns on average. The variations within each test run are quite different, some vary from a large range and others have a small change. For example, the largest change is on September 15, the memory read latency of which is ranging from 1.116 ns to 1.393 ns. However, the results on September 12 change very little, which mainly keep flat and range from 1.124 ns to 1.55 ns. The SLA sets to be 30 ns. The SLA value is used as a reference, it has not been defined by OPNFV. TC011 ----- Iperf3 is a tool for evaluating the pocket delay variation between 2 VMs on different blades. The reported pocket delay variations of the four test runs differ from each other. The results on September 13 within the date look similar and the values are between 0.0213 and 0.0225 ms, which is 0.0217 ms on average. However, on the third day, the packet delay variation has a large wide change within the date, which ranges from 0.008 ms to 0.0225 ms and has the minimum value. On Sep. 12, the packet delay is quite long, for the value is between 0.0236 and 0.0287 ms and it also has the maximum packet delay of 0.0287 ms. The packet delay of the last test run is 0.0151 ms on average. The SLA value sets to be 10 ms. The SLA value is used as a reference, it has not been defined by OPNFV. TC012 ----- Lmbench is also used to measure the memory read and write bandwidth, in which we use bw_mem to obtain the results. Among the four test runs, the memory bandwidth of three test runs almost keep stable within each run, which is 11.65, 11.57 and 11.64 GB/s on average. However, the memory read and write bandwidth on Sep. 14 has a large range, for it ranges from 11.36 GB/s to 16.68 GB/s. Here SLA set to be 15 GB/s. The SLA value is used as a reference, it has not been defined by OPNFV. TC014 ----- The Unixbench is used to evaluate the IaaS processing speed with regards to score of single cpu running and parallel running. It can be seen from the dashboard that the processing test results vary from scores 3222 to 3585, and there is only one result one date. No SLA set. TC037 ----- The amount of packets per second (PPS) and round trip times (RTT) between 2 VMs on different blades are measured when increasing the amount of UDP flows sent between the VMs using pktgen as packet generator tool. Round trip times and packet throughput between VMs can typically be affected by the amount of flows set up and result in higher RTT and less PPS throughput. The mean packet throughput of the four test runs is 124.8, 160.1, 113.8 and 137.3 kpps, of which the result of the second is t