summaryrefslogtreecommitdiffstats
path: root/behave_tests/features/non-regression.feature
blob: 57744183431c06607e39931cb8d602b916e646c7 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
@non-regression
Feature: non-regression

  @throughput
  Scenario Outline: Run a NDR test for a defined frame size
      Given 10 sec run duration
      And TRex is restarted
      And <frame_size> frame size
      And 100k flow count
      And ndr rate
      When NFVbench API is ready
      Then 3 runs are started and waiting for maximum result
      And push result to database
      And extract offered rate result
      And verify throughput result is in same range as the previous result
      And verify throughput result is in same range as the characterization result

     Examples: Frame sizes
      | frame_size |
      | 64         |
      | 768        |
      | 1518       |
      | 9000       |


  @latency
  Scenario Outline: Run a latency test for a defined frame size and throughput percentage
      Given 10 sec run duration
      And TRex is restarted
      And <frame_size> frame size
      And 100k flow count
      And <throughput> rate of previous scenario
      When NFVbench API is ready
      Then run is started and waiting for result
      And push result to database
      And verify latency result is in same range as the previous result
      And verify latency result is in same range as the characterization result

     Examples: Frame sizes and throughput percentages
      | frame_size | throughput |
      | 64         | 70%        |
      | 64         | 90%        |
      | 768        | 70%        |
      | 768        | 90%        |
      | 1518       | 70%        |
      | 1518       | 90%        |
      | 9000       | 70%        |
      | 9000       | 90%        |