blob: 55d009e8399a618ef13f8e674a78e790004f55bf (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
|
===========
Messaging
===========
General Settings
================
``ms tcp nodelay``
:Description: Disables nagle's algorithm on messenger tcp sessions.
:Type: Boolean
:Required: No
:Default: ``true``
``ms initial backoff``
:Description: The initial time to wait before reconnecting on a fault.
:Type: Double
:Required: No
:Default: ``.2``
``ms max backoff``
:Description: The maximum time to wait before reconnecting on a fault.
:Type: Double
:Required: No
:Default: ``15.0``
``ms nocrc``
:Description: Disables crc on network messages. May increase performance if cpu limited.
:Type: Boolean
:Required: No
:Default: ``false``
``ms die on bad msg``
:Description: Debug option; do not configure.
:Type: Boolean
:Required: No
:Default: ``false``
``ms dispatch throttle bytes``
:Description: Throttles total size of messages waiting to be dispatched.
:Type: 64-bit Unsigned Integer
:Required: No
:Default: ``100 << 20``
``ms bind ipv6``
:Description: Enable if you want your daemons to bind to IPv6 address instead of IPv4 ones. (Not required if you specify a daemon or cluster IP.)
:Type: Boolean
:Required: No
:Default: ``false``
``ms rwthread stack bytes``
:Description: Debug option for stack size; do not configure.
:Type: 64-bit Unsigned Integer
:Required: No
:Default: ``1024 << 10``
``ms tcp read timeout``
:Description: Controls how long (in seconds) the messenger will wait before closing an idle connection.
:Type: 64-bit Unsigned Integer
:Required: No
:Default: ``900``
``ms inject socket failures``
:Description: Debug option; do not configure.
:Type: 64-bit Unsigned Integer
:Required: No
:Default: ``0``
Async messenger options
=======================
``ms async transport type``
:Description: Transport type used by Async Messenger. Can be ``posix``, ``dpdk``
or ``rdma``. Posix uses standard TCP/IP networking and is default.
Other transports may be experimental and support may be limited.
:Type: String
:Required: No
:Default: ``posix``
``ms async op threads``
:Description: Initial number of worker threads used by each Async Messenger instance.
Should be at least equal to highest number of replicas, but you can
decrease it if you are low on CPU core count and/or you host a lot of
OSDs on single server.
:Type: 64-bit Unsigned Integer
:Required: No
:Default: ``3``
``ms async max op threads``
:Description: Maximum number of worker threads used by each Async Messenger instance.
Set to lower values when your machine has limited CPU count, and increase
when your CPUs are underutilized (i. e. one or more of CPUs are
constantly on 100% load during I/O operations).
:Type: 64-bit Unsigned Integer
:Required: No
:Default: ``5``
``ms async set affinity``
:Description: Set to true to bind Async Messenger workers to particular CPU cores.
:Type: Boolean
:Required: No
:Default: ``true``
``ms async affinity cores``
:Description: When ``ms async set affinity`` is true, this string specifies how Async
Messenger workers are bound to CPU cores. For example, "0,2" will bind
workers #1 and #2 to CPU cores #0 and #2, respectively.
NOTE: when manually setting affinity, make sure to not assign workers to
processors that are virtual CPUs created as an effect of Hyperthreading
or similar technology, because they are slower than regular CPU cores.
:Type: String
:Required: No
:Default: ``(empty)``
``ms async send inline``
:Description: Send messages directly from the thread that generated them instead of
queuing and sending from Async Messenger thread. This option is known
to decrease performance on systems with a lot of CPU cores, so it's
disabled by default.
:Type: Boolean
:Required: No
:Default: ``false``
|
