1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
|
.. This work is licensed under a Creative Commons Attribution 4.0 International License.
.. http://creativecommons.org/licenses/by/4.0
.. (c) Open Platform for NFV Project, Inc. and its contributors
========
Abstract
========
This document contains details about how to use OPNFV Fuel - Euphrates
release - after it was deployed. For details on how to deploy check the
installation instructions in the :ref:`references` section.
This is an unified documentation for both x86_64 and aarch64
architectures. All information is common for both architectures
except when explicitly stated.
================
Network Overview
================
Fuel uses several networks to deploy and administer the cloud:
+------------------+-------------------+---------------------------------------------------------+
| Network name | Deploy Type | Description |
| | | |
+==================+===================+=========================================================+
| **PXE/ADMIN** | baremetal only | Used for booting the nodes via PXE |
+------------------+-------------------+---------------------------------------------------------+
| **MCPCONTROL** | baremetal & | Used to provision the infrastructure VMs (Salt & MaaS). |
| | virtual | On virtual deploys, it is used for Admin too (on target |
| | | VMs) leaving the PXE/Admin bridge unused |
+------------------+-------------------+---------------------------------------------------------+
| **Mgmt** | baremetal & | Used for internal communication between |
| | virtual | OpenStack components |
+------------------+-------------------+---------------------------------------------------------+
| **Internal** | baremetal & | Used for VM data communication within the |
| | virtual | cloud deployment |
+------------------+-------------------+---------------------------------------------------------+
| **Public** | baremetal & | Used to provide Virtual IPs for public endpoints |
| | virtual | that are used to connect to OpenStack services APIs. |
| | | Used by Virtual machines to access the Internet |
+------------------+-------------------+---------------------------------------------------------+
These networks - except mcpcontrol - can be linux bridges configured before the deploy on the
Jumpserver. If they don't exists at deploy time, they will be created by the scripts as virsh
networks.
Mcpcontrol exists only on the Jumpserver and needs to be virtual because a DHCP server runs
on this network and associates static host entry IPs for Salt and Maas VMs.
===================
Accessing the Cloud
===================
Access to any component of the deployed cloud is done from Jumpserver to user *ubuntu* with
ssh key */var/lib/opnfv/mcp.rsa*. The example below is a connection to Salt master.
.. code-block:: bash
$ ssh -o StrictHostKeyChecking=no -i /var/lib/opnfv/mcp.rsa -l ubuntu 10.20.0.2
**Note**: The Salt master IP is not hard set, it is configurable via INSTALLER_IP during deployment
The Fuel baremetal deploy has a Virtualized Control Plane (VCP) which means that the controller
services are installed in VMs on the baremetal targets (kvm servers). These VMs can also be
accessed with virsh console: user *opnfv*, password *opnfv_secret*. This method does not apply
to infrastructure VMs (Salt master and MaaS).
The example below is a connection to a controller VM. The connection is made from the baremetal
server kvm01.
.. code-block:: bash
$ ssh -o StrictHostKeyChecking=no -i /var/lib/opnfv/mcp.rsa -l ubuntu x.y.z.141
ubuntu@kvm01:~$ virsh console ctl01
User *ubuntu* has sudo rights. User *opnfv* has sudo rights only on aarch64 deploys.
=============================
Exploring the Cloud with Salt
=============================
To gather information about the cloud, the salt commands can be used. It is based
around a master-minion idea where the salt-master pushes config to the minions to
execute actions.
For example tell salt to execute a ping to 8.8.8.8 on all the nodes.
.. figure:: img/saltstack.png
Complex filters can be done to the target like compound queries or node roles.
For more information about Salt see the :ref:`references` section.
Some examples are listed below. Note that these commands are issued from Salt master
with *root* user.
#. View the IPs of all the components
.. code-block:: bash
root@cfg01:~$ salt "*" network.ip_addrs
cfg01.baremetal-mcp-ocata-odl-ha.local:
- 10.20.0.2
- 172.16.10.100
mas01.baremetal-mcp-ocata-odl-ha.local:
- 10.20.0.3
- 172.16.10.3
- 192.168.11.3
.........................
#. View the interfaces of all the components and put the output in a file with yaml format
.. code-block:: bash
root@cfg01:~$ salt "*" network.interfaces --out yaml --output-file interfaces.yaml
root@cfg01:~# cat interfaces.yaml
cfg01.baremetal-mcp-ocata-odl-ha.local:
enp1s0:
hwaddr: 52:54:00:72:77:12
inet:
- address: 10.20.0.2
broadcast: 10.20.0.255
label: enp1s0
netmask: 255.255.255.0
inet6:
- address: fe80::5054:ff:fe72:7712
prefixlen: '64'
scope: link
up: true
.........................
#. View installed packages in MaaS node
.. code-block:: bash
root@cfg01:~# salt "mas*" pkg.list_pkgs
mas01.baremetal-mcp-ocata-odl-ha.local:
----------
accountsservice:
0.6.40-2ubuntu11.3
acl:
2.2.52-3
acpid:
1:2.0.26-1ubuntu2
adduser:
3.113+nmu3ubuntu4
anerd:
1
.........................
#. Execute any linux command on all nodes (list the content of */var/log* in this example)
.. code-block:: bash
root@cfg01:~# salt "*" cmd.run 'ls /var/log'
cfg01.baremetal-mcp-ocata-odl-ha.local:
alternatives.log
apt
auth.log
boot.log
btmp
cloud-init-output.log
cloud-init.log
.........................
#. Execute any linux command on nodes using compound queries filter
.. code-block:: bash
root@cfg01:~# salt -C '* and cfg01*' cmd.run 'ls /var/log'
cfg01.baremetal-mcp-ocata-odl-ha.local:
alternatives.log
apt
auth.log
boot.log
btmp
cloud-init-output.log
cloud-init.log
.........................
#. Execute any linux command on nodes using role filter
.. code-block:: bash
root@cfg01:~# salt -I 'nova:compute' cmd.run 'ls /var/log'
cmp001.baremetal-mcp-ocata-odl-ha.local:
alternatives.log
apache2
apt
auth.log
btmp
ceilometer
cinder
cloud-init-output.log
cloud-init.log
.........................
===================
Accessing Openstack
===================
Once the deployment is complete, Openstack CLI is accessible from controller VMs (ctl01..03).
Openstack credentials are at */root/keystonercv3*.
.. code-block:: bash
root@ctl01:~# source keystonercv3
root@ctl01:~# openstack image list
+--------------------------------------+-----------------------------------------------+--------+
| ID | Name | Status |
+======================================+===============================================+========+
| 152930bf-5fd5-49c2-b3a1-cae14973f35f | CirrosImage | active |
| 7b99a779-78e4-45f3-9905-64ae453e3dcb | Ubuntu16.04 | active |
+--------------------------------------+-----------------------------------------------+--------+
The OpenStack Dashboard, Horizon is available at http://<controller VIP>:8078, e.g. http://10.16.0.11:8078.
The administrator credentials are *admin*/*opnfv_secret*.
.. figure:: img/horizon_login.png
A full list of IPs/services is available at <proxy public VIP>:8090 for baremetal deploys.
.. figure:: img/salt_services_ip.png
For Virtual deploys, the most commonly used IPs are in the table below.
+-----------+--------------+---------------+
| Component | IP | Default value |
+===========+==============+===============+
| gtw01 | x.y.z.124 | 172.16.10.124 |
+-----------+--------------+---------------+
| ctl01 | x.y.z.11 | 172.16.10.11 |
+-----------+--------------+---------------+
| cmp001 | x.y.z.101 | 172.16.10.101 |
+-----------+--------------+---------------+
| cmp002 | x.y.z.102 | 172.16.10.102 |
+-----------+--------------+---------------+
==============================
Guest Operating System Support
==============================
There are a number of possibilities regarding the guest operating systems which can be spawned
on the nodes. The current system spawns virtual machines for VCP VMs on the KVM nodes and VMs
requested by users in OpenStack compute nodes. Currently the system supports the following
UEFI-images for the guests:
+------------------+-------------------+------------------+
| OS name | x86_64 status | aarch64 status |
+==================+===================+==================+
| Ubuntu 17.10 | untested | Full support |
+------------------+-------------------+------------------+
| Ubuntu 16.04 | Full support | Full support |
+------------------+-------------------+------------------+
| Ubuntu 14.04 | untested | Full support |
+------------------+-------------------+------------------+
| Fedora atomic 27 | untested | Not supported |
+------------------+-------------------+------------------+
| Fedora cloud 27 | untested | Not supported |
+------------------+-------------------+------------------+
| Debian | untested | Full support |
+------------------+-------------------+------------------+
| Centos 7 | untested | Not supported |
+------------------+-------------------+------------------+
| Cirros 0.3.5 | Full support | Full support |
+------------------+-------------------+------------------+
| Cirros 0.4.0 | Full support | Full support |
+------------------+-------------------+------------------+
The above table covers only UEFI image and implies OVMF/AAVMF firmware on the host. An x86 deployment
also supports non-UEFI images, however that choice is up to the underlying hardware and the administrator
to make.
The images for the above operating systems can be found in their respective websites.
===================
Openstack Endpoints
===================
For each Openstack service three endpoints are created: admin, internal and public.
.. code-block:: bash
ubuntu@ctl01:~$ openstack endpoint list --service keystone
+----------------------------------+-----------+--------------+--------------+---------+-----------+------------------------------+
| ID | Region | Service Name | Service Type | Enabled | Interface | URL |
+----------------------------------+-----------+--------------+--------------+---------+-----------+------------------------------+
| 008fec57922b4e9e8bf02c770039ae77 | RegionOne | keystone | identity | True | internal | http://172.16.10.26:5000/v3 |
| 1a1f3c3340484bda9ef7e193f50599e6 | RegionOne | keystone | identity | True | admin | http://172.16.10.26:35357/v3 |
| b0a47d42d0b6491b995d7e6230395de8 | RegionOne | keystone | identity | True | public | https://10.0.15.2:5000/v3 |
+----------------------------------+-----------+--------------+--------------+---------+-----------+------------------------------+
MCP sets up all Openstack services to talk to each other over unencrypted
connections on the internal management network. All admin/internal endpoints use
plain http, while the public endpoints are https connections terminated via nginx
at the VCP proxy VMs.
To access the public endpoints an SSL certificate has to be provided. For
convenience, the installation script will copy the required certificate into
to the cfg01 node at /etc/ssl/certs/os_cacert.
Copy the certificate from the cfg01 node to the client that will access the https
endpoints and place it under /etc/ssl/certs. The SSL connection will be established
automatically after.
.. code-block:: bash
$ ssh -o StrictHostKeyChecking=no -i /var/lib/opnfv/mcp.rsa -l ubuntu 10.20.0.2 \
"cat /etc/ssl/certs/os_cacert" | sudo tee /etc/ssl/certs/os_cacert
=============================
Reclass model viewer tutorial
=============================
In order to get a better understanding on the reclass model Fuel uses, the `reclass-doc
<https://github.com/jirihybek/reclass-doc>`_ can be used to visualise the reclass model.
A simplified installation can be done with the use of a docker ubuntu container. This
approach will avoid installing packages on the host, which might collide with other packages.
After the installation is done, a webbrowser on the host can be used to view the results.
**NOTE**: The host can be any device with Docker package already installed.
The user which runs the docker needs to have root priviledges.
**Instructions**
#. Create a new directory at any location
.. code-block:: bash
$ mkdir -p modeler
#. Place fuel repo in the above directory
.. code-block:: bash
$ cd modeler
$ git clone https://gerrit.opnfv.org/gerrit/fuel && cd fuel
#. Create a container and mount the above host directory
.. code-block:: bash
$ docker run --privileged -it -v <absolute_path>/modeler:/host ubuntu bash
#. Install all the required packages inside the container.
.. code-block:: bash
$ apt-get update
$ apt-get install -y npm nodejs
$ npm install -g reclass-doc
$ cd /host/fuel/mcp/reclass
$ ln -s /usr/bin/nodejs /usr/bin/node
$ reclass-doc --output /host /host/fuel/mcp/reclass
#. View the results from the host by using a browser. The file to open should be now at modeler/index.html
.. figure:: img/reclass_doc.png
.. _references:
==========
References
==========
1) `Installation instructions <http://docs.opnfv.org/en/stable-euphrates/submodules/fuel/docs/release/installation/installation.instruction.html>`_
2) `Saltstack Documentation <https://docs.saltstack.com/en/latest/topics>`_
3) `Saltstack Formulas <http://salt-formulas.readthedocs.io/en/latest/develop/overview-reclass.html>`_
|