Generate the endpoint map statically

A stack is an extremely heavyweight abstraction in Heat. Particularly in
TripleO, every stack includes a copy of all the template and environment
data for all of the stacks in the tree, all of which must be stored anew
in the database.

The EndpointMap abstraction created no fewer than 30 nested stacks, none
of which contained any resources but which existed purely for the
purpose of abstracting out some intrinsic functions used to calculate
the endpoint URLs for the various services. This likely adds several GB
to the memory requirements of the undercloud, and can cause things to
slow to a crawl since all 30 nested stacks need to be queried whenever
we need data from any one of them.

This change eliminates the nested stacks and instead generates the
endpoint map statically. This can be done offline in less than 250ms,
allows the input data to be expressed in an even more human-readable
form, and reduces the runtime overhead of the endpoints map by a factor
of 31, all with no loss of functionality, compatibility or flexibility.

Since we don't run a setup script to generate the tarball, the
endpoint_map.yaml output is checked in to source control. The build
script offers a --check option that can be used to make sure that the
output file is up-to-date with the input data.

Change-Id: I2df8f5569d81c1bde417ff5b12b06b7f1e19c336

1 files changed, 185 insertions, 0 deletions

diff --git a/network/endpoints/endpoint_data.yaml b/network/endpoints/endpoint_data.yaml
new file mode 100644
index 00000000..ac1e042a
--- /dev/null
+++ b/network/endpoints/endpoint_data.yaml
@@ -0,0 +1,185 @@
+# Data in this file is used to generate the endpoint_map.yaml template.
+# Run the script build_endpoint_map.py to regenerate the file.
+
+Ceilometer:
+    Internal:
+        vip_param: CeilometerApi
+    Public:
+        vip_param: Public
+    Admin:
+        vip_param: CeilometerApi
+    port: 8777
+
+Cinder:
+    Internal:
+        vip_param: CinderApi
+        uri_suffixes:
+            '': /v1/%(tenant_id)s
+            V2: /v2/%(tenant_id)s
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /v1/%(tenant_id)s
+            V2: /v2/%(tenant_id)s
+    Admin:
+        vip_param: CinderApi
+        uri_suffixes:
+            '': /v1/%(tenant_id)s
+            V2: /v2/%(tenant_id)s
+    port: 8776
+
+Glance:
+    Internal:
+        vip_param: GlanceApi
+    Public:
+        vip_param: Public
+    Admin:
+        vip_param: GlanceApi
+    port: 9292
+
+GlanceRegistry:
+    Internal:
+        vip_param: GlanceRegistry
+    Public:
+        vip_param: Public
+    Admin:
+        vip_param: GlanceRegistry
+    port: 9191
+
+Mysql:
+    '':
+        vip_param: Mysql
+
+Heat:
+    Internal:
+        vip_param: HeatApi
+        uri_suffixes:
+            '': /v1/%(tenant_id)s
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /v1/%(tenant_id)s
+    Admin:
+        vip_param: HeatApi
+        uri_suffixes:
+            '': /v1/%(tenant_id)s
+    port: 8004
+
+Horizon:
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /dashboard
+    port: 80
+
+Keystone:
+    Internal:
+        vip_param: KeystonePublicApi
+        uri_suffixes:
+            '': /v2.0
+            EC2: /v2.0/ec2tokens
+        names:
+            EC2: KeystoneEC2
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /v2.0
+    Admin:
+        vip_param: KeystoneAdminApi
+        uri_suffixes:
+            '': /v2.0
+        port: 35357
+    port: 5000
+
+# TODO(ayoung): V3 is a temporary fix. Endpoints should be versionless.
+# Required for https://bugs.launchpad.net/puppet-nova/+bug/1542486
+KeystoneV3:
+    Internal:
+        vip_param: KeystonePublicApi
+        uri_suffixes:
+            '': /v3
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /v3
+    Admin:
+        vip_param: KeystoneAdminApi
+        uri_suffixes:
+            '': /v3
+        port: 35357
+    port: 5000
+
+Neutron:
+    Internal:
+        vip_param: NeutronApi
+    Public:
+        vip_param: Public
+    Admin:
+        vip_param: NeutronApi
+    port: 9696
+
+Nova:
+    Internal:
+        vip_param: NovaApi
+        uri_suffixes:
+            '': /v2/%(tenant_id)s
+            V3: /v3
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /v2/%(tenant_id)s
+            V3: /v3
+    Admin:
+        vip_param: NovaApi
+        uri_suffixes:
+            '': /v2/%(tenant_id)s
+            V3: /v3
+    port: 8774
+
+NovaEC2:
+    Internal:
+        vip_param: NovaApi
+        uri_suffixes:
+            '': /services/Cloud
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /services/Cloud
+    Admin:
+        vip_param: NovaApi
+        uri_suffixes:
+            '': /services/Admin
+    port: 8773
+
+Swift:
+    Internal:
+        vip_param: SwiftProxy
+        uri_suffixes:
+            '': /v1/AUTH_%(tenant_id)s
+            S3:
+    Public:
+        vip_param: Public
+        uri_suffixes:
+            '': /v1/AUTH_%(tenant_id)s
+            S3:
+    Admin:
+        vip_param: SwiftProxy
+        uri_suffixes:
+            '':
+            S3:
+    port: 8080
+
+Sahara:
+    Internal:
+        vip_param: SaharaApi
+        uri_suffixes:
+            '': /v1.1/%(tenant_id)s
+    Public:
+        vip_param: SaharaApi
+        uri_suffixes:
+            '': /v1.1/%(tenant_id)s
+    Admin:
+        vip_param: SaharaApi
+        uri_suffixes:
+            '': /v1.1/%(tenant_id)s
+    port: 8386