Deploying FIWARE Generic Enablers in High Availability using Docker Swarm on FIWARE Lab nodes.

1. Recipes and Architecture Patterns for
FIWARE GEs in HA using Swarmkit
Tomas Aliaga
tomas.aliaga@martel-innovate.com
github/taliaga
www.martel-innovate.com

2. 1
SmartSDK
Registry
Swarm
Compose
Orchestrator
SmartSDK Recipes SmartSDK Data Models
SmartSDK Platform Manager
Configure ManageRegister Monitor
Specific and Generic Enablers SmartSDK Application
§ https://smartsdk.eu
§ https://github.com/smartsdk/

3. 2
SmartSDK
Smart Security
• Common Architecture patterns: e.g. HA
• Common Generic Enablers: e.g. Orion
• Common Data Models: e.g. Geo-location
Common issues! Share yours!
§ https://smartsdk.eu
§ https://github.com/smartsdk/

4. 3
FIWARE GEs in HA
§ Demand? Capacity?
§ Stateless?
§ Easy peasy
§ Stateful?
§ Tech-based replication mechanism.
§ Storage platforms (Storage as a service)
§ Flocker (ClusterHQ) https://github.com/ClusterHQ/flocker
§ REX-Ray (DellEMC) https://rexray.codedellemc.com/
§ Infinit (Docker) https://infinit.sh/
§ Portworx https://portworx.com/
§ Ultimate Goal: Ease dynamic deployment of GE-based applications

5. 4
The process so far
https://smartsdk.github.io/smartsdk-recipes/

6. 5
Docker
§ Why?
§ Most FIWARE GEs are dockerized
§ Docker containers are easy to scale and orchestrate
§ Docker 1.12+
§ Service, Service Discovery, Failover, Desired State Reconciliation
§ Container -> Task, Service, Stack.
§ Compose
§ https://github.com/docker/compose
§ Swarmkit
§ https://github.com/docker/swarmkit

7. 6
Swarm Architecture Overview
http://bit.ly/DokRefArc

8. 7
Swarm Networking Highlights
http://bit.ly/DokRefArc

9. 8
Compose Overview
§ Deployment Modes
§ Replicated vs Global
§ Customization
§ Tagging
docker node update --label-add az=X
docker service craete placement-pref
’spread=node.label.az‘
§ Health-checks
healthcheck:
test: ["CMD", "curl", "-f", "http://foo"]
interval: 1m30s
timeout: 10s
retries: 3
§ https://docs.docker.com/compose/

10. Demo
9
https://github.com/smartsdk/smartsdk-recipes
Spain
Mexico Zurich
Orion
DB
Orion
DB
Orion
DB
Comet
DB
Comet
DB
Comet
DB
Orion
Orion Orion Comet
Comet
Comet

11. 10
Some Thoughts
§ How to properly reuse recipes?
§ Templates with .env files, autogenerated .yml files?…
§ Compose is good for simple deploys…
but to maximize reuse you need to tear things apart.
§ How will rancher handle swarm deployments?
§ Portainer?
§ MasterMind?
§ How much customization do you loose with Swarm?
§ Attention to scheduler algorithm details
§ Careful with ports clashing in ingress network
Le Penseur in the Musée
Rodin in Paris.

12. 11
Roadmap
§ Explore recipes for the IoT Chapter
§ Time-series Databases for NGSI
§ Checkout
§ https://smartsdk.eu
§ https://github.com/smartsdk/
§ References
§ https://success.docker.com/Architecture/Docker_Reference_Architecture%3A_Designing_Scalable%2C_Portabl
e_Docker_Container_Networks (http://bit.ly/DokRefArc)
Image from http://www.nasampe.org.

13. Thank you!
http://fiware.org
Follow @FIWARE on Twitter
12

14. 13