Running Docker in Production

Running Docker in Production
Using Apache Brooklyn, Clocker and Project Calico
Andrew Donald Kennedy

@grkvlt
Agenda
• Introduction
• Application Management
• Networking with Calico
• Demonstration
• Roadmap
• Questions
Copyright 2015 by Cloudsoft Corporation Limited

@grkvlt
Clocker Developers

@grkvlt
Clocker Statistics
•  Open Source
•  1+ Years Old
•  725 Commits
•  153 Pull Requests
•  11 Contributors
•  2 External
•  15 KLOC
•  26 Releases
http://www.redotheweb.com/CodeFlower/


@grkvlt
•  Application Management Platform
•  Deploy, Manage and Monitor Blueprints
•  Provisioning, Installation and Customization
•  Management
•  AutoScaling, Resilience, Performance, Security
Apache Brooklyn

@grkvlt
Apache jclouds
•  Java Cloud Library
•  API Agnostic
•  SoftLayer, OpenStack, AWS EC2, GCE…
•  Create Virtual Machines
•  Return SSH Endpoint
•  Create Containers
•  Docker REST API

@grkvlt
Docker
•  Containers
•  Isolation
•  Performance
•  Composable
•  Huge Ecosystem
•  Compute Abstraction
•  Process Wrapper

@grkvlt
•  So0ware-‐Deﬁned
Networking

•  Calico

•  Weave

•  Storage
and
Volume
Management

•  Flocker

•  More
Being
Developed…

•  Na.ve
Plugins

Docker Extras

@grkvltCopyright 2015 by Cloudsoft Corporation Limited
Apache Mesos ...
•  Distributed Systems Kernel
•  Cluster Management
•  Resource Sharing and Placement
•  Calico SDN Support
•  Frameworks
•  Aurora and Marathon
•  Riak, Spark, Hadoop, Storm et al
•  Brooklyn Scheduler

@grkvlt
What does it do?
1.  Spins up and Manages Docker
Clusters in the Clouds
2.  Serves up Containers on Demand
3.  Manages Composite Application
Deployments

@grkvlt
What does it provide?
•  Infrastructure Management
•  Docker Hosts
•  Swarm Controller
•  Multi Host and Multi Container Applications
•  Seamless Networking
•  Communication Between Services
•  Orchestration and Clustering
•  Control of Containers
•  Container Management

@grkvlt
Clocker and Brooklyn Summary
•  What is it?
•  Brooklyn Application
•  Brooklyn Location
•  What does it provide?
•  First Class Docker Support in Brooklyn
•  Optimized Brooklyn Blueprints for Docker
•  Container Orchestration

@grkvlt
Brooklyn Blueprints
•  Describe Applications
•  OASIS CAMP Standard
•  TOSCA and Compose in Development
•  List of Services
•  NoSQL Database Clusters
•  Web Servers and Load Balancers
•  Shell or Python Scripts
•  Targeting Multiple Destinations
•  VM, Container, Bare Metal
•  Sensors, Eﬀectors and Policies

@grkvlt
Application Management
•  Sensors
•  Data from Services
•  Eﬀectors
•  Brooklyn Policies
•  Attached to Entities in Application
•  Nothing Docker Specific
•  Elastic Scaling and Cluster Resizing
•  Service Resilience and Replacement

@grkvlt
Blueprint Example 1
id:
redis-‐service

name:
"Docker
Hub
Redis
Service"

origin:
"https://registry.hub.docker.com/_/redis/"

locations:

-‐
my-‐docker-‐cloud

services:

-‐
type:
docker:redis:3

id:
redis

openPorts:

-‐
6379

@grkvlt
Blueprint Example 2
id:
redis-‐cluster

name:
"Redis
Cluster"

locations:

-‐  jclouds:aws-‐ec2:

region:
eu-‐central-‐1

services:

-‐
type:
org.apache.brooklyn.entity.nosql.redis.RedisCluster

initialSize:
3

@grkvlt
Blueprint Example 3
id:
appserver-‐with-‐policy

name:
"Tomcat
Scaling
Webapp
Server"

location:
jclouds:aws-‐ec2:eu-‐west-‐1

services:

-‐
type:
org.apache.brooklyn.entity.webapp.ControlledDynamicWebAppCluster

initialSize:
3

memberSpec:

$brooklyn:entitySpec:

type:
org.apache.brooklyn.entity.webapp.tomcat.Tomcat8Server

brooklyn.config:

wars.root:

https://
s3-‐eu-‐west-‐1.amazonaws.com/brooklyn-‐clocker/brooklyn-‐example-‐hello-‐world-‐sql-‐webapp-‐0.6.0.war

http.port:
8080+

java.sysprops:

brooklyn.example.db.url:
$brooklyn:formatString("jdbc:%s%s?user=%s&password=%s",

component("db").attributeWhenReady("datastore.url"),
"visitors",
"brooklyn",
"br00k11n")

brooklyn.policies:

-‐
policyType:
org.apache.brooklyn.policy.autoscaling.AutoScalerPolicy

brooklyn.config:

metric:
$brooklyn:sensor("org.apache.brooklyn.entity.webapp.DynamicWebAppCluster",
"webapp.reqs.perSec.windowed.perNode")

metricLowerBound:
10

metricUpperBound:
100

minPoolSize:
1

maxPoolSize:
5

-‐
type:
org.apache.brooklyn.entity.database.mysql.MySqlNode

id:
db

name:
DB
HelloWorld
Visitors

brooklyn.config:

datastore.creation.script.url:

https://
s3-‐eu-‐west-‐1.amazonaws.com/brooklyn-‐clocker/visitors-‐creation-‐script.sql


@grkvlt
Clocker Blueprints

@grkvlt
Docker Cloud
•  Brooklyn Blueprint for Docker Cluster
•  Docker Engine on Cloud VM or Bare Metal
•  Manage TLS Certificates and access credentials
•  Create and Mount Volumes
•  Setup Logging and Monitoring
•  Install SDN and other Agents
•  Configure local or remote Docker Registry
•  Manage Capacity or Headroom

@grkvlt
Headroom
•  Ensure resources available
•  Based on MaxContainers strategy limit
•  Or Percentage Utilisation
•  Or CPU and RAM allocation
•  Scale Docker Host Cluster Automatically
•  Add new Docker hosts
•  Remove empty Docker hosts

@grkvlt
Clocker 1.x Architecture

@grkvlt
Docker Cloud
1.  On-demand
2.  Multi-Tenant
3.  Hardware Independent
4.  Application Level

@grkvlt
Clocker Features
• Docker Extensions to Brooklyn
– Docker Image as First-Class Service Type
– Placement Strategies for Containers
– Create Docker Images and Networks
•  Manages Docker Engine and Swarm
– Deployment and Management
– Installation and Configuration
– Software-Defined Networking

@grkvlt
Container Management
•  Sources
•  Docker Image Definition
•  Docker Hub or Registry
•  Dockerfile
•  Brooklyn Entity Definition
•  Create Image Automatically
•  Commit or Push for Reuse

@grkvlt
Clocker Orchestration
Docker
Engine
Virtual
Machine
Container
Clocker
Network
Segment
SDN
Provider
Cloud
Provider
Brooklyn

@grkvlt
Software-Defined Networking
•  Needed for Seamless Provisioning
•  Host to Host Communication
•  Same LAN Segment
•  No Port Forwarding
•  Natural Application Configuration
•  Initial Driver was EPMD Applications
•  Useful for any opinionated applications

@grkvlt
Networking Providers
•  Implementation Agnostic
•  L2 overlay, L3 routing etc.
•  Similar to Hypervisor in Clouds
•  Generic Interfaces
•  Host Component
•  Service Component (or Endpoint)
•  Same idea as Docker Network Plugins

@grkvlt
Networking Capabilities
•  Attach Containers to Networks

•  Create Networks as Required
•  Also Attach to VMs and Metal
•  Provide Multiple Networks
•  Per-Application or Shared
•  Segmented Private Address Space
•  Docker Port Forwarding for Ingress

@grkvlt
Network Provisioning
•  Minimal (Zero!) Configuration
•  Use Sensible Defaults
•  Allows SDN or Cloud Specific Configuration
•  Allocate Address Space on Demand
•  IP Pool Controlled by Clocker
-‐
type:
brooklyn.networking.VirtualNetwork

networkId:
database-‐net

cidr:
192.168.34.0/24

gateway:
192.168.34.1

dnsServers:

-‐
$brooklyn:entity("bind-‐server").attributeWhenReady("host.address")

addIptablesRules:
true

-‐
type:
brooklyn.networking.OpenStackVirtualNetwork

networkId:
couchbase-‐net


@grkvlt
Clocker Networking
ContainerHost
SDN
Bridge
Container
Internet
SDN
Gateway

@grkvlt
Metaswitch Project Calico
•  SDN for Bare Metal, VMs and Containers
•  Layer 3
•  Uses OS IP routing and forwarding
•  Configuration in an etcd Cluster
•  Version 0.4.9 in Clocker
•  0.6.0 with libnetwork when Docker stable
•  Spans VMs and Containers
•  OpenStack Neutron network driver

@grkvltCopyright 2015 by Cloudsoft Corporation Limited
Cross-Target Deployment

@grkvlt
Networking Capabilities
•  Wide Area and Multi Region SDN
•  VPN or IPIP and NAT configuration
•  Cross Platform SDN
•  Both VMs and Containers on one VLAN
•  Name Resolution and Service Discovery
•  Contributing to Weave DNS for orchestration
•  Use traditional external BIND service entity
•  Brooklyn can inject correct endpoint address

@grkvlt
Application Blueprint 1
id:
my-‐application

location:

services:

-‐
type:
docker:redis:3

id:
redis

openPorts:
6379

-‐
type:
docker:amouat/dnmonster:1.0

id:
dnmonster

openPorts:
8080

-‐
type:
docker:amouat/identidock:1.0

id:
identidock

portBindings:

80:
9090

links:

-‐
$brooklyn:component("redis")

-‐
$brooklyn:component("dnmonster")

@grkvlt
id:
my-‐application

location:

services:

-‐
type:
org.apache.brooklyn.entity.nosql.redis.RedisStore

id:
redis

install.version:
3.0.0

-‐
type:

id:
dnmonster

openPorts:
8080

-‐
type:

id:
identidock

portBindings:

80:
9090

links:

-‐

-‐

@grkvlt
id:
my-‐application

location:

services:

-‐
type:

location:
jclouds:softlayer:ams01

id:
redis

install.version:
3.0.0

-‐
type:

id:
dnmonster

openPorts:
8080

-‐
type:

id:
identidock

portBindings:

80:
9090

links:

-‐

-‐

@grkvlt
id:
my-‐application

location:

services:

-‐
type:

id:
redis

install.version:
3.0.0

-‐
type:

id:
dnmonster

openPorts:
8080

-‐
type:

id:
identidock

portBindings:

80:
9090

links:

-‐

-‐

@grkvlt
id:
my-‐application

services:

-‐
type:

location:

id:
redis

install.version:
3.0.0

-‐
type:
marathon:amouat/dnmonster:1.0

location:
my-‐mesos-‐cluster

id:
dnmonster

openPorts:
8080

-‐
type:

location:

id:
identidock

portBindings:

80:
9090

links:

-‐

-‐

@grkvlt
•  Orchestrated Docker deployment and
configuration, with Project Calico SDN
•  Brooklyn application blueprints deployed with
network topology linked to OpenStack using
Project Calico
•  Automated attachment of containers to multiple
dynamic networks
•  Zero Config Multi-Target Deployment
Features

@grkvlt
Roadmap 1
•  Mesos Integration
•  View and manage existing Mesos clusters
•  Provide Mesos as another Brooklyn endpoint
•  Run Marathon tasks for Brooklyn entities
•  Future Possibilities...
•  Brooklyn as a Mesos framework or scheduler
•  Integrate with other frameworks like Riak BDP

@grkvlt
Roadmap 2

Clocker Solves:
– Docker Cloud Networking
– Container Placement and Provisioning
– Composite Application Management
Summary

@grkvlt
Resources
http://clocker.io/

http://brooklyn.io/

https://github.com/brooklyncentral/clocker/

https://github.com/apache/incubator-‐brooklyn/

https://github.com/Metaswitch/calico-‐docker/

https://github.com/weaveworks/weave/

http://blog.abstractvisitorpattern.co.uk/

Running Docker in Production

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Running Docker in Production

Similar to Running Docker in Production (20)

More from Andrew Kennedy

More from Andrew Kennedy (12)

Recently uploaded

Recently uploaded (20)

Running Docker in Production