Docker Adoption comes with a set of problems for productions operations. Tools simply do not exist for the problems a Not Pets, Not Cattle but Ants application topology comes with. StackEngine demos its Beta release in the context of each of these problems and how it proposes to address them.

1. Managing Docker
Applications in Production
Boyd E. Hemphill
@behemphi @stackengine

2. History - Boyd
Oracle Developer, MySQL DBA, PHP
Developer, System Architect,
DevOps Director (yea, really)
Started Austin DevOps In 2012
Co-Organizer of DevOps Days
Austin
Became involved in Docker
Austin in August.
Working with Docker for the first
Docker Days Austin
Keep an eye on @stackengine to
see if we can make it happen!

3. History -
StackEngine
CopperEgg
Started in May 2014 to
address problems arising
due to Docker adoptions
Funding announcement
October
Currently in private beta
mike@stackengine.com

4. Common Ground

5. What is The
Goal of Your
Company?

6. What is The
Goal of Your
Company?
Make Money!

7. So … What is
DevOps?

8. Is DevOps a Process?

9. Is it an intersection of
overlapping concerns?

10. Is DevOps a Culture?

11. DevOps:
DevOps is the way
in which a
technology
organization
embeds itself in a
business to the
benefit of that
business.

12. The Ideal Docker
Application

13. Netflix (unicorn)
Service Oriented Architecture

14. Benefits
Increase developer velocity using containers to model
application topology
Decrease build and test times using containers as
build/test agents rather than VMs
Density - Reduce Costs
Separation of Concerns - “Code to an interface” moves
to the infrastructure level
Taken together a company that can get to the end state
has a significant and lasting competitive advantage

15. Today’s Docker
Reality

16. Concerns
This is still very early days for Docker
Tools to support Dockerized applications
immature or do not exist
Service oriented architecture is hard
Increasing developer is only a local optima, thus
a false economy
Its the first major DevOps initiative not driven by
Ops.

17. SDLC
Developers are moving
forward
QA sees production
modeling and large test
grids
Build engineers see
easier build grids
Operations panics - no
tools or instrumentation

18. The Final Mile

19. The Final Mile
Developer uses
containers
System is built and
images are produced
Images stored in a
private repo
Now we need to deploy
to a QA environment
Umm ….

20. Docker Deployment
Completing the final mile

22. Deployment
Continuous Deployment was published in 2010
In general we still talk about build and
integration, not deployment
This is true for all applications, not just those
that are Dockerized
Docker promises A/B deployment
StackEngine is working on making A/B
deployment a policy based activity

23. Container Sprawl

24. Container Sprawl
First there was VMware and
suddenly a large corps departments
could easily spin up environments
Then there was the cloud and
developers could complete
circumvent Ops
Now there is Docker and Developers
are creating numerous abstractions
that are not managed like
traditional VMs
Containers on VMs on phyical
hardware located in availability
zones in data centers in geographic
regions.

25. My Head Hurts
Container Sprawl

26. Inventory
Management

27. Where’s My Stuff
Hosts

28. Where’s My Stuff
Images

29. Where’s My Stuff
Containers

30. Telemetry

31. Telemetry
What does
monitoring a
docker app look
like?
What does log
aggregation look
like?

32. Telemetry
Container size
matters - blog
Log aggregation
solution - blog

33. What’s my stuff (not) doing
Containers

34. What’s my stuff (not) doing
Containers

35. What’s my stuff (not) doing
Containers

36. Components

37. Components
Components are
infrastructure
abstractions (cloud
provider, data center,
docker registry,
docker image)
Components can be
arranged in logic ways
to represent physical
infrastructure.

38. Composing and App
Components

39. Composing and App
Components

40. Composing and App
Components

41. Service Discovery

42. Service Discovery -
Consistency Models
Zookeeper
Etcd / Consul
Chef Server / Heira

43. Service Discovery
Due out in December
Allows multiple deployments
of the same service on the
same host.
Containers register
themselves upon startup and
are found by tags rather
than URI’s, fixed ports, etc.
A step towards cattle
containers instead of pet
containers

44. Roadmap

45. Roadmap
Service Discovery
User Management
Addition of new
Components
Better telemetry
Scheduling
A/B Deployment support

46. Live Product Demo
Al Gore and his gremlins willing

47. Thank You for Your Time and
Comments.
Boyd Hemphill
@behemphi
@stackengine