Principles of Microservices - NDC 2014

PRINCIPLES OF
MICROSERVICES
Sam Newman
NDC London, December 2014
1

Accounts
Returns
Invoicing
Shipping
Inventory
Customer
Service
#ndclondon @samnewman

Small Autonomous services
that work together
Accounts
Returns
Invoicing
Shipping
Inventory
Customer
Service

4
Show Gilt, Groupon, Netflix, Amazon

Building
Microservices
DESIGNING FINE-GRAINED SYSTEMS
Sam Newman

#ndclondon @samnewman http://www.12factor.net/

Strategic Goals
Architectural
Principles
Design and Delivery
Practices
Enable scalable
business
More customers/transactions
Self-service for customers
Support entry into
new markets
Flexible operational processes
New products and operational
processes
Support innovation
in existing markets
Flexible operational processes
New products and operational
processes
Reduce inertia
Make choices that favour rapid
feedback and change, with reduced
dependencies across teams.
Eliminate accidental
complexity
Aggressively retire and replace
unnecessarily complex processes,
systems, and integrations so that we
can focus on the essential
complexity.
Consistent interfaces
and data flows
Eliminate duplication of data and
create clear systems of record, with
consistent integration interfaces.
No silver bullets
Off the shelf solutions deliver early
value but create inertia and
accidental complexity.
Standard REST/HTTP
Encapsulate legacy
Eliminate integration
databases
Consolidate and
cleanse data
Published integration
model
Small independent
Services
Continuous
deployment
Minimal customisation
of COTS/SAAS

Small Autonomous services
that work together

10
Principles Of
Microservices

10
Principles Of
Microservices
Modelled Around
Business Domain

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Deploy
Independently

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable

13
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable
✔

2 Microservices
3 Months

2 Microservices
3 Months
10 Microservices
12 Months

2 Microservices
3 Months
10 Microservices
12 Months
60 Microservices
18 Months

Infrastructure Automation

Automated Testing

Automated Testing
Continuous Delivery

✔ ✔
16
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable

✔ ✔
16
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Decentralise All
The Things
Independently
Highly
Observable

DB
HIDE YOUR DATABASE

http://martinfowler.com/bliki/images/boundedContext/sketch.png

✔ ✔ ✔
19
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable

What is autonomy?

What is autonomy?
Giving people as much freedom as possible
to do the job at hand

DEVOLUTION?

SELF-SERVICE
https://www.flickr.com/photos/katsrcool/15184711908/

SHARED GOVERNANCE
http://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice

OWNER-OPERATOR
#ndclondon https://www.flickr.com/photos/stevendepolo/5939055612
@samnewman

INTERNAL OPEN SOURCE

DUMB-PIPES, SMART ENDPOINTS
Magical Mystery Bus

Magical Mystery Bus

✔ ✔ ✔
29
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Independently
Highly
Observable
Decentralise All
The Things ✔

ONE SERVICE PER-HOST
Service
Host

ONE SERVICE PER-HOST
Service
Host
Service Service
Service Service
Host
VS

CONSUMER-DRIVEN CONTRACTS
Shipping Inventory

Shipping Inventory
Expectations

Shipping Inventory
Expectations
Prod

https://github.com/realestate-com-au/pact

CO-EXIST ENDPOINTS
Shipping
Customer Service

CO-EXIST ENDPOINTS
Shipping
V1 V2
Customer Service

CO-EXIST ENDPOINTS
Shipping
Customer Service
V2

✔ ✔ ✔
Highly
Observable
34
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Isolate Failure
Decentralise All
The Things ✔
Deploy
✔ Independently

1 in 100

4 in 100

Strangler App

Strangler App
Legacy App Legacy App
Legacy App

Requests
Strangler App
Legacy App
Legacy App
Legacy App

Requests
Strangler App
Legacy App
30 - 60 Concurrent Requests
Legacy App
Legacy App

Requests
Strangler App
Legacy App
30 - 60 Concurrent Requests
> 800 Concurrent Requests
Legacy App
Legacy App

Strangler App
Thread Pool
Legacy App Legacy App Legacy App

Strangler App
Thread Pool
Failing…slowly!

Strangler App
Thread Pool
Thread-pool
exhausted
Failing…slowly!

Strangler App
Thread Pool
No requests to other
downstream apps
Thread-pool
exhausted
Failing…slowly!

Strangler App
Thread Pool
No requests to other
downstream apps
Requests
Building Up
Thread-pool
exhausted
Failing…slowly!

Strangler App
Thread Pool
Fix Timeouts

Strangler App
Thread Pool Thread Pool Thread Pool
Fix Timeouts

Strangler App
Fix Timeouts
Bulkhead
Downstream
Connections

Strangler App
Circuit Breakers
Fix Timeouts
Bulkhead
Downstream
Connections

✔ ✔ ✔
✔ Independently ✔ Isolate Failure
39
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Highly
Observable
Decentralise All
The Things ✔
Deploy

AGGREGATION

AGGREGATION
LOGS

AGGREGATION
LOGS
STATS

CORRELATION IDS

CORRELATION IDS
ID 8964

CORRELATION IDS
ID 8964
ID 8964
ID 8964
ID 8964
ID 8964

Principles Of
Microservices

Principles Of
Microservices
Modelled Around
Business Domain

Culture Of
Automation
Principles Of
Microservices
Modelled Around
Business Domain

Culture Of
Principles Of
Microservices
Modelled Around
Business Domain
Details

Culture Of
Principles Of
Microservices
Modelled Around
Business Domain
Details
Decentralise All
The Things

Culture Of
Principles Of
Microservices
Modelled Around
Business Domain
Details
Decentralise All
The Things
Deploy
Independently

Culture Of
Principles Of
Microservices
Modelled Around
Business Domain
Details
Decentralise All
The Things
Independently

Culture Of
Principles Of
Microservices
Modelled Around
Business Domain
Details
Decentralise All
The Things
Highly
Observable
Independently

Building
Microservices
DESIGNING FINE-GRAINED SYSTEMS
http://buildingmicroservices.com/
Sam Newman

THANKS!
Sam Newman
@samnewman

Principles of Microservices - NDC 2014

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Principles of Microservices - NDC 2014

Similar to Principles of Microservices - NDC 2014 (20)

Recently uploaded

Recently uploaded (20)

Principles of Microservices - NDC 2014