Principles of microservices velocity

PRINCIPLES OF
MICROSERVICES
Sam Newman
Velocity Santa Clara, May 2015
1

@samnewman@velocityconf
Sam Newman
Building
Microservices
DESIGNING FINE-GRAINED SYSTEMS

Accounts
Returns
Invoicing
Shipping
Inventory
Customer
Service

Accounts
Returns
Invoicing
Shipping
Inventory
Customer
Service
Small Autonomous services
that work together

5
Show Gilt, Groupon, Netﬂix, Amazon

@samnewman@velocityconf http://www.12factor.net/

Strategic Goals
Architectural
Principles
Design and Delivery
Practices
Enable scalable
business
More customers/transactions
Self-service for customers
Support entry into
new markets
Flexible operational processes
New products and operational
processes
Support innovation
in existing markets
Flexible operational processes
New products and operational
processes
Reduce inertia
Make choices that favour rapid
feedback and change, with reduced
dependencies across teams.
Eliminate accidental
complexity
Aggressively retire and replace
unnecessarily complex processes,
systems, and integrations so that we
can focus on the essential
complexity.
Consistent interfaces
and data flows
Eliminate duplication of data and
create clear systems of record, with
consistent integration interfaces.
No silver bullets
Off the shelf solutions deliver early
value but create inertia and
accidental complexity.
Standard REST/HTTP
Encapsulate legacy
Eliminate integration
databases
Consolidate and
cleanse data
Published integration
model
Small independent
Services
Continuous
deployment
Minimal customisation
of COTS/SAAS

Small Autonomous services
that work together

10
Principles Of
Microservices

10
Principles Of
Microservices
Modelled Around
Business Domain

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation Hide Implementation
Details

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Deploy
Independently

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Deploy
Independently
Consumer First

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Isolate Failure Deploy
Independently
Consumer First

10
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable
Consumer First

Presentation
Business Logic
Data Access

13https://www.ﬂickr.com/photos/glimeend/5692801655/

14
Register a new customer
Oil Change

14
Emission Test
Oil Change

14
Emission Test
Replace Tire
Oil Change

14
Order parts
Emission Test
Replace Tire
Oil Change

14
Order parts
Emission Test
Replace Tire
Oil Change
Send an invoice

14
Order parts
Emission Test
Replace Tire
Oil Change
Send an invoice
Make a repair

14
Order parts
Emission Test
Replace Tire
Oil Change
Send an invoice
Make a repair
Contact a customer

14
Order parts
Emission TestReplace Tire
Oil Change
Send an invoice
Make a repair
Contact a customer

15
Customer
Management
Maintenance
Inventory

17
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable
✔
Consumer First

3 Months
2 Microservices

3 Months
2 Microservices
12 Months
10 Microservices

3 Months
2 Microservices
12 Months
10 Microservices
18 Months
60 Microservices

Infrastructure Automation

Automated Testing

Continuous Delivery
Automated Testing

20
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable
✔ ✔
Consumer First

20
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation
Hide Implementation
Details
Decentralise All
The Things
Independently
Highly
Observable
✔ ✔
Consumer First

DB
HIDE YOUR DATABASE

http://martinfowler.com/bliki/images/boundedContext/sketch.png

http://martinfowler.com/bliki/images/boundedContext/sketch.png
BOUNDED CONTEXTS

Client LibraryClient LibraryClient Library

Client Library
Client Library
Client Library

Client Library
BE CAREFUL OF CLIENT LIBRARIES
Client Library
Client Library

24
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable
✔ ✔ ✔
Consumer First

What is autonomy?

What is autonomy?
Giving people as much freedom as possible
to do the job at hand

DEVOLUTION?

SELF-SERVICE
https://www.ﬂickr.com/photos/katsrcool/15184711908/

http://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice
SHARED GOVERNANCE

OWNER-OPERATOR
https://www.ﬂickr.com/photos/stevendepolo/5939055612

INTERNAL OPEN SOURCE

DUMB-PIPES, SMART ENDPOINTS
Magical Mystery Bus

Magical Mystery Bus

Customer
Enrolment

Create
Customer
Record
Customer
Enrolment

Create
Customer
Record
Customer
Enrolment
Create Loyalty
Account

Create
Customer
Record
Customer
Enrolment
Dispatch
Welcome Pack
Create Loyalty
Account

Create
Customer
Record
Customer
Enrolment
Dispatch
Welcome Pack
Create Loyalty
Account
Send Welcome
Email

Create
Customer
Record
Customer
Enrolment
Dispatch
Welcome Pack
Create Loyalty
Account
Send Welcome
Email
Completed

ORCHESTRATION

Customer
Service
create
ORCHESTRATION

Customer
Service
create
Loyalty
Bank
create
ORCHESTRATION

Customer
Service
create
Loyalty
Bank
create
Email
send email
ORCHESTRATION

Customer
Service
create
Loyalty
Bank
create
Email
send email
Whitemail
send package
ORCHESTRATION

CHOREOGRAPHED

CHOREOGRAPHED
Customer
Service
create

CHOREOGRAPHED
Customer
Service
create
customer created

CHOREOGRAPHED
Customer
Service
create
customer created
Loyalty
Bank

CHOREOGRAPHED
Customer
Service
create
customer created
Loyalty
Bank
Email

CHOREOGRAPHED
Customer
Service
create
customer created
Loyalty
Bank
Email
Whitemail

CHOREOGRAPHED
Customer
Service
create
customer created
Loyalty
Bank
Email
Whitemail
Reporting
Dashboard

CHOREOGRAPHY OVER ORCHESTRATION

38
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Independently
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Consumer First

ONE SERVICE PER-HOST
Host
Service

ONE SERVICE PER-HOST
Host
Service
Host
Service Service
Service Service
VS

CONSUMER-DRIVEN CONTRACTS
Shipping Inventory

Expectations
Shipping Inventory

Expectations
Prod
Shipping Inventory

https://github.com/realestate-com-au/pact

CO-EXIST ENDPOINTS
Customer Service
Shipping

CO-EXIST ENDPOINTS
Customer Service
Shipping
V2V1

CO-EXIST ENDPOINTS
Customer Service
Shipping
V2

43
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Isolate Failure
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔
Consumer First

43
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Isolate Failure
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔Consumer First

DOCUMENTATION

API GATEWAYS

SERVICE DISCOVERY

HUMANE REGISTRIES

49
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Isolate Failure
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔
Consumer First✔

AVOID THE DISTRIBUTED SINGLE POINT OF FAILURE!

Strangler App

Strangler App
Legacy App
Legacy AppLegacy App

Strangler App
Legacy App
Legacy App
Requests
Legacy App

Strangler App
Legacy App
Legacy App
Requests
Legacy App
30 - 60 Concurrent Requests

Strangler App
Legacy App
Legacy App
Requests
Legacy App
30 - 60 Concurrent Requests
> 800 Concurrent Requests

Strangler App
Legacy App Legacy App Legacy App
Thread Pool

Strangler App
Thread Pool
Failing…slowly!

Strangler App
Thread Pool
Failing…slowly!
Thread-pool
exhausted

Strangler App
Thread Pool
Failing…slowly!
Thread-pool
exhausted
No requests to other
downstream apps

Strangler App
Thread Pool
Failing…slowly!
Thread-pool
exhausted
Requests
Building Up
No requests to other
downstream apps

Strangler App
Fix Timeouts
Thread Pool

Strangler App
Fix Timeouts
Thread Pool Thread PoolThread Pool

Strangler App
Fix Timeouts
Bulkhead
Downstream
Connections

Strangler App
Fix Timeouts
Bulkhead
Downstream
Connections
Circuit Breakers

55
Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Highly
Observable
✔ ✔ ✔
Decentralise All
The Things
✔
Deploy
Independently✔
Isolate Failure✔ Consumer First✔

STATS PAGES

AGGREGATION

LOGS
AGGREGATION

LOGS
STATS
AGGREGATION

CORRELATION IDS

CORRELATION IDS
ID 8964

CORRELATION IDS
ID 8964
ID 8964
ID 8964
ID 8964
ID 8964

SEMANTIC MONITORING

Principles Of
Microservices

Principles Of
Microservices
Modelled Around
Business Domain

Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Automation

Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details

Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things

Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Deploy
Independently

Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Deploy
Independently
Consumer First

Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Consumer First

Principles Of
Microservices
Modelled Around
Business Domain
Culture Of
Details
Decentralise All
The Things
Independently
Highly
Observable
Consumer First

Sam Newman
Building
Microservices
DESIGNING FINE-GRAINED SYSTEMS
http://buildingmicroservices.com/

Oﬃce Hours

Oﬃce Hours
(well, 30mins)

Oﬃce Hours
12.30pm on Thursday
(well, 30mins)

http://lanyrd.com/proﬁle/samnewman/

Principles of microservices velocity

More Related Content

Viewers also liked

Similar to Principles of microservices velocity

More from Sam Newman

Recently uploaded

Principles of microservices velocity