SlideShare a Scribd company logo
1 of 27
Download to read offline
1
FRED HEBERT
THE ZEN OF ERLANG
2
LET IT CRASH
Eureka	Presentation
3
BLOW

IT UP
ROCKET SCIENCE
Eureka	Presentation
4
CONTROLLED BURNS
FIGHT FIRE WITH FIRE
5
PROCESSES
FULLY ISOLATED
Eureka	Presentation
6
ASYNCHRONOUS
MESSAGE PASSING
7
LINKS &

MONITORS
CODIFYING DEPENDENCIES
Eureka	Presentation
8
PREEMPTIVE

SCHEDULING
DON’T TRUST THE DEVS
Eureka	Presentation
9
FAILOVERS
NETWORK AWARE
10
LET IT CRASH
Eureka	Presentation
11
SUPERVISION

TREES
STRUCTURE INTERACTIONS
12
Old
New
1 13 32
Old
New
1 3 1 2 3
Old
New
1 1 13 2 3
SUPERVISORS
strategies
13
WHY 

RESTARTING 

WORKS
HEISENBUGS & FRIENDS
14
REPEATABLE TRANSIENT
CORE FEATURE EASY HARD
SECONDARY
FEATURE
EASY, OFTEN
OVERLOOKED
HARD
Why restarting works
EASE OF FINDING BUGS IN DEVELOPMENT
15
REPEATABLE TRANSIENT
CORE FEATURE SHOULD NEVER ALL THE TIME
SECONDARY
FEATURE
PRETTY OFTEN ALL THE TIME
Why restarting works
BUGS THAT HAPPEN IN PRODUCTION
16
REPEATABLE TRANSIENT
CORE FEATURE NO YES
SECONDARY
FEATURE
DEPENDS YES
Why restarting works
BUGS HANDLED BY RESTARTS
17
“I LIKE STATICALLY TYPED
LANGUAGES, AND I RESTART MY
DAEMON AFTER UNHANDLED
EXCEPTIONS. WHAT IS ERLANG
GONNA WIN ME ON FAULT
TOLERANCE?”
- FORUM USER “Notorious b.s.d.”
18
ROOT
TALLY
DISTRICT
QUEBEC ONTARIO …
COUNT OCR
C_OCR
WORKER
POOL
STORAGE
CACHE
POOL
WORKER
POOL
WORKER
POOL
WORKER
WEB
SERVER
LIVE
REPORTS
SESSIONS
…
WEB
WORKER
WEB
WORKER
WEB
WORKER
SUPERVISION TREES
19
ROOT
TALLY
DISTRICT
QUEBEC ONTARIO …
COUNT OCR
C_OCR
WORKER
POOL
STORAGE
CACHE
POOL
WORKER
POOL
WORKER
POOL
WORKER
WEB
SERVER
LIVE
REPORTS
SESSIONS
…
WEB
WORKER
WEB
WORKER
WEB
WORKER
SUPERVISION TREES
20
ROOT
TALLY
DISTRICT
QUEBEC ONTARIO …
COUNT OCR
C_OCR
WORKER
POOL
STORAGE
CACHE
POOL
WORKER
POOL
WORKER
POOL
WORKER
WEB
SERVER
LIVE
REPORTS
SESSIONS
…
WEB
WORKER
WEB
WORKER
WEB
WORKER
SUPERVISION TREES
REPORT_APP
TALLY_APP
STORAGE_APP
21
but probably not…
HOPEFULLY
SLEEP AT NIGHT
Eureka	Presentation
22
EXPECT FAILURE
23
DANGER ZONE
laid-back area
The risk of getting comfortable
WELL-DEFINED OPERATING CONDITIONS ERODE OVER TIME
Eureka	Presentation
25
HOW THINGS
INTERACT
IN A NUTSHELL
27
Totally advertising free books to you all
QUESTIONS?
@MONONCQC

More Related Content

More from Reactivesummit

Orchestrated Chaos: Applying Failure Testing Research at Scale.
Orchestrated Chaos: Applying Failure Testing Research at Scale.Orchestrated Chaos: Applying Failure Testing Research at Scale.
Orchestrated Chaos: Applying Failure Testing Research at Scale.
Reactivesummit
 

More from Reactivesummit (6)

Distributed stream processing with Apache Kafka
Distributed stream processing with Apache KafkaDistributed stream processing with Apache Kafka
Distributed stream processing with Apache Kafka
 
Reactive Polyglot Microservices with OpenShift and Vert.x
Reactive Polyglot Microservices with OpenShift and Vert.xReactive Polyglot Microservices with OpenShift and Vert.x
Reactive Polyglot Microservices with OpenShift and Vert.x
 
Microservices: The danger of overhype and importance of checklists
Microservices: The danger of overhype and importance of checklistsMicroservices: The danger of overhype and importance of checklists
Microservices: The danger of overhype and importance of checklists
 
Orchestrated Chaos: Applying Failure Testing Research at Scale.
Orchestrated Chaos: Applying Failure Testing Research at Scale.Orchestrated Chaos: Applying Failure Testing Research at Scale.
Orchestrated Chaos: Applying Failure Testing Research at Scale.
 
Monolith to Reactive Microservices
Monolith to Reactive MicroservicesMonolith to Reactive Microservices
Monolith to Reactive Microservices
 
Back-Pressure in Action: Handling High-Burst Workloads with Akka Streams & Ka...
Back-Pressure in Action: Handling High-Burst Workloads with Akka Streams & Ka...Back-Pressure in Action: Handling High-Burst Workloads with Akka Streams & Ka...
Back-Pressure in Action: Handling High-Burst Workloads with Akka Streams & Ka...
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 

The Zen Of Erlang