Grégoire Morpain
@wz_
Bastien Murzeau
@b_a_s_t_i_e_n
Louis Amon
@louis_amon
Slack AWS User Group
Échangez et posez vos questions aux experts AWS.
bit.ly/awsfrmeetup
IPPON 2019
Observability pillars applied to
Serverless.
Steve Houël
Pierre Baillet
Ippon en quelques mots.
16ans
2002 - 2018
360
Collaborateurs
38M€
CA
2018
48M€
Prévisionnel
2019
4
Continents
Cabinet de conseil Digital · Cloud · Data
Nous croyons en nos équipes pour donner du sens et toute son essence à la technologie.
IPPON 2019
IPPON 2019
#Steve HOUËL
JHipster contributor https://www.jhipster.tech/
daSWAG creator https://github.com/daswag
- When not coworking, I am riding my unicorn
in my swimming pool
Mes publications
Les architectures Serverless How to do Serverless Livre Blanc Kit de survie Serverless
Senior Cloud Architect
Global Tech Leader
@SteveHouel
IPPON 2019
#TourDeFrance #Serverless.
➔ 7 Mai Article Observability pillars applied to Serverless
➔ 9 Mai - Bordeaux Observability pillars applied to Serverless
➔ 13 Mai WhitePaper Serverless
➔ 14 Mai - Nantes To be or not to be Serverless
➔ 21 Mai - Toulouse Observability pillars applied to Serverless
➔ 23 Mai - Lille To be or not to be Serverless
➔ 29 Mai - Paris Observability pillars applied to Serverless
➔ Juin Magazine Programmez.com - Architectures Serverless de la
théorie à la pratique
➔ 11 Juin - Lyon Observability pillars applied to Serverless
➔ 19 Juin - Lille Serverless et sécurité, ce qu’il faut comprendre
IPPON 2019
#Pierre BAILLET
SRE, R&D engineer
@octplane
● Remote SRE at Datadog
● Former Sr Consultant / Tech Manager
at Ippon
● Current geeky pleasures: AWS, GCP,
K8S, Go, Python, Rust
When not working: fighting bamboo in
the garden
IPPON 2019
What do I mean by
“Observability”?
IPPON 2019
Back to the future
1945
Abraham Wald
IPPON 2019
Abraham Wald
Bullet holes
IPPON 2019
Abraham Wald
Bullet holes
IPPON 2019
Abraham Wald
Wald noted that the study only considered the
aircraft that had survived their missions—the
bombers that had been shot down were not present
for the damage assessment.
The holes in the returning aircraft, then, represented
areas where a bomber could take damage and still
return home safely. Wald proposed that the Navy
instead reinforce the areas where the returning
aircraft were unscathed, since those were the areas
that, if hit, would cause the plane to be lost.
source: https://en.wikipedia.org/wiki/Abraham_Wald
IPPON 2019
Abraham Wald
Wald noted that the study only considered the
aircraft that had survived their missions—the
bombers that had been shot down were not present
for the damage assessment.
The holes in the returning aircraft, then, represented
areas where a bomber could take damage and still
return home safely. Wald proposed that the Navy
instead reinforce the areas where the returning
aircraft were unscathed, since those were the
areas that, if hit, would cause the plane to be
lost.
source: https://en.wikipedia.org/wiki/Abraham_Wald
IPPON 2019
Abraham Wald
Bullet holes
Recommended
area to reinforce
IPPON 2019
Back to the future
1945
Abraham Wald
2005
LAMP Stack
IPPON 2019
Solving questions?
Picture are loading slowly for some users. Why ?
(Lamp Stack)
App Tier capacity exceeded
IPPON 2019
Solving questions?
Pictures are loading slowly for some users. Why?
(LAMP Stack)
App Tier capacity exceeded
Connections to the database
are slower than normal,
causing connections to
timeout, and latency to rise
IPPON 2019
Monitoring
Watching out for
known failure
modes in the
system
e.g. Network I/O, CPU,
Memory Usage
IPPON 2019
Monitoring
Watching out for
known failure
modes in the
system
e.g. Network I/O, CPU,
Memory Usage
IPPON 2019
Back to the future
1945
Abraham Wald
2005
LAMP Stack
2016
Microservices
IPPON 2019
Scientific Graph
2005
2019
Infrastructure complexity over time
IPPON 2019
IPPON 2019
IPPON 2019
Observability definition
In control theory, observability is a measure of how well
internal states of a system can be inferred from knowledge
of its external outputs
Source: https://en.wikipedia.org/wiki/Observability
IPPON 2019
Known Success
IPPON 2019
Known SuccessKnown Error
IPPON 2019
Known Success
Known Unknowns
Known Error
IPPON 2019
Known Success
Known UnknownsUnknown Unknowns
Known Error
IPPON 2019
Known Success
Known UnknownsUnknown Unknowns
Known Error
Alert on
this
IPPON 2019
Known Success
Known UnknownsUnknown Unknowns
Known Error
INVISIBLE BULLETS
IPPON 2019
Known Success
Known UnknownsUnknown Unknowns
Known Error
Alert on the
absence of
this
IPPON 2019
Pillars of Observability
IPPON 2019
Datadog
IPPON 2019
Splunk
IPPON 2019
Serverless:
New challenges!
IPPON 2019
What is Serverless?
● No need to manage servers
● No need to even think about servers
● No need to provision infrastructure
● Pay only for what to use
● Use backend as a Service (BaaS)
● Deploy functions, not apps (FaaS)
● It’s event based/oriented
Well… It means no servers right?
IPPON 2019
Drawbacks
➔ Loss of Server optimizations
➔ Implementation drawbacks:
● Execution duration
● Startup latency
● Tests
● Packaging / versioning
IPPON 2019
No access to underlying OS
IPPON 2019
Nowhere to install agents / daemons
IPPON 2019
Higher concurrency to observability system
EC2
OBSERVABILITY
SYSTEM
(IaaS)
IPPON 2019
Higher concurrency to observability system
Lambda
Function
OBSERVABILITY
SYSTEM
(IaaS)
Function
Function
Function
Function
Function
Function
IPPON 2019
No background processing
OBSERVABILITY
SYSTEM
(IaaS)
Function
Invocation
Start
End
IPPON 2019
Complexity of interactions
IPPON 2019
Live Demo
Let’s do it!!
IPPON 2019
Our architecture
IPPON 2019
Datadog
SaaS product, created in 2010 by 2 French,
started as an Infrastructure Monitoring Tool
● system / application / business metrics
● distributed tracing
● log management
● browser testing and synthetics
● full grown alerting engine on top of that
A LOT of integrations, A LOT of opensource
code
IPPON 2018IPPON 2019
Questions?
(also we are HIRING!)
IPPON 2019
MERCI
https://github.com/stevehouel/lambda-correlation-id-demo
https://github.com/stevehouel/datadog-serverless-functions-metrics

Observability pillars applied to serverless