SlideShare a Scribd company logo
1 of 18
Download to read offline
Observability in
serverless solutions
Foundational practices on instrumenting and
achieving the true potential of serverless
Leonardo Murillo
CTO @ Qwinix, Inc
Founder @ Cloud Native Architects, Inc
DevOps Institute Ambassador
About DevOps Institute
DevOps Institute’s mission is to advance the
human elements of DevOps by creating a safe
and interactive environment where our
members can network, gain knowledge, grow
their careers, support enterprise transformation
and celebrate professional achievements.
We connect and enable the global DevOps
community to drive change in the digital age. Become a professional member at
www.devopsinstitute.com
Learn how observability and monitoring for serverless
solutions enable organizations to achieve its huge
potential.
In this webinar we will share insights and actionable
advice on:
Agenda
○ The serverless advantage
○ Understanding the serverless mindset
○ Instrumenting distributed and ephemeral
systems
○ Observability as a basis for decision making
CTO @ Qwinix, Inc
Founder @ Cloud Native Architects, Inc
DevOps Institute Ambassador
Leonardo Murillo
Wide-ranging industry perspective, with over 20 years of experience
building technology and leading teams all the way from Startups to
Fortune 500s.
Passionate about cloud native technologies, organizational
transformation and the open-source community. A believer in human
potential and the transformative power of technology, Leo focuses on
exploring leading edge technologies hands-on and pondering on
technology strategy
leonardomurillo
murillodigital
The serverless advantage
https://www.oreilly.com/radar/oreilly-serverless-survey-2019-concerns-what-works-and-what-to-expect/
• Faster development
• Cost reduction
• Massively scalable
https://newrelic.com/resources/ebooks/serverless-benchmark-report-aws-lambda-2020
Lack of foundational
knowledge and expertise may
magnify otherwise small
issues
Data and systems design must
apply to the characteristics of
serverless, scale should be
effectively designed for, not
accidentally achieved.
Understanding and
troubleshooting your solution
during development and
production requires new skills
and workflows
Serverless requires a new mindset
https://www.oreilly.com/radar/oreilly-serverless-survey-2019-concerns-what-works-and-what-to-expect/
https://serverlessfirst.com/serverless-adoption-initial-survey-results/
Approaching serverless
Functions
as a Service!
Wait…
now we need to direct
requests to them
Huh…
Some of these are asynchronous
and driven by events, need a queue
Data…
We need to store some data
Ugh, static assets…
Let’s put them in some bucket
How to deliver assets?
Of course, we need a CDN
The performance and reliability of your
serverless solution depends on the interplay
between many moving parts
How do we troubleshoot a complex, distributed solution?
How do we extract the most performance out of infinite scale?
“Knowledge is power”
Observability
Instrumentation Observability Knowledge
Metrics Logs Traces
Context
Serverless telemetry requires a specific
approach
• Solution state is distributed across a variety of
systems.
• Many data sources mean many different schemas,
time series resolution and fragmented context.
• Resources are ephemeral, telemetry data must be
stored before transactions complete (usually in ms).
• Requests traverse many different services,
traceability becomes critical.
Serverless is the way to go, and you want to build observability into your solution
Foundational Practices for effective
serverless observability
Practice 1: Centralize your telemetry data, making
sure you can correlate, and that no data gets lost
Define and use
structured metadata
• correlation identifiers
• system identifiers
• request identifiers
• process milestone
• context, entity, domain
Push, don’t scrape
• producers of telemetry data are
ephemeral, scraping will usually result
in data loss due to scrape frequency vs
compute lifecycle
Practice 2: Leverage the native metrics
provided by cloud managed services
The cloud takes care of a lot of the system specific
heavy lifting, leverage the metrics provided
natively by the managed service.
Relate, cross-reference, augment – you are looking
for a strong query language for your telemetry data
and efficient ways to extract process-oriented
insights from it.
Practice 3: Integrated, holistic and global
visibility
It’s about processes, not systems - think holistically
Code path becomes request path, consider
all the components that participate in
fulfilling a given request and build insights
from their aggregated telemetry data
Single pane of glass – build dashboards on
top of your consolidated data.
Practice 4: Look for patterns to define your
alerts, not just finite state
• Performance related patterns
• Process related patterns
End to end request time to fulfillment
Queue growth over time
Data growth over time
Number of events involved in end-to-end request
Time to milestone
• Track cloud expense over time
for predictability and efficient
cost management
Practice 5: Use observability insight to define
guiderails, quotas, limits
Automate peace of mind
Liberate developers (safely)
Keep the CFO happy
Define concurrency and capacity limits
Alert on patterns before issues arise
Simplify troubleshooting and debugging
Enable autonomous provisioning safely
Efficient budget forecasting
Educated billing alerts
Continuous cost visibility
Key takeaways
Tracing is critically important
Don’t look at systems in isolation, think process
Enrich your telemetry with meaningful metadata
Use tooling that allows you to query and
integrate data effectively
Consolidate your telemetry data
Thank you!
Leonardo Murillo
CTO @ Qwinix, Inc
Founder @ Cloud Native Architects, Inc
DevOps Institute Ambassador
leonardo@murillodigital.com
murillodigital
https://www.linkedin.com/in/leonardomurillo/
https://www.murillodigital.com

More Related Content

What's hot

What’s The Big Deal About Hadoop?
What’s The Big Deal About Hadoop?What’s The Big Deal About Hadoop?
What’s The Big Deal About Hadoop?Dell World
 
TBSNetwork Provides IT Outsourcing Support & IT Managed Services
TBSNetwork Provides IT Outsourcing Support & IT Managed ServicesTBSNetwork Provides IT Outsourcing Support & IT Managed Services
TBSNetwork Provides IT Outsourcing Support & IT Managed ServicesTechnology Business Solutions
 
Barriers to mana
Barriers to manaBarriers to mana
Barriers to manaKarl Donert
 
Match AWS Pori - Rolf Koski - Cybercom
Match AWS Pori - Rolf Koski - CybercomMatch AWS Pori - Rolf Koski - Cybercom
Match AWS Pori - Rolf Koski - CybercomRolf Koski
 
Ea at connect the dots 10.2014
Ea at connect the dots 10.2014Ea at connect the dots 10.2014
Ea at connect the dots 10.2014kevin_donovan
 
January 2015 Webinar - Wins and Successes from 2014
January 2015 Webinar -  Wins and Successes from 2014January 2015 Webinar -  Wins and Successes from 2014
January 2015 Webinar - Wins and Successes from 2014RapidScale
 
Automation First as Strategy for Data Warehouse Modernization
Automation First as Strategy for Data Warehouse Modernization Automation First as Strategy for Data Warehouse Modernization
Automation First as Strategy for Data Warehouse Modernization WhereScape
 
Cloud computing
Cloud computingCloud computing
Cloud computingjhoejoe
 
Fast Data Flow Is the Secret to Accelerating Digital Transformation
Fast Data Flow Is the Secret to Accelerating Digital TransformationFast Data Flow Is the Secret to Accelerating Digital Transformation
Fast Data Flow Is the Secret to Accelerating Digital TransformationDelphix
 
Using a Service Oriented Architecture to Manage IT Sprawl
Using a Service Oriented Architecture to Manage IT SprawlUsing a Service Oriented Architecture to Manage IT Sprawl
Using a Service Oriented Architecture to Manage IT SprawlJeffrey Hurley
 
ePlus Managed Services
ePlus Managed ServicesePlus Managed Services
ePlus Managed ServicesePlus
 
The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...
The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...
The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...IDBS
 
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...Patrick Van Renterghem
 
DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...
DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...
DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...Gene Kim
 
Trust, security and privacy issues with cloud erp
Trust, security and privacy issues with cloud erpTrust, security and privacy issues with cloud erp
Trust, security and privacy issues with cloud erpHarshit Garg
 
Sneha Summary Resume Final
Sneha Summary Resume FinalSneha Summary Resume Final
Sneha Summary Resume FinalSneha Patel
 

What's hot (20)

What’s The Big Deal About Hadoop?
What’s The Big Deal About Hadoop?What’s The Big Deal About Hadoop?
What’s The Big Deal About Hadoop?
 
TBSNetwork Provides IT Outsourcing Support & IT Managed Services
TBSNetwork Provides IT Outsourcing Support & IT Managed ServicesTBSNetwork Provides IT Outsourcing Support & IT Managed Services
TBSNetwork Provides IT Outsourcing Support & IT Managed Services
 
Enabling Cloud Deployment
Enabling Cloud DeploymentEnabling Cloud Deployment
Enabling Cloud Deployment
 
Barriers to mana
Barriers to manaBarriers to mana
Barriers to mana
 
Match AWS Pori - Rolf Koski - Cybercom
Match AWS Pori - Rolf Koski - CybercomMatch AWS Pori - Rolf Koski - Cybercom
Match AWS Pori - Rolf Koski - Cybercom
 
Ea at connect the dots 10.2014
Ea at connect the dots 10.2014Ea at connect the dots 10.2014
Ea at connect the dots 10.2014
 
4.2.cloud storage
4.2.cloud storage4.2.cloud storage
4.2.cloud storage
 
January 2015 Webinar - Wins and Successes from 2014
January 2015 Webinar -  Wins and Successes from 2014January 2015 Webinar -  Wins and Successes from 2014
January 2015 Webinar - Wins and Successes from 2014
 
Automation First as Strategy for Data Warehouse Modernization
Automation First as Strategy for Data Warehouse Modernization Automation First as Strategy for Data Warehouse Modernization
Automation First as Strategy for Data Warehouse Modernization
 
Abiquo
AbiquoAbiquo
Abiquo
 
Presentation ppm ppt
Presentation ppm pptPresentation ppm ppt
Presentation ppm ppt
 
Cloud computing
Cloud computingCloud computing
Cloud computing
 
Fast Data Flow Is the Secret to Accelerating Digital Transformation
Fast Data Flow Is the Secret to Accelerating Digital TransformationFast Data Flow Is the Secret to Accelerating Digital Transformation
Fast Data Flow Is the Secret to Accelerating Digital Transformation
 
Using a Service Oriented Architecture to Manage IT Sprawl
Using a Service Oriented Architecture to Manage IT SprawlUsing a Service Oriented Architecture to Manage IT Sprawl
Using a Service Oriented Architecture to Manage IT Sprawl
 
ePlus Managed Services
ePlus Managed ServicesePlus Managed Services
ePlus Managed Services
 
The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...
The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...
The Evolution of Laboratory Data Systems: Replacing Paper, Streamlining Proce...
 
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
 
DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...
DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...
DOES SFO 2016 - Aimee Bechtle - Utilizing Distributed Dojos to Transform a Wo...
 
Trust, security and privacy issues with cloud erp
Trust, security and privacy issues with cloud erpTrust, security and privacy issues with cloud erp
Trust, security and privacy issues with cloud erp
 
Sneha Summary Resume Final
Sneha Summary Resume FinalSneha Summary Resume Final
Sneha Summary Resume Final
 

Similar to Observability in serverless solutions

DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015Shannon Lietz
 
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!Ezhilarasan Natarajan
 
Understanding The Cloud For Enterprise Businesses.
Understanding The Cloud For Enterprise Businesses. Understanding The Cloud For Enterprise Businesses.
Understanding The Cloud For Enterprise Businesses. Triaxil
 
Introduction to DevOps slides.pdf
Introduction to DevOps slides.pdfIntroduction to DevOps slides.pdf
Introduction to DevOps slides.pdfBoreVishnusai
 
DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...
DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...
DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...Turja Narayan Chaudhuri
 
ISACA Ireland Keynote 2015
ISACA Ireland Keynote 2015ISACA Ireland Keynote 2015
ISACA Ireland Keynote 2015Shannon Lietz
 
Sabre: Master Reference Data in the Large Enterprise
Sabre: Master Reference Data in the Large EnterpriseSabre: Master Reference Data in the Large Enterprise
Sabre: Master Reference Data in the Large EnterpriseOrchestra Networks
 
Unblocking Innovation for Digital Transformation
Unblocking Innovation for Digital TransformationUnblocking Innovation for Digital Transformation
Unblocking Innovation for Digital TransformationAmazon Web Services
 
The People Model and Cloud Transformation | AWS Public Sector Summit 2016
The People Model and Cloud Transformation | AWS Public Sector Summit 2016The People Model and Cloud Transformation | AWS Public Sector Summit 2016
The People Model and Cloud Transformation | AWS Public Sector Summit 2016Amazon Web Services
 
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)Amazon Web Services
 
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31TechSoup
 
Brighttalk understanding the promise of sde - final
Brighttalk   understanding the promise of sde - finalBrighttalk   understanding the promise of sde - final
Brighttalk understanding the promise of sde - finalAndrew White
 
The most trusted, proven enterprise-class Cloud:Closer than you think
The most trusted, proven enterprise-class Cloud:Closer than you think The most trusted, proven enterprise-class Cloud:Closer than you think
The most trusted, proven enterprise-class Cloud:Closer than you think Uni Systems S.M.S.A.
 
Cloud Governance & DevOps: Must-have Tools on Your Journey to Azure Cloud
Cloud Governance & DevOps: Must-have Tools on Your Journey to Azure CloudCloud Governance & DevOps: Must-have Tools on Your Journey to Azure Cloud
Cloud Governance & DevOps: Must-have Tools on Your Journey to Azure CloudPredica Group
 
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...Databricks
 
Tour de France Azure PaaS 5/7 Accélérer avec le DevOps
Tour de France Azure PaaS 5/7 Accélérer avec le DevOpsTour de France Azure PaaS 5/7 Accélérer avec le DevOps
Tour de France Azure PaaS 5/7 Accélérer avec le DevOpsAlex Danvy
 
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...Boston Data Engineering
 

Similar to Observability in serverless solutions (20)

DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015DevSecCon KeyNote London 2015
DevSecCon KeyNote London 2015
 
DevSecCon Keynote
DevSecCon KeynoteDevSecCon Keynote
DevSecCon Keynote
 
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
Understanding The Cloud For Enterprise Businesses, an eBook from Triaxil!
 
Understanding The Cloud For Enterprise Businesses.
Understanding The Cloud For Enterprise Businesses. Understanding The Cloud For Enterprise Businesses.
Understanding The Cloud For Enterprise Businesses.
 
Introduction to DevOps slides.pdf
Introduction to DevOps slides.pdfIntroduction to DevOps slides.pdf
Introduction to DevOps slides.pdf
 
DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...
DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...
DOIS22 Why you need Cloud-agnostic practices to fuel your DevSecOps adoption ...
 
ISACA Ireland Keynote 2015
ISACA Ireland Keynote 2015ISACA Ireland Keynote 2015
ISACA Ireland Keynote 2015
 
Sabre: Master Reference Data in the Large Enterprise
Sabre: Master Reference Data in the Large EnterpriseSabre: Master Reference Data in the Large Enterprise
Sabre: Master Reference Data in the Large Enterprise
 
Unblocking Innovation for Digital Transformation
Unblocking Innovation for Digital TransformationUnblocking Innovation for Digital Transformation
Unblocking Innovation for Digital Transformation
 
The People Model and Cloud Transformation | AWS Public Sector Summit 2016
The People Model and Cloud Transformation | AWS Public Sector Summit 2016The People Model and Cloud Transformation | AWS Public Sector Summit 2016
The People Model and Cloud Transformation | AWS Public Sector Summit 2016
 
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
AWS re:Invent 2016: Governance Strategies for Cloud Transformation (WWPS302)
 
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
 
Brighttalk understanding the promise of sde - final
Brighttalk   understanding the promise of sde - finalBrighttalk   understanding the promise of sde - final
Brighttalk understanding the promise of sde - final
 
resume4
resume4resume4
resume4
 
The most trusted, proven enterprise-class Cloud:Closer than you think
The most trusted, proven enterprise-class Cloud:Closer than you think The most trusted, proven enterprise-class Cloud:Closer than you think
The most trusted, proven enterprise-class Cloud:Closer than you think
 
Cloud Governance & DevOps: Must-have Tools on Your Journey to Azure Cloud
Cloud Governance & DevOps: Must-have Tools on Your Journey to Azure CloudCloud Governance & DevOps: Must-have Tools on Your Journey to Azure Cloud
Cloud Governance & DevOps: Must-have Tools on Your Journey to Azure Cloud
 
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...
 
Dev ops
Dev opsDev ops
Dev ops
 
Tour de France Azure PaaS 5/7 Accélérer avec le DevOps
Tour de France Azure PaaS 5/7 Accélérer avec le DevOpsTour de France Azure PaaS 5/7 Accélérer avec le DevOps
Tour de France Azure PaaS 5/7 Accélérer avec le DevOps
 
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
Boston Data Engineering: Designing and Implementing Data Mesh at Your Company...
 

Recently uploaded

Module-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdfModule-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdfManish Kumar
 
Main Memory Management in Operating System
Main Memory Management in Operating SystemMain Memory Management in Operating System
Main Memory Management in Operating SystemRashmi Bhat
 
CS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdfCS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdfBalamuruganV28
 
Gravity concentration_MI20612MI_________
Gravity concentration_MI20612MI_________Gravity concentration_MI20612MI_________
Gravity concentration_MI20612MI_________Romil Mishra
 
STATE TRANSITION DIAGRAM in psoc subject
STATE TRANSITION DIAGRAM in psoc subjectSTATE TRANSITION DIAGRAM in psoc subject
STATE TRANSITION DIAGRAM in psoc subjectGayathriM270621
 
Virtual memory management in Operating System
Virtual memory management in Operating SystemVirtual memory management in Operating System
Virtual memory management in Operating SystemRashmi Bhat
 
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...Sumanth A
 
Input Output Management in Operating System
Input Output Management in Operating SystemInput Output Management in Operating System
Input Output Management in Operating SystemRashmi Bhat
 
Python Programming for basic beginners.pptx
Python Programming for basic beginners.pptxPython Programming for basic beginners.pptx
Python Programming for basic beginners.pptxmohitesoham12
 
Turn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptxTurn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptxStephen Sitton
 
Cost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based questionCost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based questionSneha Padhiar
 
KCD Costa Rica 2024 - Nephio para parvulitos
KCD Costa Rica 2024 - Nephio para parvulitosKCD Costa Rica 2024 - Nephio para parvulitos
KCD Costa Rica 2024 - Nephio para parvulitosVictor Morales
 
priority interrupt computer organization
priority interrupt computer organizationpriority interrupt computer organization
priority interrupt computer organizationchnrketan
 
CME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTES
CME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTESCME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTES
CME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTESkarthi keyan
 
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdfDEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdfAkritiPradhan2
 
"Exploring the Essential Functions and Design Considerations of Spillways in ...
"Exploring the Essential Functions and Design Considerations of Spillways in ..."Exploring the Essential Functions and Design Considerations of Spillways in ...
"Exploring the Essential Functions and Design Considerations of Spillways in ...Erbil Polytechnic University
 
Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...
Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...
Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...Erbil Polytechnic University
 
『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书
『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书
『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书rnrncn29
 
Secure Key Crypto - Tech Paper JET Tech Labs
Secure Key Crypto - Tech Paper JET Tech LabsSecure Key Crypto - Tech Paper JET Tech Labs
Secure Key Crypto - Tech Paper JET Tech Labsamber724300
 
SOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATIONSOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATIONSneha Padhiar
 

Recently uploaded (20)

Module-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdfModule-1-(Building Acoustics) Noise Control (Unit-3). pdf
Module-1-(Building Acoustics) Noise Control (Unit-3). pdf
 
Main Memory Management in Operating System
Main Memory Management in Operating SystemMain Memory Management in Operating System
Main Memory Management in Operating System
 
CS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdfCS 3251 Programming in c all unit notes pdf
CS 3251 Programming in c all unit notes pdf
 
Gravity concentration_MI20612MI_________
Gravity concentration_MI20612MI_________Gravity concentration_MI20612MI_________
Gravity concentration_MI20612MI_________
 
STATE TRANSITION DIAGRAM in psoc subject
STATE TRANSITION DIAGRAM in psoc subjectSTATE TRANSITION DIAGRAM in psoc subject
STATE TRANSITION DIAGRAM in psoc subject
 
Virtual memory management in Operating System
Virtual memory management in Operating SystemVirtual memory management in Operating System
Virtual memory management in Operating System
 
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...
 
Input Output Management in Operating System
Input Output Management in Operating SystemInput Output Management in Operating System
Input Output Management in Operating System
 
Python Programming for basic beginners.pptx
Python Programming for basic beginners.pptxPython Programming for basic beginners.pptx
Python Programming for basic beginners.pptx
 
Turn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptxTurn leadership mistakes into a better future.pptx
Turn leadership mistakes into a better future.pptx
 
Cost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based questionCost estimation approach: FP to COCOMO scenario based question
Cost estimation approach: FP to COCOMO scenario based question
 
KCD Costa Rica 2024 - Nephio para parvulitos
KCD Costa Rica 2024 - Nephio para parvulitosKCD Costa Rica 2024 - Nephio para parvulitos
KCD Costa Rica 2024 - Nephio para parvulitos
 
priority interrupt computer organization
priority interrupt computer organizationpriority interrupt computer organization
priority interrupt computer organization
 
CME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTES
CME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTESCME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTES
CME 397 - SURFACE ENGINEERING - UNIT 1 FULL NOTES
 
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdfDEVICE DRIVERS AND INTERRUPTS  SERVICE MECHANISM.pdf
DEVICE DRIVERS AND INTERRUPTS SERVICE MECHANISM.pdf
 
"Exploring the Essential Functions and Design Considerations of Spillways in ...
"Exploring the Essential Functions and Design Considerations of Spillways in ..."Exploring the Essential Functions and Design Considerations of Spillways in ...
"Exploring the Essential Functions and Design Considerations of Spillways in ...
 
Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...
Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...
Comparative study of High-rise Building Using ETABS,SAP200 and SAFE., SAFE an...
 
『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书
『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书
『澳洲文凭』买麦考瑞大学毕业证书成绩单办理澳洲Macquarie文凭学位证书
 
Secure Key Crypto - Tech Paper JET Tech Labs
Secure Key Crypto - Tech Paper JET Tech LabsSecure Key Crypto - Tech Paper JET Tech Labs
Secure Key Crypto - Tech Paper JET Tech Labs
 
SOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATIONSOFTWARE ESTIMATION COCOMO AND FP CALCULATION
SOFTWARE ESTIMATION COCOMO AND FP CALCULATION
 

Observability in serverless solutions

  • 1. Observability in serverless solutions Foundational practices on instrumenting and achieving the true potential of serverless Leonardo Murillo CTO @ Qwinix, Inc Founder @ Cloud Native Architects, Inc DevOps Institute Ambassador
  • 2. About DevOps Institute DevOps Institute’s mission is to advance the human elements of DevOps by creating a safe and interactive environment where our members can network, gain knowledge, grow their careers, support enterprise transformation and celebrate professional achievements. We connect and enable the global DevOps community to drive change in the digital age. Become a professional member at www.devopsinstitute.com
  • 3. Learn how observability and monitoring for serverless solutions enable organizations to achieve its huge potential. In this webinar we will share insights and actionable advice on: Agenda ○ The serverless advantage ○ Understanding the serverless mindset ○ Instrumenting distributed and ephemeral systems ○ Observability as a basis for decision making CTO @ Qwinix, Inc Founder @ Cloud Native Architects, Inc DevOps Institute Ambassador Leonardo Murillo Wide-ranging industry perspective, with over 20 years of experience building technology and leading teams all the way from Startups to Fortune 500s. Passionate about cloud native technologies, organizational transformation and the open-source community. A believer in human potential and the transformative power of technology, Leo focuses on exploring leading edge technologies hands-on and pondering on technology strategy leonardomurillo murillodigital
  • 4. The serverless advantage https://www.oreilly.com/radar/oreilly-serverless-survey-2019-concerns-what-works-and-what-to-expect/ • Faster development • Cost reduction • Massively scalable https://newrelic.com/resources/ebooks/serverless-benchmark-report-aws-lambda-2020
  • 5. Lack of foundational knowledge and expertise may magnify otherwise small issues Data and systems design must apply to the characteristics of serverless, scale should be effectively designed for, not accidentally achieved. Understanding and troubleshooting your solution during development and production requires new skills and workflows Serverless requires a new mindset
  • 7. Approaching serverless Functions as a Service! Wait… now we need to direct requests to them Huh… Some of these are asynchronous and driven by events, need a queue Data… We need to store some data Ugh, static assets… Let’s put them in some bucket How to deliver assets? Of course, we need a CDN The performance and reliability of your serverless solution depends on the interplay between many moving parts
  • 8. How do we troubleshoot a complex, distributed solution? How do we extract the most performance out of infinite scale? “Knowledge is power”
  • 10. Serverless telemetry requires a specific approach • Solution state is distributed across a variety of systems. • Many data sources mean many different schemas, time series resolution and fragmented context. • Resources are ephemeral, telemetry data must be stored before transactions complete (usually in ms). • Requests traverse many different services, traceability becomes critical.
  • 11. Serverless is the way to go, and you want to build observability into your solution Foundational Practices for effective serverless observability
  • 12. Practice 1: Centralize your telemetry data, making sure you can correlate, and that no data gets lost Define and use structured metadata • correlation identifiers • system identifiers • request identifiers • process milestone • context, entity, domain Push, don’t scrape • producers of telemetry data are ephemeral, scraping will usually result in data loss due to scrape frequency vs compute lifecycle
  • 13. Practice 2: Leverage the native metrics provided by cloud managed services The cloud takes care of a lot of the system specific heavy lifting, leverage the metrics provided natively by the managed service. Relate, cross-reference, augment – you are looking for a strong query language for your telemetry data and efficient ways to extract process-oriented insights from it.
  • 14. Practice 3: Integrated, holistic and global visibility It’s about processes, not systems - think holistically Code path becomes request path, consider all the components that participate in fulfilling a given request and build insights from their aggregated telemetry data Single pane of glass – build dashboards on top of your consolidated data.
  • 15. Practice 4: Look for patterns to define your alerts, not just finite state • Performance related patterns • Process related patterns End to end request time to fulfillment Queue growth over time Data growth over time Number of events involved in end-to-end request Time to milestone • Track cloud expense over time for predictability and efficient cost management
  • 16. Practice 5: Use observability insight to define guiderails, quotas, limits Automate peace of mind Liberate developers (safely) Keep the CFO happy Define concurrency and capacity limits Alert on patterns before issues arise Simplify troubleshooting and debugging Enable autonomous provisioning safely Efficient budget forecasting Educated billing alerts Continuous cost visibility
  • 17. Key takeaways Tracing is critically important Don’t look at systems in isolation, think process Enrich your telemetry with meaningful metadata Use tooling that allows you to query and integrate data effectively Consolidate your telemetry data
  • 18. Thank you! Leonardo Murillo CTO @ Qwinix, Inc Founder @ Cloud Native Architects, Inc DevOps Institute Ambassador leonardo@murillodigital.com murillodigital https://www.linkedin.com/in/leonardomurillo/ https://www.murillodigital.com