Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)

•

0 likes•94 views

Because observability is such a broad topic – and often something we learn on the job – it can feel like there’s too much to learn at once. But you don’t have to tackle everything and can start with the basics and build from there! Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack. No matter what tooling is in place, there are still observability fundamentals that developers should know. That’s why I’ve put together a primer on the different telemetry types, when to use them, how to understand the data journey, and what to look for in time series graphs.

Technology

@paigerduty
Observability
Concepts
EVERY
Developer
Should Know

@paigerduty
O11y
Knowledge
Gaps
10
Tool Sprawl

@paigerduty
O11y
Knowledge
Gaps
11
Tool Sprawl
Hidden
Processing

@paigerduty
O11y
Knowledge
Gaps
12
Tool Sprawl
No / Shallow
Onboarding
Hidden
Processing

@paigerduty
Auto-magic
O11y
Knowledge
Gaps
13
Tool Sprawl
Hidden
Processing
No / Shallow
Onboarding

@paigerduty 14
Image: smashingstocks on freepik

@paigerduty 15
Image: smashingstocks on freepik

@paigerduty
• Telemetry
Types
• Your Telemetry
Journey
• Interpreting
Visualizations 16
Key
Concepts

@paigerduty
Telemetry Types
18
Logs
Metrics
Traces
Events

@paigerduty
EVENTS
- Deployments
- Alerts
- Feature Flags
- Infrastructure Updates
20

@paigerduty
METRICS
21
- Rolling up
- Recording rules
- Deriving

@paigerduty
TRACES
- Sampling strategy
- Retention period
- Adding metadata
22

@paigerduty
LOGS
23
- Indexing
- Structuring
- Timezone alignment
- Querying unindexed
logs

@paigerduty 25
Scenario
The o11y bill is too high and Ops has
been asked to “ﬁx it ASAP”.....
You’ve identiﬁed the top contributing
services - who does the cleanup?

@paigerduty
Generate
28
Collect
Transform
Export
Store

@paigerduty
Generate
29
Collect
Transform
Export
Store

@paigerduty
Generate
30
Collect
Transform
Export
Store

@paigerduty
Generate
31
Collect
Transform
Export
Store

@paigerduty
Generate
32
Collect
Transform
Export
Store

@paigerduty 34
Scenario
Developer added some ﬁelds to their
logs but isn’t able to ﬁnd and query
them in their tooling. What gives??

@paigerduty
THE “HOW”
38
NYT “What’s Going On In This
Graph?”
Cognitive Apprenticeship SRECon

@paigerduty 39
Scenario
Developers keep blaming issues on “the
network” and your team is catching heat.
How do you move forward?

@paigerduty
- Slawek Ligus, Effective Monitoring and Alerting
41
Accept the reality —
the system as
perceived is not the
system as found

@paigerduty
O11y Knowledge Check
Where are all
the places I can
send data?
What is the
retention period for
logs? Metrics?
What metadata
(tags/labels) are
added
automatically?
How do we
sample
distributed
traces?
Add a main point
42
When and where are
aggregations applied to
metrics?

@paigerduty
Resources
43
Design for How People Learn
Julie Dirksen
Better Onboarding
Krystal Higgins
Software Telemetry
Jamie Riedesel

@paigerduty
Paige Cruz
@paigerduty
● O11y Concepts EVERY Dev
Should Know (blog)
● Open source o11y tutorials at
https://o11y-workshops.gitlab.io/
● Monitorama June 10-12
● Production Scavenger Hunt
44

@paigerduty
Credits
Special thanks to all the
people who made and
released these awesome
resources for free:
• Presentation template by
SlidesCarnival
• Photographs by Pexels
•
Happy designing!
45

Drupal 8 has a new powerful theming engine: TWIG. Twig is a powerful template engine that comes from the Symfony framework for theming. Either if you come from tpl.php files or are new to Drupal 8, there are some things you need to be aware of. Theming in Drupal 8 is way more than creating a template file and start building layouts. While Twig shows up as a solid foundation to build your themes on top of, there are many Drupal-specific features that are part of the actual "Drupal theming process" and it is not directly related to the template files.

Mythbusters: Content Edition

Elle Shelley

Dragana Đermanović, Biznis kao cirkus (onda kad mislimo da smo sve već vidjeli)

PRIME Communication

Everything I Know About Design Leadership I Learned Coaching Youth Baseball

FITC

Presented at FITC Toronto 2017 More info at http://fitc.ca/event/to17/ Albert Poon, Odopod Overview Process is a way of doing things and it’s important to establish a process and continuously refine it. But, in his years as a designer and a design leader, Albert has come to realize there is something far more important than process. It’s the most powerful force for great design over the long term. It’s people. And the *teams* they create and the *teams* they become working together. Today, Albert wants to share a few lessons about leading a team of designers. He didn’t learn these from a book, in a class, seminar, or even in the studio. He learned everything of practical value from wrangling young kids learning to play baseball. Objective If teams are the only way to achieve big, significant things, then it’s imperative that designers and budding design leaders think about leadership and team-building. The purpose of this presentation is to share ways of thinking about leadership that are suited to each person and each team’s strengths. Target Audience People who lead designers in projects. People who manage and build design teams. Five Things Audience Members Will Learn Accepting and thriving with responsibility, but no control Prioritizing the things that matter Positioning your team so it can be valuable Finding a way to succeed with the designers you have Building a culture that outlasts your superstars

You Built Something in VR. What Now? - Immersive Hack VR

Patrick Catanzariti

We are smack in the middle of a hype about AI and whilst we wonder if a robot will take our job tomorrow or a badly configured self-driving car will run us over we're forgetting that AI can be a great way for humans to deal with machines and interfaces. Let's use Natural Language Processing to allow for clever search boxes, Artificial Vision to create automatic alternative text and facial recognition for automatic tagging and collation. The clever bits of Facebook are now available to all of us as APIs. Let's help humans embrace the revolution that is deep learning by showing them the benefits

BrightonSEO July 2021: Spilling the T in EAT- Easy CRO Tricks for User Trust

Oliver Brett

Better Estimation and Planning

Gil Zilberfeld

New business models - social change for @SPARKdotme

Dragana Djermanovic

Self-Selection: A SAFe Approach to Forming Agile Release Trains

Em Campbell-Pretty

Presented on 2nd October 2019 at the Global SAFe Summit 2019. When it comes to shaping agile teams, many organisations use a leader decides model. The design of the teams is often a very delicate balancing act. Skills, experience, subject matter expertise and personalities all need to be factored in and the end result is often less than ideal. So, what if we took a different approach? What if we let the people who are going to be in the teams decide for themselves which mix of skills, experience, subject matter expertise and personalities are going to work best? In this session you will learn how Sandy Mamoli & David Mole's approach to self-selection (aka Squadification) has been used with SAFe to empower people to choose who they work with. This warts and all tale from the trenches will arm you to attempt your own self-selection workshop when launching or reshaping Agile Release Trains. Learning Objectives: Explain the value of using self-selection to create teams Identify where the standard self-selection guidance needs to be modified for SAFe Prepare for & facilitate a self-selection event

Partner or Perish by Jellybooks at Digital Book World 2014

Jellybooks Ltd

Random Play - Agile Midwest 2017

Emerson Taymor

Fighting the Dark Side of Data-Driven (Form, Function & Class Web Design Conf...

Angela Obias

These are the supporting slides from my talk on the watch-outs and potential perils of using data for design. The talk was for Form, Function & Class 6 - an annual web design conference. This year's theme was the fight for good design - and the talks ranged from web animation, by Rachel Nabors to design systems, by James Cabrera and Brad Frost. I'm a research practitioner and analyst. So although it may seem weird to present about the perils of data, I also want the design community to understand that having a lot of data doesn't mean that you'll get a "good" design. Something that I feel is critical for us to reflect on, at a time when popular opinion praises "user-centricity" and big data. FFC is organized by the Philippine Web Designers Organization.

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack. While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack. I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:

Power Up with Podman - Kubernetes Community Day LA

Paige Cruz

Curious about containers beyond Docker? There’s a new generation of containers on the scene, Podman! Supporting secure, rootless containers for Kubernetes microservices, it was designed and built with the cloud in mind. Benefitting from the lessons learned out in the open from Docker, this next generation of containers will quickly become a trusted daily driver in your dev workflow. Covering what you need to know as an end-user from the UI to the backend, sharing a real world use case leveraging Podman for open source observability workshops https://o11y-workshops.gitlab.io. Paige will share how Podman and the adorable seal mascots Caitlín, Maighréad and Róisín have transformed her local development!

99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf

Paige Cruz

Distributed tracing is still finding its footing in many organizations today, despite being an industry concept for 14 years! One challenge to overcome is managing the data volume. Keeping 100% of traces is expensive and unnecessary - enter sampling. From head-based, tail-based or mixing and matching there is a buffet of configuration options available with OpenTelemetry. Let’s review the tradeoffs associated with different sampling configurations and their impact to the cost and value of your tracing data.

OTel Orientation: How to Train Teams (OTel in Practice)

Paige Cruz

Avoiding Alert Bankruptcy and Burnout

Paige Cruz

The signal to noise ratio can be frustratingly high for on-call alerts and downright mystifying when joining a new company or rotation. If you treat PagerDuty like the boy who cried wolf you’ve certainly mired in monitoring debt. Monitoring debit is tragically common and with investment mitigatable! Just how much of a risk are false positives? The data shows that a high number of false alerts trains workers to assume most alerts will be false. Repetition of the same alerts causes even greater alert fatigue. For clinicians the likelihood of acknowledging an alert dropped 30% for each reminder. Paige will share the nuts and bolts of how to start auditing your own alerts to begin your journey towards an on-call oasis.

Tracing Adventures from PR - Production

Paige Cruz

Many things can go awry on the journey from pull request (PR) open to merge to production deployment. Issues can arise from the application code, layers of YAML configuration, underlying infrastructure or pipeline logic itself. How can distributed tracing and trace-derived metrics bring developers and operators together for troubleshooting paradise? I’ll unpack a deploy gone bad from both vantage points, gaining an empathy for the engineer who needs to deploy their changes and an ops engineer who is responsible for keeping the system up and running. With signals from OpenTelemetry I will show how increasing the observability of your deploy system can facilitate better collaboration and quicker troubleshooting.

Threat Modeling in the Cloud

Paige Cruz

Threat modeling is a key part of securing your cloud computing environment and is unique to each organization's people, practices and processes. Without a threat model you could end up going on wild goose chases and miss the forest for the trees. This talk will introduce the concept of threat modeling including how to get started, guiding questions and recap findings from the Argo Project Threat Model from 2021. Learn how and why to start threat modeling today!

There's No Place Like Production

Paige Cruz

There’s a reason “i test in prod” isn’t a cheeky take but a lived reality. And that reason is there is no place like production. Not local dev or staging or other environment. This became clear when I deployed a tiny config change that passed all checks, reviews and pre-production environments that triggered a SEV-1. Examining each step of the journey from PR to production I uncovered the snafu that had occurred (unsurprisingly it relates to overwriting key blocks on nested YAML files). I’ll share how difficult it was to reconstruct the chain of events in the system compared to the ideal case of a highly observable system and how to share your own incident learnings since we all test in prod!

Taming Feral DevOps

Paige Cruz

The misunderstanding that devops is a tool or team or role has tragically increased the gulf between developers and operators.If you have been unofficially on-call 24/7, toiled away in turmoil, managed initiatives across multiple silos sans project manager with a directive to “influence without authority”...surprise you have lived the contradiction that is feral devops! Consequences of letting this fester are: burn out, learned helplessness and missing out on the speed that happens when developers and operators communicate openly. Taming feral devops is a journey you can start by gathering feedback on the status quo, iterating on onboarding and training and holistically examining on-call health.Whether you’re an individual contributor, manager or leader you will find ideas to experiment with to “domesticate” devops in your organization

SRECon23 Cognitive Apprenticeship in Action_ Alert Triage Hour of Power

Paige Cruz

Cognitive apprenticeship is the philosophy that it is more effective to learn in context and real-world situations compared to following a tutorial in a sandboxed environment. In a nutshell it is “learning-through-guided-experience” and shines when teaching problem-solving processes experts use to handle complex tasks like say…investigating an alert by spelunking in production observability and monitoring data. Learn how Alert Triage Hour of Power became a can’t miss meeting of camaraderie and system surprises!

Pushing Observability Uphill - The Single “Pain” of Glass

Paige Cruz

For years tech companies have chased the fabled “single pane of glass” , the one observability tool to understand your system from north to south and east to west. Leafing through promo materials promising instant insights and seamless turnkey integrations you’d think increasing system observability is as easy as assembling a Lego set. In my experience chasing the “single pane of glass” translates to “pain in the ass”. Survey data supports this revealing the majority of engineers cite tool sprawl as a minor or non-existent problem despite relying on several tools. As alluring as the siren call of “single pane of glass” is, let's be practical and examine how to best observe systems across a myriad of tooling. From the telemetry buffet of metrics, events, traces and logs learn when to reach for which type and ways to bridge the gaps with links and enhance with context to free yourself from the fool’s errand of a “single pane of glass”.

Similar to Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)

Convergence 003 - Make the Leap Into Emerging Tech!

Patrick Catanzariti

Spice Up Your Teaching with Apps & Tools from A - Z

Janet Bianchini

Better Estimation and Planning

Gil Zilberfeld

Christian Heilmann - Building human interfaces powered by AI - Codemotion Ber...

Codemotion

BrightonSEO July 2021: Spilling the T in EAT- Easy CRO Tricks for User Trust

Oliver Brett

Better Estimation and Planning

Gil Zilberfeld

New business models - social change for @SPARKdotme

Dragana Djermanovic

Self-Selection: A SAFe Approach to Forming Agile Release Trains

Em Campbell-Pretty

Partner or Perish by Jellybooks at Digital Book World 2014

Jellybooks Ltd

Random Play - Agile Midwest 2017

Emerson Taymor

Fighting the Dark Side of Data-Driven (Form, Function & Class Web Design Conf...

Angela Obias

Similar to Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle) (11)

Convergence 003 - Make the Leap Into Emerging Tech!

Spice Up Your Teaching with Apps & Tools from A - Z

Better Estimation and Planning

Christian Heilmann - Building human interfaces powered by AI - Codemotion Ber...

BrightonSEO July 2021: Spilling the T in EAT- Easy CRO Tricks for User Trust

Better Estimation and Planning

New business models - social change for @SPARKdotme

Self-Selection: A SAFe Approach to Forming Agile Release Trains

Partner or Perish by Jellybooks at Digital Book World 2014

Random Play - Agile Midwest 2017

Fighting the Dark Side of Data-Driven (Form, Function & Class Web Design Conf...

More from Paige Cruz

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

Power Up with Podman - Kubernetes Community Day LA

Paige Cruz

99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf

Paige Cruz

OTel Orientation: How to Train Teams (OTel in Practice)

Paige Cruz

Avoiding Alert Bankruptcy and Burnout

Paige Cruz

Tracing Adventures from PR - Production

Paige Cruz

Threat Modeling in the Cloud

Paige Cruz

There's No Place Like Production

Paige Cruz

Taming Feral DevOps

Paige Cruz

SRECon23 Cognitive Apprenticeship in Action_ Alert Triage Hour of Power

Paige Cruz

Pushing Observability Uphill - The Single “Pain” of Glass

Paige Cruz

Power Up with Podman

Paige Cruz

Curious about containers? There’s a new generation of containers on the scene, Podman! Supporting secure, rootless containers for Kubernetes microservices, it was designed and built with the cloud in mind. Benefitting from the lessons learned out in the open from Docker, this next generation of containers will quickly become a trusted daily driver in your dev workflow. Covering what you need to know as an end-user from the UI to the backend, sharing a real world use case leveraging Podman for open source observability workshops https://o11y-workshops.gitlab.io. Paige will share how Podman and the adorable seal mascots Caitlín, Maighréad and Róisín have transformed her local development!

Intro to Instrumentation

Paige Cruz

* Who/What/Where/When/Why of openTelemetry * Demystifying observability terms (telemetry, instrumentation, cardinality, percentile, observability) * Nuts and Bolts of Instrumentation * Tour of the Sample App * Automatic instrumentation with openTelemetry * Explore OOTB response time metric on charts * Manually add a label to the metric and review new facets to query by * Explore an OOTB trace * Manually instrument and add a span and review new level of visibility

From Cardinal(ity) Sins to Cost-Efficient Metrics Aggregation

Paige Cruz

Are you collecting just about every metric under the sun and the kitchen sink too? Understanding the cost of collecting metrics and the usefulness of those metrics is the only way to scale in a cloud native world. You can’t get away with just collecting everything as you grow. How can you make decisions about what to collect, what to drop, what to aggregate while still being able to alert, triage, remediate? Gain immediate insights into high cost data (DPPS), when to drop time series data, and how to determine when the value of that data is at its lowest.

99.9% of Your Traces are Trash

Paige Cruz

3rd Wave Observability: Open or Bust

Paige Cruz

Today we are caught between the 2nd and 3rd waves of system observability - the proprietary approaches of the past are fading fast in favor of open source instrumentation. Pioneering projects like OpenTelemetry and Prometheus are leading the way providing a path for competitors to cooperate for the benefit of the community. Let's look back at the 3 waves of observability to understand how we got here, the vision for the future and ways you can join us for the journey to liberate telemetry for all!

More from Paige Cruz (16)

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Power Up with Podman - Kubernetes Community Day LA

99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf

OTel Orientation: How to Train Teams (OTel in Practice)

Avoiding Alert Bankruptcy and Burnout

Tracing Adventures from PR - Production

Threat Modeling in the Cloud

There's No Place Like Production

Taming Feral DevOps

SRECon23 Cognitive Apprenticeship in Action_ Alert Triage Hour of Power

Pushing Observability Uphill - The Single “Pain” of Glass

Power Up with Podman

Intro to Instrumentation

From Cardinal(ity) Sins to Cost-Efficient Metrics Aggregation

99.9% of Your Traces are Trash

3rd Wave Observability: Open or Bust

Recently uploaded

Communications Mining Series - Zero to Hero - Session 1

DianaGray10

This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered: • Communication Mining Overview • Why is it important? • How can it help today’s business and the benefits • Phases in Communication Mining • Demo on Platform overview • Q/A

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024

Neo4j

Removing Uninteresting Bytes in Software Fuzzing

Aftab Hussain

Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process. In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds. - These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Neo4j

Dr. Sean Tan, Head of Data Science, Changi Airport Group Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

91mobiles

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Aggregage

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Albert Hoitingh

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

Introduction to CHERI technology - Cybersecurity

mikeeftimakis1

20240607 QFM018 Elixir Reading List May 2024

Matthew Sinclair

Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx

nkrafacyberclub

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

James Anderson

Elizabeth Buie - Older adults: Are we really designing for our future selves?

Nexer Digital

GraphRAG is All You need? LLM & Knowledge Graph

Guy Korland

Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs. 1. Unifying Large Language Models and Knowledge Graphs: A Roadmap. https://arxiv.org/abs/2306.08302 2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs: https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/

20240605 QFM017 Machine Intelligence Reading List May 2024

Matthew Sinclair

Recently uploaded (20)

Communications Mining Series - Zero to Hero - Session 1

FIDO Alliance Osaka Seminar: Overview.pdf

PCI PIN Basics Webinar from the Controlcase Team

GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024

Removing Uninteresting Bytes in Software Fuzzing

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Securing your Kubernetes cluster_ a step-by-step guide to success !

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Monitoring Java Application Security with JDK Tools and JFR Events

Introduction to CHERI technology - Cybersecurity

20240607 QFM018 Elixir Reading List May 2024

Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx

Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...

Elizabeth Buie - Older adults: Are we really designing for our future selves?

GraphRAG is All You need? LLM & Knowledge Graph

20240605 QFM017 Machine Intelligence Reading List May 2024

Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)

1. @paigerduty Observability Concepts EVERY Developer Should Know

2. @paigerduty 2 SHOULD

3. @paigerduty 3 NEW GRAD

4. @paigerduty 4 NEW GRAD SR. DEV

5. @paigerduty 5 NEW GRAD SR. DEV STAFF

6. @paigerduty

7. @paigerduty

8. @paigerduty

9. @paigerduty O11y Knowledge Gaps 9

10. @paigerduty O11y Knowledge Gaps 10 Tool Sprawl

11. @paigerduty O11y Knowledge Gaps 11 Tool Sprawl Hidden Processing

12. @paigerduty O11y Knowledge Gaps 12 Tool Sprawl No / Shallow Onboarding Hidden Processing

13. @paigerduty Auto-magic O11y Knowledge Gaps 13 Tool Sprawl Hidden Processing No / Shallow Onboarding

14. @paigerduty 14 Image: smashingstocks on freepik

15. @paigerduty 15 Image: smashingstocks on freepik

16. @paigerduty • Telemetry Types • Your Telemetry Journey • Interpreting Visualizations 16 Key Concepts

17. @paigerduty Understand Telemetry Types

18. @paigerduty Telemetry Types 18 Logs Metrics Traces Events

19. @paigerduty 19

20. @paigerduty EVENTS - Deployments - Alerts - Feature Flags - Infrastructure Updates 20

21. @paigerduty METRICS 21 - Rolling up - Recording rules - Deriving

22. @paigerduty TRACES - Sampling strategy - Retention period - Adding metadata 22

23. @paigerduty LOGS 23 - Indexing - Structuring - Timezone alignment - Querying unindexed logs

24. @paigerduty THE “HOW” 24

25. @paigerduty 25 Scenario The o11y bill is too high and Ops has been asked to “ﬁx it ASAP”..... You’ve identiﬁed the top contributing services - who does the cleanup?

26. @paigerduty Follow Telemetry Journey

27. @paigerduty 27

28. @paigerduty Generate 28 Collect Transform Export Store

29. @paigerduty Generate 29 Collect Transform Export Store

30. @paigerduty Generate 30 Collect Transform Export Store

31. @paigerduty Generate 31 Collect Transform Export Store

32. @paigerduty Generate 32 Collect Transform Export Store

33. @paigerduty THE “HOW” 33

34. @paigerduty 34 Scenario Developer added some ﬁelds to their logs but isn’t able to ﬁnd and query them in their tooling. What gives??

35. @paigerduty Deciphering Visualizations

36. @paigerduty 36

37. @paigerduty 37

38. @paigerduty THE “HOW” 38 NYT “What’s Going On In This Graph?” Cognitive Apprenticeship SRECon

39. @paigerduty 39 Scenario Developers keep blaming issues on “the network” and your team is catching heat. How do you move forward?

40. @paigerduty NOW WHAT?

41. @paigerduty - Slawek Ligus, Effective Monitoring and Alerting 41 Accept the reality — the system as perceived is not the system as found

42. @paigerduty O11y Knowledge Check Where are all the places I can send data? What is the retention period for logs? Metrics? What metadata (tags/labels) are added automatically? How do we sample distributed traces? Add a main point 42 When and where are aggregations applied to metrics?

43. @paigerduty Resources 43 Design for How People Learn Julie Dirksen Better Onboarding Krystal Higgins Software Telemetry Jamie Riedesel

44. @paigerduty Paige Cruz @paigerduty ● O11y Concepts EVERY Dev Should Know (blog) ● Open source o11y tutorials at https://o11y-workshops.gitlab.io/ ● Monitorama June 10-12 ● Production Scavenger Hunt 44

45. @paigerduty Credits Special thanks to all the people who made and released these awesome resources for free: • Presentation template by SlidesCarnival • Photographs by Pexels • Happy designing! 45

Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)

Recommended

Recommended

More Related Content

Similar to Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)

Similar to Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle) (11)

More from Paige Cruz

More from Paige Cruz (16)

Recently uploaded

Recently uploaded (20)

Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)