Logging, Instrumentation, Dashboards and Alerts - for developers

•Download as PPTX, PDF•

0 likes•180 views

An introduction into monitoring & logging, for developers. Some theory, a discussion of what to monitor and what not and getting started implementing monitoring & logging using Microsoft Azure

Software

Logging
Instrumentation
Dashboards
Alerts
- for developers

WONDERING WHO
IS THAT GUY?
HENRY BEEN
Independent Devops & Azure Architect
E: consultancy@henrybeen.nl
T: @henry_been
L: linkedin.com/in/henrybeen
W: henrybeen.nl

Very boring part
Pretty boring part
Maybe boring part
Amazing part
Really amazing part
Mindblowing part
LOGGING, INSTRUMENTATION, DASHBOARDS & ALERTS

A bit of monitoring theory
What to monitor
Demo’s!
LOGGING, INSTRUMENTATION, DASHBOARDS, ALERTS

MONITORING
-or-
KNOWING WHAT BE HAPPENING

Instrumentation
Most often forgotten
Concerned with metrics
• (Timestamp, value) tuples
• Events & values
• Dimensions
• Used for Dashboards & Alerts
Rolled up over time
Logging
Often combined with tracing
Concerned with state changes
• When
• By who
• What changed
• Can a source of metrics
Retained for longer or indefinitly
Tracing
Used for troubleshooting
What we developers call logging
• When
• Code location
• Very, very verbose message
• Can a source of metrics
Retained for a limited time
MONITORING

VM / container
Timeseries
Database
Application Instance Agent
SDK
Logging
Database
Https endpoint
Visualization Engine
Your Dashboards
Query Engine
Your Alerts
Streaming Data Engine

BUT HEY THAT STUFF
IS OPERATIONS…
WHY WOULD I CARE?

• DevOps is the union of people,
process, and products to enable
continuous delivery of value to
your end users.
“
”
DEVOPS

OKAY, OKAY I CARE…
NOW, WHAT TO MONITOR?

OKAY, OKAY I CARE…
NOW, WHAT NOT TO MONITOR?

WHAT NOT TO DO
FOCUS ON AVERAGES
Averages are lying cheats and hide real issues!
• Use dimensions to find outliers
• Use maximums or percentiles to identify spread
FOCUS ON YOUR SYSTEMS
Do you think your users care? At all?
• Is the amount of disk IO really interesting?
• Does page file usage predict conversion?
To add some nuance:
- Some system metrics are handy, just don’t start there maybe
- Same goes for averages

0
20
40
60
80
100
120
Database load(%)
DO WE HAVE AN ISSUE?
Proposed alert

ARE MY USERS HAPPY?
0
20
40
60
80
100
120
140
160
Average response time

0
200
400
600
800
1000
1200
Average response time and maximum response time
Average response time Maximum response time
ARE MY USERS HAPPY?

0
100
200
300
400
500
600
700
800
900
Average response time and response time per operation
Average response time View item AddToBasket
ARE MY USERS HAPPY?

MEASURE THINGS
THE USER CARES ABOUT
AND THINK IT THROUGH!

FOR THOSE USING AZURE
HOW WOULD YOU DO IT?

AddTodo
DeleteTodo
CompleteTodo
UncompleteTodo
GetAllTodos
AddTodoProcessor
DeleteTodoProcessor
CompleteTodoProcessor
UncompleteTodoProcessor IsFeatureFlagEnabled
SQL Database

Two more things
“YOU CAN USE THE DEMOS!”
“AND YOU CAN USE THE DEMOS!”
“EVERYBODY CAN USE THE DEMOS!”
DASHBOARDS
AND ALERTS
AS CODE

DO TRY THIS AT HOME!
HENRY BEEN
Independent Devops & Azure Architect
E: consultancy@henrybeen.nl
T: @henry_been
L: linkedin.com/in/henrybeen
W: henrybeen.nl

What's hot

Humans by the hundred (DevOps Days Ohio)

Yelp Engineering

Humans by the hundred

Yelp Engineering

Monte Carlo presentation for FM

Wm. Hunter Tammaro

Limiting WIP - Music City Tech 2021

Wm. Hunter Tammaro

BA World Boston: Evening the Odds with Monte Carlo Project Forecasting

Wm. Hunter Tammaro

Building a slack bot

Jason Loeffler

If your site were one second slower, how many of your visitors would bounce? If your site were one second faster, how many additional orders would you receive? Bottom line: Do you know what one second of latency is worth to your business? Traditional approaches to performance monitoring are fatally flawed. They measure performance only in a silo, telling you how long key actions took but not putting that information into a context you can use to improve the one metric that ultimately matters: revenue. Bridging this gap requires the collection of performance and business data together, and then analyzing this data using the proper analytic methods. Using modern Real User Monitoring (RUM) techniques, Buddy Brewer will show you how to quantify the impact even one second of latency has on key business metrics like bounce and conversion rate.

How to measure the business impact of web performance

SOASTA

Neptune : Re-thinking Incident Response Automation

Kiran Gollu

Predictability: No Magic Required Julia Wester, Improvement Coach, LeanKit When you merge onto a freeway and are stuck in bumper-to-bumper traffic, you know right away that its going to be a long trip. Similarly, you can predict the cycle time of your work before it is finished without time consuming, and often incorrect, estimation. Sound like magic? Fortunately for all of us, it's not. This talk explains the basics of queueing theory; demonstrates how allocation models and pull policies affect the cycle time of work; discusses the effects of batch size and variability on queues; and teaches how to successfully monitor your workflow to get leading indicators of effectiveness. With this information, you'll be doing better forecasting, and achieving better outcomes, in no time!

DOES SFO 2016 San Francisco - Julia Wester - Predictability: No Magic Required

Gene Kim

In this video webinar recording, Garland discusses best practices for working with Virtual Assistants. If you would like to hire a virtual assistant trained and mentored by Garland, visit https://captaintime.com/virtual-assistant-tasks-outsourcing/ If you are a virtual assistant looking for training and mentoring, visit https://captaintime.com/va-mentorship-program/ Grab $75 off Garland's one-on-one time management coaching at this link: https://www.paypal.com/cgi-bin/webscr?cmd=_s-xclick&hosted_button_id=Z3VSW7JS6A8RN Connect with Garland: -------------------------------- Online School: http://courses.captaintime.com Blog: http://captaintime.com Twitter: http://twitter.com/ebusinesstutor Facebook: https://www.facebook.com/ebusinesstutor LinkedIn: https://ca.linkedin.com/in/ebusinesst... Email: http://www.subscribepage.com/t4p2y8

How to Work with a Virtual Assistant

Garland Coulson

The Atlassian Bug Bounty Program

Atlassian

Learning to be a lean startup

anickelsen

Invoice reading made simple

Rob Camerlink

Site reliability engineering - Lightning Talk

Michae Blakeney

What's hot (14)

Humans by the hundred (DevOps Days Ohio)

Humans by the hundred

Monte Carlo presentation for FM

Limiting WIP - Music City Tech 2021

BA World Boston: Evening the Odds with Monte Carlo Project Forecasting

Building a slack bot

How to measure the business impact of web performance

Neptune : Re-thinking Incident Response Automation

DOES SFO 2016 San Francisco - Julia Wester - Predictability: No Magic Required

How to Work with a Virtual Assistant

The Atlassian Bug Bounty Program

Learning to be a lean startup

Invoice reading made simple

Site reliability engineering - Lightning Talk

Similar to Logging, Instrumentation, Dashboards and Alerts - for developers

To point and click our way through a SharePoint installation is relatively easy, but what about all the other 'stuff' that we might not have considered? These slides are from Andy Talbot's MetaVis webinar for a detailed discussion on building SharePoint platforms fit for enterprise customers. In this webinar, Andy talked about some of the common challenges that can take some enterprises by surprise, factors that we should have planned for, and common failure points. Attendees should have benefited from this discussion regardless if they were starting out with their deployment, or already in production.

Building SharePoint Enterprise Platforms - Off the beaten path

Andy Talbot

Unified IT Monitoring: Beautiful Dashboards vs. Deep Reporting - What’s More ...

uptime software

Building SharePoint Enterprise Platforms - Off the beaten path - SharePoint S...

Andy Talbot

Oracle Management Cloud provides seven services that collect metrics and logging from all tiers in the stack and from clouds and on premises systems alike and provide various levels of insight in what is going on or what went on. To find performance bottlenecks, browser incompatibilities, application health issues, infrastructure problems at runtime , OMC provides dasboards, alerting, synthetic tests and log watchers. This presentation gives an overview of OMC, highlights some key features and describes how AMIS got started with APM, Log Analytics and Infrastructure Monitoring.

Oracle Management Cloud - introduction, overview and getting started (AMIS, 2...

Lucas Jellema

Event logs provide valuable information to troubleshoot operational errors, and investigate potential security exposures. They are literally the bread crumbs of the IT world. As a result, a commonly-used approach is to collect logs from everything connected to the network "just in case" without thinking about what data is actually useful. But, as you're likely aware, the "collect everything" approach can actually make threat detection and incident response more difficult as you wade through massive amounts of irrelevant data. Join us for this session to learn practical strategies for defining what you actually need to collect (and why) to help you improve threat detection and incident response, and satisfy compliance requirements. In this session, you'll learn : *What log data you always need to collect and why *Best practices for network, perimeter and host monitoring *Key capabilities to ensure easy, reliable access to logs for incident response efforts *How to use event correlation to detect threats and add valuable context to your logs

How to Leverage Log Data for Effective Threat Detection

AlienVault

Movin’ On Up - A #SharePoint Migration Case Study #HSPUG

Jim Adcock

10 things you should know before rolling out Tableau to the enterprise, including dashboard design best practices. View the webinar recording at: http://www.senturus.com/resources/rolling-out-tableau-to-the-enterprise/ Senturus, a business analytics consulting firm, has a resource library with hundreds of free recorded webinars, trainings, demos and unbiased product reviews. Take a look and share them with your colleagues and friends: http://www.senturus.com/resources/.

Rolling Out Tableau to the Enterprise

Senturus

Movin’ On Up - SP Engage Oct 2015

Jim Adcock

Metrics & more

Stefan Thies

Do you need Ops in your new startup? If not now, then when? And...what is Ops? Learn how to scale ruby-based distributed software infrastructure in the cloud to serve 4,000 requests per second, handle 400 updates per second, and achieve 99.97% uptime – all while building the product at the speed of light. Unimpressed? Now try doing the above altogether without the Ops team, while growing your traffic 100x in 6 months and deploying 5-6 times a day! It could be a dream, but luckily it's a reality that could be yours.

Dev Ops without the Ops

Konstantin Gredeskoul

SharePoint Engage Phoenix 2017 Our SharePoint environment is a lot like many others – a SharePoint 2007 implementation that was used more as a file dump than a collaboration space. With minimal user adoption, we were never quite ready to implement 2010, with a pilot SharePoint 2010 implementation stalled out of the gate. In the meantime, some content was put on Box and other services to address external collaboration needs. Business users needed more relevant search results, content databases had grown uncomfortably large, and access controls had become spaghetti. Fortunately, site sprawl wasn’t too bad… except that the reason for that was the low adoption. SharePoint 2013 arrived to a perfect storm – business and technology needs to be addressed, content that needs to be brought back in-house, and user adoption that needs to be improved. Time to upgrade! See how we approached the upgrade, the issues than needed to be addressed, and the questions that needed to be answered.

Movin on Up - SPEngage Phoenix 2017

Jim Adcock

Augmenting MySQL with NoSQL options - Data Lifecycles

David Murphy

Jeremy Engle's slides from Redshift / Big Data meetup on July 13, 2017

AWS Chicago

Monitoring means many things to many people. This talk looks at Systems Monitoring, that is how to keep an eye on a given system and use this as part of overall management of a system. This talk will cover Why one monitors, What to monitor, How to monitor, the general design of a monitoring system and how Prometheus is a good fit for this in terms of instrumentation, consoles, alerts, general system health and sanity. Prometheus is a next-generation monitoring system publicly announced earlier this year, developed by companies including SoundCloud, locals Boxever and Docker. Since launch there has been wide-spread interest, and many community contributions. For more information see http://prometheus.io or http://www.boxever.com/tag/monitoring

Systems Monitoring with Prometheus (Devops Ireland April 2015)

Brian Brazil

Role of-analytics-in-db as-life

Navneet Upneja

The Logentries and Hosted Graphite integration allows you to connect two of your favorite Ops tools to easily extract important data from your log files, visualize them as metrics, and share them in Hosted Graphite dashboards. • Integrate your systems to extract the metrics you need, from both your applications and log data. • Set-up log metric dashboards based on common use cases (e.g. error tracking, performance, app usage). • Get off the "complexity elevator" of hosting your own in-house logging or graphite solutions. • Delight your team and organization with valuable metrics and performance insights.

Correlate Log Data with Business Metrics Like a Jedi

Trevor Parsons

All the content of this website is informative and non-commercial, does not imply a commitment to develop, launch or schedule delivery of any feature or functionality, should not rely on it in making decisions, incorporate or take it as a reference in a contract or academic matters. Likewise, the use, distribution and reproduction by any means, in whole or in part, without the authorization of the author and / or third-party copyright holders, as applicable, is prohibited.

SRE Organizational Framework

Olaf Reitmaier Veracierta

Building enterprise platforms - off the beaten path - SharePoint User Group U...

Andy Talbot

Securing your environment requires an understanding of the current and evolving threat landscape as well as knowledge of network technology and system design. This session will combine lecture, demo and interactive Q/A that will highlight how to build out a security plan to defend against today’s threats. Join AlienVault for this webinar to learn: • What network, system and host data you should be collecting for the quickest path to security visibility • Best practices for network, perimeter and host monitoring • Security advantages of new AlienVault Threat Alerts coming soon to SpiceWorks

SpiceWorks Webinar: Whose logs, what logs, why logs

AlienVault

Atlassian’s acquisition of Opsgenie peaked organizations' interest in integrating these technologies into a powerful DevOps solution. While these integrations are currently available to cloud users only, there are still innovative ways to tap into capabilities and integrate product such as Jira Cloud, Jira Software, Jira Service Desk, Opsgenie and other 3rd party apps into a powerhouse DevOps solution. In the cloud or behind the firewall. Learn more about these integrations and explore some fresh ideas, new use cases you can implement right now, combined with instructive hands-on examples.

Atlassian Based DevOps Command Center: Adding Opsgenie to the Powerful Mix!

Cprime

Similar to Logging, Instrumentation, Dashboards and Alerts - for developers (20)

Building SharePoint Enterprise Platforms - Off the beaten path

Unified IT Monitoring: Beautiful Dashboards vs. Deep Reporting - What’s More ...

Building SharePoint Enterprise Platforms - Off the beaten path - SharePoint S...

Oracle Management Cloud - introduction, overview and getting started (AMIS, 2...

How to Leverage Log Data for Effective Threat Detection

Movin’ On Up - A #SharePoint Migration Case Study #HSPUG

Rolling Out Tableau to the Enterprise

Movin’ On Up - SP Engage Oct 2015

Metrics & more

Dev Ops without the Ops

Movin on Up - SPEngage Phoenix 2017

Augmenting MySQL with NoSQL options - Data Lifecycles

Jeremy Engle's slides from Redshift / Big Data meetup on July 13, 2017

Systems Monitoring with Prometheus (Devops Ireland April 2015)

Role of-analytics-in-db as-life

Correlate Log Data with Business Metrics Like a Jedi

SRE Organizational Framework

Building enterprise platforms - off the beaten path - SharePoint User Group U...

SpiceWorks Webinar: Whose logs, what logs, why logs

Atlassian Based DevOps Command Center: Adding Opsgenie to the Powerful Mix!

More from Henry Been

Henry been azure resource manager - inside out

Henry Been

Do you still store secrets in source control? Are your secrets safely stored, but are you struggling to distribute them to your applications? Do you feel this should be easy, but you can’t just find out how? In this session, Henry will take you on a journey that starts with passwords in source control. From there he will quickly take you along on a series of improvements to make both local development and production deployments more and more secure with every change. Along the way, you will learn how to use Azure Key Vault, Azure Active Directory (AAD) and App Service Managed Instance to get everyone on a need to know basis. Finally, you will see how forgetting about keys, certificates and passwords completely and just using AAD could solve all your problems. That is.., if everyone would just use AAD!

Henry Been - Secure development: keeping your application secrets private

Henry Been

Serverless computing henry been - continuous deployment of azure functions

Henry Been

Cloud brew cloudcamp

Henry Been

Secure deployments keeping your application secrets private -duug fest

Henry Been

Secure deployments keeping your application secrets private - condensed

Henry Been

Writing, build and releasing your own vsts extension

Henry Been

Continuous delivery for the it pro

Henry Been

Focus on business value by going Serverless

Henry Been

To create an application that is truly designed for massive scale, scale-out at every level of the solution is needed. While doing so at the services level, many developers are still using a single database to serve every request. In response to this, a new pattern, database-per-tenant, is emerging. In this pattern, all data is distributed over a large number of databases. In this session Henry will explore this pattern in detail, covering its advantages and disadvantages and a number of common scenarios around such an architecture.

Henry been database-per-tenant with 50k databases

Henry Been

Henry been - Multi-tenant applications using 30k databases

Henry Been

More from Henry Been (11)

Henry been azure resource manager - inside out

Henry Been - Secure development: keeping your application secrets private

Serverless computing henry been - continuous deployment of azure functions

Cloud brew cloudcamp

Secure deployments keeping your application secrets private -duug fest

Secure deployments keeping your application secrets private - condensed

Writing, build and releasing your own vsts extension

Continuous delivery for the it pro

Focus on business value by going Serverless

Henry been database-per-tenant with 50k databases

Henry been - Multi-tenant applications using 30k databases

Recently uploaded

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

WSO2

AI/ML Infra Meetup May. 23, 2024 Organized by Alluxio For more Alluxio Events: https://www.alluxio.io/events/ Speaker: - Junchen Jiang (Assistant Professor of Computer Science, @University of Chicago) Prefill in LLM inference is known to be resource-intensive, especially for long LLM inputs. While better scheduling can mitigate prefill’s impact, it would be fundamentally better to avoid (most of) prefill. This talk introduces our preliminary effort towards drastically minimizing prefill delay for LLM inputs that naturally reuse text chunks, such as in retrieval-augmented generation. While keeping the KV cache of all text chunks in memory is difficult, we show that it is possible to store them on cheaper yet slower storage. By improving the loading process of the reused KV caches, we can still significantly speed up prefill delay while maintaining the same generation quality.

AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG

Alluxio, Inc.

Migrating your customer service data from Gorgias to Re:amaze can greatly enhance your support operations, but it requires detailed planning and precise execution. "A Guideline to Gorgias to Re:amaze Data Migration" is crafted to help businesses manage this transition smoothly and efficiently. This comprehensive guide ensures that all aspects of the data migration process are covered, from initial planning to post-migration support.

A Guideline to Gorgias to to Re:amaze Data Migration

Help Desk Migration

Studiovity film pre-production and screenwriting software

info611746

INGKA DIGITAL: Linked Metadata by Design

Neo4j

APVP,apvp apvp High quality supplier safe spot transport, 98% purity

amy56318795

Skilrock is an igaming technology platform & lottery software provider to the Global Lottery & Gaming Industry with a strong presence across continents. As part of the $2.4 billion SUGAL & DAMANI GROUP, Skilrock leverages the group's extensive domain experience to offer the INFINITI gaming platform - a true Omni-Channel, Omni-Gaming Platform that can serve any lottery or gaming operator anywhere in the world. INFINITI serves Retail, iGaming & Self Service Channels with equal ease and at the same time supports a wide variety of games like Lotto, Keno, Bingo, Instant, Sports, Poker, Rummy, Casino and Slots. Our popular solutions are Scratch Lottery, Retail Lottery, Instant Lottery and other igaming and lottery solutions.

iGaming Platform & Lottery Solutions by Skilrock

Skilrock Technologies

Top Mobile App Development Companies 2024

XongoLab Technologies LLP

CompTIA Security+ (Study Notes) for cs.pdf

Furqanuddin10

Microsoft 365 Copilot is available to Enterprise customers and smaller organizations from January 16, 2024. It goes for the price set at $30 per user/month across all purchasing channels and customer types. Microsoft 365 Copilot gives users experiences allowing for the composition and replying of emails, chats, documents, contacts, and meeting minutes.    Microsoft 365 Copilot is available across all sales channels including Enterprise Agreement and Cloud Solution Provider (CSP).  Also, for commercial customers with:   • Microsoft 365 E3  • Microsoft 365 E5  • Office 365 E3  • Office 365 E5  • Microsoft 365 Business Standard  • Microsoft 365 Business Premium  They will be able to purchase Copilot for Microsoft 365 add-on SKU across all Microsoft sales channels. See below the full list of the Microsoft sales channels for Copilot:  • Enterprise Agreement  • Enterprise Agreement Subscription  • Cloud Solution Provider (CSP)  • Microsoft Customer Agreement – Enterprise (MCA-E)  • Direct from Microsoft  • Education customers through Enrollment for Education Solutions  You can reach out to our team of Microsoft licensing experts concerning any on-premises or cloud related questions seeking for clarity. Send us an email…info@q-advise.com

Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf

Q-Advise

Breaking the Code : A Guide to WhatsApp Business API.pdf

Meon Technology

Scenarios are the central artifact of the Behaviour Driven Development (BDD) process. Although many teams use scenarios and tools like Cucumber or SpecFlow to automate them, in many cases their scenarios contain a lot of details, particularly test data, and therefore they become too complicated to support collaboration with the business. The "essential" principle of scenario writing (scenario formulation) states that only those details should be included in the scenario that are relevant for the outcome. This talk provides help for those who struggle implementing this principle or would be interested to learn how you can create brief and maintainable scenarios.

Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)

Gáspár Nagy

"Introduction to Windows 7" serves as the foundational chapter in our guide, setting the stage for understanding the key features and functionalities of this operating system. Windows 7, released by Microsoft in 2009, quickly became one of the most popular and widely used versions of Windows due to its user-friendly interface, stability, and performance improvements over its predecessor, Windows Vista. This chapter begins by providing an overview of the Windows 7 operating system, highlighting its key attributes and improvements compared to earlier versions of Windows. It introduces users to the visual enhancements such as Aero Glass, the revamped taskbar (also known as the Superbar), and the redesigned Start menu, which all contribute to a more intuitive and streamlined user experience. Furthermore, "Introduction to Windows 7" delves into the architecture and system requirements of the operating system, helping users understand what hardware specifications are necessary for optimal performance. It covers topics such as processor requirements, RAM, disk space, and graphics capabilities, ensuring that readers have a clear 3 understanding of the hardware prerequisites for running Windows 7 smoothly. Additionally, this chapter explores the various editions of Windows 7, including Home Premium, Professional, Ultimate, and Enterprise, outlining the differences between them and helping users choose the edition that best suits their needs and requirements. Moreover, "Introduction to Windows 7" provides an overview of the installation process, guiding users through the steps required to install or upgrade to Windows 7 on their computers. It covers topics such as preparing for installation, choosing the installation type (upgrade or custom), partitioning disks, and configuring initial settings. In summary, "Introduction to Windows 7" serves as a comprehensive primer for users who are new to the operating system or seeking to refresh their understanding. By familiarizing themselves with the core concepts and features of Windows 7, readers can lay a solid foundation for exploring more advanced topics covered in subsequent chapters of this guide.

Mastering Windows 7 A Comprehensive Guide for Power Users .pdf

mbmh111980

AI/ML Infra Meetup | Perspective on Deep Learning Framework

Alluxio, Inc.

Crafting the Perfect Measurement Sheet with PLM Integration

Wave PLM

Migrating your customer service data from Zendesk to Re:amaze can significantly enhance your support operations, but it requires careful planning and execution. "A Guideline to Zendesk to Re:amaze Data Migration" is designed to assist businesses in managing this transition smoothly and efficiently. This comprehensive guide covers all aspects of the data migration process, ensuring that your data is transferred accurately and effectively.

A Guideline to Zendesk to Re:amaze Data Migration

Help Desk Migration

The Impact of PLM Software on Fashion Production

Wave PLM

This is a classic migration case study (the past, current and the future) at scale from a world-wide company transitioning from Confluent Platform and Confluent Cloud to self-managed Apache Kafka on Kubernetes using Strimzi. At Maersk, we have been architecting, designing and implementing our 3rd generation Event Streaming Platform. This platform is based on Kubernetes in Azure and using Strimzi to operate Apache Kafka at large scale, highly reliable, segregating data based on isolated use cases. Our 2nd generation was based on OnPrem Confluent Platform and Confluent Cloud and this presentation is the story of this migration and reasoning behind it. Furthermore, we would get into details on how we monitor (Grafana, Prometheus), alert (GoAlert and alert as code), operate and provide self-service solutions on top of Strimzi to enable business critical application in Maersk, implemented in GoLang using the GitOps deployment model with Flux and Kustomization among others. Finally, if time allows we will end with a demo of an open-source self service tool to monitor and explore the cluster with most wanted features such as topic message browsing and configuring and restarting connectors.

StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi

steffenkarlsson2

Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...

Abortion Clinic

GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates

Neo4j

Recently uploaded (20)

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG

A Guideline to Gorgias to to Re:amaze Data Migration

Studiovity film pre-production and screenwriting software

INGKA DIGITAL: Linked Metadata by Design

APVP,apvp apvp High quality supplier safe spot transport, 98% purity

iGaming Platform & Lottery Solutions by Skilrock

Top Mobile App Development Companies 2024

CompTIA Security+ (Study Notes) for cs.pdf

Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf

Breaking the Code : A Guide to WhatsApp Business API.pdf

Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)

Mastering Windows 7 A Comprehensive Guide for Power Users .pdf

AI/ML Infra Meetup | Perspective on Deep Learning Framework

Crafting the Perfect Measurement Sheet with PLM Integration

A Guideline to Zendesk to Re:amaze Data Migration

The Impact of PLM Software on Fashion Production

StrimziCon 2024 - Transition to Apache Kafka on Kubernetes with Strimzi

Abortion ^Clinic ^%[+971588192166''] Abortion Pill Al Ain (?@?) Abortion Pill...

GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates

Logging, Instrumentation, Dashboards and Alerts - for developers

1. Logging Instrumentation Dashboards Alerts - for developers

2. WONDERING WHO IS THAT GUY? HENRY BEEN Independent Devops & Azure Architect E: consultancy@henrybeen.nl T: @henry_been L: linkedin.com/in/henrybeen W: henrybeen.nl

3. Very boring part Pretty boring part Maybe boring part Amazing part Really amazing part Mindblowing part LOGGING, INSTRUMENTATION, DASHBOARDS & ALERTS

4. A bit of monitoring theory What to monitor Demo’s! LOGGING, INSTRUMENTATION, DASHBOARDS, ALERTS

5. MONITORING -or- KNOWING WHAT BE HAPPENING

6. Instrumentation Most often forgotten Concerned with metrics • (Timestamp, value) tuples • Events & values • Dimensions • Used for Dashboards & Alerts Rolled up over time Logging Often combined with tracing Concerned with state changes • When • By who • What changed • Can a source of metrics Retained for longer or indefinitly Tracing Used for troubleshooting What we developers call logging • When • Code location • Very, very verbose message • Can a source of metrics Retained for a limited time MONITORING

7. VM / container Timeseries Database Application Instance Agent SDK Logging Database Https endpoint Visualization Engine Your Dashboards Query Engine Your Alerts Streaming Data Engine

8. BUT HEY THAT STUFF IS OPERATIONS… WHY WOULD I CARE?

9. DEVOPS POWERRRR

10. • DevOps is the union of people, process, and products to enable continuous delivery of value to your end users. “ ” DEVOPS

11. OKAY, OKAY I CARE… NOW, WHAT TO MONITOR?

12. OKAY, OKAY I CARE… NOW, WHAT NOT TO MONITOR?

13. WHAT NOT TO DO FOCUS ON AVERAGES Averages are lying cheats and hide real issues! • Use dimensions to find outliers • Use maximums or percentiles to identify spread FOCUS ON YOUR SYSTEMS Do you think your users care? At all? • Is the amount of disk IO really interesting? • Does page file usage predict conversion? To add some nuance: - Some system metrics are handy, just don’t start there maybe - Same goes for averages

14. 0 20 40 60 80 100 120 Database load(%) DO WE HAVE AN ISSUE? Proposed alert

15. ARE MY USERS HAPPY? 0 20 40 60 80 100 120 140 160 Average response time

16. 0 200 400 600 800 1000 1200 Average response time and maximum response time Average response time Maximum response time ARE MY USERS HAPPY?

17. 0 100 200 300 400 500 600 700 800 900 Average response time and response time per operation Average response time View item AddToBasket ARE MY USERS HAPPY?

18. PERCENTILES! PERCENTILES! PERCENTILES!

19. MEASURE THINGS THE USER CARES ABOUT AND THINK IT THROUGH!

20. Let’s do a Quick Demo! Demo

21. A VERY GOOD BOOK ALSO QUITE THIN

22. FOR THOSE USING AZURE HOW WOULD YOU DO IT?

23. DEMO TIME! A Todo Application… ALMOST

24. AddTodo DeleteTodo CompleteTodo UncompleteTodo GetAllTodos AddTodoProcessor DeleteTodoProcessor CompleteTodoProcessor UncompleteTodoProcessor IsFeatureFlagEnabled SQL Database

25. VM / container Timeseries Database Application Instance Agent SDK Logging Database Https endpoint Visualization Engine Your Dashboards Query Engine Your Alerts Streaming Data Engine

26. Two more things “YOU CAN USE THE DEMOS!” “AND YOU CAN USE THE DEMOS!” “EVERYBODY CAN USE THE DEMOS!” DASHBOARDS AND ALERTS AS CODE

27. DO TRY THIS AT HOME! HENRY BEEN Independent Devops & Azure Architect E: consultancy@henrybeen.nl T: @henry_been L: linkedin.com/in/henrybeen W: henrybeen.nl

Logging, Instrumentation, Dashboards and Alerts - for developers

Recommended

Recommended

More Related Content

What's hot

What's hot (14)

Similar to Logging, Instrumentation, Dashboards and Alerts - for developers

Similar to Logging, Instrumentation, Dashboards and Alerts - for developers (20)

More from Henry Been

More from Henry Been (11)

Recently uploaded

Recently uploaded (20)

Logging, Instrumentation, Dashboards and Alerts - for developers