This document discusses logging, instrumentation, dashboards and alerts for developers. It covers monitoring theory, what to monitor and not monitor, and using Azure services like Azure Monitor and Application Insights for metrics, logs and setting up dashboards and alerts. A demo of instrumenting an application and viewing metrics and logs is also included.

1. Logging
Instrumentation
Dashboards
Alerts
- for developers

2. VRAAG JE JE AF
WIE IS DIE GAST?
HENRY BEEN
Independent Devops & Azure Architect
E: henry@azurespecialist.nl
T: @henry_been
L: linkedin.com/in/henrybeen
W: henrybeen.nl

3. Very boring part
Pretty boring part
Maybe boring part
Amazing part
Really amazing part
Mindblowing part
LOGGING, INSTRUMENTATION, DASHBOARDS & ALERTS
@henry_been

4. Monitoring Theorie
Wat te monitoren
Demo’s!
LOGGING, INSTRUMENTATION, DASHBOARDS & ALERTS
@henry_been

5. MONITORING
-or-
KNOWING WHAT BE HAPPENING
@henry_been

6. Instrumentation
Most often forgotten
Concerned with metrics
• (Timestamp, value) tuples
• Events & values
• Dimensions
• Used for Dashboards & Alerts
Rolled up over time
Logging
Often combined with tracing
Concerned with state changes
• When
• By who
• What changed
• Can be a source of metrics
Retained for longer or indefinitly
Tracing
Used for troubleshooting
What we developers call logging
• When
• Code location
• Very, very verbose message
• Can be a source of metrics
Retained for a limited time
MONITORING
@henry_been

7. VM / container
Timeseries
Database
Application Instance Agent
SDK
Logging
Database
Https endpoint
Visualization Engine
Your Dashboards
Query Engine
Your Alerts
Streaming Data Engine
@henry_been

8. BUT HEY THAT STUFF
IS OPERATIONS…
WHY WOULD I CARE?
@henry_been

9. DEVOPS POWERRRR
@henry_been

10. • DevOps is the union of people,
process, and products to enable
continuous delivery of value to
your end users.
“
”
DEVOPS
@henry_been

11. OKAY, OKAY I CARE…
NOW, WHAT TO MONITOR?
@henry_been

12. OKAY, OKAY I CARE…
NOW, WHAT NOT TO MONITOR?
@henry_been

13. WHAT NOT TO MONITOR (MAYBE)
FOCUS ON AVERAGES
Averages are lying cheats and hide real issues!
• Use dimensions to find outliers
• Use maximums or percentiles to identify spread
FOCUS ON YOUR SYSTEMS
Do you think your users care? At all?
• Is the amount of disk IO really interesting?
• Does page file usage predict conversion?
To add some nuances:
- Some system metrics are handy, just don’t start there maybe
- Same goes for averages
@henry_been

14. 0
20
40
60
80
100
120
Database load(%)
DO WE HAVE AN ISSUE?
Proposed alert
@henry_been

15. ARE MY USERS HAPPY?
0
20
40
60
80
100
120
140
160
Average response time
@henry_been

16. 0
200
400
600
800
1000
1200
Average response time and maximum response time
Average response time Maximum response time
ARE MY USERS HAPPY?
@henry_been

17. 0
100
200
300
400
500
600
700
800
900
Average response time and response time per operation
Average response time View item AddToBasket
ARE MY USERS HAPPY?
@henry_been

18. PERCENTILES!
PERCENTILES!
PERCENTILES!
@henry_been

19. MEASURE THINGS
THE USER CARES ABOUT
AND THINK IT THROUGH!
@henry_been

20. Let’s do a
Quick Demo!
Demo
@henry_been

21. A VERY GOOD BOOK
ALSO QUITE THIN
@henry_been

22. FOR THOSE USING AZURE
HOW WOULD YOU DO IT?
@henry_been

23. AZURE SERVICES
Azure Monitor
Application Insights
Log Analytics
@henry_been

24. AZURE SERVICES
Azure Monitor
@henry_been

25. AZURE SERVICES
Metrics Logs
Azure Monitor
@henry_been

26. Platform
Built into (almost) every offering
Fixed metrics
• Different for each offering
• Automatically recorded
Enabled by default and FREE!
Custom
Using Application Insights
Custom metrics
• Self-chosen name
• Double values
• Dimensions disabled by default
NuGet package, instrumentation key
and use the TelemetryClient class
Application
Using Application Insights
Well known metrics
• CPU percentage
• Response times
• Memory usage
Install NuGet package, configure
instrumentation key and DONE
METRIC – WHAT GETS RECORDED
@henry_been

27. LOGGING – WHAT GETS RECORDED
@henry_been

28. DEMO TIME!
An Url Shortner Application…
ALMOST

29. POST AddAlias AddAliasProcessor
Redis Database
GET GetAlias
@henry_been
GET GetStatistics

30. POST AddAlias AddAliasProcessor
Redis Database
GET GetAlias
@henry_been
GET GetStatistics
1 / 2s LoadGen
1 / 4h Reset

31. POST AddAlias AddAliasProcessor
Redis Database
GET GetAlias
@henry_been
GET GetStatistics
Sql Database
AliasReporter

32. VM / container
Timeseries
Database
Application Instance Agent
SDK
Logging
Database
Https endpoint
Visualization Engine
Your Dashboards
Query Engine
Your Alerts
Streaming Data Engine
@henry_been

33. And now for real…

34. Application Instance
SDK
@henry_been

35. Application Instance
SDK
@henry_been

36. Application Instance
ApplicationInsights
@henry_been

37. Application Instance
ApplicationInsights
@henry_been
Your Code

38. Application Instance
NLOG
@henry_been
Your Code
Seq
Files
Application Insights

39. Two more things
“YOU CAN USE THE DEMOS!”
“AND YOU CAN USE THE DEMOS!”
“EVERYBODY CAN USE THE DEMOS!”
DASHBOARDS
AND ALERTS
AS CODE
@henry_been

40. DO TRY THIS AT HOME!
HENRY BEEN
Independent Devops & Azure Architect
E: henry@azurespecialist.nl
T: @henry_been
L: linkedin.com/in/henrybeen
W: henrybeen.nl

41. Questions?
Now is the time!
@henry_been