Advanced Monitoring Talk With Tony Mullen and Matt Houghton for Amazon RDS. https://aws4dmanchester.splashthat.com

1. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Advanced Monitoring for
Amazon RDS
Senior RDS Specialist Solutions Architect
Amazon Web Services
Tony Mullen (he/him)
Data Architect
CDL
Matthew Houghton(he/him)

2. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Agenda
• Monitoring capabilities
• CloudWatch alarms
• Custom metrics
• RDS events

3. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Monitoring capabilities at a glance
Monitor core (CPU, memory) and
transactional (throughput,
latency)
metrics
Publishing database logs
(errors, audit, and slow
queries)
to a centralized log store
Query- and wait-
level
performance data
Additional database-
specific
metrics at up to 1 second
granularity
Amazon CloudWatch
Metrics
Amazon CloudWatch
Logs
Performance
Insights
Enhanced
Monitoring

4. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
DB is slow....

5. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Why is my system running slow?
RDS Cloudwatch
• 1 Minute Interval
• View in AWS Console or
push to monitoring
systems
• Available for 15 Days

6. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Why is my system running slow?
RDS Enhanced Monitoring
• Per-process host metrics
• View in AWS Console or push
to monitoring systems
• 1-60 second granularity
• Start with 15s
• Dial down to 1s when
troubleshooting

7. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Why is my system running slow?
RDS Performance Insights
• Measure database load, average active
sessions
• All RDS engines
• No licensing requirements
• View in AWS Console or push to
monitoring systems

8. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Amazon RDS
Performance
Insights

9. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Amazon RDS
Performance
Insights

10. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
CloudWatch Alarms
RDS instance
Alarm
Lambda function
Email notification
Amazon CloudWatch

11. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
CloudWatch
Alarms

12. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Publishing Logs to CloudWatch Logs
• You can configure your Amazon RDS Oracle DB instance to publish log data
to a log group in Amazon CloudWatch Logs.
• With CloudWatch Logs, you can analyze the log data, and use CloudWatch
to create alarms and view metrics and store your log records in highly
durable storage.
• Amazon RDS publishes each log as a separate database stream in the log
group.
• CWLogs location - /aws/rds/instance/my_instance/audit log group
• Types of log files which can be published to CloudWatch
§ Oracle RDS - Alert, Audit, Listener, Trace & Oracle management Agent
§ Postgres RDS - PostreSQL

13. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Publishing Logs to Cloud Watch Logs

14. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Custom Metrics
• Flexibility
• Granularity
• Enhanced insights
• Alarms

15. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Custom Metrics
• Application performance
• Business metrics
• Operational metrics
• Resource utilization

16. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Custom Metrics
aws cloudwatch put-metric-data
—namespace test-custom-metric
—metric-name test-blocking-session
—unit Count —value $BLOCKING_COUNT
—dimensions InstanceID=orcl-blog-tonym

17. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Custom Metrics
#!/bin/bash
echo "Gathering blocking session"
BLOCKING_COUNT=`sqlplus -s username@"(DESCRIPTION = (ADDRESS = (PROTOCOL = TCP)(HOST =
hostname )(PORT = 1521)) (CONNECT_DATA = (SERVER = DEDICATED) (SERVICE_NAME = ORCL)))"
<< EOF
set head off verify off feedback off pagesize0;
select count(*) from v$lock l1, v$lock l2 where l1.block =1 and l2.request > 0 and
l1.id1=l2.id1 and l1.id2=l2.id2;
EOF`
echo "Blocking Count = $BLOCKING_COUNT”
echo "Pushing to cloudwatch"
aws cloudwatch put-metric-data —namespace test-custom-metric
—metric-name test-blocking-session —unit Count —value $BLOCKING_COUNT
—dimensions InstanceID=orcl-blog-tonym

18. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Custom Metrics

19. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
CloudWatch Dashboard

20. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Tracking RDS Events

21. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Recommendations

22. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
DevOps Guru for RDS

23. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL

24. CDL - EXTERNAL
AA Component
“CDL provides
the most stable
and functionally
complete
insurance
broking platform
software in the
UK.”
Strata
Component
Overview

25. CDL - EXTERNAL
AWS Cloud
Availability Zone 1 Availability Zone 2
VPC
Multi-AZ
AWS Cloud
Availability Zone 1
VPC
Clone
Transportable
Database
Production Non-Production
Amazon QuickSight
Read-Replica
AWS Cloud
Services
VPC
AWS Lambda
AWS Backup
AWS Cloud
Availability Zone 1 Availability Zone 2
Multi-AZ
Read-Replica
Analytics
VPC
CDC

26. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Availability Monitoring
• Rundeck
• Heartbeat
• OpenSearch

27. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Availability Monitoring

28. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL

29. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
It’s Up, But Is It Ok?
• CloudWatch Metrics
• Logs

30. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL

31. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Logs

32. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Logs
Parameter Default CDL
log_connections – 1
log_disconnections – 1
log_checkpoints 1
log_lock_waits –
log_min_duration_sample –
log_min_duration_statement – 1000
log_statement – all|ddl|mod
log_statement_sample_rate –
log_statement_stats –

33. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
SQL
• Log Minimum Duration
• Review SQL
• Tune

34. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL

35. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Lambda
• Bespoke SQL

36. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL

37. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Playbook
• When there is a problem
§ Login to database
§ List of scripts is shown
§ Run scripts
§ SharePoint – On Call Known Issues

38. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Dynatrace

39. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Playbook

40. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Playbook

41. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Future
• Dynatrace
• RDS DevOps Guru
• Systems Manager
• S3 For Logs / OpenSearch Serverless
Matt Houghton
• @mattdevdba

42. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thanks
Linked in
• Let’s Talk About Data
§ Streams every Wednesday
§ https://www.twitch.tv/aws