This document summarizes a presentation about migrating 600 databases from an on-premises environment to AWS. The key steps included using the AWS Schema Conversion Tool to migrate the databases, change data capture to replicate ongoing changes, and automating infrastructure deployment. Migrating to AWS improved availability, reduced costs, and allowed developers and DBAs to focus on higher-level tasks rather than undifferentiated heavy lifting like maintenance and upgrades. AWS services like RDS provided managed database services and features like fast materialized view refresh.

1. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL

2. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Migrating 600 databases to AWS
and making them better, faster,
and cheaper
C O M 3 1 1
Matt Houghton (he/him)
Data Architect
CDL

3. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL

4. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
High availability

5. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Enterprise-grade database

6. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Hybrid cloud
Primary Secondary
Read-Only

7. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Move up the stack
• Learn by failing
• Undifferentiated heavy lifting
• Focus on the business problem

8. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Migration steps
• AWS Schema Conversion Tool
(AWS SCT)
• Change data capture (CDC)
• Database objects
• Database code
• Engine-specific functions
• Code/rewrite/rearchitect

9. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Change data capture

10. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Demo

11. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Event-driven
-

12. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Migration monitoring

13. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Automation
• Infrastructure as code
• Parameterize
• Switchover
• Rollback
• Reduce risk
• Consistency
• Speed of deployment

14. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Tuning
• join_collapse_limit
• from_collapse_limit
• work_mem
• pg_stat_statements
• pg_prewarm
• Long-running SQL
• Tools
• The organization

15. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
What do the DBAs do now?
• Infrastructure as code
• More automation
• Config-driven deployments
• Faster upgrades/fixes
• Scale the business

16. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Developer experience
• Self-service
• Database clones
• Privacy automation
• Speed
• Preapproved queries
• Health checks
• Database-as-a-service product
• New skills

17. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS Ready

18. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Connection pooling

19. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Application logging

20. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Data encryption

21. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Database failure and performance

22. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Open source

23. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Fast refresh materialized views

24. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Fast refresh materialized views – Walkthrough

25. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Fast refresh materialized views – Walkthrough

26. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Fast refresh materialized views – Walkthrough

27. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Fast refresh materialized views – Walkthrough

28. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Demo

29. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Final tip

30. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CDL - EXTERNAL
Thank you!
Matt Houghton
@mattdevdba
Please complete
the session survey