Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Next Generation Data Warehouse Development with Lambda and Redshift

106 views

Published on

TerraAlto technical talk on DevOPs approach to Data Warehousing with Redshift and Lambda. Talk given by Senior Data & Database Engineer, Andras Gombosi, at the AWS Enterprise Briefing, Dublin, Ireland on Wednesday, 28 November 2018.

Published in: Technology
  • Be the first to comment

Next Generation Data Warehouse Development with Lambda and Redshift

  1. 1. Next Generation Data Warehouse Development with Lambda and Redshift Andras Gombosi
  2. 2. AMAZON REDSHIFT Petabyte scale Massively Parallel Data Warehouse Exceptionally fast * Horizontally Scalable Massive Storage capacity Attractive and transparent pricing SQL interface AWS ecosystem Secure *
  3. 3. Challenges – the cost of greatness SLAs Security Audit & Compliance
  4. 4. Solution: Empower the Database Developer and DBA communities with DevOps methodologies!
  5. 5. 5 AWS Cloud Lambda Trigger CD Pipeline for DB code Developer And DBA Communites Git Push Task Router DEPLOYER APP
  6. 6. Data Modeller SDLC: Forward Engineering CD PIPELINE Data Modeling Tool
  7. 7. Edge ETL Use Cases: AWS Billing Data Load SQL Forwarder CD PIPELINE
  8. 8. Deployer functionality Email
  9. 9. SDLC changes and effects UPTIME and REPUTATION CODE QUALITY AND SKILLS AUTOMATIC, PROCESS ENFORCED DATA SECURITY Push changes to repo instead of execute!
  10. 10. Well Architected : Security Pillar Endpoints
  11. 11. Well Architected : Other Pillars Security Reliability AWS Well Architected Framework Performance Efficiency Cost Optimisation Operational Excellence
  12. 12. Conclusion & Questions • AWS Ecosystem • Cloud-native • Not just for Redshift • Not “outside the box”, use multiple boxes!

×