SlideShare a Scribd company logo

TECHTalks - Philadelphia PA - Brien Blandford

EagleDream Technologies
EagleDream Technologies
EagleDream TechnologiesEagleDream Technologies

Data lakes and serverless computing - Brien Blandford - AWS Partner Solution Architect - October 2nd 2019

TECHTalks - Philadelphia PA - Brien Blandford

1 of 27
Download to read offline
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
2
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
Brien Blandford
Partner Solutions Architect
Amazon Web Services
brieb@amazon.com
Data Lakes and Serverless Computing
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
3
The world’s most valuable
resource is
*Copyright: The Economist, 2017, David Parkins
Data is an Asset
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
4
* IDC, Data Age 20215: The Evolution of Data to Life-Critical Don’t Focus on Big Data, Focus on the Data That’s Big, April 2017.
Data
every 5 years
Thereismore data than
people think
01100111 01100101 01110100 00100000 01100001 00100000
01101000 01101111 01100010 01100010 01111001 00001101
00001010 01100111 01100101 01110100 00100000 01100001
00100000 01101000 01101111 01100010 01100010 01111001
00001101 00001010 01100111 01100101 01110100 00100000
01100001 00100000 01101000 01101111 01100010 01100010
01111001 00001101 00001010 01100111 01100101 01110100
00100000 01100001 00100000 01101000 01101111 01100010
01100010 01111001 00001101 00001010 01100111 01100101
01110100 00100000 01100001 00100000 01101000 01101111
01100010 01100010 01111001 00001101 0000101001100111
01100101 01110100 00100000 01100001 00100000 01101000
01101111 01100010 01100010 01111001 00001101 00001010
01100111 01100101 01110100 00100000 01100001 00100000
01101000 01101111 01100010 01100010 01111001 00001101
00001010 01100111 01100101 01110100 00100000 01100001
00100000 01101000 01101111 01100010 01100010 01111001
00001101 00001010 0110011 01100010 01100010 01111001
00001101 0000101001100111 01100101 01110100 00100000
15
years
live for
Data platforms need to
1,000x
scale
>10x
grows
CHALLENGE
Need to create constant feedback loop for
designers
Gain up-to-the-minute understanding of
gamer satisfaction to guarantee gamers
are engaged, thus resulting in the most
popular game played in the world
Fortnite | 125+ million players
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
6
Equinox Fitness Cubs is a company with integrated luxury and
lifestyle offerings centered on movement, nutrition and
regeneration. Equinox built connected experiences using
applications that connect to Apple Health and built data collection
in their exercise equipment.
More than 200 locations within every major city across the
U.S., London, and Canada
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
7
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do we build new
types of applications that
can leverage this data?

Recommended

AWS 預測性維護與智慧物聯應用
AWS 預測性維護與智慧物聯應用AWS 預測性維護與智慧物聯應用
AWS 預測性維護與智慧物聯應用Amazon Web Services
 
進化中的遊戲產業-以微服務架構-全球布局與現代化資料庫策略來打造高成長遊戲
進化中的遊戲產業-以微服務架構-全球布局與現代化資料庫策略來打造高成長遊戲進化中的遊戲產業-以微服務架構-全球布局與現代化資料庫策略來打造高成長遊戲
進化中的遊戲產業-以微服務架構-全球布局與現代化資料庫策略來打造高成長遊戲Amazon Web Services
 
Serverless in Big Data
Serverless in Big DataServerless in Big Data
Serverless in Big DataEric Johnson
 
Tech Talk: Cloud Data Management with Veeam & AWS
Tech Talk: Cloud Data Management with Veeam & AWSTech Talk: Cloud Data Management with Veeam & AWS
Tech Talk: Cloud Data Management with Veeam & AWSAmazon Web Services
 
AWS AI and Machine Learning Journey
AWS AI and Machine Learning JourneyAWS AI and Machine Learning Journey
AWS AI and Machine Learning JourneyAmazon Web Services
 
Migrate and Modernize Your Database
Migrate and Modernize Your DatabaseMigrate and Modernize Your Database
Migrate and Modernize Your DatabaseAmazon Web Services
 

More Related Content

What's hot

AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summits
 
The Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration JourneyThe Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration JourneyAmazon Web Services
 
Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...
Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...
Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...Amazon Web Services
 
Starting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelStarting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelBoaz Ziniman
 
設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務
設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務
設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務Amazon Web Services
 
Becoming A High Frequency Enterprise
Becoming A High Frequency EnterpriseBecoming A High Frequency Enterprise
Becoming A High Frequency EnterpriseAmazon Web Services
 
Increase innovation and business agility by using Veeam Backup for AWS - DEM0...
Increase innovation and business agility by using Veeam Backup for AWS - DEM0...Increase innovation and business agility by using Veeam Backup for AWS - DEM0...
Increase innovation and business agility by using Veeam Backup for AWS - DEM0...Amazon Web Services
 
Real-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case StudiesReal-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case StudiesAmazon Web Services
 
AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習
AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習
AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習Amazon Web Services
 
[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...
[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...
[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...Amazon Web Services
 
AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...
AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...
AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...Amazon Web Services
 
AWS最新區塊鏈服務與應用
AWS最新區塊鏈服務與應用AWS最新區塊鏈服務與應用
AWS最新區塊鏈服務與應用Amazon Web Services
 
SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...
SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...
SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...Boaz Ziniman
 
Keynote_AWS_BecomingAHighFrequencyEnterprise
Keynote_AWS_BecomingAHighFrequencyEnterpriseKeynote_AWS_BecomingAHighFrequencyEnterprise
Keynote_AWS_BecomingAHighFrequencyEnterpriseAmazon Web Services
 
機器學習技術在工業應用上的最佳實務
機器學習技術在工業應用上的最佳實務機器學習技術在工業應用上的最佳實務
機器學習技術在工業應用上的最佳實務Amazon Web Services
 
Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0
Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0
Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0Amazon Web Services
 
Standard Chartered Bank Cloud Journey
Standard Chartered Bank Cloud JourneyStandard Chartered Bank Cloud Journey
Standard Chartered Bank Cloud JourneyAmazon Web Services
 
AWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & Risk
AWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & RiskAWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & Risk
AWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & RiskAmazon Web Services
 

What's hot (20)

AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
 
The Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration JourneyThe Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration Journey
 
Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...
Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...
Keynote: What Transformation Really Means for the Enterprise - Virtual Transf...
 
Starting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelStarting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay Israel
 
設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務
設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務
設計可擴展-安全的創新金融科技-FinTech-應用-深入探討現代化的數位支付服務
 
Becoming A High Frequency Enterprise
Becoming A High Frequency EnterpriseBecoming A High Frequency Enterprise
Becoming A High Frequency Enterprise
 
AWS reInvent 2017 Recap Webinar
AWS reInvent 2017 Recap WebinarAWS reInvent 2017 Recap Webinar
AWS reInvent 2017 Recap Webinar
 
Increase innovation and business agility by using Veeam Backup for AWS - DEM0...
Increase innovation and business agility by using Veeam Backup for AWS - DEM0...Increase innovation and business agility by using Veeam Backup for AWS - DEM0...
Increase innovation and business agility by using Veeam Backup for AWS - DEM0...
 
Real-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case StudiesReal-World AI and Deep Learning for Enterprise with Case Studies
Real-World AI and Deep Learning for Enterprise with Case Studies
 
AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習
AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習
AWS及客戶在AI/ML的數位運行過程中得到的重要經驗與學習
 
[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...
[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...
[NEW LAUNCH!] How do I know I need a ledger database? An Introduction to Amaz...
 
AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...
AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...
AWS IoT services: Extract value for industrial applications - SVC202 - Mexico...
 
AWS最新區塊鏈服務與應用
AWS最新區塊鏈服務與應用AWS最新區塊鏈服務與應用
AWS最新區塊鏈服務與應用
 
SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...
SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...
SKL208 - Turbocharge your Business with AI and Machine Learning - Tel Aviv Su...
 
Keynote_AWS_BecomingAHighFrequencyEnterprise
Keynote_AWS_BecomingAHighFrequencyEnterpriseKeynote_AWS_BecomingAHighFrequencyEnterprise
Keynote_AWS_BecomingAHighFrequencyEnterprise
 
機器學習技術在工業應用上的最佳實務
機器學習技術在工業應用上的最佳實務機器學習技術在工業應用上的最佳實務
機器學習技術在工業應用上的最佳實務
 
Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0
Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0
Move users to AWS with Amazon WorkSpaces and Amazon AppStream 2-0
 
Standard Chartered Bank Cloud Journey
Standard Chartered Bank Cloud JourneyStandard Chartered Bank Cloud Journey
Standard Chartered Bank Cloud Journey
 
Open Data on AWS
Open Data on AWSOpen Data on AWS
Open Data on AWS
 
AWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & Risk
AWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & RiskAWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & Risk
AWS re:Invent Comes to London 2019 - Cashflow, Customer Experience & Risk
 

Similar to TECHTalks - Philadelphia PA - Brien Blandford

Modern Data Platforms - Thinking Data Flywheel on the Cloud
Modern Data Platforms - Thinking Data Flywheel on the CloudModern Data Platforms - Thinking Data Flywheel on the Cloud
Modern Data Platforms - Thinking Data Flywheel on the CloudAlluxio, Inc.
 
Immersion Day - Como a AWS apoia a estratégia analítica de sua empresa
Immersion Day - Como a AWS apoia a estratégia analítica de sua empresaImmersion Day - Como a AWS apoia a estratégia analítica de sua empresa
Immersion Day - Como a AWS apoia a estratégia analítica de sua empresaAmazon Web Services LATAM
 
Building Data Lakes for Analytics on AWS
Building Data Lakes for Analytics on AWSBuilding Data Lakes for Analytics on AWS
Building Data Lakes for Analytics on AWSAmazon Web Services
 
Building Serverless IoT solutions - EPAM SEC 2018 Minsk
Building Serverless IoT solutions - EPAM SEC 2018 MinskBuilding Serverless IoT solutions - EPAM SEC 2018 Minsk
Building Serverless IoT solutions - EPAM SEC 2018 MinskBoaz Ziniman
 
Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...
Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...
Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...Amazon Web Services
 
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019Amazon Web Services
 
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019AWS Summits
 
Building Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS Summit
Building Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS SummitBuilding Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS Summit
Building Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS SummitAmazon Web Services
 
Industrial IoT, Machine Learning, and Innovation in the AWS Cloud
Industrial IoT, Machine Learning, and Innovation in the AWS CloudIndustrial IoT, Machine Learning, and Innovation in the AWS Cloud
Industrial IoT, Machine Learning, and Innovation in the AWS CloudAmazon Web Services
 
Automate Business Insights on AWS - Simple, Fast, and Secure Analytics Platforms
Automate Business Insights on AWS - Simple, Fast, and Secure Analytics PlatformsAutomate Business Insights on AWS - Simple, Fast, and Secure Analytics Platforms
Automate Business Insights on AWS - Simple, Fast, and Secure Analytics PlatformsAmazon Web Services
 
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1Amazon Web Services
 
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...Amazon Web Services
 
Databases - Choosing the right Database on AWS
Databases - Choosing the right Database on AWSDatabases - Choosing the right Database on AWS
Databases - Choosing the right Database on AWSAmazon Web Services
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Boaz Ziniman
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Amazon Web Services
 
¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...
¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...
¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...javier ramirez
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Amazon Web Services
 
Deriving Value with Next Gen Analytics and ML Architectures
Deriving Value with Next Gen Analytics and ML ArchitecturesDeriving Value with Next Gen Analytics and ML Architectures
Deriving Value with Next Gen Analytics and ML ArchitecturesAmazon Web Services
 
The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...
The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...
The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...Amazon Web Services Korea
 
AI and IoT innovation - an industry focus
AI and IoT innovation - an industry focusAI and IoT innovation - an industry focus
AI and IoT innovation - an industry focusAmazon Web Services
 

Similar to TECHTalks - Philadelphia PA - Brien Blandford (20)

Modern Data Platforms - Thinking Data Flywheel on the Cloud
Modern Data Platforms - Thinking Data Flywheel on the CloudModern Data Platforms - Thinking Data Flywheel on the Cloud
Modern Data Platforms - Thinking Data Flywheel on the Cloud
 
Immersion Day - Como a AWS apoia a estratégia analítica de sua empresa
Immersion Day - Como a AWS apoia a estratégia analítica de sua empresaImmersion Day - Como a AWS apoia a estratégia analítica de sua empresa
Immersion Day - Como a AWS apoia a estratégia analítica de sua empresa
 
Building Data Lakes for Analytics on AWS
Building Data Lakes for Analytics on AWSBuilding Data Lakes for Analytics on AWS
Building Data Lakes for Analytics on AWS
 
Building Serverless IoT solutions - EPAM SEC 2018 Minsk
Building Serverless IoT solutions - EPAM SEC 2018 MinskBuilding Serverless IoT solutions - EPAM SEC 2018 Minsk
Building Serverless IoT solutions - EPAM SEC 2018 Minsk
 
Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...
Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...
Leadership Session: Cloud Adoption and the Future of Financial Services (FSV2...
 
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
 
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
 
Building Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS Summit
Building Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS SummitBuilding Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS Summit
Building Data Lakes for Analytics on AWS - ADB201 - Anaheim AWS Summit
 
Industrial IoT, Machine Learning, and Innovation in the AWS Cloud
Industrial IoT, Machine Learning, and Innovation in the AWS CloudIndustrial IoT, Machine Learning, and Innovation in the AWS Cloud
Industrial IoT, Machine Learning, and Innovation in the AWS Cloud
 
Automate Business Insights on AWS - Simple, Fast, and Secure Analytics Platforms
Automate Business Insights on AWS - Simple, Fast, and Secure Analytics PlatformsAutomate Business Insights on AWS - Simple, Fast, and Secure Analytics Platforms
Automate Business Insights on AWS - Simple, Fast, and Secure Analytics Platforms
 
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
 
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...
 
Databases - Choosing the right Database on AWS
Databases - Choosing the right Database on AWSDatabases - Choosing the right Database on AWS
Databases - Choosing the right Database on AWS
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
 
¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...
¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...
¿Son las bases de datos de contabilidad interesantes, o son parte del hype al...
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML
 
Deriving Value with Next Gen Analytics and ML Architectures
Deriving Value with Next Gen Analytics and ML ArchitecturesDeriving Value with Next Gen Analytics and ML Architectures
Deriving Value with Next Gen Analytics and ML Architectures
 
The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...
The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...
The Next Wave of Retailing, An AWS Perspective - Tom Litchford 월드와이드 리테일 사업 개...
 
AI and IoT innovation - an industry focus
AI and IoT innovation - an industry focusAI and IoT innovation - an industry focus
AI and IoT innovation - an industry focus
 

More from EagleDream Technologies

More from EagleDream Technologies (12)

Pitt Immersion Day Module 5 - security overview
Pitt Immersion Day Module 5 - security overviewPitt Immersion Day Module 5 - security overview
Pitt Immersion Day Module 5 - security overview
 
Pitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWSPitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWS
 
Pitt Immersion Day Module 3 - networking in AWS
Pitt Immersion Day Module 3 - networking in AWSPitt Immersion Day Module 3 - networking in AWS
Pitt Immersion Day Module 3 - networking in AWS
 
Pitt Immersion Day Module 2 - ec2 overview
Pitt Immersion Day Module 2 - ec2 overviewPitt Immersion Day Module 2 - ec2 overview
Pitt Immersion Day Module 2 - ec2 overview
 
Pitt Immersion Day- Module 1
Pitt Immersion Day- Module 1Pitt Immersion Day- Module 1
Pitt Immersion Day- Module 1
 
TECHTalks - Philadelphia PA - Mike Mitnick
TECHTalks - Philadelphia PA - Mike MitnickTECHTalks - Philadelphia PA - Mike Mitnick
TECHTalks - Philadelphia PA - Mike Mitnick
 
TECHTalks - Boston MA - Tim Harney
TECHTalks - Boston MA - Tim HarneyTECHTalks - Boston MA - Tim Harney
TECHTalks - Boston MA - Tim Harney
 
TECHTalks - Boston MA - Mike Festa
TECHTalks - Boston MA - Mike FestaTECHTalks - Boston MA - Mike Festa
TECHTalks - Boston MA - Mike Festa
 
TECHTalks - Buffalo NY - Adam Stotz
TECHTalks - Buffalo NY - Adam StotzTECHTalks - Buffalo NY - Adam Stotz
TECHTalks - Buffalo NY - Adam Stotz
 
TECHTalks - Buffalo NY - Joe Peacock
TECHTalks - Buffalo NY - Joe PeacockTECHTalks - Buffalo NY - Joe Peacock
TECHTalks - Buffalo NY - Joe Peacock
 
TECHTalks - Buffalo NY - Liz Tsai
TECHTalks - Buffalo NY - Liz TsaiTECHTalks - Buffalo NY - Liz Tsai
TECHTalks - Buffalo NY - Liz Tsai
 
TECHTalks - Pittsburgh & Philadelphia PA - Scott Weber
TECHTalks - Pittsburgh & Philadelphia PA - Scott WeberTECHTalks - Pittsburgh & Philadelphia PA - Scott Weber
TECHTalks - Pittsburgh & Philadelphia PA - Scott Weber
 

Recently uploaded

SABARI PRIYAN's self introduction as a reference
SABARI PRIYAN's self introduction as a referenceSABARI PRIYAN's self introduction as a reference
SABARI PRIYAN's self introduction as a referencepriyansabari355
 
Recurrent neural network for machine learning
Recurrent neural network for machine learningRecurrent neural network for machine learning
Recurrent neural network for machine learningomogire08
 
SABARI PRIYAN's self introduction as reference
SABARI PRIYAN's self introduction as referenceSABARI PRIYAN's self introduction as reference
SABARI PRIYAN's self introduction as referencepriyansabari355
 
Artificial Intelligence and its Impact on Society.pptx
Artificial Intelligence and its Impact on Society.pptxArtificial Intelligence and its Impact on Society.pptx
Artificial Intelligence and its Impact on Society.pptxVighnesh Shashtri
 
AWS Identity and access management for users
AWS Identity and access management for usersAWS Identity and access management for users
AWS Identity and access management for usersStephenEfange3
 
Lies and Myths in InfoSec - 2023 Usenix Enigma
Lies and Myths in InfoSec - 2023 Usenix EnigmaLies and Myths in InfoSec - 2023 Usenix Enigma
Lies and Myths in InfoSec - 2023 Usenix EnigmaAdrian Sanabria
 
PredictuVu ProposalV1.pptx
PredictuVu ProposalV1.pptxPredictuVu ProposalV1.pptx
PredictuVu ProposalV1.pptxKapilSinghal47
 
Big Data - large Scale data (Amazon, FB)
Big Data - large Scale data (Amazon, FB)Big Data - large Scale data (Amazon, FB)
Big Data - large Scale data (Amazon, FB)CUO VEERANAN VEERANAN
 
Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...
Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...
Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...Thibaud Le Douarin
 
Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...
Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...
Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...Cyber Security Experts
 
IIBA Adl - Being Effective on Day 1 - Slide Deck.pdf
IIBA Adl - Being Effective on Day 1 - Slide Deck.pdfIIBA Adl - Being Effective on Day 1 - Slide Deck.pdf
IIBA Adl - Being Effective on Day 1 - Slide Deck.pdfAustraliaChapterIIBA
 
Industry 4.0 in IoT Transforming the Future.pptx
Industry 4.0 in IoT Transforming the Future.pptxIndustry 4.0 in IoT Transforming the Future.pptx
Industry 4.0 in IoT Transforming the Future.pptxMdRafiqulIslam403212
 
Oppotus - Malaysians on Malaysia 4Q 2023.pdf
Oppotus - Malaysians on Malaysia 4Q 2023.pdfOppotus - Malaysians on Malaysia 4Q 2023.pdf
Oppotus - Malaysians on Malaysia 4Q 2023.pdfOppotus
 
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...Daniele Malitesta
 
data analytics and tools from in2inglobal.pdf
data analytics  and tools from in2inglobal.pdfdata analytics  and tools from in2inglobal.pdf
data analytics and tools from in2inglobal.pdfdigimartfamily
 
Soil Health Policy Map Years 2020 to 2023
Soil Health Policy Map Years 2020 to 2023Soil Health Policy Map Years 2020 to 2023
Soil Health Policy Map Years 2020 to 2023stephizcoolio
 

Recently uploaded (17)

2.pptx
2.pptx2.pptx
2.pptx
 
SABARI PRIYAN's self introduction as a reference
SABARI PRIYAN's self introduction as a referenceSABARI PRIYAN's self introduction as a reference
SABARI PRIYAN's self introduction as a reference
 
Recurrent neural network for machine learning
Recurrent neural network for machine learningRecurrent neural network for machine learning
Recurrent neural network for machine learning
 
SABARI PRIYAN's self introduction as reference
SABARI PRIYAN's self introduction as referenceSABARI PRIYAN's self introduction as reference
SABARI PRIYAN's self introduction as reference
 
Artificial Intelligence and its Impact on Society.pptx
Artificial Intelligence and its Impact on Society.pptxArtificial Intelligence and its Impact on Society.pptx
Artificial Intelligence and its Impact on Society.pptx
 
AWS Identity and access management for users
AWS Identity and access management for usersAWS Identity and access management for users
AWS Identity and access management for users
 
Lies and Myths in InfoSec - 2023 Usenix Enigma
Lies and Myths in InfoSec - 2023 Usenix EnigmaLies and Myths in InfoSec - 2023 Usenix Enigma
Lies and Myths in InfoSec - 2023 Usenix Enigma
 
PredictuVu ProposalV1.pptx
PredictuVu ProposalV1.pptxPredictuVu ProposalV1.pptx
PredictuVu ProposalV1.pptx
 
Big Data - large Scale data (Amazon, FB)
Big Data - large Scale data (Amazon, FB)Big Data - large Scale data (Amazon, FB)
Big Data - large Scale data (Amazon, FB)
 
Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...
Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...
Generative AI Rennes Meetup with OVHcloud - WAICF highlights & how to deploy ...
 
Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...
Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...
Web 3.0 in Data Privacy and Security | Data Privacy |Blockchain Security| Cyb...
 
IIBA Adl - Being Effective on Day 1 - Slide Deck.pdf
IIBA Adl - Being Effective on Day 1 - Slide Deck.pdfIIBA Adl - Being Effective on Day 1 - Slide Deck.pdf
IIBA Adl - Being Effective on Day 1 - Slide Deck.pdf
 
Industry 4.0 in IoT Transforming the Future.pptx
Industry 4.0 in IoT Transforming the Future.pptxIndustry 4.0 in IoT Transforming the Future.pptx
Industry 4.0 in IoT Transforming the Future.pptx
 
Oppotus - Malaysians on Malaysia 4Q 2023.pdf
Oppotus - Malaysians on Malaysia 4Q 2023.pdfOppotus - Malaysians on Malaysia 4Q 2023.pdf
Oppotus - Malaysians on Malaysia 4Q 2023.pdf
 
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
[IRTalks@The University of Glasgow] A Topology-aware Analysis of Graph Collab...
 
data analytics and tools from in2inglobal.pdf
data analytics  and tools from in2inglobal.pdfdata analytics  and tools from in2inglobal.pdf
data analytics and tools from in2inglobal.pdf
 
Soil Health Policy Map Years 2020 to 2023
Soil Health Policy Map Years 2020 to 2023Soil Health Policy Map Years 2020 to 2023
Soil Health Policy Map Years 2020 to 2023
 

TECHTalks - Philadelphia PA - Brien Blandford

  • 1. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 2 © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Brien Blandford Partner Solutions Architect Amazon Web Services brieb@amazon.com Data Lakes and Serverless Computing
  • 2. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 3 The world’s most valuable resource is *Copyright: The Economist, 2017, David Parkins Data is an Asset
  • 3. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 4 * IDC, Data Age 20215: The Evolution of Data to Life-Critical Don’t Focus on Big Data, Focus on the Data That’s Big, April 2017. Data every 5 years Thereismore data than people think 01100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 00001010 01100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 00001010 01100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 00001010 01100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 00001010 01100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 0000101001100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 00001010 01100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 00001010 01100111 01100101 01110100 00100000 01100001 00100000 01101000 01101111 01100010 01100010 01111001 00001101 00001010 0110011 01100010 01100010 01111001 00001101 0000101001100111 01100101 01110100 00100000 15 years live for Data platforms need to 1,000x scale >10x grows
  • 4. CHALLENGE Need to create constant feedback loop for designers Gain up-to-the-minute understanding of gamer satisfaction to guarantee gamers are engaged, thus resulting in the most popular game played in the world Fortnite | 125+ million players
  • 5. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 6 Equinox Fitness Cubs is a company with integrated luxury and lifestyle offerings centered on movement, nutrition and regeneration. Equinox built connected experiences using applications that connect to Apple Health and built data collection in their exercise equipment. More than 200 locations within every major city across the U.S., London, and Canada
  • 6. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 7 © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How do we build new types of applications that can leverage this data?
  • 7. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 8 Two Innovations in Tech Serverless Data Lakes
  • 8. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 9 What is Serverless?
  • 9. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 10 Amazon.com traffic November 76% 24%
  • 10. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 11 What changes have to be made in this new world? Architectural patterns Operational model Software delivery
  • 11. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 12 monolithic application + teams 2001 Lesson learned: decompose for agility 2002 microservices + 2 pizza teams
  • 12. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 13 On-premise server provisioning X max demand 110% X cost 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 230 1 2 3 4 5 X
  • 13. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 14 Auto-scaling 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 230 1 2 3 4 5 X max demand 61% X cost
  • 14. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 15 Auto-scaling more granularly 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 230 1 2 3 4 5 X max demand 51% X cost
  • 15. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 16 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 230 1 2 3 4 5 Auto-scaling with reserved instances X max demand 47% X cost
  • 16. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 17 What is Serverless? No infrastructure provisioning, no management Automatic scaling Pay for value Highly available and secure
  • 17. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 18 Comparison ofOperational Responsibility AWS Lambda Serverless Functions AWS Fargate Serverless Containers Amazon ECS/EKS Container Management Service Amazon EC2 Compute as a Service More opinionated Less opinionated AWS manages Customer manages • Data source integrations • Physical hardware, software, networking, and facilities • Provisioning • Application code • Container orchestration, provisioning • Cluster scaling • Physical hardware, host OS/kernel, networking, and facilities • Container orchestration control plane • Physical hardware software, networking, and facilities • Application code • Data source integrations • Work clusters • Security config and updates, network config, firewall, management tasks • Physical hardware software, networking, and facilities • Application code • Data source integrations • Scaling • Security config and updates, network config, management tasks • Provisioning, managing scaling and patching of servers • Application code
  • 18. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 19 On-Premises Cloud Less Compute Virtual Machine EC2 Elastic Beanstalk AWS LambdaFargate Databases MySQL MySQL on EC2 RDS MySQL RDS Aurora Aurora Serverless DynamoDB Storage Storage S3 Messaging ESBs Amazon MQ Kinesis SQS / SNS Analytics Hadoop Hadoop on EC2 EMR Elasticsearch Service Athena FromOn-Prem to Serverless AWS Storage GW Amazon EBS More Serverless
  • 19. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 20 Cloud-native architectures are small pieces, loosely joined
  • 20. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 21 SoWhat are Data Lakes?
  • 21. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 22 Customers want more value from their data Growing exponentially From new sources Increasingly diverse Used by many people Analyzed by many applications
  • 22. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 23 Companies want more value from their data Complications Siloed approaches don’t work anymore It’s too expensive and limiting to store data on-premises Implication A new approach is needed to extract insights and value
  • 23. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 24 Cloud data lakes are the future Data lake Customers want: To move to a single store, i.e., a data lake in the cloud To store data securely in standard formats To grow to any scale with low costs To analyze their data in a variety of ways To easily access and analyze data
  • 24. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 25 Store exabytes of data Stage from landing dock to transformed to curated – Make available in each stage Load, transform, and catalog once Make data available to many tools Open formats and interfaces support innovationBig Data Huge Data Bulk Ingestion RealTime Streams Data Lake Data Warehouse Analytics Adhoc Query Realtime Data Elasticsearch Data lakes help you cost-effectively scale Media Ingestion AI/ML Services Visualization What Makes a Data Lake
  • 25. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 27 How it works – Serverless Data Lakes and analytics IAM Encryption OLTP ERP CRM LOB Devices Web Sensors Social Streaming Build Data Lakes quickly • Identify, crawl, and catalog sources • Ingest and clean data • Transform into optimal formats Simplify security management • Enforce encryption • Define access policies • Implement audit login Enable self-service and combined analytics • Analysts discover all data available for analysis from a single data catalog • Use multiple analytics tools over the same data Adhoc Query Data Warehouse AI/ML Services Analytics Visualization Data Catalog Data Lake
  • 26. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 29 Amazon S3 Data lake AWS Glue (ETL & Data Catalog) Athena Amazon QuickSight Serverless. Zero infrastructure. Zero administration Never pay for idle resources $ Availability and fault tolerance built in Automatically scales resources with usage AWS IoT Core AI/ML Devices Web Sensors Social Serverless Analytics – Deliver On-Demand Kinesis Firehose Consumer
  • 27. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 30 What do you want to Build today?

Editor's Notes

  1. Let’s start with microservices, and how Amazon.com has experience transforming our organization to use microservices. Moving from monoliths to microservices is an organizational change, not just a development and software change.
  2. Brien Blandford is a Partner Solutions Architect for AWS. His role is to provide our partners with the necessary resources to deliver results to our mutual customers. Brien started with AWS in 2016 with the infrastructure team (yes, he has been in many AWS data centers!) in Seattle, but returned to the New York City region in 2018.
  3. https://aws.amazon.com/blogs/gametech/epic-fortnite-all-in-on-aws-cloud/
  4. https://aws.amazon.com/blogs/big-data/closing-the-customer-journey-loop-with-amazon-redshift-at-equinox-fitness-clubs/
  5. *and do it cost-effectively?
  6. We are going to cover the basics of serverless compute, how it changes your paradigm for software delivery, maintenance, and use Then we will discuss Data Lakes and the natural affinity for serverless architectures
  7. Let’s start with microservices, and how Amazon.com has experience transforming our organization to use microservices. Moving from monoliths to microservices is an organizational change, not just a development and software change.
  8. This kind of approach is a natural fit for building modern applications, which are serverless microservices, delivered with automated release pipelines. So lets look at what changes need to be made and how AWS has helped many of these customers with those changes This is just Amazon’s story but hundreds of thousands of customers have embarked on this journey as well
  9. We’ll start by using Amazon as an example of building modern applications. At Amazon the way we build software is really driven by maximizing innovation. And specifically, the kind of innovation that lets you do lots and lots of experiments. And while that’s always been part of our DNA, back in 2001 our application itself looked a whole lot different. At that time, Amazon had one giant monolith and one giant database. It wasn’t very agile. IF you wanted to add a new product, you had to do that by editing stuff that was designed for our first product – the book store. This wasn’t conducive to innovation at all. So in 2001 we changed the way we built applications and decomposed to microservices and 2 pizza teams. And yes, the move to microservices was a technical decision but it was also supported by organizational design patterns and a culture that granted teams more ownership over a smaller piece of code - a microservice.
  10. Assuming one provisions for a little more (10%) of peak anticipation
  11. 72 possible squares 44 Used
  12. 120 possible squares 61 Used
  13. 120 possible squares 24 Reserved 30 on demand
  14. So what is serverless? When we say serverless, we mean it’s the removal of the undifferentiated heavy lifting that is server operations. This is an important distinction for customers because it allows customers to focus on the building of the application rather than the management and scaling of the infrastructure to support the application. This means not thinking about infrastructure or scaling. It means you only pay for what you value, and it means availability and security are built in. --- These are the tenets that define serverless as an operational model (unless you know better ones):  No infrastructure to provision or manage (no servers to provision, operate, patch, etc.) Automatically scales by unit of consumption (scales by unit of work/consumption rather than by server unit) Pay for value billing model (if you value consistent throughput or execution duration you only pay for that unit rather than by server unit) Built-in availability and fault tolerance (no need to architect for availability because it is built into the service)  
  15. You have heard us talk about shared responsibility in the past. Simply stated, a shared responsibility model implies there are parts of the system that AWS is responsible for and there are parts of the systems that you as a customer must take responsibility for. In many cases we provide tools and there is a rich ecosystem of open source and commercial products that makes it easier for all of you to own your side of the responsibility box. There is no one hard line on where this line is drawn between the two parts of shared responisbility. One one side of the spectrum you can leverage the power and flexibility of EC2 to run your own database. You can use something like RDS to simplify the management of the database or use RDS Aurora to completely offload the database storage infrastructure to an AWS managed backend. Alternatively you can move to a fully managed database like DynamoDB where you create tables, put data in those tables, and query the data. There is no infrastructure to manage. QoS is part of the the database service with sufficient knobs and dials to give you the right level of control. The question we keep asking ourselves is: how can we draw this line in a way that allows our customers to innovate on business problems, but makes the underlying infrastructure less visible. Any time you spend coraling infrastructure is undifferentiated heavy lifting. Over the last 12 years as more and more people start in the cloud or move major applications to the cloud, this definition of "undifferentiated havy lifting has evolved"
  16. You have heard us talk about shared responsibility in the past. Simply stated, a shared responsibility model implies there are parts of the system that AWS is responsible for and there are parts of the systems that you as a customer must take responsibility for. In many cases we provide tools and there is a rich ecosystem of open source and commercial products that makes it easier for all of you to own your side of the responsibility box. There is no one hard line on where this line is drawn between the two parts of shared responsibility. One one side of the spectrum you can leverage the power and flexibility of EC2 to run your own database. You can use something like RDS to simplify the management of the database or use RDS Aurora to completely offload the database storage infrastructure to an AWS managed backend. Alternatively you can move to a fully managed database like DynamoDB where you create tables, put data in those tables, and query the data. There is no infrastructure to manage. QoS is part of the the database service with sufficient knobs and dials to give you the right level of control. The question we keep asking ourselves is: how can we draw this line in a way that allows our customers to innovate on business problems, but makes the underlying infrastructure less visible. Any time you spend corralling infrastructure is undifferentiated heavy lifting. Over the last 12 years as more and more people start in the cloud or move major applications to the cloud, this definition of "undifferentiated heavy lifting has evolved" This is essentially a recap of what we discussed earlier with databases. There is a spectrum of shared responsibility you have over your options for compute. With EC2, you can build and run things, but you manage integrations, scaling, security config, provisioning, patching etc. in addition to your code. Compare that to Lambda, where all you mange is your application code.
  17. So changes to the architectural pattern are really defined by this quote. If you can loosely couple things, and do lots and lots of experienemts, you’re going to be able to learn faster, and produce more innovation.