SlideShare a Scribd company logo
1 of 34
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Craig Stires
Head of AI, Analytics, Big Data - Asia Pacific, AWS
Better Business from Exploring Ideas
Modern Data Architectures on AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s go on a common customer journey
Meet EarEcstasy, as they move from B2B to B2C
* This case is representative of a common customer journey, but EarEcstasy isn’t an actual business
EarEcstasy manufacturers headsets. They ran
a traditional B2B business since 2005, selling
through distribution and retail channels.
2005
In 2018, they launched their first “Smart
Buds”. These wireless headsets have voice
enablement, GPS tracking, and heartrate
monitors built in, and the device syncs with
the users mobile phone via Bluetooth. The
mobile app also supports scene detection.
2018
EarEcstasy needs to answer new questions and move faster
Raymond, Head of ProductLim, Head of Finance
Which regions are the new earbuds selling well?
What is the demand forecast by product category?
What is the social sentiment about our products?
How do quality issues impact cost of production?
Can I look at supplier performance over time?
How can we reduce our inventory holding costs?
To answer new questions quickly, we look to a
modern data architecture design
Massive upfront costs
Overprovisioned capacity
Long implementation times
Pay as you go, for what you use
Decoupled pipelines and engines
Experimentation platform
Ingest/
Collect
Consume/
visualize
Store Process/
analyze
1 4
0 9
5
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Outcome 1: Modernize and consolidate
Start with a set of specific questions to answer, then work
backwards to the data required
Lim, Head of Finance
How do quality issues impact cost of production?
Can I look at supplier performance over time?
How can we reduce our inventory holding costs?
Order History /
Returns (CRM)
Inventory /
Production (ERP)
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
ERP
Data analysts
DATA PIPELINES
Ingest/
Collect
Consume /
visualize
Store Process /
analyze
1 4
0 9
5
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Start small and iterate
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
ERP
DATA PIPELINES
Data
Lake
expdp
Data Data analysts
Data Warehouse
Amazon Redshift
Direct Query
Amazon Athena
She asks for the SMALLEST amount of data to answer her questions.
If it isn’t good enough, she asks for another small slice to be loaded to the DATA LAKE
Amazon Redshift – Modern Data Warehousing
Fast, scalable, fully managed data warehouse at 1/10th the cost
Massively parallel, scales from gigabytes to exabytes
Queries data across your Redshift data warehouse and Amazon S3 data lake
Fast at scale
Columnar storage
technology to improve I/O
efficiency and scale query
performance
Open file formats
Analyze optimized data
formats on direct-attached
disks, and all open file
formats in S3
Cost-effective
Start at $0.25 per hour;
as low as $250-$333 per
uncompressed terabyte
per year
$
Secure
Audit everything; encrypt
data end-to-end; extensive
certification and compliance
Characteristics of a Data Lake
Future
Proof
Flexible
Access
Dive in
Anywhere
Collect
Anything
Start with a set of specific questions to answer, then work
backwards to the data required
Raymond, Head of Product
Which regions are the new earbuds selling well?
What is the demand forecast by product category?
What is the social sentiment about our products?
Trending /
Mentions (Social)
Order History /
Returns (CRM)
NOW IN THE DATA LAKE
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Experiment, validate, then scale
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
DATA PIPELINES
Data
Lake
He first looks to the DATA LAKE, and imports only the category data he needs
He imports JUST ENOUGH data to see if the market is responding to products.
Business users
Transactions
ERP
Social media
Data
Stream
Capture
Amazon
Kinesis
Events
Amazon
QuickSight
Data Warehouse
Amazon Redshift
Stream Data
Amazon
ElasticSearch
Common data pipeline configuration
Raw Data
Amazon S3
Highly decoupled configurations scale better, are more fault tolerant, and cost optimized
ETL (Hadoop)
Amazon EMR
Triggered Code
Amazon Lambda
Staged Data
(Data Lake)
Amazon S3
ETL & Catalog Management
AWS Glue
Data Warehouse
Amazon Redshift
Triggered Code
Amazon Lambda
Data security
and management
Encryption
Access Controls
Monitoring and Metrics
Audit Trails
Automation
Serverless Computing
Data Discovery and
Protection
Data Visualization
Data movement
Physical Appliances
Hybrid Storage
Private Networks
File Data
WAN Acceleration
Third-party Applications
Streaming Data
Complete set of building blocks
FileBlock
Object Archival
Storage types
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
ERP
Data analysts
Business users
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
Social media
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Outcome 2: Innovate for new revenues
EarEcstasy has its first direct relationship with consumers
Krzysztof, Data ScientistBala, Head of Marketing
What are our customer segments, based on usage?
Can predict music preference from location and HR?
Are there additional signals in the voice commands?
Can we infer user activity, from scenes in pictures?
How are people using the Smart Buds?
How to understand what they listen to and when?
What kinds of people are in/decreasing usage?
Start with a set of specific questions to answer, then work
backwards to the data required
Bala, Head of Marketing
How are people using the Smart Buds?
How to understand what they listen to and when?
What kinds of people are in/decreasing usage?
Media
consumption
(Partner API)
Registration,
usage [time/place]
(Mobile app)
Start with a set of specific questions to answer, then work
backwards to the data required
Krzysztof, Data Scientist
What are our customer segments, based on usage?
Can predict music preference from location and HR?
Are there additional signals in the voice commands?
Can we infer user activity, from scenes in pictures?
HR, Voice, GPS,
Images (Device
data)
DATA LAKE, OR NOT?
Registration,
usage [time/place]
(Mobile app)
LOAD TO DATA LAKE
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sandboxes - fast, cheap, low risk
Ingest ServingData
sources
Modern data architecture
Insights to enhance business applications, new digital services
Transactions
Data scientists
Business users
Connected
devices
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
Sandbox
ML / Analytics / DLWeb logs /
clickstream
Ingest ServingData
sources
Modern data architecture
Innovate for new revenues - personalization and forecasting
Transactions
ERP
Data analysts
Data scientists
Business users
Connected
devices
DATA PIPELINES
EVENT PIPELINES
Data
Event
Insights
Data
Lake
ML / Analytics
Social media
Web logs /
clickstream
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Outcome 3: Real-time engagement
EarEcstasy offers a personalized life soundtrack
Personalized, based on
past preferences,
people with similar behaviors,
and environments detected
Use EarEcstasy voice enablement to play music
I’m tired, play me
some music!
Amazon Transcribe
/ Comprehend
Action: PLAY
Category: MUSIC
Genre: <RECOMMEND>
Request content
HISTORY
Twenty One Pilots!
PEOPLE LIKE YOU
Amazon Kinesis
Streams
Connected device data
Location: <FIND GPS>
Mood: <FIND HR>
Use the mobile app to take a picture to identify
activity
A QUIET OFFICE
Amazon SageMaker
Image Classification
Amazon Rekognition
Image
CHAIR
LAPTOP
LAMP
DESK
97%
95%
88%
82%
Object Identification
WORKING!
<HISTORY>
Ingest ServingData
sources
Modern data architecture
Real-time engagement and interactive customer experiences
Transactions
ERP
Data analysts
Data scientists
Business users
Engagement platformsConnected
devices
Automation / events
DATA PIPELINES
EVENT PIPELINES
Data
Event Action
Insights
Data
Lake
ML / Analytics
Predict /
Recommend
AI Services
Social media
Web logs /
clickstream
Business Outcomes on a Modern Data Architecture
Outcome 1 : Modernize and consolidate
• Insights to enhance business applications and create new digital
services
Outcome 2 : Innovate for new revenues
• Personalization, demand forecasting, risk analysis
Outcome 3 : Real-time engagement
• Interactive customer experience, event-driven automation, fraud
detection
Ready to build better business from your ideas?
Short list projects that
directly impact
customer engagement
and adoption
Build simple data
pipelines that allow you
to test new ideas, and
fill your data lake
Ask our solution architects
and professional services
teams to help you build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Summit sessions to dive deeper:
Wednesday (04-April-18)
14:00 Architecting a Serverless Data Lake on AWS
15:10 Machine Learning in Practice
16:20 Artificial Intelligence to Delight Your Customers
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Please complete the session survey in the
summit mobile app.
Thank you!

More Related Content

What's hot

AWS Summit Singapore 2019 | Enterprise Migration Journey Roadmap
AWS Summit Singapore 2019 | Enterprise Migration Journey RoadmapAWS Summit Singapore 2019 | Enterprise Migration Journey Roadmap
AWS Summit Singapore 2019 | Enterprise Migration Journey RoadmapAWS Summits
 
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summits
 
Initiate Edinburgh 2019 - AWS in the UK
Initiate Edinburgh 2019 - AWS in the UKInitiate Edinburgh 2019 - AWS in the UK
Initiate Edinburgh 2019 - AWS in the UKAmazon Web Services
 
Initiate Edinburgh 2019 - The AWS Way to Smart Cities
Initiate Edinburgh 2019 - The AWS Way to Smart CitiesInitiate Edinburgh 2019 - The AWS Way to Smart Cities
Initiate Edinburgh 2019 - The AWS Way to Smart CitiesAmazon Web Services
 
Achieving Business Value - Virtual Transformation Day Feb 2019
Achieving Business Value - Virtual Transformation Day Feb 2019Achieving Business Value - Virtual Transformation Day Feb 2019
Achieving Business Value - Virtual Transformation Day Feb 2019Amazon Web Services
 
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise StrategyAWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise StrategyAmazon Web Services
 
Closing - Virtual Transformation Day Feb 2019
Closing - Virtual Transformation Day Feb 2019Closing - Virtual Transformation Day Feb 2019
Closing - Virtual Transformation Day Feb 2019Amazon Web Services
 
Driving Digital Transformation for Citizen Services
Driving Digital Transformation for Citizen Services  Driving Digital Transformation for Citizen Services
Driving Digital Transformation for Citizen Services Amazon Web Services
 
AWS 預測性維護與智慧物聯應用
AWS 預測性維護與智慧物聯應用AWS 預測性維護與智慧物聯應用
AWS 預測性維護與智慧物聯應用Amazon Web Services
 
AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018
AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018
AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018Amazon Web Services
 
The Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration JourneyThe Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration JourneyAmazon Web Services
 
Starting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelStarting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelBoaz Ziniman
 
Education: Digital Transformation & AWS Foundations
Education: Digital Transformation & AWS FoundationsEducation: Digital Transformation & AWS Foundations
Education: Digital Transformation & AWS FoundationsAmazon Web Services
 
Drive Digital Transformation Using AI
Drive Digital Transformation Using AIDrive Digital Transformation Using AI
Drive Digital Transformation Using AIAmazon Web Services
 
The Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedThe Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedAmazon Web Services
 
An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...Amazon Web Services
 
Modern Application Development in the Cloud
Modern Application Development in the CloudModern Application Development in the Cloud
Modern Application Development in the CloudAmazon Web Services
 

What's hot (20)

AWS Summit Singapore 2019 | Enterprise Migration Journey Roadmap
AWS Summit Singapore 2019 | Enterprise Migration Journey RoadmapAWS Summit Singapore 2019 | Enterprise Migration Journey Roadmap
AWS Summit Singapore 2019 | Enterprise Migration Journey Roadmap
 
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
 
Hive: A Cloud Story
Hive: A Cloud StoryHive: A Cloud Story
Hive: A Cloud Story
 
Initiate Edinburgh 2019 - AWS in the UK
Initiate Edinburgh 2019 - AWS in the UKInitiate Edinburgh 2019 - AWS in the UK
Initiate Edinburgh 2019 - AWS in the UK
 
Initiate Edinburgh 2019 - The AWS Way to Smart Cities
Initiate Edinburgh 2019 - The AWS Way to Smart CitiesInitiate Edinburgh 2019 - The AWS Way to Smart Cities
Initiate Edinburgh 2019 - The AWS Way to Smart Cities
 
Achieving Business Value - Virtual Transformation Day Feb 2019
Achieving Business Value - Virtual Transformation Day Feb 2019Achieving Business Value - Virtual Transformation Day Feb 2019
Achieving Business Value - Virtual Transformation Day Feb 2019
 
Logrando valor de negocio con AWS
Logrando valor de negocio con AWSLogrando valor de negocio con AWS
Logrando valor de negocio con AWS
 
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise StrategyAWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
AWS Summit Kuala Lumpur Keynote with Stephen Orban - Head of Enterprise Strategy
 
Closing - Virtual Transformation Day Feb 2019
Closing - Virtual Transformation Day Feb 2019Closing - Virtual Transformation Day Feb 2019
Closing - Virtual Transformation Day Feb 2019
 
Driving Digital Transformation for Citizen Services
Driving Digital Transformation for Citizen Services  Driving Digital Transformation for Citizen Services
Driving Digital Transformation for Citizen Services
 
AWS 預測性維護與智慧物聯應用
AWS 預測性維護與智慧物聯應用AWS 預測性維護與智慧物聯應用
AWS 預測性維護與智慧物聯應用
 
AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018
AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018
AIoT: AI Meets IoT (IOT204) - AWS re:Invent 2018
 
The Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration JourneyThe Secret Treasures of Cloud Migration Journey
The Secret Treasures of Cloud Migration Journey
 
Starting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay IsraelStarting your cloud journey - AWSomeDay Israel
Starting your cloud journey - AWSomeDay Israel
 
Amazon SageMaker
Amazon SageMakerAmazon SageMaker
Amazon SageMaker
 
Education: Digital Transformation & AWS Foundations
Education: Digital Transformation & AWS FoundationsEducation: Digital Transformation & AWS Foundations
Education: Digital Transformation & AWS Foundations
 
Drive Digital Transformation Using AI
Drive Digital Transformation Using AIDrive Digital Transformation Using AI
Drive Digital Transformation Using AI
 
The Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons LearnedThe Future of Enterprise IT - Lessons Learned
The Future of Enterprise IT - Lessons Learned
 
An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...
An Overview of Best Practices for Large-Scale Migrations - AWS Transformation...
 
Modern Application Development in the Cloud
Modern Application Development in the CloudModern Application Development in the Cloud
Modern Application Development in the Cloud
 

Similar to Modern Data Architectures for Customer Insights

AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAmazon Web Services
 
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Amazon Web Services Korea
 
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...Amazon Web Services
 
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...Amazon Web Services
 
Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018Amazon Web Services
 
Better Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWSBetter Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWSAmazon Web Services
 
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)Amazon Web Services
 
An Overview of Machine Learning on AWS
An Overview of Machine Learning on AWSAn Overview of Machine Learning on AWS
An Overview of Machine Learning on AWSAmazon Web Services
 
Better Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWSBetter Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWSAmazon Web Services
 
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureGet to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureAmazon Web Services
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...AWS Summits
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Amazon Web Services
 
Hadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHortonworks
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Amazon Web Services
 
Build and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureBuild and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureAmazon Web Services
 
Leveraging Cloud Analytics to Support Data-Driven Decisions
Leveraging Cloud Analytics to Support Data-Driven DecisionsLeveraging Cloud Analytics to Support Data-Driven Decisions
Leveraging Cloud Analytics to Support Data-Driven DecisionsAmazon Web Services
 
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2Amazon Web Services
 
AWS Initiate Day Manchester 2019 – AWS Big Data Meets AI
AWS Initiate Day Manchester 2019 – AWS Big Data Meets AIAWS Initiate Day Manchester 2019 – AWS Big Data Meets AI
AWS Initiate Day Manchester 2019 – AWS Big Data Meets AIAmazon Web Services
 
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech TalksEnabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech TalksAmazon Web Services
 
Hooduku - Big data analytics - case study
Hooduku - Big data analytics - case studyHooduku - Big data analytics - case study
Hooduku - Big data analytics - case studySudhi Seshachala
 

Similar to Modern Data Architectures for Customer Insights (20)

AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data ArchitectureAWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
AWS Summit Singapore - Get to Know Your Customers - Modern Data Architecture
 
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
Data Analytics를 통한 비지니스 혁신::Craig Stries::AWS Summit Seoul 2018
 
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
Pemahaman Pelanggan & Machine Learning (Level 200 – 300) | Kenali Pelanggan A...
 
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
AWS Summit Webinar Edition | Modern Data Architecture | Microsoft Application...
 
Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018Better Business From Exploring Ideas - AWS Summit Sydney 2018
Better Business From Exploring Ideas - AWS Summit Sydney 2018
 
Better Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWSBetter Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWS
 
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
雲上打造資料湖 (Data Lake):智能化駕馭商機 (Level 300)
 
An Overview of Machine Learning on AWS
An Overview of Machine Learning on AWSAn Overview of Machine Learning on AWS
An Overview of Machine Learning on AWS
 
Better Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWSBetter Business from Exploring Ideas - Modern Data Architectures on AWS
Better Business from Exploring Ideas - Modern Data Architectures on AWS
 
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data ArchitectureGet to Know Your Customers - Build and Innovate with a Modern Data Architecture
Get to Know Your Customers - Build and Innovate with a Modern Data Architecture
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
 
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
Building with AWS Databases: Match Your Workload to the Right Database | AWS ...
 
Hadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data ProcessingHadoop 2.0: YARN to Further Optimize Data Processing
Hadoop 2.0: YARN to Further Optimize Data Processing
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML
 
Build and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data ArchitectureBuild and Innovate with a Modern Data Architecture
Build and Innovate with a Modern Data Architecture
 
Leveraging Cloud Analytics to Support Data-Driven Decisions
Leveraging Cloud Analytics to Support Data-Driven DecisionsLeveraging Cloud Analytics to Support Data-Driven Decisions
Leveraging Cloud Analytics to Support Data-Driven Decisions
 
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
 
AWS Initiate Day Manchester 2019 – AWS Big Data Meets AI
AWS Initiate Day Manchester 2019 – AWS Big Data Meets AIAWS Initiate Day Manchester 2019 – AWS Big Data Meets AI
AWS Initiate Day Manchester 2019 – AWS Big Data Meets AI
 
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech TalksEnabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
Enabling New Retail Customer Experiences with Big Data - AWS Online Tech Talks
 
Hooduku - Big data analytics - case study
Hooduku - Big data analytics - case studyHooduku - Big data analytics - case study
Hooduku - Big data analytics - case study
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Modern Data Architectures for Customer Insights

  • 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Craig Stires Head of AI, Analytics, Big Data - Asia Pacific, AWS Better Business from Exploring Ideas Modern Data Architectures on AWS
  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Let’s go on a common customer journey
  • 3. Meet EarEcstasy, as they move from B2B to B2C * This case is representative of a common customer journey, but EarEcstasy isn’t an actual business EarEcstasy manufacturers headsets. They ran a traditional B2B business since 2005, selling through distribution and retail channels. 2005 In 2018, they launched their first “Smart Buds”. These wireless headsets have voice enablement, GPS tracking, and heartrate monitors built in, and the device syncs with the users mobile phone via Bluetooth. The mobile app also supports scene detection. 2018
  • 4. EarEcstasy needs to answer new questions and move faster Raymond, Head of ProductLim, Head of Finance Which regions are the new earbuds selling well? What is the demand forecast by product category? What is the social sentiment about our products? How do quality issues impact cost of production? Can I look at supplier performance over time? How can we reduce our inventory holding costs?
  • 5. To answer new questions quickly, we look to a modern data architecture design Massive upfront costs Overprovisioned capacity Long implementation times Pay as you go, for what you use Decoupled pipelines and engines Experimentation platform Ingest/ Collect Consume/ visualize Store Process/ analyze 1 4 0 9 5
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Outcome 1: Modernize and consolidate
  • 7. Start with a set of specific questions to answer, then work backwards to the data required Lim, Head of Finance How do quality issues impact cost of production? Can I look at supplier performance over time? How can we reduce our inventory holding costs? Order History / Returns (CRM) Inventory / Production (ERP)
  • 8. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions ERP Data analysts DATA PIPELINES Ingest/ Collect Consume / visualize Store Process / analyze 1 4 0 9 5
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Start small and iterate
  • 10. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions ERP DATA PIPELINES Data Lake expdp Data Data analysts Data Warehouse Amazon Redshift Direct Query Amazon Athena She asks for the SMALLEST amount of data to answer her questions. If it isn’t good enough, she asks for another small slice to be loaded to the DATA LAKE
  • 11. Amazon Redshift – Modern Data Warehousing Fast, scalable, fully managed data warehouse at 1/10th the cost Massively parallel, scales from gigabytes to exabytes Queries data across your Redshift data warehouse and Amazon S3 data lake Fast at scale Columnar storage technology to improve I/O efficiency and scale query performance Open file formats Analyze optimized data formats on direct-attached disks, and all open file formats in S3 Cost-effective Start at $0.25 per hour; as low as $250-$333 per uncompressed terabyte per year $ Secure Audit everything; encrypt data end-to-end; extensive certification and compliance
  • 12. Characteristics of a Data Lake Future Proof Flexible Access Dive in Anywhere Collect Anything
  • 13. Start with a set of specific questions to answer, then work backwards to the data required Raymond, Head of Product Which regions are the new earbuds selling well? What is the demand forecast by product category? What is the social sentiment about our products? Trending / Mentions (Social) Order History / Returns (CRM) NOW IN THE DATA LAKE
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Experiment, validate, then scale
  • 15. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services DATA PIPELINES Data Lake He first looks to the DATA LAKE, and imports only the category data he needs He imports JUST ENOUGH data to see if the market is responding to products. Business users Transactions ERP Social media Data Stream Capture Amazon Kinesis Events Amazon QuickSight Data Warehouse Amazon Redshift Stream Data Amazon ElasticSearch
  • 16. Common data pipeline configuration Raw Data Amazon S3 Highly decoupled configurations scale better, are more fault tolerant, and cost optimized ETL (Hadoop) Amazon EMR Triggered Code Amazon Lambda Staged Data (Data Lake) Amazon S3 ETL & Catalog Management AWS Glue Data Warehouse Amazon Redshift Triggered Code Amazon Lambda
  • 17. Data security and management Encryption Access Controls Monitoring and Metrics Audit Trails Automation Serverless Computing Data Discovery and Protection Data Visualization Data movement Physical Appliances Hybrid Storage Private Networks File Data WAN Acceleration Third-party Applications Streaming Data Complete set of building blocks FileBlock Object Archival Storage types
  • 18. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions ERP Data analysts Business users DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake Social media
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Outcome 2: Innovate for new revenues
  • 20. EarEcstasy has its first direct relationship with consumers Krzysztof, Data ScientistBala, Head of Marketing What are our customer segments, based on usage? Can predict music preference from location and HR? Are there additional signals in the voice commands? Can we infer user activity, from scenes in pictures? How are people using the Smart Buds? How to understand what they listen to and when? What kinds of people are in/decreasing usage?
  • 21. Start with a set of specific questions to answer, then work backwards to the data required Bala, Head of Marketing How are people using the Smart Buds? How to understand what they listen to and when? What kinds of people are in/decreasing usage? Media consumption (Partner API) Registration, usage [time/place] (Mobile app)
  • 22. Start with a set of specific questions to answer, then work backwards to the data required Krzysztof, Data Scientist What are our customer segments, based on usage? Can predict music preference from location and HR? Are there additional signals in the voice commands? Can we infer user activity, from scenes in pictures? HR, Voice, GPS, Images (Device data) DATA LAKE, OR NOT? Registration, usage [time/place] (Mobile app) LOAD TO DATA LAKE
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sandboxes - fast, cheap, low risk
  • 24. Ingest ServingData sources Modern data architecture Insights to enhance business applications, new digital services Transactions Data scientists Business users Connected devices DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake Sandbox ML / Analytics / DLWeb logs / clickstream
  • 25. Ingest ServingData sources Modern data architecture Innovate for new revenues - personalization and forecasting Transactions ERP Data analysts Data scientists Business users Connected devices DATA PIPELINES EVENT PIPELINES Data Event Insights Data Lake ML / Analytics Social media Web logs / clickstream
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Outcome 3: Real-time engagement
  • 27. EarEcstasy offers a personalized life soundtrack Personalized, based on past preferences, people with similar behaviors, and environments detected
  • 28. Use EarEcstasy voice enablement to play music I’m tired, play me some music! Amazon Transcribe / Comprehend Action: PLAY Category: MUSIC Genre: <RECOMMEND> Request content HISTORY Twenty One Pilots! PEOPLE LIKE YOU Amazon Kinesis Streams Connected device data Location: <FIND GPS> Mood: <FIND HR>
  • 29. Use the mobile app to take a picture to identify activity A QUIET OFFICE Amazon SageMaker Image Classification Amazon Rekognition Image CHAIR LAPTOP LAMP DESK 97% 95% 88% 82% Object Identification WORKING! <HISTORY>
  • 30. Ingest ServingData sources Modern data architecture Real-time engagement and interactive customer experiences Transactions ERP Data analysts Data scientists Business users Engagement platformsConnected devices Automation / events DATA PIPELINES EVENT PIPELINES Data Event Action Insights Data Lake ML / Analytics Predict / Recommend AI Services Social media Web logs / clickstream
  • 31. Business Outcomes on a Modern Data Architecture Outcome 1 : Modernize and consolidate • Insights to enhance business applications and create new digital services Outcome 2 : Innovate for new revenues • Personalization, demand forecasting, risk analysis Outcome 3 : Real-time engagement • Interactive customer experience, event-driven automation, fraud detection
  • 32. Ready to build better business from your ideas? Short list projects that directly impact customer engagement and adoption Build simple data pipelines that allow you to test new ideas, and fill your data lake Ask our solution architects and professional services teams to help you build
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Summit sessions to dive deeper: Wednesday (04-April-18) 14:00 Architecting a Serverless Data Lake on AWS 15:10 Machine Learning in Practice 16:20 Artificial Intelligence to Delight Your Customers
  • 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Please complete the session survey in the summit mobile app. Thank you!