SlideShare a Scribd company logo
1 of 17
Download to read offline
利用 Cloudfront與Lambda 實現即時閱
讀行為分析架構
Kenny Lee 李坤承
技術長, 風傳媒 Storm.mg
媒體面臨的挑戰
85 percent of Americans use mobile devices to access news
JUNE 12, 2017 Pewresearch.org
手持裝置的普及
紙本的沒落
“I believe at least 10 years is what we can see in the U.S. for our print products”
New York Times CEO - Thompson
Reuters Institute Digital News Report 2017
讀者喜歡演算法更勝編輯
Reuters Institute Digital News Report 2017
全球平均 24% AD-BLOCKING 開始影響線上廣告
Facebook 演算法之亂
2018.02 美國自由派媒體獲得 2% 的流量增加,但保守派媒體失去 14%
BigData for media
媒體的 BigData 在哪裡?
媒體怎麼應用 BigData?
流量背後的使用者行為
大量的影音媒體庫
新聞文字資料庫
媒體的 BigData 在哪裡? 媒體怎麼應用 BigData ?
預測使用者的興趣
個人化的內容推薦
洞察客戶流失的原因
強化廣告投遞
精準的業務行銷
精準的EDM發送
風傳媒如何思考 BigData
風傳媒如何思考 BigData
Data-Driven 信念 :
從IT到編輯到業務,每一個成員都要瞭解Data,融入工作
GA 不夠我們使用:
沒有個別的(individual)資料行為、無法進一步 reach及分析
關於FB:
維持 Instance Article 但發展 AMP,應用但不依賴
即時的(real-time/streaming)、活的Data、Always ready 的 Data
研發精準的推薦引擎、語義分析技術
如何跨出 Data 的第一步 – user behavior collection
蒐集資料量大
效能差
系統需求也大
成本其實也不低
自己寫 API 接口,從前端把資料寫入 DB
Data collection 第一次失敗的經驗
更好的架構
CloudFront:利用既有的架構,開啟 log 儲存到 S3 提供分析
Lambda:log parsing、filter、dispatch
Data Visualization:
ElasticSearch - stream monitor (for IT – SE、Data Engineer)
QuickSight - BI (for data analyst 、sales/marketing)
Amazon
CloudFront
Access Log
bucket
Amazon
SNS
Lambda
Dispatch
EC2
Logstash
Amazon ES
EC2
BigObject
Analytics
Lambda
Firehose
Dispatch
AmazonKinesis
Firehose
Distribute
Access Log
bucket
EC2
Recommendation
Server
mobile APP
AWS WAF
Amazon
Athena
Amazon
QuickSight
Storm Track / Region : Tokyo
kafka
Lambda
Transformation
AWS 提供大量的學習資料,使得成員技術不落後
充分利用費用彈性化及RI特性,使得成本最佳化
Fullstack 分工的開發模式
建構 SaaS 的服務平台
風傳媒的雲端策略
風傳媒未來使用 aws 的目標及應用
Lambda@Edge – 即時讀者文章A/B Testing
Amazon SageMaker – 訓練與部署機器學習模型
Amazon QuickSight – 數據視覺化與商業決策BI
Amazon ECS - 彈性及有效的資源應用

More Related Content

Similar to 利用 Cloudfront 與 Lambda 實現即時閱讀行為分析架構

Wavemaker express weekly #27
Wavemaker express weekly #27Wavemaker express weekly #27
Wavemaker express weekly #27Wavemaker Taiwan
 
雲端產業及巨量資料分析
雲端產業及巨量資料分析雲端產業及巨量資料分析
雲端產業及巨量資料分析RICK Lin
 
Wavemaker express weekly #32
Wavemaker express weekly #32Wavemaker express weekly #32
Wavemaker express weekly #32Wavemaker Taiwan
 
【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7
【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7
【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7數位膠囊
 
Wavemaker express weekly #43
Wavemaker express weekly #43Wavemaker express weekly #43
Wavemaker express weekly #43Wavemaker Taiwan
 
WM Express Weekly-0423.pdf
WM Express Weekly-0423.pdfWM Express Weekly-0423.pdf
WM Express Weekly-0423.pdfWavemaker Taiwan
 
Big Data For CIO_大數據白皮書_2015
Big Data For CIO_大數據白皮書_2015Big Data For CIO_大數據白皮書_2015
Big Data For CIO_大數據白皮書_2015Fang-hsun Yeh
 
數位媒體的客戶洞察行銷術
數位媒體的客戶洞察行銷術數位媒體的客戶洞察行銷術
數位媒體的客戶洞察行銷術Etu Solution
 
大數據與資料科學人才現況與趨勢
大數據與資料科學人才現況與趨勢大數據與資料科學人才現況與趨勢
大數據與資料科學人才現況與趨勢Anna Yen
 
互联网改变了什么 For it
互联网改变了什么 For it互联网改变了什么 For it
互联网改变了什么 For it孔子 无敌
 
博晓通社会化大数据解决方案和公司介绍201406
博晓通社会化大数据解决方案和公司介绍201406博晓通社会化大数据解决方案和公司介绍201406
博晓通社会化大数据解决方案和公司介绍201406Yu Zhang
 
【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8
【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8
【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8數位膠囊
 
Wavemaker express weekly #39
Wavemaker express weekly #39Wavemaker express weekly #39
Wavemaker express weekly #39Wavemaker Taiwan
 
Way to big date 資策會李進寶所長 20120620
Way to big date 資策會李進寶所長 20120620Way to big date 資策會李進寶所長 20120620
Way to big date 資策會李進寶所長 20120620Lawrence Huang
 
兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼
兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼
兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼Yu-Ming Hsu
 
【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6
【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6
【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6數位膠囊
 
魏凯:大数据商业利用的政策管制问题
魏凯:大数据商业利用的政策管制问题魏凯:大数据商业利用的政策管制问题
魏凯:大数据商业利用的政策管制问题hdhappy001
 
New listening 2南宁学生版
New listening 2南宁学生版New listening 2南宁学生版
New listening 2南宁学生版Jing Wang
 
The development trends of smart applications and open source system software ...
The development trends of smart applications and open source system software ...The development trends of smart applications and open source system software ...
The development trends of smart applications and open source system software ...William Liang
 
Wavemaker express weekly #49
Wavemaker express weekly #49Wavemaker express weekly #49
Wavemaker express weekly #49Wavemaker Taiwan
 

Similar to 利用 Cloudfront 與 Lambda 實現即時閱讀行為分析架構 (20)

Wavemaker express weekly #27
Wavemaker express weekly #27Wavemaker express weekly #27
Wavemaker express weekly #27
 
雲端產業及巨量資料分析
雲端產業及巨量資料分析雲端產業及巨量資料分析
雲端產業及巨量資料分析
 
Wavemaker express weekly #32
Wavemaker express weekly #32Wavemaker express weekly #32
Wavemaker express weekly #32
 
【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7
【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7
【數位膠囊】專題:[數位媒體 關鍵對談]系列五 2013.12 no.7
 
Wavemaker express weekly #43
Wavemaker express weekly #43Wavemaker express weekly #43
Wavemaker express weekly #43
 
WM Express Weekly-0423.pdf
WM Express Weekly-0423.pdfWM Express Weekly-0423.pdf
WM Express Weekly-0423.pdf
 
Big Data For CIO_大數據白皮書_2015
Big Data For CIO_大數據白皮書_2015Big Data For CIO_大數據白皮書_2015
Big Data For CIO_大數據白皮書_2015
 
數位媒體的客戶洞察行銷術
數位媒體的客戶洞察行銷術數位媒體的客戶洞察行銷術
數位媒體的客戶洞察行銷術
 
大數據與資料科學人才現況與趨勢
大數據與資料科學人才現況與趨勢大數據與資料科學人才現況與趨勢
大數據與資料科學人才現況與趨勢
 
互联网改变了什么 For it
互联网改变了什么 For it互联网改变了什么 For it
互联网改变了什么 For it
 
博晓通社会化大数据解决方案和公司介绍201406
博晓通社会化大数据解决方案和公司介绍201406博晓通社会化大数据解决方案和公司介绍201406
博晓通社会化大数据解决方案和公司介绍201406
 
【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8
【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8
【數位膠囊】專題:[數位媒體 關鍵對談]系列六 2014.02 no.8
 
Wavemaker express weekly #39
Wavemaker express weekly #39Wavemaker express weekly #39
Wavemaker express weekly #39
 
Way to big date 資策會李進寶所長 20120620
Way to big date 資策會李進寶所長 20120620Way to big date 資策會李進寶所長 20120620
Way to big date 資策會李進寶所長 20120620
 
兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼
兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼
兩分鐘看懂網路與媒體怎麼了、與我們失去了什麼
 
【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6
【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6
【數位膠囊】專題:[數位媒體 關鍵對談]系列加映場 2013.12 no.6
 
魏凯:大数据商业利用的政策管制问题
魏凯:大数据商业利用的政策管制问题魏凯:大数据商业利用的政策管制问题
魏凯:大数据商业利用的政策管制问题
 
New listening 2南宁学生版
New listening 2南宁学生版New listening 2南宁学生版
New listening 2南宁学生版
 
The development trends of smart applications and open source system software ...
The development trends of smart applications and open source system software ...The development trends of smart applications and open source system software ...
The development trends of smart applications and open source system software ...
 
Wavemaker express weekly #49
Wavemaker express weekly #49Wavemaker express weekly #49
Wavemaker express weekly #49
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

利用 Cloudfront 與 Lambda 實現即時閱讀行為分析架構