SlideShare a Scribd company logo
1 of 32
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
全民直播時代的多CDN架構監控
與觀看體驗最佳化
Kim Kao 高翊凱
Solutions Architect
Amazon Web Services
JC Wang 王教昌
Sr. VP of Engineering
浪Live 旭瑞文化傳媒股份有限公司
T r a c k 2 | S e s s i o n 4
Messaging between
microservices
Response analytics
(web and mobile
app notifications)
Log ingestion
IoT device
maintenance
Change data
capture
Streaming extract,
transfer, and load
(ETL) into data lakes
and data warehouses
Milliseconds Seconds Minutes
Common real-time data streaming use cases
What
is a
Live
Event?
Live Sports
Stream?
Answer: They both are
Popular VOD Series
Finale?
What Drives Live Event Scale?
• Peak Concurrent Viewers
• Join Rate
• Geographic/Regional Concentration
Audience Characteristics
Video Characteristics
• Encoded Bit Rate
• Number of formats & profiles
• Segment Duration
How does internet Video work?
1 - Camera/Source generates Video
1 2
2 - Encoder & Packager create
Segmented Video and Manifests for
HLS/DASH
3
4
5
https://mydomain.com/video.m3u8
3 - Player is initiated via a client
requesting a link to the video
(master manifest)
5 - Player requests video segments in sequence
4 - Player requests playlist(s)/manifest(s)
6
6 - Steps 4 & 5 repeat until video ends.
Typical Components of a Video Workflow with AWS
Components
Media
Live
Media
Package
Media Tailor
Media
Store
CloudFront
Web browser
TV
Direct Connect
GroundStation
Media Connect
Vyvx (Centurylink)
Other
Signal Acquisition/Ingest
Transcoding/Packaging/
Personalization/Storage Playout/Delivery
Source/
Venue
Multi-CDNS3 Bucket
Being Redundantly Redundant
• Diverse signal acquisition paths (satellite, terrestrial, multiple networks/links)
• Redundant Encoders with time/epoch locking (primary/secondary stream)
• Encoders writing to redundant origins (packagers/storage) in multiple regions
• DNS-based or API-based traffic management and stream selection by region
• Health checks and failover between primary/secondary in region or across regions
It’s not just about the Video
Web Applications
Mobile App backend
APIs and microsservices
DRM & Key
Management
Authentication and
Tokenization
User/Entitlement
databases
CMS and content
metadata services
Ad networks/
Decisioning/bidding
“Waiting Room”
Many predicate failure modes
Stream hijacking/pirating
Source Interruptions Prescaling/Autoscaling
Capacity Planning &
Allocation
DDoS Attacks
Fiber/Network Issues
Component Failures/
Overload
Network Congestion/
Overload
AWS Advantages: Capacity, Scale, Performance,
Reach
China
Launched in China with 4
New cities:
Beijing, Shanghai,
Zhongwei, Shenzhen
EMEA
4 New countries:
Bahrain, Belgium,
Portugal, Israel
13 Embeds in UK
South America
Added 3 New countries:
Argentina, Chile, and
Colombia
56% price cut
India / Australia
16 PoPs in India
Added 3 PoPs in Syd,
Currently 6 PoPs in AU
210 PoPs in 79 cities, 37 countries
75+ PoPs added in 2019
Japan
Added 6 PoPs in Tokyo.
Currently 17 PoPs in JP
North America
Added 50% more PoPs in
last year. Launched in 2
new cities: Houston and
Salt Lake City
Video Delivery Optimization
• Ingest optimization via S3TA, Media-Connect, Direct Connect or other methods
• Redundancy and regional localization as appropriate
• Encoding/Packaging configuration
First-mile
Video Delivery Optimization in CloudFront
Middle-mile
• Connection keep-alive in cache fill path all the way to origin
• Chunked-transfer encoding
• Hierarchical/Regional caching and Connection Collapsing
• AWS Backbone provides low-latency, high throughput, low-congestion network
• Range Request consolidation & background fetching
• Negative Caching to protect origin
Video Delivery Optimization in CloudFront
Last-mile
• Connection keep-alives
• Protocol Optimization (BBR, MTU, HTTP-2, QUIC/HTTP-3)
• Lots of capacity (>120Tbps of network connectivity)
• Direct Peering with many networks
• Embedded POPs deeper within major consumer ISP networks
• Perimeter Protection @ Edge with WAF & Shield
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
浪Live串流服務的監控與體驗最佳化
JC Wang 王教昌
Sr. VP of Engineering
浪Live 旭瑞文化傳媒股份有限公司
才藝直播 - 浪Live
電競直播 - 浪Play
短影音 - iM短影
浪Live
旭瑞文化傳媒
Agenda
為何需要多CDN架構
如何收集數據了解用戶觀看體驗
推拉流的用戶體驗數據監控架構
導入AWS服務
如何利用卡頓數據改善觀看體驗
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why Multi-CDN strategy ?
Why Multi-CDN Strategy ?
網路覆蓋
推拉流端的設備以及網路環境多樣
跨國的網路覆蓋
備援
降低單一CDN故障的風險
CDN廠商的局部節點錯誤
Why Multi-CDN Strategy ?
容量擴展
大型活動的流量提早分配
非預期的瞬增流量
成本彈性
預算控制 (流量計價 v.s. 峰值計價)
議價空間
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
True Visibility into User Experience
數據收集
OS/ 手機型號/ 網路
/ 頻寬/ bitrate/
frame rate ...etc
src_ip/ bitrate/ fps/
frame_drop … etc
拉流人數/ 來源/ 下
行速度 … etc
cdn / edge node/ 網
速/ 卡頓/ fps/ 網路
...etc
推拉流狀態監控架構
推拉流狀態監控架構 (Phase II)
觀看體驗的監控與警報
觀看體驗的監控與警報
觀看體驗的監控與警報
利用監控數據改善用戶體驗
Dynamic bitrate manipulation: 局部最佳化 → 全局最佳化
acceptable
bitrate
利用監控數據改善用戶體驗
透過AI手段, Region-of-Interest(ROI) Encoding
original image matting Lower bitrate ROI encoding enhanced
Take Away
• Multiple CDN is always a good strategy
• Choose right services to serve business
• Reliable storage to persist logs for monitoring
• Enhancement by whole picture understanding
Thank you!
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Kim Kao 高翊凱
Solutions Architect
Amazon Web Services
JC Wang 王教昌
Sr. VP of Engineering
浪Live 旭瑞文化傳媒股份有限公司

More Related Content

What's hot

Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢
Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢
Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢Amazon Web Services
 
Track 3 Session 2_從傳統 legacy 邁向數位化與現代化架構
Track 3 Session 2_從傳統  legacy  邁向數位化與現代化架構Track 3 Session 2_從傳統  legacy  邁向數位化與現代化架構
Track 3 Session 2_從傳統 legacy 邁向數位化與現代化架構Amazon Web Services
 
Track 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptx
Track 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptxTrack 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptx
Track 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptxAmazon Web Services
 
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptxTrack 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptxAmazon Web Services
 
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用Amazon Web Services
 
Come costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWSCome costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWSAmazon Web Services
 
Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用
Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用
Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用Amazon Web Services
 
Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...
Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...
Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Track 1 Session 1_企業善用雲端來加速數位化及創新
Track 1 Session 1_企業善用雲端來加速數位化及創新Track 1 Session 1_企業善用雲端來加速數位化及創新
Track 1 Session 1_企業善用雲端來加速數位化及創新Amazon Web Services
 
Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018
Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018
Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018Amazon Web Services
 
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)Denodo
 
AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남
AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남
AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남Amazon Web Services Korea
 
Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用
Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用
Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用Amazon Web Services
 
Track 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptx
Track 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptxTrack 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptx
Track 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptxAmazon Web Services
 
DEM06 How Demandbase Cut Its Container Costs by 79%
DEM06 How Demandbase Cut Its Container Costs by 79%DEM06 How Demandbase Cut Its Container Costs by 79%
DEM06 How Demandbase Cut Its Container Costs by 79%Amazon Web Services
 
AWS Enterprise First Call Deck
AWS Enterprise First Call DeckAWS Enterprise First Call Deck
AWS Enterprise First Call DeckAlexandre Melo
 

What's hot (20)

Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢
Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢
Track 3 Session 6_打造應用專屬資料庫 (Purpose-built) 與了解託管服務優勢
 
Track 3 Session 2_從傳統 legacy 邁向數位化與現代化架構
Track 3 Session 2_從傳統  legacy  邁向數位化與現代化架構Track 3 Session 2_從傳統  legacy  邁向數位化與現代化架構
Track 3 Session 2_從傳統 legacy 邁向數位化與現代化架構
 
Track 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptx
Track 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptxTrack 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptx
Track 6 Session 1_進入 AI 領域的第一步驟_資料平台的建置.pptx
 
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptxTrack 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
Track 5 Session 4_ intel 透過AWS Outposts就地佈署 on-premises 雲端環境.pptx
 
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
Track 6 Session 6_ 透過 AWS AI 服務模擬、部署機器人於產業之應用
 
Come costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWSCome costruire un'architettura Serverless nel Cloud AWS
Come costruire un'architettura Serverless nel Cloud AWS
 
Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用
Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用
Track 4 Session 1_MAD01 如何活用事件驅動架構快速擴展應用
 
Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...
Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...
Enterprise Cloud Computing with AWS - How enterprises are using the AWS Cloud...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Track 1 Session 1_企業善用雲端來加速數位化及創新
Track 1 Session 1_企業善用雲端來加速數位化及創新Track 1 Session 1_企業善用雲端來加速數位化及創新
Track 1 Session 1_企業善用雲端來加速數位化及創新
 
Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018
Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018
Realize Value of Your Microsoft Investments - Transformation Day Montreal 2018
 
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
Powering Real-Time Analytics with Data Virtualization on AWS (ASEAN & ANZ)
 
AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남
AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남
AWS Enterprise Summit - AWS로 엔터프라이즈 솔루션 구축 및 운영하기 - 이종남
 
Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用
Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用
Track 4 Session 6_ IOT01 如何透過 AWS IoT 服務建構物聯網應用
 
Track 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptx
Track 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptxTrack 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptx
Track 4 Session 2_MAD03 容器技術和 AWS Lambda 讓您專注「應用優先」.pptx
 
State of the Union: Networking
State of the Union: NetworkingState of the Union: Networking
State of the Union: Networking
 
Cost Optimization on AWS
Cost Optimization on AWSCost Optimization on AWS
Cost Optimization on AWS
 
DEM06 How Demandbase Cut Its Container Costs by 79%
DEM06 How Demandbase Cut Its Container Costs by 79%DEM06 How Demandbase Cut Its Container Costs by 79%
DEM06 How Demandbase Cut Its Container Costs by 79%
 
AWS Enterprise First Call Deck
AWS Enterprise First Call DeckAWS Enterprise First Call Deck
AWS Enterprise First Call Deck
 
Lambda Function Security
Lambda Function SecurityLambda Function Security
Lambda Function Security
 

Similar to 多CDN架構監控與觀看體驗最佳化

Service Provider Architectures for Tomorrow by Chow Khay Kid
Service Provider Architectures for Tomorrow by Chow Khay KidService Provider Architectures for Tomorrow by Chow Khay Kid
Service Provider Architectures for Tomorrow by Chow Khay KidMyNOG
 
What do you need to know to scale your business to China using Microsoft Azure
What do you need to know to scale your business to China using Microsoft AzureWhat do you need to know to scale your business to China using Microsoft Azure
What do you need to know to scale your business to China using Microsoft AzureAsaf Nakash
 
Tech Talk by Peng Li: Open Mobile Networks with NFV
Tech Talk by Peng Li: Open Mobile Networks with NFVTech Talk by Peng Li: Open Mobile Networks with NFV
Tech Talk by Peng Li: Open Mobile Networks with NFVnvirters
 
F5 Value For Virtualization
F5 Value For VirtualizationF5 Value For Virtualization
F5 Value For VirtualizationPatricio Campos
 
BTI Systems CommunicAsia Presentation
BTI Systems CommunicAsia PresentationBTI Systems CommunicAsia Presentation
BTI Systems CommunicAsia PresentationBTI Systems
 
Cloud 12 08 V2
Cloud 12 08 V2Cloud 12 08 V2
Cloud 12 08 V2Pini Cohen
 
Istio Service Mesh
Istio Service MeshIstio Service Mesh
Istio Service MeshLew Tucker
 
How to Evaluate, Rollout, and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout, and Operationalize Your SD-WAN ProjectsHow to Evaluate, Rollout, and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout, and Operationalize Your SD-WAN ProjectsThousandEyes
 
Cisco’s Cloud Ready Infrastructure
Cisco’s Cloud Ready InfrastructureCisco’s Cloud Ready Infrastructure
Cisco’s Cloud Ready InfrastructureCisco Canada
 
Real-time Visibility at Scale with Sumo Logic
Real-time Visibility at Scale with Sumo LogicReal-time Visibility at Scale with Sumo Logic
Real-time Visibility at Scale with Sumo LogicAmazon Web Services
 
Internet 2020: The Future Connection
Internet 2020: The Future ConnectionInternet 2020: The Future Connection
Internet 2020: The Future ConnectionChristine Nolan
 
How to Evaluate, Rollout and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout and Operationalize Your SD-WAN ProjectsHow to Evaluate, Rollout and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout and Operationalize Your SD-WAN ProjectsThousandEyes
 
AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...
AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...
AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...Amazon Web Services
 
Keeping Technology Current: A Driver for Change
Keeping Technology Current: A Driver for ChangeKeeping Technology Current: A Driver for Change
Keeping Technology Current: A Driver for ChangeCisco Canada
 
Juniper Networks®, Tech Mahindra & CA Discuss New Perspectives & Partnership...
Juniper Networks®, Tech Mahindra & CA  Discuss New Perspectives & Partnership...Juniper Networks®, Tech Mahindra & CA  Discuss New Perspectives & Partnership...
Juniper Networks®, Tech Mahindra & CA Discuss New Perspectives & Partnership...CA Technologies
 
Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...
Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...
Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...Amazon Web Services
 
What is ThousandEyes Webinar
What is ThousandEyes WebinarWhat is ThousandEyes Webinar
What is ThousandEyes WebinarThousandEyes
 

Similar to 多CDN架構監控與觀看體驗最佳化 (20)

Service Provider Architectures for Tomorrow by Chow Khay Kid
Service Provider Architectures for Tomorrow by Chow Khay KidService Provider Architectures for Tomorrow by Chow Khay Kid
Service Provider Architectures for Tomorrow by Chow Khay Kid
 
What do you need to know to scale your business to China using Microsoft Azure
What do you need to know to scale your business to China using Microsoft AzureWhat do you need to know to scale your business to China using Microsoft Azure
What do you need to know to scale your business to China using Microsoft Azure
 
Tech Talk by Peng Li: Open Mobile Networks with NFV
Tech Talk by Peng Li: Open Mobile Networks with NFVTech Talk by Peng Li: Open Mobile Networks with NFV
Tech Talk by Peng Li: Open Mobile Networks with NFV
 
F5 Value For Virtualization
F5 Value For VirtualizationF5 Value For Virtualization
F5 Value For Virtualization
 
BTI Systems CommunicAsia Presentation
BTI Systems CommunicAsia PresentationBTI Systems CommunicAsia Presentation
BTI Systems CommunicAsia Presentation
 
Cloud 12 08 V2
Cloud 12 08 V2Cloud 12 08 V2
Cloud 12 08 V2
 
WWT IWAN Technical Presentation
WWT IWAN Technical PresentationWWT IWAN Technical Presentation
WWT IWAN Technical Presentation
 
Istio Service Mesh
Istio Service MeshIstio Service Mesh
Istio Service Mesh
 
How to Evaluate, Rollout, and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout, and Operationalize Your SD-WAN ProjectsHow to Evaluate, Rollout, and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout, and Operationalize Your SD-WAN Projects
 
Open Networking Summit
Open Networking SummitOpen Networking Summit
Open Networking Summit
 
From Monolith to Microservices
From Monolith to MicroservicesFrom Monolith to Microservices
From Monolith to Microservices
 
Cisco’s Cloud Ready Infrastructure
Cisco’s Cloud Ready InfrastructureCisco’s Cloud Ready Infrastructure
Cisco’s Cloud Ready Infrastructure
 
Real-time Visibility at Scale with Sumo Logic
Real-time Visibility at Scale with Sumo LogicReal-time Visibility at Scale with Sumo Logic
Real-time Visibility at Scale with Sumo Logic
 
Internet 2020: The Future Connection
Internet 2020: The Future ConnectionInternet 2020: The Future Connection
Internet 2020: The Future Connection
 
How to Evaluate, Rollout and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout and Operationalize Your SD-WAN ProjectsHow to Evaluate, Rollout and Operationalize Your SD-WAN Projects
How to Evaluate, Rollout and Operationalize Your SD-WAN Projects
 
AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...
AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...
AWS re:Invent 2016: Media Delivery from the Cloud: Integrated AWS Solutions f...
 
Keeping Technology Current: A Driver for Change
Keeping Technology Current: A Driver for ChangeKeeping Technology Current: A Driver for Change
Keeping Technology Current: A Driver for Change
 
Juniper Networks®, Tech Mahindra & CA Discuss New Perspectives & Partnership...
Juniper Networks®, Tech Mahindra & CA  Discuss New Perspectives & Partnership...Juniper Networks®, Tech Mahindra & CA  Discuss New Perspectives & Partnership...
Juniper Networks®, Tech Mahindra & CA Discuss New Perspectives & Partnership...
 
Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...
Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...
Enterprise Network Transformation Powered by OrangeX, with Nokia Nuage and AW...
 
What is ThousandEyes Webinar
What is ThousandEyes WebinarWhat is ThousandEyes Webinar
What is ThousandEyes Webinar
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 
AWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei serverAWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei serverAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 
AWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei serverAWS Serverless per startup: come innovare senza preoccuparsi dei server
AWS Serverless per startup: come innovare senza preoccuparsi dei server
 

多CDN架構監控與觀看體驗最佳化

  • 1. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. 全民直播時代的多CDN架構監控 與觀看體驗最佳化 Kim Kao 高翊凱 Solutions Architect Amazon Web Services JC Wang 王教昌 Sr. VP of Engineering 浪Live 旭瑞文化傳媒股份有限公司 T r a c k 2 | S e s s i o n 4
  • 2.
  • 3. Messaging between microservices Response analytics (web and mobile app notifications) Log ingestion IoT device maintenance Change data capture Streaming extract, transfer, and load (ETL) into data lakes and data warehouses Milliseconds Seconds Minutes Common real-time data streaming use cases
  • 4. What is a Live Event? Live Sports Stream? Answer: They both are Popular VOD Series Finale?
  • 5. What Drives Live Event Scale? • Peak Concurrent Viewers • Join Rate • Geographic/Regional Concentration Audience Characteristics Video Characteristics • Encoded Bit Rate • Number of formats & profiles • Segment Duration
  • 6. How does internet Video work? 1 - Camera/Source generates Video 1 2 2 - Encoder & Packager create Segmented Video and Manifests for HLS/DASH 3 4 5 https://mydomain.com/video.m3u8 3 - Player is initiated via a client requesting a link to the video (master manifest) 5 - Player requests video segments in sequence 4 - Player requests playlist(s)/manifest(s) 6 6 - Steps 4 & 5 repeat until video ends.
  • 7. Typical Components of a Video Workflow with AWS Components Media Live Media Package Media Tailor Media Store CloudFront Web browser TV Direct Connect GroundStation Media Connect Vyvx (Centurylink) Other Signal Acquisition/Ingest Transcoding/Packaging/ Personalization/Storage Playout/Delivery Source/ Venue Multi-CDNS3 Bucket
  • 8. Being Redundantly Redundant • Diverse signal acquisition paths (satellite, terrestrial, multiple networks/links) • Redundant Encoders with time/epoch locking (primary/secondary stream) • Encoders writing to redundant origins (packagers/storage) in multiple regions • DNS-based or API-based traffic management and stream selection by region • Health checks and failover between primary/secondary in region or across regions
  • 9. It’s not just about the Video Web Applications Mobile App backend APIs and microsservices DRM & Key Management Authentication and Tokenization User/Entitlement databases CMS and content metadata services Ad networks/ Decisioning/bidding “Waiting Room”
  • 10. Many predicate failure modes Stream hijacking/pirating Source Interruptions Prescaling/Autoscaling Capacity Planning & Allocation DDoS Attacks Fiber/Network Issues Component Failures/ Overload Network Congestion/ Overload
  • 11. AWS Advantages: Capacity, Scale, Performance, Reach China Launched in China with 4 New cities: Beijing, Shanghai, Zhongwei, Shenzhen EMEA 4 New countries: Bahrain, Belgium, Portugal, Israel 13 Embeds in UK South America Added 3 New countries: Argentina, Chile, and Colombia 56% price cut India / Australia 16 PoPs in India Added 3 PoPs in Syd, Currently 6 PoPs in AU 210 PoPs in 79 cities, 37 countries 75+ PoPs added in 2019 Japan Added 6 PoPs in Tokyo. Currently 17 PoPs in JP North America Added 50% more PoPs in last year. Launched in 2 new cities: Houston and Salt Lake City
  • 12. Video Delivery Optimization • Ingest optimization via S3TA, Media-Connect, Direct Connect or other methods • Redundancy and regional localization as appropriate • Encoding/Packaging configuration First-mile
  • 13. Video Delivery Optimization in CloudFront Middle-mile • Connection keep-alive in cache fill path all the way to origin • Chunked-transfer encoding • Hierarchical/Regional caching and Connection Collapsing • AWS Backbone provides low-latency, high throughput, low-congestion network • Range Request consolidation & background fetching • Negative Caching to protect origin
  • 14. Video Delivery Optimization in CloudFront Last-mile • Connection keep-alives • Protocol Optimization (BBR, MTU, HTTP-2, QUIC/HTTP-3) • Lots of capacity (>120Tbps of network connectivity) • Direct Peering with many networks • Embedded POPs deeper within major consumer ISP networks • Perimeter Protection @ Edge with WAF & Shield
  • 15. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. 浪Live串流服務的監控與體驗最佳化 JC Wang 王教昌 Sr. VP of Engineering 浪Live 旭瑞文化傳媒股份有限公司
  • 16. 才藝直播 - 浪Live 電競直播 - 浪Play 短影音 - iM短影 浪Live 旭瑞文化傳媒
  • 18. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why Multi-CDN strategy ?
  • 19. Why Multi-CDN Strategy ? 網路覆蓋 推拉流端的設備以及網路環境多樣 跨國的網路覆蓋 備援 降低單一CDN故障的風險 CDN廠商的局部節點錯誤
  • 20. Why Multi-CDN Strategy ? 容量擴展 大型活動的流量提早分配 非預期的瞬增流量 成本彈性 預算控制 (流量計價 v.s. 峰值計價) 議價空間
  • 21. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. True Visibility into User Experience
  • 22. 數據收集 OS/ 手機型號/ 網路 / 頻寬/ bitrate/ frame rate ...etc src_ip/ bitrate/ fps/ frame_drop … etc 拉流人數/ 來源/ 下 行速度 … etc cdn / edge node/ 網 速/ 卡頓/ fps/ 網路 ...etc
  • 28. 利用監控數據改善用戶體驗 Dynamic bitrate manipulation: 局部最佳化 → 全局最佳化 acceptable bitrate
  • 30.
  • 31. Take Away • Multiple CDN is always a good strategy • Choose right services to serve business • Reliable storage to persist logs for monitoring • Enhancement by whole picture understanding
  • 32. Thank you! © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved. Kim Kao 高翊凱 Solutions Architect Amazon Web Services JC Wang 王教昌 Sr. VP of Engineering 浪Live 旭瑞文化傳媒股份有限公司

Editor's Notes

  1. Media live - 一款影片處理服務,影片提供者可透過該服務編碼高品質即時影片串流,以交付到廣播電視和多螢幕裝置 Media package - 影片交付服務,可讓影片提供者安全可靠地大規模分發串流影片。它可讓您輕鬆準備即時和隨選影片內容以交付到多個裝置,並透過進階功能改善觀眾的體驗 Media Store - 影片創作和儲存服務。它提供交付串流媒體所需的效能和一致性,並結合 AWS 跨服務提供的安全性與耐久性 Media tailor – 廣告
  2. 多種信號採集路徑(衛星,地面,多個網絡/鏈路) 具有時間/紀元鎖定功能的冗餘編碼器(主要/次要流) 編碼器寫入多個區域中的冗餘來源(打包器/存儲) 基於DNS或基於API的流量管理以及按區域選擇流 區域內或區域間主要/次要之間的運行狀況檢查和故障轉移
  3. AWS Elemental MediaConnect 是高品質的即時影片傳輸服務。廣播公司和內容擁有者現在仰賴衛星網路或光纖連線,將高價值的內容傳送到雲端或傳輸給發行合作夥伴。衛星和光纖方法都很昂貴,需要很長的前置期設定,而且缺乏因應需求變化的彈性。為了要獲得更多彈性,部分客戶嘗試使用在 IP 基礎架構上傳輸即時影片的解決方案,但缺乏可靠性和安全性。
  4. BBR(Bottleneck Bandwidth and Round-trip propagation time)是Google的一種壅塞控制演算法,在網路連結的電腦或行動裝置中運行,可決定數據發送的速度,旨在解決網路壅塞問題 MTU , 調節最適合的封包傳輸大小