SlideShare a Scribd company logo
1 of 46
F.LIVE
Shannon Chen (cchen116@Illinois.edu),
Zhenhuan Gao, and Klara Nahrstedt
University of Illinois at Urbana-Champaign
Towards Interactive Live Broadcast
Free-viewpoint TV Experience
This material is based in part upon work supported by
the National Science Foundation (NeTS-0520182)
FREE-VIEWPOINT TV (FTV)
Multi-Lens
Capturing
Free-Viewpoint
Viewing
DESIRED FTV FEATURES
• Interactive
• Live
• Broadcasting
DESIRED FTV FEATURES
• Interactive
• Live
• Broadcasting
*beep*
DESIRED FTV FEATURES
• Interactive
• Live
• Broadcasting
DESIRED FTV FEATURES
• Interactive
• Live
• Broadcasting
DESIRED FTV FEATURES
• Interactive
• Live
• Broadcasting
DESIRED FTV FEATURES
• Interactive
• Live
• Broadcasting
EXISTING FTV
DELIVERY FRAMEWORKS
• Type-1: View chosen by content provider
• EyeVision System [Kanade ‘01] used in Super Bowl XXXV
Editing DecodeAggregateCapture
Capture
Capture
Encode
Director
Viewpoint decision
Audience
• Interactive
• Live
EXISTING FTV
DELIVERY FRAMEWORKS
• Type-2: Aggregated stream bundle
• Nagoya System [Tanimoto ‘12]
• Interactive
• Live
DecodeAggregateCapture
Audience
Capture
Viewpoint decision
Capture
Encode
OUR SOLUTION: F.LIVE
• View-based delivery framework
Audience 1
Viewpoint decisions
Renderer
Audience 2
Renderer
Decode
Decode
Capture
Capture
Capture
Encode Transmit
Transmit
TransmitEncode
Encode
Session
manager
Transmission
assignment
• Interactive
• Live
• Broadcasting ?
OUR SOLUTION: F.LIVE
• No aggregation → distributed entities
• P2P sharing among audience
• Pub/Sub Model
Session
manager
OUR SOLUTION: F.LIVE
• No aggregation → distributed entities
• P2P sharing among audience
• Pub/Sub Model
Session
manager
Publishers
OUR SOLUTION: F.LIVE
• No aggregation → distributed entities
• P2P sharing among audience
• Pub/Sub Model
Session
manager
Broker
OUR SOLUTION: F.LIVE
• No aggregation → distributed entities
• P2P sharing among audience
• Pub/Sub Model
Session
manager
Subscribers
OUR SOLUTION: F.LIVE
Session
manager
View
decisions
OUR SOLUTION: F.LIVE
Session
manager
Transmission
assignments
OUR SOLUTION: F.LIVE
Session
manager
OUR SOLUTION: F.LIVE
• No aggregation → distributed entities
• P2P sharing among audience
• Pub/Sub Model
S
S
S
Physical proximity
• Broadcasting
CHALLENGES
• Interactive ← Synchronization delay
• Live ← Content freshness
• Broadcast ← Producer bandwidth
CHALLENGES
R
CHALLENGES
• Synchronization delay
• Content freshness
Buffer for stream A
Buffer for stream B
Cam
B
Cam
A
Audience site
1
1
CHALLENGES
• Synchronization delay
• Content freshness
Buffer for stream A
Buffer for stream B
Cam
B
Cam
A
Audience site
1
2
2
1
CHALLENGES
• Synchronization delay
• Content freshness
Buffer for stream A
Buffer for stream B
Cam
B
Cam
A
Audience site
1
12
3
3
2
Wait
CHALLENGES
• Synchronization delay
• Content freshness
Buffer for stream A
Buffer for stream B
Cam
B
Cam
A
Audience site
1
12
2
3
4
4
3
CHALLENGES
• Synchronization delay
• Content freshness
Buffer for stream A
Buffer for stream B
Cam
B
Cam
A
Audience site
1
12
2
3
4
4
3
Rendering
CHALLENGES
• Synchronization delay
• Content freshness
Buffer for stream A
Buffer for stream B
Cam
B
Cam
A
Audience site
1
12
2
3
4
4
3
Rendering
Propagation delay
(i.e., frame elapse = freshness)
Synchronization
delay
CHALLENGES
• Synchronization delay
• Content freshness
• Producer Bandwidth
CHALLENGES
• Synchronization delay
• Content freshness
• Producer Bandwidth
CHALLENGES
• Synchronization delay
• Content freshness
• Producer Bandwidth
Gbps
FOREST PLANNING
CHALLENGES
• If we have all the subscription information at the beginning
of forest planning , an optimal planning is not a hard
problem
• However, subscriptions are dynamic
• P2P churn
• View change “Forest adaptation”
Initial forest
construction
Cam
B
Cam
A
Cam
C
FOREST PLANNING
CHALLENGES
• If we have all the subscription information at the beginning
of forest planning , an optimal planning is not a hard
problem
• However, subscriptions are dynamic
• P2P churn
• View change “Forest adaptation”
Initial forest
construction
Cam
B
Cam
A
Cam
C
Audience
join
Bandwidth?
Freshness?
FOREST PLANNING
CHALLENGES
• If we have all the subscription information at the beginning
of forest planning , an optimal planning is not a hard
problem
• However, subscriptions are dynamic
• P2P churn
• View change “Forest adaptation”
Initial forest
construction
Cam
B
Cam
A
Cam
C
Audience
leave
FOREST PLANNING
CHALLENGES
• If we have all the subscription information at the beginning
of forest planning , an optimal planning is not a hard
problem
• However, subscriptions are dynamic
• P2P churn
• View change “Forest adaptation”
Initial forest
construction
Cam
B
Cam
A
Cam
C
Audience
leave
3 4
FOREST PLANNING
CHALLENGES
• If we have all the subscription information at the beginning
of forest planning , an optimal planning is not a hard
problem
• However, subscriptions are dynamic
• P2P churn
• View change “Forest adaptation”
Initial forest
construction
Cam
B
Cam
A
Cam
C
View
change
FOREST PLANNING
CHALLENGES
• If we have all the subscription information at the beginning
of forest planning , an optimal planning is not a hard
problem
• However, subscriptions are dynamic
• P2P churn
• View change “Forest adaptation”
Initial forest
construction
Cam
B
Cam
A
Cam
C
View
change
3 3
FOREST PLANNING
CHALLENGES
• If we have all the subscription information at the beginning
of forest planning , an optimal planning is not a hard
problem
• However, subscriptions are dynamic
• P2P churn
• View change
 We do not aim for optimization (no tearing down trees)
 Heuristics that deal with new batch of subscription requests
(audience join/leave/view change)
 Details on initial construction and adaptation algorithms (w/
pseudocodes) can be found in the paper
[Shannon Chen et al. INFOCOM’16]
“Forest adaptation”
Initial forest
construction
EVALUATION
• Simulation settings
• Single TV-studio performer site
• Network capability of audience sites: [Netmap]
• In/out-bound bandwidth, site-to-site propagation delay
• Simulate new subscription requests when there are 0 to
100,000 audiences in the session
High-resolution
cameras
Moderate 100-camera array
# of cameras 16 30 100
Camera framerate 30 FPS 30 FPS 30 FPS
Camera bitrate 12 Mbps (HDTV) 6 Mbps 2 Mbps (SDTV)
EVALUATION METRICS
• Synchronization delay (Interactive)
• Content freshness (Live)
• Producer bandwidth (Broadcast)
SYNCHRONIZATION DELAY
• Unstable at first: not many candidates for newly
joined/rejoined audience to find a group of sources with
similar propagation delays
• Delay for handling new coming subscriptions during
application session is in 100ms-scale in stable state
0
1000
0 500 1000Audience group size
High-Res Setting
0
1000
0 500 1000
Audience group size
Moderate Setting
0
1000
0 5000 10000Audience group size
100-Camera Setting
Syncdelay(ms)
Syncdelay(ms)
Syncdelay(ms)
PRODUCER BANDWIDTH
CONSUMPTION
• P2P sharing restricts the growth of bandwidth consumption
• Outbound bandwidth requirement is well-manageable by
Gbps infrastructure
0
250
500
0 500 1000
Totalproducer…
Audience group size
High Bitrate Setting
0
250
500
0 500 1000
Totalproducer…
Audience group size
Moderate Setting
0
250
500
0 2500 5000
Totalproducer…
Audience group size
100-Camera Setting
CONTENT FRESHNESS
• > 50% audience have higher-than-average elapses
• But the tree structure makes the elapse grows sub-linearly
• Max elapse < 4.5 seconds
(compare: CBS TV network’s time elapse is 5 sec)
COMPARE TO OTHER FTV
FRAMEWORKS
Editing DecodeAggregateCap
Cap
Cap
Encode
Audience
DecodeAggregateCap
Audience
Cap
Viewpoint decision
Cap
Encode
Type-1: customized content
Type-2: aggregated content
Viewpoint decision
MVC
COMPARE TO OTHER FTV
FRAMEWORKS
0
50
100
150
Bandwidthconsumptionof
audiencesite(Mpbs)
 High-Res
 Moderate
 100-Cameras
Type-1 (dash)
View-based (solid)
 High-Res
 Moderate
 100-Cameras
Type-2 (stripe); View-based (solid)
Producer site bandwidth
consumption
Audience site bandwidth
consumption
CONCLUSION
• We propose a new FTV content delivery framework which
aims at co-existence of three desired features
• Interactive
• Live
• Broadcasting
• Result of large-scale simulation shows the proposed F.Live
framework with view-based delivery chain achieves
• Interactive response time in 100ms-scale
• Acceptable content freshness by TV industry standard
• Feasible bandwidth consumption while sustaining 1000-scale
audience group
THANK YOU

More Related Content

Similar to f.live

ZT: It's Not the Cost, It's the Quality
ZT: It's Not the Cost, It's the QualityZT: It's Not the Cost, It's the Quality
ZT: It's Not the Cost, It's the Quality
wish
 

Similar to f.live (20)

Canary Analyze All the Things
Canary Analyze All the ThingsCanary Analyze All the Things
Canary Analyze All the Things
 
When a FILTER makes the di fference in continuously answering SPARQL queries ...
When a FILTER makes the difference in continuously answering SPARQL queries ...When a FILTER makes the difference in continuously answering SPARQL queries ...
When a FILTER makes the di fference in continuously answering SPARQL queries ...
 
Attack of the Content Clones: Saving the Internet from On-demand Video Streaming
Attack of the Content Clones: Saving the Internet from On-demand Video StreamingAttack of the Content Clones: Saving the Internet from On-demand Video Streaming
Attack of the Content Clones: Saving the Internet from On-demand Video Streaming
 
Canary Analyze All The Things: How We Learned to Keep Calm and Release Often
Canary Analyze All The Things: How We Learned to Keep Calm and Release OftenCanary Analyze All The Things: How We Learned to Keep Calm and Release Often
Canary Analyze All The Things: How We Learned to Keep Calm and Release Often
 
AWS re:Invent 2016: Accelerating the Transition to Broadcast and OTT Infrastr...
AWS re:Invent 2016: Accelerating the Transition to Broadcast and OTT Infrastr...AWS re:Invent 2016: Accelerating the Transition to Broadcast and OTT Infrastr...
AWS re:Invent 2016: Accelerating the Transition to Broadcast and OTT Infrastr...
 
AWS powered online classes platform
AWS powered online classes platformAWS powered online classes platform
AWS powered online classes platform
 
A Dive into Streams @LinkedIn with Brooklin
A Dive into Streams @LinkedIn with BrooklinA Dive into Streams @LinkedIn with Brooklin
A Dive into Streams @LinkedIn with Brooklin
 
A Distributed Approach for Bitrate Selection in HTTP Adaptive Streaming
A Distributed Approach for Bitrate Selection in HTTP Adaptive StreamingA Distributed Approach for Bitrate Selection in HTTP Adaptive Streaming
A Distributed Approach for Bitrate Selection in HTTP Adaptive Streaming
 
Integration
IntegrationIntegration
Integration
 
Much Faster Networking
Much Faster NetworkingMuch Faster Networking
Much Faster Networking
 
ZT: It's Not the Cost, It's the Quality
ZT: It's Not the Cost, It's the QualityZT: It's Not the Cost, It's the Quality
ZT: It's Not the Cost, It's the Quality
 
Maximizing Audience Engagement in Media Delivery (MED303) | AWS re:Invent 2013
Maximizing Audience Engagement in Media Delivery (MED303) | AWS re:Invent 2013Maximizing Audience Engagement in Media Delivery (MED303) | AWS re:Invent 2013
Maximizing Audience Engagement in Media Delivery (MED303) | AWS re:Invent 2013
 
Tuning kafka pipelines
Tuning kafka pipelinesTuning kafka pipelines
Tuning kafka pipelines
 
Multimedia streaming
Multimedia streamingMultimedia streaming
Multimedia streaming
 
AWS re:Invent 2016: From Resilience to Ubiquity - #NetflixEverywhere Global A...
AWS re:Invent 2016: From Resilience to Ubiquity - #NetflixEverywhere Global A...AWS re:Invent 2016: From Resilience to Ubiquity - #NetflixEverywhere Global A...
AWS re:Invent 2016: From Resilience to Ubiquity - #NetflixEverywhere Global A...
 
High performance network programming on the jvm oscon 2012
High performance network programming on the jvm   oscon 2012 High performance network programming on the jvm   oscon 2012
High performance network programming on the jvm oscon 2012
 
AWS re:Invent 2016: Design Patterns for High Availability: Lessons from Amazo...
AWS re:Invent 2016: Design Patterns for High Availability: Lessons from Amazo...AWS re:Invent 2016: Design Patterns for High Availability: Lessons from Amazo...
AWS re:Invent 2016: Design Patterns for High Availability: Lessons from Amazo...
 
Keystone - ApacheCon 2016
Keystone - ApacheCon 2016Keystone - ApacheCon 2016
Keystone - ApacheCon 2016
 
Scalable Microservices at Netflix. Challenges and Tools of the Trade
Scalable Microservices at Netflix. Challenges and Tools of the TradeScalable Microservices at Netflix. Challenges and Tools of the Trade
Scalable Microservices at Netflix. Challenges and Tools of the Trade
 
Reactive Systems by Dave Farley at #AgileIndia2019
Reactive Systems by Dave Farley at #AgileIndia2019Reactive Systems by Dave Farley at #AgileIndia2019
Reactive Systems by Dave Farley at #AgileIndia2019
 

Recently uploaded

Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
Epec Engineered Technologies
 
Digital Communication Essentials: DPCM, DM, and ADM .pptx
Digital Communication Essentials: DPCM, DM, and ADM .pptxDigital Communication Essentials: DPCM, DM, and ADM .pptx
Digital Communication Essentials: DPCM, DM, and ADM .pptx
pritamlangde
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
Kamal Acharya
 
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills KuwaitKuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
jaanualu31
 
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
HenryBriggs2
 
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
AldoGarca30
 

Recently uploaded (20)

Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
 
8th International Conference on Soft Computing, Mathematics and Control (SMC ...
8th International Conference on Soft Computing, Mathematics and Control (SMC ...8th International Conference on Soft Computing, Mathematics and Control (SMC ...
8th International Conference on Soft Computing, Mathematics and Control (SMC ...
 
Introduction to Geographic Information Systems
Introduction to Geographic Information SystemsIntroduction to Geographic Information Systems
Introduction to Geographic Information Systems
 
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
 
Linux Systems Programming: Inter Process Communication (IPC) using Pipes
Linux Systems Programming: Inter Process Communication (IPC) using PipesLinux Systems Programming: Inter Process Communication (IPC) using Pipes
Linux Systems Programming: Inter Process Communication (IPC) using Pipes
 
Ground Improvement Technique: Earth Reinforcement
Ground Improvement Technique: Earth ReinforcementGround Improvement Technique: Earth Reinforcement
Ground Improvement Technique: Earth Reinforcement
 
Digital Communication Essentials: DPCM, DM, and ADM .pptx
Digital Communication Essentials: DPCM, DM, and ADM .pptxDigital Communication Essentials: DPCM, DM, and ADM .pptx
Digital Communication Essentials: DPCM, DM, and ADM .pptx
 
Hospital management system project report.pdf
Hospital management system project report.pdfHospital management system project report.pdf
Hospital management system project report.pdf
 
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
 
Online food ordering system project report.pdf
Online food ordering system project report.pdfOnline food ordering system project report.pdf
Online food ordering system project report.pdf
 
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills KuwaitKuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
Kuwait City MTP kit ((+919101817206)) Buy Abortion Pills Kuwait
 
Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)
 
Max. shear stress theory-Maximum Shear Stress Theory ​ Maximum Distortional ...
Max. shear stress theory-Maximum Shear Stress Theory ​  Maximum Distortional ...Max. shear stress theory-Maximum Shear Stress Theory ​  Maximum Distortional ...
Max. shear stress theory-Maximum Shear Stress Theory ​ Maximum Distortional ...
 
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
 
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
scipt v1.pptxcxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
 
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf
 
Post office management system project ..pdf
Post office management system project ..pdfPost office management system project ..pdf
Post office management system project ..pdf
 
Introduction to Artificial Intelligence ( AI)
Introduction to Artificial Intelligence ( AI)Introduction to Artificial Intelligence ( AI)
Introduction to Artificial Intelligence ( AI)
 
Memory Interfacing of 8086 with DMA 8257
Memory Interfacing of 8086 with DMA 8257Memory Interfacing of 8086 with DMA 8257
Memory Interfacing of 8086 with DMA 8257
 

f.live

  • 1. F.LIVE Shannon Chen (cchen116@Illinois.edu), Zhenhuan Gao, and Klara Nahrstedt University of Illinois at Urbana-Champaign Towards Interactive Live Broadcast Free-viewpoint TV Experience This material is based in part upon work supported by the National Science Foundation (NeTS-0520182)
  • 3. DESIRED FTV FEATURES • Interactive • Live • Broadcasting
  • 4. DESIRED FTV FEATURES • Interactive • Live • Broadcasting *beep*
  • 5. DESIRED FTV FEATURES • Interactive • Live • Broadcasting
  • 6. DESIRED FTV FEATURES • Interactive • Live • Broadcasting
  • 7. DESIRED FTV FEATURES • Interactive • Live • Broadcasting
  • 8. DESIRED FTV FEATURES • Interactive • Live • Broadcasting
  • 9. EXISTING FTV DELIVERY FRAMEWORKS • Type-1: View chosen by content provider • EyeVision System [Kanade ‘01] used in Super Bowl XXXV Editing DecodeAggregateCapture Capture Capture Encode Director Viewpoint decision Audience • Interactive • Live
  • 10. EXISTING FTV DELIVERY FRAMEWORKS • Type-2: Aggregated stream bundle • Nagoya System [Tanimoto ‘12] • Interactive • Live DecodeAggregateCapture Audience Capture Viewpoint decision Capture Encode
  • 11. OUR SOLUTION: F.LIVE • View-based delivery framework Audience 1 Viewpoint decisions Renderer Audience 2 Renderer Decode Decode Capture Capture Capture Encode Transmit Transmit TransmitEncode Encode Session manager Transmission assignment • Interactive • Live • Broadcasting ?
  • 12. OUR SOLUTION: F.LIVE • No aggregation → distributed entities • P2P sharing among audience • Pub/Sub Model Session manager
  • 13. OUR SOLUTION: F.LIVE • No aggregation → distributed entities • P2P sharing among audience • Pub/Sub Model Session manager Publishers
  • 14. OUR SOLUTION: F.LIVE • No aggregation → distributed entities • P2P sharing among audience • Pub/Sub Model Session manager Broker
  • 15. OUR SOLUTION: F.LIVE • No aggregation → distributed entities • P2P sharing among audience • Pub/Sub Model Session manager Subscribers
  • 19. OUR SOLUTION: F.LIVE • No aggregation → distributed entities • P2P sharing among audience • Pub/Sub Model S S S Physical proximity • Broadcasting
  • 20. CHALLENGES • Interactive ← Synchronization delay • Live ← Content freshness • Broadcast ← Producer bandwidth
  • 22. CHALLENGES • Synchronization delay • Content freshness Buffer for stream A Buffer for stream B Cam B Cam A Audience site 1 1
  • 23. CHALLENGES • Synchronization delay • Content freshness Buffer for stream A Buffer for stream B Cam B Cam A Audience site 1 2 2 1
  • 24. CHALLENGES • Synchronization delay • Content freshness Buffer for stream A Buffer for stream B Cam B Cam A Audience site 1 12 3 3 2 Wait
  • 25. CHALLENGES • Synchronization delay • Content freshness Buffer for stream A Buffer for stream B Cam B Cam A Audience site 1 12 2 3 4 4 3
  • 26. CHALLENGES • Synchronization delay • Content freshness Buffer for stream A Buffer for stream B Cam B Cam A Audience site 1 12 2 3 4 4 3 Rendering
  • 27. CHALLENGES • Synchronization delay • Content freshness Buffer for stream A Buffer for stream B Cam B Cam A Audience site 1 12 2 3 4 4 3 Rendering Propagation delay (i.e., frame elapse = freshness) Synchronization delay
  • 28. CHALLENGES • Synchronization delay • Content freshness • Producer Bandwidth
  • 29. CHALLENGES • Synchronization delay • Content freshness • Producer Bandwidth
  • 30. CHALLENGES • Synchronization delay • Content freshness • Producer Bandwidth Gbps
  • 31. FOREST PLANNING CHALLENGES • If we have all the subscription information at the beginning of forest planning , an optimal planning is not a hard problem • However, subscriptions are dynamic • P2P churn • View change “Forest adaptation” Initial forest construction Cam B Cam A Cam C
  • 32. FOREST PLANNING CHALLENGES • If we have all the subscription information at the beginning of forest planning , an optimal planning is not a hard problem • However, subscriptions are dynamic • P2P churn • View change “Forest adaptation” Initial forest construction Cam B Cam A Cam C Audience join Bandwidth? Freshness?
  • 33. FOREST PLANNING CHALLENGES • If we have all the subscription information at the beginning of forest planning , an optimal planning is not a hard problem • However, subscriptions are dynamic • P2P churn • View change “Forest adaptation” Initial forest construction Cam B Cam A Cam C Audience leave
  • 34. FOREST PLANNING CHALLENGES • If we have all the subscription information at the beginning of forest planning , an optimal planning is not a hard problem • However, subscriptions are dynamic • P2P churn • View change “Forest adaptation” Initial forest construction Cam B Cam A Cam C Audience leave 3 4
  • 35. FOREST PLANNING CHALLENGES • If we have all the subscription information at the beginning of forest planning , an optimal planning is not a hard problem • However, subscriptions are dynamic • P2P churn • View change “Forest adaptation” Initial forest construction Cam B Cam A Cam C View change
  • 36. FOREST PLANNING CHALLENGES • If we have all the subscription information at the beginning of forest planning , an optimal planning is not a hard problem • However, subscriptions are dynamic • P2P churn • View change “Forest adaptation” Initial forest construction Cam B Cam A Cam C View change 3 3
  • 37. FOREST PLANNING CHALLENGES • If we have all the subscription information at the beginning of forest planning , an optimal planning is not a hard problem • However, subscriptions are dynamic • P2P churn • View change  We do not aim for optimization (no tearing down trees)  Heuristics that deal with new batch of subscription requests (audience join/leave/view change)  Details on initial construction and adaptation algorithms (w/ pseudocodes) can be found in the paper [Shannon Chen et al. INFOCOM’16] “Forest adaptation” Initial forest construction
  • 38. EVALUATION • Simulation settings • Single TV-studio performer site • Network capability of audience sites: [Netmap] • In/out-bound bandwidth, site-to-site propagation delay • Simulate new subscription requests when there are 0 to 100,000 audiences in the session High-resolution cameras Moderate 100-camera array # of cameras 16 30 100 Camera framerate 30 FPS 30 FPS 30 FPS Camera bitrate 12 Mbps (HDTV) 6 Mbps 2 Mbps (SDTV)
  • 39. EVALUATION METRICS • Synchronization delay (Interactive) • Content freshness (Live) • Producer bandwidth (Broadcast)
  • 40. SYNCHRONIZATION DELAY • Unstable at first: not many candidates for newly joined/rejoined audience to find a group of sources with similar propagation delays • Delay for handling new coming subscriptions during application session is in 100ms-scale in stable state 0 1000 0 500 1000Audience group size High-Res Setting 0 1000 0 500 1000 Audience group size Moderate Setting 0 1000 0 5000 10000Audience group size 100-Camera Setting Syncdelay(ms) Syncdelay(ms) Syncdelay(ms)
  • 41. PRODUCER BANDWIDTH CONSUMPTION • P2P sharing restricts the growth of bandwidth consumption • Outbound bandwidth requirement is well-manageable by Gbps infrastructure 0 250 500 0 500 1000 Totalproducer… Audience group size High Bitrate Setting 0 250 500 0 500 1000 Totalproducer… Audience group size Moderate Setting 0 250 500 0 2500 5000 Totalproducer… Audience group size 100-Camera Setting
  • 42. CONTENT FRESHNESS • > 50% audience have higher-than-average elapses • But the tree structure makes the elapse grows sub-linearly • Max elapse < 4.5 seconds (compare: CBS TV network’s time elapse is 5 sec)
  • 43. COMPARE TO OTHER FTV FRAMEWORKS Editing DecodeAggregateCap Cap Cap Encode Audience DecodeAggregateCap Audience Cap Viewpoint decision Cap Encode Type-1: customized content Type-2: aggregated content Viewpoint decision MVC
  • 44. COMPARE TO OTHER FTV FRAMEWORKS 0 50 100 150 Bandwidthconsumptionof audiencesite(Mpbs)  High-Res  Moderate  100-Cameras Type-1 (dash) View-based (solid)  High-Res  Moderate  100-Cameras Type-2 (stripe); View-based (solid) Producer site bandwidth consumption Audience site bandwidth consumption
  • 45. CONCLUSION • We propose a new FTV content delivery framework which aims at co-existence of three desired features • Interactive • Live • Broadcasting • Result of large-scale simulation shows the proposed F.Live framework with view-based delivery chain achieves • Interactive response time in 100ms-scale • Acceptable content freshness by TV industry standard • Feasible bandwidth consumption while sustaining 1000-scale audience group