SlideShare a Scribd company logo
1 of 33
Download to read offline
HESP
ULTRA LOW LATENCY, ULTRA FAST ZAPPING, LOW
BANDWIDTH AT SCALE
Worldwide online video revenues are growing exponentially.
0
50
100
150
200
2018 2019 2024
B
B
B
B
€
€
€
€
€
ONLINE VIDEO IS BOOMING, CALLING FOR SCALABILITY
O N L I N E V I D E O A C R O S S D I F F E R E N T P L AT F O R M S A N D D E V I C E S
Online video consumption
growth in 2018-2019
period
25%
of Internet Traffic will be
video by 2022. And 15% of
it will be live.
82%
60% 2 sec
Almost 60% of people
would be more likely to
watch live sports online if
the stream was not
delayed from broadcast.
A majority of viewers will
abandon video services
after less than two
seconds of zapping time.
Lean back experience
becomes the minimal
requirement
ONLINE VIEWERS ARE MORE DEMANDING THAN EVER
 Near real time interactivity
 In-sync delivery across devices
 Interactive user experiences
 Low bandwidth
 Single protocol, for all devices
 Cost efficient delivery over internet infrastructure
 Instant zapping & seek times
 Full adaptive bitrate algorithm (ABR)
CURRENT OTT VIDEO DISTRIBUTION REQUIRES A
TRADE-OFF…
Low
Latency
Viewer
experience
Large
Scale
… RESULTING IN SUBOPTIMAL VIDEO DELIVERY
SOLUTIONS
Low
Latency
Viewer
experience
Large
Scale
WebRTC / RTMP streaming
focuses on ultra-low latency,
at the expense of BW and high cost
HLS/DASH HTTP Adaptive Streaming
focuses on cost, scalability, reach,
at the expense of latency & zapping times
REDUCING SEGMENT SIZE DOES NOT HELP ENOUGH
60+ seconds
Latency Decreases
High Latency
10+ Second Segment
HLS/DASH
Short Segment
HLS/DASH
Standard Latency Low Latency Ultra Low Latency Sub Second
TARGET
30 seconds 10 seconds 4 seconds 1 seconds 0.2 seconds
LL-DASH AND LL-HLS IMPROVE LATENCY AND ZAPPING
TIMES
Still not at the level of streaming technologies
60+ seconds
Latency Decreases
High Latency
10+ Second Segment
HLS/DASH
Short Segment
HLS/DASH
Chunked Transfer HLS/DASH
Apple LL HLS
Standard Latency Low Latency Ultra Low Latency Sub Second
30 seconds 10 seconds 4 seconds 1 seconds 0.2 seconds
TARGET
Next generation
protocols combine
viewer experience, low
latency and scalability
WE NEED A NEW ONLINE VIDEO DELIVERY APPROACH
OR AND
Low
Latency
Viewer
experience
Large
Scale
time
stream of frames,
delivered over
HTTP
Now
Can tune in at any frame
Can start playback at any frame
HESP COMBINES THE LOW LATENCY OF STREAMING
APPROACHES WITH THE SCALABILITY OF HAS
HESP OFFERS A TRUE BROADCAST-LIKE VIDEO STREAMING
EXPERIENCE COMBINED WITH ADVANCED INTERACTIVITY
 Near real time interactivity
 In-sync delivery across devices
 Interactive user experiences
SUB-SECOND LATENCY
SIGNIFICANT COST REDUCTION
IN DELIVERY
SCALES IN EXISTING
INFRASTRUCTURE
ENHANCED USER EXPERIENCE
 Remove 10-20% bandwidth overhead for significant cost reduction
 Single protocol, for all devices
 Cost efficient delivery over HTTP internet infrastructure
 Compatible with standard encoders
 Deliver over standard CDN’s
 Instant zapping & seek times
 Full adaptive bitrate algorithm (ABR)
HESP OUTPERFORMS EXISTING SOLUTIONS
HESP OUTPERFORMS CMAF-CTE
0
500
1.000
1.500
2.000
2.500
Latency
(milliseconds)
HESP
CMAF-CTE 1s/1f
CMAF-CTE 2s/5f
CMAF-CTE 6s/5f
0
500
1.000
1.500
2.000
2.500
Latency
(milliseconds)
0
500
1.000
1.500
2.000
2.500
Zapping
time
(milliseconds)
0
50
100
150
200
250
300
Bandwidth
(MB)
HESP has up to 7
times less delivery
delays
HESP has up to
20 times faster
zapping times
HESP has up to
20% bandwidth
savings
HESP: BRINGING HAS TO THE BIG SCREEN THE RIGHT
WAY
 HAS protocols have already established a decent
footprint on most mobile devices and streaming devices
 For IPTV and delivery to STB however, HAS has
significant downsides
 HESP aims to solve this problem by optimizing delivery
towards these platforms as well, targeting RDK and
Android TV based STBs
Web Mobile
Streaming devices
Smart TV
STBs
HESP FUNDAMENTALS = SIMPLICITY
REDUCING OVERHEAD AND INCREASING PERFORMANCE
 Manifest is not needed to start playing the stream.
 Low frequency updates
 HTTP/1.1 based (HTTP/1.1 CTE & Range Requests)
 HTTP/2 frame based streaming
 Initialization stream: can request images at any moment to start playback
 Continuation stream: can continue playback after any initialization stream image
MINIMALISTIC MANIFEST
HTTP DELIVERY
TWO COMPLEMENTARY
STREAMS
HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS
1 2 3 4 5 6 7 8 9 10 11
A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1
C1
Initialization stream 1
Player buffer
Image sequence
HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS
1 2 3 4 5 6 7 8 9 10 11
a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1
d1
Initialization stream 1
Continuation stream 1
Player buffer
Image sequence
A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1
C1
a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1
HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS
1 2 3 4 5 6 7 8 9 10 11
d1 e1 f1
Initialization stream 1
Continuation stream 1
Player buffer
Image sequence
A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1
C1
a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1
HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS
1 2 3 4 5 6 7 8 9 10 11
A2 B2 C2 D2 E2 F2 G2 H2 I2 J2 K2
Initialization stream 1
Initialization stream 2
Continuation stream 1
Player buffer G2
Image sequence
A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1
C1 d1 e1 f1
A2 B2 C2 D2 E2 F2 G2 H2 I2 J2 K2
a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1
HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS
1 2 3 4 5 6 7 8 9 10 11
a2 b2 c2 d2 e2 f2 g2 h2 i2 j2 k2
d1 e1 f1
Initialization stream 1
Initialization stream 2
Continuation stream 1
Continuation stream 2
Player buffer G2 h2 i2 j2 k2
Image sequence
A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1
C1
IMPACT ON INFRASTRUCTURE
HESP
packager
Standard
encoder
Standard
production
NEWS
Regular
CDN
HESP
player
MAXIMAL GAIN
 Target: lowest latency, lowest bandwidth, lowest zapping
times, …
 Continuation stream
 Long CMAF-CTE segments (minutes)
 Ultra-short chunks (1 frame)
 P (and I) frames only (referencing only one previous
frame)
MAXIMAL COMPATIBILITY
 Target: re-use LL-DASH and LL-HLS streams
 Continuation stream
 Regular sized CMAF-CTE segments (~6 seconds)
 Small chunk sizes: ~200msec
 B frames possible: B B B P subgops (in a chunk)
 No bandwidth gain
 HESP latency, zapping times, startup time gain
TWO HESP PROFILES
VIDEO CONTROL FLOW
Video = complete
feed to viewers
VIDEO CONTROL FLOW
Video = complete
feed to viewers
Video is a set of
presentations
The presentation is
the lowest granularity inside a manifest.
Presentation is a set of
segments.
Segment addressing
happens automatically within a
presentation for an efficient and continuous delivery of the continuation stream
VIDEO CONTROL FLOW
Video = complete
feed to viewers
Video is a set of
presentations
The presentation is
the lowest granularity inside a manifest.
MARKERS TO TRIGGER MANIFEST UPDATES
Video packet Video packet Video packet Video packet
Continue with content packets …….
Get initialization packet
MARKERS TO TRIGGER MANIFEST UPDATES
Video packet Video packet Video packet Video packet
Continue with content packets …….
Marker
packet
Get initialization packet
MARKERS TO TRIGGER MANIFEST UPDATES
Video packet Video packet Video packet Video packet
Continue with content packets …….
Manifest file
Marker
packet
Get initialization packet
MARKERS TO TRIGGER MANIFEST UPDATES
Video packet Video packet Video packet Video packet
Video
packet
Video packet
Continue with content packets ……. Get new
initialization
packet
Manifest file
Marker
packet
Get initialization packet
MARKERS TO TRIGGER MANIFEST UPDATES
Video packet Video packet Video packet Video packet
Video
packet
Video packet
Continue with content packets ……. Get new
initialization
packet
Manifest file
Marker
packet
Ad video
packet
Ad video
packet
Continue with content packets …….
Get initialization packet
Ad video
packet
Manifest manipulator
EXAMPLE: AD INSERTION
AD Server
information on viewer
behavior
Video packet Video packet Video packet Video packet
Video
packet
Video packet
Continue with content packets ……. Get new
initialization
packet
Manifest file
Marker
packet
Ad video
packet
Ad video
packet
Continue with content packets …….
Ad video
packet
HESP FEATURES
CBS encryption and
DRM support
Metadata Support SSAI support Advanced ABR
AD
Q3
Q2
Q1
Sub second latency
Instantaneous zapping
Bandwidth saving
Delivery at scale
HESP (HIGH EFFICIENCY STREAMING PROTOCOL)
ALWAYS AHEAD
QUICK LINKS
WANT TO KNOW MORE ABOUT THE HESP ALLIANCE?
VISIT OUR WEBSITE: WWW.HESPALLIANCE.ORG
INTERESTED IN BECOMING A MEMBER?
FIND OUT MORE: WWW.HESPALLIANCE.ORG/JOIN
HAVE ANY QUESTIONS?
CONTACT US: WWW.HESPALLIANCE.ORG/CONTACT

More Related Content

Similar to 2020+HESP+Technical+Deck+-+HESP+Alliance.pdf

Best practices for live streaming
Best practices for live streamingBest practices for live streaming
Best practices for live streamingAlden Fertig
 
[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...
[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...
[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...Amazon Web Services Korea
 
MPEG4 codec for Access Grid
MPEG4 codec for Access GridMPEG4 codec for Access Grid
MPEG4 codec for Access GridVideoguy
 
MPEG4 codec for Access Grid
MPEG4 codec for Access GridMPEG4 codec for Access Grid
MPEG4 codec for Access GridVideoguy
 
Video Streaming Ali Saman Tosun
Video Streaming Ali Saman TosunVideo Streaming Ali Saman Tosun
Video Streaming Ali Saman TosunVideoguy
 
PR-340: DVC: An End-to-end Deep Video Compression Framework
PR-340: DVC: An End-to-end Deep Video Compression FrameworkPR-340: DVC: An End-to-end Deep Video Compression Framework
PR-340: DVC: An End-to-end Deep Video Compression FrameworkHyeongmin Lee
 
Multimedia applications
Multimedia applicationsMultimedia applications
Multimedia applicationssmoky_stu
 
Hikvision 6467 dm device
Hikvision 6467 dm deviceHikvision 6467 dm device
Hikvision 6467 dm deviceBenjie Fabro
 
Developing & Deploying AIR Applications for TV
Developing & Deploying AIR Applications for TVDeveloping & Deploying AIR Applications for TV
Developing & Deploying AIR Applications for TVElad Elrom
 
Open Presentation
Open PresentationOpen Presentation
Open PresentationJason Lysak
 
WebRTC Videobroadcasting
WebRTC VideobroadcastingWebRTC Videobroadcasting
WebRTC VideobroadcastingRavi Kuril
 
IBC 2013 Multi-network Forum - Akamai
IBC 2013 Multi-network Forum - Akamai IBC 2013 Multi-network Forum - Akamai
IBC 2013 Multi-network Forum - Akamai Verimatrix
 
H.265 RTSP Streaming to VLC + NewTek NDI Plugin
H.265 RTSP Streaming to VLC + NewTek NDI PluginH.265 RTSP Streaming to VLC + NewTek NDI Plugin
H.265 RTSP Streaming to VLC + NewTek NDI PluginPaul Richards
 
dat-Post-Producer-final
dat-Post-Producer-finaldat-Post-Producer-final
dat-Post-Producer-finalScott Matics
 

Similar to 2020+HESP+Technical+Deck+-+HESP+Alliance.pdf (20)

Netgem Introduction 2010
Netgem Introduction 2010Netgem Introduction 2010
Netgem Introduction 2010
 
Google tv
Google tvGoogle tv
Google tv
 
Best practices for live streaming
Best practices for live streamingBest practices for live streaming
Best practices for live streaming
 
[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...
[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...
[AWS Media Symposium 2019] AWS Media Services Innovation - Christer Whitehorn...
 
A103_Roe
A103_RoeA103_Roe
A103_Roe
 
MPEG4 codec for Access Grid
MPEG4 codec for Access GridMPEG4 codec for Access Grid
MPEG4 codec for Access Grid
 
MPEG4 codec for Access Grid
MPEG4 codec for Access GridMPEG4 codec for Access Grid
MPEG4 codec for Access Grid
 
Video Streaming Ali Saman Tosun
Video Streaming Ali Saman TosunVideo Streaming Ali Saman Tosun
Video Streaming Ali Saman Tosun
 
PR-340: DVC: An End-to-end Deep Video Compression Framework
PR-340: DVC: An End-to-end Deep Video Compression FrameworkPR-340: DVC: An End-to-end Deep Video Compression Framework
PR-340: DVC: An End-to-end Deep Video Compression Framework
 
Multimedia applications
Multimedia applicationsMultimedia applications
Multimedia applications
 
Hikvision 6467 dm device
Hikvision 6467 dm deviceHikvision 6467 dm device
Hikvision 6467 dm device
 
Developing & Deploying AIR Applications for TV
Developing & Deploying AIR Applications for TVDeveloping & Deploying AIR Applications for TV
Developing & Deploying AIR Applications for TV
 
Open Presentation
Open PresentationOpen Presentation
Open Presentation
 
WebRTC Videobroadcasting
WebRTC VideobroadcastingWebRTC Videobroadcasting
WebRTC Videobroadcasting
 
IBC 2013 Multi-network Forum - Akamai
IBC 2013 Multi-network Forum - Akamai IBC 2013 Multi-network Forum - Akamai
IBC 2013 Multi-network Forum - Akamai
 
Mips track a
Mips   track aMips   track a
Mips track a
 
H.265 RTSP Streaming to VLC + NewTek NDI Plugin
H.265 RTSP Streaming to VLC + NewTek NDI PluginH.265 RTSP Streaming to VLC + NewTek NDI Plugin
H.265 RTSP Streaming to VLC + NewTek NDI Plugin
 
Technoserve
Technoserve Technoserve
Technoserve
 
dat-Post-Producer-final
dat-Post-Producer-finaldat-Post-Producer-final
dat-Post-Producer-final
 
Slide
SlideSlide
Slide
 

More from JunZhao68

1-MIV-tutorial-part-1.pdf
1-MIV-tutorial-part-1.pdf1-MIV-tutorial-part-1.pdf
1-MIV-tutorial-part-1.pdfJunZhao68
 
GOP-Size_report_11_16.pdf
GOP-Size_report_11_16.pdfGOP-Size_report_11_16.pdf
GOP-Size_report_11_16.pdfJunZhao68
 
02-VariableLengthCodes_pres.pdf
02-VariableLengthCodes_pres.pdf02-VariableLengthCodes_pres.pdf
02-VariableLengthCodes_pres.pdfJunZhao68
 
MHV-Presentation-Forman (1).pdf
MHV-Presentation-Forman (1).pdfMHV-Presentation-Forman (1).pdf
MHV-Presentation-Forman (1).pdfJunZhao68
 
CODA_presentation.pdf
CODA_presentation.pdfCODA_presentation.pdf
CODA_presentation.pdfJunZhao68
 
http3-quic-streaming-2020-200121234036.pdf
http3-quic-streaming-2020-200121234036.pdfhttp3-quic-streaming-2020-200121234036.pdf
http3-quic-streaming-2020-200121234036.pdfJunZhao68
 
NTTW4-FFmpeg.pdf
NTTW4-FFmpeg.pdfNTTW4-FFmpeg.pdf
NTTW4-FFmpeg.pdfJunZhao68
 
03-Reznik-DASH-IF-workshop-2019-CAE.pdf
03-Reznik-DASH-IF-workshop-2019-CAE.pdf03-Reznik-DASH-IF-workshop-2019-CAE.pdf
03-Reznik-DASH-IF-workshop-2019-CAE.pdfJunZhao68
 
Practical Programming.pdf
Practical Programming.pdfPractical Programming.pdf
Practical Programming.pdfJunZhao68
 
Overview_of_H.264.pdf
Overview_of_H.264.pdfOverview_of_H.264.pdf
Overview_of_H.264.pdfJunZhao68
 
20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdf
20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdf20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdf
20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdfJunZhao68
 
Wojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdf
Wojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdfWojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdf
Wojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdfJunZhao68
 
100G Networking Berlin.pdf
100G Networking Berlin.pdf100G Networking Berlin.pdf
100G Networking Berlin.pdfJunZhao68
 
20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdf
20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdf20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdf
20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdfJunZhao68
 
3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdf
3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdf3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdf
3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdfJunZhao68
 
5 - Advanced SVE.pdf
5 - Advanced SVE.pdf5 - Advanced SVE.pdf
5 - Advanced SVE.pdfJunZhao68
 

More from JunZhao68 (16)

1-MIV-tutorial-part-1.pdf
1-MIV-tutorial-part-1.pdf1-MIV-tutorial-part-1.pdf
1-MIV-tutorial-part-1.pdf
 
GOP-Size_report_11_16.pdf
GOP-Size_report_11_16.pdfGOP-Size_report_11_16.pdf
GOP-Size_report_11_16.pdf
 
02-VariableLengthCodes_pres.pdf
02-VariableLengthCodes_pres.pdf02-VariableLengthCodes_pres.pdf
02-VariableLengthCodes_pres.pdf
 
MHV-Presentation-Forman (1).pdf
MHV-Presentation-Forman (1).pdfMHV-Presentation-Forman (1).pdf
MHV-Presentation-Forman (1).pdf
 
CODA_presentation.pdf
CODA_presentation.pdfCODA_presentation.pdf
CODA_presentation.pdf
 
http3-quic-streaming-2020-200121234036.pdf
http3-quic-streaming-2020-200121234036.pdfhttp3-quic-streaming-2020-200121234036.pdf
http3-quic-streaming-2020-200121234036.pdf
 
NTTW4-FFmpeg.pdf
NTTW4-FFmpeg.pdfNTTW4-FFmpeg.pdf
NTTW4-FFmpeg.pdf
 
03-Reznik-DASH-IF-workshop-2019-CAE.pdf
03-Reznik-DASH-IF-workshop-2019-CAE.pdf03-Reznik-DASH-IF-workshop-2019-CAE.pdf
03-Reznik-DASH-IF-workshop-2019-CAE.pdf
 
Practical Programming.pdf
Practical Programming.pdfPractical Programming.pdf
Practical Programming.pdf
 
Overview_of_H.264.pdf
Overview_of_H.264.pdfOverview_of_H.264.pdf
Overview_of_H.264.pdf
 
20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdf
20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdf20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdf
20160927-tierney-improving-performance-40G-100G-data-transfer-nodes.pdf
 
Wojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdf
Wojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdfWojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdf
Wojciech Przybyl - Efficient Trick Modes with MPEG-DASH.pdf
 
100G Networking Berlin.pdf
100G Networking Berlin.pdf100G Networking Berlin.pdf
100G Networking Berlin.pdf
 
20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdf
20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdf20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdf
20230320-信息技术-人工智能系列深度报告:AIGC行业综述篇——开启AI新篇章-国海证券.pdf
 
3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdf
3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdf3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdf
3 Open-Source-SYCL-Intel-Khronos-EVS-Workshop_May19.pdf
 
5 - Advanced SVE.pdf
5 - Advanced SVE.pdf5 - Advanced SVE.pdf
5 - Advanced SVE.pdf
 

Recently uploaded

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 

Recently uploaded (20)

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 

2020+HESP+Technical+Deck+-+HESP+Alliance.pdf

  • 1. HESP ULTRA LOW LATENCY, ULTRA FAST ZAPPING, LOW BANDWIDTH AT SCALE
  • 2. Worldwide online video revenues are growing exponentially. 0 50 100 150 200 2018 2019 2024 B B B B € € € € € ONLINE VIDEO IS BOOMING, CALLING FOR SCALABILITY O N L I N E V I D E O A C R O S S D I F F E R E N T P L AT F O R M S A N D D E V I C E S Online video consumption growth in 2018-2019 period 25% of Internet Traffic will be video by 2022. And 15% of it will be live. 82%
  • 3. 60% 2 sec Almost 60% of people would be more likely to watch live sports online if the stream was not delayed from broadcast. A majority of viewers will abandon video services after less than two seconds of zapping time. Lean back experience becomes the minimal requirement ONLINE VIEWERS ARE MORE DEMANDING THAN EVER
  • 4.  Near real time interactivity  In-sync delivery across devices  Interactive user experiences  Low bandwidth  Single protocol, for all devices  Cost efficient delivery over internet infrastructure  Instant zapping & seek times  Full adaptive bitrate algorithm (ABR) CURRENT OTT VIDEO DISTRIBUTION REQUIRES A TRADE-OFF… Low Latency Viewer experience Large Scale
  • 5. … RESULTING IN SUBOPTIMAL VIDEO DELIVERY SOLUTIONS Low Latency Viewer experience Large Scale WebRTC / RTMP streaming focuses on ultra-low latency, at the expense of BW and high cost HLS/DASH HTTP Adaptive Streaming focuses on cost, scalability, reach, at the expense of latency & zapping times
  • 6. REDUCING SEGMENT SIZE DOES NOT HELP ENOUGH 60+ seconds Latency Decreases High Latency 10+ Second Segment HLS/DASH Short Segment HLS/DASH Standard Latency Low Latency Ultra Low Latency Sub Second TARGET 30 seconds 10 seconds 4 seconds 1 seconds 0.2 seconds
  • 7. LL-DASH AND LL-HLS IMPROVE LATENCY AND ZAPPING TIMES Still not at the level of streaming technologies 60+ seconds Latency Decreases High Latency 10+ Second Segment HLS/DASH Short Segment HLS/DASH Chunked Transfer HLS/DASH Apple LL HLS Standard Latency Low Latency Ultra Low Latency Sub Second 30 seconds 10 seconds 4 seconds 1 seconds 0.2 seconds TARGET
  • 8. Next generation protocols combine viewer experience, low latency and scalability WE NEED A NEW ONLINE VIDEO DELIVERY APPROACH OR AND Low Latency Viewer experience Large Scale
  • 9. time stream of frames, delivered over HTTP Now Can tune in at any frame Can start playback at any frame HESP COMBINES THE LOW LATENCY OF STREAMING APPROACHES WITH THE SCALABILITY OF HAS
  • 10. HESP OFFERS A TRUE BROADCAST-LIKE VIDEO STREAMING EXPERIENCE COMBINED WITH ADVANCED INTERACTIVITY  Near real time interactivity  In-sync delivery across devices  Interactive user experiences SUB-SECOND LATENCY SIGNIFICANT COST REDUCTION IN DELIVERY SCALES IN EXISTING INFRASTRUCTURE ENHANCED USER EXPERIENCE  Remove 10-20% bandwidth overhead for significant cost reduction  Single protocol, for all devices  Cost efficient delivery over HTTP internet infrastructure  Compatible with standard encoders  Deliver over standard CDN’s  Instant zapping & seek times  Full adaptive bitrate algorithm (ABR)
  • 12. HESP OUTPERFORMS CMAF-CTE 0 500 1.000 1.500 2.000 2.500 Latency (milliseconds) HESP CMAF-CTE 1s/1f CMAF-CTE 2s/5f CMAF-CTE 6s/5f 0 500 1.000 1.500 2.000 2.500 Latency (milliseconds) 0 500 1.000 1.500 2.000 2.500 Zapping time (milliseconds) 0 50 100 150 200 250 300 Bandwidth (MB) HESP has up to 7 times less delivery delays HESP has up to 20 times faster zapping times HESP has up to 20% bandwidth savings
  • 13. HESP: BRINGING HAS TO THE BIG SCREEN THE RIGHT WAY  HAS protocols have already established a decent footprint on most mobile devices and streaming devices  For IPTV and delivery to STB however, HAS has significant downsides  HESP aims to solve this problem by optimizing delivery towards these platforms as well, targeting RDK and Android TV based STBs Web Mobile Streaming devices Smart TV STBs
  • 14. HESP FUNDAMENTALS = SIMPLICITY REDUCING OVERHEAD AND INCREASING PERFORMANCE  Manifest is not needed to start playing the stream.  Low frequency updates  HTTP/1.1 based (HTTP/1.1 CTE & Range Requests)  HTTP/2 frame based streaming  Initialization stream: can request images at any moment to start playback  Continuation stream: can continue playback after any initialization stream image MINIMALISTIC MANIFEST HTTP DELIVERY TWO COMPLEMENTARY STREAMS
  • 15. HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS 1 2 3 4 5 6 7 8 9 10 11 A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1 C1 Initialization stream 1 Player buffer Image sequence
  • 16. HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS 1 2 3 4 5 6 7 8 9 10 11 a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1 d1 Initialization stream 1 Continuation stream 1 Player buffer Image sequence A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1 C1
  • 17. a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1 HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS 1 2 3 4 5 6 7 8 9 10 11 d1 e1 f1 Initialization stream 1 Continuation stream 1 Player buffer Image sequence A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1 C1
  • 18. a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1 HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS 1 2 3 4 5 6 7 8 9 10 11 A2 B2 C2 D2 E2 F2 G2 H2 I2 J2 K2 Initialization stream 1 Initialization stream 2 Continuation stream 1 Player buffer G2 Image sequence A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1 C1 d1 e1 f1
  • 19. A2 B2 C2 D2 E2 F2 G2 H2 I2 J2 K2 a1 b1 c1 d1 e1 f1 g1 h1 i1 j1 k1 HESP FUNDAMENTALS = TWO COMPLEMENTARY STREAMS 1 2 3 4 5 6 7 8 9 10 11 a2 b2 c2 d2 e2 f2 g2 h2 i2 j2 k2 d1 e1 f1 Initialization stream 1 Initialization stream 2 Continuation stream 1 Continuation stream 2 Player buffer G2 h2 i2 j2 k2 Image sequence A1 B1 C1 D1 E1 F1 G1 H1 I1 J1 K1 C1
  • 21. MAXIMAL GAIN  Target: lowest latency, lowest bandwidth, lowest zapping times, …  Continuation stream  Long CMAF-CTE segments (minutes)  Ultra-short chunks (1 frame)  P (and I) frames only (referencing only one previous frame) MAXIMAL COMPATIBILITY  Target: re-use LL-DASH and LL-HLS streams  Continuation stream  Regular sized CMAF-CTE segments (~6 seconds)  Small chunk sizes: ~200msec  B frames possible: B B B P subgops (in a chunk)  No bandwidth gain  HESP latency, zapping times, startup time gain TWO HESP PROFILES
  • 22. VIDEO CONTROL FLOW Video = complete feed to viewers
  • 23. VIDEO CONTROL FLOW Video = complete feed to viewers Video is a set of presentations The presentation is the lowest granularity inside a manifest.
  • 24. Presentation is a set of segments. Segment addressing happens automatically within a presentation for an efficient and continuous delivery of the continuation stream VIDEO CONTROL FLOW Video = complete feed to viewers Video is a set of presentations The presentation is the lowest granularity inside a manifest.
  • 25. MARKERS TO TRIGGER MANIFEST UPDATES Video packet Video packet Video packet Video packet Continue with content packets ……. Get initialization packet
  • 26. MARKERS TO TRIGGER MANIFEST UPDATES Video packet Video packet Video packet Video packet Continue with content packets ……. Marker packet Get initialization packet
  • 27. MARKERS TO TRIGGER MANIFEST UPDATES Video packet Video packet Video packet Video packet Continue with content packets ……. Manifest file Marker packet Get initialization packet
  • 28. MARKERS TO TRIGGER MANIFEST UPDATES Video packet Video packet Video packet Video packet Video packet Video packet Continue with content packets ……. Get new initialization packet Manifest file Marker packet Get initialization packet
  • 29. MARKERS TO TRIGGER MANIFEST UPDATES Video packet Video packet Video packet Video packet Video packet Video packet Continue with content packets ……. Get new initialization packet Manifest file Marker packet Ad video packet Ad video packet Continue with content packets ……. Get initialization packet Ad video packet
  • 30. Manifest manipulator EXAMPLE: AD INSERTION AD Server information on viewer behavior Video packet Video packet Video packet Video packet Video packet Video packet Continue with content packets ……. Get new initialization packet Manifest file Marker packet Ad video packet Ad video packet Continue with content packets ……. Ad video packet
  • 31. HESP FEATURES CBS encryption and DRM support Metadata Support SSAI support Advanced ABR AD Q3 Q2 Q1
  • 32. Sub second latency Instantaneous zapping Bandwidth saving Delivery at scale HESP (HIGH EFFICIENCY STREAMING PROTOCOL) ALWAYS AHEAD
  • 33. QUICK LINKS WANT TO KNOW MORE ABOUT THE HESP ALLIANCE? VISIT OUR WEBSITE: WWW.HESPALLIANCE.ORG INTERESTED IN BECOMING A MEMBER? FIND OUT MORE: WWW.HESPALLIANCE.ORG/JOIN HAVE ANY QUESTIONS? CONTACT US: WWW.HESPALLIANCE.ORG/CONTACT