Wowza Ultra-Low Latency Streaming

Ryan Jespersen
Ryan JespersenStreaming Media & Video Expert at Wowza Media Systems
Ultra-Low Latency
Streaming for OTTtv
CONFIDENTIAL© 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
Content DeliveryWorld Summit
WOWZA MAKES VIDEO UBIQUITOUS
© 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
20,000+ CUSTOMERS IN 170+ COUNTRIES FROM THE WORLD’S MOST
SOPHISTICATED MEDIA, TELCO, AND TECH COMPANIES TO SMALL BUSINESSES & DEVELOPERS
SERVICE PROVIDERS
ENTERPRISE &
GOVERNMENT
EDUCATION
Video comprised 64% of
global internet traffic in 2014
and will reach 80% by 2019
94% of young executives say
video breaks down language
barriers in the global market
Viewers of sports on
mobile devices` doubled
from 2011 to 2015
66% of university
respondents said streaming
is a top strategic initiative
~40% OF CDNS
WORLDWIDE RUN
WOWZA
70+ PERCENT OF
GARTNER’S ENTERPRISE
VIDEO QUADRANT
RUNS WOWZA
EVERY MINOR LEAGUE
BASEBALL GAME RUNS
ON WOWZA
85% OF THE TOP 25 U.S.
UNIVERSITIES, WITH 100%
OF IVY LEAGUE RUN
WOWZA
EVERYONE
Houses of
Worship
Transportation
Public Safety
Public Transit
Medical
Security
Armed Services
20,000 customers across all
industries build on Wowza for
video & audio
SPORTS
Powering Leading-Edge Broadcasting
© 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
© 2016 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
THE SOFTWARE BEHIND THE STREAMING REVOLUTION
• END-TO-END VIDEO & AUDIO WORKFLOW
• DEEP DEVELOPER INTEGRATION VIA API, IDE, SDK
• ENORMOUS GLOBAL CUSTOMER BASE
• STRATEGIC TO ALL CLOUD PLATFORMS
450 Million
Live Viewing Hours per Month
20,000
Paying Customers
43 Million
Live Broadcasts per Year
(not including social media)
OVER 25%
OF WORLDWIDE LIVE STREAMING
WOWZA POWERS
345,000
Hours of Live
Transcoding per Day
WHAT IS LATENCY?
Latency is a time interval between the stimulation and response, or, from a
more general point of view, a time delay between the cause and the effect of
some physical change in the system being observed.
In terms of streaming, latency is the delay between the initial capture of the
video and the viewer.
TERMS
• Time to first frame - Time delay from when a person clicks the play button
and when video appears
• Broadcast Delay – The practice of intentionally delaying the broadcast of live
material to prevent profanity, bloopers, or violence
• Quality - Higher quality = higher resolution = more data to send
• Scale - How many inputs/participants, how far, how many viewers
• Bandwidth - How much traffic can the infrastructure ideally handle
• Throughput - How much traffic is the infrastructure really delivering
• Bitrate - How many bits of data are being processed over time
LATENCY ADDS UP
© 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
The video streaming industry solved for scale, but sacrificed latency. Now we need the best of both worlds.
Success Depends on a Usable Experience
© 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
An interactive and social gaming audience
Synchronized streams for a “live” experience
Betting with near-real time information
Requires	imperceptible	delay	
where	up	to	the	second	
information	means	winning	
or	losing.
Requires	the	coordination	
between	two	delivery	
systems	so	the	audience	
experience	is	seamless.
Requires	near-real	time	
viewing	so	an	audience	can	
actively	participate	or	interact	
with	the	gaming	experience.
STREAMING LATENCY
© 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
WHY IS LATENCY A PROBLEM?
• Latency is not usually a problem – but people think it is.
• For many (or possibly most) live streams, latency does not matter.
• HTTP streaming intentionally introduces latency for improved reliability.
For some live streams, latency is critical.
Ultra-Low Latency Demo
WHAT FACTORS IMPACT LATENCY?
1. Quality
• Resolution
• Two-way
• Multi-thread
• Frame rate
• Smooth playback
• Chunk/Block Size
• Buffering
2. Scale
• Distance
• Participants
• Viewers
• Streams
• Complexity
• Variability
• Diverse endpoints
Low	
Latency
Large		
Scale
High	
Quality
As either (or both) increase latency increases
HOW QUALITY INJECTS LATENCY?
• Higher quality = higher resolution = more data to send.
• Resolution increases the amount of data in any frame, block, chunk or time
slice. If we hold infrastructure constant as resolution goes up the window and
latency to deliver a segment increases.
• Trade-offs: Some mitigation techniques:
Increasing Throughput
Increasing throughput with
more bandwidth(network)
and bitrate(compute) = More
infrastructure, more
overhead, more cost
Reducing Buffer
Reducing the buffer requirement will
reduce latency but it also makes
network fluctuations more visible to
the viewer – e.g. a 1ms buffer
ideally means content can be
viewed as little as 1ms after capture
but a 0.1-second network
interruption will result in 100 buffer
segments being un-recoverable in a
live stream.
Reducing Framerate
Reducing the (frame rate) number of
frames per second reduces the
smoothness of the viewing
experience – e.g. 15 fps is generally
a good viewing experience for low
movement broadcasts like
presentation screen capture/sharing
or many church services, it will
produce a choppy experience for
viewing sports
HOW SCALE INJECTS LATENCY?
• Scale increases distances, complexity and variability.
• As distance, the number of streams, and viewers increase, network
imperfections, variability, and degradation increase and can amplify latency.
• Trade-offs: Some mitigation techniques:
Increasing Throughput
Increasing throughput with
more bandwidth(network)
and bitrate(compute) = More
infrastructure, more
complexity, more overhead,
more cost
Increasing Buffer
Increasing buffer size adds ability
for both encoders, transcoders and
players to deal with variability
smoothly but increasing buffer
inherently increases latency. By
definition, buffer size is the
minimum amount of data for which a
process can be initiated. If more
data must be accumulated, then
processing will take longer.
TCP vs UDP
Because it is a lighter weight protocol
without error checking, monitoring,
order of messaging and headers
roughly 1/3 the size of TCP, UDP is
inherently faster but there is no
guarantee data is received.
WHERE STREAMING LATENCY HAS BEEN
Windows Media
• MMS, RTSP, HTTP (using UDP or TCP)
• Encoder, Server, and Player buffer size
management
• “Low delay” audio codecs
• Fast Start, Advanced Fast Start, Fast
Recovery, Fast Reconnect, FEC
• 2-3 seconds (on a good network)
Real Time Streaming Protocol (RTSP)
• Developed and by RealNetworks
• Relies on RTP and RTCP
• Frames can be sent one at a time
in real time
• Can leverage UDP
• Potential latency could be as low
as ~125 ms with minimal buffering
Real Time Messaging Protocol (RTMP)
• Developed & open sourced by Adobe
• 1-3 seconds and sub-1 second
HTTP
• Apple HLS
• 30+ seconds on iOS
• Using 10 second chunk sizes
• MPEG-DASH
• 10-20 seconds (variable)
WHERE LATENCY IS GOING
WebRTC
• Designed for real-time audio, video
and data delivery over less-reliable
connections
• Leverages TCP or UDP
• Multiple protocols related to
RTSP/RTP
• 1 second or less (as low as 200 ms)
WebSocket
• Designed to provide a standardized,
two-way, reliable communications
channel between a browser and a
server
• Works with TCP
• Can be used with other streaming
protocols including RTMP, WebRTC,
Haivision SRT, Wowza WOWZ and
Aspera FASP
• As low as 200 ms
WHERE LATENCY IS GOING
HTTP
• Below 4 seconds (using 1 second chunks) for DASH
• Optimizing DASH MPD attributes (availabilityStartTime and minBufferTime)
• Below 8 seconds (using 2 second chunks) for HLS (includes GOP
adjustments as well)
• CMAF + HTTP/1.1 (using HTTP Chunked Transfer Coding) enables video
transfer, decode, and display before the end of the chunk encoding
• Video encoding enhancements that do not impact decoding (H.264 GDR)
WHERE LATENCY IS GOING
Quick UDP Internet Connections (QUIC)
• Uses UDP (with TCP fallback)
• Focuses on security and reliability
• Tries to be like TCP while reducing
connect and round trip times, packet
loss, congestion control, and more
using intelligent retransmissions and
storage and delivery of information
• Built with HTTP/2 in mind
Secure Reliable Transport (SRT)
• A video transport protocol that
enables the delivery of high-
quality and secure, low-latency
video across the public Internet
• Designed to deliver the best
quality live video over the worst
networks
• Accounts for packet loss, jitter,
and fluctuating bandwidth while
maximizing quality
WHERE LATENCY IS GOING
Wowza Streaming Cloud Ultra Low Latency Service
• A cloud-based, highly scalable streaming service
• Using Wowza WOWZ + WebSocket in an origin-edge architecture
• Sub 2 seconds end-to-end (origin to player)
• Completely API-driven, no user-interface
Features include:
• Scaled Origin Network
• Scaled Edge network
• Playback components: SDK for browser and native apps on mobile
• Publishing and playback security
• Basic Analytics
• Recording
Mid tier EdgeOrigin
{ }Analytics
Live encoderIP camera
REST APIPull distribution Push distribution
Push distribution
WOWZA ULTRA LOW LATENCY SERVICE
REDUCING WORKFLOW COMPONENT LATENCY
Think about latency at every step
• Content creation (codec, bitrate, resolution)
• Streaming workflow and devices
• Buffer management (encoder, player)
• Network considerations
• How you optimize delivery (protocol, transport layer)
• How you reach your audience (size, location, and quality)
WebRTC and WebSocket can scale using traditional origin/mid-tier/edge
configurations (still requires “aware” clients)
CDNs are investigating options to enable low latency through their networks
• “Tuned” HTTP is a front runner
MEASURING LATENCY
• This is not easy (especially at scale)
• Latency is commonly measured in seconds (or milliseconds) though some
prefer frames
• A visual test is easy but requires accurate clocks (synchronized using
“reliable” NTP servers)
• For “traditional” streaming protocols, markers in the stream can be used
Wowza Ultra-Low Latency Streaming
©	2017	Wowza	Media	Systems,	LLC.	All	rights	reserved.	Confidential	&	 Proprietary
Network	Characteristic	that	KILL	real	time	video
Ø Packet	loss	– packets	being	discarded	by	routers
Ø Jitter – packets	arriving	at	different	times	than	expected
Ø Delay – the	time	from	sender	to	receiver
Ø Bandwidth – the	fluctuating	capacity	between	points
Overcoming	Adverse	Network	Conditions
©	2017	Wowza	Media	Systems,	LLC.	All	rights	reserved.	Confidential	&	 Proprietary
SRT	Fundamentals	
Source Destination
SRT	Workflow
AWS
AWS
©	2017	Wowza	Media	Systems,	LLC.	All	rights	reserved.	Confidential	&	 Proprietary
SRT	Fundamentals	
bps
t
Constant	frame	rate
Encoder	Variable	Bitrate
Unreliable	“Dirty" Network
Packet	Loss,	Network	Jitter,
Variable	Delay,	Bandwidth	Fluctuation
t
Erratic bitrate	and frame	rate
Decoder’s	Worst	Nightmare!
SRT	Fundamentals
©	2017	Wowza	Media	Systems,	LLC.	All	rights	reserved.	Confidential	&	 Proprietary
bps
t
Constant	frame	rate
Encoder	Variable	Bitrate
t
Reconstructed	video	frame	rate
Much	Happier	Decoder	J
Sender
Buffer
Receiver
Buffer
Encapsulation	& Network	Time	Stamps
Feedback
SRT	Fundamentals	
SRT	Fundamentals
©	2017	Wowza	Media	Systems,	LLC.	All	rights	reserved.	Confidential	&	 Proprietary
bps
t
Constant	frame	rate
Encoder	Variable	Bitrate
t
Reconstructed	video	frame	rate
Much	Happier	Decoder	Jü Video
ü Audio
ü Metadata
ü Packet	acknowledgement	– error	recovery
ü Timing	– low	latency	streaming
ü Network	connection	characteristics
ü Bi-directional
ü Firewall	Friendly
SRT	Fundamentals	
SRT	Fundamentals
©	2017	Wowza	Media	Systems,	LLC.	All	rights	reserved.	Confidential	&	 Proprietary
SRT	Fundamentals	
SRT	Demo
SRT	in	Wowza	Streaming Engine
Ø Greater	reliability	of	throughput	and	packet	loss
Ø Improved	bandwidth	utilization	with	network	bandwidth	fluctuations	&	long-haul	video	transport
RESULTS	- Germany	to	Australia,	using	a	consumer	DSL	connection:	
• 7.5x	increase	of	throughput	with	SRT,	compared	to	RTMP	connections	over	TCP.
• RTMP:	800/10,000	kbits throughput
• SRT:	and	6000/10,000	kbits throughput
Ø Independent	security	/	encryption
Ø Minimized	buffer	4x	RTT	(re-transmission	time)
Ø Logic	for	packet	loss	recovery	and	jitter	only	requires	4	x	the	network	latency	to	the	server
Ø Wide	adoption:	free	open	source,	known	&	trusted
SRT	in	Wowza	Streaming	Engine	Wowza	Streaming EngineSRT	Fundamentals	
Benefits	of	SRT	|	Results
SRT	Alliance Members
Members
© 2015 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
“Wowza” and other identified trademarks are either registered or claimed trademarks of Wowza Media Systems, LLC;
visit wowza.com/legal/trademarks for more information. Third-party trademarks are property of their respective owners;
their use does not imply endorsement of Wowza products or services by the trademark owner.
www.twitter.com/wowzamedia
www.youtube.com/user/wowzamediawww.facebook.com/wowza
www.plus.google.com/+wowza/posts
www.linkedin.com/company/wowza-media-systems
WWW.WOWZA.COM
1 of 32

Recommended

ABEMA を次のフェーズへ進化させる技術への取り組み by
ABEMA を次のフェーズへ進化させる技術への取り組みABEMA を次のフェーズへ進化させる技術への取り組み
ABEMA を次のフェーズへ進化させる技術への取り組みYusuke Goto
1.2K views100 slides
ABEMA の視聴品質向上戦術 by
ABEMA の視聴品質向上戦術ABEMA の視聴品質向上戦術
ABEMA の視聴品質向上戦術Yusuke Goto
1.8K views102 slides
Tokyo Video Tech #2 動画配信の課題とCMAF活用のメリットデメリット by
Tokyo Video Tech #2 動画配信の課題とCMAF活用のメリットデメリットTokyo Video Tech #2 動画配信の課題とCMAF活用のメリットデメリット
Tokyo Video Tech #2 動画配信の課題とCMAF活用のメリットデメリットMasashi Ito
4.1K views44 slides
より高品質なメディアサービスを目指す ABEMA の技術進化 by
より高品質なメディアサービスを目指す ABEMA の技術進化より高品質なメディアサービスを目指す ABEMA の技術進化
より高品質なメディアサービスを目指す ABEMA の技術進化Yusuke Goto
1.9K views164 slides
KubeEdgeを触ってみた by
KubeEdgeを触ってみたKubeEdgeを触ってみた
KubeEdgeを触ってみたTomoyuki Tanigaki
533 views9 slides
リアルタイムなゲームの開発でコンテナを使ってみたら簡単便利で激安だったのでオススメしたい by
リアルタイムなゲームの開発でコンテナを使ってみたら簡単便利で激安だったのでオススメしたいリアルタイムなゲームの開発でコンテナを使ってみたら簡単便利で激安だったのでオススメしたい
リアルタイムなゲームの開発でコンテナを使ってみたら簡単便利で激安だったのでオススメしたいYutoNishine
1.4K views21 slides

More Related Content

What's hot

【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~ by
【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~
【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~UnityTechnologiesJapan002
63.1K views82 slides
実践 NestJS by
実践 NestJS実践 NestJS
実践 NestJSAyumi Goto
1.2K views189 slides
動画配信プラットフォーム on AWS by
動画配信プラットフォーム on AWS動画配信プラットフォーム on AWS
動画配信プラットフォーム on AWSAmazon Web Services Japan
19.2K views40 slides
ライブストリーミングの基礎知識 by
ライブストリーミングの基礎知識ライブストリーミングの基礎知識
ライブストリーミングの基礎知識kumaryu
47.4K views22 slides
モバイルアプリの高速で安定したビルドを支えるJenkins運用術 by
モバイルアプリの高速で安定したビルドを支えるJenkins運用術モバイルアプリの高速で安定したビルドを支えるJenkins運用術
モバイルアプリの高速で安定したビルドを支えるJenkins運用術KLab Inc. / Tech
226 views15 slides
Hyperledger Fabric のプラットフォームおよびインフラ運用 by
Hyperledger Fabric のプラットフォームおよびインフラ運用Hyperledger Fabric のプラットフォームおよびインフラ運用
Hyperledger Fabric のプラットフォームおよびインフラ運用Hyperleger Tokyo Meetup
1.1K views55 slides

What's hot(20)

【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~ by UnityTechnologiesJapan002
【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~
【Unite Tokyo 2019】Unityだったら簡単!マルチプレイ用ゲームサーバ開発 ~実践編~
実践 NestJS by Ayumi Goto
実践 NestJS実践 NestJS
実践 NestJS
Ayumi Goto1.2K views
ライブストリーミングの基礎知識 by kumaryu
ライブストリーミングの基礎知識ライブストリーミングの基礎知識
ライブストリーミングの基礎知識
kumaryu47.4K views
モバイルアプリの高速で安定したビルドを支えるJenkins運用術 by KLab Inc. / Tech
モバイルアプリの高速で安定したビルドを支えるJenkins運用術モバイルアプリの高速で安定したビルドを支えるJenkins運用術
モバイルアプリの高速で安定したビルドを支えるJenkins運用術
KLab Inc. / Tech226 views
Hyperledger Fabric のプラットフォームおよびインフラ運用 by Hyperleger Tokyo Meetup
Hyperledger Fabric のプラットフォームおよびインフラ運用Hyperledger Fabric のプラットフォームおよびインフラ運用
Hyperledger Fabric のプラットフォームおよびインフラ運用
RUM と STM で実現する動画視聴における信頼性エンジニアリング by Yusuke Goto
RUM と STM で実現する動画視聴における信頼性エンジニアリングRUM と STM で実現する動画視聴における信頼性エンジニアリング
RUM と STM で実現する動画視聴における信頼性エンジニアリング
Yusuke Goto738 views
Aws amplify studioが変えるフロントエンド開発の未来とは v2 by Koitabashi Yoshitaka
Aws amplify studioが変えるフロントエンド開発の未来とは v2Aws amplify studioが変えるフロントエンド開発の未来とは v2
Aws amplify studioが変えるフロントエンド開発の未来とは v2
SFUの話 by tnoho
SFUの話SFUの話
SFUの話
tnoho14.3K views
ライブストリーミング低遅延化の取り組み @ DeNA by akirahiguchi
ライブストリーミング低遅延化の取り組み @ DeNAライブストリーミング低遅延化の取り組み @ DeNA
ライブストリーミング低遅延化の取り組み @ DeNA
akirahiguchi11.4K views
MagicOnion入門 by torisoup
MagicOnion入門MagicOnion入門
MagicOnion入門
torisoup10.4K views
NABShow報告:マルチCDNと最新ストリーミングプロトコル by Tomohiro Matsuzawa
NABShow報告:マルチCDNと最新ストリーミングプロトコルNABShow報告:マルチCDNと最新ストリーミングプロトコル
NABShow報告:マルチCDNと最新ストリーミングプロトコル
Tomohiro Matsuzawa1.8K views
GitLab CI/CD パイプライン by Tetsurou Yano
GitLab CI/CD パイプラインGitLab CI/CD パイプライン
GitLab CI/CD パイプライン
Tetsurou Yano12K views
OpenStackを利用したNFVの商用化 - OpenStack最新情報セミナー 2017年7月 by VirtualTech Japan Inc.
OpenStackを利用したNFVの商用化 - OpenStack最新情報セミナー 2017年7月OpenStackを利用したNFVの商用化 - OpenStack最新情報セミナー 2017年7月
OpenStackを利用したNFVの商用化 - OpenStack最新情報セミナー 2017年7月
イベント・ソーシングを知る by Shuhei Fujita
イベント・ソーシングを知るイベント・ソーシングを知る
イベント・ソーシングを知る
Shuhei Fujita31K views
今話題のいろいろなコンテナランタイムを比較してみた by Kohei Tokunaga
今話題のいろいろなコンテナランタイムを比較してみた今話題のいろいろなコンテナランタイムを比較してみた
今話題のいろいろなコンテナランタイムを比較してみた
Kohei Tokunaga61.8K views
AbemaTV が対峙する技術的課題と開発の現場 by Yusuke Goto
AbemaTV が対峙する技術的課題と開発の現場AbemaTV が対峙する技術的課題と開発の現場
AbemaTV が対峙する技術的課題と開発の現場
Yusuke Goto6.2K views

Similar to Wowza Ultra-Low Latency Streaming

ENSA_Module_9-QoS Concept.pptx by
ENSA_Module_9-QoS Concept.pptxENSA_Module_9-QoS Concept.pptx
ENSA_Module_9-QoS Concept.pptxZikoSuryaLesmana
9 views58 slides
Video Streaming by
Video StreamingVideo Streaming
Video StreamingVideoguy
2.3K views45 slides
Audio And Video Over Internet by
Audio And Video Over InternetAudio And Video Over Internet
Audio And Video Over InternetSudarsun Santhiappan
2.7K views28 slides
Inlet Technologies - Powering Smooth Streaming by
Inlet Technologies - Powering Smooth StreamingInlet Technologies - Powering Smooth Streaming
Inlet Technologies - Powering Smooth StreamingSematron UK Ltd
694 views4 slides
Computer Networking by
Computer NetworkingComputer Networking
Computer NetworkingJayaprakash Nagaruru
406 views47 slides
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobile by
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobilebitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
bitdash - Simple & Easy MPEG-DASH Player for Web and MobileBitmovin Inc
3.2K views16 slides

Similar to Wowza Ultra-Low Latency Streaming(20)

Video Streaming by Videoguy
Video StreamingVideo Streaming
Video Streaming
Videoguy2.3K views
Inlet Technologies - Powering Smooth Streaming by Sematron UK Ltd
Inlet Technologies - Powering Smooth StreamingInlet Technologies - Powering Smooth Streaming
Inlet Technologies - Powering Smooth Streaming
Sematron UK Ltd694 views
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobile by Bitmovin Inc
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobilebitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
bitdash - Simple & Easy MPEG-DASH Player for Web and Mobile
Bitmovin Inc3.2K views
AWS re:Invent - Med305 Achieving consistently high throughput for very large ... by asperasoft
AWS re:Invent - Med305 Achieving consistently high throughput for very large ...AWS re:Invent - Med305 Achieving consistently high throughput for very large ...
AWS re:Invent - Med305 Achieving consistently high throughput for very large ...
asperasoft601 views
The OTT Challenge - Eric Leung by MyNOG
The OTT Challenge - Eric LeungThe OTT Challenge - Eric Leung
The OTT Challenge - Eric Leung
MyNOG492 views
6. QoS Concepts.pdf by yohansurya2
6. QoS Concepts.pdf6. QoS Concepts.pdf
6. QoS Concepts.pdf
yohansurya2131 views
WiZE Streaming Vs Downloading by maharastaman
WiZE  Streaming Vs DownloadingWiZE  Streaming Vs Downloading
WiZE Streaming Vs Downloading
maharastaman477 views
Download presentation source by Videoguy
Download presentation sourceDownload presentation source
Download presentation source
Videoguy118 views
Voice Over IP (VoIP) and STREAMING by Ragheb Gmira
Voice Over IP (VoIP) and STREAMINGVoice Over IP (VoIP) and STREAMING
Voice Over IP (VoIP) and STREAMING
Ragheb Gmira7.9K views
VoIP Monitoring and Troubleshooting by ThousandEyes
VoIP Monitoring and TroubleshootingVoIP Monitoring and Troubleshooting
VoIP Monitoring and Troubleshooting
ThousandEyes2K views
WEEK 1 by Videoguy
WEEK 1WEEK 1
WEEK 1
Videoguy562 views
Monitoring whole mpeg transport stream by Volicon
Monitoring whole mpeg transport streamMonitoring whole mpeg transport stream
Monitoring whole mpeg transport stream
Volicon692 views
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers... by Amazon Web Services
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
Amazon Web Services2.5K views
Best practices for live streaming by Alden Fertig
Best practices for live streamingBest practices for live streaming
Best practices for live streaming
Alden Fertig800 views
Deployment of the nanoCDN solution with an operator by Nicolas Weil
Deployment of the nanoCDN solution with an operatorDeployment of the nanoCDN solution with an operator
Deployment of the nanoCDN solution with an operator
Nicolas Weil12.9K views
“What Every Digital TV Executive Needs to Know About Adaptive Rate Streaming... by Verimatrix
 “What Every Digital TV Executive Needs to Know About Adaptive Rate Streaming... “What Every Digital TV Executive Needs to Know About Adaptive Rate Streaming...
“What Every Digital TV Executive Needs to Know About Adaptive Rate Streaming...
Verimatrix1.6K views

Recently uploaded

CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue by
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueCloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueShapeBlue
46 views15 slides
Microsoft Power Platform.pptx by
Microsoft Power Platform.pptxMicrosoft Power Platform.pptx
Microsoft Power Platform.pptxUni Systems S.M.S.A.
67 views38 slides
Ransomware is Knocking your Door_Final.pdf by
Ransomware is Knocking your Door_Final.pdfRansomware is Knocking your Door_Final.pdf
Ransomware is Knocking your Door_Final.pdfSecurity Bootcamp
76 views46 slides
"Surviving highload with Node.js", Andrii Shumada by
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada Fwdays
40 views29 slides
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc
77 views29 slides
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or... by
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...ShapeBlue
88 views20 slides

Recently uploaded(20)

CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue by ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueCloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
ShapeBlue46 views
"Surviving highload with Node.js", Andrii Shumada by Fwdays
"Surviving highload with Node.js", Andrii Shumada "Surviving highload with Node.js", Andrii Shumada
"Surviving highload with Node.js", Andrii Shumada
Fwdays40 views
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc77 views
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or... by ShapeBlue
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...
ShapeBlue88 views
Why and How CloudStack at weSystems - Stephan Bienek - weSystems by ShapeBlue
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystems
ShapeBlue111 views
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by ShapeBlue
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
ShapeBlue74 views
Business Analyst Series 2023 - Week 4 Session 7 by DianaGray10
Business Analyst Series 2023 -  Week 4 Session 7Business Analyst Series 2023 -  Week 4 Session 7
Business Analyst Series 2023 - Week 4 Session 7
DianaGray1080 views
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava... by ShapeBlue
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
ShapeBlue48 views
The Power of Heat Decarbonisation Plans in the Built Environment by IES VE
The Power of Heat Decarbonisation Plans in the Built EnvironmentThe Power of Heat Decarbonisation Plans in the Built Environment
The Power of Heat Decarbonisation Plans in the Built Environment
IES VE57 views
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ... by ShapeBlue
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
Backroll, News and Demo - Pierre Charton, Matthias Dhellin, Ousmane Diarra - ...
ShapeBlue83 views
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by ShapeBlue
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
ShapeBlue77 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software344 views
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... by ShapeBlue
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
ShapeBlue65 views
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue by ShapeBlue
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlueWhat’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlue
ShapeBlue131 views
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T by ShapeBlue
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&TCloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T
CloudStack and GitOps at Enterprise Scale - Alex Dometrius, Rene Glover - AT&T
ShapeBlue56 views

Wowza Ultra-Low Latency Streaming

  • 1. Ultra-Low Latency Streaming for OTTtv CONFIDENTIAL© 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary. Content DeliveryWorld Summit
  • 2. WOWZA MAKES VIDEO UBIQUITOUS © 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary. 20,000+ CUSTOMERS IN 170+ COUNTRIES FROM THE WORLD’S MOST SOPHISTICATED MEDIA, TELCO, AND TECH COMPANIES TO SMALL BUSINESSES & DEVELOPERS SERVICE PROVIDERS ENTERPRISE & GOVERNMENT EDUCATION Video comprised 64% of global internet traffic in 2014 and will reach 80% by 2019 94% of young executives say video breaks down language barriers in the global market Viewers of sports on mobile devices` doubled from 2011 to 2015 66% of university respondents said streaming is a top strategic initiative ~40% OF CDNS WORLDWIDE RUN WOWZA 70+ PERCENT OF GARTNER’S ENTERPRISE VIDEO QUADRANT RUNS WOWZA EVERY MINOR LEAGUE BASEBALL GAME RUNS ON WOWZA 85% OF THE TOP 25 U.S. UNIVERSITIES, WITH 100% OF IVY LEAGUE RUN WOWZA EVERYONE Houses of Worship Transportation Public Safety Public Transit Medical Security Armed Services 20,000 customers across all industries build on Wowza for video & audio SPORTS
  • 3. Powering Leading-Edge Broadcasting © 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
  • 4. © 2016 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary. THE SOFTWARE BEHIND THE STREAMING REVOLUTION • END-TO-END VIDEO & AUDIO WORKFLOW • DEEP DEVELOPER INTEGRATION VIA API, IDE, SDK • ENORMOUS GLOBAL CUSTOMER BASE • STRATEGIC TO ALL CLOUD PLATFORMS 450 Million Live Viewing Hours per Month 20,000 Paying Customers 43 Million Live Broadcasts per Year (not including social media) OVER 25% OF WORLDWIDE LIVE STREAMING WOWZA POWERS 345,000 Hours of Live Transcoding per Day
  • 5. WHAT IS LATENCY? Latency is a time interval between the stimulation and response, or, from a more general point of view, a time delay between the cause and the effect of some physical change in the system being observed. In terms of streaming, latency is the delay between the initial capture of the video and the viewer.
  • 6. TERMS • Time to first frame - Time delay from when a person clicks the play button and when video appears • Broadcast Delay – The practice of intentionally delaying the broadcast of live material to prevent profanity, bloopers, or violence • Quality - Higher quality = higher resolution = more data to send • Scale - How many inputs/participants, how far, how many viewers • Bandwidth - How much traffic can the infrastructure ideally handle • Throughput - How much traffic is the infrastructure really delivering • Bitrate - How many bits of data are being processed over time
  • 7. LATENCY ADDS UP © 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary. The video streaming industry solved for scale, but sacrificed latency. Now we need the best of both worlds.
  • 8. Success Depends on a Usable Experience © 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary. An interactive and social gaming audience Synchronized streams for a “live” experience Betting with near-real time information Requires imperceptible delay where up to the second information means winning or losing. Requires the coordination between two delivery systems so the audience experience is seamless. Requires near-real time viewing so an audience can actively participate or interact with the gaming experience.
  • 9. STREAMING LATENCY © 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary.
  • 10. WHY IS LATENCY A PROBLEM? • Latency is not usually a problem – but people think it is. • For many (or possibly most) live streams, latency does not matter. • HTTP streaming intentionally introduces latency for improved reliability. For some live streams, latency is critical.
  • 12. WHAT FACTORS IMPACT LATENCY? 1. Quality • Resolution • Two-way • Multi-thread • Frame rate • Smooth playback • Chunk/Block Size • Buffering 2. Scale • Distance • Participants • Viewers • Streams • Complexity • Variability • Diverse endpoints Low Latency Large Scale High Quality As either (or both) increase latency increases
  • 13. HOW QUALITY INJECTS LATENCY? • Higher quality = higher resolution = more data to send. • Resolution increases the amount of data in any frame, block, chunk or time slice. If we hold infrastructure constant as resolution goes up the window and latency to deliver a segment increases. • Trade-offs: Some mitigation techniques: Increasing Throughput Increasing throughput with more bandwidth(network) and bitrate(compute) = More infrastructure, more overhead, more cost Reducing Buffer Reducing the buffer requirement will reduce latency but it also makes network fluctuations more visible to the viewer – e.g. a 1ms buffer ideally means content can be viewed as little as 1ms after capture but a 0.1-second network interruption will result in 100 buffer segments being un-recoverable in a live stream. Reducing Framerate Reducing the (frame rate) number of frames per second reduces the smoothness of the viewing experience – e.g. 15 fps is generally a good viewing experience for low movement broadcasts like presentation screen capture/sharing or many church services, it will produce a choppy experience for viewing sports
  • 14. HOW SCALE INJECTS LATENCY? • Scale increases distances, complexity and variability. • As distance, the number of streams, and viewers increase, network imperfections, variability, and degradation increase and can amplify latency. • Trade-offs: Some mitigation techniques: Increasing Throughput Increasing throughput with more bandwidth(network) and bitrate(compute) = More infrastructure, more complexity, more overhead, more cost Increasing Buffer Increasing buffer size adds ability for both encoders, transcoders and players to deal with variability smoothly but increasing buffer inherently increases latency. By definition, buffer size is the minimum amount of data for which a process can be initiated. If more data must be accumulated, then processing will take longer. TCP vs UDP Because it is a lighter weight protocol without error checking, monitoring, order of messaging and headers roughly 1/3 the size of TCP, UDP is inherently faster but there is no guarantee data is received.
  • 15. WHERE STREAMING LATENCY HAS BEEN Windows Media • MMS, RTSP, HTTP (using UDP or TCP) • Encoder, Server, and Player buffer size management • “Low delay” audio codecs • Fast Start, Advanced Fast Start, Fast Recovery, Fast Reconnect, FEC • 2-3 seconds (on a good network) Real Time Streaming Protocol (RTSP) • Developed and by RealNetworks • Relies on RTP and RTCP • Frames can be sent one at a time in real time • Can leverage UDP • Potential latency could be as low as ~125 ms with minimal buffering Real Time Messaging Protocol (RTMP) • Developed & open sourced by Adobe • 1-3 seconds and sub-1 second HTTP • Apple HLS • 30+ seconds on iOS • Using 10 second chunk sizes • MPEG-DASH • 10-20 seconds (variable)
  • 16. WHERE LATENCY IS GOING WebRTC • Designed for real-time audio, video and data delivery over less-reliable connections • Leverages TCP or UDP • Multiple protocols related to RTSP/RTP • 1 second or less (as low as 200 ms) WebSocket • Designed to provide a standardized, two-way, reliable communications channel between a browser and a server • Works with TCP • Can be used with other streaming protocols including RTMP, WebRTC, Haivision SRT, Wowza WOWZ and Aspera FASP • As low as 200 ms
  • 17. WHERE LATENCY IS GOING HTTP • Below 4 seconds (using 1 second chunks) for DASH • Optimizing DASH MPD attributes (availabilityStartTime and minBufferTime) • Below 8 seconds (using 2 second chunks) for HLS (includes GOP adjustments as well) • CMAF + HTTP/1.1 (using HTTP Chunked Transfer Coding) enables video transfer, decode, and display before the end of the chunk encoding • Video encoding enhancements that do not impact decoding (H.264 GDR)
  • 18. WHERE LATENCY IS GOING Quick UDP Internet Connections (QUIC) • Uses UDP (with TCP fallback) • Focuses on security and reliability • Tries to be like TCP while reducing connect and round trip times, packet loss, congestion control, and more using intelligent retransmissions and storage and delivery of information • Built with HTTP/2 in mind Secure Reliable Transport (SRT) • A video transport protocol that enables the delivery of high- quality and secure, low-latency video across the public Internet • Designed to deliver the best quality live video over the worst networks • Accounts for packet loss, jitter, and fluctuating bandwidth while maximizing quality
  • 19. WHERE LATENCY IS GOING Wowza Streaming Cloud Ultra Low Latency Service • A cloud-based, highly scalable streaming service • Using Wowza WOWZ + WebSocket in an origin-edge architecture • Sub 2 seconds end-to-end (origin to player) • Completely API-driven, no user-interface Features include: • Scaled Origin Network • Scaled Edge network • Playback components: SDK for browser and native apps on mobile • Publishing and playback security • Basic Analytics • Recording
  • 20. Mid tier EdgeOrigin { }Analytics Live encoderIP camera REST APIPull distribution Push distribution Push distribution WOWZA ULTRA LOW LATENCY SERVICE
  • 21. REDUCING WORKFLOW COMPONENT LATENCY Think about latency at every step • Content creation (codec, bitrate, resolution) • Streaming workflow and devices • Buffer management (encoder, player) • Network considerations • How you optimize delivery (protocol, transport layer) • How you reach your audience (size, location, and quality) WebRTC and WebSocket can scale using traditional origin/mid-tier/edge configurations (still requires “aware” clients) CDNs are investigating options to enable low latency through their networks • “Tuned” HTTP is a front runner
  • 22. MEASURING LATENCY • This is not easy (especially at scale) • Latency is commonly measured in seconds (or milliseconds) though some prefer frames • A visual test is easy but requires accurate clocks (synchronized using “reliable” NTP servers) • For “traditional” streaming protocols, markers in the stream can be used
  • 24. © 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary Network Characteristic that KILL real time video Ø Packet loss – packets being discarded by routers Ø Jitter – packets arriving at different times than expected Ø Delay – the time from sender to receiver Ø Bandwidth – the fluctuating capacity between points Overcoming Adverse Network Conditions
  • 28. © 2017 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary bps t Constant frame rate Encoder Variable Bitrate t Reconstructed video frame rate Much Happier Decoder Jü Video ü Audio ü Metadata ü Packet acknowledgement – error recovery ü Timing – low latency streaming ü Network connection characteristics ü Bi-directional ü Firewall Friendly SRT Fundamentals SRT Fundamentals
  • 30. SRT in Wowza Streaming Engine Ø Greater reliability of throughput and packet loss Ø Improved bandwidth utilization with network bandwidth fluctuations & long-haul video transport RESULTS - Germany to Australia, using a consumer DSL connection: • 7.5x increase of throughput with SRT, compared to RTMP connections over TCP. • RTMP: 800/10,000 kbits throughput • SRT: and 6000/10,000 kbits throughput Ø Independent security / encryption Ø Minimized buffer 4x RTT (re-transmission time) Ø Logic for packet loss recovery and jitter only requires 4 x the network latency to the server Ø Wide adoption: free open source, known & trusted SRT in Wowza Streaming Engine Wowza Streaming EngineSRT Fundamentals Benefits of SRT | Results
  • 32. © 2015 Wowza Media Systems, LLC. All rights reserved. Confidential & Proprietary. “Wowza” and other identified trademarks are either registered or claimed trademarks of Wowza Media Systems, LLC; visit wowza.com/legal/trademarks for more information. Third-party trademarks are property of their respective owners; their use does not imply endorsement of Wowza products or services by the trademark owner. www.twitter.com/wowzamedia www.youtube.com/user/wowzamediawww.facebook.com/wowza www.plus.google.com/+wowza/posts www.linkedin.com/company/wowza-media-systems WWW.WOWZA.COM