This document discusses different types of multimedia streaming including RTP/RTSP streaming, HTTP progressive download, and adaptive HTTP streaming. It provides details on each type such as protocols used, advantages, and requirements. Adaptive HTTP streaming generates multiple versions of content at different bitrates and resolutions, chops them into segments, and allows the client to adaptively switch between versions based on available bandwidth. The document also discusses quality of service (QoS) versus quality of experience (QoE) for streaming and how adaptation techniques can help improve streaming quality.

1. Multimedia Streaming
Dr. Selvaraj Kesavan

2. Contents
2
Introduction
Streaming Classification
RTP/RTSP streaming
HTTP Progressive Download
Adaptive HTTP Streaming
Streaming QoS and QoE

3. Video
 Video comprises of 64% of the internet traffic in 2014. By 2019 By 2019, 80% of the
World's Internet Traffic Will Be Video
 Internet video to TV grew 47% in 2014
 Netflix+Amazon+Youtube+Hulu occupies more than 50% internet traffic
3

4. Media Streaming
Media Streaming: Clients request audio/video files from servers and of playing data across a network without
downloading it completely
Why streaming ?
- Instant play
- streaming client can be a low-cost device with little local storage
Requirement
- The Network connection should be consistently fast enough to transfer data
Streaming Stack 4

5. Media Streaming - Classification
UDP Based Streaming
Conventional TCP
Streaming
Adaptive HTTP
Streaming
• RTP/RTSP Streaming
• Adobe RTMFP Streaming
• Used UDP for transport
• Issue with network firewalls
and NAT.
• Need media server
• HTTP Progressive Download
• Adobe RTMP
• Pass-through firewall
• Stream in single bit rate
• Use existing web infrastructure
• packet retransmission and the
delays restrict the real-time
streaming experience.
• Use existing or special web
server
• Pass-through firewall
• Multiple bit rate streaming
• Client driven adaptation
• Variants: HDS,MSS,HLS
• MPEG-DASH standard Adaptive
HTTP Streaming
5

6. Conventional RTP/RTSP Streaming
RTSP (Real-Time Streaming Protocol) - Session Establishment
RTP (Real-Time Transport Protocol) – Streaming Content
transport
RTCP (Real Time Control Protocol) – Session Quality Feedback
Applications:
• Streaming
• Video Telephony
• Video Conference
• Set top box
• IPTV
6

7. Progressive Download
• Streaming file is downloaded from web server to the client device.
• Regardless of bandwidth drop or surge, the video representation remains same for
the entire duration
• Uses the existing web infrastructure and does not require any additional set up.
• Packet retransmission consumes extra bandwidth and time which restricts the real
time end user experience
7

8. Adaptive HTTP Streaming
Generate multiple versions of the same content (different bitrates or spatial resolutions) and chop these versions
into segments ( two seconds).
 MPEG-DASH: Dynamic Adaptive Streaming over HTTP
• MPEG-LA and ISO organizations created a cross-industry standard to unify adaptive HTTP streaming.
• Official International standard (MPEG,ISO)
• Adopted by YouTube, Netflix
 HLS: HTTP Live Streaming
• Proprietary standard developed by Apple.
 MSS: Microsoft Smooth Streaming
• Microsoft standard for streaming contents over HTTP .
 ADS: HTTP Dynamic streaming
• Proprietary standard developed by Adobe
8

9. Adaptive HTTP Streaming
Real time ,multi bit rate streaming
Index File: (MPD,M3U8)
• An XML-based manifest file describes the
media presentation details and playlists
required to stream the content to the client.
• The media segments with various bit
representations can be requested based on the
information extracted from the manifest file.
Adaptation Module
• Adaptive bit rate calculation
• Bit rate changes based on
• Available bandwidth
• End client capabilities
9

10. Streaming QoS and QoE
Quality-of-Service (QoS)
• Technology oriented
• measures streaming delivery performance with
respect to the software, hardware, network
infrastructure.
• Metrics such as transit time delay, error rate,
synchronization, caching efficiency, response time.
Quality-of-Experience (QoE)
• QoE is an extension to QoS
• It defines overall user perception to the media
content quality and service acceptability.
• Key Indicators to the user perception: blurring, frame
freeze, glitches ,video pause etc.
User
Application
Network
QoS
QoE
Delay ,packet loss
,Channel Errors, Jitter
etc.
User experience
Frame rate , bit rate,
codec, buffering time
etc.
10

11. Improvement of streaming quality
Rate control and Adaptation
• A good streaming delivery system should
periodically measure the performance and
improve the quality.
• The system defined and custom objective
and subjective metrics have been used to
study the performance of streaming
services.
• The system periodically evaluates the
received streaming content quality with the
help of congestion and rate adaption
procedures.
• The streaming content quality improved by
optimizing the sending rate
11
Sender Driven Rate Adaptation
• Receiver collects metrics, network statistics
and sends to sender.
Client Driven Rate Adaptation
• Receiver collects all required data chooses
appropriate sending rate.

12. Thank You
12