An Overlay Multicast Infrastructure for Live/Stored Video Streaming Visual Communication Laboratory Department of Computer Science National Tsing Hua University
Outline Live video broadcasting Typical service model Limitations Our goals Overlay multicast infrastructure Our previous works Multicast video streaming Peer-to-peer search & delivery Scalable video coding
Live Video Broadcasting Techniques Live video encoding Multicast delivery Commercial products Windows Media Services (Microsoft) Real System Server (Real) QuickTime Streaming Server (Apple)
Service Architecture Encoder Stream   Server (VOD) Storage Internet (VOD) (Live  Broadcast ) Stream Server ( Live )
Multicast Routing Tree Client A (10:00) Client B (10:00) Client C (10:00) Client D (10:00)
Common Solution: Prefix Caching Permanently cache the front part of the video. Clients request before ( the start time + the length of the prefix ) can see the entire video program. 4 1 2 3 Prefix cache C 1 1, 2, 3, 4 5, 6, 7, …
Multicast + Prefix Caching Client A (10:00) Client B (10:00) Client C (10:00) 5 min (10:05) queue the stream (10:10) read data from the buffer Client D (10:05) 5 min store the first 5 min
Limitations Must know the video source in advance. Need router support. (IP multicast) Cannot pass through firewall/NAT. Users arrive after the system startup time cannot view the front part of the video. Prefix caching is not perfect.
Scenario: Request & Playback User input Service mode (live/on-demand) Video attributes Peer-to-peer search Streaming Overlay multicast Payment (?) By service mode (VOD > live) (from server > from p2p) By video (popular > unpopular) (bit rate) By search method (advanced > basic)
Request flow EPG meta data peer 1 peer 0 peer 2 Search P2P Player input :  service mode query rules peer 3 peer 4 distributed query init multicast video stream
Topics in this project Overlay multicast Peer-to-peer infrastructure Performance optimization Two-mode multicasting Live broadcasting (real-time) On-demand streaming (see the entire video)
Advanced Topics (?) Advanced electronic program guide Intelligent search Personal profile Ambiguous keyword search Melody / scene search Distributed / continuous query Matchmaker (?) Meta datas Creation/collection/distribution Format (?) (object-based?)
Our Previous Works On-Demand Multicast Streaming Delivery Platform Technology and Systems Peer-to-Peer Streaming Video (Directory Search) Proxy-based Streaming Video Multicast streaming platform for layered videos
On-Demand Multicast Communications 10:00 10:00 10:00 10:00 10:00 10:00 10:00 10:00 10:00 10:02 10:03 10:04 Source Node with timing control 10:04 10:01 10:02 10:03 10:02
Interval Caching Cache a sliding interval of the video. Caching buffer 4, 3, 2, 1 1 1 5, 4, 3, 2, 1 2, 1 1 4 3 2 2 5 4 3 C 1 10:00 C 2 10:04
Timing Control Mechanism 10:00 10:03 10:00 3 4 5 6 7 To player D, 10:05 To player B, 10:00 2, 1 7, 6, 5, 4, 3, 2, 1 10:05 4, 3, 2, 1 To player C, 10:03
On-Demand Multicast Routing source 10:00 Network Constructing an on-demand multicast tree find a routing path allocate buffers to generate path delay 10:02 10:03 10:06 10:06 10:08
Playback (with Directory Server) directory server module.exe IE Client Proxy Source module.exe 1 2 3 4 5 6 7 8 WWW
Playback (Peer-to-Peer) find a source find a routing path allocate buffers source … … … client P i P j P s 10:00 10:02
P2P v.s. Proxy Platform IP Networks Virtual File System (Media Query) (Information Delivery) Video Streaming (HTTP) Media Player QoS IP Networks Cache Replacement Network Mgmt. Proxy-Based Peer-to-Peer Selection & Chaining Proxy Video Streaming (HTTP) Media Player Mgmt. GUI Network Mgmt. QoS Reservation Proxy Protocol Replacement Chaining
Fault Handling Source 11:30 11:40 11:43 11:44 11:30 11:40 One of the clients faults Auto reconfiguration 11:33 11:34 11:35 11:32
Scalable Video Coding
Heterogeneous Network Bandwidth Server 1.5 Mbps 0.8 Mbps 1.5 Mbps 0.8 Mbps 0.7 Mbps aggregated stream 0.8 Mbps low quality 1.5 Mbps High quality Bottleneck = 0.7 Mbps
End-to-end Layer Subscription with Bandwidth Constraint … Layer 1 Layer 2 Layer L Scheduler Lossy Channel Sender Decoder with  Error Concealment Receiver
Demo System
GUI (Media Player) filename number of layers
GUI (Management)

Slide1

  • 1.
    An Overlay MulticastInfrastructure for Live/Stored Video Streaming Visual Communication Laboratory Department of Computer Science National Tsing Hua University
  • 2.
    Outline Live videobroadcasting Typical service model Limitations Our goals Overlay multicast infrastructure Our previous works Multicast video streaming Peer-to-peer search & delivery Scalable video coding
  • 3.
    Live Video BroadcastingTechniques Live video encoding Multicast delivery Commercial products Windows Media Services (Microsoft) Real System Server (Real) QuickTime Streaming Server (Apple)
  • 4.
    Service Architecture EncoderStream Server (VOD) Storage Internet (VOD) (Live Broadcast ) Stream Server ( Live )
  • 5.
    Multicast Routing TreeClient A (10:00) Client B (10:00) Client C (10:00) Client D (10:00)
  • 6.
    Common Solution: PrefixCaching Permanently cache the front part of the video. Clients request before ( the start time + the length of the prefix ) can see the entire video program. 4 1 2 3 Prefix cache C 1 1, 2, 3, 4 5, 6, 7, …
  • 7.
    Multicast + PrefixCaching Client A (10:00) Client B (10:00) Client C (10:00) 5 min (10:05) queue the stream (10:10) read data from the buffer Client D (10:05) 5 min store the first 5 min
  • 8.
    Limitations Must knowthe video source in advance. Need router support. (IP multicast) Cannot pass through firewall/NAT. Users arrive after the system startup time cannot view the front part of the video. Prefix caching is not perfect.
  • 9.
    Scenario: Request &Playback User input Service mode (live/on-demand) Video attributes Peer-to-peer search Streaming Overlay multicast Payment (?) By service mode (VOD > live) (from server > from p2p) By video (popular > unpopular) (bit rate) By search method (advanced > basic)
  • 10.
    Request flow EPGmeta data peer 1 peer 0 peer 2 Search P2P Player input : service mode query rules peer 3 peer 4 distributed query init multicast video stream
  • 11.
    Topics in thisproject Overlay multicast Peer-to-peer infrastructure Performance optimization Two-mode multicasting Live broadcasting (real-time) On-demand streaming (see the entire video)
  • 12.
    Advanced Topics (?)Advanced electronic program guide Intelligent search Personal profile Ambiguous keyword search Melody / scene search Distributed / continuous query Matchmaker (?) Meta datas Creation/collection/distribution Format (?) (object-based?)
  • 13.
    Our Previous WorksOn-Demand Multicast Streaming Delivery Platform Technology and Systems Peer-to-Peer Streaming Video (Directory Search) Proxy-based Streaming Video Multicast streaming platform for layered videos
  • 14.
    On-Demand Multicast Communications10:00 10:00 10:00 10:00 10:00 10:00 10:00 10:00 10:00 10:02 10:03 10:04 Source Node with timing control 10:04 10:01 10:02 10:03 10:02
  • 15.
    Interval Caching Cachea sliding interval of the video. Caching buffer 4, 3, 2, 1 1 1 5, 4, 3, 2, 1 2, 1 1 4 3 2 2 5 4 3 C 1 10:00 C 2 10:04
  • 16.
    Timing Control Mechanism10:00 10:03 10:00 3 4 5 6 7 To player D, 10:05 To player B, 10:00 2, 1 7, 6, 5, 4, 3, 2, 1 10:05 4, 3, 2, 1 To player C, 10:03
  • 17.
    On-Demand Multicast Routingsource 10:00 Network Constructing an on-demand multicast tree find a routing path allocate buffers to generate path delay 10:02 10:03 10:06 10:06 10:08
  • 18.
    Playback (with DirectoryServer) directory server module.exe IE Client Proxy Source module.exe 1 2 3 4 5 6 7 8 WWW
  • 19.
    Playback (Peer-to-Peer) finda source find a routing path allocate buffers source … … … client P i P j P s 10:00 10:02
  • 20.
    P2P v.s. ProxyPlatform IP Networks Virtual File System (Media Query) (Information Delivery) Video Streaming (HTTP) Media Player QoS IP Networks Cache Replacement Network Mgmt. Proxy-Based Peer-to-Peer Selection & Chaining Proxy Video Streaming (HTTP) Media Player Mgmt. GUI Network Mgmt. QoS Reservation Proxy Protocol Replacement Chaining
  • 21.
    Fault Handling Source11:30 11:40 11:43 11:44 11:30 11:40 One of the clients faults Auto reconfiguration 11:33 11:34 11:35 11:32
  • 22.
  • 23.
    Heterogeneous Network BandwidthServer 1.5 Mbps 0.8 Mbps 1.5 Mbps 0.8 Mbps 0.7 Mbps aggregated stream 0.8 Mbps low quality 1.5 Mbps High quality Bottleneck = 0.7 Mbps
  • 24.
    End-to-end Layer Subscriptionwith Bandwidth Constraint … Layer 1 Layer 2 Layer L Scheduler Lossy Channel Sender Decoder with Error Concealment Receiver
  • 25.
  • 26.
    GUI (Media Player)filename number of layers
  • 27.