Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 
D3-4 Media Services - 
Beyond the MCU 
Chad Hart...
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 2 
Image source: http://thewrestlinglifeupdate.tu...
Easy & cheap approach to multi-party: Mesh 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 3 
3 ...
Mesh does not scale for many video conferees 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 4 
...
Traditional Telephony Approach: MCU 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 5 
5 
Multip...
Traditional MCU resource usage 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 6 
6 
Worst-case ...
Efficient MCU resource usage 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 7 
7 
Efficient pro...
Resource efficient MCU with encoder sharing 
100% 
80% 
60% 
40% 
20% 
0% 
Encoder sharing vs. multi-encode 
1 2 3 4 5 6 7...
Newer approach: SFU 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 9 
9 
SFU 
Selective Forward...
Newer approach: SFU 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 10 
10 
SFU 
Selective Forwa...
New WebRTC approach: Simulcast 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 11 
11 
SFU 
High...
A look at Google Hangouts with Simulcast 
http://webrtchacks.com/hangout-analysis-philipp-hancke/ 
COMPANY CONFIDENTIAL © ...
Future Approach with VP9 – SVC? 
Selective Forwarding Unit 
(SFU) with SVC 
Clients send layered stream to 
SFU 
Layers ha...
Multi-party video summary comparison 
http://networkfuel.dialogic.com/webrtc-whitepaper 
COMPANY CONFIDENTIAL © COPYRIGHT ...
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 15 
Building a compelling UX with a 
MCU
Video UX: Traditional method 
MCU 
1 2 
3 4 
3G Device 
Mixed stream 1 2 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC I...
Video UX: Traditional method 
MCU 
1 2 
3 4 
3G Device 
Mixed stream 1 2 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC I...
Modern UX with MCU mixing, HTML5 & JavaScript 
Mixed stream 
App Server Client app 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 ...
What do you care more about? 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 19
CPU & processing power is expensive 
Client view Provider View 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RI...
Bandwidth is not always ubiquitous or free 
Client-side Server-side 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. A...
Why do you need a media server? 
Multi-party conferencing Transcoding Interworking 
Recording Stream processing Person-to-...
Case Study: Video Recording Service 
Key Functions 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVE...
The future: gesture controls 
https://github.com/mtschirs/js-objectdetect/ 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC...
The future: machine vision 
COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 25
The future: augmented reality 
http://jooink.blogspot.com/2012/10/gwt-augmented-reality-howto-step-1.html 
COMPANY CONFIDE...
Upcoming SlideShare
Loading in …5
×

Beyond the MCU

3,985 views

Published on

Learn about why Mesh may not be the answer for #WebRTC and why the better approach is to centralize and mix all the media in an MCU. As well as an in-depth explanation on the benefits of using an MCU. As presented by Chad Hart at WebRTC Expo V.

Published in: Technology
  • Be the first to comment

Beyond the MCU

  1. 1. COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. D3-4 Media Services - Beyond the MCU Chad Hart WebRTC Expo V
  2. 2. COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 2 Image source: http://thewrestlinglifeupdate.tumblr.com/ Multi-PARTY! Video Conferencing
  3. 3. Easy & cheap approach to multi-party: Mesh COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 3 3 Full Mesh Works for a few parties No server cost Lowest latency
  4. 4. Mesh does not scale for many video conferees COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 4 4 Full Mesh Clients get overloaded Encode costs more than decode Limited uplink bandwidth Inconsistent performance across participants
  5. 5. Traditional Telephony Approach: MCU COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 5 5 Multipoint Control Unit (MCU) Good at manipulating all media Transcoding Transizing Transrating Interworking Server-side CPU intensive Client can request different conference mixes Usually client friendly Downsizing & mixing can reduce bandwidth Fewer client streams to process MCU
  6. 6. Traditional MCU resource usage COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 6 6 Worst-case process: 1. Each stream decoded at the MCU 2. MCU mixes each conferee 3. MCU encodes individual mix for each conferee MCU 1 1 2 2 3 3 4 4 5 5 6 6 Ingress streams 6 Egress streams 6 MCU decodes 6 MCU encodes 6
  7. 7. Efficient MCU resource usage COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 7 7 Efficient process: 1. Each stream decoded at the MCU 2. MCU mixes each conferee 3. MCU shares same encoder for all conferees MCU 1 2 3 4 5 6 Ingress streams 6 Egress streams 6 MCU decodes 6 MCU encodes 1 1
  8. 8. Resource efficient MCU with encoder sharing 100% 80% 60% 40% 20% 0% Encoder sharing vs. multi-encode 1 2 3 4 5 6 7 8 9 10 11 15 17 20 System CPU Utilization Conferees Traditional MCU Dialogic Evolved MCU 30%-50% reduction in compute resources COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 8
  9. 9. Newer approach: SFU COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 9 9 SFU Selective Forwarding Unit (SFU) routing Clients send one & receive many Client can instruct SFU which streams to send High throughput Can be lots of downlink bandwidth Low latency
  10. 10. Newer approach: SFU COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 10 10 SFU Selective Forwarding Unit (SFU) routing Clients send one & receive many Client can instruct SFU which streams to send High throughput Can be lots of downlink bandwidth Low latency
  11. 11. New WebRTC approach: Simulcast COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 11 11 SFU High bitrate Low bitrate Selective Forwarding Unit (SFU) with Simulcast Clients send multiple streams to SFU one high-bit rate one or more lower-bit Client directs SFU which streams to receive Reduces bandwidth vs. SFU Simulcast in WebRTC coming
  12. 12. A look at Google Hangouts with Simulcast http://webrtchacks.com/hangout-analysis-philipp-hancke/ COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 12
  13. 13. Future Approach with VP9 – SVC? Selective Forwarding Unit (SFU) with SVC Clients send layered stream to SFU Layers have varying bitrates – time, size, quality SFU directs who gets what Coming to WebRTC eventually COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 13 13 SFU Layered bitrates: High Medium Low
  14. 14. Multi-party video summary comparison http://networkfuel.dialogic.com/webrtc-whitepaper COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 14
  15. 15. COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 15 Building a compelling UX with a MCU
  16. 16. Video UX: Traditional method MCU 1 2 3 4 3G Device Mixed stream 1 2 COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 16 3 4
  17. 17. Video UX: Traditional method MCU 1 2 3 4 3G Device Mixed stream 1 2 COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 17 3 Active Talker Media Server Chooses Layout
  18. 18. Modern UX with MCU mixing, HTML5 & JavaScript Mixed stream App Server Client app COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 18 2 Browser MCU 1 2 3 4 HTML5 Canvas Javascript Application-defined UX Layout "Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum." Benefits: Application defined UX User specific & customizable layout Lower client BW & CPU vs. mesh
  19. 19. What do you care more about? COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 19
  20. 20. CPU & processing power is expensive Client view Provider View COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 20
  21. 21. Bandwidth is not always ubiquitous or free Client-side Server-side COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 21
  22. 22. Why do you need a media server? Multi-party conferencing Transcoding Interworking Recording Stream processing Person-to-machine COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 22
  23. 23. Case Study: Video Recording Service Key Functions COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 23 Application highlights Record live events – E.g. Kids soccer game Share event recording with family/friends – Multi-party stream Supported Recording Formats .3GP .mp4 .wav Codecs G.711, Opus, AMR-NB and AMR-WB (voice) VP8, H.264 (video) Message Storage Local storage Remote message deposit via MSRP HTTP/ MSRP REST (HTTP) Application Server Media Server Message Storage RTP (media) Solution Highlights Software-based Media Server Virtualized (VM) and COTS deployment High Availability and Geographical Redundancy Scalability via Media Resource Broker Architected to support 3.5M Subscriber Network Recording Remote Message Deposit Transcoding WebRTC Signaling WAN
  24. 24. The future: gesture controls https://github.com/mtschirs/js-objectdetect/ COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 24
  25. 25. The future: machine vision COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 25
  26. 26. The future: augmented reality http://jooink.blogspot.com/2012/10/gwt-augmented-reality-howto-step-1.html COMPANY CONFIDENTIAL © COPYRIGHT 2014 DIALOGIC INC. ALL RIGHTS RESERVED. 26

×