Media processing with serverless architecture

2. Copyright © NTT Communications Corporation. All rights reserved. Kensaku Komatsu Technical manager of ECL SkyWay Web application evangelist at NTT Communications in Silicon valley office @komasshu kensakukomatsu

11. Copyright © NTT Communications Corporation. All rights reserved. Wish from our customer 11 • Recording • Voice recognition, translation • Video detection, recognition • Emotion detection • Low latency live streaming • VR / AR / Avatar • …

12. Copyright © NTT Communications Corporation. All rights reserved. • Recording • Voice recognition, translation • Video detection, recognition • Emotion detection • Avatar • … Question 12 How do we support these needs from our customer?

15. Copyright © NTT Communications Corporation. All rights reserved. What’s SkyWay WebRTC GW 15 • Protocol gateway of WebRTC • Enabler for server side media processing • Can get RTP media stream from client • Controllable with REST API • Easy to connect from skyway client • Supported platform : Linux and Windows WebRTC GW Processing engineRTP

17. Copyright © NTT Communications Corporation. All rights reserved. Use case 1 : server side recording 17 • WebRTC GW … stream out media data as RTP streaming • Bind decoder / encoder when needed • POST media data to cloud storage or else WebRTC GW Decoder / EncoderRTP Storage POST

18. Copyright © NTT Communications Corporation. All rights reserved. Use case 2 : voice recognition 18 • WebRTC GW … stream out media data as RTP streaming • Bind decoder to get raw PCM data stream • POST voice data to Voice recognition PaaS • POST recognition result to cloud database. WebRTC GW Decoder RTP DB POST Voice recognition

19. Copyright © NTT Communications Corporation. All rights reserved. • WebRTC GW … stream out media data as RTP streaming • Bind decoder to get raw PCM data stream • POST voice data to Voice recognition PaaS • POST recognition result to cloud database. Question 19 How do we manage these service for each scenario?

21. Copyright © NTT Communications Corporation. All rights reserved. Base idea to manage server side processing 21 • Apply micro-service model for each media processing scenario. • Agility, Flexibility and scalability 21 WebRTC GW Micro Service #1 RTP Micro Service #2 Micro Service #3

22. Copyright © NTT Communications Corporation. All rights reserved. Issues, we faced with 22 • We found that… • Sometime, media processing engine makes state issue. • Scalability issue for each components • Especially media encoder and recognition process requires high resource usage. • Have to allocate much resources for above micro servers.

23. Copyright © NTT Communications Corporation. All rights reserved. Serverless architecture 23 • AKA ”Function as a service” • Event base execution model • Each function will be executed and killed in each session cycle • Easy to get scalability • No-need to care about long-term state issue 23 spawn

24. Copyright © NTT Communications Corporation. All rights reserved. Our challenge 24 • Apply serverless architecture into server side media processing scenario. • Build serverless system from scratch on top of docker container • Current FaaS is focused to only RPC GW Decoder recognition GW Decoder recognition API GW orchestrator spawn

26. Copyright © NTT Communications Corporation. All rights reserved. Pros and Cons 26 • Pros • Flexibility, Scalability and Agility • Do not need to care about execution time than short lived functions • Easy to re-use each components • Each scenario is well isolated, e.g. security perspective • Cons • Need to have consolidate monitoring • Controlling each components while set upping orchestration is difficult • Several timing issue will happen, especially video streaming.

27. Copyright © NTT Communications Corporation. All rights reserved. Summary 27 • Current business in WebRTC • It is used for bunch of use cases • Media processing is needed • WebRTC GW – enabler for AI/IoT • Protocol GW for WebRTC • Can be orchestrated with media processing engines • Media processing with Serverless architecture • Flexibility, scalability and agility • Well isolated and security • Need to have more practice and management system.

Media processing with serverless architecture

You are reading a preview.

Check these out next

Media processing with serverless architecture

More Related Content

Slideshows for you (20)

Similar to Media processing with serverless architecture (20)

More from Kensaku Komatsu (20)

Recently uploaded (20)