Automatic video transcription and translation can help make videos more available and accessible to a global audience in many languages, enabling your employees or customers to access, understand, and benefit from your content. In this chalk talk, we discuss how to transcribe videos, translate them in the required languages in a multilingual application, and enable video search in the viewer’s preferred language—all in an automated and cost-effective manner.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Powering Multilingual Video
Transcription, Translation, and Search
Rob Dachowski
Partner Solutions Architect
Amazon Web Services
A I M 3 3 7
Paul Zhao
Technical Product Manager
Amazon Web Services

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The original – Andy Jassey @ re:Invent 2017

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The final product–What are we trying to solve?

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Our ingredients ...

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe: Automatic speech recognition (batch mode)
Hello
/ Hola

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe: Automatic speech recognition (streaming mode)

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Translate: Neural network-based translation

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly: Lifelike speech from deep learning

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Design considerations
• Batch or real time?
• Does it need translation or simply subtitles?
• Language structures, idioms, timing, and more don’t align
• Scope of translation? By word, phrase, sentence, whole transcription?
• Aligning Amazon Polly audio streams with the content

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Step Functions
A batch approach
Multimedia

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Client
A real-time approach

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
For more information
Blog: https://aws.amazon.com/blogs/machine-learning/create-video-
subtitles-with-translation-using-machine-learning/
Transcribe: https://aws.amazon.com/transcribe
Translate: https://aws.amazon.com/translate
Polly: https://aws.amazon.com/polly
MoviePy: https://zulko.github.io/moviepy/index.html

15. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.