In this hands-on workshop, participants will use AWS ML services to generate transcripts from audio files, use NLP to analyze those transcripts, and produce subtitles in multiple languages. Using ML, you can keep pace with the proliferation of audio/video content across businesses. Asset managers can unlock hidden value in existing media libraries by finding precise moments when particular keywords or phrases are spoken; video publishers can benefit from subtitle and localized files for reaching global audiences; and IT organizations can utilize transcription data to improve organizational governance.

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Workshop: Amazon ML Services for Video Transcription & Translation
Niranjan Hira – Solutions Architect
David Ping – Solutions Architect
Jillian Forde – Associate Solutions Architect
Kashif Imran – Sr. Solutions Architect
Ro Mullier – Solutions Architect

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Workshop Goals
• Introduction to relevant services
• Amazon Comprehend, Amazon Translate, and Amazon Transcribe
• Generate subtitles in English and Spanish
• Considerations for a production workflow

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
The Amazon machine learning stack
PLATFORM SERVICES
APPLICATION SERVICES
FRAMEWORKS & INTERFACES
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
The Instructions
https://s3.amazonaws.com/mast-mast-3/
public/langws/2018/readme.html

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Comprehend
N a t u ra l l a n g u a g e p ro c e s s i n g
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Transcribe
A u t o m a t i c s p e e c h r e c o g n i t i o n
Support for
telephony audio
Timestamp
generation
Intelligent punctuation
and formatting
Recognize multiple
speakers
Custom
vocabulary
Multiple
languages

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Translate
N a t u ra l a n d f l u e n t l a n g u a g e t ra n s l a t i o n ( b a s e d o n n e u ra l n e t w o r k s )
Real-time
translation
Batch analysis Automatic language
recognition
Low cost

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
The Instructions
https://s3.amazonaws.com/mast-mast-3/
public/langws/2018/readme.html

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Information Bots
Education
Accessibility
Knowledge Management
Voice of Customer
Applications
Customer Service/
Call Centers
Enterprise
Digital Assistant
Semantic Search
Captioning Workflows
LocalizationPersonalization
Common Use Cases for Language Services

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Transcription Results (walk-through)

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Amazon Translate
1. Translate.translateText({
2. "Text": 'Hello world',
3. "SourceLanguageCode": 'en',
4. "TargetLanguageCode": 'es'
5. }, function(err, data) { ... });

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Demo – Video Subtitles
Submit
Transcribe
Job
Wait for
Job
Get
Transcript
Detect
Entities
Write
HTML
Wrapper
Translate
Subtitles
Write
Subtitles

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
What does the HTML look like?
1. <video controls id="vplayr">
2. <source src=”....mp4" type="video/mp4">
3. <track kind ="subtitles" label="English" srclang="en-us"
src=”..._en.vtt">
4. <track kind ="subtitles" label="Spanish" srclang="es"
src=”..._es.vtt">
5. This browser does not seem to support the video element.
6. </video>

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
What is WebVTT?
• Web Video Text Tracks format
• https://www.w3.org/TR/webvtt1/
• “Borrows” from SRT (SubRip Subtitles)
1. 2
2. 00:00:08.490 --> 00:00:11.000
3. Europa están convocando a ejecutivos de
4. facebook
5.
6. 3
7. 00:00:11.590 --> 00:00:14.000
8. para responder preguntas sobre si los
9. datos

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved
aws.amazon.com/activate
Everything and Anything Startups
Need to Get Started on AWS