Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for developers to add speech to text capability to their applications. The ASR service can be used across a breadth of industries. For example, customer contact centers can convert call recordings into text for further analysis of what drives positive outcomes; media content producers can automate subtitling workflows for greater reach, and marketers and advertisers can enhance content discovery and display more targeted advertising based on the extracted metadata.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENT
Introducing Amazon Transcribe
(Now in Preview)
V i k r a m A n b a z h a g a n – H e a d o f P r o d u c t - L a n g u a g e T e c h
N o v e m b e r 3 0 , 2 0 1 7
M C L 2 1 5

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Audio
• Contact centers
• Meetings
Video
• Broadcast TV
• On-demand video
• Social media
Audio and video data is being generated at an unprecedented rate

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Solution
Transcribe
Customer
insights
Greater access
Global reach
Targeted
advertising
Search archives

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe
A fu lly manag e d and continu ou sly traine d
au tomatic sp e e ch re cog nition (ASR ) se rvice that
take s in au dio and au tomatically ge ne rate s
accu rate transcrip ts

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe: Automatic Speech
Recognition
Time stamps and
confidence scores
Support for both
regular and
telephony audio
Punctuation
§
S3 integration
Hello
/Hola
English and
Spanish with more
to come
Amazon
S3

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe: Automatic Speech
Recognition
Detect multiple
speakers
Custom
vocabulary

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Support for a Wide Range of Audio/Video
Fidelity Format
Accurate transcription for 8 kHz
(telephony) audio or better
Multiple formats like FLAC,
WAV, MP3, and MP4

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Timestamping and Confidence Score
1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 15.0 16.0 17.0
“Hi I would like to reschedule my flight to Seattle to later tonight”
3.480 sec
Confidence : 1
6.402 sec
Confidence : 0.95
10.541 sec
Confidence : 1

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Punctuation Support
please extrapolate the projections based on market
growth and segment share can you email it to me once
you are done
Please extrapolate the projections based on market
growth and segment share. Can you email it to me once
you’re done?

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Speaker Detection
Speaker 1
Speaker 2
Speaker 3
Speaker 1
We are speaking with the customer
tomorrow.
Speaker 2
What’s our plan for the meeting?
Speaker 3
I have it covered.
We are speaking with the customer
tomorrow.
What’s our plan for the meeting?
I have it covered.

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Custom Vocabulary
Upload custom
vocabulary
Higher
accuracy

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Security Standards
SSL encryption
AWS Identity and Access Management (IAM)
Signed URLs for transcripts

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Lambda
Amazon S3
Amazon
Athena
Amazon Transcribe—Integration with AWS
Audio Input
Amazon
QuickSight
Amazon
Comprehend

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Call
centers
Amazon Transcribe: Use Cases
Transcribe 8Khz call
recordings with
high accuracy
Analyze the text with
Amazon Comprehend
Visualize results
on Amazon
QuickSight

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Subtitles for
VOD
Broadcast closed
captions
Amazon Transcribe: Use Cases
Transcribe the
audio/video
to text
Align the text
with the video
based on time
stamp
Post-edit/
QA
Translate to
language of
choice

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Transcribe
meetings
Amazon Transcribe: Use Cases
Transcribe the
recordings
Index text
using
Amazon ES
Search and
discover content
on demand
Save
recordings to
Amazon S3

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe: How It Works
Deep Learning based
Speech Recognition
Pre-Processing
Post-Processing
Audio
Transcription

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe: Challenges
- High Noise Environment
- Conversational Artifacts and Nuances
- Cross-Talk
- Code-Changing
- Unknown Words
- Specialized Vernacular
- Low-Resource Languages and Dialects

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe Demo

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Sample Transcript
Hello Harry I see you have a flight to Seattle tonight is
that what you’re calling about?
Yes I was hoping I could get a seat upgrade.
Sure thing I see you are a platinum member and there
is a seat in first class number 1C available. Does that
work?
That would be great.
Ok. You are all set and I have upgraded your seat to
1C. Is there anything else I can help with?
No thank you so much. Bye.
High
Accuracy
Punctuated

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Entities
Hello Harry I see you have a flight to Seattle tonight is
that what you’re calling about?
Yes I was hoping I could get a seat upgrade
Sure thing! I see you are a platinum member and there
is a seat in first class number 1C. available Does that
work?
That would be great!
Ok. You are all set and I have upgraded your seat to
1C. Is there anything else I can help with?
No thank you so much. Bye!

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Entities + Key Phrases
Hello Harry I see you have a flight to Seattle tonight is
that what you’re calling about?
Yes I was hoping I could get a seat upgrade
Sure thing! I see you are a platinum member and there
is a seat in first class number 1C. available Does that
work?
That would be great!
Ok. You are all set and I have upgraded your seat to
1C. Is there anything else I can help with?
No thank you so much. Bye!

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Entities + Key Phrases + Sentiment
Hello Harry I see you have a flight to Seattle tonight is
that what you’re calling about?
Yes I was hoping I could get a seat upgrade
Sure thing! I see you are a platinum member and there
is a seat in first class number 1C. available Does that
work?
That would be great!
Ok. You are all set and I have upgraded your seat to
1C. Is there anything else I can help with?
No thank you so much. Bye!

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How Do I Use it?

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe Console

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe–SDKs
transcribe.start_transcription_job(
TranscriptionJobName='transcribe-demo',
Media={
'MediaFileUri': 'https://s3-us-east-
1.amazonaws.com/transcribe-demo/demo.wav'
},
MediaFormat='wav',
LanguageCode='en-US',
MediaSampleRateHertz=16000
)

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe—Pricing
$0.0004 per second with a minimum of 15 seconds per request
Free tier: 60 minutes per month for the first year
Free during preview

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe: Launch Customers

29. Real-time, relevant information drives better decisions for
our clients
Mediaportal delivers comprehensive media data and
accurate search with analytics
ISENTIA IS A LEADING MEDIA
INTELLIGENCE BUSINESS
5,000
Clients
84/100
of the top global brands
Isentia + Amazon Transcribe

30. Ingest
(audio/video)
Segment
Store
Summarize
Relevance
• Human summarization is slow, expensive, and time-consuming
• A lot of inefficiencies and duplication of effort (same segment done twice or more)
Human
summarization
Isentia + Amazon Transcribe
30

31. Ingest
(audio/video)
Segment
Store
Transcribe
Summarize
Relevance
• Automated transcription to augment summarization of the content in the pipeline
• Additional enrichments such as extraction of entity and topic
Amazon Transcribe
Isentia + Amazon Transcribe
31

32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Howard Brown, CEO and Founder

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enterprise Sales Acceleration and
AI Powered Communications Platform

34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RingDNA Powers Great Conversations

35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CONVERSATION DATA
IS THE HOLY GRAIL

36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Unlocks Insights
Hidden in Every
Conversation
Conversation AI

37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo

38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Mines Conversation
Data for Actionable
Insights and Learning
Moments
Conversation AI Labs

39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• Quick Onboarding
• Custom Training
• Effective Team
Collaboration
• Measurable Objectives
Best Practices Libraries

40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How Do I Get Started?
aws.amazon.com/transcribe

43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!