Amazon brings natural language processing (NLP), automatic speech recognition (ASR), text-to-speech (TTS), and neural machine translation (NMT) technologies within reach of every developer. In this session, learn how you can easily add intelligence to any application with solution-oriented machine learning (ML) services that provide speech, language, and chatbot functionalities. We also share real-world examples of ML in action. See how others are defining and building the next generation of apps that can hear, speak, understand, and interact with the world around us.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Vikram Anbazhagan
Head of Product – Language Tech
BDA302
Building Intelligent Apps with Amazon
Machine Learning –
Language Services

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Frameworks
&
Infrastructure
AWS Deep Learning AMI
GPU
(P3 Instances)
MobileCPU
IoT
(Greengrass)
Vision:
Amazon Rekognition Image
Amazon Rekognition Video
Speech:
Polly
Transcribe
Language:
Lex Translate
Comprehend
Apache
MXNet
PyTorch
Cognitive
Toolkit
Keras
Caffe2
& Caffe
TensorFlow Gluon
Application
Services
Platform
Services
Amazon Machine
Learning
Mechanical
Turk
Spark &
EMR
Amazon
SageMaker
AWS
DeepLens
Amazon confidential
Amazon Machine Learning Stack

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Powerful language capabilities
Amazon Transcribe
Automatic conversion of speech into accurate,
grammatically correct text
Amazon Translate Natural and fluent language translation
Amazon Polly Turn text into lifelike speech using deep learning
Amazon Comprehend Discover insights and relationships in text
Amazon Lex
Conversational interfaces for text-based and voice-based
applications

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Common Language Use Cases
Information Bots
Education
Accessibility
Knowledge Management
Voice of Customer
Applications
Customer Service/
Call Centers
Enterprise
Digital Assistant
Semantic Search
Captioning Workflows
LocalizationPersonalization

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you make your applications
conversational?

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex
A service for building conversational interfaces
into any application using voice and text

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex
Social Intelligence
Personality
Modality
Dynamic
Conversation
• Built in error handling allows you to manage unexpected scenarios
• Intent chaining can be used to build a conversation flow based on user
input
• Rich formatting capabilities can be leveraged for a more engaging
experience
• Create conversation combining speech and text in the same session
• Select from multiple prompts to give your bot a personality
• Choose from a range of Amazon Polly voices depending on target
audience
• Use AWS Lambda to personalize the conversation based on user’s
social profile
• Context is maintained allowing you to build intelligent conversations

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lex – Use Cases
Informational Bots
Chatbots for everyday consumer requests
Application Bots
Build powerful interfaces to mobile applications
• News updates
• Weather information
• Game scores ….
• Book tickets
• Order food
• Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise work activities and improve efficiencies
• Check sales numbers
• Marketing performance
• Inventory status ….
Internet of Things (IoT) Bots
Enable conversational interfaces for device interactions
• Wearables
• Appliances
• Auto ….
Contact Center Bots
Chatbots for customer service IVR
• Account inquiries
• Bill payment
• Service update ….

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you give your applications a
voice?

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly
A Text-to-Speech service that uses advanced
deep learning technologies to synthesize speech
that sounds like a human voice

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly
• Content Creation
• Mobile & Desktop Applications
• Internet of Things (IoT)
• Education & E-Learning
• Telephony
• Game Development
Use Cases
• 52 Voices across 25 languages
• Lip-Syncing & Text Highlighting
• Fine-grained Voice Control
• Custom Vocabularies
• Available in 14 AWS regions
Key Features

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly: Use Cases
Voiced
Notifications
Special Needs
AI Assistant
AI Radio
Announcer
Video
Creation
Amazon Polly
Navigation
Podcasting

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you extract insights from
unstructured text?

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend
A fully managed and continuously trained
service that helps you extract insights from
unstructured text

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend
Sentiment Entities LanguagesKey phrases Topic modeling

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Comprehend: Natural Language Processing
A m a z o n . c o m , I n c . i s l o c a t e d
i n S e a t t l e , W A a n d w a s
f o u n d e d J u l y 5 , 1 9 9 4 b y J e f f
B e z o s . O u r c u s t o m e r s l o v e
b u y i n g e v e r y t h i n g f r o m b o o k s
t o b l e n d e r s a t g r e a t p r i c e s
N a m e d E n t i t i e s
• A m a z o n . c o m :
O r g a n i z a t i o n
• S e a t t l e , W A : L o c a t i o n
• J u l y 5 t h , 1 9 9 4 : D a t e
• J e f f B e z o s : P e r s o n
K e y p h r a s e s
• O u r c u s t o m e r s
• b o o k s
• b l e n d e r s
• g r e a t p r i c e s
S e n t i m e n t
• P o s i t i v e
L a n g u a g e
• E n g l i s h

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Popular Text Analytics Use Cases
Content Personalization: Customers are using Comprehend NLP output to understand related documents
based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and
recommendations
Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking
search results.
Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in
relational databases, processing data within the data lake (S3) and then inserting it back into the data
warehouse
Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from
entities and sentiment from social media posts across Twitter and Facebook.

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Text Analytics Workload
Amazon Kinesis
Amazon ES
Amazon Redshift
Amazon EMR
• Semantic
• Rich Filtering
• Grouping, Trends
• Joining, Correlating
• Clustering
• Graph, Search
• Near real-time
• Alerts
Amazon S3
Social Media, Support
Amazon Aurora
Articles, Documents

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you make your applications
listen?

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe
A fully managed and continuously trained
automatic speech recognition (ASR) service that
takes in audio and automatically generates
accurate transcripts

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe: Automatic Speech
Recognition
Time stamps and
confidence scores
Support for both
regular and
telephony audio
Punctuation
§
S3 integration
Hello/
Hola
English and
Spanish with
more to come
Detect multiple
speakers
Custom
vocabulary

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe: Use Cases
Call
Centers
Subtitles for
VOD
Broadcast closed
captions
Transcribe
meetings

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Lambda
Amazon S3
Amazon
Athena
Audio Input
Amazon
QuickSight
Amazon
Comprehend
Amazon Transcribe—Integration with AWS

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do you make your applications
multilingual?

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Translate
A fully managed and continuously trained neural
machine translation service that translates text
from one language to another

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Translate: Features
TRANSLATE TEXT
INPUT and TAGGED
INPUTS (e.g., HTML)
REAL-TIME
TRANSLATION OF ~30
WORDS (i.e., <500ms)
ENGLISH <> ARABIC,
SIMPLIFIED CHINESE,
FRENCH, GERMAN,
SPANISH & PORTUGUESE
LANGUAGE
DETECTION VIA
COMPREHEND
AWS SECURITY
STANDARDS
AVAILABLE IN US EAST
(N. VIRGINIA), US EAST
(OHIO), US WEST
(OREGON) & DUBLIN
EASY TO USE AND
INTEGRATE VIA CLI OR
SDKs
BEST IN CLASS
RETURN ON
INVESTMENT

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
USE FOR HIGH VOLUME AND TIME-SENSITIVE
INFORMATION
Share of worldwide digital content
• Legal Documents
• Healthcare Documents
• Advertising Materials
Machine Translation
• User-authored content
• Text Analytics
• Real-time Communication
• Content Discovery
Post-edited
Machine
Translation

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Contact Center Demo
Yasser El-Haggan, Solutions Architect
yhaggan@

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Connect
Amazon
S3
Amazon
Kinesis Data
Firehose
Amazon
Kinesis
Streams
Amazon
S3
CTRs
Call Recordings
Amazon
QuickSight
Amazon
Athena
Transcribe
Recordings
Sentiment
Analysis
Transform
CTRs
Amazon
S3
Looking ahead - Analytics with Transcribe and
Comprehend

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Connect
Amazon
Kinesis Data
Firehose
Amazon
Kinesis
Streams
Raw CTRs AWS Glue Transformed
CTRs
Amazon
QuickSight
Amazon
Athena
CTR Transformation

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Connect
Amazon
S3
Call
Recordings
Step Function
Split
recording
Agent
Recording
Customer
Recording
Kick off
transcription
Step FunctionKick off
transcription
Transcript
Transcription

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transcription – Step Function

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transcription – submit transcription

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transcription – get status

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transcription – job completed

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transcription – write transcript

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Transcript Process
transcript
Sentiment
Result
Kinesis Data
Firehose
entities
Kinesis Data
Firehose
Kinesis Data
Firehose
key phrases
sentiment
Sentiment Analysis

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sentiment Analysis
Entities:
Key Phrases:

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon
Connect
Amazon
S3
Kinesis Data
Firehose
Amazon
Kinesis
Streams
Amazon
S3
CTRs
Call Recordings
Amazon
QuickSight
Amazon
Athena
Transcribe
Recordings
Sentiment
Analysis
Transform
CTRs
Amazon
S3
Architecture recap

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Social Analytics Demo
Ben Snively, Solutions Architect
snivelyb@

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Analyze social media postings and comments to organize and classify
customer feedback and look for common patterns.
Twitter
Stream API
Amazon
Kinesis
Amazon
S3
Amazon
Athena
Visualize results in Amazon QuickSight

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Todd Greene
Founder & CEO, PubNub

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PubNub ChatEngine
& Amazon Machine Learning
Services

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PubNub Real-Time Messaging APIs
Rich APIs to power
every real-time
experience
Global replication
for 99.999%
reliability
Managed infrastructure
delivers unlimited
scalability
Multiple layers of
security &
encryption (HIPAA,
GDPR, SOC 2)
Event-driven Development made easy
✔
✔
✔
✔

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Common PubNub Use Cases
Real-time
Updates
Chat/
Collaboration
IoT Device
Control

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Great Chat Is
Complex
to Build
? ? ? ?
How do you add rich
features like
translation and
chatbots?
How do you track
online status of
your users?
How to build chat
history and
support privacy
laws/GDPR?
How do you reliably
and quickly deliver
messages globally?

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Private and Group Chat
No backend / servers neededUnread Message Counts
Typing IndicatorsRich Message
History
User Online SearchPush Notifications for Offline
Users
Read ReceiptsBasic UI Components for Chat
Scale to 1+ Million Users in Chat
Room
Emojis
Serverless, event driven design

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ChatEngine + Amazon APIs Demo

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank You!
vikrama@amazon.com

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Please complete the session survey in
the summit mobile app.

54. Submit Session Feedback
1. Tap the Schedule icon. 2. Select the session
you attended.
3. Tap Session
Evaluation to submit your
feedback.