© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Adding intelligence to applications
with AWS AI services
A I M 2 0 1
Randall Hunt
Sr. Software Engineer and Tech Evangelist
AWS

Our mission at AWS
Put machine learning in the hands
of every developer

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Why AWS for AI?
Broadest and deepest set of
AI and ML services for your
business
Solving the toughest
problems holding back ML -
cost, ease of use, and data
75% lower inference cost
70% cost reduction in data-
labeling
“No ML experience required”
Unmatched support for
the most popular
frameworks
Built on the most comprehensive
cloud platform optimized for
Machine Learning
85% of TensorFlow projects
in the cloud happen on
AWS
200+ new features and
services since Jan 2018
AWS holds the top spots on
Stanford’s benchmark, for
fastest training time, lowest
cost, lowest inference latency
Deepest set of security and
encryption features, with robust
analytics capabilities

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
More machine learning happens on AWS than anywhere else

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
A I S E R V I C E S
Vision | Documents | Speech | Language | Chatbots | Forecasting | Recommendations
M L S E R V I C E S Data labeling | Pre-built algorithms & notebooks | One-click training and deployment
Build, train, and deploy machine learning models fast
Easily add intelligence to applications without machine learning
skills
Flexibility & choice, highest-performing infrastructure
Support for ML frameworks | Compute options purpose-built for ML
The Amazon ML stack: Broadest & deepest set of capabilities

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
AI Services
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n P o l l y A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n L e xA m a z o n
R e k o g n i t i o n
V i d e o
A m a z o n
F o r e c a s t
A m a z o n
T e x t r a c t
A m a z o n
P e r s o n a l i z e
VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS
ML Services Amazon
SageMaker Ground Truth Notebooks Algorithms + Marketplace
Reinforcement
Learning
Training Optimization Deployment Hosting
ML Frameworks +
Infrastructure EC2 P3
& P3dn
EC2
C5
FPGAs
AWS IoT
Greengrass
Elastic
Inference
FRAMEWORKS INTERFACES INFRASTRUCTURE
AWS
Inferentia
EC2
G4
The Amazon ML stack: Broadest & deepest set of capabilities

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
AI Services
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n P o l l y A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n L e xA m a z o n
R e k o g n i t i o n
V i d e o
A m a z o n
F o r e c a s t
A m a z o n T e x t r a c t A m a z o n
P e r s o n a l i z e
VISION SPEECH LANGUAGE CHATBOTS FORECASTING RECOMMENDATIONS
The Amazon ML stack: Broadest & deepest set of capabilities
Pre-trained AI services that require no
ML skills or training
Easily add intelligence to your existing
apps and workflows
Quality and accuracy from
continuously-learning APIs

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Polly
Use Cases
Content creation
Mobile & desktop applications
Internet of Things (IoT)
Education & e-learning
Telephony
Game development
Key Features
52 voices across 25 languages
Lip-syncing & text highlighting
Fine-grained voice control
Custom vocabularies
Available in 14 AWS Regions
Turn text into lifelike speech

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Utterances
Spoken or typed phrases that invoke
your intent
Book Hotel
Intents
An intent performs an action in
response to natural language user
input
Slots
Slots are input data required to fulfill
the intent
Fulfillment
Fulfillment mechanism for your intent
Amazon Lex
Conversational interfaces

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Lex
Automatic Speech
Recognition (ASR)
Natural Language
Understanding (NLU)
Same technology that powers Alexa
Amazon Cognito AWS CloudTrail Amazon CloudWatch
AWS Services
Action
AWS Lambda
Authentication &
Visibility
Speech
API
Language
API
Fulfillment
Users
Developers
Console
SDK
Intents,
Slots,
Prompts,
Utterances
Input:
Speech
or Text
Multi-Platform Clients:
Mobile, IoT, Web,
Chat
API
Output:
Speech (via Amazon Polly TTS)
or Text
Amazon Lex
Technology

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Informational
Bots
Chatbots for everyday
consumer requests
Application
Bots
Build powerful
interfaces to mobile
applications
News updates
Weather information
Game scores ….
Book tickets
Order food
Manage bank accounts ….
Enterprise Productivity Bots
Streamline enterprise
work activities and
improve efficiencies
Check sales numbers
Marketing performance
Inventory status ….
Internet of Things
(IoT) Bots
Enable conversational interfaces
for device interactions
Wearables
Appliances
Auto ….
Contact Center
Bots
Chatbots for customer
service IVR
Account inquiries
Bill payment
Service update ….
Amazon Lex
Use cases

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Speaker identification Channel identification
Streaming
transcription
Language support
US English US Spanish Australian English Canadian FrenchBritish English
Word-level
timestamps
Punctuation and
capitalization
Word-level
confidence scores
Custom
vocabularies
ItalianBrazilian Portuguese
Amazon Transcribe
Automatic speech recognition

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Call centers Subtitles for VOD Transcribe meetingsBroadcast closed
captions
Amazon Transcribe
Use cases

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
• Contextual
• Full sentences
• Fluent
Amazon Translate
Neural machine translation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Dozens to hundreds of words per second vs. ~4
per minute for human
Speed
Translate is nearing human parity based on
human evaluations
Quality
Translate costs 0.07% of human translation on
average
Cost
Amazon Translate
Shifting from human to artificial intelligence
X300
faster
X1500
85% as
good
Speed Cost Quality

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Translate
Features
21 languages
417 Combinations
Real time
<500 ms / sentence on average
<150 ms / conversational / short
form
Tag handling
XML tags placement maintains
styling and formatting through
translation
< / >
Data security
Data ownership
Encryption
Access management
Ease of use
Simple API calls and partner
solutions
$15/1M characters
Or $0.000075 per word;
Pay as you go, 2M characters
monthly free tier
HIPAA Eligible
Key features

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Entities
Key Phrases
Language
Sentiment
Syntax
Grouping
A m a z o n
C o m p r e h e n d
Discover insights and relationships in text
Amazon Comprehend

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Comprehend
Natural language processing
Sentiment Entities LanguagesKey phrases Topic modeling

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
A m a z o n . c o m , I n c . i s l o c a t e d i n
S e a t t l e , W A a n d w a s f o u n d e d
J u l y 5 , 1 9 9 4 b y J e f f B e z o s . O u r
c u s t o m e r s l o v e b u y i n g
e v e r y t h i n g f r o m b o o k s t o
b l e n d e r s a t g r e a t p r i c e s
N a m e d e n t i t i e s
A m a z o n . c o m : O r g a n i z a t i o n
S e a t t l e , W A : L o c a t i o n
J u l y 5 , 1 9 9 4 : D a t e
J e f f B e z o s : P e r s o n
K e y p h r a s e s
O u r c u s t o m e r s
b o o k s
b l e n d e r s
g r e a t p r i c e s
S e n t i m e n t
P o s i t i v e
L a n g u a g e
E n g l i s h
Text analysis
Amazon Comprehend

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Rekognition
Deep-learning-based image & video analysis

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Faces Celebrities Labels
Moderation ScenesActivities Paths
Text
Amazon Rekognition
Features

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Customer analysis
Analyze trends, not individuals
Recognize your customer
Verify the identities of customers who opt in
Amazon Rekognition
Face: Common use cases

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Recognize your customer
Verify the identities of customers who opt in
Amazon Rekognition
Face: Common use cases

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Textract
Easily extract text and data from virtually any document
Text extraction Table extraction Form extraction

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Input
Uploaded document
images such as tax
forms, credit
applications, or
medical notes
Amazon S3
Uploaded
documents are
stored in data lake
AWS Lambda
A Lambda function is
triggered to initiate
document analysis
using the
Hieroglyph API
Amazon Textract
Automatically
extract text,
including key-value
pairs and tables
Amazon
Elasticsearch
Service
Extracted data and
confidence scores
are indexed to
enable document
search
Output
Perform contextual
search on millions of
documents or
integrate data into
your document
management system
Amazon Textract
Reference architecture – index and search documents

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Input
Customer uses mobile
app to capture a photo of
a W2 form
Amazon Textract
The Amazon Textract API
is integrated into the user
application to
automatically extract text
from the W2 form and
auto-populate the
form fields
Customer application
Customers experience
real-time capture of their
tax information by taking
a photo instead of
manual data entry
Database
User-submitted data
is loaded into a
database for use in tax
preparation
Amazon Textract
Reference architecture: Form capture

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Quickly turn extracted text/data into actionable insights
Input
Uploaded document
images of medical
notes, explanation of
benefits, and
patient forms
Amazon S3
Uploaded
documents are
stored in
Amazon S3
Amazon
Comprehend
Use natural language
processing to extract
insights
Amazon
Elasticsearch
Service
Easily search
through extracted
data and text
insights
Output
Discover medical
insights to improve
patient care
Amazon Textract
Automatically
extract words and
lines of text, and
tables
Amazon Textract
Reference architecture: Extract for NLP

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Popularity trap
Naïve models give recommendations similar to popular items
Cold starts
New users should get relevant recommendations, new items should show in recommendations
Scale
Recommendations should scale across millions of users and items
Real time
Personalization must be responsive to the changing user intent
Custom models
Personalization models must accurately reflect business context and user behavior
Amazon Personalize
Real-time personalization and recommendation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Articles, products,
videos, etc.
Age, location, etc. Amazon Personalize
Customized
personalization &
recommendation
API
Views, signups,
conversion, etc.
Amazon Personalize
Real-time personalization and recommendation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Customized
personalization &
recommendation
API
F u l l y m a n a g e d b y A m a z o n
P e r s o n a l i z e
Amazon Personalize
Inspect
data
Identify
features
Select
algorithms
Select
hyperparameters
Train
models
Optimize
models
Host
models
Build feature
store
Create
real-time
caches
Activity stream
from app
Inventory
Demographics
(optional)
Amazon Personalize
Real-time personalization and recommendation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Historical data
Supply chain,
inventory, etc.
Customized
forecasting API
Related “causal” data
Weather, special offers, product
details
Amazon Forecast
Amazon Forecast
Accurate time-series forecasting

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Forecast
Accurate time-series forecasting
Historical data
Supply chain,
inventory, etc.
Customized
forecasting API
Inspect
data
Identify
features
Select
from eight
algorithms
Select
hyperparameters
Host
models
Load
data
Train
models
Optimize
models
Related “causal” data
Weather, special offers, product
details
F u l l y m a n a g e d b y A m a z o n
F o r e c a s t
Amazon Forecast

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Forecast
Accurate time-series forecasting
Any historical
time-series
Export to CSV to
Integrate with SAP and
Oracle Supply Chain
Custom forecasts
with 3 clicks
Up to 50% more
accurate
1/10th
the cost
Retail demand Travel demand AWS usage
Revenue forecasts Web traffic Advertising demand
Generate
forecasts for:

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Modernize your contact
center to improve customer
service
Use identity verification to
strengthen safety & security
Increase efficiency with
automated document analysis
Accurately forecast
future business
outcomes
Personalize customer
experiences with targeted
recommendations
Automate media workflows to
reduce costs & monetize
content
Understand the
voice of your
customer
Extract and understand
complex medical information

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Modernize your contact center to improve customer service
conversational chat bots | call transcription | intelligent routing | sentiment analysis | VoC
analytics text-to speech | multilingual omni-channel communication
A m a z o n P o l l y A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n L e x

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Modernize your contact center to improve customer service
Live agent optimization with AI
Amazon
TranslateCustomer
Chat
Agents
Live translation enables global,
multi-lingual chat
Amazon
Comprehend
Real-time analysis provides
next best action guidance
Amazon
Transcribe
Amazon
ConnectCustomer
Voice
Agents
Amazon
Comprehend Live transcription extends
guidance for voice calls

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Livecallanalysiswithnextbestactionandtranslation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Livecallanalysiswithnextbestactionandtranslation

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Modernize your contact center to improve customer service
Agentless service optimization with AI
single bot engine provides
multi-lingual text chat
sentiment detection and
dynamic routing
AI-powered smart voice
interaction (IVR)Amazon
Translate
Customer
Amazon
Connect
Amazon
Lex
Amazon
Comprehend
Amazon
Polly
sentiment
Customer

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Modernize your contact center to improve customer service
Voice of customer analytics with AI
Amazon
S3
Amazon
Athena
Amazon
Translate
Amazon
Comprehend
Amazon
Transcribe
sentiment, entities,
and key phrases
Call Recordings
Transcription and analysis of
historical call recordings
enables VOC assessment over
time
• products & issues
• topics & sentiment

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
Meaningful
customer interactions
Liberty Mutual uses Amazon Lex and AI Services
to develop natural language-driven conversational apps
to allow customer service agents to respond to
customer requests with real-time and contextual
intelligence, improving response time, and quality of
service.

GE Appliances uses Amazon Lex, Amazon
Connect, Amazon Polly and Amazon Transcribe
to automate customer service requests such as
looking up product information and recording
customer requests, thereby increasing contact
center efficiency and improving customer
service.
Meaningful
customer interactions

Fast time to value
NHS Business Services implemented Amazon Connect with
Amazon Lex and Amazon Polly to improve their call center
operations
Following the initial deployment, 42% of calls were
managed by the automated chatbot with no increase in
call dropouts, saving the NHS $650K a year
Business Services Authority

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Use AI services to strengthen safety & security
accurate facial analysis | identity protection | metadata extraction
A m a z o n
C o m p r e h e n d
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
R e k o g n i t i o n
V i d e o

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
Real-time
identity verification
Aella Credit uses Amazon Rekognition to
analyze images to verify an individual’s identity in real-
time without human intervention, allowing it to provide
instant loans to eligible customers through its mobile
app.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Increase efficiency with automated document analysis
optical character recognition (OCR) | automatic data extraction | natural language
processing intelligent search | text analytics
A m a z o n
C o m p r e h e n d &
C o m p r e h e n d M e d i c a l
A m a z o n
T e x t r a c t

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon
Rekognition
Amazon
Transcribe
Amazon
ComprehendAmazon
S3
AWS Step
Functions
AWS
Lambda
Amazon
Elasticsearch
Service
image video
audiodocs
Amazon
Translate
Amazon
Textract
Amazon
Neptune
eDiscovery
Web App
Increase efficiency with automated document analysis
eDiscovery: building a smart asset index

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Accurately forecast future business outcomes
forecasting technology used by Amazon.com | multiple time-series data
forecast scheduling & visualization | supply chain integration
A m a z o n
F o r e c a s t

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Personalize customer experiences with targeted recommendations
recommendation technology used by Amazon.com | context-aware recommendations
sentiment analysis | VoC analytics
A m a z o n
P e r s o n a l i z e
A m a z o n
C o m p r e h e n d
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
R e k o g n i t i o n
V i d e o

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
Personalizing
customer experiences
Domino’s uses Amazon Personalize to customize and
scale relevant marketing communications to customers
based on time, context, and content, thereby improving
and enhancing their experience with the Domino’s
brand.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Automate media workflows to reduce costs & monetize content
content moderation | contextual ad insertion | searchable media library
custom facial recognition | multi-language metadata search
A m a z o n
C o m p r e h e n d
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
R e k o g n i t i o n
V i d e o
A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
T e x t r a c t

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Automate media workflows to reduce costs & monetize content
Automated moderation & compliance
• Filter inappropriate images
• Build a fast take-down switch
• Adjacency – display ads
alongside suitable content
• Redact faces, people,
weapons
• Bleep censor profane speech
• Mask or remove personally
identifiable information
• Align content to ratings
standards
• Enforce acceptable use
policies
• Adopt culturally sensitive
criteria for global content

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Safe Explicit NuditySuggestive
Confidence: 98.39%
Type: male, skin, shoulders
Confidence: 99.27%
Type: nudity
Automate media workflows to reduce costs & monetize content
Detecting unsafe content

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Automate media workflows to reduce costs & monetize content
Detecting unsafe content
Top-Level
Category
Second-Level
Category
Confidence
Threshold
Explicit Nudity Nudity XX.X%
Graphic Male Nudity XX.X%
Graphic Female Nudity XX.X%
Sexual Activity XX.X%
Partial Nudity XX.X%
Suggestive Female Swimwear or Underwear XX.X%
Male Swimwear or Underwear XX.X%
Revealing Clothes XX.X%
fine-grain
thresholds trigger
status:
• approve
• reject
• review
uploaded content
classified against the
hierarchical
taxonomy

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Tag, filter, and redact inappropriate content
redact
faces
detect
weapons
Drink 96.4% Alcohol 80.1% Wine 69.9%
tag culturally
sensitive content
Automate media workflows to reduce costs & monetize content

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Personally identifiable info in images
✓ Detection
✓ Recognition
✓ Coordinates
✓ Classification
w/ confidence levels
w/ confidence levels
Automate media workflows to reduce costs & monetize content

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Upload content for classification and use confidence percentage to determine
which images and video require human review
Amazon RekognitionAmazon S3 AWS Lambda
image video
Human
Review
Approved
Content
Rejected
Content
Confidence level
• safe/unsafe
• objects
• people
• text
Automate media workflows to reduce costs & monetize content

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
A full multi-media architecture provides a single pipeline to enable content
moderation and compliance use cases using image, video, speech and text
Amazon Rekognition
Amazon Transcribe
Amazon Comprehend
Amazon S3 AWS Step
Functions
AWS Lambda
Amazon
Elasticsearch
Service
image video
audiotext
Automate media workflows to reduce costs & monetize content

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
Scaling video indexing
C-SPAN uses Amazon Rekognition to automatically
index video news footage
for search. With Amazon Rekognition, C-SPAN
reduced indexing time per video from 1
hour to 20 minutes and uploaded 97,000
images in under 2 hours.

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
Scaling
real-time translation
Using Amazon Translate, Lionbridge is able to scale
machine translation in order to localize content faster
and in more languages. Using Translate, Lionbridge was
able to reduce translation costs by 20 percent.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Understand the voice of your customer
sentiment analysis | app localization | translation services | transcription services | cataloging media | accessibility
A m a z o n
T r a n s c r i b e
A m a z o n
T r a n s l a t e
A m a z o n
C o m p r e h e n d
A m a z o n
R e k o g n i t i o n
I m a g e
A m a z o n
R e k o g n i t i o n
V i d e o

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Understand the voice of your customer
Voice of customer analytics with AI
Email AWS Lambda
Product
Reviews
AWS Lambda
Social Media Amazon Kinesis
Amazon
S3
Amazon
Athena
Amazon
Translate
Amazon
Comprehend
Amazon
Transcribe
sentiment, entities,
and key phrases
Call Recordings

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
Targeted
customer acquisition
VidMob uses Amazon Rekognition and
Amazon Transcribe for metadata extraction
and sentiment analysis, to help marketers understand
which videos resonate with audiences. This allows
marketers to promote targeted content to acquire new
customers.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Comprehend Medical
Extract information from unstructured medical text accurately and quickly
1.2B unstructured clinical documents created per year
Critical information “trapped” in these documents
Difficult to extract insights

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Comprehend Medical
Extract information from unstructured medical text accurately and quickly
Entities
• Medication
• Medical condition
• Test, Treatments and Procedures
• Anatomy
• Protected Health Information (PHI)
Relationship Extraction
• Medication and dosage
• Test and result
• Many more
Entity Traits
• Negation
• Diagnosis, Sign or
Symptom
Protected Health Information Identification
(PHId API)*
Distill a complex process into a simple API call
Medical Named Entity and Relationship
Extraction (NERe API)
Service is HIPAA Eligible and “Stateless”, no customer data stored
*This API extracts Protect Health Information only at lower cost.

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Protected Health Information (PHI)
Mr. Smith: Name
63: Age
Mr. Smith is a 63-year-old gentleman with coronary
artery disease and hypertension. CURRENT
MEDICATIONS: taking a dose of LIPITOR 20 mg once
daily
aws comprehend-medical detect-entities --region us-
east-1 --text “<Insert Text Here>”
Named Entities
Amazon Comprehend Medical
NERe API

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Comprehend Medical
NERe API
CURRENT MEDICATIONS: taking a dose of LIPITOR 20
mg once daily
aws comprehend-medical detect-entities --region us-
east-1 --text “<Insert Text Here>”
Relationship Extraction

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Comprehend Medical
NERe API
What are Entity Traits?
(1) Negation
(2) Diagnosis, sign or symptom
Rash
Discontinue Abraxane, patient denies taking
Tylenol 325 mg and is not taking calcium
carbonate, patient also stopped taking
cholecalciferol 1,000 units PO
Entity Traits

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Comprehend Medical
PHId API
Mr. Smith is a 63-year-old gentleman with coronary artery
disease and hypertension. He currently lives in Seattle and
works as a teacher. His PCP, Dr. John, works at the University of
Washington
aws comprehend-medical detect-phi --region us-east-1 --
text “<Insert Text Here>”
In addition to extracting PHI, the PHId API
identifies relevant patient identifiers described in
HIPAA Safe Harbor method of de-identification
Protected Health Information

© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
Amazon Comprehend Medical
Use cases
Patient & population health
analytics
Clinical Trial
managementRevenue cycle
management (Medical
Coding)
Pharmacovigilance
PHI Compliance
What else?

Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.