AI State of the Union

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AI: State of the Union
A d r i a n H o r n s b y – T e c h n i c a l E v a n g e l i s t w i t h A W S
@ a d h o r n

Track Sponsor:

Amazon AI

Put machine learning in the hands of every developer
and data scientist
ML @ AWS: Our mission

Application
Services
Platform
Services
Frameworks
&
Infrastructure
API-driven services: Vision & Language Services, Conversational Chatbots
AWS ML Stack
Deploy machine learning models with high-performance machine learning
algorithms, broad framework support, and one-click training, tuning, and
inference.
Develop sophisticated models with any framework, create managed, auto-
scaling clusters of GPUs for large scale training, or run inference on trained
models.

Customer Running ML on AWS Today

Application
Services
API-driven services: Vision & Language Services, Conversational Chatbots
AWS ML Stack

Amazon Rekognition
Deep learning-based visual analysis service

Amazon
Rekognition
Object and scene detection
Facial analysis
Face comparison
Celebrity recognition
Image moderation
Text-in-Image

Object & Scene Detection

Facial Analysis

Crowd-Mode Face Detection N
EW

Facial Search

Text in Image N
EW

Explicit Nudity
Nudity
Graphic Male Nudity
Graphic Female Nudity
Sexual Activity
Partial Nudity
Suggestive
Female Swimwear or Underwear
Male Swimwear or Underwear
Revealing Clothes
Image Moderation

Rekognition API example
aws rekognition detect-labels
–-image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}'
{
"Labels": [
{
"Confidence": 99.29136657714844,
"Name": "Human"
},
{
"Confidence": 99.29136657714844,
"Name": "People"
},
{
"Confidence": 99.29136657714844,
"Name": "Person"
},
……

Rekognition API example
aws rekognition detect-faces
--image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}'
--attributes "ALL”
{
"FaceDetails": [
{
"BoundingBox": {
"Width": 0.05462963134050369,
"Top": 0.2880098819732666,
"Left": 0.4722222089767456,
"Height": 0.07292954623699188
}, "Landmarks": [
{
"Y": 0.31606796383857727,
"X": 0.48852023482322693,
"Type": "eyeLeft"
………

Marinus Analytics uses facial recognition to
stop human trafficking
“Now with Traffic Jam’s
FaceSearch, powered by
Amazon Rekognition,
investigators are able to
take effective action by
searching through millions
of records in seconds to
find victims.”
http://www.marinusanalytics.com/articles/2017/10/17/amazon-rekognition-helps-marinus-analytics-fight-human-trafficking

Amazon Rekognition Video
N
EW
(GA)

Rekognition Video Analysis Service

Rekognition Video API example
aws rekognition start-label-detection
--video '{"S3Object":{"Bucket":"adhorn-reko","Name":"bourne.mp4"}}’
{
"JobId": "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496”
}
aws rekognition get-label-detection
--jobId "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496”

City of Orlando
Real-time video analysis
”The City of Orlando is excited to work with Amazon to
pilot the latest in public safety software through a
unique, first-of-it's-kind public-private partnership.
Through the pilot, Orlando will utilize Amazon
Rekognition Video and Amazon Kinesis Video
Streams technology in a way that will use existing City
resources to provide real-time detection and
notification of persons-of-interests, further increasing
public safety, and operational efficiency opportunities
for the City of Orlando and other cities across the
nation”.
John Mina, Police Chief, City of Orlando

Amazon Polly
Deep learning-based Text-to-Speech service

Amazon Polly
“What's the
difference between a
hippo and a zippo?
One is really heavy,
and the other is a
little lighter.”
Amazon Polly: Text In, Life-like Speech Out

<speak xml:lang="en-US">
The price of this book is <prosody rate="60%">€45</prosody>
</speak>
A Focus On Voice Quality & Pronunciation
Support for Speech Synthesis Markup Language (SSML) Version 1.0
https://www.w3.org/TR/speech-synthesis

Polly API example
aws polly synthesize-speech
--text "It was nice to live such a wonderful live show"
--output-format mp3
--voice-id Joanna
--text-type text johanna.mp3
aws polly synthesize-speech
--text-type ssml
--text file://ssml_polly
--output-format mp3
--voice-id Joanna speech.mp3

“With Amazon Polly our users benefit from
the most lifelike Text-to-Speech voices
available on the market.”
Severin Hacker
CTO, Duolingo

”
“ Amazon Polly delivers
incredibly lifelike voices
which captivate and engage
our readers.
John Worsfold
Solutions Implementation Manager, RNIB
• RNIB delivers largest library of
audiobooks in the UK for nearly 2
million people with sight loss
• Naturalness of generated speech is
critical to captivate and engage readers
• No restrictions on speech
redistributions enables RNIB to create
and distribute accessible information in
a form of synthesized content
RNIB provides the largest library in the UK for people with sight loss

Amazon Translate
Neural Machine Translation Service
(Preview Today)
N
EW

“Hello, what’s up? Do you
want to go see a movie
tonight?”
Amazon Translate
Natural and fluent language translation
"Bonjour, quoi de neuf ? Tu
veux aller voir un film ce
soir ?"
Amazon
Translate

Automatically translates text between languages
Real-time
translation
Powered by deep
learning
12 Language pairs
(more to come)
Language detection

Translate API example
aws translate translate-text
--endpoint-url https://translate.us-east-1.amazonaws.com
--region us-east-1
--text "hello, what’s up? Do you want to go see a movie tonight?"
--source-language-code "en"
--target-language-code "fr”
{
"TargetLanguageCode": "fr”,
"TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”,
"SourceLanguageCode": "en”
}

Translate API example
aws translate translate-text
--endpoint-url https://translate.us-east-1.amazonaws.com
--region us-east-1
--text "hello, what’s up? Do you want to go see a movie tonight?"
--source-language-code "en"
--target-language-code "fr”
{
"TargetLanguageCode": "fr”,
"TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”,
"SourceLanguageCode": "en”
}
Context Awareness

Hotels.com
Natural Language Processing
« Amazon Comprehend helps us
analyze the key sentiments, objects, and
geos in our 30 million plus reviews &
testimonies. Now we are able to discover
new insights into the unique experiences
available at each property, so our
customers can make the best
decision possible for their travel.”
Machine Translation
« We operate 90 localized websites in 41
languages. (…)
Having evaluated Amazon Translate
and several other solutions, we believe
that Amazon Translate presents a quick,
efficient and most importantly, accurate
solution.»
Matt Fryer, VP and Chief Data Science Officer, Hotels.com

DEMO – Translation service

Amazon Transcribe
Automatic speech recognition service
N
EW
(Preview Today)

“Hello, this is Allan
speaking”
Amazon
Transcribe

Available in
preview
today
Support for
telephony audio
Timestamp
generation
Intelligent
punctuation and
formatting
Recognize
multiple
speakers
Custom
vocabulary
Multiple
languages

ringDNA
• RingDNA is an end-to-end
communications platform for sales
teams.
• Hundreds of enterprise organizations
use RingDNA to dramatically increase
productivity, engage in smarter sales
conversations, gain predictive sales
insights and improve their win rate.
Speech to Text
"A critical component of RingDNA’s Conversation AI
requires best of breed speech-to-text to deliver
transcriptions of every phone call. RingDNA is excited
about Amazon Transcribe since it provides high-quality
speech recognition at scale, helping us to better
transcribe every call to text "
Howard Brown, CEO & Founder, RingDNA
https://www.youtube.com/watch?v=1ZJ_f1bDdog

Amazon Comprehend
N
EW
(GA)

Fully managed natural language processing
Discover valuable insights from text
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend

Support for large data sets and topic modeling
STORM
WORLD SERIES
STOCK MARKET
WASHINGTON
LIBRARY OF
NEWS ARTICLES *
Amazon
Comprehend
* Integrated with Amazon S3 and AWS Glue

Comprehend API example
aws comprehend detect-sentiment
--text "I love you"
--language-code "en”
{
"SentimentScore":
{
"Mixed": 0.005664939060807228,
"Positive": 0.9262985587120056,
"Neutral": 0.06511948257684708,
"Negative": 0.0029170133639127016
},
"Sentiment": "POSITIVE”
}

The Washington Post
Text to Speech
« This is a new technology that can give users more choice and
better accessibility to our content, so we wanted to create an
experiment to dive deeper into the user experience. After a month,
we’ll take what we’ve learned about how users engage with this
feature to develop our first iteration of a product with Amazon
Polly. »
Joseph Price, Product Manager, The Washington Post
https://www.washingtonpost.com/pr/wp/201
7/06/09/the-washington-post-to-start-
experimenting-with-audio-articles-using-
amazon-polly
« The Post strives to give its nearly 100 million readers the best
experience possible and relevant content recommendations are a
key part of that mission. With Amazon Comprehend, we can
leverage the continuously-trained NLP capabilities like Keyphrase
and Topic APIs to potentially allow us to provide even better
content personalization, SEO, and ad targeting capabilities. »
Dr. Sam Han, Director of Data Science, The Washington
Post

Amazon Lex
Conversational Interfaces

Amazon Lex
“What’s the weather
forecast?”
“It will be sunny
and 25°C”
Weather
Forecast
Amazon Lex
Build Conversational Chatbots

Intents
A particular goal that the
user wants to achieve
Utterances
Spoken or typed phrases
that invoke your intent
Slots
Data the user must provide to fulfill the
intent
Prompts
Questions that ask the user to input
data
Fulfillment
The business logic required to fulfill the
user’s intent
BookHotel

Capital One
https://www.capitalone.com/applications/alexa/

Liberty Mutual
https://www.youtube.com/watch?v=TeLvFqLW_0A
Speech Recognition and Natural Language
Understanding
« Amazon Lex integrates easily into our existing
applications, as well as our new cloud-native
serverless architectures, enabling us to rapidly
take advantage of these powerful technologies
to improve and extend the capabilities we can
offer our employees and customers.»
Gillian Armstrong, Technologist, Liberty Mutual

Platform
Services
AWS ML Stack
Deploy machine learning models with high-performance machine learning
algorithms, broad framework support, and one-click training, tuning, and
inference.

Amazon EMR
Easily Run and Scale Apache Hadoop,
Spark, HBase, Presto, Hive, and other
Big Data Frameworks

ML Applications on Amazon EMR
Amazon EMR
(Elastic MapReduce)

Amazon SageMaker
A fully managed service to quickly and easily
build machine-learning based models
N
EW
(GA)

End-to-End
Machine Learning
Platform
Zero setup Flexible Model
Training
Pay by the second
$
Amazon SageMaker
Build, train, and deploy machine learning models at scale

Highly-optimized
machine learning
algorithms
BuildPre-built
notebook
instances
Amazon SageMaker

Highly-optimized
machine learning
algorithms
One-click training
for ML, DL, and
custom algorithms
BuildPre-built
notebook
instances
Easier training with
hyperparameter
optimization
Train
Amazon SageMaker

One-click training
for ML, DL, and
custom algorithms
Easier training with
hyperparameter
optimization
Highly-optimized
machine learning
algorithms
Deployment
without
engineering effort
Fully-managed
hosting at scale
BuildPre-built
notebook
instances
Deploy
Train
Amazon SageMaker

Launch Customers

Frameworks
&
Infrastructure
AWS ML Stack
Develop sophisticated models with any framework, create managed, auto-
scaling clusters of GPUs for large scale training, or run inference on trained
models.

Amazon EC2 P3 Instances (October 2017)
• Up to eight NVIDIA Tesla V100 GPUs
• 1 PetaFLOPs of computational
performance – 14x better than P2
• 300 GB/s GPU-to-GPU communication
(NVLink) – 9X better than P2
• 16GB GPU memory with 900 GB/sec peak
GPU memory bandwidth
T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d
N
EW

AWS Deep Learning AMI
• Easy-to-launch tutorials
• Hassle-free setup and configuration
• Pay only for what you use
• Accelerate your model training and deployment
• Support for popular deep learning frameworks

FDA-approved
medical imaging
https://www.periscope.tv/AWSstartups/1vAGRgevBXRJl
https://www.youtube.com/watch?v=WE81dncwnIc

AWS DeepLens
Deep learning enabled video camera for
developers
N
EW
(Pre-order Today)

A new way to learn
Custom built for deep learning
Broad Framework Support
Deploy models from Amazon SageMaker
Integrated with AWS
Full programmable with AWS Lambda
AWS DeepLens
W o r l d ’ s f i r s t d e e p l e a r n i n g e n a b l e d v i d e o c a m e r a f o r d e v e l o p e r s

Amazon ML Lab
Provides the missing ML expertise
N
EW

Amazon ML Lab
Lots of companies
doing Machine
Learning
Unable to unlock
business potential
Brainstorming Modeling Teaching
Lack ML
expertise
Leverage Amazon experts with decades of ML
experience with technologies like Amazon Echo,
Amazon Alexa, Prime Air and Amazon Go
Amazon ML Lab
provides the missing
ML expertise

Summary

Model
Training
Inference
in the Cloud
Inference
at the Edge
Infrastructure to support model build and deploy

FRAMEWORKS AND INTERFACES
PLATFORM SERVICES
APPLICATION SERVICES
Amazon
Rekognition
Amazon Polly Amazon Lex
Democratization of AI
Amazon
Rekognition Video
Amazon Transcribe
Amazon Comprehend
Amazon SageMaker AWS DeepLens Amazon EMR
Deep Learning AMI
Amazon Translate

AI State of the Union

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to AI State of the Union

Similar to AI State of the Union (20)

More from Amazon Web Services

More from Amazon Web Services (20)

AI State of the Union