An overview of AWS AI Services covering Polly, Rekognition and Lex.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Web Summit - Lisbon
November 2017
AI Services on AWS
Boaz Ziniman – Technical Evangelist, AWS
@ziniman

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The difficulty comes in writing
software that will make sense
of the data

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Artificial Intelligence
A system or service which can perform tasks
that usually require human intelligence

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
25,000 skills

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
And a few more examples…
Fraud detection Detecting fraudulent transactions, filtering spam emails,
flagging suspicious reviews, …
Personalization Recommending content, predictive content loading,
improving user experience, …
Targeted marketing Matching customers and offers, choosing marketing
campaigns, cross-selling and up-selling, …
Content classification Categorizing documents, matching hiring managers and
resumes, …
Churn prediction Finding customers who are likely to stop using the
service, free-tier upgrade targeting, …
Customer support Predictive routing of customer emails, social media
listening, …

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine Learning On AWS Today

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
General-purpose GPU compute applications.
Features:
• High Frequency Intel Xeon E5-2686v4 (Broadwell)
• High-performance NVIDIA K80 GPUs, each with
2,496 parallel processing cores and 12GiB of GPU
memory
• Supports GPUDirect™
• Enhanced Networking
• EBS-optimized by default at no additional cost
Amazon EC2 P2 Instances
Instance Size GPUs GPU Peer
to Peer
vCPUs Memory
(GiB)
Network
Bandwidth*
p2.xlarge 1 - 4 61 1.25Gbps
p2.8xlarge 8 Y 32 488 10Gbps
p2.16xlarge 16 Y 64 732 20Gbps

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
General-purpose GPU compute applications.
Features:
• High Frequency Intel Xeon E5-2686v4 (Broadwell)
• High-performance NVIDIA V100 GPUs, each with
5,120 GPU cores + 640 Tensor cores and 16GiB of
GPU memory
• Supports GPUDirect™
• Enhanced Networking
• EBS-optimized by default at no additional cost
Amazon EC2 P3 Instances
Instance Size GPUs GPU Peer
to Peer
vCPUs Memory
(GiB)
Network
Bandwidth*
p3.2xlarge 1 - 8 61 Up to 10Gbps
p3.8xlarge 4 Y 32 244 10Gbps
p3.16xlarge 8 Y 64 488 25Gbps

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Expedia - Ranking Hotel Images
Leading online travel company
How to improve hotels listing images?
• Use GPUs and deep learning to rank hotel images
• Build a model based on 100K images
How to rank 10M images?
• Use data parallelization across multiple GPUs on AWS
• Improve ranking time from more than a week to 1 day

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
One-Click
Deep Learning
AWS Deep Learning AMIs
Amazon Linux & Ubuntu
Up to~40k CUDA cores
Apache MXNet
TensorFlow
Theano
Keras
Caffe
CNTK
Torch
Pre-configured CUDA drivers
Anaconda, Python3
Out-of-the-box Tutorials
+ CloudFormation template
+ Container Image
Available in the AWS Marketplace

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Can We Help Customers
Put Intelligence At The Heart Of
Every Application & Business?

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Ecosystem

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Polly
Text-to-Speech
Artificial Intelligence Services on AWS

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition
Image Analysis
Artificial Intelligence Services on AWS

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lex
Conversation Bots
Artificial Intelligence Services on AWS

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Polly
Text-to-Speech
Artificial Intelligence Services on AWS

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly
“Today in Seattle, WA
it’s 11°F”
“Today in Seattle Washington it’s
11 degrees Fahrenheit”
Text In, Life-like Speech Out

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
• “Today in Seattle, WA, it’s 11°F”
• ‘"We live for the music" live from the Madison Square Garden.’

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
https://www.w3.org/TR/speech-synthesis/
<speak>
The spelling of my name is
<prosody rate='x-slow'>
<say-as interpret-as="characters">Boaz</say-as>
</prosody>
</speak>
A Focus On Voice Quality & Pronunciation

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
<say-as interpret-as="telephone">

30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
• “My daughter’s name is Kaja.”

31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
• “My daughter’s name is Kaja.”
4. Amazon Polly-specific tags
• dynamic range compression (drc)
<speak><prosody volume="loud">This text needs to be understandable
and loud.<amazon:effect name="drc">This text also needs to be more
understandable in a moving car.</amazon:effect></prosody></speak>

32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
• “My daughter’s name is Kaja.”
4. Amazon Polly-specific tags
• dynamic range compression (drc)
• whispered

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Duolingo voices its language learning service Using Polly
Duolingo is a free language learning service where
users help translate the web and rate translations.
With Amazon Polly our users
benefit from the most lifelike
Text-to-Speech voices
available on the market.
Severin Hacker
CTO, Duolingo
”
“ • Spoken language crucial for
language learning
• Accurate pronunciation matters
• Faster iteration thanks to TTS
• As good as natural human speech

34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High quality,
through
best-in-class
deep learning
Deep
functionality
Easy to use
& thoughtfully
integrated
Built for
production
Low
cost
Polly: Life-like Speech Service

35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition
Image Analysis
Artificial Intelligence Services on AWS

36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon
Rekognition
Object and scene detection
Facial analysis
Face comparison
Celebrity recognition
Image moderation
Amazon Rekognition: Images In, Rich Metadata Out

37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Object & Scene Detection

38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Analysis

39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smiling?
Facial Analysis
(Deep) Learning from a Masterpiece
http://bit.ly/MonaLisaAI

40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Celebrity Recognition

41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Search

42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Explicit Nudity
Nudity
Graphic Male Nudity
Graphic Female Nudity
Sexual Activity
Partial Nudity
Suggestive
Female Swimwear or Underwear
Male Swimwear or Underwear
Revealing Clothes
Image moderation

43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Customers
Digital Asset Management
Media and Entertainment
Travel and Hospitality
Influencer Marketing
Systems Integration
Digital Advertising
Consumer Storage
Law Enforcement
Public Safety
eCommerce
Education

44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
https://aws.amazon.com/solutions/case-studies/cspan/

45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DEMO

46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
High quality,
through
best-in-class
deep learning
Deep
functionality
Easy to use
& thoughtfully
integrated
Built for
production
Low
cost
Rekognition: Search & Understand Visual Content

47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lex
Conversation Bots
Artificial Intelligence Services on AWS

48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Automatic Speech Recognition
Natural Language Understanding
“What’s the weather
forecast?”
Weather
Forecast
Speech Recognition & Natural Language
Understanding

49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Automatic Speech Recognition
Natural Language Understanding
“What’s the weather
forecast?”
“It will be sunny
and 25°C”
Weather
Forecast
Speech Recognition & Natural Language
Understanding

50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin
Destination
Departure Date
✈ Flight Booking

51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin
Destination
Departure Date
✈ Flight Booking
“Book a flight to
London”

52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London
Origin
Destination
Departure Date
✈ Flight Booking

53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural Language
Understanding
Flight booking
London Heathrow
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London
Origin
Destination
Departure Date
✈ Flight Booking

54. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural Language
Understanding
Flight booking
London Heathrow
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London
Origin
Destination London Heathrow
Departure Date
✈ Flight Booking

55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural Language
Understanding
Flight booking
London Heathrow
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking

56. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Natural Language
Understanding
Flight booking
London Heathrow
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
Prompt
“When would you
like to fly?”

57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“When would you
like to fly?”
Polly
Prompt
“When would you
like to fly?”
Natural Language
Understanding
Flight booking
London Heathrow
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking

58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“When would you
like to fly?”
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking

59. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
Automatic
Speech Recognition
Next Friday

60. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date
✈ Flight Booking
Natural Language
Understanding
Flight booking
10/11/2017
Automatic
Speech Recognition
Next Friday

61. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
“Next Friday”
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking
Natural Language
Understanding
Flight booking
10/11/2017
Automatic
Speech Recognition
Next Friday

62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking

63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking
Confirmation
“Your flight is booked
for next Friday”

64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Origin Lisbon
Destination London Heathrow
Departure Date 10/11/2017
✈ Flight Booking
Confirmation
“Your flight is booked
for next Friday”
“Your flight is booked for
next Friday”
Polly

65. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lex: Build Natural, Conversational Interactions In
Voice & Text
High quality,
through
best-in-class
deep learning
Deep
functionality
Easy to use
& thoughtfully
integrated
Built for
production
Low
cost

66. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Wrap up

67. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smile!
@ziniman

68. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!
@ziniman