The document discusses Amazon Web Services' artificial intelligence services. It provides an overview of Amazon Rekognition for image and video analysis, Amazon Polly for text-to-speech, Amazon Transcribe for speech recognition, Amazon Translate for language translation, and Amazon Lex for conversational interfaces. The document highlights key features and capabilities of each service, including examples of real-world customers using the services. It emphasizes that the services provide high-quality AI through best-in-class deep learning models, with easy-to-use and production-ready interfaces at low cost.

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
HUStart Taglit – AWS Herzelia
January 2018
AI Services on AWS
Boaz Ziniman – Technical Evangelist, AWS
@ziniman

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The difficulty comes in writing
software that will make sense
of the data

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Artificial Intelligence
A system or service which can perform tasks
that usually require human intelligence

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
25,000 skills

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
And a few more examples…
Fraud detection Detecting fraudulent transactions, filtering spam emails,
flagging suspicious reviews, …
Personalization Recommending content, predictive content loading,
improving user experience, …
Targeted marketing Matching customers and offers, choosing marketing
campaigns, cross-selling and up-selling, …
Content classification Categorizing documents, matching hiring managers and
resumes, …
Churn prediction Finding customers who are likely to stop using the
service, free-tier upgrade targeting, …
Customer support Predictive routing of customer emails, social media
listening, …

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine Learning On AWS Today

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VISION LANGUAGE
A P P L I C A T I O N S E R V I C E S
Amazon Rekognition Image Amazon Polly Amazon Lex
Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW
Amazon AI Ecosystem

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VISION LANGUAGE
A P P L I C A T I O N S E R V I C E S
Amazon Rekognition Image Amazon Polly Amazon Lex
Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW
Amazon AI Ecosystem

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
General-purpose GPU compute applications.
Features:
• High Frequency Intel Xeon E5-2686v4 (Broadwell)
• High-performance NVIDIA V100 GPUs, each with
5,120 GPU cores + 640 Tensor cores and 16GiB of
GPU memory
• Supports GPUDirect™
• Enhanced Networking
• EBS-optimized by default at no additional cost
Amazon EC2 P3 Instances
Instance Size GPUs GPU Peer
to Peer
vCPUs Memory
(GiB)
Network
Bandwidth*
p3.2xlarge 1 - 8 61 Up to 10Gbps
p3.8xlarge 4 Y 32 244 10Gbps
p3.16xlarge 8 Y 64 488 25Gbps

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Expedia - Ranking Hotel Images
• Leading online travel company
• How to improve hotels listing images?
• Use GPUs and deep learning to rank hotel images
• Build a model based on 100K images
• How to rank 10M images?
• Use data parallelization across multiple GPUs on AWS
• Improve ranking time from more than a week to 1 day

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VISION LANGUAGE
A P P L I C A T I O N S E R V I C E S
Amazon Rekognition Image Amazon Polly Amazon Lex
Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW
Amazon AI Ecosystem

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VISION LANGUAGE
A P P L I C A T I O N S E R V I C E S
Amazon Rekognition Image Amazon Polly Amazon Lex
Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW
Amazon AI Ecosystem

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
One-Click
Deep Learning
AWS Deep Learning AMIs
Amazon Linux & Ubuntu
Up to~40k CUDA cores
Apache MXNet
TensorFlow
Theano
Keras
Caffe
CNTK
Torch
Pre-configured CUDA drivers
Anaconda, Python3
Out-of-the-box Tutorials
+ CloudFormation template
+ Container Image
Available in the AWS Marketplace

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Can We Help Customers
Put Intelligence At The Heart Of Every
Application & Business?

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VISION LANGUAGE
A P P L I C A T I O N S E R V I C E S
Amazon Rekognition Image Amazon Polly Amazon Lex
Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW
Amazon AI Ecosystem

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon
Rekognition
Object and scene detection
Facial analysis
Face comparison
Celebrity recognition
Image moderation
Amazon Rekognition: Images In, Rich Metadata Out

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Object & Scene Detection

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Analysis

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smiling?
Facial Analysis
(Deep) Learning from a Masterpiece
http://bit.ly/MonaLisaAI

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Celebrity Recognition

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Search

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Explicit Nudity
Nudity
Graphic Male Nudity
Graphic Female Nudity
Sexual Activity
Partial Nudity
Suggestive
Female Swimwear or Underwear
Male Swimwear or Underwear
Revealing Clothes
Image moderation

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Customers
Digital Asset Management
Media and Entertainment
Travel and Hospitality
Influencer Marketing
Systems Integration
Digital Advertising
Consumer Storage
Law Enforcement
Public Safety
eCommerce
Education

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
https://aws.amazon.com/solutions/case-studies/cspan/

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
R e a l - t i m e a n d b a t c h v i d e o
a n a l y t i c s
Generally available today
NEW!
Amazon
Rekognition Video

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AMAZON REKOGNITION VIDEO
A M A Z O N R E K O G N I T I O N
V I D E O
Video in. People, activities, and details out.
Objects and scenes
Facial analysis and recognition
Inappropriate content detection
Celebrity recognition
Person tracking

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AMAZON REKOGNITION VIDEO
Easy to use Batch
processing
Processes
real-time
video
Continually
trained
Low costTimestamp
generation

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly
“Today in Seattle, WA
it’s 11°F”
“Today in Seattle Washington
it’s 11 degrees Fahrenheit”
Amazon Polly: Text In, Life-like Speech Out
52 voices across 25 languages

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
• “Today in Seattle, WA, it’s 11°F”
• ‘"We live for the music" live from the Madison Square Garden.’

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
https://www.w3.org/TR/speech-synthesis/
<speak>
The spelling of my name is
<prosody rate='x-slow'>
<say-as interpret-as="characters">Boaz</say-as>
</prosody>
</speak>
A Focus On Voice Quality & Pronunciation

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
<say-as interpret-as="telephone">

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
• “My daughter’s name is Kaja.”

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
• “My daughter’s name is Kaja.”
4. Amazon Polly-specific tags
• dynamic range compression (drc)
<speak><prosody volume="loud">This text needs to be understandable
and loud.<amazon:effect name="drc">This text also needs to be more
understandable in a moving car.</amazon:effect></prosody></speak>

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
• “Richard’s number is 2122341237“
• “My daughter’s name is Kaja.”
4. Amazon Polly-specific tags
• dynamic range compression (drc)
• whispered

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Duolingo voices its language learning service Using Polly
Duolingo is a free language learning service where
users help translate the web and rate translations.
With Amazon Polly our users
benefit from the most lifelike
Text-to-Speech voices
available on the market.
Severin Hacker
CTO, Duolingo
”
“ • Spoken language crucial for
language learning
• Accurate pronunciation matters
• Faster iteration thanks to TTS
• As good as natural human speech

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A u t o m a t i c s p e e c h r e c o g n i t i o n
Available in preview today
NEW!
A m a z o n
T r a n s c r i b e

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Transcribe
Support for
telephony audio
Timestamp
generation
Intelligent
punctuation and
formatting
Recognize multiple
speakers
Custom
vocabulary
Multiple
languages
A u t o m a t i c c o n v e r s i o n o f s p e e c h i n t o a c c u r a t e , g r a m m a t i c a l l y
c o r r e c t t e x t

43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A u t o m a t i c a l l y t r a n s l a t e s
t e x t b e t w e e n l a n g u a g e s
Available in preview today
A m a z o n
T r a n s l a t e
NEW!

44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Translate
Real-time translation Batch analysis Automatic language recognition Low cost

45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Buy what does all this text mean?

46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
F u l l y m a n a g e d n a t u r a l l a n g u a g e
p r o c e s s i n g
Generally available today
NEW!
A m a z o n
C o m p r e h e n d

47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Discover valuable insights from text
Entities
Key Phrases
Language
Sentiment
Amazon
Comprehend
Amazon Comprehend

48. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
STORM
WORLD SERIES
STOCK MARKET
WASHINGTON
LIBRARY OF
NEWS ARTICLES
Amazon
Comprehend
Discover valuable insights from text
Amazon Comprehend

49. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DEMO

50. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Automatic Speech Recognition
Natural Language Understanding
“What’s the weather
forecast?”
Weather
Forecast
Amazon Lex: Speech Recognition & Natural
Language Understanding

51. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Lex
Automatic Speech Recognition
Natural Language Understanding
“What’s the weather
forecast?”
“It will be sunny
and 25°C”
Weather
Forecast
Speech Recognition & Natural Language
Understanding

52. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
VISION LANGUAGE
A P P L I C A T I O N S E R V I C E S
Amazon Rekognition Image Amazon Polly Amazon Lex
Amazon Rekognition Video Amazon Transcribe Amazon Translate Amazon ComprehendNEW NEWNEWNEW
Amazon AI Ecosystem

53. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon AI Services
High quality,
through
best-in-class
deep learning
Deep
functionality
Easy to use
& thoughtfully
integrated
Built for
production
Low
cost

54. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smile!
@ziniman

55. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!
@ziniman

56. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
@zinimanboazz@amazon.com
Artificial Intelligence Workshop
January 2018
Boaz Ziniman - Technical Evangelist - AWS

57. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What to expect
Rekognition – Image recognition (20 min)
• 5,000 images per month and store up to 1,000 face metadata
each month, for the first 12 months.
Polly – Text to Speech (10 min)
• 5 million characters per month for speech or Speech Marks
requests, for the first 12 months
Lex – Building a chatbot (10 min)
• 10,000 text requests and 5,000 speech requests per month for
free for the first year.

58. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition
• Login to AWS Console - https://console.aws.amazon.com/
• Go to Rekognition UI (Try Demo)
• Try all 5 demos with photos you take/found online
• Object and scene detection
• Image moderation
• Facial analysis
• Celebrity recognition
• Face comparison

59. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Polly
• Login to AWS Console - https://console.aws.amazon.com/
• Go to Polly UI
• Play with the Plain text tab
• Save some of the files locally
• Open SSML docs - http://bit.ly/AWS-SSML
(Using SSML with the Amazon Polly Console)
• Find a dialog from a movie you like
(http://www.simplyscripts.com/)
• Try to use SSML to give life to this dialog with Polly

60. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lex
• Login to AWS Console - https://console.aws.amazon.com/
• Go to Lex UI (Try Demo)
• Create a new Bot
• Choose one of the 3 sample bots
• Chat with your bot
• Try to change some of the answers (don’t forget to re-build)