Make your solution see, hear and talk, leveraging artificial intelligence services based on deep learning and neural networks. We will discover three new AI tools from AWS - Lex, Polly and Rekognition; integrated with AWS IoT and a physical world device for human interaction and environmental awareness.

1. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Unni Pillai
Solutions Architect
unni_k_pillai
Artificial Intelligence on AWS

2. A Flywheel For Data
More Users Better Products
More Data Better Analytics

4. A Flywheel For Data
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
More Users Better Products
More Data Better Analytics

5. A Flywheel For Data
ObjectStorage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
More Users Better Products
More Data Better Analytics

6. A Flywheel For Data
Artificial
Intelligence
ObjectStorage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
More Users Better Products
More Data Better Analytics

7. Machine Learning &
Artificial Intelligence
A Flywheel For Data
More Users Better Products
More Data Better Analytics
Big Data

8. Artificial Intelligence
At Amazon (1995)

10. AI Applications on AWS
Netflix Recommendation Engine
Pinterest Lens

11. Building Smarter Applications / Autonomous Systems
UNNI_K_PILLAI

12. Natural Language Processing
Computer Vision Speak Synthesis
Building Smarter Applications / Autonomous Systems

13. Can We Help Customers
Put Intelligence At The HeartOf
Every Application & Business?

14. DIY Deep Learning
for Custom Models
AI Enabled
Managed API Services
Amazon AI: New Deep Learning Services
Polly Rekognition
Deep Learning
Frameworks
MXNet, TensorFlow, Theano, Caffe, Torch
CONTROL
USABILITY&
SIMPLICITY
Lex

15. One-Click GPU
Deep Learning
AWS Deep Learning AMI
Up to~40k CUDAcores
MXNet
TensorFlow
Theano
Caffe
Torch
Pre-configured CUDA drivers
Anaconda, Python3
+ CloudFormation template
+ Container Image

16. Rekognition
ImageAnalysis

17. Amazon Rekognition
Deep learning-based image recognition service
Search, verify, and organize millions of images
Object and Scene
Detection
Facial
Analysis
Face
Comparison
Facial
Recognition
Integrated with S3, Lambda, Polly, Lex

18. Object and Scene Detection
Generate labels for thousands of objects, scenes, and
concepts, each with a confidence score
• Search, filter, and
curate image
libraries
• Smart searches for
user generated
content
• Photo, travel, real
estate, vacation
rental applications
Maple
Plant
Villa
Garden
Water
Swimming Pool
Tree
Potted Plant
Backyard

19. Demographic Data
Facial Landmarks
Sentiment Expressed
Image Quality
Facial Analysis
General Attributes

20. Demographic Data
Facial Landmarks
Sentiment Expressed
Image Quality
Facial Analysis
Brightness: 25.84
Sharpness: 160
General Attributes

21. Look Your Best All Day
Time for A New Look?
Facial Analysis - Use Case
(Targeted Marketing)
Demographic and Sentiment Analysis
PersonAPersonB
Sees
Sees

22. Face Comparison
Measure the likelihood that faces in two images are of the
same person
• Add face verification to
applications and devices
• Extend physical security
controls
• Provide guest access to
VIP-only facilities
• Verify users for online
exams and polls

23. Facial Recognition
Identify people in images by finding the closest match for an
input face image against a collection of stored face vectors
• Add friend tagging to
social and messaging apps
• Assist public safety officers
find missing persons
• Identify employees as they
access sensitive locations
• Identify celebrities in
historical media archives

24. Polly
Life-like Speech

25. Converts text
to life-like speech
47 voices 24 languages Low latency,
real time
Fully managed
Polly: Life-like Speech Service
Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
4. Customized Pronunciation
Articles and Blogs
Training Material
Chatbots (Lex)
Public Announcements

26. LEX
Conversation Engine

27. Voice & Text
“Chatbots”
Powers
Alexa
Voice interactions
on mobile, web
& devices
Text interaction
with Slack & Messenger
(with more coming)
Enterprise
Connectors
Salesforce
Microsoft Dynamics
Marketo
Zendesk
Quickbooks
Hubspot
Lex: Build Natural, Conversational
Interactions In Voice & Text
Improving human interactions…
• Contact, service, and support center interfaces (text + voice)
• Employee productivity and collaboration (minutes into seconds)

28. “Book a flight to
Hong Kong from
Singapore”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight Booking
Flight booking
London Heathrow
Intent /
Slot model
Key Value
Origin
Destination
Departure Date

29. Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight Booking
Flight booking
London Heathrow
Intent /
Slot model
Key Value
Origin Changi (SIN)
Destination Hong Kong (HKG)
Departure Date
“Book a flight to
Hong Kong from
Singapore”
Location
Location

30. Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight Booking
Flight booking
London Heathrow
Intent /
Slot model
“When would you like to fly?”
Prompt
“When would you
like to fly?”
Polly
“Book a flight to
Hong Kong from
Singapore”
Key Value
Origin Changi (SIN)
Destination Hong Kong (HKG)
Departure Date
Location
Location

31. Flight Booking
“When would you like to fly?”
Prompt
“When would you
like to fly?”
Polly
“Next Friday”
Key Value
Origin Changi (SIN)
Destination Hong Kong (HKG)
Departure Date

32. “Next Friday”
Automatic
Speech Recognition
Next Friday
Utterances
Flight Booking
Natural Language
Understanding
Flight booking
02 / 24 / 2017
Intent /
Slot model
Key Value
Origin Changi (SIN)
Destination Hong Kong (HKG)
Departure Date 23/June/2017
Date
Date

33. “Next Friday”
Automatic
Speech Recognition
Next Friday
Utterances
Flight Booking
Natural Language
Understanding
Flight booking
02 / 24 / 2017
Intent /
Slot model
“Your flight is booked for next Friday”
Polly
Confirmation
“Your flight is booked
for next Friday”
Key Value
Origin Changi (SIN)
Destination Hong Kong (HKG)
Departure Date 23/June/2017

34. Demo
Smart Door Lock

35. Camera
Door Lock
Door BellVisitor iotButtonDoorbellPressed
smsDeliveryHandler
verifyFace
AWS IoT
SNS
S3 Bucket
Lex
Rekognition
Polly
CloudWatch Log
Voice
User
Interface
API calls
Image Upload API call
SMS SMS
Delivery
Report
Prompt for passcode
New passcode
Doorbell
Is pressed
Command to
Capture
photo

37. Thank You
https://aws.amazon.com/blogs/ai/
unni_k_pillai