In this session. We will provide an overview of the latest Amazon Rekognition features including real-time face recognition, Text in Image recognition, and improved face detection. Amazon Rekognition recently added three new features: detection and recognition of text in images; real-time face recognition across tens of millions of faces; and detection of up to 100 faces in challenging crowded photos. In this session, we will cover features, benefits and use cases for these latest Rekognition features, while highlighting customer examples and a brief demo showcasing Amazon Rekognition.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENT
What’s New with Amazon Rekognition
E a s y - t o - U s e D e e p L e a r n i n g - B a s e d I m a g e a n d V i d e o A n a l y s i s
M a r c o C a g n a & V e n k a t e s h B a g a r i a
N o v e m b e r 3 0 , 2 0 1 7
M C L 3 3 6

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition
VideoImage &

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Image
Object and Scene
Detection
Facial
Analysis
Face
Recognition
Text in Image
Deep learning-based image recognition service
Unsafe Image
Detection
Celebrity
Recognition

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Image
re:INVENT 2016
April 2017
June 2017
November 2017

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Image Customers

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Boat 99.3%
Plant 95.1%
Harbor 94.8%
Yacht 78.1%
Dock 75.7%
City 72.4%
Architecture 71.8%
Urban 63.9%
Building 62.3%
Marina 60.3%
Plaza 51.1%
Spire 50.8%
Neighborhood 50.7%
Flower 50.6%
Waterfront 94.8%
Object and Scene Detection

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Label Detection – Dynamic Search Indexing
MOBILE APP AMAZON S3 AWS LAMBDA Amazon Rekognition
AMAZON ELASTICSEARCH
SERVICE
AMAZON DYNAMODB
The mobile app uploads
a new image to S3

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Detection and Analysis
Image Quality
Facial Landmarks
Demographic Data Emotions
General Attributes
Facial Pose
Brightness 23.6%
Sharpness 99.9%
EyeLeft,EyeRight,Nose
RightPupil,LeftPupil
MouthRight,LeftEyeBrowUp
Bounding Box
Age Range 29-45
Gender: Male 96.5%
Happy 83.8%
Surprised 0.65%
Smile:True 23.6%
EyesOpen:True 99.8%
Beard:True 99.5%
Mustache:True 99.9%
Pitch 1.446
Roll 5.725
Yaw 4.383

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Facial Detection and Analysis - Crowd
Support for up to 100 faces

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Retail Demographics and Sentiment Analysis
Shoppers APPLICATION DetectFaces
AMAZON QUICKSIGHT AMAZON REDSHIFT AMAZON S3
The application uses in-store
cameras to capture live images of
shoppers in a retail store
DetectFaces analyzes the image and
returns demographics, facial attributes and
emotions

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Real-time face search against tens of millions of faces
Face Search

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Face Search - Public Safety
300,000+ images of previous offenders indexed in 2 days
Match time reduced from multiple days to seconds

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Face Search - Public Safety
First suspect identified within the first week

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Face Search - Public Safety

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Face Search - Media and Entertainment
A u t o m a t i n g F o o t a g e
T a g g i n g w i t h A m a z o n
R e k o g n i t i o n
Indexed 99,000 people
Saves ~9,000 hours a year in labor

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Best Practices for Faces
• Faces at least ~2% image size, minimum 25-32
pixels
• For live use cases, send image as bytes (5MB limit)
• Reduce image resolution for faster response
• Use separate Collections for separate identities
• Face Model Versioning

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Unsafe Image Detection
Female Swimwear Or Underwear 98.7%
Suggestive 98.7%

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Unsafe Image Detection

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Celebrity Recognition
Automatically recognize hundreds of thousands of global, public figures in politics, sports,
entertainment, business, and media.
Name: Jeff Bezos
MatchConfidence: 100

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition Text in Image
Extract textual content from real world images in various layouts, fonts, and styles

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition Text in Image
Extract textual content from real world images in various layouts, fonts, and styles

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Rekognition Text in Image
Extract textual content from real world images in various layouts, fonts, and styles

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Photo Upload Amazon S3 AWS Lambda
Image Search Amazon Elasticsearch
Amazon Rekognition
“Seattle”
Applications in image sharing, social media, and media and entertainment
Amazon DynamoDB
Text based Visual Search

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Identification of vehicles and products
Camera and Video
capture client
Amazon Kinesis
Streams
AWS Lambda
SMS
Notification
Amazon SNS
Amazon Rekognition
“AB123CD”
Applications in security and public safety, logistics, manufacturing
Amazon
DynamoDB
Amazon
S3

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Best Practices for Text in Image
• Focus on real world images
• Send crop for specific areas of interest
• Test multiple orientations
• Use spell-checker if interested only in dictionary
words
• Use AWS NLP APIs to detect languages, entities, key
phrases, and sentiment!

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Developer Resources for Amazon Rekognition
Getting started https://aws.amazon.com/rekognition/getting-started/
Developer Resources https://aws.amazon.com/rekognition/developers/
AWS AI Blog – Amazon Rekognition
https://aws.amazon.com/blogs/ai/tag/amazon-rekognition/

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
THANK YOU!