Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Workshop: Build an Image-Based Automatic Alert System with Amazon Rekognition

331 views

Published on

by Kashif Imran, Solutions Architect, AWS

This hands-on workshop will walk through how to build a solution that listens and captures images from Twitter, and then compares those images against a reference image to automatically notify you about a new post featuring your favorite celebrity. Additionally, we will integrate sentiment analysis into this image-based automatic alert system in order to gauge whether the determined celebrities are happy, sad, etc. in the posted image.

  • Login to see the comments

Workshop: Build an Image-Based Automatic Alert System with Amazon Rekognition

  1. 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Pop-up Loft Build an Image-Based Automatic Alert System with Amazon Rekognition Kashif Imran, Sr. Solutions Architect
  2. 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved What to expect? • Goal: Learn how to build computer vision based smart applications • Overview of Amazon Rekognition • Outline of the Workshop Scenario • Preview of the Lab/Instructions
  3. 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved The Amazon Machine Learning Stack FRAMEWORKS & INTERFACES Caffe2 CNTK Apache MXNet PyTorch TensorFlow Chainer Keras Gluon AWSDeepLearningAMIs AmazonSageMaker Rekognition Transcribe Translate Polly Comprehend Lex AWS DeepLens EDUCATION PLATFORM SERVICES APPLICATION SERVICES AmazonMechanical Turk
  4. 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Deep learning-based image and video analysis service Object and Scene Detection Facial Analysis Face Search & Match Text in ImageUnsafe Image Detection Celebrity Recognition Amazon Rekognition We encourage law enforcement agencies to work with local government officials to develop acceptable use policies for facial recognition technologies that both protects the rights of citizens and enables law enforcement to do their job.
  5. 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Boat 99.3% Plant 95.1% Harbor 94.8% Yacht 78.1% Dock 75.7% City 72.4% Architecture 71.8% Urban 63.9% Building 62.3% Marina 60.3% Plaza 51.1% Spire 50.8% Neighborhood 50.7% Flower 50.6% Waterfront 94.8% Object and Scene Detection
  6. 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Unsafe Image Detection Suggestive 98.7% Female Swimwear or Underwear 98.7%
  7. 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Facial Detection and Analysis smart cropping & ad overlays demographic & sentiment analysis face redaction & privacy protection Age Range: 38-57 Beard: False 97.3% Emotion: Happy 87.1% Eyeglasses: False 99.6% Eyes Open: True 99.9% Gender: Male 99.9% Mouth Open: False 86.2% Mustache: False 99.8% Smile: True 95.9% Sunglasses: False 99.8%
  8. 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved FaceID: 4c55926e-69b3-5c80-8c9b-78ea01d30690 Similarity: 97 FaceID: 02e56305-1579-5b39-ba57-9afb0fd8782d Similarity: 92 FaceID: 02e56305-1579-5b39-ba57-9afb0fd8782d Similarity: 85 Real-time search against tens of millions of faces Face Search Index Faces Collection Search Faces MaxFaces FaceMatchThreshold
  9. 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Combatting Human Trafficking • Machine learning and analytics platforms for law enforcement • Match photos of exploited children to those on the dark web • Reduces the time and effort to identify and rescue victims
  10. 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Celebrity Guests at the Royal Wedding • “Who’s Who Live” function • Celebrity guests identified in live stream • On Screen captions of relation to the royal couple
  11. 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved
  12. 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved
  13. 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Sports Media: Player Tracking and Recognition
  14. 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Image API – Request and Response DetectLabels { "Image": { "Bytes": blob, "S3Object": { "Bucket": "string", "Name": "string", "Version": "string" } }, "MaxLabels": number, "MinConfidence": number } { "Labels": [ { "Confidence": number, "Name": "string” } ], "OrientationCorrection": "string" }
  15. 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Video API – Request and Response GetLabelDetection StartLabelDetection { “ClientRequestToken": "string", "JobTag": "string", "MinConfidence": number, "NotificationChannel": { "RoleArn": "string", "SNSTopicArn": "string” }, "Video": { "S3Object": { "Bucket": "string", "Name": "string", "Version": "string” } } } { "JobStatus": string, "StatusMessage": string, "VideoMetadata": { "Format": string, "Codec": string, "DurationMillis": number, "FrameRate": float, "FrameWidth": number, "FrameHeight": number }, "NextToken": string, "Labels": [ { "Timestamp": number, "Label": { "Name": string, "Confidence": float } } ], ... JobId
  16. 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Other Services You Will Use Today
  17. 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Amazon Elastic Compute Cloud (EC2) Match Capacity and Demand Global Footprint Elasticity Provision Servers in Minutes Infrastructure as Code Programmatic Networking
  18. 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Amazon Kinesis Data Firehose
  19. 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved AWS Lambda No Servers to Manage Continuous Scaling Don’t Pay for Idle Capacity Lambda allows you to run application logic without provisioning servers or worrying about the health or security of underlying resources Lambda scales infrastructure beneath your application logic; just send requests and events and Lambda will automatically scale to accommodate it With Lambda, you’re billed in 100ms increments of execution time and number of requests and you’re never charged for anything when your code isn’t running
  20. 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Amazon DynamoDB • Fast and flexible NoSQL database service for any scale Dead Simple • GetItem(primaryKey) • PutItem(item) Robust Depth • Fine-Grained Access Control • Streams • Triggers • Global Tables • Encryption • DynamoDB local • Free-text search • Strong consistency option • Atomic counters
  21. 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Amazon Simple Storage Service (S3) • Durable, massively scalable object storage • Designed for 99.999999999% durability and 99.99% availability • Stores trillions of objects and regularly handles millions of requests per second • Effectively infinite storage without provisioning capacity
  22. 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Workshop Overview
  23. 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Architecture
  24. 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Extension
  25. 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Workshop Step by Step Guide • https://github.com/aws-samples/aws-developer- workshop/blob/master/episode2/Instructions.md https://bit.ly/2tdSmH8
  26. 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved Pop-up Loft aws.amazon.com/activate Everything and Anything Startups Need to Get Started on AWS

×