by Itzik Paz, Solutions Architect, Martin Schade, Solutions Architect, and Rich Cowper, Solutions Architect Manager, AWS Are you interested in processing images at scale without launching a single virtual machine? In this workshop, we show participants how to create an entirely serverless image processing platform using Amazon Cognito, AWS Lambda, Amazon Rekognition, and Amazon Elasticsearch Service (Amazon ES). Participants leave this workshop with a web portal where users can upload images that ultimately end up in a searchable index powered by Amazon ES and Kibana.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENT
Create a Serverless Image
Processing Platform
R i c h C o w p e r — A W S S o l u t i o n s A r c h i t e c t
A R C 3 2 6
N o v e m b e r 2 9 , 2 0 1 7

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What to expect
• Use AWS CloudFormation to build out an components
• Review serverless architecture concepts
• Review capabilities of Amazon Rekognition, AWS Lambda, and
Amazon Elasticsearch Service
• Perform an architectural assessment guided by AWS Well-
Architected Framework

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Workshop step 1
Let's get started!
Step 1 is to deploy the CloudFormation stack
We do this first because it takes about 20 minutes to get up and running. We’ll
discuss the rest of the workshop while it loads.
bitly.com/reinvent2017-arc326

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What problem are we solving?
Provide a website for end users to upload images
• Workload that processes millions of images per year
• Workload is very sporadic, large peaks and long idle periods
• Need to create thumbnails, identify objects on the images, and
ability to search images for metadata or objects

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What did we create?
VPC
Bastion host
Amazon Elasticsearch Service
cluster
S3 bucket
IAM Role

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What will are building today

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why serverless?
No servers to maintain, patch
Instant scalability
Cost-effective
Secure
Focus on what’s important

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Run code without servers. Pay only for the compute
time you consume.
Triggered by events or called from APIs:
• PUT to an Amazon Simple Storage Service
(Amazon S3) bucket
• Updates to Amazon DynamoDB table
• Call to an Amazon API Gateway endpoint
• Mobile app back-end call
• And many more…
Makes it easy to:
• Perform real-time data processing
• Build scalable back-end services
• AWS Glue and choreograph systems
AWS Lambda

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Benefits of AWS Lambda
No servers to
manage
Continuous
scaling
Never pay for idle

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Lambda programming
Bring your own code
• Node.js, Java, Python, .NET
• Bring your own libraries (even
native ones)
Simple resource model
• Select power rating from
128 MB to 1.5 GB
• CPU and network allocated
proportionately
• Reports actual usage
Stateless
• Persist data using Amazon
DynamoDB, Amazon S3, or
Amazon ElastiCache
• No affinity to infrastructure
(can’t “log in to the box”)
Programming model
• AWS SDK built in (Python
and Node.js)
• Lambda is the “webserver”
• Use processes, threads,
/tmp, sockets normally

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Cognito—fully managed user directory
User management User directory Enhanced security
features

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition
Deep learning-based image recognition service
Object and
Scene
Detection
Facial
Analysis
Face
Recognition
Text in
Image
Unsafe
Image
Detection
Celebrity
Recognition

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Elasticsearch Service
Distributed search and analytics engine
Managed service using Elasticsearch and Kibana
Fully managed—zero admin
Highly available and reliable
Tightly integrated with other AWS services

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EASY TO USE OPEN
Amazon Elasticsearch Service benefits
Create an
Elasticsearch cluster
in minutes.
Use the Elasticsearch
native API.
Secure
Integrates with AWS
Identity and Access
Management
AVAILABLE
Provides High
Availability with Zone
Awareness
AWS INTEGRATED
Integrated into Amazon
Kinesis Firehose, AWS
IoT, and Amazon
CloudWatch Logs
SCALABLE
Scale clusters from a
single node up to 20
notes

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is good architecture?
Five Pillars of AWS Well-Architected Framework
Cost efficiencyOperational
excellence
Security
Performance
efficiency
Reliability

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Lab
A R C 3 2 6

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!
C L I C K T O A D D T E X T
A R C 3 2 6