Build on AWS

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Getting Started with AI/ML using
Amazon Sagemaker
Dennis Magsajo
Solutions Architect, Amazon Web Services

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solving Some of the Biggest Challenges in Computer Science
Learning Language Perception Problem
Solving
Reasoning

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML @ AWS
OUR MISSION
Put machine learning in the
hands of every developer and
data scientist

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Machine Learning at Amazon: A Long Heritage
Voice driven
interactions
Fulfillment automation
& inventory management
Personalized
recommendations
Drones
Inventing entirely new
customer experiences

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KERAS
PLATFORMS
APPLICATION SERVICES
A M A Z O N
R E K O G N I T I O N
A M A Z O N
R E K O G N I T I O N
V I D E O
A M A Z O N
P O L L Y
A M A Z O N
T R A N S C R I B E
A M A Z O N
T R A N S L A T E
A M A Z O N
C O M P R E H E N D
A M A Z O N
L E X
Amazon SageMaker Amazon Mechanical Turk
The AWS Machine Learning Stack
FRAMEWORKS / INTERFACES

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KERAS
PLATFORMS
APPLICATION SERVICES
R E K O G N I T I O N R E K O G N I T I O N
V I D E O
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E X
Amazon SageMaker Amazon Mechanical Turk
The AWS Machine Learning Stack
FRAMEWORKS / INTERFACES

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
K E R A S
F R A M E W O R K S A N D I N T E R F A C E S
F r a m e w o r k s I n t e r f a c e s
NVIDIA
Tesla V100 GPUs
(14x faster than P2)
P3
Machine Learning
AMIs
5,120 Tensor cores
128GB of memory
1 Petaflop of compute
NVLink 2.0
I N F R A S T R U C T U R E
Complete Control over Frameworks & Infrastructure
For the data scientist, AI researcher, or advanced ML practitioner

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Deep Learning AMI
• Get started quickly with easy-to-launch tutorials
• Hassle-free setup and configuration
• Pay only for what you use – no additional charge for
the AMI
• Accelerate your model training and deployment
• Support for popular deep learning frameworks

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Up to eight NVIDIA Tesla V100 GPUs
• 1 PetaFLOPs of computational performance
14x better than P2
• 300 GB/s GPU-to-GPU communication
(NVLink) 9X better than P2
• 16GB GPU memory with 900 GB/sec peak
GPU memory bandwidth
Amazon EC2 P3 Instances
The fastest, most powerful GPU instances in the cloud

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KERAS
PLATFORMS
APPLICATION SERVICES
R E K O G N I T I O N R E K O G N I T I O N
V I D E O
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E X
Amazon SageMaker Amazon Mechanical Turk
The AWS Machine Learning Stack
FRAMEWORKS / INTERFACES

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KERAS
PLATFORMS
APPLICATION SERVICES
R E K O G N I T I O N R E K O G N I T I O N
V I D E O
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E X
Amazon SageMaker Amazon Mechanical Turk
The AWS Machine Learning Stack
FRAMEWORKS / INTERFACES

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition and Rekognition Video
Deep learning-based image and video analysis service
We encourage law enforcement agencies to work with local government officials
to develop acceptable use policies for facial recognition technologies that both
protects the rights of citizens and enables law enforcement to do their job.
Object and Scene
Detection
Facial
Analysis
Face Search
& Match
Text in ImageUnsafe Image
Detection
Celebrity
Recognition

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KERAS
PLATFORMS
APPLICATION SERVICES
R E K O G N I T I O N R E K O G N I T I O N
V I D E O
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E X
Amazon SageMaker Amazon Mechanical Turk
The AWS Machine Learning Stack
FRAMEWORKS / INTERFACES

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
KERAS
PLATFORMS
APPLICATION SERVICES
R E K O G N I T I O N R E K O G N I T I O N
V I D E O
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E X
Amazon SageMaker Amazon Mechanical Turk
The AWS Machine Learning Stack
FRAMEWORKS / INTERFACES

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Where should you spend your
time?
Machine Learning

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
BUILD
Where should you spend your time?
Design training experiments

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
BUILD TRAI N
Where should you spend your time?
Run scalable training

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
BUILD TRAI N
Where should you spend your time?
Tune Hyperparameters
TUNE

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
BUILD TRAI N DEPLOY
Where should you spend your time?
TUNE
Deploy and operate

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data
Selection
Data
Cleansing
Data
Annotation
Model
Selection
Model
Evaluation
Model
Deployment
Data readiness challenges

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build, train, tune, and host your own models
Amazon
SageMaker

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
TRAI N DEPLOY
TUNE
Build, train, tune, and host your own models
Amazon
SageMaker
BUILD

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
TRAI N DEPLOY
BUILD
TUNE
Build, train, tune, and host your own models
Amazon
SageMaker

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
Hyperparamete
r optimization
DEPLOY
BUILD TRAI N & TUNE
Build, train, tune, and host your own models
Amazon
SageMaker

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fully managed
hosting with
auto-scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
BUILD TRAI N & TUNE DEPLOY
Hyperparamete
r optimization
Build, train, tune, and host your own models
Amazon
SageMaker

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fully managed
hosting with
auto-scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
BUILD TRAI N & TUNE DEPLOY
Hyperparamete
r optimization
End-to-end-encryption
End-to-end VPC support
Compliance and audit capabilities
Metadata and experiment management capabilities
Pay as you go
Build, train, tune, and host your own models
Amazon
SageMaker

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build, train, tune, and host your own models
Amazon
SageMaker Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
BUILD
• Blazing Text
• DeepAR Forecasting
• Factorization Machines
• Image Classification Algorithm
• K-Means Algorithm
• K-Nearest Neighbors
• Latent Dirichlet Allocation (LDA)
• Linear Learner
• Neural Topic Model (NTM)
• Object Detection Algorithm
• Principal Component Analysus (PCA)
• Random Cut Forest
• Sequence2Sequence
• Xboost Algorithm

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fully managed
hosting with
auto-scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
BUILD TRAI N & TUNE DEPLOY
Hyperparamete
r optimization
End-to-end-encryption
End-to-end VPC support
Compliance and audit capabilities
Metadata and experiment management capabilities
Pay as you go
Build, train, tune, and host your own models
Amazon
SageMaker

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build, train, tune, and host your own models
Amazon
SageMaker One-click
training
TRAI N & TUNE
Hyperparamete
r optimization

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Fully managed
hosting with
auto-scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
BUILD TRAI N & TUNE DEPLOY
Hyperparamete
r optimization
End-to-end-encryption
End-to-end VPC support
Compliance and audit capabilities
Metadata and experiment management capabilities
Pay as you go
Build, train, tune, and host your own models
Amazon
SageMaker

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build, train, tune, and host your own models
Amazon
SageMaker Fully managed
hosting with
auto-scaling
One-click
deployment
DEPLOY

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Collect and
prepare
training data
Choose and
optimize
your ML algorithm
Set up and manage
environments for
training
Train and tune
model
(iterate, iterate)
Scale and manage
the production
environment
Deploy model
in production
Build, train, tune, and host your own models
Amazon
SageMaker

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“With Amazon SageMaker, we can accelerate our
Artificial Intelligence initiatives at scale by building and
deploying our algorithms on the platform. We will create
novel large-scale machine learning and AI algorithms and
deploy them on this platform to solve complex problems
that can power prosperity for our customers.“
- Ashok Srivastava, Chief Data Officer, Intuit
Amazon SageMaker

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“As the world’s leading provider of high-resolution Earth
imagery, data and analysis, DigitalGlobe works with enormous
amounts of data every day. DigitalGlobe is making it easier for
people to find, access, and run compute against our entire
100PB image library, which is stored in AWS’s cloud, to apply
deep learning to satellite imagery. We plan to use Amazon
SageMaker to train models against petabytes of Earth
observation imagery datasets using hosted Jupyter
notebooks, so DigitalGlobe's Geospatial Big Data Platform
(GBDX) users can just push a button, create a model, and
deploy it all within one scalable distributed environment at
scale.
”
- Dr. Walter Scott, CTO of Maxar Technologies and founder of
DigitalGlobe
Amazon SageMaker

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customer Success With Amazon SageMaker

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How do we put ML in the hands
of developers (literally)?

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DeepLens
The world’s first deep-learning
enabled video camera for developers

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DeepLens
Fully programmable video camera
Optimized for deep-learning on the device with
Apache MXNet, Caffe, TensorFlow
Tutorials, sample code, examples and pre-built models
Integrated with Amazon SageMaker for custom models
A deep learning-enabled video camera for developers

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deep learning models
run in real time on the device
Deploy pre-trained
educational models
Deploy custom models from
Amazon SageMaker
AWS DeepLens
How does it work?

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Stream live video back to AWS
Integrate with Lambda, SNS, SES, etc.
Video analytics with Rekognition Video
Sophisticated inference with
Amazon SageMaker hosted models
Deep learning models
run in real time on the device
AWS DeepLens
A deep learning-enabled video camera for developers

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Artistic Style Transfer Hot Dog/Not Hot Dog
Recognition
Object Recognition
AWS DeepLens
Project Templates

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
First Place Second Place Third Place
ReadToMe
Created by Alex Schultz
ReadToMe is a deep learning
enabled application that is able to
read books to kids. In this case,
reading Green Eggs and Ham, by
Dr. Seuss.
Dee
Created by Matthew Clark
Dee is a fun AWS DeepLens
interactive device for children. The
device asks children to answer
questions by showing a picture of
the answer.
SafeHaven
Created by Nathan Stone and Peter
McLean
SafeHaven uses Alexa and AWS
DeepLens to bring peace of mind for
vulnerable people and their families.
AWS DeepLens
2018 Hackaton Winners

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tens of thousands of customers running
Machine Learning on AWS

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data Lake Storage
Amazon S3
Security
Access Control
Encryption
VPC
KMS
Auditing
Compliance
Roles
Fine Grained Access Controls
Compute
Powerful GPU & CPU Instances
AWS Lambda
Analytics
Amazon Athena
Amazon EMR
Amazon Redshift & Redshift Spectrum
Broadest & Easiest to Use ML Platform with
the Most Customers

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!