AI & Machine Learning at Amazon: AWS Developer Workshop - Web Summit 2018 Amazon has been applying machine learning to create artifical intelligence features within its products and services for over 20 years. Join this session and learn about the application of ML and AI within Amazon, from retail product recommendations to the latest in natural language understanding, and how you can use easily accessible services from AWS to enable you to include AI features within your applications or build your own custom ML models for your own specific AI use cases. Speaker: Ian Massingham - Director, Technical Evangelist, AWS

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ian Massingham | AWS Developer Evangelism @IanMmmm
aws.amazon.com ianm@amazon.com
AI & Machine Learning
at Amazon

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fulfilment & logisticsAt Amazon,
we’ve been making
investments in ML for
the last 20 years…

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fulfilment & logistics
Search & discovery
At Amazon,
we’ve been making
investments in ML for
the last 20 years…

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fulfilment & logistics
Search & discovery
Existing products
At Amazon,
we’ve been making
investments in ML for
the last 20 years…

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fulfilment & logistics
Search & discovery
Existing products
New products
At Amazon,
we’ve been making
investments in ML for
the last 20 years…

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Put machine learning in the
hands of every developer
and data scientist
ML @ AWS:
OUR MISSION

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CUSTOMERS RUNNING MACHINE LEARNING ON AWS TODAY

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What are some of the
ML capabilities our customers are asking for?

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Amazon ML Stack
Platform Services
Application Services
Frameworks & Interfaces
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Amazon ML Stack
Platform Services
Application Services
Frameworks & Interfaces
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 P3 Instances
Up to eight NVIDIA Tesla V100 GPUs
1 PetaFLOP of computational performance – 14x better than P2
300 GB/s GPU-to-GPU communication (NVLink) – 9X better than P2
16GB GPU memory with 900 GB/sec peak GPU memory bandwidth
The fastest, most powerful GPU instances in the cloud

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Deep Learning AMI
Get started quickly with easy-to-launch tutorials
Hassle-free setup and configuration
Pay only for what you use – no additional charge for the AMI
Accelerate your model training and deployment
Support for popular deep learning frameworks

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Amazon ML Stack
Platform Services
Application Services
Frameworks & Interfaces
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine learning process is hard…
Data wrangling
Setup and manage
Notebook environments
Get data to notebooks securely
Experimentation
Setup and manage clusters
Scale/distribute ML
algorithms
Deployment
Setup and manage
inference clusters
Manage and auto scale
inference APIs
Testing, versioning,
and monitoring
Fetch data
Clean & format
data
Train model
Evaluate
model
Integrate with
prod
Monitor/
debug/refresh
Prepare &
transform data

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
6-18
months
…and time consuming
Fetch data
Clean & format
data
Prepare &
transform data
Train model
Evaluate
model
Integrate with
prod
Monitor/
debug/refresh

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
A managed service that provides
the quickest and easiest way
for your data scientists and developers to get
ML models from idea to production.

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
End-to-end machine
learning platform
Zero setup Flexible model training Pay by the
second
Amazon SageMaker
The quickest and easiest way to get ML models from idea to production

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
BuildPre-built notebook
instances
Highly-optimized
machine learning
algorithms

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Train
Amazon SageMaker
One-click training for
Ml, Dl, and custom
algorithms
Easier training with
hyperparameter
optimization
BuildPre-built notebook
instances
Highly-optimized
machine learning
algorithms

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Deploy
Amazon SageMaker
Train
One-click training for
Ml, Dl, and custom
algorithms
Easier training with
hyperparameter
optimization
BuildPre-built notebook
instances
Highly-optimized
machine learning
algorithms
Deployment without
engineering effort
Fully-managed
hosting at scale

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming
datasets, for
cheaper training
Train faster,
in a single
pass
Greater reliability
on extremely
large datasets
Choice of
several ML
algorithms
Amazon SageMaker
10x better algorithms

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customers using Amazon SageMaker

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Amazon ML Stack
Platform Services
Application Services
Frameworks & Interfaces
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Object and scene
Detection
Facial
analysis
Face
comparison
Facial
recognition
Celebrity
recognition
Image
moderation
Amazon Rekognition Image
Deep learning-based image analysis service

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Image
Customers

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Rekognition Video
Object and activity
detection
Person
tracking
Face
recognition
Real-time live
stream
Content
moderation
Celebrity
recognition
Video analysis

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Amazon ML Stack
Platform Services
Application Services
Frameworks & Interfaces
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly
Use Cases
Content Creation
Mobile & Desktop Applications
Internet of Things (IoT)
Education & E-Learning
Telephony
Game Development
Key Features
52 Voices across 25 languages
Lip-Syncing & Text Highlighting
Fine-grained Voice Control
Custom Vocabularies
Available in 14 AWS regions

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Polly Customers

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Platform Services
Application Services
Frameworks & Interfaces
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex
Data Lake Storage
Amazon S3
Security
Access Control
Encryption
Compute
Powerful GPU & CPU Instances
AWS Lambda
Analytics
Amazon Athena
Amazon EMR
Amazon Redshift & Redshift Spectrum
Broadest & Easiest to Use ML Platform with the Most Customers

37. AMAZON CONFIDENTIAL
Remember to opt-in to AWS
communications & you will receive a
post-event email with a link to:
• AWS Developer Workshop Slides
• $200 in AWS Credits
Did we scan your badge?

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ian Massingham | AWS Developer Evangelism @IanMmmm
aws.amazon.com ianm@amazon.com
Thank You
Learn more @ ml.aws