by Dan Romuald Mbanga, Business Development Manager, AWS Deep learning continues to push the state of the art in domains such as computer vision, natural language understanding and recommendation engines.  One of the key reasons for this progress is the availability of highly flexible and developer friendly deep learning frameworks. In this workshop, we will provide an overview of deep learning focusing on getting started with the TensorFlow and Keras frameworks on AWS. Level 100

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dan Romuald Mbanga
Business Development Manager
AI Platforms and Engines
Introduction to Deep Learning
@dmbanga

2. Thank You

3. A Flywheel For Data
More Data Better Analytics

4. A Flywheel For Data
More Data Better Analytics
Better Products

5. A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users

6. A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data

7. A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch

8. A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Artificial
Intelligence

9. A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Artificial
Intelligence
Pinpoint

10. AI: TL;DR

11. Fast Compute
Ubiquitous Data
Advanced Learning Algorithms

12. Artificial Intelligence At Amazon
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfilment &
Logistics
Enhance
Existing Products
Define New
Categories Of
Products
Bring Machine
Learning To All

17. • Applied Research
• Core Research
• Alexa
• Demand Forecasting
• Risk Analytics
• Search
• Recommendations
• AI Services | Rek, Lex, Polly
• Q&A Systems
• Supply Chain Optimization
• Advertising
• Machine Translation
• Video Content Analysis
• Robotics
• Lots of Computer Vision..
• NLP / NLU
Just a few Deep Learning Use Cases at Amazon…

18. Running AI In Production on AWS Today

19. Pinterest
Visual Search

20. Pinterest Lens

21. Recommendations & Ranking At Netflix
Personalized ranking,
page generation,
search, similarity, ratings
In 140 new countries,
simultaneously

22. Neural Style Transfer

23. Neural Style Transfer

24. Neural Style Transfer

25. Neural Style Transfer

26. Amazon AI
Intelligent Services Powered By Deep Learning

27. More in
2017
Infrastructure CPU
Engines MXNet TensorFlow Caffe Theano Pytorch CNTK
Services
Amazon Polly
Platforms
IoT
Speech
Mobile
Amazon
ML
Spark &
EMR
Kinesis Batch ECS
GPU
More in
2017
Chat
Amazon Lex
Amazon AI: Machine Learning In The Hands Of Every Developer
Amazon Rekognition
Vision

28. More in
2017
Infrastructure CPU
Engines MXNet TensorFlow Caffe Theano Pytorch CNTK
Services
Amazon Polly
Platforms
IoT
Speech
Mobile
Amazon
ML
Spark &
EMR
Kinesis Batch ECS
GPU
More in
2017
Chat
Amazon Lex
Amazon AI: Machine Learning In The Hands Of Every Developer
Amazon Rekognition
Vision

29. Solving Some Of The Hardest Problems In Computer Science
Learning Language Perception Problem
Solving
Reasoning

30. AWS Deep Learning AMI: One-Click GPU Deep Learning
Up To 40,000
CUDA Cores
Python 3 Notebooks
& Examples
(and others)(Volta at launch)
Scale for
Training
TensorFlow,
Apache MXNet

31. Train In The Cloud, Predict at the Edge
BigSmall Fast

32. Tensors
1994
1999
2003
2007
2009
Tensors
Neural Net
Train
Optimize
Scale
Input Data

33. Tensors
Neural Net
Train
Optimize
Scale
Input Data

34. Tensor
Neural Net
Train
Optimize
Scale
Input Data

35. Tensor
Neural Net
Train
Optimize
Scale
Input Data
Vanishing Gradient Problem
Other Optimizers

36. Tensor
Neural Net
Train
Optimize
Scale
Input Data
key-value store
Read Data Partitions
Pull the parameters
Compute the gradient
Push the gradient
Update the weights
Single MachineCluster

37. Tensor
Neural Net
Train
Optimize
Scale
Input Data
mxnet.io mxnet.io.recordio mxnet.image

38. “Sounds great, Dan!
How can we get started?”

39. Direct Connect
Collect & Organize Data
Kinesis Streams, Firehose,
Analytics
Upload

40. AWS Snowball Edge
100T Data Transport Device
With On-board Compute

41. Snowball Selfies: Customers Love AWS Snowball

43. Direct Connect
Kinesis
Snowball
Snowmobile
IoT
Database Migration
Streams, Firehose,
Analytics
Upload
Collect & Organize Data

44. Direct Connect
S3
Kinesis
Snowball
Snowmobile
IoT
Database Migration
DynamoDB
Elastic Search
Cloud Search
Glacier
RDS MySQL, PostgreSQL, MariaDB
Oracle, SQL Server
Aurora MySQL
PostgreSQL
Streams, Firehose,
Analytics
Upload
Collect & Organize Data

45. Direct Connect
S3
Kinesis
Snowball
Snowmobile
IoT
Database Migration
EC2
DynamoDB
EMR
Elastic Search
Cloud Search
Glacier
RDS MySQL, PostgreSQL, MariaDB
Oracle, SQL Server
Aurora MySQL
PostgreSQL
Streams, Firehose,
Analytics
Redshift & Spectrum
Athena
QuickSight
Upload
Amazon AI
Lambda
Collect & Organize Data

46. Direct Connect
S3
Kinesis
Snowball
Snowmobile
IoT
Database Migration
EC2
DynamoDB
EMR
Elastic Search
Cloud Search
Glacier
RDS MySQL, PostgreSQL, MariaDB
Oracle, SQL Server
Aurora MySQL
PostgreSQL
Streams, Firehose,
Analytics
Athena
QuickSight
Upload
Amazon AI
Lambda
Mech Turk
Glue
Collect & Organize Data
Redshift & Spectrum

47. Security & Encryption Integrated Across The Platform
Fine grained
access controls
Broad KMS
integration
Server-side
encryption
with CMK
Audit key
usage by
user & role
Import
keys
Policy
validation
& simulation

48. Code Walkthrough
Boston House Prices Estimate with Keras on Tensorflow

49. Thank you!
dmmbanga@amazon.com
THANK YOU!
@dmbanga