Collision Conference 2018 - AWS Developer Workshop Deep Learning for Developers: Julien Simon

1. Deep Learning for Developers
Julien Simon
Principal Evangelist, Artificial Intelligence & Machine Learning
@julsimon
April 2018

2. What to expect
• An introduction to Apache MXNet
• Demos
• Resources

3. Apache MXNet

4. Apache MXNet: Open Source library for Deep Learning
Programmable Portable High Performance
Near linear scaling
across hundreds of
GPUs
Highly efficient
models for
mobile
and IoT
Simple syntax,
multiple
languages
Most Open Best On AWS
Optimized for
Deep Learning on AWS
Accepted into the
Apache Incubator
MXNet 1.0 released on December 4th

5. Input Output
1 1 1
1 0 1
0 0 0
3
mx.sym.Convolution(data, kernel=(5,5), num_filter=20)
mx.sym.Pooling(data, pool_type="max", kernel=(2,2),
stride=(2,2)
lstm.lstm_unroll(num_lstm_layer, seq_len, len, num_hidden, num_embed)
4 2
2 0
4=Max
1
3
...
4
0.2
-0.1
...
0.7
mx.sym.FullyConnected(data, num_hidden=128)
2
mx.symbol.Embedding(data, input_dim, output_dim = k)
0.2
-0.1
...
0.7
Queen
4 2
2 0
2=Avg
Input Weights
cos(w, queen) = cos(w, king) - cos(w, man) + cos(w, woman)
mx.sym.Activation(data, act_type="xxxx")
"relu"
"tanh"
"sigmoid"
"softrelu"
Neural Art
Face Search
Image Segmentation
Image Caption
“People Riding
Bikes”
Bicycle, People,
Road, Sport
Image Labels
Image
Video
Speech
Text
“People Riding
Bikes”
Machine Translation
“Οι άνθρωποι
ιππασίας ποδήλατα”
Events
mx.model.FeedForward model.fit
mx.sym.SoftmaxOutput

6. https://github.com/awslabs/mxnet-model-server/

7. https://aws.amazon.com/blogs/ai/announcing-onnx-support-for-apache-mxnet/

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Apache MXNet API
• Storing and accessing data in multi-dimensional arrays
àNDArray API
• Building models (layers, weights, activation functions)
à Symbol API ‘define-then-run’
à Gluon API ‘define-by-run’
• Serving data during training and validation
à Iterators
• Training and using models
à Module API

9. Demos
https://github.com/juliensimon/dlnotebooks
https://github.com/juliensimon/aws/tree/master/mxnet

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Resources
https://aws.amazon.com/machine-learning
https://aws.amazon.com/blogs/ai
https://mxnet.incubator.apache.org
https://github.com/apache/incubator-mxnet
https://github.com/gluon-api
https://medium.com/@julsimon

12. Thank you!
Julien Simon
Principal Evangelist, Artificial Intelligence & Machine Learning
@julsimon