The document discusses various topics related to deep learning including programming languages used for deep learning like Python, Java, and Lua, what deep learning is and is not, common machine learning algorithms, training deep learning models, convolutional neural networks, popular deep learning models from 1998 to present, pre-trained models, links to deep learning resources, and data used to train autonomous vehicles.

1. Deep Learning
meetup
Protobuf/Lua (Caffe/Torch)
Python (TensorFlow)
Java (DeepLearning4J)

2. Programming vs ML

3. AI Landscape

4. Stage of AI

5. Deep Learning history

6. What is (not) DL
● Deep Learning is not GOFAI
● Deep Learning is different than ML
● Deep Learning doesn't mimic Brain
● Deep Learning is not Statistics
● Deep Learning is not Big Data
● Deep Learning is not made by Data Scientists
● Deep Learning is not ANN or MLP

7. ML algorithms

9. Training DL model

10. ConvNets
32
32
3
Convolution Layer
32x32x3 image
5x5x3 filter
convolve (slide) over all
spatial locations
activation
map
1
28
28

11. ConvNets
32
32
3
Convolution Layer
activation maps
6
28
For example, if we had 6 5x5 filters, we’ll get 6 separate activation maps:
We processed [32x32x3] volume into [28x28x6] volume.
Q: how many parameters are used ?
A: (5*5*3)*6 = 450 parameters, (5*5*3)*(28*28*6) = ~350K multiplies
28

13. ● InputLayer
● ConvLayer
● ReLuLayer
● PoolLayer
● FullyConnLayer
● SoftMaxLayer

14. Models
● LeNet - 1998
● AlexNet - ILSVRC 2012
● ZFNet - ILSVRC 2013
● GoogLeNet - ILSVRC 2014
● VGGNet - ILSVRC 2014
● ResNet - ILSVRC 2015
● ILSVRC 2016

15. Pre-trained Models

16. Karpathy
● Matlab is so 2012
● Caffe is so 2013
● Theano is so 2014
● Torch is so 2015
● TensorFlow is so 2016
● *PyTorch is so 2017

17. Links
● DL4J-examples
● Deep Learning Papers
● ConvNetJava
● NVIDIA DIGITS
● Darknet
● Awesome Deep Learning Papers
● Learning for Self-Driving Cars

18. Links v2
● Graphcore Poplar
● Dlib
● Udacity's Self-Driving Car Simulator
● DL4J Model Zoo
● Trained models for Keras
● DIGITS Object Detection
● DIGITS Semantic Segmentation

19. Data to train
● Auto Pilot
● Traffic Light Recognition
● Traffic Signs Recognition
● Lane Finding
● Object Recognition

20. Autonomous car
● Autopilot TensorFlow
● Udacity self-driving car
● CommaAI openpilot
● FUBAR Labs
● Nvidia Autopilot Keras GTA V
● Udacity self-driving car nanodegree
● Traffic Light Recognition
● Traffic Signs Recognition
● Quadcopter Navigation