Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Deep Learning
Christian S. Perone
Jun 2016
Convolutional
Neural Networks
Architectural Zoo
Who
Christian S. Perone
Machine Learning Engineer
Software Engineer
Blog
http://blog.christianperone.com
Open-source
http:...
Agenda
 Traditional Architectures
 Siamese Networks
 Dense Predictions
 Video
 Music Recommendation
 Localization, D...
Convolutional
Neural
Networks
Traditional
Architectures
1
Traditional Building Blocks
Three main building blocks:
– Convolutional
– Pooling
– Fully Connected (Dense)
Image by Liu e...
Traditional Building Blocks
The input data
Color Image
(RGB)
28 pixels (width)
28 pixels (height)
3 channels
(RGB)
Traditional Building Blocks
Convolutions
Animation by Vincent Dumoulin et al, 2016
Image by Apple
Traditional Building Blocks
Pooling
Images by Karpathy, cs2311 Stanford, 2016
Traditional Building Blocks
Fully Connected
Traditional Architecture
The canonical CNNs
Images by Rob Hess et al, 2016
Convolutional
Neural
Networks
Siamese
Networks
2
Architectural Zoo
The Siamese Architecture
Learning Hierarchies of Invariant Features. Yann LeCun.
Architectural Zoo
The Siamese Architecture
Learning visual similarity for product design with convolutional neural network...
Architectural Zoo
The Siamese Architecture
Learning visual similarity for product design with convolutional neural network...
Architectural Zoo
The Siamese Architecture
Learning visual similarity for product design with convolutional neural network...
Architectural Zoo
The Siamese Architecture
Learning Deep Representations for Ground-to-Aerial Geolocalization, Tsung-Yi Li...
Architectural Zoo
The Siamese Architecture
Learning Deep Representations for Ground-to-Aerial Geolocalization, Tsung-Yi Li...
Convolutional
Neural
Networks
Dense
Prediction
3
Architectural Zoo
Dense Prediction
Fully Convolutional Networks for Semantic Segmentation. Jonathan Long et al. 2015
Architectural Zoo
Dense Prediction
Fully Convolutional Networks for Semantic Segmentation. Jonathan Long et al. 2015
Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...
Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...
Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...
Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...
Architectural Zoo
Dense Prediction
Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup. Edgar Simo...
Architectural Zoo
Dense Prediction
Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup. Edgar Simo...
Convolutional
Neural
Networks
Video
4
Architectural Zoo
Video
Large-scale Video Classification with Convolutional Neural Networks . Andrej Karpathy. 2014
Architectural Zoo
Video
Large-scale Video Classification with Convolutional Neural Networks . Andrej Karpathy. 2014
Architectural Zoo
Video
Learning Spatiotemporal Features with 3D Convolutional Networks . Du Tran et al. 2015
Convolutional
Neural
Networks
Music
Recommendation
5
Architectural Zoo
Music Recommendation
Recommending music on Spotify with Deep Learning. Sander Dieleman. 2014.
Convolutional
Neural
Networks
Localization
Detection
Alignment
6
Architectural Zoo
Localization, Detection and Alignment
Rich feature hierarchies for accurate object detection and semanti...
Architectural Zoo
Localization, Detection and Alignment
Selective Search for Object Recognition. Uijlings et al. IJCV 2013
Architectural Zoo
Localization, Detection and Alignment
Fast R-CNN. Girschick et al. 2015.
Architectural Zoo
Localization, Detection and Alignment
Image by Fei-Fei Li & Andrej Karpathy & Justin Johnson. Cs231n, 20...
Architectural Zoo
Localization, Detection and Alignment
Faster R-CNN: Towards Real-Time Object Detection with Region Propo...
Architectural Zoo
Localization, Detection and Alignment
Right Whale Recognition Challenge, winner report. Robert Bogucki, ...
Architectural Zoo
Localization, Detection and Alignment
Spatial Transformer Networks. Max Jaderberg et al. 2015.
Upcoming SlideShare
Loading in …5
×

Deep Learning - Convolutional Neural Networks - Architectural Zoo

23,848 views

Published on

A overview over different Convolutional Neural Networks architectures used in Deep Learning.

Published in: Technology
  • Be the first to comment

Deep Learning - Convolutional Neural Networks - Architectural Zoo

  1. 1. Deep Learning Christian S. Perone Jun 2016 Convolutional Neural Networks Architectural Zoo
  2. 2. Who Christian S. Perone Machine Learning Engineer Software Engineer Blog http://blog.christianperone.com Open-source http://github.com/perone Twitter @tarantulae
  3. 3. Agenda  Traditional Architectures  Siamese Networks  Dense Predictions  Video  Music Recommendation  Localization, Detection, Alignment  Q & A
  4. 4. Convolutional Neural Networks Traditional Architectures 1
  5. 5. Traditional Building Blocks Three main building blocks: – Convolutional – Pooling – Fully Connected (Dense) Image by Liu et al, 2016 Architecture Overview
  6. 6. Traditional Building Blocks The input data Color Image (RGB) 28 pixels (width) 28 pixels (height) 3 channels (RGB)
  7. 7. Traditional Building Blocks Convolutions Animation by Vincent Dumoulin et al, 2016 Image by Apple
  8. 8. Traditional Building Blocks Pooling Images by Karpathy, cs2311 Stanford, 2016
  9. 9. Traditional Building Blocks Fully Connected
  10. 10. Traditional Architecture The canonical CNNs Images by Rob Hess et al, 2016
  11. 11. Convolutional Neural Networks Siamese Networks 2
  12. 12. Architectural Zoo The Siamese Architecture Learning Hierarchies of Invariant Features. Yann LeCun.
  13. 13. Architectural Zoo The Siamese Architecture Learning visual similarity for product design with convolutional neural networks, Sean Bell et al
  14. 14. Architectural Zoo The Siamese Architecture Learning visual similarity for product design with convolutional neural networks, Sean Bell et al
  15. 15. Architectural Zoo The Siamese Architecture Learning visual similarity for product design with convolutional neural networks, Sean Bell et al
  16. 16. Architectural Zoo The Siamese Architecture Learning Deep Representations for Ground-to-Aerial Geolocalization, Tsung-Yi Lin et al. 2016.
  17. 17. Architectural Zoo The Siamese Architecture Learning Deep Representations for Ground-to-Aerial Geolocalization, Tsung-Yi Lin et al. 2016.
  18. 18. Convolutional Neural Networks Dense Prediction 3
  19. 19. Architectural Zoo Dense Prediction Fully Convolutional Networks for Semantic Segmentation. Jonathan Long et al. 2015
  20. 20. Architectural Zoo Dense Prediction Fully Convolutional Networks for Semantic Segmentation. Jonathan Long et al. 2015
  21. 21. Architectural Zoo Dense Prediction Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification. Satoshi Iizuka et al. 2016
  22. 22. Architectural Zoo Dense Prediction Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification. Satoshi Iizuka et al. 2016
  23. 23. Architectural Zoo Dense Prediction Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification. Satoshi Iizuka et al. 2016
  24. 24. Architectural Zoo Dense Prediction Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification. Satoshi Iizuka et al. 2016
  25. 25. Architectural Zoo Dense Prediction Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup. Edgar Simo-Serra et al. 2016.
  26. 26. Architectural Zoo Dense Prediction Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup. Edgar Simo-Serra et al. 2016.
  27. 27. Convolutional Neural Networks Video 4
  28. 28. Architectural Zoo Video Large-scale Video Classification with Convolutional Neural Networks . Andrej Karpathy. 2014
  29. 29. Architectural Zoo Video Large-scale Video Classification with Convolutional Neural Networks . Andrej Karpathy. 2014
  30. 30. Architectural Zoo Video Learning Spatiotemporal Features with 3D Convolutional Networks . Du Tran et al. 2015
  31. 31. Convolutional Neural Networks Music Recommendation 5
  32. 32. Architectural Zoo Music Recommendation Recommending music on Spotify with Deep Learning. Sander Dieleman. 2014.
  33. 33. Convolutional Neural Networks Localization Detection Alignment 6
  34. 34. Architectural Zoo Localization, Detection and Alignment Rich feature hierarchies for accurate object detection and semantic segmentation. Girschick et al. 2014.
  35. 35. Architectural Zoo Localization, Detection and Alignment Selective Search for Object Recognition. Uijlings et al. IJCV 2013
  36. 36. Architectural Zoo Localization, Detection and Alignment Fast R-CNN. Girschick et al. 2015.
  37. 37. Architectural Zoo Localization, Detection and Alignment Image by Fei-Fei Li & Andrej Karpathy & Justin Johnson. Cs231n, 2016. Fast R-CNN. Girschick et al. 2015.
  38. 38. Architectural Zoo Localization, Detection and Alignment Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Ren et al. 2015. Image by Ross Girschick / Slide from CS231n, Fei-Fei & Andrej Karpathy & Justin Johnson. 2016.
  39. 39. Architectural Zoo Localization, Detection and Alignment Right Whale Recognition Challenge, winner report. Robert Bogucki, Deepsense.io. 2016.
  40. 40. Architectural Zoo Localization, Detection and Alignment Spatial Transformer Networks. Max Jaderberg et al. 2015.

×