Deep Learning - Convolutional Neural Networks - Architectural Zoo

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Deep Learning
Christian S. Perone
Jun 2016
Convolutional
Neural Networks
Architectural Zoo

Who
Christian S. Perone
Machine Learning Engineer
Software Engineer
Blog
http://blog.christianperone.com
Open-source
http:...

Agenda
 Traditional Architectures
 Siamese Networks
 Dense Predictions
 Video
 Music Recommendation
 Localization, D...

Convolutional
Neural
Networks
Traditional
Architectures
1

Traditional Building Blocks
Three main building blocks:
– Convolutional
– Pooling
– Fully Connected (Dense)
Image by Liu e...

Traditional Building Blocks
The input data
Color Image
(RGB)
28 pixels (width)
28 pixels (height)
3 channels
(RGB)

Traditional Building Blocks
Convolutions
Animation by Vincent Dumoulin et al, 2016
Image by Apple

Traditional Building Blocks
Pooling
Images by Karpathy, cs2311 Stanford, 2016

Traditional Building Blocks
Fully Connected

Traditional Architecture
The canonical CNNs
Images by Rob Hess et al, 2016

Convolutional
Neural
Networks
Siamese
Networks
2

Architectural Zoo
The Siamese Architecture
Learning Hierarchies of Invariant Features. Yann LeCun.

Architectural Zoo
The Siamese Architecture
Learning visual similarity for product design with convolutional neural network...

Architectural Zoo
The Siamese Architecture
Learning visual similarity for product design with convolutional neural network...

Architectural Zoo
The Siamese Architecture
Learning visual similarity for product design with convolutional neural network...

Architectural Zoo
The Siamese Architecture
Learning Deep Representations for Ground-to-Aerial Geolocalization, Tsung-Yi Li...

Architectural Zoo
The Siamese Architecture
Learning Deep Representations for Ground-to-Aerial Geolocalization, Tsung-Yi Li...

Convolutional
Neural
Networks
Dense
Prediction
3

Architectural Zoo
Dense Prediction
Fully Convolutional Networks for Semantic Segmentation. Jonathan Long et al. 2015

Architectural Zoo
Dense Prediction
Fully Convolutional Networks for Semantic Segmentation. Jonathan Long et al. 2015

Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...

Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...

Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...

Architectural Zoo
Dense Prediction
Let there be Color!: Joint End-to-end Learning of Global and Local Image Priors for Aut...

Architectural Zoo
Dense Prediction
Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup. Edgar Simo...

Architectural Zoo
Dense Prediction
Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup. Edgar Simo...

Convolutional
Neural
Networks
Video
4

Architectural Zoo
Video
Large-scale Video Classification with Convolutional Neural Networks . Andrej Karpathy. 2014

Architectural Zoo
Video
Large-scale Video Classification with Convolutional Neural Networks . Andrej Karpathy. 2014

Architectural Zoo
Video
Learning Spatiotemporal Features with 3D Convolutional Networks . Du Tran et al. 2015

Convolutional
Neural
Networks
Music
Recommendation
5

Architectural Zoo
Music Recommendation
Recommending music on Spotify with Deep Learning. Sander Dieleman. 2014.

Convolutional
Neural
Networks
Localization
Detection
Alignment
6

Architectural Zoo
Localization, Detection and Alignment
Rich feature hierarchies for accurate object detection and semanti...

Architectural Zoo
Localization, Detection and Alignment
Selective Search for Object Recognition. Uijlings et al. IJCV 2013

Architectural Zoo
Localization, Detection and Alignment
Fast R-CNN. Girschick et al. 2015.

Architectural Zoo
Localization, Detection and Alignment
Image by Fei-Fei Li & Andrej Karpathy & Justin Johnson. Cs231n, 20...

Architectural Zoo
Localization, Detection and Alignment
Faster R-CNN: Towards Real-Time Object Detection with Region Propo...

Architectural Zoo
Localization, Detection and Alignment
Right Whale Recognition Challenge, winner report. Robert Bogucki, ...

Architectural Zoo
Localization, Detection and Alignment
Spatial Transformer Networks. Max Jaderberg et al. 2015.

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

Deep Learning - Convolutional Neura... by Christian Perone 73544 views
Word Embeddings - Introduction by Christian Perone 20654 views
AI and the Future of Growth by Accenture Technology 427162 views

View on Slideshare

1 of 40 Ad

View on Slideshare

1 of 40 Ad