SlideShare a Scribd company logo
Anil Kumar Gupta
Senior Software Engineer
LinkedIn
Image Classification
3
Outline
Why Image Classification?
Classical Method of Image classification
Convolution in Images
Deep convolutional neural networks
Success of DCNN on MNIST
ImageNet Challenge
Success of DCNN on ImageNet
What DCNN learns
DCNN on limited dataset
Caffe Introduction
Result of our dataset
References and Resources
4
Why Image Classification
Introduced Group posts with Images
Solutions:
a) Let all Post with Images go through human review
b) Small fraction of post go to human review. This fraction should include any
obscene image posted
5
Classical Method of Image classification
Compute bag of features
Bag of features are computed using different Image processing techniques
Smoothing
Derivatives of image
Blob detection
HOG
SIFT
……
……
Learn some ML model on these features
6
Convolution in Images
Compute bag of features
Bag of features are computed using different Image processing techniques
Smoothing
Derivatives of image
Blob detection
HOG
SIFT
……
……
Learn some ML model on these features
7
Convolution in Images
8
9
Convolutional Neural network
10
Success of DCNN on MNIST (LeNet 1998)
Source: Gradient Based Learning Applied to document Recognition
11
Source: Gradient Based Learning Applied to document Recognition
12
Ciresan et. al. net on MNIST (2010)
Used lots of synthetic data to
train bigger net
Used Model averaging
The right answer is almost
always in the top 2 guesses.
Source: Handwritten Digit
Recognition with a Committee
of Deep Neural Nets on GPUs
13
ImageNet Challenge (2012)
The dataset has 1.2 million high-resolution training images.
The classification task:
Get the “correct” class in your top 5 bets. There are 1000 classes.
Some of the best existing computer vision methods were tried on this dataset by
leading computer vision groups from Oxford, INRIA, XRCE, …
14
ImageNet Challenge Results (2012)
University of Tokyo 26.1%
Oxford University Computer Vision Group 26.9%
INRIA (French national research institute in CS)
+ XRCE (Xerox Research Center Europe) 27.0%
University of Amsterdam 29.5%
University of Toronto (Alex Krizhevsky) 16.4 %
15
ImageNet Challenge Results (2012)
Why so many years for another successful result by DCNN ?
16
Success of DCNN on ImageNet (AlexNet 2012)
Source: ImageNet Classification with Deep Convolutional Neural Networks
17
18
AlexNet (2012)
Use of GPUs to train the network
Use of Data Augmentation
Use of ReLU instead of Sigmoid
Use of DropOut Layers
19
ImageNet Results 2010 - 2015
20
What CNN learns
Source: Rich feature hierarchies for accurate object detection and semantic
segmentation
21
DCNN on limited dataset
CNN learns hierarchical features
Goes from generic features to task specific features
Can use generic feature learned on different task for your specific task
How transferable are features in deep neural networks?
Learning and Transferring Mid-Level Image Representations using Convolutional
Neural Networks
Monza: Image Classification of Vehicle Make and Model Using Convolutional Neural
Networks and Transfer Learning
Rich feature hierarchies for accurate object detection and semantic segmentation
22
Caffe
A DNN library
Let you define DNN architecture in plain text file
Let you define parameters in plain text file
Can train on GPU and CPU
Can train on GPU and deploy in CPU
23
Layer
Setup: run once for initialization.
Forward: make output given input.
Backward: make gradient of output
- w.r.t. bottom
- w.r.t. parameters (if needed)
Reshape: set dimensions.
24
Loss
Classification:
SoftmaxWithLoss
HingeLoss
Linear Regression:
EuclideanLoss
Multiclassification:
SigmoidCrossEntropyLoss
Others…
loss (LOSS_TYPE)
25
Blob
Blobs are 4-D arrays for storing and communicating information.
hold data, derivatives, and parameters
lazily allocate memory
shuttle between CPU and GPU
top
blob
bottom blob
26
Our results from Transfer learning
Training image: 5872
Good: 3075 Bad: 2797
Validation images: 1679
Good: 880 Bad: 799
Test images: 831
Good: 436 Bad: 395
Precision ~ 95%
Recall ~ 95%
27
In Production
Bad images is ~ 1 in 1000
5 - 7 % send for human review
Have not received any bad image post via user flagging
Latency ~ 600 ms per image
5-6 QPS on single machine
28
Reference & Resources
Gradient Based Learning Applied to document Recognition
Handwritten Digit Recognition with a Committee of Deep Neural Nets on GPUs
ImageNet Classification with Deep Convolutional Neural Networks
Rich feature hierarchies for accurate object detection and semantic segmentation
How transferable are features in deep neural networks?
Learning and Transferring Mid-Level Image Representations using Convolutional Neural
Networks
Monza: Image Classification of Vehicle Make and Model Using Convolutional Neural
Networks and Transfer Learning
Dropout: A Simple Way to Prevent Neural Networks from Overfitting
Mathematical Intuition for Performance of Rectified Linear Unit in Deep Neural Networks
Convolutional Neural Network for Visual Recognition
Neural Networks for Machine Learning
Practical Recommendation for Train DNN
©2014 LinkedIn Corporation. All Rights Reserved.©2014 LinkedIn Corporation. All Rights Reserved.

More Related Content

What's hot

深度學習在AOI的應用
深度學習在AOI的應用深度學習在AOI的應用
深度學習在AOI的應用
CHENHuiMei
 
Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018
Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018
Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018
Universitat Politècnica de Catalunya
 
Devil in the Details: Analysing the Performance of ConvNet Features
Devil in the Details: Analysing the Performance of ConvNet FeaturesDevil in the Details: Analysing the Performance of ConvNet Features
Devil in the Details: Analysing the Performance of ConvNet Features
Ken Chatfield
 
Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...
Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...
Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...
Fellowship at Vodafone FutureLab
 
Review : Rethinking Pre-training and Self-training
Review : Rethinking Pre-training and Self-trainingReview : Rethinking Pre-training and Self-training
Review : Rethinking Pre-training and Self-training
Dongmin Choi
 
Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]
Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]
Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]
Dongmin Choi
 
Image segmentation hj_cho
Image segmentation hj_choImage segmentation hj_cho
Image segmentation hj_cho
Hyungjoo Cho
 
ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]
Dongmin Choi
 
LeNet to ResNet
LeNet to ResNetLeNet to ResNet
LeNet to ResNet
Somnath Banerjee
 
Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)
Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)
Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)
Universitat Politècnica de Catalunya
 
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
Edge AI and Vision Alliance
 
AI & ML in Defence Systems - Sunil Chomal
AI & ML in Defence Systems   - Sunil ChomalAI & ML in Defence Systems   - Sunil Chomal
AI & ML in Defence Systems - Sunil Chomal
Sunil Chomal
 
Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017
Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017
Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017
Universitat Politècnica de Catalunya
 
更適應性的AOI-深度強化學習之應用
更適應性的AOI-深度強化學習之應用更適應性的AOI-深度強化學習之應用
更適應性的AOI-深度強化學習之應用
CHENHuiMei
 
A brief introduction to recent segmentation methods
A brief introduction to recent segmentation methodsA brief introduction to recent segmentation methods
A brief introduction to recent segmentation methods
Shunta Saito
 
Transformer in Computer Vision
Transformer in Computer VisionTransformer in Computer Vision
Transformer in Computer Vision
Dongmin Choi
 
Lecture3 xing fei-fei
Lecture3 xing fei-feiLecture3 xing fei-fei
Lecture3 xing fei-fei
Tianlu Wang
 
Meetup 18/10/2018 - Artificiële intelligentie en mobiliteit
Meetup 18/10/2018 - Artificiële intelligentie en mobiliteitMeetup 18/10/2018 - Artificiële intelligentie en mobiliteit
Meetup 18/10/2018 - Artificiële intelligentie en mobiliteit
Digipolis Antwerpen
 
AI&BigData Lab. Артем Чернодуб "Распознавание изображений методом Lazy Deep ...
AI&BigData Lab. Артем Чернодуб  "Распознавание изображений методом Lazy Deep ...AI&BigData Lab. Артем Чернодуб  "Распознавание изображений методом Lazy Deep ...
AI&BigData Lab. Артем Чернодуб "Распознавание изображений методом Lazy Deep ...
GeeksLab Odessa
 
Comparison of Matrix Completion Algorithms for Background Initialization in V...
Comparison of Matrix Completion Algorithms for Background Initialization in V...Comparison of Matrix Completion Algorithms for Background Initialization in V...
Comparison of Matrix Completion Algorithms for Background Initialization in V...
ActiveEon
 

What's hot (20)

深度學習在AOI的應用
深度學習在AOI的應用深度學習在AOI的應用
深度學習在AOI的應用
 
Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018
Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018
Medical Imaging at DCU - Kevin McGuinness - UPC Barcelona 2018
 
Devil in the Details: Analysing the Performance of ConvNet Features
Devil in the Details: Analysing the Performance of ConvNet FeaturesDevil in the Details: Analysing the Performance of ConvNet Features
Devil in the Details: Analysing the Performance of ConvNet Features
 
Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...
Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...
Deep Learning based Segmentation Pipeline for Label-Free Phase-Contrast Micro...
 
Review : Rethinking Pre-training and Self-training
Review : Rethinking Pre-training and Self-trainingReview : Rethinking Pre-training and Self-training
Review : Rethinking Pre-training and Self-training
 
Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]
Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]
Review : Multi-Domain Image Completion for Random Missing Input Data [cdm]
 
Image segmentation hj_cho
Image segmentation hj_choImage segmentation hj_cho
Image segmentation hj_cho
 
ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]
 
LeNet to ResNet
LeNet to ResNetLeNet to ResNet
LeNet to ResNet
 
Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)
Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)
Deep convnets for global recognition (Master in Computer Vision Barcelona 2016)
 
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
 
AI & ML in Defence Systems - Sunil Chomal
AI & ML in Defence Systems   - Sunil ChomalAI & ML in Defence Systems   - Sunil Chomal
AI & ML in Defence Systems - Sunil Chomal
 
Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017
Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017
Deep Visual Saliency - Kevin McGuinness - UPC Barcelona 2017
 
更適應性的AOI-深度強化學習之應用
更適應性的AOI-深度強化學習之應用更適應性的AOI-深度強化學習之應用
更適應性的AOI-深度強化學習之應用
 
A brief introduction to recent segmentation methods
A brief introduction to recent segmentation methodsA brief introduction to recent segmentation methods
A brief introduction to recent segmentation methods
 
Transformer in Computer Vision
Transformer in Computer VisionTransformer in Computer Vision
Transformer in Computer Vision
 
Lecture3 xing fei-fei
Lecture3 xing fei-feiLecture3 xing fei-fei
Lecture3 xing fei-fei
 
Meetup 18/10/2018 - Artificiële intelligentie en mobiliteit
Meetup 18/10/2018 - Artificiële intelligentie en mobiliteitMeetup 18/10/2018 - Artificiële intelligentie en mobiliteit
Meetup 18/10/2018 - Artificiële intelligentie en mobiliteit
 
AI&BigData Lab. Артем Чернодуб "Распознавание изображений методом Lazy Deep ...
AI&BigData Lab. Артем Чернодуб  "Распознавание изображений методом Lazy Deep ...AI&BigData Lab. Артем Чернодуб  "Распознавание изображений методом Lazy Deep ...
AI&BigData Lab. Артем Чернодуб "Распознавание изображений методом Lazy Deep ...
 
Comparison of Matrix Completion Algorithms for Background Initialization in V...
Comparison of Matrix Completion Algorithms for Background Initialization in V...Comparison of Matrix Completion Algorithms for Background Initialization in V...
Comparison of Matrix Completion Algorithms for Background Initialization in V...
 

Viewers also liked

Obscenity and Indecency
Obscenity and IndecencyObscenity and Indecency
Obscenity and IndecencyMiriam Smith
 
Cybercrimes (Against Children)
Cybercrimes (Against Children)Cybercrimes (Against Children)
Cybercrimes (Against Children)
Can R. PAHALI
 
Criminal justice against child pornography
Criminal justice against child pornographyCriminal justice against child pornography
Criminal justice against child pornography
A Oneessays
 
Cyber crime against children
Cyber crime against childrenCyber crime against children
Cyber crime against children
Anchalanshri Dixit
 
Libel/Defamation/Slander
Libel/Defamation/SlanderLibel/Defamation/Slander
Libel/Defamation/SlanderTamannaAli
 
El Materialista
El MaterialistaEl Materialista
El Materialista
megajimysito
 
Un Doctor En El Cielo
Un Doctor En El CieloUn Doctor En El Cielo
Un Doctor En El Cielo
megajimysito
 
Stephania hurtado4
Stephania hurtado4Stephania hurtado4
Stephania hurtado4
Laura265
 
ppt on child pornography and cyber crime
ppt on child pornography and cyber crimeppt on child pornography and cyber crime
ppt on child pornography and cyber crime
008_Anuj
 
Billy d
Billy dBilly d
Billy d
billydeansdot
 
Indecent photo morphings on facebook
Indecent photo morphings on facebookIndecent photo morphings on facebook
Indecent photo morphings on facebook
cyber advocate
 
Presentation
PresentationPresentation
Presentation
bethany1996
 
MUJER
MUJERMUJER
MUJERAlyla
 
Analysing moving image
Analysing moving imageAnalysing moving image
Analysing moving imagedavid-rowland
 
MUJER LATINA - Poema
MUJER LATINA - PoemaMUJER LATINA - Poema
MUJER LATINA - PoemaAlyla
 
Privacy issues and internet privacy
Privacy issues and internet privacyPrivacy issues and internet privacy
Privacy issues and internet privacyvinyas87
 
Pop music video – audience research
Pop music video – audience researchPop music video – audience research
Pop music video – audience researchEthan Burton
 
Representation of women in music videos
Representation of women in music videosRepresentation of women in music videos
Representation of women in music videos
Ruth Ellen
 

Viewers also liked (20)

Obscenity on the Web
Obscenity on the WebObscenity on the Web
Obscenity on the Web
 
Obscenity and Indecency
Obscenity and IndecencyObscenity and Indecency
Obscenity and Indecency
 
Cybercrimes (Against Children)
Cybercrimes (Against Children)Cybercrimes (Against Children)
Cybercrimes (Against Children)
 
Criminal justice against child pornography
Criminal justice against child pornographyCriminal justice against child pornography
Criminal justice against child pornography
 
Cyber crime against children
Cyber crime against childrenCyber crime against children
Cyber crime against children
 
Libel/Defamation/Slander
Libel/Defamation/SlanderLibel/Defamation/Slander
Libel/Defamation/Slander
 
El Materialista
El MaterialistaEl Materialista
El Materialista
 
Un Doctor En El Cielo
Un Doctor En El CieloUn Doctor En El Cielo
Un Doctor En El Cielo
 
Stephania hurtado4
Stephania hurtado4Stephania hurtado4
Stephania hurtado4
 
Laws on mass media
Laws on mass mediaLaws on mass media
Laws on mass media
 
ppt on child pornography and cyber crime
ppt on child pornography and cyber crimeppt on child pornography and cyber crime
ppt on child pornography and cyber crime
 
Billy d
Billy dBilly d
Billy d
 
Indecent photo morphings on facebook
Indecent photo morphings on facebookIndecent photo morphings on facebook
Indecent photo morphings on facebook
 
Presentation
PresentationPresentation
Presentation
 
MUJER
MUJERMUJER
MUJER
 
Analysing moving image
Analysing moving imageAnalysing moving image
Analysing moving image
 
MUJER LATINA - Poema
MUJER LATINA - PoemaMUJER LATINA - Poema
MUJER LATINA - Poema
 
Privacy issues and internet privacy
Privacy issues and internet privacyPrivacy issues and internet privacy
Privacy issues and internet privacy
 
Pop music video – audience research
Pop music video – audience researchPop music video – audience research
Pop music video – audience research
 
Representation of women in music videos
Representation of women in music videosRepresentation of women in music videos
Representation of women in music videos
 

Similar to Obscenity Detection in Images

Learn to Build an App to Find Similar Images using Deep Learning- Piotr Teterwak
Learn to Build an App to Find Similar Images using Deep Learning- Piotr TeterwakLearn to Build an App to Find Similar Images using Deep Learning- Piotr Teterwak
Learn to Build an App to Find Similar Images using Deep Learning- Piotr Teterwak
PyData
 
Report face recognition : ArganRecogn
Report face recognition :  ArganRecognReport face recognition :  ArganRecogn
Report face recognition : ArganRecogn
Ilyas CHAOUA
 
Rapid object detection using boosted cascade of simple features
Rapid object detection using boosted  cascade of simple featuresRapid object detection using boosted  cascade of simple features
Rapid object detection using boosted cascade of simple featuresHirantha Pradeep
 
小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵
小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵
小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵
CHENHuiMei
 
Transfer Learning and Fine-tuning Deep Neural Networks
 Transfer Learning and Fine-tuning Deep Neural Networks Transfer Learning and Fine-tuning Deep Neural Networks
Transfer Learning and Fine-tuning Deep Neural Networks
PyData
 
230208 MLOps Getting from Good to Great.pptx
230208 MLOps Getting from Good to Great.pptx230208 MLOps Getting from Good to Great.pptx
230208 MLOps Getting from Good to Great.pptx
Arthur240715
 
Scene recognition using Convolutional Neural Network
Scene recognition using Convolutional Neural NetworkScene recognition using Convolutional Neural Network
Scene recognition using Convolutional Neural Network
DhirajGidde
 
Android Malware 2020 (CCCS-CIC-AndMal-2020)
Android Malware 2020 (CCCS-CIC-AndMal-2020)Android Malware 2020 (CCCS-CIC-AndMal-2020)
Android Malware 2020 (CCCS-CIC-AndMal-2020)
Indraneel Dabhade
 
Deep learning: Cutting through the Myths and Hype
Deep learning: Cutting through the Myths and HypeDeep learning: Cutting through the Myths and Hype
Deep learning: Cutting through the Myths and Hype
Siby Jose Plathottam
 
Region-oriented Convolutional Networks for Object Retrieval
Region-oriented Convolutional Networks for Object RetrievalRegion-oriented Convolutional Networks for Object Retrieval
Region-oriented Convolutional Networks for Object Retrieval
Universitat Politècnica de Catalunya
 
Image super resolution using Generative Adversarial Network.
Image super resolution using Generative Adversarial Network.Image super resolution using Generative Adversarial Network.
Image super resolution using Generative Adversarial Network.
IRJET Journal
 
Deep learning in Computer Vision
Deep learning in Computer VisionDeep learning in Computer Vision
Deep learning in Computer Vision
David Dao
 
DSDT meetup July 2021
DSDT meetup July 2021DSDT meetup July 2021
DSDT meetup July 2021
DSDT_MTL
 
Image De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural NetworkImage De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural Network
aciijournal
 
IMAGE DE-NOISING USING DEEP NEURAL NETWORK
IMAGE DE-NOISING USING DEEP NEURAL NETWORKIMAGE DE-NOISING USING DEEP NEURAL NETWORK
IMAGE DE-NOISING USING DEEP NEURAL NETWORK
aciijournal
 
Image De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural NetworkImage De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural Network
aciijournal
 
Avihu Efrat's Viola and Jones face detection slides
Avihu Efrat's Viola and Jones face detection slidesAvihu Efrat's Viola and Jones face detection slides
Avihu Efrat's Viola and Jones face detection slides
wolf
 
IRJET- Identification of Scene Images using Convolutional Neural Networks - A...
IRJET- Identification of Scene Images using Convolutional Neural Networks - A...IRJET- Identification of Scene Images using Convolutional Neural Networks - A...
IRJET- Identification of Scene Images using Convolutional Neural Networks - A...
IRJET Journal
 
Can AI say from our eyes when we read relevant information?
Can AI say from our eyes when we read relevant information?Can AI say from our eyes when we read relevant information?
Can AI say from our eyes when we read relevant information?
Nilavra Bhattacharya
 

Similar to Obscenity Detection in Images (20)

Learn to Build an App to Find Similar Images using Deep Learning- Piotr Teterwak
Learn to Build an App to Find Similar Images using Deep Learning- Piotr TeterwakLearn to Build an App to Find Similar Images using Deep Learning- Piotr Teterwak
Learn to Build an App to Find Similar Images using Deep Learning- Piotr Teterwak
 
MultiModal Retrieval Image
MultiModal Retrieval ImageMultiModal Retrieval Image
MultiModal Retrieval Image
 
Report face recognition : ArganRecogn
Report face recognition :  ArganRecognReport face recognition :  ArganRecogn
Report face recognition : ArganRecogn
 
Rapid object detection using boosted cascade of simple features
Rapid object detection using boosted  cascade of simple featuresRapid object detection using boosted  cascade of simple features
Rapid object detection using boosted cascade of simple features
 
小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵
小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵
小數據如何實現電腦視覺,微軟AI研究首席剖析關鍵
 
Transfer Learning and Fine-tuning Deep Neural Networks
 Transfer Learning and Fine-tuning Deep Neural Networks Transfer Learning and Fine-tuning Deep Neural Networks
Transfer Learning and Fine-tuning Deep Neural Networks
 
230208 MLOps Getting from Good to Great.pptx
230208 MLOps Getting from Good to Great.pptx230208 MLOps Getting from Good to Great.pptx
230208 MLOps Getting from Good to Great.pptx
 
Scene recognition using Convolutional Neural Network
Scene recognition using Convolutional Neural NetworkScene recognition using Convolutional Neural Network
Scene recognition using Convolutional Neural Network
 
Android Malware 2020 (CCCS-CIC-AndMal-2020)
Android Malware 2020 (CCCS-CIC-AndMal-2020)Android Malware 2020 (CCCS-CIC-AndMal-2020)
Android Malware 2020 (CCCS-CIC-AndMal-2020)
 
Deep learning: Cutting through the Myths and Hype
Deep learning: Cutting through the Myths and HypeDeep learning: Cutting through the Myths and Hype
Deep learning: Cutting through the Myths and Hype
 
Region-oriented Convolutional Networks for Object Retrieval
Region-oriented Convolutional Networks for Object RetrievalRegion-oriented Convolutional Networks for Object Retrieval
Region-oriented Convolutional Networks for Object Retrieval
 
Image super resolution using Generative Adversarial Network.
Image super resolution using Generative Adversarial Network.Image super resolution using Generative Adversarial Network.
Image super resolution using Generative Adversarial Network.
 
Deep learning in Computer Vision
Deep learning in Computer VisionDeep learning in Computer Vision
Deep learning in Computer Vision
 
DSDT meetup July 2021
DSDT meetup July 2021DSDT meetup July 2021
DSDT meetup July 2021
 
Image De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural NetworkImage De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural Network
 
IMAGE DE-NOISING USING DEEP NEURAL NETWORK
IMAGE DE-NOISING USING DEEP NEURAL NETWORKIMAGE DE-NOISING USING DEEP NEURAL NETWORK
IMAGE DE-NOISING USING DEEP NEURAL NETWORK
 
Image De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural NetworkImage De-Noising Using Deep Neural Network
Image De-Noising Using Deep Neural Network
 
Avihu Efrat's Viola and Jones face detection slides
Avihu Efrat's Viola and Jones face detection slidesAvihu Efrat's Viola and Jones face detection slides
Avihu Efrat's Viola and Jones face detection slides
 
IRJET- Identification of Scene Images using Convolutional Neural Networks - A...
IRJET- Identification of Scene Images using Convolutional Neural Networks - A...IRJET- Identification of Scene Images using Convolutional Neural Networks - A...
IRJET- Identification of Scene Images using Convolutional Neural Networks - A...
 
Can AI say from our eyes when we read relevant information?
Can AI say from our eyes when we read relevant information?Can AI say from our eyes when we read relevant information?
Can AI say from our eyes when we read relevant information?
 

Recently uploaded

Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
JoytuBarua2
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
addressing modes in computer architecture
addressing modes  in computer architectureaddressing modes  in computer architecture
addressing modes in computer architecture
ShahidSultan24
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
AhmedHussein950959
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
Kamal Acharya
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Teleport Manpower Consultant
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
Robbie Edward Sayers
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.
PrashantGoswami42
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation & Control
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
Kamal Acharya
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
DuvanRamosGarzon1
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
Jayaprasanna4
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
Pipe Restoration Solutions
 

Recently uploaded (20)

Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
addressing modes in computer architecture
addressing modes  in computer architectureaddressing modes  in computer architecture
addressing modes in computer architecture
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
 
Final project report on grocery store management system..pdf
Final project report on grocery store management system..pdfFinal project report on grocery store management system..pdf
Final project report on grocery store management system..pdf
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
 

Obscenity Detection in Images

  • 1.
  • 2. Anil Kumar Gupta Senior Software Engineer LinkedIn Image Classification
  • 3. 3 Outline Why Image Classification? Classical Method of Image classification Convolution in Images Deep convolutional neural networks Success of DCNN on MNIST ImageNet Challenge Success of DCNN on ImageNet What DCNN learns DCNN on limited dataset Caffe Introduction Result of our dataset References and Resources
  • 4. 4 Why Image Classification Introduced Group posts with Images Solutions: a) Let all Post with Images go through human review b) Small fraction of post go to human review. This fraction should include any obscene image posted
  • 5. 5 Classical Method of Image classification Compute bag of features Bag of features are computed using different Image processing techniques Smoothing Derivatives of image Blob detection HOG SIFT …… …… Learn some ML model on these features
  • 6. 6 Convolution in Images Compute bag of features Bag of features are computed using different Image processing techniques Smoothing Derivatives of image Blob detection HOG SIFT …… …… Learn some ML model on these features
  • 8. 8
  • 10. 10 Success of DCNN on MNIST (LeNet 1998) Source: Gradient Based Learning Applied to document Recognition
  • 11. 11 Source: Gradient Based Learning Applied to document Recognition
  • 12. 12 Ciresan et. al. net on MNIST (2010) Used lots of synthetic data to train bigger net Used Model averaging The right answer is almost always in the top 2 guesses. Source: Handwritten Digit Recognition with a Committee of Deep Neural Nets on GPUs
  • 13. 13 ImageNet Challenge (2012) The dataset has 1.2 million high-resolution training images. The classification task: Get the “correct” class in your top 5 bets. There are 1000 classes. Some of the best existing computer vision methods were tried on this dataset by leading computer vision groups from Oxford, INRIA, XRCE, …
  • 14. 14 ImageNet Challenge Results (2012) University of Tokyo 26.1% Oxford University Computer Vision Group 26.9% INRIA (French national research institute in CS) + XRCE (Xerox Research Center Europe) 27.0% University of Amsterdam 29.5% University of Toronto (Alex Krizhevsky) 16.4 %
  • 15. 15 ImageNet Challenge Results (2012) Why so many years for another successful result by DCNN ?
  • 16. 16 Success of DCNN on ImageNet (AlexNet 2012) Source: ImageNet Classification with Deep Convolutional Neural Networks
  • 17. 17
  • 18. 18 AlexNet (2012) Use of GPUs to train the network Use of Data Augmentation Use of ReLU instead of Sigmoid Use of DropOut Layers
  • 20. 20 What CNN learns Source: Rich feature hierarchies for accurate object detection and semantic segmentation
  • 21. 21 DCNN on limited dataset CNN learns hierarchical features Goes from generic features to task specific features Can use generic feature learned on different task for your specific task How transferable are features in deep neural networks? Learning and Transferring Mid-Level Image Representations using Convolutional Neural Networks Monza: Image Classification of Vehicle Make and Model Using Convolutional Neural Networks and Transfer Learning Rich feature hierarchies for accurate object detection and semantic segmentation
  • 22. 22 Caffe A DNN library Let you define DNN architecture in plain text file Let you define parameters in plain text file Can train on GPU and CPU Can train on GPU and deploy in CPU
  • 23. 23 Layer Setup: run once for initialization. Forward: make output given input. Backward: make gradient of output - w.r.t. bottom - w.r.t. parameters (if needed) Reshape: set dimensions.
  • 25. 25 Blob Blobs are 4-D arrays for storing and communicating information. hold data, derivatives, and parameters lazily allocate memory shuttle between CPU and GPU top blob bottom blob
  • 26. 26 Our results from Transfer learning Training image: 5872 Good: 3075 Bad: 2797 Validation images: 1679 Good: 880 Bad: 799 Test images: 831 Good: 436 Bad: 395 Precision ~ 95% Recall ~ 95%
  • 27. 27 In Production Bad images is ~ 1 in 1000 5 - 7 % send for human review Have not received any bad image post via user flagging Latency ~ 600 ms per image 5-6 QPS on single machine
  • 28. 28 Reference & Resources Gradient Based Learning Applied to document Recognition Handwritten Digit Recognition with a Committee of Deep Neural Nets on GPUs ImageNet Classification with Deep Convolutional Neural Networks Rich feature hierarchies for accurate object detection and semantic segmentation How transferable are features in deep neural networks? Learning and Transferring Mid-Level Image Representations using Convolutional Neural Networks Monza: Image Classification of Vehicle Make and Model Using Convolutional Neural Networks and Transfer Learning Dropout: A Simple Way to Prevent Neural Networks from Overfitting Mathematical Intuition for Performance of Rectified Linear Unit in Deep Neural Networks Convolutional Neural Network for Visual Recognition Neural Networks for Machine Learning Practical Recommendation for Train DNN
  • 29. ©2014 LinkedIn Corporation. All Rights Reserved.©2014 LinkedIn Corporation. All Rights Reserved.