SlideShare a Scribd company logo
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 1/8
Introducing Google’s MobileNets
( by Larry Guo tcglarry@gmail.com)
The following Material is introduction of Paper:    
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications (Google)
https://arxiv.org/abs/1704.04861
Objective
a class of efficient models called MobileNets for mobile and embedded vision applications
Motivation: 
General Trend of  CNN - Getting Deeper and Complicated to get higher accuracy 
However, not improve in size and speed
In many real world applications,  , the recognition tasks need to be carried out in a timely fashion on
a computation- ally limited platform.
MobileNets: 
Primarily focus on optimizing for latency but also yield small networks. 
MobileNet Architecture(Depthwise Separable Convolution)
D is the Keneral Size
M:  Input Channel 
N: Output Chanel 
Traditional CNN : Kernel Size: [D , D , M] *N (Feature Maps)
Issues: Resulting to High Computation Cost 
K
K K
 
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 2/8
MobileNet (depthwise Separable Convolution)
Stage1: Depthwise Convolution - Using Kernel size  [D , D , 1] *M(Feature Maps)
Stage2: Pointwise Convolution - Using (Stage1Output) with Kernel Size [1, 1, M]*N(Feature Maps)
Combine the above 2 operation will get ‘similar result’ as traditional CNN with significantly lower
computation cost to ( )
Left: Traditional CNN Layer;     Right: MobileNet Layer
Actual Network Architecture 
K K
 
 
N
1
DK
2
1
 
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 3/8
Note: Most Computation in 1x1 Convolution: Cna be used GEMM (general matrix multiply) to
Accelerate 
Downsizing Methodology 
α ∈ (0, 1]: reduce the feature maps size αM, αN, (in the paper 1, 0.75,0.5,0.25) (reduce
computation roughly by α
ρ ∈ (0, 1], change the input resolution 224, 192, 160, 128 (reduce computation by ρ
Results (Comparison of Hyper Parameter Setting): 
 
 
2
2
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 4/8
 
Result of Depthwise Separable Convolution vs Full Convolution 
with sacrifice of 1% accuracy, the computation cost decreases significantly!
Cut width or Cut Depth ? (shallow =  the 5 layers of separable filters with feature size 14 × 14 × 512
in Table 1 are removed),     0.75 = 0.75*M feature maps   Cut width is better !!!
Comparison of different width (accuracy vs computation cost), SAME resolution 
Comparison of different resolution 
 
 
 
 
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 5/8
Log Linear dependency between Accuracy and Multi Adds
Accuracy vs Number of Parameters 
Results vs Popular Model 
vs GoogleNet, VGG16
 
 
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 6/8
Smaller MobileNet vs SquuezeNet(for a smaller Network) and AlexNet
Fine Grained Recognition (Stanford Dogs)
Face Attributes Classification 
 
 
 
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 7/8
Object Detection 
vs FaceNet
 
 
 
2017/7/16 Introducing Google’s MobileNets
https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 8/8

More Related Content

What's hot

“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...
“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...
“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...
Edge AI and Vision Alliance
 
"Machine Learning- based Image Compression: Ready for Prime Time?," a Present...
"Machine Learning- based Image Compression: Ready for Prime Time?," a Present..."Machine Learning- based Image Compression: Ready for Prime Time?," a Present...
"Machine Learning- based Image Compression: Ready for Prime Time?," a Present...
Edge AI and Vision Alliance
 
Creating smaller, faster, production-ready mobile machine learning models.
Creating smaller, faster, production-ready mobile machine learning models.Creating smaller, faster, production-ready mobile machine learning models.
Creating smaller, faster, production-ready mobile machine learning models.
Jameson Toole
 
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Bharath Sudharsan
 
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio..."Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
Edge AI and Vision Alliance
 
"Designing CNN Algorithms for Real-time Applications," a Presentation from Al...
"Designing CNN Algorithms for Real-time Applications," a Presentation from Al..."Designing CNN Algorithms for Real-time Applications," a Presentation from Al...
"Designing CNN Algorithms for Real-time Applications," a Presentation from Al...
Edge AI and Vision Alliance
 
Possibility of hpc application on cloud infrastructure by container cluster
Possibility of hpc application on cloud infrastructure by container clusterPossibility of hpc application on cloud infrastructure by container cluster
Possibility of hpc application on cloud infrastructure by container cluster
Kyunam Cho
 
SeRanet introduction
SeRanet introductionSeRanet introduction
SeRanet introduction
Kosuke Nakago
 
Large scale gpu cluster for ai
Large scale gpu cluster for aiLarge scale gpu cluster for ai
Large scale gpu cluster for ai
Kyunam Cho
 
Image super resolution based on
Image super resolution based onImage super resolution based on
Image super resolution based on
jpstudcorner
 
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View SynthesisPR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Hyeongmin Lee
 
Anomaly Detection at Scale
Anomaly Detection at ScaleAnomaly Detection at Scale
Anomaly Detection at Scale
Jeff Henrikson
 
Yangqing Jia at AI Frontiers: Towards Better DL Frameworks
Yangqing Jia at AI Frontiers: Towards Better DL FrameworksYangqing Jia at AI Frontiers: Towards Better DL Frameworks
Yangqing Jia at AI Frontiers: Towards Better DL Frameworks
AI Frontiers
 
ECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT Devices
ECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT DevicesECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT Devices
ECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT Devices
Bharath Sudharsan
 
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
Edge AI and Vision Alliance
 
“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...
“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...
“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...
Edge AI and Vision Alliance
 
"Deploying Deep Learning Models on Embedded Processors for Autonomous Systems...
"Deploying Deep Learning Models on Embedded Processors for Autonomous Systems..."Deploying Deep Learning Models on Embedded Processors for Autonomous Systems...
"Deploying Deep Learning Models on Embedded Processors for Autonomous Systems...
Edge AI and Vision Alliance
 
ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]
Dongmin Choi
 
“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...
“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...
“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...
Edge AI and Vision Alliance
 
“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...
“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...
“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...
Edge AI and Vision Alliance
 

What's hot (20)

“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...
“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...
“DNN Training Data: How to Know What You Need and How to Get It,” a Presentat...
 
"Machine Learning- based Image Compression: Ready for Prime Time?," a Present...
"Machine Learning- based Image Compression: Ready for Prime Time?," a Present..."Machine Learning- based Image Compression: Ready for Prime Time?," a Present...
"Machine Learning- based Image Compression: Ready for Prime Time?," a Present...
 
Creating smaller, faster, production-ready mobile machine learning models.
Creating smaller, faster, production-ready mobile machine learning models.Creating smaller, faster, production-ready mobile machine learning models.
Creating smaller, faster, production-ready mobile machine learning models.
 
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
 
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio..."Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
"Quantizing Deep Networks for Efficient Inference at the Edge," a Presentatio...
 
"Designing CNN Algorithms for Real-time Applications," a Presentation from Al...
"Designing CNN Algorithms for Real-time Applications," a Presentation from Al..."Designing CNN Algorithms for Real-time Applications," a Presentation from Al...
"Designing CNN Algorithms for Real-time Applications," a Presentation from Al...
 
Possibility of hpc application on cloud infrastructure by container cluster
Possibility of hpc application on cloud infrastructure by container clusterPossibility of hpc application on cloud infrastructure by container cluster
Possibility of hpc application on cloud infrastructure by container cluster
 
SeRanet introduction
SeRanet introductionSeRanet introduction
SeRanet introduction
 
Large scale gpu cluster for ai
Large scale gpu cluster for aiLarge scale gpu cluster for ai
Large scale gpu cluster for ai
 
Image super resolution based on
Image super resolution based onImage super resolution based on
Image super resolution based on
 
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View SynthesisPR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
 
Anomaly Detection at Scale
Anomaly Detection at ScaleAnomaly Detection at Scale
Anomaly Detection at Scale
 
Yangqing Jia at AI Frontiers: Towards Better DL Frameworks
Yangqing Jia at AI Frontiers: Towards Better DL FrameworksYangqing Jia at AI Frontiers: Towards Better DL Frameworks
Yangqing Jia at AI Frontiers: Towards Better DL Frameworks
 
ECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT Devices
ECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT DevicesECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT Devices
ECML PKDD 2021 ML meets IoT Tutorial Part I: ML for IoT Devices
 
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
“Case Study: Facial Detection and Recognition for Always-On Applications,” a ...
 
“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...
“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...
“Introduction to Simultaneous Localization and Mapping (SLAM),” a Presentatio...
 
"Deploying Deep Learning Models on Embedded Processors for Autonomous Systems...
"Deploying Deep Learning Models on Embedded Processors for Autonomous Systems..."Deploying Deep Learning Models on Embedded Processors for Autonomous Systems...
"Deploying Deep Learning Models on Embedded Processors for Autonomous Systems...
 
ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]ViT (Vision Transformer) Review [CDM]
ViT (Vision Transformer) Review [CDM]
 
“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...
“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...
“From Inference to Action: AI Beyond Pattern Recognition,” a Keynote Presenta...
 
“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...
“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...
“Building an Autonomous Detect-and-Avoid System for Commercial Drones,” a Pre...
 

Similar to Introducing google’s mobile nets

HPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud TechnologiesHPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud TechnologiesInderjeet Singh
 
Stochastic Computing Correlation Utilization in Convolutional Neural Network ...
Stochastic Computing Correlation Utilization in Convolutional Neural Network ...Stochastic Computing Correlation Utilization in Convolutional Neural Network ...
Stochastic Computing Correlation Utilization in Convolutional Neural Network ...
TELKOMNIKA JOURNAL
 
(Im2col)accelerating deep neural networks on low power heterogeneous architec...
(Im2col)accelerating deep neural networks on low power heterogeneous architec...(Im2col)accelerating deep neural networks on low power heterogeneous architec...
(Im2col)accelerating deep neural networks on low power heterogeneous architec...
Bomm Kim
 
Rendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile DevicesRendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile Devices
Waqas Tariq
 
Introduction to 2D/3D Graphics
Introduction to 2D/3D GraphicsIntroduction to 2D/3D Graphics
Introduction to 2D/3D Graphics
Prabindh Sundareson
 
1801.06434
1801.064341801.06434
1801.06434
emil_laurence
 
2022-01-17-Rethinking_Bisenet.pptx
2022-01-17-Rethinking_Bisenet.pptx2022-01-17-Rethinking_Bisenet.pptx
2022-01-17-Rethinking_Bisenet.pptx
JAEMINJEONG5
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacm
lmphuong06
 
A N A LTERNATIVE G REEN S CREEN K EYING M ETHOD F OR F ILM V ISUAL E ...
A N  A LTERNATIVE  G REEN  S CREEN  K EYING M ETHOD  F OR  F ILM  V ISUAL  E ...A N  A LTERNATIVE  G REEN  S CREEN  K EYING M ETHOD  F OR  F ILM  V ISUAL  E ...
A N A LTERNATIVE G REEN S CREEN K EYING M ETHOD F OR F ILM V ISUAL E ...
ijma
 
オープンハウスにおける 機械学習・データサイエンスの 取り組みについて
オープンハウスにおける機械学習・データサイエンスの取り組みについてオープンハウスにおける機械学習・データサイエンスの取り組みについて
オープンハウスにおける 機械学習・データサイエンスの 取り組みについて
Teito Nakagawa
 
RunPool: A Dynamic Pooling Layer for Convolution Neural Network
RunPool: A Dynamic Pooling Layer for Convolution Neural NetworkRunPool: A Dynamic Pooling Layer for Convolution Neural Network
RunPool: A Dynamic Pooling Layer for Convolution Neural Network
Putra Wanda
 
Energy and latency aware application
Energy and latency aware applicationEnergy and latency aware application
Energy and latency aware application
csandit
 
ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...
ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...
ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...
cscpconf
 
Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...
Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...
Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...
NTT Software Innovation Center
 
Colfax-Winograd-Summary _final (1)
Colfax-Winograd-Summary _final (1)Colfax-Winograd-Summary _final (1)
Colfax-Winograd-Summary _final (1)Sangamesh Ragate
 
Green cloud computing
Green cloud computingGreen cloud computing
Green cloud computing
Nalini Mehta
 
Efficient de cvpr_2020_paper
Efficient de cvpr_2020_paperEfficient de cvpr_2020_paper
Efficient de cvpr_2020_paper
shanullah3
 
Download It
Download ItDownload It
Download Itbutest
 
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction NetworkEDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
gerogepatton
 
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction NetworkEDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
gerogepatton
 

Similar to Introducing google’s mobile nets (20)

HPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud TechnologiesHPC with Clouds and Cloud Technologies
HPC with Clouds and Cloud Technologies
 
Stochastic Computing Correlation Utilization in Convolutional Neural Network ...
Stochastic Computing Correlation Utilization in Convolutional Neural Network ...Stochastic Computing Correlation Utilization in Convolutional Neural Network ...
Stochastic Computing Correlation Utilization in Convolutional Neural Network ...
 
(Im2col)accelerating deep neural networks on low power heterogeneous architec...
(Im2col)accelerating deep neural networks on low power heterogeneous architec...(Im2col)accelerating deep neural networks on low power heterogeneous architec...
(Im2col)accelerating deep neural networks on low power heterogeneous architec...
 
Rendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile DevicesRendering Process of Digital Terrain Model on Mobile Devices
Rendering Process of Digital Terrain Model on Mobile Devices
 
Introduction to 2D/3D Graphics
Introduction to 2D/3D GraphicsIntroduction to 2D/3D Graphics
Introduction to 2D/3D Graphics
 
1801.06434
1801.064341801.06434
1801.06434
 
2022-01-17-Rethinking_Bisenet.pptx
2022-01-17-Rethinking_Bisenet.pptx2022-01-17-Rethinking_Bisenet.pptx
2022-01-17-Rethinking_Bisenet.pptx
 
Mapreduce2008 cacm
Mapreduce2008 cacmMapreduce2008 cacm
Mapreduce2008 cacm
 
A N A LTERNATIVE G REEN S CREEN K EYING M ETHOD F OR F ILM V ISUAL E ...
A N  A LTERNATIVE  G REEN  S CREEN  K EYING M ETHOD  F OR  F ILM  V ISUAL  E ...A N  A LTERNATIVE  G REEN  S CREEN  K EYING M ETHOD  F OR  F ILM  V ISUAL  E ...
A N A LTERNATIVE G REEN S CREEN K EYING M ETHOD F OR F ILM V ISUAL E ...
 
オープンハウスにおける 機械学習・データサイエンスの 取り組みについて
オープンハウスにおける機械学習・データサイエンスの取り組みについてオープンハウスにおける機械学習・データサイエンスの取り組みについて
オープンハウスにおける 機械学習・データサイエンスの 取り組みについて
 
RunPool: A Dynamic Pooling Layer for Convolution Neural Network
RunPool: A Dynamic Pooling Layer for Convolution Neural NetworkRunPool: A Dynamic Pooling Layer for Convolution Neural Network
RunPool: A Dynamic Pooling Layer for Convolution Neural Network
 
Energy and latency aware application
Energy and latency aware applicationEnergy and latency aware application
Energy and latency aware application
 
ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...
ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...
ENERGY AND LATENCY AWARE APPLICATION MAPPING ALGORITHM & OPTIMIZATION FOR HOM...
 
Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...
Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...
Hybrid Computing Platform for Combinatorial Optimization with the Coherent Is...
 
Colfax-Winograd-Summary _final (1)
Colfax-Winograd-Summary _final (1)Colfax-Winograd-Summary _final (1)
Colfax-Winograd-Summary _final (1)
 
Green cloud computing
Green cloud computingGreen cloud computing
Green cloud computing
 
Efficient de cvpr_2020_paper
Efficient de cvpr_2020_paperEfficient de cvpr_2020_paper
Efficient de cvpr_2020_paper
 
Download It
Download ItDownload It
Download It
 
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction NetworkEDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
 
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction NetworkEDGE-Net: Efficient Deep-learning Gradients Extraction Network
EDGE-Net: Efficient Deep-learning Gradients Extraction Network
 

Recently uploaded

How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
kalichargn70th171
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
Globus
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
vrstrong314
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Anthony Dahanne
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
Globus
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Globus
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
informapgpstrackings
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
Srikant77
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Jay Das
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
Donna Lenk
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Natan Silnitsky
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Shahin Sheidaei
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
rickgrimesss22
 

Recently uploaded (20)

How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
A Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdfA Comprehensive Look at Generative AI in Retail App Testing.pdf
A Comprehensive Look at Generative AI in Retail App Testing.pdf
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
 
top nidhi software solution freedownload
top nidhi software solution freedownloadtop nidhi software solution freedownload
top nidhi software solution freedownload
 
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...
 
Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024Globus Compute Introduction - GlobusWorld 2024
Globus Compute Introduction - GlobusWorld 2024
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
 
Prosigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns: Transforming Business with Tailored Technology Solutions
Prosigns: Transforming Business with Tailored Technology Solutions
 
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
RISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent EnterpriseRISE with SAP and Journey to the Intelligent Enterprise
RISE with SAP and Journey to the Intelligent Enterprise
 
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdfEnhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
Enhancing Project Management Efficiency_ Leveraging AI Tools like ChatGPT.pdf
 
Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"Navigating the Metaverse: A Journey into Virtual Evolution"
Navigating the Metaverse: A Journey into Virtual Evolution"
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptxTop Features to Include in Your Winzo Clone App for Business Growth (4).pptx
Top Features to Include in Your Winzo Clone App for Business Growth (4).pptx
 

Introducing google’s mobile nets

  • 1. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 1/8 Introducing Google’s MobileNets ( by Larry Guo tcglarry@gmail.com) The following Material is introduction of Paper:     MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications (Google) https://arxiv.org/abs/1704.04861 Objective a class of efficient models called MobileNets for mobile and embedded vision applications Motivation:  General Trend of  CNN - Getting Deeper and Complicated to get higher accuracy  However, not improve in size and speed In many real world applications,  , the recognition tasks need to be carried out in a timely fashion on a computation- ally limited platform. MobileNets:  Primarily focus on optimizing for latency but also yield small networks.  MobileNet Architecture(Depthwise Separable Convolution) D is the Keneral Size M:  Input Channel  N: Output Chanel  Traditional CNN : Kernel Size: [D , D , M] *N (Feature Maps) Issues: Resulting to High Computation Cost  K K K  
  • 2. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 2/8 MobileNet (depthwise Separable Convolution) Stage1: Depthwise Convolution - Using Kernel size  [D , D , 1] *M(Feature Maps) Stage2: Pointwise Convolution - Using (Stage1Output) with Kernel Size [1, 1, M]*N(Feature Maps) Combine the above 2 operation will get ‘similar result’ as traditional CNN with significantly lower computation cost to ( ) Left: Traditional CNN Layer;     Right: MobileNet Layer Actual Network Architecture  K K     N 1 DK 2 1  
  • 3. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 3/8 Note: Most Computation in 1x1 Convolution: Cna be used GEMM (general matrix multiply) to Accelerate  Downsizing Methodology  α ∈ (0, 1]: reduce the feature maps size αM, αN, (in the paper 1, 0.75,0.5,0.25) (reduce computation roughly by α ρ ∈ (0, 1], change the input resolution 224, 192, 160, 128 (reduce computation by ρ Results (Comparison of Hyper Parameter Setting):      2 2
  • 4. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 4/8   Result of Depthwise Separable Convolution vs Full Convolution  with sacrifice of 1% accuracy, the computation cost decreases significantly! Cut width or Cut Depth ? (shallow =  the 5 layers of separable filters with feature size 14 × 14 × 512 in Table 1 are removed),     0.75 = 0.75*M feature maps   Cut width is better !!! Comparison of different width (accuracy vs computation cost), SAME resolution  Comparison of different resolution         
  • 5. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 5/8 Log Linear dependency between Accuracy and Multi Adds Accuracy vs Number of Parameters  Results vs Popular Model  vs GoogleNet, VGG16    
  • 6. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 6/8 Smaller MobileNet vs SquuezeNet(for a smaller Network) and AlexNet Fine Grained Recognition (Stanford Dogs) Face Attributes Classification       
  • 7. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 7/8 Object Detection  vs FaceNet      
  • 8. 2017/7/16 Introducing Google’s MobileNets https://paper.dropbox.com/doc/print/ObfURZ1vmZcZMGs0zN9zo?print=true 8/8