SlideShare a Scribd company logo
1 of 2
Download to read offline
2.6.2 Mobilenetv2
MobilenetV2 主要設計在行動裝置的深度學習模型,主要是透過稠密連接
(dense connections)和特徵融合(feature fusion)來提高模型的特徵表示能力,
同時保持模型的輕量級和高效率。
稠密連接(dense connections)的主要功能是確保每一層神經元都與前面所
有層的神經元連接
,
這樣可以有效地減少梯度消失和維持更好的特徵表示能力。
特徵融合(feature fusion)則是通過對每一層神經元進行特徵融合來增強特徵表
示能力,實作上將多個不同的特徵結合在一起,例如,在地標識別中,可以將圖
像中地標主要的顏色和形狀作為特徵,再加上地標中出現過的物件,例如:建築
物、樹木和草地等特徵,然後將這些特徵結合在一起,以便更好地識別地標。同
時也提升模型的泛化能力(模型對新數據的適應力)使此模型的應用層面更多更
廣。
另外,MobileNetV2 還採用了殘差連接(residual connections)和瓶頸模塊
(bottleneck modules)的設計,這些設計可以有效地降低模型的參數量,減少過
擬合的風險。
殘差連接(residual connections)是一種常見的神經網路架構,它可以使網
路學習到殘差(residual)
,即輸入數據與輸出數據之間的差異。在殘差連接中,
在每一層網路中都會有一個輸入和一個輸出,並且將這兩個連接在一起,以便網
路能夠學習到殘差。這種架構通常可以提高網路的性能,並且有助於防止梯度消
失問題,使得網路能夠更好地擬合訓練數據。
瓶頸模塊(bottleneck modules)是深度學習領域中的一種技術,它的作用是
通過降低神經網路中某些層的特徵數量來減少參數量,同時保持輸出特徵的質
量。瓶頸模塊通常包含三個子層:一個 1x1 的卷積層,一個 3x3 的卷積層,以
及另一個 1x1 的卷積層。第一個和第三個子層的作用是降低和恢復特徵的維
度,而中間的子層則用於捕捉特徵。瓶頸模塊的主要目的是減少神經網路的參數
量,從而降低過擬合的風險。
總的來說
,MobileNetV2 是一種高效且輕量級的 CNN 架構,
架構如圖 2. 15
所示,可以在移動裝置上運行的深度學習模型,且根據我們的研究此模型是我們
測試的模型中 Epoch 起始最高的,所需時間也是最短的。
另外,本研究之所以使用 MobileNetV2 而不使用 MobileNetV3,主要是 V3
的架構與 V2 差異太大,且根據我們的實驗中發現,且 V3 過於複雜導致有太多
局部最小值,所以在此任務中表現並沒有 V2 好。
圖 2. 15、mobilenetv2 架構圖

More Related Content

Featured

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming LanguageSimplilearn
 

Featured (20)

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming Language
 

ChatGPT.pdf

  • 1. 2.6.2 Mobilenetv2 MobilenetV2 主要設計在行動裝置的深度學習模型,主要是透過稠密連接 (dense connections)和特徵融合(feature fusion)來提高模型的特徵表示能力, 同時保持模型的輕量級和高效率。 稠密連接(dense connections)的主要功能是確保每一層神經元都與前面所 有層的神經元連接 , 這樣可以有效地減少梯度消失和維持更好的特徵表示能力。 特徵融合(feature fusion)則是通過對每一層神經元進行特徵融合來增強特徵表 示能力,實作上將多個不同的特徵結合在一起,例如,在地標識別中,可以將圖 像中地標主要的顏色和形狀作為特徵,再加上地標中出現過的物件,例如:建築 物、樹木和草地等特徵,然後將這些特徵結合在一起,以便更好地識別地標。同 時也提升模型的泛化能力(模型對新數據的適應力)使此模型的應用層面更多更 廣。 另外,MobileNetV2 還採用了殘差連接(residual connections)和瓶頸模塊 (bottleneck modules)的設計,這些設計可以有效地降低模型的參數量,減少過 擬合的風險。 殘差連接(residual connections)是一種常見的神經網路架構,它可以使網 路學習到殘差(residual) ,即輸入數據與輸出數據之間的差異。在殘差連接中, 在每一層網路中都會有一個輸入和一個輸出,並且將這兩個連接在一起,以便網 路能夠學習到殘差。這種架構通常可以提高網路的性能,並且有助於防止梯度消 失問題,使得網路能夠更好地擬合訓練數據。 瓶頸模塊(bottleneck modules)是深度學習領域中的一種技術,它的作用是 通過降低神經網路中某些層的特徵數量來減少參數量,同時保持輸出特徵的質 量。瓶頸模塊通常包含三個子層:一個 1x1 的卷積層,一個 3x3 的卷積層,以 及另一個 1x1 的卷積層。第一個和第三個子層的作用是降低和恢復特徵的維 度,而中間的子層則用於捕捉特徵。瓶頸模塊的主要目的是減少神經網路的參數 量,從而降低過擬合的風險。 總的來說 ,MobileNetV2 是一種高效且輕量級的 CNN 架構, 架構如圖 2. 15 所示,可以在移動裝置上運行的深度學習模型,且根據我們的研究此模型是我們 測試的模型中 Epoch 起始最高的,所需時間也是最短的。
  • 2. 另外,本研究之所以使用 MobileNetV2 而不使用 MobileNetV3,主要是 V3 的架構與 V2 差異太大,且根據我們的實驗中發現,且 V3 過於複雜導致有太多 局部最小值,所以在此任務中表現並沒有 V2 好。 圖 2. 15、mobilenetv2 架構圖