SlideShare a Scribd company logo
1 of 9
Download to read offline
March 11th, 2016
Jason Helgren, Jaime Pastor, Abhishek Singh
Have ye seen the Right Whale? A Classification Problem
Problem: Identifying the “Right Whale” Calls
Goal
Identify audio clips containing sounds from
the North Atlantic right whale.
Type
Binary classification
Data
30,000 2-second audio clips
Application
Collision avoidance in shipping lanes.
Audio Classification to Image Classification
Fourier Transformation
Frequency domain representation
of a time varying signal
Spectrogram
Frequency characteristics of a
signal over time
Audio Recording
Pressure variation in time. We
perceive these pressure variations as
sound
time
time
frequency
frequencydensitypressure
Idealized example - a tuning fork
Whale Call Spectrogram
Frequency
Time
Feature Engineering (I)
Processing images: Contrast-enhancement
Original spectrogram Processed image
Time and frequency metrics (300 features)
Feature Engineering (II)
Template matching (150 features)
Search for template over spectrogram and find the area of the image that
best matches the template
Original Image and matchWhale call
template example
Best match
(Correlation, x, y)
Modeling and results (I)
Model selection
❏ Random Forests
❏ Gradient Boosting
Hyper-parameter tuning
❏ Learning rate
❏ Sampling rate
❏ Number of trees
Scoring on the test set
❏ Using all variables (450 features)
❏ Using only template matching variables (150 features)
❏ Using non-template matching variables (300 features)
Modeling and results (II)
FEATURE SELECTION
TRAIN AUC
(24k obs.)
TEST AUC
(6k obs.)
All features
(450 features)
.9992 .9965
Only template matching features
(150 features)
.9982 .9951
Only non-template matching
features (300 features)
.9796 .9499
AUC Summary
Jason Helgren
jmhelgren@usfca.edu
in/jasonhelgren
“Have ye seen the Right Whale? A Classification Problem”
Kaggle 2013 Marinexplore Whale Detection Challenge
Project available at Github
Jaime Pastor
jpastorsamper@usfca.edu
in/jaimepastor2
Abhishek Singh
aasingh4@usfca.edu
in/abhishek19895
Thank you

More Related Content

Viewers also liked

Viewers also liked (6)

The Dynamics of Unconscious Communication: Projection, Projective Identificat...
The Dynamics of Unconscious Communication: Projection, Projective Identificat...The Dynamics of Unconscious Communication: Projection, Projective Identificat...
The Dynamics of Unconscious Communication: Projection, Projective Identificat...
 
Iniciativa con proyecto de ley de etica
Iniciativa con proyecto de ley de eticaIniciativa con proyecto de ley de etica
Iniciativa con proyecto de ley de etica
 
Caro. Trail des Korrigans : le classement des 10km (catégories)
Caro. Trail des Korrigans : le classement des 10km (catégories)Caro. Trail des Korrigans : le classement des 10km (catégories)
Caro. Trail des Korrigans : le classement des 10km (catégories)
 
Windsurfing for dummies
Windsurfing for dummiesWindsurfing for dummies
Windsurfing for dummies
 
Παρουσιαση Ιστιοπλοια
Παρουσιαση ΙστιοπλοιαΠαρουσιαση Ιστιοπλοια
Παρουσιαση Ιστιοπλοια
 
Windsurfing
WindsurfingWindsurfing
Windsurfing
 

Recently uploaded

Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
JohnnyPlasten
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
shivangimorya083
 
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
shivangimorya083
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 

Recently uploaded (20)

Introduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptxIntroduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptx
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptx
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptx
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
 
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
 
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
 

Audio clip classification

  • 1. March 11th, 2016 Jason Helgren, Jaime Pastor, Abhishek Singh Have ye seen the Right Whale? A Classification Problem
  • 2. Problem: Identifying the “Right Whale” Calls Goal Identify audio clips containing sounds from the North Atlantic right whale. Type Binary classification Data 30,000 2-second audio clips Application Collision avoidance in shipping lanes.
  • 3. Audio Classification to Image Classification Fourier Transformation Frequency domain representation of a time varying signal Spectrogram Frequency characteristics of a signal over time Audio Recording Pressure variation in time. We perceive these pressure variations as sound time time frequency frequencydensitypressure Idealized example - a tuning fork
  • 5. Feature Engineering (I) Processing images: Contrast-enhancement Original spectrogram Processed image Time and frequency metrics (300 features)
  • 6. Feature Engineering (II) Template matching (150 features) Search for template over spectrogram and find the area of the image that best matches the template Original Image and matchWhale call template example Best match (Correlation, x, y)
  • 7. Modeling and results (I) Model selection ❏ Random Forests ❏ Gradient Boosting Hyper-parameter tuning ❏ Learning rate ❏ Sampling rate ❏ Number of trees Scoring on the test set ❏ Using all variables (450 features) ❏ Using only template matching variables (150 features) ❏ Using non-template matching variables (300 features)
  • 8. Modeling and results (II) FEATURE SELECTION TRAIN AUC (24k obs.) TEST AUC (6k obs.) All features (450 features) .9992 .9965 Only template matching features (150 features) .9982 .9951 Only non-template matching features (300 features) .9796 .9499 AUC Summary
  • 9. Jason Helgren jmhelgren@usfca.edu in/jasonhelgren “Have ye seen the Right Whale? A Classification Problem” Kaggle 2013 Marinexplore Whale Detection Challenge Project available at Github Jaime Pastor jpastorsamper@usfca.edu in/jaimepastor2 Abhishek Singh aasingh4@usfca.edu in/abhishek19895 Thank you