SlideShare a Scribd company logo
1 of 12
Download to read offline
Introduction to Audio Content Analysis
module 9.4: beat histogram
alexander lerch
overview intro beat histogram features summary
introduction
overview
corresponding textbook section
section 9.4
lecture content
• introduction of the beat histogram
• low level features used to describe rhythmic properties
learning objectives
• explain the terms beat histogram and beat spectrum and how they related to each
other
• describe two low level features derived from the beat spectrum and discuss their
musical meaning and limits
module 9.4: beat histogram 1 / 8
overview intro beat histogram features summary
introduction
overview
corresponding textbook section
section 9.4
lecture content
• introduction of the beat histogram
• low level features used to describe rhythmic properties
learning objectives
• explain the terms beat histogram and beat spectrum and how they related to each
other
• describe two low level features derived from the beat spectrum and discuss their
musical meaning and limits
module 9.4: beat histogram 1 / 8
overview intro beat histogram features summary
beat histogram
problem statement
previously introduced low-level features not suitable for temporal or rhythm
description
onset, beat, and downbeat detection either error prone or complicated
⇒ “robust” low level representation focused on tempo and rhythm:
beat histogram/spectrum
module 9.4: beat histogram 2 / 8
overview intro beat histogram features summary
beat histogram
introduction
beat spectrum or beat histogram:
x-axis (BPM or inter-onset-time)
y-axis (’strength’ of periodicity or number of occurrences)
compact representation of periodicities
module 9.4: beat histogram 3 / 8
matlab
source:
plotBeatHistogram.m
overview intro beat histogram features summary
beat histogram
input
1 option 1: novelty function
• time domain features: envelope, rms
• spectral differences: flux, ...
• any other feature meaningful for rhythm
description
2 option 2: series of onset times
graph from1
1
A. Lykartsis and A. Lerch, “Rhythm Features for Musical Genre Classification Using Multiple Novelty Functions,” in Proceedings of the
International Conference on Digital Audio Effects (DAFX), Trondheim, Norway, 2015.
module 9.4: beat histogram 4 / 8
overview intro beat histogram features summary
beat histogram
transform
1 option 1: frequency transform
• magnitude spectrum
• filterbank
2 option 2: ACF
• ACF maxima indicate periodicity periods
3 option 3: histogram
• measure Inter-Onset-Intervals (IOIs)
• sort them into bins and plot number of occurrences
module 9.4: beat histogram 5 / 8
overview intro beat histogram features summary
beat histogram
feature examples
statistical features
• mean, centroid, standard deviation,
kurtosis, . . .
peak features
• value and position of absolute max
• ratio (value and position) of
strongest and 2nd strongest peaks
other features
• flatness, crest, high frequency
content, MFCCs (??),. . .
• features from ACF of beat histogram
module 9.4: beat histogram 6 / 8
overview intro beat histogram features summary
beat histogram
feature examples
statistical features
• mean, centroid, standard deviation,
kurtosis, . . .
peak features
• value and position of absolute max
• ratio (value and position) of
strongest and 2nd strongest peaks
other features
• flatness, crest, high frequency
content, MFCCs (??),. . .
• features from ACF of beat histogram
module 9.4: beat histogram 6 / 8
overview intro beat histogram features summary
beat histogram
feature examples
statistical features
• mean, centroid, standard deviation,
kurtosis, . . .
peak features
• value and position of absolute max
• ratio (value and position) of
strongest and 2nd strongest peaks
other features
• flatness, crest, high frequency
content, MFCCs (??),. . .
• features from ACF of beat histogram
plot from2
2
J. J. Burred and A. Lerch, “Hierarchical Automatic Audio Signal Classification,” Journal of the Audio Engineering Society (JAES), vol. 52,
no. 7/8, pp. 724–739, 2004.
module 9.4: beat histogram 6 / 8
overview intro beat histogram features summary
rhythm description
open questions
what are the salient perceptual properties of rhythm?
what rhythms are perceptually similar?
should a rhythm description be tempo dependent or not?
what role does micro-timing play?
should rhythm descriptors be normalized to bar length?
module 9.4: beat histogram 7 / 8
overview intro beat histogram features summary
summary
lecture content
beat histogram or spectrum
• some frequency domain representation of novelty/ onsets
• usually characterizing the periodicities
beat histogram features
• low level features characterizing the beat spectrum
• often statistical descriptors
• easy to extract but limited meaning
usefulness of the beat histogram
• relatively compact representation of periodicity
• lacks phase → not a good rhythm description
module 9.4: beat histogram 8 / 8

More Related Content

Similar to 09-04-ACA-Temporal-BeatHisto.pdf

Final presentation
Final presentationFinal presentation
Final presentation
Rohan Lad
 
NMR Automation
NMR AutomationNMR Automation
NMR Automation
cknoxrun
 
Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...
Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...
Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...
Joao Rio
 
28 h 264-avc_by_dhchang
28   h 264-avc_by_dhchang28   h 264-avc_by_dhchang
28 h 264-avc_by_dhchang
Badri Patro
 

Similar to 09-04-ACA-Temporal-BeatHisto.pdf (15)

07-06-ACA-Tonal-Chord.pdf
07-06-ACA-Tonal-Chord.pdf07-06-ACA-Tonal-Chord.pdf
07-06-ACA-Tonal-Chord.pdf
 
Final presentation
Final presentationFinal presentation
Final presentation
 
International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)International Journal of Engineering and Science Invention (IJESI)
International Journal of Engineering and Science Invention (IJESI)
 
NMR Automation
NMR AutomationNMR Automation
NMR Automation
 
Syllabus
SyllabusSyllabus
Syllabus
 
auditory model
auditory modelauditory model
auditory model
 
12-02-ACA-Genre.pdf
12-02-ACA-Genre.pdf12-02-ACA-Genre.pdf
12-02-ACA-Genre.pdf
 
Teaching Computers to Listen to Music
Teaching Computers to Listen to MusicTeaching Computers to Listen to Music
Teaching Computers to Listen to Music
 
Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...
Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...
Numerical Modelling of the Dynamic Behaviour of a Soil in True Triaxial Tests...
 
28 h 264-avc_by_dhchang
28   h 264-avc_by_dhchang28   h 264-avc_by_dhchang
28 h 264-avc_by_dhchang
 
Comparative Analysis of Natural Frequency of Transverse Vibration of a Cantil...
Comparative Analysis of Natural Frequency of Transverse Vibration of a Cantil...Comparative Analysis of Natural Frequency of Transverse Vibration of a Cantil...
Comparative Analysis of Natural Frequency of Transverse Vibration of a Cantil...
 
03-03-04-ACA-Input-TF-Filterbanks.pdf
03-03-04-ACA-Input-TF-Filterbanks.pdf03-03-04-ACA-Input-TF-Filterbanks.pdf
03-03-04-ACA-Input-TF-Filterbanks.pdf
 
07-03-04-ACA-Tonal-Polyf0.pdf
07-03-04-ACA-Tonal-Polyf0.pdf07-03-04-ACA-Tonal-Polyf0.pdf
07-03-04-ACA-Tonal-Polyf0.pdf
 
07-03-03-ACA-Tonal-Monof0.pdf
07-03-03-ACA-Tonal-Monof0.pdf07-03-03-ACA-Tonal-Monof0.pdf
07-03-03-ACA-Tonal-Monof0.pdf
 
Recommended text books for ptu ece courses
Recommended text books for ptu ece coursesRecommended text books for ptu ece courses
Recommended text books for ptu ece courses
 

More from AlexanderLerch4

More from AlexanderLerch4 (19)

0A-02-ACA-Fundamentals-Convolution.pdf
0A-02-ACA-Fundamentals-Convolution.pdf0A-02-ACA-Fundamentals-Convolution.pdf
0A-02-ACA-Fundamentals-Convolution.pdf
 
10-02-ACA-Alignment.pdf
10-02-ACA-Alignment.pdf10-02-ACA-Alignment.pdf
10-02-ACA-Alignment.pdf
 
13-00-ACA-Mood.pdf
13-00-ACA-Mood.pdf13-00-ACA-Mood.pdf
13-00-ACA-Mood.pdf
 
09-07-ACA-Temporal-Structure.pdf
09-07-ACA-Temporal-Structure.pdf09-07-ACA-Temporal-Structure.pdf
09-07-ACA-Temporal-Structure.pdf
 
09-01-ACA-Temporal-Intro.pdf
09-01-ACA-Temporal-Intro.pdf09-01-ACA-Temporal-Intro.pdf
09-01-ACA-Temporal-Intro.pdf
 
15-00-ACA-Music-Performance-Analysis.pdf
15-00-ACA-Music-Performance-Analysis.pdf15-00-ACA-Music-Performance-Analysis.pdf
15-00-ACA-Music-Performance-Analysis.pdf
 
12-01-ACA-Similarity.pdf
12-01-ACA-Similarity.pdf12-01-ACA-Similarity.pdf
12-01-ACA-Similarity.pdf
 
11-00-ACA-Fingerprinting.pdf
11-00-ACA-Fingerprinting.pdf11-00-ACA-Fingerprinting.pdf
11-00-ACA-Fingerprinting.pdf
 
08-00-ACA-Intensity.pdf
08-00-ACA-Intensity.pdf08-00-ACA-Intensity.pdf
08-00-ACA-Intensity.pdf
 
05-00-ACA-Data-Intro.pdf
05-00-ACA-Data-Intro.pdf05-00-ACA-Data-Intro.pdf
05-00-ACA-Data-Intro.pdf
 
07-03-05-ACA-Tonal-F0Eval.pdf
07-03-05-ACA-Tonal-F0Eval.pdf07-03-05-ACA-Tonal-F0Eval.pdf
07-03-05-ACA-Tonal-F0Eval.pdf
 
03-03-01-ACA-Input-TF-Fourier.pdf
03-03-01-ACA-Input-TF-Fourier.pdf03-03-01-ACA-Input-TF-Fourier.pdf
03-03-01-ACA-Input-TF-Fourier.pdf
 
03-06-ACA-Input-FeatureLearning.pdf
03-06-ACA-Input-FeatureLearning.pdf03-06-ACA-Input-FeatureLearning.pdf
03-06-ACA-Input-FeatureLearning.pdf
 
07-02-ACA-Tonal-Music.pdf
07-02-ACA-Tonal-Music.pdf07-02-ACA-Tonal-Music.pdf
07-02-ACA-Tonal-Music.pdf
 
06-00-ACA-Evaluation.pdf
06-00-ACA-Evaluation.pdf06-00-ACA-Evaluation.pdf
06-00-ACA-Evaluation.pdf
 
07-01-ACA-Tonal-Perception.pdf
07-01-ACA-Tonal-Perception.pdf07-01-ACA-Tonal-Perception.pdf
07-01-ACA-Tonal-Perception.pdf
 
03-01-ACA-Input-Signals.pdf
03-01-ACA-Input-Signals.pdf03-01-ACA-Input-Signals.pdf
03-01-ACA-Input-Signals.pdf
 
02-00-ACA-System-Intro.pdf
02-00-ACA-System-Intro.pdf02-00-ACA-System-Intro.pdf
02-00-ACA-System-Intro.pdf
 
01-00-ACA-Introduction-2-MIR.pdf
01-00-ACA-Introduction-2-MIR.pdf01-00-ACA-Introduction-2-MIR.pdf
01-00-ACA-Introduction-2-MIR.pdf
 

Recently uploaded

Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
FIDO Alliance
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
Wonjun Hwang
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
FIDO Alliance
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
Muhammad Subhan
 

Recently uploaded (20)

How to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in PakistanHow to Check GPS Location with a Live Tracker in Pakistan
How to Check GPS Location with a Live Tracker in Pakistan
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
الأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهلهالأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهله
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)CORS (Kitworks Team Study 양다윗 발표자료 240510)
CORS (Kitworks Team Study 양다윗 발표자료 240510)
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 

09-04-ACA-Temporal-BeatHisto.pdf

  • 1. Introduction to Audio Content Analysis module 9.4: beat histogram alexander lerch
  • 2. overview intro beat histogram features summary introduction overview corresponding textbook section section 9.4 lecture content • introduction of the beat histogram • low level features used to describe rhythmic properties learning objectives • explain the terms beat histogram and beat spectrum and how they related to each other • describe two low level features derived from the beat spectrum and discuss their musical meaning and limits module 9.4: beat histogram 1 / 8
  • 3. overview intro beat histogram features summary introduction overview corresponding textbook section section 9.4 lecture content • introduction of the beat histogram • low level features used to describe rhythmic properties learning objectives • explain the terms beat histogram and beat spectrum and how they related to each other • describe two low level features derived from the beat spectrum and discuss their musical meaning and limits module 9.4: beat histogram 1 / 8
  • 4. overview intro beat histogram features summary beat histogram problem statement previously introduced low-level features not suitable for temporal or rhythm description onset, beat, and downbeat detection either error prone or complicated ⇒ “robust” low level representation focused on tempo and rhythm: beat histogram/spectrum module 9.4: beat histogram 2 / 8
  • 5. overview intro beat histogram features summary beat histogram introduction beat spectrum or beat histogram: x-axis (BPM or inter-onset-time) y-axis (’strength’ of periodicity or number of occurrences) compact representation of periodicities module 9.4: beat histogram 3 / 8 matlab source: plotBeatHistogram.m
  • 6. overview intro beat histogram features summary beat histogram input 1 option 1: novelty function • time domain features: envelope, rms • spectral differences: flux, ... • any other feature meaningful for rhythm description 2 option 2: series of onset times graph from1 1 A. Lykartsis and A. Lerch, “Rhythm Features for Musical Genre Classification Using Multiple Novelty Functions,” in Proceedings of the International Conference on Digital Audio Effects (DAFX), Trondheim, Norway, 2015. module 9.4: beat histogram 4 / 8
  • 7. overview intro beat histogram features summary beat histogram transform 1 option 1: frequency transform • magnitude spectrum • filterbank 2 option 2: ACF • ACF maxima indicate periodicity periods 3 option 3: histogram • measure Inter-Onset-Intervals (IOIs) • sort them into bins and plot number of occurrences module 9.4: beat histogram 5 / 8
  • 8. overview intro beat histogram features summary beat histogram feature examples statistical features • mean, centroid, standard deviation, kurtosis, . . . peak features • value and position of absolute max • ratio (value and position) of strongest and 2nd strongest peaks other features • flatness, crest, high frequency content, MFCCs (??),. . . • features from ACF of beat histogram module 9.4: beat histogram 6 / 8
  • 9. overview intro beat histogram features summary beat histogram feature examples statistical features • mean, centroid, standard deviation, kurtosis, . . . peak features • value and position of absolute max • ratio (value and position) of strongest and 2nd strongest peaks other features • flatness, crest, high frequency content, MFCCs (??),. . . • features from ACF of beat histogram module 9.4: beat histogram 6 / 8
  • 10. overview intro beat histogram features summary beat histogram feature examples statistical features • mean, centroid, standard deviation, kurtosis, . . . peak features • value and position of absolute max • ratio (value and position) of strongest and 2nd strongest peaks other features • flatness, crest, high frequency content, MFCCs (??),. . . • features from ACF of beat histogram plot from2 2 J. J. Burred and A. Lerch, “Hierarchical Automatic Audio Signal Classification,” Journal of the Audio Engineering Society (JAES), vol. 52, no. 7/8, pp. 724–739, 2004. module 9.4: beat histogram 6 / 8
  • 11. overview intro beat histogram features summary rhythm description open questions what are the salient perceptual properties of rhythm? what rhythms are perceptually similar? should a rhythm description be tempo dependent or not? what role does micro-timing play? should rhythm descriptors be normalized to bar length? module 9.4: beat histogram 7 / 8
  • 12. overview intro beat histogram features summary summary lecture content beat histogram or spectrum • some frequency domain representation of novelty/ onsets • usually characterizing the periodicities beat histogram features • low level features characterizing the beat spectrum • often statistical descriptors • easy to extract but limited meaning usefulness of the beat histogram • relatively compact representation of periodicity • lacks phase → not a good rhythm description module 9.4: beat histogram 8 / 8