SlideShare a Scribd company logo
Introduction to Audio Content Analysis
module 9.1: introduction to tempo & rhythm terminology
alexander lerch
overview intro perception musical summary
introduction
overview
corresponding textbook section
sections 9.1 & 9.2
lecture content
• terminology for rhythm detection
• perceptually motivated rhythm accuracy
learning objectives
• describe the terms onset, tempo, meter, bar, and rhythm
• give two examples of typical onset times for musical instruments
module 9.1: introduction to tempo & rhythm terminology 1 / 10
overview intro perception musical summary
introduction
overview
corresponding textbook section
sections 9.1 & 9.2
lecture content
• terminology for rhythm detection
• perceptually motivated rhythm accuracy
learning objectives
• describe the terms onset, tempo, meter, bar, and rhythm
• give two examples of typical onset times for musical instruments
module 9.1: introduction to tempo & rhythm terminology 1 / 10
overview intro perception musical summary
temporal events
introduction
categorization of temporal parameters:
• score parameters:
structure, time signature, rhythm, . . .
• performance parameters:
tempo, timing, . . .
perception of temporal parameters:
• audio signal/stream is segmented into distinct events ⇒ onsets (segment start)
• humans structure and group these events due to position, salience, . . .
module 9.1: introduction to tempo & rhythm terminology 2 / 10
overview intro perception musical summary
temporal events
introduction
categorization of temporal parameters:
• score parameters:
structure, time signature, rhythm, . . .
• performance parameters:
tempo, timing, . . .
perception of temporal parameters:
• audio signal/stream is segmented into distinct events ⇒ onsets (segment start)
• humans structure and group these events due to position, salience, . . .
module 9.1: introduction to tempo & rhythm terminology 2 / 10
overview intro perception musical summary
human perception of temporal events
introduction to onsets
onset is start of a musical event
properties:
• position
• strength, salience
• length?
module 9.1: introduction to tempo & rhythm terminology 3 / 10
matlab
source:
plotOnset.m
overview intro perception musical summary
human perception of temporal events
initial transients
percussive instruments:
• 3-20 ms
woodwind instruments:
• up to 300 ms
typical range for majority of
instruments:
• 15–50 ms
module 9.1: introduction to tempo & rhythm terminology 4 / 10
overview intro perception musical summary
human perception of temporal events
initial transients
percussive instruments:
• 3-20 ms
woodwind instruments:
• up to 300 ms
typical range for majority of
instruments:
• 15–50 ms
module 9.1: introduction to tempo & rhythm terminology 4 / 10
overview intro perception musical summary
human perception of temporal events
human detection accuracy
detection & discrimination of 2 subsequent onsets
• detection ∆t > 2 ms, discrimination ∆t > 20 ms1
prediction of looped monophonic instrument onsets
• IOI 600 ms: σ = 12 ms
• IOI < 240 ms: σ = 10 ms
manual onset time annotation
• piano: mean abs. error: 4.3 ms, max: 35 ms
• various: mean abs. error: 10 ms, max: 30 ms
ensemble performance
• string & woodwind: deviations up to 30-50 ms
• piano: σ = 14 − 38 ms
1
I. J. Hirsh, “Auditory Perception of Temporal Order,” JASA, vol. 31, no. 6, p. 759, 1959.
module 9.1: introduction to tempo & rhythm terminology 5 / 10
overview intro perception musical summary
human perception of temporal events
human detection accuracy
detection & discrimination of 2 subsequent onsets
• detection ∆t > 2 ms, discrimination ∆t > 20 ms
prediction of looped monophonic instrument onsets
• IOI 600 ms: σ = 12 ms1
• IOI < 240 ms: σ = 10 ms2
manual onset time annotation
• piano: mean abs. error: 4.3 ms, max: 35 ms
• various: mean abs. error: 10 ms, max: 30 ms
ensemble performance
• string & woodwind: deviations up to 30-50 ms
• piano: σ = 14 − 38 ms
1
J. W. Gordon, “Perception of Attack Transients in Musical Tones,” Dissertation, Stanford University, Center for Computer Research in Music
and Acoustics (CCRMA), Stanford, 1984.
2
A. Friberg and J. Sundberg, “Perception of just noticeable time displacement of a tone presented in a Metrical Sequence at Different Tempos,”
STL-QPSR, vol. 33, no. 4, pp. 97–108, 1992.
module 9.1: introduction to tempo & rhythm terminology 5 / 10
overview intro perception musical summary
human perception of temporal events
human detection accuracy
detection & discrimination of 2 subsequent onsets
• detection ∆t > 2 ms, discrimination ∆t > 20 ms
prediction of looped monophonic instrument onsets
• IOI 600 ms: σ = 12 ms
• IOI < 240 ms: σ = 10 ms
manual onset time annotation
• piano: mean abs. error: 4.3 ms, max: 35 ms1
• various: mean abs. error: 10 ms, max: 30 ms2
ensemble performance
• string & woodwind: deviations up to 30-50 ms
• piano: σ = 14 − 38 ms
1
B. H. Repp, “Diversity and commonality in music performance: An analysis of timing microstructure in Schumann’s ’Träumerei’,” JASA,
vol. 92, no. 5, pp. 2546–2568, 1992.
2
P. Leveau, L. Daudet, and G. Richard, “Methodology and Tools for the Evaluation of Automatic Onset Detection Algorithms in Music,” in
ISMIR, Barcelona, 2004.
module 9.1: introduction to tempo & rhythm terminology 5 / 10
overview intro perception musical summary
human perception of temporal events
human detection accuracy
detection & discrimination of 2 subsequent onsets
• detection ∆t > 2 ms, discrimination ∆t > 20 ms
prediction of looped monophonic instrument onsets
• IOI 600 ms: σ = 12 ms
• IOI < 240 ms: σ = 10 ms
manual onset time annotation
• piano: mean abs. error: 4.3 ms, max: 35 ms
• various: mean abs. error: 10 ms, max: 30 ms
ensemble performance
• string & woodwind: deviations up to 30-50 ms1
• piano: σ = 14 − 38 ms2
1
R. A. Rasch, “Synchronization in Performed Ensemble Music,” Acustica, vol. 43, pp. 121–131, 1979.
2
L. H. Shaffer, “Timing in Solo and Duet Piano Performances,” Quarterly Journal of Experimental Psychology, vol. 36A, pp. 577–595, 1984.
module 9.1: introduction to tempo & rhythm terminology 5 / 10
overview intro perception musical summary
human perception of temporal events
offsets
what about offsets/end of notes
module 9.1: introduction to tempo & rhythm terminology 6 / 10
overview intro perception musical summary
human perception of temporal events
offsets
what about offsets/end of notes
perceptually not as important as an onset
• offset are often ignored in rhythm perception
systematic difficulties: when does a note end?
• performer stops excitation
• instrument stops oscillation
• listener cannot recognize it anymore
practical difficulties: hard to detect
• low volume
• reverberation
• masking
module 9.1: introduction to tempo & rhythm terminology 6 / 10
overview intro perception musical summary
human perception of temporal events
tempo, meter & rhythm
tempo: perceived equal duration pulses at a “natural” rate — tactus
• constant tempo
T =
B · 60 s
∆ts
[BPM]
• dynamic tempo
Tlocal(j) =
60 s
tb(j + 1) − tb(j)
[BPM]
• perceived overall tempo?
▶ average, main, mode, . . .
meter
• group of strong and weak musical elements/beats
• typically 3 to 7 beats (app. 5 s)
rhythm
• group length 1–8 beats
• defined by accents and time intervals
module 9.1: introduction to tempo & rhythm terminology 7 / 10
overview intro perception musical summary
human perception of temporal events
tempo, meter & rhythm
tempo: perceived equal duration pulses at a “natural” rate — tactus
• constant tempo
T =
B · 60 s
∆ts
[BPM]
• dynamic tempo
Tlocal(j) =
60 s
tb(j + 1) − tb(j)
[BPM]
• perceived overall tempo?
▶ average, main, mode, . . .
meter
• group of strong and weak musical elements/beats
• typically 3 to 7 beats (app. 5 s)
rhythm
• group length 1–8 beats
• defined by accents and time intervals
module 9.1: introduction to tempo & rhythm terminology 7 / 10
overview intro perception musical summary
human perception of temporal events
tempo, meter & rhythm
tempo: perceived equal duration pulses at a “natural” rate — tactus
• constant tempo
T =
B · 60 s
∆ts
[BPM]
• dynamic tempo
Tlocal(j) =
60 s
tb(j + 1) − tb(j)
[BPM]
• perceived overall tempo?
▶ average, main, mode, . . .
meter
• group of strong and weak musical elements/beats
• typically 3 to 7 beats (app. 5 s)
rhythm
• group length 1–8 beats
• defined by accents and time intervals
module 9.1: introduction to tempo & rhythm terminology 7 / 10
overview intro perception musical summary
temporal events
hierarchical structure
module 9.1: introduction to tempo & rhythm terminology 8 / 10
matlab
source:
plotBeatHierarchy.m
overview intro perception musical summary
musical notation of temporal events
tempo, time signature, bar & note value
tempo
• Largo, Adagio, Andante, Moderato, Allegro, Presto
• ritardando, accelerando, . . .
• modern scores: sometimes overall tempo in BPM
bar
• score equivalent of perceptual meter
• begin of bar is marked by a vertical line
time signature
• conveys length of bar
note value
module 9.1: introduction to tempo & rhythm terminology 9 / 10
overview intro perception musical summary
summary
lecture content
perceptual terms
• onset, tempo, meter, rhythm
musical terms
• tempo, bar, time signature, note value, rhythm
accuracy range of interest
• 2–300 ms
module 9.1: introduction to tempo & rhythm terminology 10 / 10

More Related Content

Similar to 09-01-ACA-Temporal-Intro.pdf

MIR
MIRMIR
Transferring Singing Expressions from One Voice to Another for a Given Song
Transferring Singing Expressions from One Voice to Another for a Given SongTransferring Singing Expressions from One Voice to Another for a Given Song
Transferring Singing Expressions from One Voice to Another for a Given Song
NAVER Engineering
 
Mit21 m 380s12_complecnot
Mit21 m 380s12_complecnotMit21 m 380s12_complecnot
Mit21 m 380s12_complecnot
VenkateshKumar708402
 
Natural automatic musical note player using time-frequency analysis on human ...
Natural automatic musical note player using time-frequency analysis on human ...Natural automatic musical note player using time-frequency analysis on human ...
Natural automatic musical note player using time-frequency analysis on human ...
TELKOMNIKA JOURNAL
 
Interference and Beats
Interference and BeatsInterference and Beats
Interference and Beats
Mervé Fattah
 
Rhythm and Meter
Rhythm and MeterRhythm and Meter
Rhythm and Meter
Lumen Learning
 
Denktank 2010
Denktank 2010Denktank 2010
Denktank 2010
ocor203
 
this is about music SLAC Rhythm Maliwalo.pptx
this is about music SLAC Rhythm Maliwalo.pptxthis is about music SLAC Rhythm Maliwalo.pptx
this is about music SLAC Rhythm Maliwalo.pptx
revorevo3
 
Presentation for "Provas de Agergação" - 3 licao
Presentation for "Provas de Agergação" - 3 licaoPresentation for "Provas de Agergação" - 3 licao
Presentation for "Provas de Agergação" - 3 licao
Alvaro Barbosa
 
Rhythm and Meter
Rhythm and MeterRhythm and Meter
Rhythm and Meter
Lumen Learning
 
A Novel Method for Silence Removal in Sounds Produced by Percussive Instruments
A Novel Method for Silence Removal in Sounds Produced by Percussive InstrumentsA Novel Method for Silence Removal in Sounds Produced by Percussive Instruments
A Novel Method for Silence Removal in Sounds Produced by Percussive Instruments
IJMTST Journal
 
Cataloging sound recordings
Cataloging sound recordingsCataloging sound recordings
Cataloging sound recordings
Ime Amor Mortel
 
The 6 Elements Of A Mix
The 6 Elements Of A MixThe 6 Elements Of A Mix
The 6 Elements Of A Mix
Magic Finger Lounge
 
acoustics on human ear
acoustics on human earacoustics on human ear
acoustics on human ear
Abhishek kumar
 
Sound physics
Sound physicsSound physics
Sound physics
Pratik Nakrani
 
Trends in Answer Set-Programming - Focus Musik - Presentation
Trends in Answer Set-Programming - Focus Musik - PresentationTrends in Answer Set-Programming - Focus Musik - Presentation
Trends in Answer Set-Programming - Focus Musik - Presentation
Erhard Dinhobl
 
Analysis of Piano Duo Tempo Changes in Varying Convolution
Analysis of Piano Duo Tempo Changes in Varying ConvolutionAnalysis of Piano Duo Tempo Changes in Varying Convolution
Analysis of Piano Duo Tempo Changes in Varying Convolution
James Weaver
 
HUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATION
HUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATIONHUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATION
HUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATION
IRJET Journal
 
Human Perception and Recognition of Musical Instruments: A Review
Human Perception and Recognition of Musical Instruments: A ReviewHuman Perception and Recognition of Musical Instruments: A Review
Human Perception and Recognition of Musical Instruments: A Review
Editor IJCATR
 
Sound&amp;resonance
Sound&amp;resonanceSound&amp;resonance
Sound&amp;resonance
Subas Nandy
 

Similar to 09-01-ACA-Temporal-Intro.pdf (20)

MIR
MIRMIR
MIR
 
Transferring Singing Expressions from One Voice to Another for a Given Song
Transferring Singing Expressions from One Voice to Another for a Given SongTransferring Singing Expressions from One Voice to Another for a Given Song
Transferring Singing Expressions from One Voice to Another for a Given Song
 
Mit21 m 380s12_complecnot
Mit21 m 380s12_complecnotMit21 m 380s12_complecnot
Mit21 m 380s12_complecnot
 
Natural automatic musical note player using time-frequency analysis on human ...
Natural automatic musical note player using time-frequency analysis on human ...Natural automatic musical note player using time-frequency analysis on human ...
Natural automatic musical note player using time-frequency analysis on human ...
 
Interference and Beats
Interference and BeatsInterference and Beats
Interference and Beats
 
Rhythm and Meter
Rhythm and MeterRhythm and Meter
Rhythm and Meter
 
Denktank 2010
Denktank 2010Denktank 2010
Denktank 2010
 
this is about music SLAC Rhythm Maliwalo.pptx
this is about music SLAC Rhythm Maliwalo.pptxthis is about music SLAC Rhythm Maliwalo.pptx
this is about music SLAC Rhythm Maliwalo.pptx
 
Presentation for "Provas de Agergação" - 3 licao
Presentation for "Provas de Agergação" - 3 licaoPresentation for "Provas de Agergação" - 3 licao
Presentation for "Provas de Agergação" - 3 licao
 
Rhythm and Meter
Rhythm and MeterRhythm and Meter
Rhythm and Meter
 
A Novel Method for Silence Removal in Sounds Produced by Percussive Instruments
A Novel Method for Silence Removal in Sounds Produced by Percussive InstrumentsA Novel Method for Silence Removal in Sounds Produced by Percussive Instruments
A Novel Method for Silence Removal in Sounds Produced by Percussive Instruments
 
Cataloging sound recordings
Cataloging sound recordingsCataloging sound recordings
Cataloging sound recordings
 
The 6 Elements Of A Mix
The 6 Elements Of A MixThe 6 Elements Of A Mix
The 6 Elements Of A Mix
 
acoustics on human ear
acoustics on human earacoustics on human ear
acoustics on human ear
 
Sound physics
Sound physicsSound physics
Sound physics
 
Trends in Answer Set-Programming - Focus Musik - Presentation
Trends in Answer Set-Programming - Focus Musik - PresentationTrends in Answer Set-Programming - Focus Musik - Presentation
Trends in Answer Set-Programming - Focus Musik - Presentation
 
Analysis of Piano Duo Tempo Changes in Varying Convolution
Analysis of Piano Duo Tempo Changes in Varying ConvolutionAnalysis of Piano Duo Tempo Changes in Varying Convolution
Analysis of Piano Duo Tempo Changes in Varying Convolution
 
HUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATION
HUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATIONHUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATION
HUFFMAN CODING ALGORITHM BASED ADAPTIVE NOISE CANCELLATION
 
Human Perception and Recognition of Musical Instruments: A Review
Human Perception and Recognition of Musical Instruments: A ReviewHuman Perception and Recognition of Musical Instruments: A Review
Human Perception and Recognition of Musical Instruments: A Review
 
Sound&amp;resonance
Sound&amp;resonanceSound&amp;resonance
Sound&amp;resonance
 

More from AlexanderLerch4

0A-02-ACA-Fundamentals-Convolution.pdf
0A-02-ACA-Fundamentals-Convolution.pdf0A-02-ACA-Fundamentals-Convolution.pdf
0A-02-ACA-Fundamentals-Convolution.pdf
AlexanderLerch4
 
12-02-ACA-Genre.pdf
12-02-ACA-Genre.pdf12-02-ACA-Genre.pdf
12-02-ACA-Genre.pdf
AlexanderLerch4
 
10-02-ACA-Alignment.pdf
10-02-ACA-Alignment.pdf10-02-ACA-Alignment.pdf
10-02-ACA-Alignment.pdf
AlexanderLerch4
 
09-03-ACA-Temporal-Onsets.pdf
09-03-ACA-Temporal-Onsets.pdf09-03-ACA-Temporal-Onsets.pdf
09-03-ACA-Temporal-Onsets.pdf
AlexanderLerch4
 
13-00-ACA-Mood.pdf
13-00-ACA-Mood.pdf13-00-ACA-Mood.pdf
13-00-ACA-Mood.pdf
AlexanderLerch4
 
09-07-ACA-Temporal-Structure.pdf
09-07-ACA-Temporal-Structure.pdf09-07-ACA-Temporal-Structure.pdf
09-07-ACA-Temporal-Structure.pdf
AlexanderLerch4
 
07-06-ACA-Tonal-Chord.pdf
07-06-ACA-Tonal-Chord.pdf07-06-ACA-Tonal-Chord.pdf
07-06-ACA-Tonal-Chord.pdf
AlexanderLerch4
 
15-00-ACA-Music-Performance-Analysis.pdf
15-00-ACA-Music-Performance-Analysis.pdf15-00-ACA-Music-Performance-Analysis.pdf
15-00-ACA-Music-Performance-Analysis.pdf
AlexanderLerch4
 
12-01-ACA-Similarity.pdf
12-01-ACA-Similarity.pdf12-01-ACA-Similarity.pdf
12-01-ACA-Similarity.pdf
AlexanderLerch4
 
09-04-ACA-Temporal-BeatHisto.pdf
09-04-ACA-Temporal-BeatHisto.pdf09-04-ACA-Temporal-BeatHisto.pdf
09-04-ACA-Temporal-BeatHisto.pdf
AlexanderLerch4
 
09-05-ACA-Temporal-Tempo.pdf
09-05-ACA-Temporal-Tempo.pdf09-05-ACA-Temporal-Tempo.pdf
09-05-ACA-Temporal-Tempo.pdf
AlexanderLerch4
 
11-00-ACA-Fingerprinting.pdf
11-00-ACA-Fingerprinting.pdf11-00-ACA-Fingerprinting.pdf
11-00-ACA-Fingerprinting.pdf
AlexanderLerch4
 
08-00-ACA-Intensity.pdf
08-00-ACA-Intensity.pdf08-00-ACA-Intensity.pdf
08-00-ACA-Intensity.pdf
AlexanderLerch4
 
03-05-ACA-Input-Features.pdf
03-05-ACA-Input-Features.pdf03-05-ACA-Input-Features.pdf
03-05-ACA-Input-Features.pdf
AlexanderLerch4
 
07-03-03-ACA-Tonal-Monof0.pdf
07-03-03-ACA-Tonal-Monof0.pdf07-03-03-ACA-Tonal-Monof0.pdf
07-03-03-ACA-Tonal-Monof0.pdf
AlexanderLerch4
 
05-00-ACA-Data-Intro.pdf
05-00-ACA-Data-Intro.pdf05-00-ACA-Data-Intro.pdf
05-00-ACA-Data-Intro.pdf
AlexanderLerch4
 
07-03-05-ACA-Tonal-F0Eval.pdf
07-03-05-ACA-Tonal-F0Eval.pdf07-03-05-ACA-Tonal-F0Eval.pdf
07-03-05-ACA-Tonal-F0Eval.pdf
AlexanderLerch4
 
03-03-01-ACA-Input-TF-Fourier.pdf
03-03-01-ACA-Input-TF-Fourier.pdf03-03-01-ACA-Input-TF-Fourier.pdf
03-03-01-ACA-Input-TF-Fourier.pdf
AlexanderLerch4
 
03-06-ACA-Input-FeatureLearning.pdf
03-06-ACA-Input-FeatureLearning.pdf03-06-ACA-Input-FeatureLearning.pdf
03-06-ACA-Input-FeatureLearning.pdf
AlexanderLerch4
 
07-03-04-ACA-Tonal-Polyf0.pdf
07-03-04-ACA-Tonal-Polyf0.pdf07-03-04-ACA-Tonal-Polyf0.pdf
07-03-04-ACA-Tonal-Polyf0.pdf
AlexanderLerch4
 

More from AlexanderLerch4 (20)

0A-02-ACA-Fundamentals-Convolution.pdf
0A-02-ACA-Fundamentals-Convolution.pdf0A-02-ACA-Fundamentals-Convolution.pdf
0A-02-ACA-Fundamentals-Convolution.pdf
 
12-02-ACA-Genre.pdf
12-02-ACA-Genre.pdf12-02-ACA-Genre.pdf
12-02-ACA-Genre.pdf
 
10-02-ACA-Alignment.pdf
10-02-ACA-Alignment.pdf10-02-ACA-Alignment.pdf
10-02-ACA-Alignment.pdf
 
09-03-ACA-Temporal-Onsets.pdf
09-03-ACA-Temporal-Onsets.pdf09-03-ACA-Temporal-Onsets.pdf
09-03-ACA-Temporal-Onsets.pdf
 
13-00-ACA-Mood.pdf
13-00-ACA-Mood.pdf13-00-ACA-Mood.pdf
13-00-ACA-Mood.pdf
 
09-07-ACA-Temporal-Structure.pdf
09-07-ACA-Temporal-Structure.pdf09-07-ACA-Temporal-Structure.pdf
09-07-ACA-Temporal-Structure.pdf
 
07-06-ACA-Tonal-Chord.pdf
07-06-ACA-Tonal-Chord.pdf07-06-ACA-Tonal-Chord.pdf
07-06-ACA-Tonal-Chord.pdf
 
15-00-ACA-Music-Performance-Analysis.pdf
15-00-ACA-Music-Performance-Analysis.pdf15-00-ACA-Music-Performance-Analysis.pdf
15-00-ACA-Music-Performance-Analysis.pdf
 
12-01-ACA-Similarity.pdf
12-01-ACA-Similarity.pdf12-01-ACA-Similarity.pdf
12-01-ACA-Similarity.pdf
 
09-04-ACA-Temporal-BeatHisto.pdf
09-04-ACA-Temporal-BeatHisto.pdf09-04-ACA-Temporal-BeatHisto.pdf
09-04-ACA-Temporal-BeatHisto.pdf
 
09-05-ACA-Temporal-Tempo.pdf
09-05-ACA-Temporal-Tempo.pdf09-05-ACA-Temporal-Tempo.pdf
09-05-ACA-Temporal-Tempo.pdf
 
11-00-ACA-Fingerprinting.pdf
11-00-ACA-Fingerprinting.pdf11-00-ACA-Fingerprinting.pdf
11-00-ACA-Fingerprinting.pdf
 
08-00-ACA-Intensity.pdf
08-00-ACA-Intensity.pdf08-00-ACA-Intensity.pdf
08-00-ACA-Intensity.pdf
 
03-05-ACA-Input-Features.pdf
03-05-ACA-Input-Features.pdf03-05-ACA-Input-Features.pdf
03-05-ACA-Input-Features.pdf
 
07-03-03-ACA-Tonal-Monof0.pdf
07-03-03-ACA-Tonal-Monof0.pdf07-03-03-ACA-Tonal-Monof0.pdf
07-03-03-ACA-Tonal-Monof0.pdf
 
05-00-ACA-Data-Intro.pdf
05-00-ACA-Data-Intro.pdf05-00-ACA-Data-Intro.pdf
05-00-ACA-Data-Intro.pdf
 
07-03-05-ACA-Tonal-F0Eval.pdf
07-03-05-ACA-Tonal-F0Eval.pdf07-03-05-ACA-Tonal-F0Eval.pdf
07-03-05-ACA-Tonal-F0Eval.pdf
 
03-03-01-ACA-Input-TF-Fourier.pdf
03-03-01-ACA-Input-TF-Fourier.pdf03-03-01-ACA-Input-TF-Fourier.pdf
03-03-01-ACA-Input-TF-Fourier.pdf
 
03-06-ACA-Input-FeatureLearning.pdf
03-06-ACA-Input-FeatureLearning.pdf03-06-ACA-Input-FeatureLearning.pdf
03-06-ACA-Input-FeatureLearning.pdf
 
07-03-04-ACA-Tonal-Polyf0.pdf
07-03-04-ACA-Tonal-Polyf0.pdf07-03-04-ACA-Tonal-Polyf0.pdf
07-03-04-ACA-Tonal-Polyf0.pdf
 

Recently uploaded

Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
Pixlogix Infotech
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Zilliz
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Vladimir Iglovikov, Ph.D.
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 

Recently uploaded (20)

Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 

09-01-ACA-Temporal-Intro.pdf

  • 1. Introduction to Audio Content Analysis module 9.1: introduction to tempo & rhythm terminology alexander lerch
  • 2. overview intro perception musical summary introduction overview corresponding textbook section sections 9.1 & 9.2 lecture content • terminology for rhythm detection • perceptually motivated rhythm accuracy learning objectives • describe the terms onset, tempo, meter, bar, and rhythm • give two examples of typical onset times for musical instruments module 9.1: introduction to tempo & rhythm terminology 1 / 10
  • 3. overview intro perception musical summary introduction overview corresponding textbook section sections 9.1 & 9.2 lecture content • terminology for rhythm detection • perceptually motivated rhythm accuracy learning objectives • describe the terms onset, tempo, meter, bar, and rhythm • give two examples of typical onset times for musical instruments module 9.1: introduction to tempo & rhythm terminology 1 / 10
  • 4. overview intro perception musical summary temporal events introduction categorization of temporal parameters: • score parameters: structure, time signature, rhythm, . . . • performance parameters: tempo, timing, . . . perception of temporal parameters: • audio signal/stream is segmented into distinct events ⇒ onsets (segment start) • humans structure and group these events due to position, salience, . . . module 9.1: introduction to tempo & rhythm terminology 2 / 10
  • 5. overview intro perception musical summary temporal events introduction categorization of temporal parameters: • score parameters: structure, time signature, rhythm, . . . • performance parameters: tempo, timing, . . . perception of temporal parameters: • audio signal/stream is segmented into distinct events ⇒ onsets (segment start) • humans structure and group these events due to position, salience, . . . module 9.1: introduction to tempo & rhythm terminology 2 / 10
  • 6. overview intro perception musical summary human perception of temporal events introduction to onsets onset is start of a musical event properties: • position • strength, salience • length? module 9.1: introduction to tempo & rhythm terminology 3 / 10 matlab source: plotOnset.m
  • 7. overview intro perception musical summary human perception of temporal events initial transients percussive instruments: • 3-20 ms woodwind instruments: • up to 300 ms typical range for majority of instruments: • 15–50 ms module 9.1: introduction to tempo & rhythm terminology 4 / 10
  • 8. overview intro perception musical summary human perception of temporal events initial transients percussive instruments: • 3-20 ms woodwind instruments: • up to 300 ms typical range for majority of instruments: • 15–50 ms module 9.1: introduction to tempo & rhythm terminology 4 / 10
  • 9. overview intro perception musical summary human perception of temporal events human detection accuracy detection & discrimination of 2 subsequent onsets • detection ∆t > 2 ms, discrimination ∆t > 20 ms1 prediction of looped monophonic instrument onsets • IOI 600 ms: σ = 12 ms • IOI < 240 ms: σ = 10 ms manual onset time annotation • piano: mean abs. error: 4.3 ms, max: 35 ms • various: mean abs. error: 10 ms, max: 30 ms ensemble performance • string & woodwind: deviations up to 30-50 ms • piano: σ = 14 − 38 ms 1 I. J. Hirsh, “Auditory Perception of Temporal Order,” JASA, vol. 31, no. 6, p. 759, 1959. module 9.1: introduction to tempo & rhythm terminology 5 / 10
  • 10. overview intro perception musical summary human perception of temporal events human detection accuracy detection & discrimination of 2 subsequent onsets • detection ∆t > 2 ms, discrimination ∆t > 20 ms prediction of looped monophonic instrument onsets • IOI 600 ms: σ = 12 ms1 • IOI < 240 ms: σ = 10 ms2 manual onset time annotation • piano: mean abs. error: 4.3 ms, max: 35 ms • various: mean abs. error: 10 ms, max: 30 ms ensemble performance • string & woodwind: deviations up to 30-50 ms • piano: σ = 14 − 38 ms 1 J. W. Gordon, “Perception of Attack Transients in Musical Tones,” Dissertation, Stanford University, Center for Computer Research in Music and Acoustics (CCRMA), Stanford, 1984. 2 A. Friberg and J. Sundberg, “Perception of just noticeable time displacement of a tone presented in a Metrical Sequence at Different Tempos,” STL-QPSR, vol. 33, no. 4, pp. 97–108, 1992. module 9.1: introduction to tempo & rhythm terminology 5 / 10
  • 11. overview intro perception musical summary human perception of temporal events human detection accuracy detection & discrimination of 2 subsequent onsets • detection ∆t > 2 ms, discrimination ∆t > 20 ms prediction of looped monophonic instrument onsets • IOI 600 ms: σ = 12 ms • IOI < 240 ms: σ = 10 ms manual onset time annotation • piano: mean abs. error: 4.3 ms, max: 35 ms1 • various: mean abs. error: 10 ms, max: 30 ms2 ensemble performance • string & woodwind: deviations up to 30-50 ms • piano: σ = 14 − 38 ms 1 B. H. Repp, “Diversity and commonality in music performance: An analysis of timing microstructure in Schumann’s ’Träumerei’,” JASA, vol. 92, no. 5, pp. 2546–2568, 1992. 2 P. Leveau, L. Daudet, and G. Richard, “Methodology and Tools for the Evaluation of Automatic Onset Detection Algorithms in Music,” in ISMIR, Barcelona, 2004. module 9.1: introduction to tempo & rhythm terminology 5 / 10
  • 12. overview intro perception musical summary human perception of temporal events human detection accuracy detection & discrimination of 2 subsequent onsets • detection ∆t > 2 ms, discrimination ∆t > 20 ms prediction of looped monophonic instrument onsets • IOI 600 ms: σ = 12 ms • IOI < 240 ms: σ = 10 ms manual onset time annotation • piano: mean abs. error: 4.3 ms, max: 35 ms • various: mean abs. error: 10 ms, max: 30 ms ensemble performance • string & woodwind: deviations up to 30-50 ms1 • piano: σ = 14 − 38 ms2 1 R. A. Rasch, “Synchronization in Performed Ensemble Music,” Acustica, vol. 43, pp. 121–131, 1979. 2 L. H. Shaffer, “Timing in Solo and Duet Piano Performances,” Quarterly Journal of Experimental Psychology, vol. 36A, pp. 577–595, 1984. module 9.1: introduction to tempo & rhythm terminology 5 / 10
  • 13. overview intro perception musical summary human perception of temporal events offsets what about offsets/end of notes module 9.1: introduction to tempo & rhythm terminology 6 / 10
  • 14. overview intro perception musical summary human perception of temporal events offsets what about offsets/end of notes perceptually not as important as an onset • offset are often ignored in rhythm perception systematic difficulties: when does a note end? • performer stops excitation • instrument stops oscillation • listener cannot recognize it anymore practical difficulties: hard to detect • low volume • reverberation • masking module 9.1: introduction to tempo & rhythm terminology 6 / 10
  • 15. overview intro perception musical summary human perception of temporal events tempo, meter & rhythm tempo: perceived equal duration pulses at a “natural” rate — tactus • constant tempo T = B · 60 s ∆ts [BPM] • dynamic tempo Tlocal(j) = 60 s tb(j + 1) − tb(j) [BPM] • perceived overall tempo? ▶ average, main, mode, . . . meter • group of strong and weak musical elements/beats • typically 3 to 7 beats (app. 5 s) rhythm • group length 1–8 beats • defined by accents and time intervals module 9.1: introduction to tempo & rhythm terminology 7 / 10
  • 16. overview intro perception musical summary human perception of temporal events tempo, meter & rhythm tempo: perceived equal duration pulses at a “natural” rate — tactus • constant tempo T = B · 60 s ∆ts [BPM] • dynamic tempo Tlocal(j) = 60 s tb(j + 1) − tb(j) [BPM] • perceived overall tempo? ▶ average, main, mode, . . . meter • group of strong and weak musical elements/beats • typically 3 to 7 beats (app. 5 s) rhythm • group length 1–8 beats • defined by accents and time intervals module 9.1: introduction to tempo & rhythm terminology 7 / 10
  • 17. overview intro perception musical summary human perception of temporal events tempo, meter & rhythm tempo: perceived equal duration pulses at a “natural” rate — tactus • constant tempo T = B · 60 s ∆ts [BPM] • dynamic tempo Tlocal(j) = 60 s tb(j + 1) − tb(j) [BPM] • perceived overall tempo? ▶ average, main, mode, . . . meter • group of strong and weak musical elements/beats • typically 3 to 7 beats (app. 5 s) rhythm • group length 1–8 beats • defined by accents and time intervals module 9.1: introduction to tempo & rhythm terminology 7 / 10
  • 18. overview intro perception musical summary temporal events hierarchical structure module 9.1: introduction to tempo & rhythm terminology 8 / 10 matlab source: plotBeatHierarchy.m
  • 19. overview intro perception musical summary musical notation of temporal events tempo, time signature, bar & note value tempo • Largo, Adagio, Andante, Moderato, Allegro, Presto • ritardando, accelerando, . . . • modern scores: sometimes overall tempo in BPM bar • score equivalent of perceptual meter • begin of bar is marked by a vertical line time signature • conveys length of bar note value module 9.1: introduction to tempo & rhythm terminology 9 / 10
  • 20. overview intro perception musical summary summary lecture content perceptual terms • onset, tempo, meter, rhythm musical terms • tempo, bar, time signature, note value, rhythm accuracy range of interest • 2–300 ms module 9.1: introduction to tempo & rhythm terminology 10 / 10