Oral

Student: Ting-Ting Chou Advisor: Dr. Herng-Yow Chen Dr. Keh-Ning Chang 11/23/09 即時跟譜系統及其應用

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],11/23/09

[object Object],[object Object],[object Object],11/23/09

11/23/09 MIDI Event Audio Signal Feature Extraction FFT, peak structure match … Match Algorithm Page Turner, Accompaniment Implementation Target Score

11/23/09 International Computer Music Conference’84 An On-Line Algorithm for Real-Time Accompaniment Roger B. Dannenberg

11/23/09 ACM International Conference on Multimedia’ 04 Family Ensemble Chika Oshima et al Place Number of mistakes % Extra 7 1.2 Wrong 37 6.1 Missing 3 0.5 Replaying 1 st beat 156 75.4 2 nd downbeat 19 3.1 Last beat 6 1.0 Start of phrase 5 0.8 Alternation 4 0.7 1 st beat(pre-bar) 51 8.4 Last beat(pre-bar) 5 0.8 Start of piece 10 1.7 Start of column 2 0.3 Sum 605 100.0

11/23/09 Score MIDI Keyboard Score following algorithm Optical Music Recognition (OMR) User Interface Score (MIDI Format) Performance (MIDI Event) Position of Notes User

[object Object],11/23/09 E4 C5 C5 E4 A4 A4 C4 G4 E4 t d t d t d t d t d t d t d t d Leading note following note ,[object Object],[object Object],[object Object],Smallest duration time

[object Object],The DP cost function w( i , j ) is initialized by setting: i: ID of performance MIDI events. j: ID of note set of the score. P i : Note of the performance event at current time t i S j : Note set of the score W( i , j ): The weight of element ( i , j )

11/23/09 Notes in the score Performed notes …… 48 67 72 76 43 67 71

11/23/09 Notes in the score Performed notes 48 67 72 76 43 67 71 48 1 0 0 0 0 0 0

11/23/09 Notes in the score Performed notes 48 67 72 76 43 67 71 48 1 0 0 0 0 0 0 67 0 2 0 0 0 1 0

11/23/09 Notes in the score Performed notes 48 67 72 76 43 67 71 48 1 0 0 0 0 0 0 67 0 2 0 0 0 1 0 70 0 0 1 0 0 0 0

11/23/09 Notes in the score Performed notes 48 67 72 76 43 67 71 48 1 0 0 0 0 0 0 67 0 2 0 0 0 1 0 70 0 0 1 0 0 0 0 76 0 0 0 2 0 0 0

11/23/09 Notes in the score Performed notes 48 67 72 76 43 67 71 48 1 0 0 0 0 0 0 67 0 2 0 0 0 1 0 70 0 0 1 0 0 0 0 76 0 0 0 2 0 0 0 43 0 0 0 0 3 0 0

11/23/09 Notes in the score Performed notes 48 67 72 76 43 67 71 48 1 0 0 0 0 0 0 67 0 2 0 0 0 1 0 70 0 0 1 0 0 0 0 76 0 0 0 2 0 0 0 43 0 0 0 0 3 0 0 67 0 1 0 0 0 4 0

11/23/09 Notes in the score Performed notes 48 67 72 76 43 67 71 48 1 0 0 0 0 0 0 67 0 2 0 0 0 1 0 70 0 0 1 0 0 0 0 76 0 0 0 2 0 0 0 43 0 0 0 0 3 0 0 67 0 1 0 0 0 4 0 67 0 1 0 0 0 0 3

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],11/23/09 N: 1 3 3 3 3 1 1 1 3 3

11/23/09 score Performed notes …… …… 49 66 69 42 66 69 49 66 69 72 60 48 77 65 77 65 53 79 67

11/23/09 Notes in the score Performed notes …… …… 72 60 48 77 65 77 65 53 79 67 Leading, 72 1 0 0 0

11/23/09 Notes in the score Performed notes …… …… 72 60 48 77 65 77 65 53 79 67 Leading, 72 1 0 0 0 Following, 48 1 + 2/3 0 + 0/2 0 + 0/3 0 + 0/2

11/23/09 Notes in the score Performed notes …… …… 72 60 48 77 65 77 65 53 79 67 Leading, 72 1 0 0 0 Following, 48 1.67 0 0 0 Following, 60 1 + 3/3 0 + 0/2 0 + 0/3 0 + 0/2

11/23/09 Notes in the score Performed notes …… …… 72 60 48 77 65 77 65 53 79 67 Leading, 72 1 0 0 0 Following, 48 1.67 0 0 0 Following, 60 2 0 0 0 Leading, 77 0 3 1 0

11/23/09 Notes in the score Performed notes …… …… 72 60 48 77 65 77 65 53 79 67 Leading, 72 1 0 0 0 Following, 48 1.67 0 0 0 Following, 60 2 0 0 0 Leading, 77 0 3 1 0 Following, 67 0 + 0/3 3 + 1/2 1 + 1/3 0 + 1/2

11/23/09 Notes in the score Performed notes …… …… 72 60 48 77 65 77 65 53 79 67 Leading, 72 1 0 0 0 Following, 48 1.67 0 0 0 Following, 60 2 0 0 0 Leading, 77 0 3 1 0 Following, 67 0 3.5 1.33 0.5 Leading, 79 0 0 2.5 2.33

11/23/09 Notes in the score Performed notes …… …… 72 60 48 77 65 77 65 53 79 67 Leading, 72 1 0 0 0 Following, 48 1.67 0 0 0 Following, 60 2 0 0 0 Leading, 77 0 3 1 0 Following, 67 0 3.5 1.33 0.5 Leading, 79 0 0 2.5 2.33 Following, 65 0 0.5 2.83 2.33 Following, 53 0 0 3.17 2.33 Leading, 79 0 0 0 4.17 Following, 65 0 0.5 0.33 4.67

[object Object],11/23/09 error S 1 S 5 S 10 S 16 S 21 S 26 S 29 Weight = cur_weight Weight = cur_weight- 1 cur_weight = w(current position+1, j )

[object Object],11/23/09 error Weight = cur_weight Weight => cur_weight - 1 cur_weight = w(current position+1, j )

[object Object],[object Object],[object Object],[object Object],11/23/09

11/23/09 C4 G4 E5 W( i , j ) = W( i-1 , j-1) + 1 W( i , j+1 ) = W( i , j) + 2/3 W( i , j+2 ) = W( i , j) + 3/3 C4 F4(X) E5 W( i , j ) = W( i-1 , j-1) + 1 W( i , j+1 ) = W( i-1 , j-1) + 1/3 W( i , j+2 ) = W( i-1 , j-1) + 2/3

Oral

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (17)

Recently uploaded

Recently uploaded (20)

Oral