My Master Research Plan

477 views

Published on

This is my master research plan.
My research is related to computer music.
Especially, It focus to Score Tracking.
Score Tracking is one of the method to check a current position from musical score.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
477
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

My Master Research Plan

  1. 1. Real-Time Score TrackingUsing Hidden Markov Models m5151154 Kousuke Sato Computer Arts lab Supervised by Satoshi Nishimura
  2. 2. Outline Score Tracking Applications Related Research(technology) Problem and Approach Current Status Future plan References
  3. 3. Score Tracking  Score Tracking It locates the performance position when we play a musical instrument. Player Score B♭ A GPlaying notes : B♭→A → G Playing here
  4. 4. Applications of Score Tracking Learning tool for musical instruments ・ Automatic Accompaniment System ・ Score-Viewing System with Automatic Scrolling
  5. 5. Target users beginners of musical instruments ・ Automatic Accompaniment System ・ Score-Viewing System with Automatic Scrolling Conductor ・ Score-Viewing System with Automatic Scrolling
  6. 6. Related technology Pattern recognition・DP MatchingThe matching algorithm using matrix.It is able to decide matching mathematically.・HMM(Hidden Markov Model) A state transition model with probabilities.
  7. 7. System overview Input Audio(wave) Musical score signal Fourier Generate transform ideal spectrum Spectrum Ideal data(audio) Spectrum data similarity analysis Hidden Markov Model Output
  8. 8. Related research “A hybrid graphical model for aligning polyphonic audio with musical scores” C.Raphael, Proc.ISMIR, Barcelona,Spain,2004 ・Search notes from current state, rear state and front state. ・Not match a sound refusing, it changes in the next state State 1 State 2 State 3 ・・・ State N-1 State N Provisional state
  9. 9. Related research “Real-Time Musical Score Tracking System Using a Performance Position Analysis Algorithm” M.Yoshizawa, University of Aizu, March,2009. ・Search notes from all states ・The system can cope all cases State 1 State 2 State 3 ・・・ State N-1 State N Provisional state
  10. 10. Problem Problem It is too much computational complexity when using past technology. → not usable in real time
  11. 11. Approaches for reducingcalculation Pruning ・Searching with precedence →reduce a useless calculation in the Viterbi algorithm Index of the search ・Classifying score fragments by conditions → reduce useless calculation.
  12. 12. Current statusI read the papers of past researches Studied the related technology ・DP Matching ・HMM(Hidden Markov Model) and more…
  13. 13. Future plan Sep.2011~Oct.2011 I reproduce the system of a past researches. Understanding the movement. Nov.2011~Mar.2012 Design new algorithm and design new system. Apr.2012~Sep.2012 Run a system and evaluate it. Look for an improvement Oct.2012~ Writing research paper Look for an improvement
  14. 14. References “A hybrid graphical model for aligning polyphonic audio with musical scores” C. Raphael, Proc. ISMIR, Barcelona,Spain,2004 “Real-Time Musical Score Tracking System Using a Performance Position Analysis Algorithm” M. Yoshizawa, University of Aizu, March,2009. “A Performance Position Analysis Algorithm for Automatic Accompaniment” M. Maekawa, University of Aizu, March,2008 “Score following using spectral analysis and hidden markov models” Orio N, Dechelle F, Proceedings of the ICMA,2001

×