Your SlideShare is downloading. ×
A Preliminary Evaluation of Music Visualization
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

A Preliminary Evaluation of Music Visualization

1,315
views

Published on

Literature review and exploration of music visualization as an Information Visualization research area. Presentation examines all forms of visual music, from 2d images and music videos to media player …

Literature review and exploration of music visualization as an Information Visualization research area. Presentation examines all forms of visual music, from 2d images and music videos to media player plug-ins and Computer Science publications.

Published in: Design

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,315
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. A Preliminary Evaluation of Music Visualization Danny Rado The “clavilux” [above] was invented by Thomas Wilfred in 1924
  • 2. ¿ Is Music Visualization  an area of research ?     Plan Motivation Everyday music visualizations Research The very best of music visualizations Discussion Identify some key issues for the field Determine why the field is underdeveloped
  • 3. Motivation :: Karaoke
    • Karaoke sounds bad because it is difficult:
      • The text gives little music information
      • User must rely on memory
  • 4. Motivation :: Personal
    • AI project:
      • LongSong: Automatic Song Extension 
    •  
    • Songs can be extended at theme repetitions
    • Identifying theme structure by sound is difficult
    • The identification is simple with a 2D visualization:
    Martin Wattenburg, http://www.bewitched.com/match/music.html
  • 5. Motivation :: Music Informatics
    • Music information that requires visualization:
      • Interaction of instruments
      • Tonality, movement of tonal center
      • Rhythm
      • Relationship between notes
        • Consonance, dissonance, triadic relationships
      •   Harmonic Analysis
      • Phrase Structure
      • Note spelling
    Bach, Minuet G Major
  • 6. Itunes Visualization Effects are generated on sound events These visualizations give less information than the standard music video
  • 7. Windows Media Player Visualization Frequency bars are the most informative visualizations Still not portraying any depth of music visualization
  • 8. Winamp Visualization Stick Figures plug-in allows users to create drawings and animate them to a few frequencies Gives semantic meaning to music information making it easier to identify and follow
  • 9. Media Player Visualization Review
      • Equivalent to music video screen savers
      • Simply hypnotic, psychedelic imagery
    •  
    • Despite the useful framework for plug-ins, the creative effort is effectively wasted
      • Frequencies simply have little inherent information
  • 10. The Standard Music Video
    • Not a visualization
      • Limited information is obscured by performance, creativity, and celebrity
    Shows the instruments being played   Serves as a baseline to measure the success of music visualizations
  • 11. The Important Music Video Hints at the structure of the music Graphics are repeated on musical theme repetition
  • 12. Music Format
      • Standard music formats do not have enough information
    •  
    • MIDI format has far more information
    •  
    • Instead of audio information, 
    • MIDI stores composition information:
      • Instruments
      • Note times
      • Note intensities
      • Changes in pitch
      • Changes in rhythm 
    •  
    • MIDI creates the opportunity to visualize music
  • 13. MIDI Text [Midi Disassembler]
      • MThd | Format=1 | # of Tracks=8 | Division=384 Track #0 ******************************************     Time       Event    1: 1:  0 |Tempo     | BPM=140   | microsquarter=428570         |Time Sig     |  4/4      | MIDI-clocksclick=24 | 32ndsquarter=8  106: 1:  0 |End of track| Track #1 ******************************************     Time       Event    1: 1:  0 |Track Name  | len=9     |         0x31 0x73 0x74 0x20 0x56 0x6F 0x69 0x63 0x65       <1st Voice>    9: 1:  0 |Program     | chan=14   | pgm #= 54 Choir Oohs         |Controller  | chan=14   | contr=Volume H | value=100      96 |Controller  | chan=14   | contr=Effects | value= 40       3:  0 |On Note     | chan=14   | pitch=F 3     | vol=127     336 |Off Note     | chan=14   | pitch=f 3     | vol=127       4:  0 |On Note     | chan=14   | pitch=G 3     | vol=127     336 |Off Note     | chan=14   | pitch=g 3     | vol=127   10: 1:  0 |On Note     | chan=14   | pitch=A 3     | vol=127     336 |Off Note     | chan=14   | pitch=a 3     | vol=127       2:  0 |On Note     | chan=14   | pitch=G 3     | vol=127       4:332 |Off Note     | chan=14   | pitch=g 3     | vol=127
      • [Skipping ahead]
      • Track #5 ******************************************     Time       Event    1: 1:  0 |Track Name  | len=7     |         0x54 0x72 0x75 0x6D 0x70 0x65 0x74               <Trumpet>    2: 1:  0 |Controller  | chan= 4   | contr=Effects | value= 40         |Program     | chan= 4   | pgm #= 57 Trumpet         |Controller  | chan= 4   | contr=Volume H | value=100       1 |On Note     | chan= 4   | pitch=F 2     | vol=62      
  • 14. UIUC Research: Isochords
    • Isochords: Visualizing Structure in Music,
      •   Helps classify music structure with information about:
        • chord quality
        • interval quality
        • chord progression
      • http://social.cs.uiuc.edu/projects/isochords-movies/Here%20Comes%20the%20Sun.mov
    •  
    • University of Illinois,
    • Urbana Champaign
  • 15. UL + CUL Research: i-Maestro
    • 3D Augmented Mirror: A Multimodal Interface for String Instrument Learning and Teaching with Gesture Support
      •   Prevent or repair bad performance posture
    • University of Leeds + City University of London
  • 16. USC Research: MuSA.RT
    • MuSA.RT: Music on the Spiral Array . Real-Time
      •   a multimodal interactive system for music analysis and visualization
      •   3D model, shows tonal structures such as pitches, chords and keys.
  • 17. Applications: Animusic
    • Manually Animated Music Visualizations
      •   Invent virtual instruments that often resemble real ones
      •   Visualizations present some limited music information
  • 18. Applications: MidiJam
    • Automatically Animated Music Visualizations
      • Shows interaction between real instruments and animates their performance
  • 19. Applications: Music Animation Machine
    • Program has many display types:
    • Piano Roll [right] , Pitch Class Wheel, Interval Wheel, Interval + Pitch, Shapes,
    • Tonality Staff, Tonality Compass, Triads Lattice, Parts Sequence:
      • Lines
      • Balls
      • Wedges
  • 20. Applications: Music Animation Machine
    • Program has many display types:
    • Piano Roll, 
    • Pitch Class Wheel, Interval Wheel, Interval + Pitch, Shapes,
    • Tonality Staff, Tonality Compass, Triads Lattice, Parts Sequence:
      • Lines
      • Balls [right]
      • Wedges
  • 21. Conclusion:
    • Despite the common perception that Music Visualization is not an area of research, significant work has been done.
    Beethoven, Fur Elise
  • 22. Discussion:
      • Does the Music Visualization research seem substantial?
      • Why are there so few publications in the field?
        • ACM Portal has less than 35
      • Can we identify some key issues for the field?