SlideShare a Scribd company logo
1 of 32
Download to read offline
An Introduction to Music Technology
1020
Xiang Cao
• Computer Science from Zhejiang University
• Music Technology from Georgia Tech
• Apple Inc.
Agenda
• Different fields of music technology
• Show some examples from myself and others in
selected fields
Music Technology as a field of study and research
• Music Information Retrieval (MIR)
• New Musical Instrument Design
• Robotic Musicianship
• Electronic Music
• Psychoacoustics
• and more…
Music Information Retrieval - How to make it
• Music Information Retrieval (MIR)
• Apply computer algorithm on music as a series of
signal
• Involve Pattern recognition, machine learning, DSP, etc…
• Basics like beat, key, genre, pitch and chord detection.
Music Information Retrieval - Example
• Automatic Accompaniment
Music Information Retrieval - Example
• Automatic Accompaniment
Music Information Retrieval - Example
• Automatic Accompaniment
Music Information Retrieval - Example
• Automatic Accompaniment
New Musical Instrument Design - Where is my
New Musical Instrument Design - Where is my
• Traditional string instruments like piano and guitar are
dated back to hundreds of years ago
New Musical Instrument Design - Where is my
• Traditional string instruments like piano and guitar are
dated back to hundreds of years ago
• With technology, musical instruments are not bounded in
their traditional forms any more
New Musical Instrument Design - Where is my
• Traditional string instruments like piano and guitar are
dated back to hundreds of years ago
• With technology, musical instruments are not bounded in
their traditional forms any more
• Theremin: one of the first electronic musical instrument
New Musical Instrument Design - Where is my
• Traditional string instruments like piano and guitar are
dated back to hundreds of years ago
• With technology, musical instruments are not bounded in
their traditional forms any more
• Theremin: one of the first electronic musical instrument
New Musical Instrument Design - Example
New Musical Instrument Design - Example
• wanna have a rock band but cannot afford any instruments?
New Musical Instrument Design - Example
• wanna have a rock band but cannot afford any instruments?
New Musical Instrument Design - Example
• wanna have a rock band but cannot afford any instruments?
Robotic Musicianship - Whom should I play with?
• The ultimate human-computer interaction in music
Robotic Musicianship - Whom should I play with?
• The ultimate human-computer interaction in music
Electronic Music - Is this still music?
Electronic Music - Is this still music?
• Algorithm synthesized sound are manipulated by
controllers, sensor or code
Electronic Music - Is this still music?
• Algorithm synthesized sound are manipulated by
controllers, sensor or code
• Computer languages are invented to compose music.
Electronic Music - Is this still music?
• Algorithm synthesized sound are manipulated by
controllers, sensor or code
• Computer languages are invented to compose music.
• Sometimes, the music is composed to showcase
technology
Electronic Music - Is this still music?
• Algorithm synthesized sound are manipulated by
controllers, sensor or code
• Computer languages are invented to compose music.
• Sometimes, the music is composed to showcase
technology
• Read the document before listening!
Electronic Music - Is this still music?
• Algorithm synthesized sound are manipulated by
controllers, sensor or code
• Computer languages are invented to compose music.
• Sometimes, the music is composed to showcase
technology
• Read the document before listening!
• Live coding in a performance!
Electronic Music - Example
• Stanford Laptop Orchestra
Electronic Music - Example
• Stanford Laptop Orchestra
Q&A

More Related Content

Similar to Introduction musictech

Genre Classification and Analysis
Genre Classification and AnalysisGenre Classification and Analysis
Genre Classification and AnalysisAnat Gilboa
 
20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mir20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mirYi-Hsuan Yang
 
Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017Yi-Hsuan Yang
 
AI for the Classical Musician (PowerPoint).pptx
AI for the Classical Musician (PowerPoint).pptxAI for the Classical Musician (PowerPoint).pptx
AI for the Classical Musician (PowerPoint).pptxLola McIntyre, M.M.
 
Denktank 2010
Denktank 2010Denktank 2010
Denktank 2010ocor203
 
Music Objects to Social Machines
Music Objects to Social MachinesMusic Objects to Social Machines
Music Objects to Social MachinesDavid De Roure
 
Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)Yi-Hsuan Yang
 
20211026 taicca 2 music generation
20211026 taicca 2 music generation20211026 taicca 2 music generation
20211026 taicca 2 music generationYi-Hsuan Yang
 
Music Industry: Technology
Music Industry: TechnologyMusic Industry: Technology
Music Industry: TechnologyNicola Naisbett
 
Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adam Sporka
 
The Wonder of Digitizing Artifacts Left Behind by Our Kindred Dead
The Wonder of Digitizing Artifacts Left Behind by Our Kindred DeadThe Wonder of Digitizing Artifacts Left Behind by Our Kindred Dead
The Wonder of Digitizing Artifacts Left Behind by Our Kindred DeadRsMom
 
Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016
Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016
Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016Wojciech Franke
 
Prelude 1 Enjoyment of Music 3rd Ed.
Prelude 1 Enjoyment of Music 3rd Ed.Prelude 1 Enjoyment of Music 3rd Ed.
Prelude 1 Enjoyment of Music 3rd Ed.Laura Riddle
 
Prelude 1 Listening to Music Today
Prelude 1 Listening to Music TodayPrelude 1 Listening to Music Today
Prelude 1 Listening to Music TodayLaura Riddle
 
Lesson 1.1 Why Music Theory is Important
Lesson 1.1 Why Music Theory is Important Lesson 1.1 Why Music Theory is Important
Lesson 1.1 Why Music Theory is Important tylerjustinhughes
 
Music Information Retrieval: Overview and Current Trends 2008
Music Information Retrieval: Overview and Current Trends 2008Music Information Retrieval: Overview and Current Trends 2008
Music Information Retrieval: Overview and Current Trends 2008Rui Pedro Paiva
 
"All you need is AI and music" by Keunwoo Choi
"All you need is AI and music" by Keunwoo Choi"All you need is AI and music" by Keunwoo Choi
"All you need is AI and music" by Keunwoo ChoiKeunwoo Choi
 
MA: Presentation Seminar
MA: Presentation SeminarMA: Presentation Seminar
MA: Presentation Seminarelmidodd
 

Similar to Introduction musictech (20)

楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索
 
Genre Classification and Analysis
Genre Classification and AnalysisGenre Classification and Analysis
Genre Classification and Analysis
 
20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mir20211026 taicca 1 intro to mir
20211026 taicca 1 intro to mir
 
Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017
 
AI for the Classical Musician (PowerPoint).pptx
AI for the Classical Musician (PowerPoint).pptxAI for the Classical Musician (PowerPoint).pptx
AI for the Classical Musician (PowerPoint).pptx
 
Denktank 2010
Denktank 2010Denktank 2010
Denktank 2010
 
Music Objects to Social Machines
Music Objects to Social MachinesMusic Objects to Social Machines
Music Objects to Social Machines
 
Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)Machine learning for creative AI applications in music (2018 nov)
Machine learning for creative AI applications in music (2018 nov)
 
20211026 taicca 2 music generation
20211026 taicca 2 music generation20211026 taicca 2 music generation
20211026 taicca 2 music generation
 
Edm
EdmEdm
Edm
 
Music Industry: Technology
Music Industry: TechnologyMusic Industry: Technology
Music Industry: Technology
 
Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)
 
The Wonder of Digitizing Artifacts Left Behind by Our Kindred Dead
The Wonder of Digitizing Artifacts Left Behind by Our Kindred DeadThe Wonder of Digitizing Artifacts Left Behind by Our Kindred Dead
The Wonder of Digitizing Artifacts Left Behind by Our Kindred Dead
 
Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016
Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016
Wojciech Franke - Composing music with clojure.spec - Clojure/conj 2016
 
Prelude 1 Enjoyment of Music 3rd Ed.
Prelude 1 Enjoyment of Music 3rd Ed.Prelude 1 Enjoyment of Music 3rd Ed.
Prelude 1 Enjoyment of Music 3rd Ed.
 
Prelude 1 Listening to Music Today
Prelude 1 Listening to Music TodayPrelude 1 Listening to Music Today
Prelude 1 Listening to Music Today
 
Lesson 1.1 Why Music Theory is Important
Lesson 1.1 Why Music Theory is Important Lesson 1.1 Why Music Theory is Important
Lesson 1.1 Why Music Theory is Important
 
Music Information Retrieval: Overview and Current Trends 2008
Music Information Retrieval: Overview and Current Trends 2008Music Information Retrieval: Overview and Current Trends 2008
Music Information Retrieval: Overview and Current Trends 2008
 
"All you need is AI and music" by Keunwoo Choi
"All you need is AI and music" by Keunwoo Choi"All you need is AI and music" by Keunwoo Choi
"All you need is AI and music" by Keunwoo Choi
 
MA: Presentation Seminar
MA: Presentation SeminarMA: Presentation Seminar
MA: Presentation Seminar
 

More from Jia Liu

Vincy cheung1020
Vincy cheung1020Vincy cheung1020
Vincy cheung1020Jia Liu
 
Extreme land new_york_pm_def
Extreme land new_york_pm_defExtreme land new_york_pm_def
Extreme land new_york_pm_defJia Liu
 
Extreme land new_york_pm_def
Extreme land new_york_pm_defExtreme land new_york_pm_def
Extreme land new_york_pm_defJia Liu
 
Yang renqian2014s
Yang renqian2014sYang renqian2014s
Yang renqian2014sJia Liu
 
Using representational languge to paint the abstract
Using representational languge to paint the abstractUsing representational languge to paint the abstract
Using representational languge to paint the abstractJia Liu
 
140719 de perio-1020_particle_physics
140719 de perio-1020_particle_physics140719 de perio-1020_particle_physics
140719 de perio-1020_particle_physicsJia Liu
 
1020 ppt
1020 ppt1020 ppt
1020 pptJia Liu
 
11.3.2013.1020 xiao
11.3.2013.1020 xiao11.3.2013.1020 xiao
11.3.2013.1020 xiaoJia Liu
 
Zx 110313
Zx 110313Zx 110313
Zx 110313Jia Liu
 
Our muslim neighbor deng beiyin
Our muslim neighbor deng beiyinOur muslim neighbor deng beiyin
Our muslim neighbor deng beiyinJia Liu
 
Rules of play_1020_120dpi
Rules of play_1020_120dpiRules of play_1020_120dpi
Rules of play_1020_120dpiJia Liu
 
Miao jiaxin's presentation for 1020
Miao jiaxin's presentation for 1020Miao jiaxin's presentation for 1020
Miao jiaxin's presentation for 1020Jia Liu
 
Luo 1020 v_f
Luo 1020 v_fLuo 1020 v_f
Luo 1020 v_fJia Liu
 
Ldc impressionist exhibitions
Ldc impressionist exhibitionsLdc impressionist exhibitions
Ldc impressionist exhibitionsJia Liu
 
Eric ku presentation
Eric ku presentationEric ku presentation
Eric ku presentationJia Liu
 
How to do things with theory
How to do things with theoryHow to do things with theory
How to do things with theoryJia Liu
 
Lifetime fairytale zhu yi
Lifetime fairytale   zhu yiLifetime fairytale   zhu yi
Lifetime fairytale zhu yiJia Liu
 
Delirious new york zhong nianlai
Delirious new york   zhong nianlaiDelirious new york   zhong nianlai
Delirious new york zhong nianlaiJia Liu
 
4 dimentional animal chen sijing
4 dimentional animal    chen sijing4 dimentional animal    chen sijing
4 dimentional animal chen sijingJia Liu
 

More from Jia Liu (20)

Vincy cheung1020
Vincy cheung1020Vincy cheung1020
Vincy cheung1020
 
Extreme land new_york_pm_def
Extreme land new_york_pm_defExtreme land new_york_pm_def
Extreme land new_york_pm_def
 
Extreme land new_york_pm_def
Extreme land new_york_pm_defExtreme land new_york_pm_def
Extreme land new_york_pm_def
 
Yang renqian2014s
Yang renqian2014sYang renqian2014s
Yang renqian2014s
 
Using representational languge to paint the abstract
Using representational languge to paint the abstractUsing representational languge to paint the abstract
Using representational languge to paint the abstract
 
140719 de perio-1020_particle_physics
140719 de perio-1020_particle_physics140719 de perio-1020_particle_physics
140719 de perio-1020_particle_physics
 
1020 ppt
1020 ppt1020 ppt
1020 ppt
 
1020 ny
1020 ny1020 ny
1020 ny
 
11.3.2013.1020 xiao
11.3.2013.1020 xiao11.3.2013.1020 xiao
11.3.2013.1020 xiao
 
Zx 110313
Zx 110313Zx 110313
Zx 110313
 
Our muslim neighbor deng beiyin
Our muslim neighbor deng beiyinOur muslim neighbor deng beiyin
Our muslim neighbor deng beiyin
 
Rules of play_1020_120dpi
Rules of play_1020_120dpiRules of play_1020_120dpi
Rules of play_1020_120dpi
 
Miao jiaxin's presentation for 1020
Miao jiaxin's presentation for 1020Miao jiaxin's presentation for 1020
Miao jiaxin's presentation for 1020
 
Luo 1020 v_f
Luo 1020 v_fLuo 1020 v_f
Luo 1020 v_f
 
Ldc impressionist exhibitions
Ldc impressionist exhibitionsLdc impressionist exhibitions
Ldc impressionist exhibitions
 
Eric ku presentation
Eric ku presentationEric ku presentation
Eric ku presentation
 
How to do things with theory
How to do things with theoryHow to do things with theory
How to do things with theory
 
Lifetime fairytale zhu yi
Lifetime fairytale   zhu yiLifetime fairytale   zhu yi
Lifetime fairytale zhu yi
 
Delirious new york zhong nianlai
Delirious new york   zhong nianlaiDelirious new york   zhong nianlai
Delirious new york zhong nianlai
 
4 dimentional animal chen sijing
4 dimentional animal    chen sijing4 dimentional animal    chen sijing
4 dimentional animal chen sijing
 

Introduction musictech

  • 1. An Introduction to Music Technology 1020
  • 2.
  • 3.
  • 4.
  • 5. Xiang Cao • Computer Science from Zhejiang University • Music Technology from Georgia Tech • Apple Inc.
  • 6. Agenda • Different fields of music technology • Show some examples from myself and others in selected fields
  • 7. Music Technology as a field of study and research • Music Information Retrieval (MIR) • New Musical Instrument Design • Robotic Musicianship • Electronic Music • Psychoacoustics • and more…
  • 8. Music Information Retrieval - How to make it • Music Information Retrieval (MIR) • Apply computer algorithm on music as a series of signal • Involve Pattern recognition, machine learning, DSP, etc… • Basics like beat, key, genre, pitch and chord detection.
  • 9. Music Information Retrieval - Example • Automatic Accompaniment
  • 10. Music Information Retrieval - Example • Automatic Accompaniment
  • 11. Music Information Retrieval - Example • Automatic Accompaniment
  • 12. Music Information Retrieval - Example • Automatic Accompaniment
  • 13. New Musical Instrument Design - Where is my
  • 14. New Musical Instrument Design - Where is my • Traditional string instruments like piano and guitar are dated back to hundreds of years ago
  • 15. New Musical Instrument Design - Where is my • Traditional string instruments like piano and guitar are dated back to hundreds of years ago • With technology, musical instruments are not bounded in their traditional forms any more
  • 16. New Musical Instrument Design - Where is my • Traditional string instruments like piano and guitar are dated back to hundreds of years ago • With technology, musical instruments are not bounded in their traditional forms any more • Theremin: one of the first electronic musical instrument
  • 17. New Musical Instrument Design - Where is my • Traditional string instruments like piano and guitar are dated back to hundreds of years ago • With technology, musical instruments are not bounded in their traditional forms any more • Theremin: one of the first electronic musical instrument
  • 18. New Musical Instrument Design - Example
  • 19. New Musical Instrument Design - Example • wanna have a rock band but cannot afford any instruments?
  • 20. New Musical Instrument Design - Example • wanna have a rock band but cannot afford any instruments?
  • 21. New Musical Instrument Design - Example • wanna have a rock band but cannot afford any instruments?
  • 22. Robotic Musicianship - Whom should I play with? • The ultimate human-computer interaction in music
  • 23. Robotic Musicianship - Whom should I play with? • The ultimate human-computer interaction in music
  • 24. Electronic Music - Is this still music?
  • 25. Electronic Music - Is this still music? • Algorithm synthesized sound are manipulated by controllers, sensor or code
  • 26. Electronic Music - Is this still music? • Algorithm synthesized sound are manipulated by controllers, sensor or code • Computer languages are invented to compose music.
  • 27. Electronic Music - Is this still music? • Algorithm synthesized sound are manipulated by controllers, sensor or code • Computer languages are invented to compose music. • Sometimes, the music is composed to showcase technology
  • 28. Electronic Music - Is this still music? • Algorithm synthesized sound are manipulated by controllers, sensor or code • Computer languages are invented to compose music. • Sometimes, the music is composed to showcase technology • Read the document before listening!
  • 29. Electronic Music - Is this still music? • Algorithm synthesized sound are manipulated by controllers, sensor or code • Computer languages are invented to compose music. • Sometimes, the music is composed to showcase technology • Read the document before listening! • Live coding in a performance!
  • 30. Electronic Music - Example • Stanford Laptop Orchestra
  • 31. Electronic Music - Example • Stanford Laptop Orchestra
  • 32. Q&A