slides presented at a three-hour local AI music course in Taiwan in Oct 2021; part 3: state-of-the-art tools for music analysis

1. http://mac.citi.sinica.edu.tw/~yang/
yhyang@ailabs.tw
yang@citi.sinica.edu.tw
Yi‐Hsuan Yang Ph.D. 1,2
1 Taiwan AI Labs
2 Research Center for IT Innovation, Academia Sinica
October 26, 2021

2. Framework: Sonic Visualiser
https://www.sonicvisualiser.org/
https://www.vamp‐plugins.org/
7

3. Framework: Audacity
https://www.audacityteam.org/
https://arxiv.org/pdf/2110.13323.pdf
8

4. Framework: librosa
https://github.com/librosa/librosa
9

5. Framework: Essentia.js
https://mtg.github.io/essentia.js/
https://archives.ismir.net/ismir2020/paper/000260.pdf
10

6. Music Classification
https://github.com/minzwon/sota‐music‐tagging‐models
https://arxiv.org/abs/2006.00751
11

7. Source Separation (Off‐the‐shelf)
https://github.com/deezer/spleeter
12

8. https://github.com/sigsep/open‐unmix‐pytorch
https://joss.theoj.org/papers/10.21105/joss.01667
Source Separation (Build‐your‐own)
13
https://arxiv.org/pdf/2110.09958.pdf
https://arxiv.org/pdf/2008.02480.pdf

9. Beat/Downbeat Tracking
https://github.com/CPJKU/madmom
https://madmom.readthedocs.io/en/v0.16/modules/fe
atures/downbeats.html
http://www.cp.jku.at/research/papers/Boeck_etal_ISMI
R_2016.pdf
19

10. Beat/Downbeat Tracking
https://github.com/SunnyCYC/drum‐aware4beat
https://arxiv.org/pdf/2106.08685.pdf
20

11. Melody Extraction
https://github.com/marl/crepe
https://arxiv.org/pdf/1802.06182.pdf
21

12. Music Transcription
https://github.com/Music‐and‐Culture‐Technology‐
Lab/omnizart
https://arxiv.org/pdf/2106.00497.pdf
22

13. Structure Segmentation
https://github.com/urinieto/msaf
https://archives.ismir.net/ismir2016/paper/000043.pdf
23

14. Thumbnailing
https://github.com/remyhuang/pop‐music‐highlighter
• Applications
‒ Music browsing
‒ Ringtone generation
‒ Reference‐based music composition
24
↙30 sec highlight
“A song”

15. https://remyhuang.github.io/music_thumbnailing/
Thumbnailing
25
周杰倫 - 稻香
光良 - 童話
胡夏 - 那些年
Linkin Park ‐ Burn It Down
Adam Lambert ‐ Whataya Want from Me

16. AI DJ‐related Techniques
https://aidjwebsite.herokuapp.com/
33