SlideShare a Scribd company logo
1 of 15
Download to read offline
Sustainable Software
for Audio & Music Research
            Mark Plumbley
         Centre for Digital Music
          SoundSoftware.ac.uk
Why?

Why write code?                        Why do research?
•Have fun!                             •Have fun!
•Make money*                           •Make money*
•Change the world...                   •Change the world...

“Changing the world”
- Helping other people to use your code or research.
-Takes more work, but worth it
- In research circles, this is called “impact”.

 * Or, have someone pay your salary / studentship, or buy you beer & pizza
Impact of Coding
“High Impact” Coding            Hobby coding
•Collaborate                    •Write code
•Design code                    •Never document
•Write code                     •Deliver (maybe)
•Document                       •Erm...
•Deliver                        •That’s it.
•Advise
•Maintain
Others can use this code
(Yes, you know all this...
but what about your hack...?)   Nobody can use this code
                                BUT – what about Research?
Ideal Research Pipeline
Researcher A (“Producer”)
• Read background papers
• Do own research
• Publish paper X
Researcher B (“Consumer-Producer”)
• Read paper X
• Understand/reproduce results in paper X
• Do more research building on X
• Publish paper Y that cites X / produce product that uses X
Etc etc                                 (Today: Thomas from MuScore)
Researchers write code (badly)
Typical Research Skills:    Typical Coding Skills:
•Maths                      •Design
•Experiments                •Documenting
•Analysis                   •Version control
•Proofs                     •Unit testing
•Writing & presenting       •APIs
•Matlab/Gnuplot/LaTeX       •C++/Java/Python

  Some can do both (including people here today).
  But lots can’t.
So: Real Research Pipeline
Researcher A (“Producer”)
• Read background papers
• Do own research (including lots of coding)
• Publish paper X (not enough space for all the code)
Researcher B (“Consumer-Producer”)
• Read paper X
• Can’t reproduce or use results in paper X
• Tear out hair
• Give up / do something else
NB: A and B may be in same group (or same person later!)
Reproducible Research
Research used to be “reproducible” from the paper alone.
Research is now too complex. Just the paper is not enough.
So, we need
• The paper (ideally Open Access)
• The code    (ideally Open Source)
• The data    (ideally Open Data)

In audio & music research, hardly anyone does this?
Why?
Why is Reproducible Research Hard?
Researchers don’t release code because
• Copyright/Licensing – could sell it later?
• Badly written – would be embarrassing!
• No time to tidy up – not a priority (“Its not research”)?
Researchers don’t release data because
• I don’t own it (e.g. my CD collection)
• Its too big
Or even:
• Someone else might use it to do better research than me
• Someone might notice something wrong with my research
Reusable research
Even “Reproducible” might not get to the people who need it:
• Musicologists don’t use Matlab
• Code no longer works when they come to use it

So – new project: “SoundSoftware.ac.uk”
• Help audio & music researchers to make
  sustainable and reusable research software
• Help other researchers use audio & music research
  through sustainable research software
and so, make audio & music research have an IMPACT.
How can SoundSoftware.ac.uk help?
• Employ software developers
  to make existing research software robust & usable

• Training for researchers
  to write robust & reliable research code

• Help for academics / research project managers
  to build software development into research projects

• Curation of data and software
  to help future researchers find what they need
Example software:
Long-term software reuse: Sonic Visualiser
• Multi-purpose visualiser for
  sound recordings
• Open source
• Built from modular libraries
  which can be used for other
  applications
• Introduced plugin architecture
  (Vamp plugins) for analysis
  tools based on research
• Used by audio researchers,
  musicologists, etc
Example service:
Maintaining systems and services: SAWA
• Allow access to rdf
  repositories with audio and
  music related meta-data
  (150000 audio tracks).
• Web-based audio features
  extraction and similarity
  search services.
• Can be seen as a
  continuous service for
  researchers in music/audio
  similarity research.
First steps
• Survey supply/demand for audio research software/data
   • To be completed late 2010
• Software training course for researchers
   • Software Carpentry autumn school Nov 2010
• Initial field-tests of development services
   • Start locally at Centre for Digital Music,
      expand after survey out
Conclusions
 Could researchers use you?
Definitely:
• Have fun
Sometimes:
• Make money (or at least, get free beer & pizza)
But more important:
• Change the world...

Watch this space: www.SoundSoftware.ac.uk

                        And Finally...
New Startup Wants You
 A seed-funded team from UCL is building something exciting.
 If you
• are an experienced DSP developer
• are available for contracting this year
• want to see your code on 5.1m mobile devices
• want know more about this project
Mail: patrick@thisisanimal.com

or give your name to me (Mark Plumbley). Thanks!

More Related Content

Similar to Sound soft hackday-100905

NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...
NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...
NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...
Rizwan Habib
 
Creating a Digital Media Space for Today's Teens
Creating a Digital Media Space for Today's TeensCreating a Digital Media Space for Today's Teens
Creating a Digital Media Space for Today's Teens
ALATechSource
 

Similar to Sound soft hackday-100905 (20)

How to get started in Open Source!
How to get started in Open Source!How to get started in Open Source!
How to get started in Open Source!
 
IT Systems for Knowledge Management used in Software Engineering (2010)
IT Systems for Knowledge Management used in Software Engineering (2010)IT Systems for Knowledge Management used in Software Engineering (2010)
IT Systems for Knowledge Management used in Software Engineering (2010)
 
Creating a Digital Media Space for Today's Teens: Part 2 (Jan. 2019)
Creating a Digital Media Space for Today's Teens: Part 2 (Jan. 2019)Creating a Digital Media Space for Today's Teens: Part 2 (Jan. 2019)
Creating a Digital Media Space for Today's Teens: Part 2 (Jan. 2019)
 
2023-My AI Experience - Colm Dunphy.pdf
2023-My AI Experience - Colm Dunphy.pdf2023-My AI Experience - Colm Dunphy.pdf
2023-My AI Experience - Colm Dunphy.pdf
 
PyData Texas 2015 Keynote
PyData Texas 2015 KeynotePyData Texas 2015 Keynote
PyData Texas 2015 Keynote
 
pre- venture cup #1: Rune Rex
pre- venture cup #1: Rune Rexpre- venture cup #1: Rune Rex
pre- venture cup #1: Rune Rex
 
Copy and Paste Hardware
Copy and Paste Hardware Copy and Paste Hardware
Copy and Paste Hardware
 
Your research as open science
Your research as open scienceYour research as open science
Your research as open science
 
Learning how to learn, with Software Carpentry
Learning how to learn, with Software CarpentryLearning how to learn, with Software Carpentry
Learning how to learn, with Software Carpentry
 
OSFair2017 Training | Best practice in Open Science
OSFair2017 Training | Best practice in Open ScienceOSFair2017 Training | Best practice in Open Science
OSFair2017 Training | Best practice in Open Science
 
Open Sesame (and other open movements)
Open Sesame (and other open movements)Open Sesame (and other open movements)
Open Sesame (and other open movements)
 
Preservation and institutional repositories for the digital arts and humanities
Preservation and institutional repositories for the digital arts and humanitiesPreservation and institutional repositories for the digital arts and humanities
Preservation and institutional repositories for the digital arts and humanities
 
NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...
NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...
NYAI #7 - Top-down vs. Bottom-up Computational Creativity by Dr. Cole D. Ingr...
 
Oscon 2016: open source lessons from the todo group
Oscon 2016: open source lessons from the todo groupOscon 2016: open source lessons from the todo group
Oscon 2016: open source lessons from the todo group
 
GDSC NYCU | 如何建立自己的開源專案
 GDSC NYCU | 如何建立自己的開源專案 GDSC NYCU | 如何建立自己的開源專案
GDSC NYCU | 如何建立自己的開源專案
 
Open Source Lessons from the TODO Group
Open Source Lessons from the TODO GroupOpen Source Lessons from the TODO Group
Open Source Lessons from the TODO Group
 
What is open source?
What is open source?What is open source?
What is open source?
 
Creating a Digital Media Space for Today's Teens
Creating a Digital Media Space for Today's TeensCreating a Digital Media Space for Today's Teens
Creating a Digital Media Space for Today's Teens
 
Dr. You or, How I Learned to Stop Worry and Love the PhD
Dr. You or, How I Learned to Stop Worry and Love the PhDDr. You or, How I Learned to Stop Worry and Love the PhD
Dr. You or, How I Learned to Stop Worry and Love the PhD
 
2013-06-26: Meet The Blinky Tape
2013-06-26: Meet The Blinky Tape2013-06-26: Meet The Blinky Tape
2013-06-26: Meet The Blinky Tape
 

Recently uploaded

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Recently uploaded (20)

Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 

Sound soft hackday-100905

  • 1. Sustainable Software for Audio & Music Research Mark Plumbley Centre for Digital Music SoundSoftware.ac.uk
  • 2. Why? Why write code? Why do research? •Have fun! •Have fun! •Make money* •Make money* •Change the world... •Change the world... “Changing the world” - Helping other people to use your code or research. -Takes more work, but worth it - In research circles, this is called “impact”. * Or, have someone pay your salary / studentship, or buy you beer & pizza
  • 3. Impact of Coding “High Impact” Coding Hobby coding •Collaborate •Write code •Design code •Never document •Write code •Deliver (maybe) •Document •Erm... •Deliver •That’s it. •Advise •Maintain Others can use this code (Yes, you know all this... but what about your hack...?) Nobody can use this code BUT – what about Research?
  • 4. Ideal Research Pipeline Researcher A (“Producer”) • Read background papers • Do own research • Publish paper X Researcher B (“Consumer-Producer”) • Read paper X • Understand/reproduce results in paper X • Do more research building on X • Publish paper Y that cites X / produce product that uses X Etc etc (Today: Thomas from MuScore)
  • 5. Researchers write code (badly) Typical Research Skills: Typical Coding Skills: •Maths •Design •Experiments •Documenting •Analysis •Version control •Proofs •Unit testing •Writing & presenting •APIs •Matlab/Gnuplot/LaTeX •C++/Java/Python Some can do both (including people here today). But lots can’t.
  • 6. So: Real Research Pipeline Researcher A (“Producer”) • Read background papers • Do own research (including lots of coding) • Publish paper X (not enough space for all the code) Researcher B (“Consumer-Producer”) • Read paper X • Can’t reproduce or use results in paper X • Tear out hair • Give up / do something else NB: A and B may be in same group (or same person later!)
  • 7. Reproducible Research Research used to be “reproducible” from the paper alone. Research is now too complex. Just the paper is not enough. So, we need • The paper (ideally Open Access) • The code (ideally Open Source) • The data (ideally Open Data) In audio & music research, hardly anyone does this? Why?
  • 8. Why is Reproducible Research Hard? Researchers don’t release code because • Copyright/Licensing – could sell it later? • Badly written – would be embarrassing! • No time to tidy up – not a priority (“Its not research”)? Researchers don’t release data because • I don’t own it (e.g. my CD collection) • Its too big Or even: • Someone else might use it to do better research than me • Someone might notice something wrong with my research
  • 9. Reusable research Even “Reproducible” might not get to the people who need it: • Musicologists don’t use Matlab • Code no longer works when they come to use it So – new project: “SoundSoftware.ac.uk” • Help audio & music researchers to make sustainable and reusable research software • Help other researchers use audio & music research through sustainable research software and so, make audio & music research have an IMPACT.
  • 10. How can SoundSoftware.ac.uk help? • Employ software developers to make existing research software robust & usable • Training for researchers to write robust & reliable research code • Help for academics / research project managers to build software development into research projects • Curation of data and software to help future researchers find what they need
  • 11. Example software: Long-term software reuse: Sonic Visualiser • Multi-purpose visualiser for sound recordings • Open source • Built from modular libraries which can be used for other applications • Introduced plugin architecture (Vamp plugins) for analysis tools based on research • Used by audio researchers, musicologists, etc
  • 12. Example service: Maintaining systems and services: SAWA • Allow access to rdf repositories with audio and music related meta-data (150000 audio tracks). • Web-based audio features extraction and similarity search services. • Can be seen as a continuous service for researchers in music/audio similarity research.
  • 13. First steps • Survey supply/demand for audio research software/data • To be completed late 2010 • Software training course for researchers • Software Carpentry autumn school Nov 2010 • Initial field-tests of development services • Start locally at Centre for Digital Music, expand after survey out
  • 14. Conclusions Could researchers use you? Definitely: • Have fun Sometimes: • Make money (or at least, get free beer & pizza) But more important: • Change the world... Watch this space: www.SoundSoftware.ac.uk And Finally...
  • 15. New Startup Wants You A seed-funded team from UCL is building something exciting. If you • are an experienced DSP developer • are available for contracting this year • want to see your code on 5.1m mobile devices • want know more about this project Mail: patrick@thisisanimal.com or give your name to me (Mark Plumbley). Thanks!