Downloaded 19 times
![import org.jfugue.player.Player;
public class HelloWorld {
public static void main(String[] args) {
Player player = new Player();
player.play(“C”);
}
}
“Hello, World!” in JFugue](https://image.slidesharecdn.com/4130musicalprograms-150220224540-conversion-gate02/85/The-Art-Joy-and-Power-of-Creating-Musical-Programs-JFugue-at-SXSW-Interactive-2015-4-320.jpg)
![import org.jfugue.player.Player;
public class HelloWorld {
public static void main(String[] args) {
Player player = new Player();
player.play(“C”);
}
}
“Hello, World!” in JFugue](https://image.slidesharecdn.com/4130musicalprograms-150220224540-conversion-gate02/85/The-Art-Joy-and-Power-of-Creating-Musical-Programs-JFugue-at-SXSW-Interactive-2015-5-320.jpg)
![public class TwelveBarBlues {
public static void main(String[] args) {
Pattern pattern = new ChordProgression(“I IV V”)
.distribute(“7%6”)
.allChordsAs(“$0 $0 $0 $0 $1 $1 $0 $0 $2 $1 $0 $0”)
.eachChordAs(“$0i $1i $2i $3i $4i $3i $2i $1i”)
.getPattern()
.setInstrument(“Acoustic Bass”)
.setTempo(120);
new Player().play(pattern);
}
}
Advanced JFugue… still fits on one slide](https://image.slidesharecdn.com/4130musicalprograms-150220224540-conversion-gate02/85/The-Art-Joy-and-Power-of-Creating-Musical-Programs-JFugue-at-SXSW-Interactive-2015-7-320.jpg)
![video stream is created
video stream is destroyed
video stream has failed
[BASS_DRUM]s
[ACOUSTIC_SNARE]s
[CRASH_CYMBAL_1]s
Mapping Events to Music](https://image.slidesharecdn.com/4130musicalprograms-150220224540-conversion-gate02/85/The-Art-Joy-and-Power-of-Creating-Musical-Programs-JFugue-at-SXSW-Interactive-2015-17-320.jpg)
![Music is easy to specify
and intentionally human-readable
I[Flute] Change instrument to Flute
T[Allegro] Change tempo to Allegro (120bpm)
m560.8q Play a 560.8 Hz tone at ¼-duration
Rq Rest (takes duration just like a note)
Ease of Use](https://image.slidesharecdn.com/4130musicalprograms-150220224540-conversion-gate02/85/The-Art-Joy-and-Power-of-Creating-Musical-Programs-JFugue-at-SXSW-Interactive-2015-45-320.jpg)
![Pattern melodyVerseOne = new Pattern("T115 V0
I[Synth_Choir]")
.add("Bi B B Ai Gi Bihi Bi Bi Bi Aqi F#ih Rhi F#i Ai Bi")
.add("Aqit Ehtq Rhs Gi Aqi+C#6qi Bi+D6i Aih+C#6ih
Rhqi B5i")
.add("Bi B B Ai Gi Bihi Bi Bi Bi Aqi F#ih Rhi F#i Ai Bi")
.add("Aqit Ehtq Rhs Gi Aqi+C#6qi Bi+D6i Aih+C#6ih Rh
B D6");
Ease of Use](https://image.slidesharecdn.com/4130musicalprograms-150220224540-conversion-gate02/85/The-Art-Joy-and-Power-of-Creating-Musical-Programs-JFugue-at-SXSW-Interactive-2015-46-320.jpg)
![public class TwelveBarBlues {
public static void main(String[] args) {
Pattern pattern = new ChordProgression(“I IV V”)
.distribute(“7%6”)
.allChordsAs(“$0 $0 $0 $0 $1 $1 $0 $0 $2 $1 $0 $0”)
.eachChordAs(“$0i $1i $2i $3i $4i $3i $2i $1i”)
.getPattern()
.setInstrument(“Acoustic Bass”)
.setTempo(120);
new Player().play(pattern);
}
}
Ease of “Expression”](https://image.slidesharecdn.com/4130musicalprograms-150220224540-conversion-gate02/85/The-Art-Joy-and-Power-of-Creating-Musical-Programs-JFugue-at-SXSW-Interactive-2015-47-320.jpg)
Uploaded byDavid Koelle
The Art, Joy, and Power of Creating Musical Programs (JFugue at SXSW Interactive 2015)
This document discusses JFugue, an open source library for programmatically generating music. It provides examples of using JFugue to play simple notes, generate musical patterns and chord progressions, integrate with MIDI systems, and parse musical data into other formats. The document highlights features like JFugue's ease of use, basis in music theory, built-in functions, consistent architecture, and event-based design. It also presents ideas for using JFugue like algorithmic music generation, interactive experiences, and education.
More Related Content
![JFugue, Music, and the Future of Java [JavaOne 2016, CON1851]](https://cdn.slidesharecdn.com/ss_thumbnails/con1851jfuguev2-160921161450-thumbnail.jpg?width=640&height=640&fit=bounds)
Similar to The Art, Joy, and Power of Creating Musical Programs (JFugue at SXSW Interactive 2015)
![20260201 [FOSDEM] gomodjail - library sandboxing for Go modules.pdf](https://cdn.slidesharecdn.com/ss_thumbnails/20260201fosdemgomodjail-librarysandboxingforgomodules-260201225659-76609ec4-thumbnail.jpg?width=640&height=640&fit=bounds)
![谷歌留痕技术教程[ 𝙩𝙤𝙥 𝟮𝟯𝟯. 𝙘 𝙤𝙢 ]](https://cdn.slidesharecdn.com/ss_thumbnails/top233-260130173900-2eb784f9-thumbnail.jpg?width=640&height=640&fit=bounds)
The Art, Joy, and Power of Creating Musical Programs (JFugue at SXSW Interactive 2015)
- 1. The Art, Joy,& Power of Creating Musical Programs David Koelle @dmkoelle #JFugue
- 2.
- 3. Musically-Inclined Programmers! Programming-Inclined Musicians! Anyonewho wants to infuse fun into programming! Who is JFugue for?
- 4. import org.jfugue.player.Player; public classHelloWorld { public static void main(String[] args) { Player player = new Player(); player.play(“C”); } } “Hello, World!” in JFugue
- 5. import org.jfugue.player.Player; public classHelloWorld { public static void main(String[] args) { Player player = new Player(); player.play(“C”); } } “Hello, World!” in JFugue
- 6. Sequencer sequencer =MidiSystem.getSequencer(); Sequence sequence = sequencer.getSequence(); Track track = sequence.createTrack(); ShortMessage onMessage = new ShortMessage(); onMessage.setMessage(ShortMessage.NOTE_ON, 0, 60, 128); MidiEvent noteOnEvent = new MidiEvent(onMessage, 0); track.add(noteOnEvent); ShortMessage offMessage = new ShortMessage(); offMessage.setMessage(ShortMessage.NOTE_OFF, 0, 60, 128); MidiEvent noteOffEvent = new MidiEvent(offMessage, 200); track.add(noteOffEvent); sequencer.start(); try { Thread.sleep(track.ticks()); } catch (InterruptedException e) { Thread.currentThread().interrupt(); } “Hello, World!” without JFugue
- 7. public class TwelveBarBlues{ public static void main(String[] args) { Pattern pattern = new ChordProgression(“I IV V”) .distribute(“7%6”) .allChordsAs(“$0 $0 $0 $0 $1 $1 $0 $0 $2 $1 $0 $0”) .eachChordAs(“$0i $1i $2i $3i $4i $3i $2i $1i”) .getPattern() .setInstrument(“Acoustic Bass”) .setTempo(120); new Player().play(pattern); } } Advanced JFugue… still fits on one slide
- 8.
- 9. Log Files ClassicNovels
- 10. Log Files ClassicNovels
- 11. Brian Tarbox “I wantto know the status of my video servers without staring at a screen.”
- 12.
- 13.
- 14. o server logfiles
- 15. video stream iscreated video stream has failed video stream is tricked video stream is destroyed video content is added SNMP trap emitted Interesting Events in Video On Demand (a video stream is content that is being played)
- 16. video stream iscreated video stream has failed video stream is tricked video stream is destroyed video content is added SNMP trap emitted Interesting Events in Video On Demand
- 17. video stream iscreated video stream is destroyed video stream has failed [BASS_DRUM]s [ACOUSTIC_SNARE]s [CRASH_CYMBAL_1]s Mapping Events to Music
- 18. Listening to Videoon Demand Servers
- 19. Learn more at Log4JFugue.org Winner, 2010Duke’s Choice Award Integrates with Spring Framework Scala version now available
- 20. Log Files ClassicNovels
- 21. Hannah Davis “I wantto create a new interactive experience to perceive classic novels.”
- 22. TransProse creates music fromliterature Songs are based on the emotional content of a novel Introducing TransProse
- 23. unique word prevalence averagesentence length book length punctuation presence of main characters descriptive words chapters/sections changes between tones/moods narrator perspective pacing, plot action/movement locations/environment overall mood/tone/emotion real world or mental landscape smaller individual scenes character ages, voices time period average syllable count amount of dialog Textual Things to Analyze
- 24. unique word prevalence averagesentence length book length punctuation presence of main characters descriptive words chapters/sections changes between tones/moods narrator perspective pacing, plot action/movement locations/environment overall mood/tone/emotion real world or mental landscape smaller individual scenes character ages, voices time period average syllable count amount of dialog Textual Things to Analyze
- 25. Emolex – 14Ktagged words
- 26. The Art ofMaking the Music
- 27. Stable Tones Emotion Counts MusicalConsiderations Melodic Shape
- 28. minor/major key tempo note duration harmony pitch changingbetween keys different instrument voices rhythm time signature melody lyrics/vocals # of notes in key used (complexity) Musical Elements to Use
- 29. minor/major key tempo note duration harmony pitch changingbetween keys different instrument voices rhythm time signature melody lyrics/vocals # of notes in key used (complexity) Musical Elements to Use
- 30. amount of emotion lowemotion counts high emotion counts spikes in emotion active:passive emotions positive:negative emotion amt of emotion per section total emotions in chapter prevalent emotions in novel stability of note from root note more consonant notes more dissonant notes interesting melodic movement tempo major/minor key and octave note duration main melody additional melodies Mappings From Analysis to Music
- 33. Learn more at MusicFromText.com TIME Discovery Wired io9 NBC Engadget FastCompany Popular Science CNET Der Spiegel Le Monde … Lots of press More complex music Motifs for main characters Additional instruments and genres Future Work
- 34.
- 35. Interactive Experiences &Games Algorithmic/Generative Music Music Based on Data Education Art & Design Software Support for Cultural Music General Categories
- 36.
- 37. “I'm analyzing microblogslike YikYak, Tumblr and Twitter to get trending topics. I'm trying to translate text to quantitative data (semantics, topic, gender, time of day, etc.) to then interpolate and put through a genetic algorithm to generate music.” -Tyler Music from Live-Streaming Data
- 38. Making Music froma Chess Match
- 39. Soundtrack for AstrophotographyShow Based on 6000 naked-eye stars: declination (latitude) pitch right ascension (longitude) time magnitude volume and duration
- 40. “Since JFugue canturn MIDI into text, algorithmically created music can be made using the same technology your phone uses for predicting the next word” www.frizzythegame.com brendan@frizzythegame.com JFugue and Markov chaining
- 41. A Tour ofthe Magic of JFugue
- 42. Easy to Use Basedon Music Theory Fun Things are Baked In Consistent “System” Event-Based Architecture Five Bits of JFugue Magic
- 43. Play music withtwo lines of code: Player player = new Player(); player.play(“C”); Ease of Use
- 44. Music is easyto specify and intentionally human-readable C Middle-C C#6h C# note, 6th octave, half duration EbMAJ^w E-flat major chord, first inversion, whole duration Ease of Use
- 45. Music is easyto specify and intentionally human-readable I[Flute] Change instrument to Flute T[Allegro] Change tempo to Allegro (120bpm) m560.8q Play a 560.8 Hz tone at ¼-duration Rq Rest (takes duration just like a note) Ease of Use
- 46. Pattern melodyVerseOne =new Pattern("T115 V0 I[Synth_Choir]") .add("Bi B B Ai Gi Bihi Bi Bi Bi Aqi F#ih Rhi F#i Ai Bi") .add("Aqit Ehtq Rhs Gi Aqi+C#6qi Bi+D6i Aih+C#6ih Rhqi B5i") .add("Bi B B Ai Gi Bihi Bi Bi Bi Aqi F#ih Rhi F#i Ai Bi") .add("Aqit Ehtq Rhs Gi Aqi+C#6qi Bi+D6i Aih+C#6ih Rh B D6"); Ease of Use
- 47. public class TwelveBarBlues{ public static void main(String[] args) { Pattern pattern = new ChordProgression(“I IV V”) .distribute(“7%6”) .allChordsAs(“$0 $0 $0 $0 $1 $1 $0 $0 $2 $1 $0 $0”) .eachChordAs(“$0i $1i $2i $3i $4i $3i $2i $1i”) .getPattern() .setInstrument(“Acoustic Bass”) .setTempo(120); new Player().play(pattern); } } Ease of “Expression”
- 48. Define a Scalein terms of Intervals Define a Chord in terms of Intervals Create a “I IV V” Chord Progression Set the Root of a Chord Progression Get the Chords from a Chord Progression Get the Notes from a Chord … Based on Music Theory
- 49. Rhythm rhythm =new Rhythm() .addLayer("O..oO...O..oOO..") .addLayer("..S...S...S...S.") .addLayer("````````````````") .addLayer("...............+"); new Player() .play(rhythm.getPattern().repeat(2)); Fun Things are Baked In
- 50. Pattern prog =ChordProgression .fromChords("C#4min E4maj B3maj A3maj") .eachChordAs("$_i $_i Ri $_i") .getPattern() .setInstrument("GUITAR") .setVoice(0); Rhythm rhythm = new Rhythm() .addLayer("..X...X...X...XO"); new Player() .play(new Pattern(prog, rhythm).repeat(2)); Consistent “System”
- 51. MidiParser parser =new MidiParser(); LilyPondListener listener = new LilyPondListener(); parser.addListener(listener); parser.parse(midi sequence); listener.displayEngravedSheetMusic(); Event-Based Architecture
- 52. StaccatoParser parser =new StaccatoParser(); LilyPondListener listener = new LilyPondListener(); parser.addListener(listener); parser.parse(“C D E F G A B”); listener.displayEngravedSheetMusic(); Event-Based Architecture
- 53. StaccatoParser parser =new StaccatoParser(); MusicXmlListener listener = new MusicXmlListener(); parser.addListener(listener); parser.parse(“C D E F G A B”); listener.save(new File(“my_song.xml”)); Event-Based Architecture
- 54. MidiParser parser =new MidiParser(); MyParserListener listener = new MyParserListener(); parser.addParserListener(listener); parser.parse(MidiSystem.getSequence(new File(“some midi file"))); System.out.println("There are "+listener.counter+" 'C' notes in this music."); class MyParserListener extends ParserListenerAdapter { public int counter; @Override public void onNoteParsed(Note note) { if (note.getPositionInOctave() == 0) { counter++; } } } Event-Based Architecture
- 55. Sending to /Receiving from MIDI Devices Creating New Patterns in Real-Time Sending Musical Events “Before” They Occur Extending the Staccato Parser Using Replacement Maps to Play Solfege Writing Functions for Musical Effects (e.g., Trill) Scratching the Surface…
- 56.
- 57. Making Music fromDNA Many people have done this many ways… http://www.mimg.ucla.edu/faculty/miller_jh/gene2music/ previouswork.html
- 58. Download JFugue Make beautifuland creative things! http://www.jfugue.org Optionally: Contribute to JFugue! Live coding, Tools for Melodic Structure, Making Awesome Music… What Next?
- 59. Thank You! David Koelle@dmkoelle #JFugue
Editor's Notes
- #2 I am so glad you could be here today. Welcome to The Art, Joy, and Power of Creating Musical Programs. My name is David Koelle. I am the author of JFugue, which is a music programming library for Java and other JVM languages, like Scala. Today, we’re going to see how people around the world are using music programming to change how we perceive and experience everyday things, And I’ll show you how you can create your own magic through music.
- #3 JFugue started as a personal journey that was both a reflection of the past and the promise of the future. Along the way, beautiful things grew. It’s a simple notion: I want people to be able to program music as easily as humanly possible. My initial inspiration came in the mid-80’s. I was twelve. I had a Commodore-128 computer. And with that computer, I created music with a command in the BASIC language called “play”. This enthralled me! It helped cement my interest in programming. And made programming fun and joyful. Back then, my only perception about programming was that it was fun and joyful. And then, times changed. Computers and languages got more advanced. And the thing that I once found as a simple pleasure was insanely difficult to do. In the world of modern technology, I couldn’t play music anymore. Now clearly, musical technology advanced. We have amazing digital audio workstations, distribution of MP3s became commonplace, and music recommender systems point us to new music that we might like. But these are either digital instruments for making an audio recording, or involve listening to audio recordings that other people have already created. The ability for an everyday person to easily and simply create a musical program – a program that can make music in response to changing conditions in the world, a program that can be more than a recording of one’s instrument but could be based on that artistic hand to craft generative music – that ability was gone. So this is my quest: to introduce the beauty of what you see on the screen to the world. I’m here today because I have several exciting things to share with you. First, play(“C”) exists! And not only does play(“C”) exist, but all of these other bits of magic have sprung up to create a joyful and musically sound playground in which to explore and easily create new musical ideas. This is the essence JFugue. On the surface, JFugue is a music programming library. it’s a jar file. Its default output is MIDI music. But it contains so much more, and I look forward to sharing these ideas with you in the next hour. Second, people all around the world are using JFugue to do phenomenally interesting things. I’ll show you a sample of those today. And third, this sets the stage for a future in which we can easily engage our auditory sense in ways that have been prohibitively difficult to explore in the past, and this is a new angle to inspire tomorrow’s musicians and developers to explore the fun of music and of programming. ***Make sure I answer here: What is music programming, and why is it artful, joyful, and powerful? Optional content / things to consider working in: There is something fundamentally different about being able to program music. First, it means you can produce music that is responsive to an environment, to context. That’s useful for art, for new ways of experiencing the world It’s useful for applications We have four types of applications that have sound in them: Error sounds Music playing applications like iTunes Music creation applications like Garageband or Ableton Live Games Is there utility for sound outside of entertainment? Is there room for entertainment to generate music? Generative applications: No Man’s Sky. Live coding. (Guzdial: Live coding inspires programming) (is live coding just another kind of musical instrument?)
- #4 Can refer to Processing here ‘Anyone’: “I think of my 12-year-old self in that target audience” If Bach were around today, he would totally use JFugue
- #9 [PART 2]
- #12 “This is Brian Tarbox. Brian is a Software Engineer at a Video On Demand company. *CLICK* And Brian wants to know…” Enterprise scale applications are large and complex Knowing what an application is doing is hard One can spend many sleepless nights looking at enormous log files trying to figure out the cause of a customer problem
- #13 Using the popular logging package Log4J
- #15 There are two things you can do with a log file. You can watch it, but then you need to pay attention to it – this is application visualization Or you can listen to it, and attend to other work. Plus, you can get an innate sense for how badly things are going by the types of sounds you hear – this is application sonification Will it surprise you to know that Brian went with the listening idea?
- #16 Tricking a stream means fast forward, pause, rewind. SNMP traps are emitted to tell other monitoring systems about what'd going on.
- #18 We would expect to hear a steady pattern of creates and destroys, and only an occasional failure (As time allows, talk about some early decisions about chromatic vs. achromatic music, and talk about buffering rhythms)
- #20 Log4JFugue earned a Duke's Choice award for Innovation. The Duke’s Choice Awards recognize and honor extreme innovation in the world of Java technology, and are granted to the most innovative uses of the Java platform. Because the primary judging criteria is innovation, the awards put even small developer shops on an equal footing with multinational giants. The winners are selected by Oracle’s Java technology leadership team
- #27 Difficulties: Broke under certain number of words Misunderstandings
- #28 Follow the arc of emotions, sampling total emotion count Increase melodic movement at particularly emotional points
- #31 We would expect to hear a steady pattern of creates and destroys, and only an occasional failure
- #34 TIME: This Is What Classic Novels Sound Like When a Computer Turns Them Into Piano Music Popular Science: Robot Reads Novels, Writes Songs About Them Wired: A Novel Approach To Composing io9: Researchers Train Computers to Manipulate Human Emotions with Art NBC: Score! Software Writes Music Based on Book's Content Engadget: New algorithm turns 'Lord of the Flies' into an emotional ballad Fast Company: Turn Your Favorite Books Into Original Music Scores Discovery: Beautiful Music Programmed from Famous Novels CNET: TransProse turns literature into music Vice: TransProse Turns Your Favorite Novels Into Original Music Scores Billboard: Computers, Classics and Cadenzas: Making Math Music From Literature Live Science: 'TransProse' Software Creates Musical Soundtracks from Books Der Spiegel: Automatischer Soundtrack: Software schreibt Musik nach Drehbuch Le Monde: La mélodie des mots Diario Correo: Conoce el programa convierte los libros en música Gizmodo Japan: 好きな小説からオリジナルの音楽を作れるプログラム「TransProse」 La Patilla: Crean un programa que convierte los libros en música Superinteressante: TransProse, o programa que transforma literatura em música Hyperallergic: New Algorithm Turns The Emotion of Language into Music IBDA3World: برنامج يُحولّ الكُتب إلى موسيقى TransProse
- #35 [PART 2]
- #36 Games: Guitar Hero, Piano Hero
- #38 I'm structurally overanalyzing microblogs like YikYak, Tumblr and Twitter to get trending topics in the United States and to see how people feel about them. So I'm trying to translate text to quantitative data (semantics, topic, gender, time of day, etc) to then interpolate and put through a the L system (maybe a combination of that and a genetic algorithm later) to generate the music. Make a soundtrack for an audiovisual show for astrophotography (Graham Relf) - Sounds based on 6000 naked-eye stars using their declinations (celetsial latitudes) to determine pitch, RA (longititde) to determine when to sound, magnitude (brightness) volume and duration
- #39 Games: Guitar Hero, Piano Hero
- #40 Graham
- #41 What he means here is Staccato
- #45 This human-readable music specification is called Staccato. “Now I know there are other music representations out there!” MusicXML, ABC notation Why create yet another music specification?
- #46 In MIDI, “Flute” is Instrument 73 Allegro is 120 bpm
- #49 JFugue doesn’t just play notes, there is a solid foundation of music theory
- #52 Staccato-to-MIDI happens to be the default, but you can do stuff like this
- #57 Does anyone have any DNA on them?
- #58 Many people have done this over a long period of time – over 30 years! There are a lot of ways to do this, it’s interesting work, and it’s fascinating to listen to. But it’s been done. Well, while I was making these slides, I was procrastinating on Facebook, and a friend of mine had posted a frightening animation from the European Space Agency on ocean acidification over the past 5 years. And I got an idea. Because while many people have turned DNA into music, I have not yet seen…