SlideShare a Scribd company logo
The Sound Of AI
Aleksandr Tavgen
About Me
• Love machinery from childhood
• First gamewrote at 13y. old
• UFO bombed tanks (Basic)
• Last years worked at ML and Data
Science fields related to FinTech
• As a hobby different projects in
art and robotics field
Some Of The Past Projects
• Computer Vision
• Robotics
• New Ways Of Interactions
• Art Related Projects
Neuroshtein
Prepared for
conference badge
pickup party
Planned as live
improvisation
3 professional
musicians
And……
Recurrent Neural Networks
• Produce good results when handling
time series data with an underlying
structure
• The structure of a natural language
has a number of dimensions
• Semantic dimension is quite
difficult for machines to grasp
• Syntactic dimension is quite
manageable for machines
Music As A Text
Music is structured
along various
dimensions such as
rhythm, intervals,
dynamics
01
Music constitutes
well-structured
time series data
02
MIDI events could
be represented as
an alphabet
03
Trump Speeches Generating
• Collected Corpus of Trump Speeches
• Results were quite funny
• Completed 340 minibatches of size 32x1000 characters
Second. They left you asses, believe me, but I will have
great people.I solling us some -- and you see something
youve seen deterner to Mexico, we are building interest.
100,000. Im not going to be so bad.
It was so proud of me. Incredible and or their cities which
I kept the same wealthy. They dont want them, were the
world companies.
Magenta Project
• Google AI project
• Stumbled upon when started this Project
• Interface between MIDI and Tensorflow
• Ableton was a glue
First Steps
• MIDI signals should first be
mapped onto an artificial
alphabet
• Pretrained LSTM RNN with two
hidden layers of 128 elements
• Continued Training on bunch of
MIDI
• Call-Response approach
• Given the example Model try to
reproduce rhythm structure
Configuration And Problems
• Two models listens to each other in call-response mode
• There were problems with midi-clock synchronization
• Some latency were presented due to a large routes amount
between MIDI
• Latency were fixed by shifting
We made a video in
Playtech Tallinn’s
office
• Every attempt of improvisation
was different
• Quite funny to fill office building
with powerful bass sound
Vinyl Was Published
• One track was taken from one of Neural Networks
Improvisation
• Music from this vinyl were used in next large project
• Interactive Theatre with Java-Graphs and Non Linear
Plotline
Bringing To Live
• Connect Those Configuration With Solenoids
• 8-10 Solenoids will be used
• Main concert 07. march 2019
Q&A
• Medium @Atavgen
• Twitter @Atavgen
• Will send some other articles by mail

More Related Content

Similar to Sound Of AI

The Impact of Women Trailblazers in Tech
The Impact of Women Trailblazers in TechThe Impact of Women Trailblazers in Tech
The Impact of Women Trailblazers in Tech
Sarah Dutkiewicz
 
Automated Composition & Generative Music
Automated Composition & Generative MusicAutomated Composition & Generative Music
Automated Composition & Generative Music
柏豪 紀
 
Embedded Systems PPt.pptx
Embedded Systems PPt.pptxEmbedded Systems PPt.pptx
Embedded Systems PPt.pptx
Tabrezahmed39
 
Public domain calculator
Public domain calculatorPublic domain calculator
Public domain calculator
Marco Montanari
 
The world's most famous programmers
The world's most famous programmersThe world's most famous programmers
The world's most famous programmers
Arno Huetter
 
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
MME 4.5 / Music 4.5 / 2Pears
 
MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")
MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")
MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")
Leif Bloomquist
 
Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...
Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...
Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...
linshanleearchive
 
01. introduction to computer history - generation
01. introduction to computer   history - generation01. introduction to computer   history - generation
01. introduction to computer history - generation
TimesRide
 
I school creative symposium tpl october 6, 2014
I school creative symposium tpl   october 6, 2014I school creative symposium tpl   october 6, 2014
I school creative symposium tpl october 6, 2014
Stephen Abram
 
SFPC The First Day
SFPC The First Day SFPC The First Day
SFPC The First Day
tchoi8
 
Dennis Richie
Dennis RichieDennis Richie
Dennis Richie
Ali ElSheikh
 
Why Computer Science is a Great Choice
Why Computer Science is a Great ChoiceWhy Computer Science is a Great Choice
Why Computer Science is a Great Choice
turingfan
 
Classification Of Computers.pptx
Classification Of Computers.pptxClassification Of Computers.pptx
Classification Of Computers.pptx
Asif469093
 
Lecture 1 a
Lecture 1 aLecture 1 a
Lecture 1 a
AttaullahRahimoon
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
RamhariYadav
 
History of Women in Tech
History of Women in TechHistory of Women in Tech
History of Women in Tech
Sarah Dutkiewicz
 
Paradigms
ParadigmsParadigms
Paradigms
Edward Blurock
 
Tom Crane - An Introduction to IIIF
Tom Crane - An Introduction to IIIF Tom Crane - An Introduction to IIIF
Tom Crane - An Introduction to IIIF
dri_ireland
 
Lecture # 8.ppt
Lecture # 8.pptLecture # 8.ppt
Lecture # 8.ppt
HumzaWaris1
 

Similar to Sound Of AI (20)

The Impact of Women Trailblazers in Tech
The Impact of Women Trailblazers in TechThe Impact of Women Trailblazers in Tech
The Impact of Women Trailblazers in Tech
 
Automated Composition & Generative Music
Automated Composition & Generative MusicAutomated Composition & Generative Music
Automated Composition & Generative Music
 
Embedded Systems PPt.pptx
Embedded Systems PPt.pptxEmbedded Systems PPt.pptx
Embedded Systems PPt.pptx
 
Public domain calculator
Public domain calculatorPublic domain calculator
Public domain calculator
 
The world's most famous programmers
The world's most famous programmersThe world's most famous programmers
The world's most famous programmers
 
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
Artificial Intelligence in Music, Mick Grierson, Reader, Director of Computin...
 
MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")
MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")
MIDI Mad Science and Mayhem (Soundhackers #5 "Controller Crazy")
 
Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...
Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...
Doing Something We Never Could with Spoken Language Technologies_109-10-29_In...
 
01. introduction to computer history - generation
01. introduction to computer   history - generation01. introduction to computer   history - generation
01. introduction to computer history - generation
 
I school creative symposium tpl october 6, 2014
I school creative symposium tpl   october 6, 2014I school creative symposium tpl   october 6, 2014
I school creative symposium tpl october 6, 2014
 
SFPC The First Day
SFPC The First Day SFPC The First Day
SFPC The First Day
 
Dennis Richie
Dennis RichieDennis Richie
Dennis Richie
 
Why Computer Science is a Great Choice
Why Computer Science is a Great ChoiceWhy Computer Science is a Great Choice
Why Computer Science is a Great Choice
 
Classification Of Computers.pptx
Classification Of Computers.pptxClassification Of Computers.pptx
Classification Of Computers.pptx
 
Lecture 1 a
Lecture 1 aLecture 1 a
Lecture 1 a
 
Artificial intelligence
Artificial intelligenceArtificial intelligence
Artificial intelligence
 
History of Women in Tech
History of Women in TechHistory of Women in Tech
History of Women in Tech
 
Paradigms
ParadigmsParadigms
Paradigms
 
Tom Crane - An Introduction to IIIF
Tom Crane - An Introduction to IIIF Tom Crane - An Introduction to IIIF
Tom Crane - An Introduction to IIIF
 
Lecture # 8.ppt
Lecture # 8.pptLecture # 8.ppt
Lecture # 8.ppt
 

Recently uploaded

一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理
一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理
一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理
zeyhe
 
2024 MATFORCE Youth Poster Contest Winners
2024 MATFORCE Youth Poster Contest Winners2024 MATFORCE Youth Poster Contest Winners
2024 MATFORCE Youth Poster Contest Winners
matforce
 
A Brief Introduction About Hadj Ounis
A Brief  Introduction  About  Hadj OunisA Brief  Introduction  About  Hadj Ounis
A Brief Introduction About Hadj Ounis
Hadj Ounis
 
All the images mentioned in 'See What You're Missing'
All the images mentioned in 'See What You're Missing'All the images mentioned in 'See What You're Missing'
All the images mentioned in 'See What You're Missing'
Dave Boyle
 
My storyboard for a sword fight scene with lightsabers
My storyboard for a sword fight scene with lightsabersMy storyboard for a sword fight scene with lightsabers
My storyboard for a sword fight scene with lightsabers
AlejandroGuarnGutirr
 
Tibbetts_HappyAwesome_NewArc Sketch to AI
Tibbetts_HappyAwesome_NewArc Sketch to AITibbetts_HappyAwesome_NewArc Sketch to AI
Tibbetts_HappyAwesome_NewArc Sketch to AI
Todd Tibbetts
 
In Focus_ The Evolution of Boudoir Photography in NYC.pdf
In Focus_ The Evolution of Boudoir Photography in NYC.pdfIn Focus_ The Evolution of Boudoir Photography in NYC.pdf
In Focus_ The Evolution of Boudoir Photography in NYC.pdf
Boudoir Photography by Your Hollywood Portrait
 
FinalLessonPlanResponding.docxnknknknknknk
FinalLessonPlanResponding.docxnknknknknknkFinalLessonPlanResponding.docxnknknknknknk
FinalLessonPlanResponding.docxnknknknknknk
abbieharman
 
➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...
➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...
➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...
➒➌➎➏➑➐➋➑➐➐Dpboss Matka Guessing Satta Matka Kalyan Chart Indian Matka
 
Dino Ranch Storyboard / Kids TV Advertising
Dino Ranch Storyboard / Kids TV AdvertisingDino Ranch Storyboard / Kids TV Advertising
Dino Ranch Storyboard / Kids TV Advertising
Alessandro Occhipinti
 
ART APPRECIATION DISCUSSION LESSON 9.pptx
ART APPRECIATION DISCUSSION  LESSON 9.pptxART APPRECIATION DISCUSSION  LESSON 9.pptx
ART APPRECIATION DISCUSSION LESSON 9.pptx
AlizzaJoyceManuel
 
Heart Touching Romantic Love Shayari In English with Images
Heart Touching Romantic Love Shayari In English with ImagesHeart Touching Romantic Love Shayari In English with Images
Heart Touching Romantic Love Shayari In English with Images
Short Good Quotes
 
Sandra García Palero Fashion Portfolio..
Sandra García Palero Fashion Portfolio..Sandra García Palero Fashion Portfolio..
Sandra García Palero Fashion Portfolio..
SandraGarcaPalero
 
Complete Lab 123456789123456789123456789
Complete Lab 123456789123456789123456789Complete Lab 123456789123456789123456789
Complete Lab 123456789123456789123456789
vickyvikas51556
 
storyboard: Victor and Verlin discussing about top hat
storyboard: Victor and Verlin discussing about top hatstoryboard: Victor and Verlin discussing about top hat
storyboard: Victor and Verlin discussing about top hat
LyneSun
 
Fed by curiosity and beauty - Remembering Myrsine Zorba
Fed by curiosity and beauty - Remembering Myrsine ZorbaFed by curiosity and beauty - Remembering Myrsine Zorba
Fed by curiosity and beauty - Remembering Myrsine Zorba
mariavlachoupt
 
FinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvn
FinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvnFinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvn
FinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvn
abbieharman
 
Cream and Brown Illustrative Food Journal Presentation.pptx
Cream and Brown Illustrative Food Journal Presentation.pptxCream and Brown Illustrative Food Journal Presentation.pptx
Cream and Brown Illustrative Food Journal Presentation.pptx
cndywjya001
 
My storyboard for the short film "Maatla".
My storyboard for the short film "Maatla".My storyboard for the short film "Maatla".
My storyboard for the short film "Maatla".
AlejandroGuarnGutirr
 
Domino Express Storyboard - TV Adv Toys 30"
Domino Express Storyboard - TV Adv Toys 30"Domino Express Storyboard - TV Adv Toys 30"
Domino Express Storyboard - TV Adv Toys 30"
Alessandro Occhipinti
 

Recently uploaded (20)

一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理
一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理
一比一原版(UniSA毕业证)南澳大学毕业证成绩单如何办理
 
2024 MATFORCE Youth Poster Contest Winners
2024 MATFORCE Youth Poster Contest Winners2024 MATFORCE Youth Poster Contest Winners
2024 MATFORCE Youth Poster Contest Winners
 
A Brief Introduction About Hadj Ounis
A Brief  Introduction  About  Hadj OunisA Brief  Introduction  About  Hadj Ounis
A Brief Introduction About Hadj Ounis
 
All the images mentioned in 'See What You're Missing'
All the images mentioned in 'See What You're Missing'All the images mentioned in 'See What You're Missing'
All the images mentioned in 'See What You're Missing'
 
My storyboard for a sword fight scene with lightsabers
My storyboard for a sword fight scene with lightsabersMy storyboard for a sword fight scene with lightsabers
My storyboard for a sword fight scene with lightsabers
 
Tibbetts_HappyAwesome_NewArc Sketch to AI
Tibbetts_HappyAwesome_NewArc Sketch to AITibbetts_HappyAwesome_NewArc Sketch to AI
Tibbetts_HappyAwesome_NewArc Sketch to AI
 
In Focus_ The Evolution of Boudoir Photography in NYC.pdf
In Focus_ The Evolution of Boudoir Photography in NYC.pdfIn Focus_ The Evolution of Boudoir Photography in NYC.pdf
In Focus_ The Evolution of Boudoir Photography in NYC.pdf
 
FinalLessonPlanResponding.docxnknknknknknk
FinalLessonPlanResponding.docxnknknknknknkFinalLessonPlanResponding.docxnknknknknknk
FinalLessonPlanResponding.docxnknknknknknk
 
➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...
➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...
➒➌➎➏➑➐➋➑➐➐ Dpboss Satta Matka Matka Guessing Kalyan Chart Indian Matka Satta ...
 
Dino Ranch Storyboard / Kids TV Advertising
Dino Ranch Storyboard / Kids TV AdvertisingDino Ranch Storyboard / Kids TV Advertising
Dino Ranch Storyboard / Kids TV Advertising
 
ART APPRECIATION DISCUSSION LESSON 9.pptx
ART APPRECIATION DISCUSSION  LESSON 9.pptxART APPRECIATION DISCUSSION  LESSON 9.pptx
ART APPRECIATION DISCUSSION LESSON 9.pptx
 
Heart Touching Romantic Love Shayari In English with Images
Heart Touching Romantic Love Shayari In English with ImagesHeart Touching Romantic Love Shayari In English with Images
Heart Touching Romantic Love Shayari In English with Images
 
Sandra García Palero Fashion Portfolio..
Sandra García Palero Fashion Portfolio..Sandra García Palero Fashion Portfolio..
Sandra García Palero Fashion Portfolio..
 
Complete Lab 123456789123456789123456789
Complete Lab 123456789123456789123456789Complete Lab 123456789123456789123456789
Complete Lab 123456789123456789123456789
 
storyboard: Victor and Verlin discussing about top hat
storyboard: Victor and Verlin discussing about top hatstoryboard: Victor and Verlin discussing about top hat
storyboard: Victor and Verlin discussing about top hat
 
Fed by curiosity and beauty - Remembering Myrsine Zorba
Fed by curiosity and beauty - Remembering Myrsine ZorbaFed by curiosity and beauty - Remembering Myrsine Zorba
Fed by curiosity and beauty - Remembering Myrsine Zorba
 
FinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvn
FinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvnFinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvn
FinalA1LessonPlanMaking.docxdvdnlskdnvsldkvnsdkvn
 
Cream and Brown Illustrative Food Journal Presentation.pptx
Cream and Brown Illustrative Food Journal Presentation.pptxCream and Brown Illustrative Food Journal Presentation.pptx
Cream and Brown Illustrative Food Journal Presentation.pptx
 
My storyboard for the short film "Maatla".
My storyboard for the short film "Maatla".My storyboard for the short film "Maatla".
My storyboard for the short film "Maatla".
 
Domino Express Storyboard - TV Adv Toys 30"
Domino Express Storyboard - TV Adv Toys 30"Domino Express Storyboard - TV Adv Toys 30"
Domino Express Storyboard - TV Adv Toys 30"
 

Sound Of AI

  • 1. The Sound Of AI Aleksandr Tavgen
  • 2. About Me • Love machinery from childhood • First gamewrote at 13y. old • UFO bombed tanks (Basic) • Last years worked at ML and Data Science fields related to FinTech • As a hobby different projects in art and robotics field
  • 3. Some Of The Past Projects • Computer Vision • Robotics • New Ways Of Interactions • Art Related Projects
  • 4. Neuroshtein Prepared for conference badge pickup party Planned as live improvisation 3 professional musicians And……
  • 5. Recurrent Neural Networks • Produce good results when handling time series data with an underlying structure • The structure of a natural language has a number of dimensions • Semantic dimension is quite difficult for machines to grasp • Syntactic dimension is quite manageable for machines
  • 6. Music As A Text Music is structured along various dimensions such as rhythm, intervals, dynamics 01 Music constitutes well-structured time series data 02 MIDI events could be represented as an alphabet 03
  • 7. Trump Speeches Generating • Collected Corpus of Trump Speeches • Results were quite funny • Completed 340 minibatches of size 32x1000 characters Second. They left you asses, believe me, but I will have great people.I solling us some -- and you see something youve seen deterner to Mexico, we are building interest. 100,000. Im not going to be so bad. It was so proud of me. Incredible and or their cities which I kept the same wealthy. They dont want them, were the world companies.
  • 8. Magenta Project • Google AI project • Stumbled upon when started this Project • Interface between MIDI and Tensorflow • Ableton was a glue
  • 9. First Steps • MIDI signals should first be mapped onto an artificial alphabet • Pretrained LSTM RNN with two hidden layers of 128 elements • Continued Training on bunch of MIDI • Call-Response approach • Given the example Model try to reproduce rhythm structure
  • 10.
  • 11. Configuration And Problems • Two models listens to each other in call-response mode • There were problems with midi-clock synchronization • Some latency were presented due to a large routes amount between MIDI • Latency were fixed by shifting
  • 12. We made a video in Playtech Tallinn’s office • Every attempt of improvisation was different • Quite funny to fill office building with powerful bass sound
  • 13.
  • 14. Vinyl Was Published • One track was taken from one of Neural Networks Improvisation • Music from this vinyl were used in next large project • Interactive Theatre with Java-Graphs and Non Linear Plotline
  • 15.
  • 16. Bringing To Live • Connect Those Configuration With Solenoids • 8-10 Solenoids will be used • Main concert 07. march 2019
  • 17.
  • 18. Q&A • Medium @Atavgen • Twitter @Atavgen • Will send some other articles by mail