Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Conducting music with react native and machine learning

55 views

Published on

Today's smartphones have all that's necessary to be an electronic conductors baton. You can use accelerometers and machine learning to detect music conducting gestures that affect the tempo (BPM) and dynamic range of MIDI music.

Published in: Software
  • Be the first to comment

  • Be the first to like this

Conducting music with react native and machine learning

  1. 1. React native Overview It’s a mobile app framework that allows you to build a native mobile app with JavaScript You can expect the same level of performance as a native mobile app Web developers can use their existing JavaScript skills
  2. 2. JavaScript Bridge iOS Android Bass Midi C++ GRT C++ GRT C++ Bass Midi C++
  3. 3. Counts the number of zero crossings that occur in an N dimensional signal over a given window.
  4. 4. • Dynamic time warping (DTW) • Supervised learning classification algorithm • Measures similarity between two temporal sequences that very in speed • Common used for speech and signature recognition
  5. 5. Links to the Code and to Learn More justinmaurer.net Demo Code: https://github.com/jmdotnet/airconductor Gesture Recognition Toolkit (GRT) http://www.nickgillian.com/wiki/pmwiki.php/GRT/Reference Bass Midi: https://www.un4seen.com/ AirConductor App: airconductor.com https://play.google.com/store/apps/details?id=com.jmnet.air conductor

×