Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

INTERACTIVE APPLICATIONS IN MACHINE LEARNING

135 views

Published on

2016 - Porto International Conference on Musical Gesture as Creative Interface, Porto, Portugal

Published in: Technology
  • Be the first to comment

  • Be the first to like this

INTERACTIVE APPLICATIONS IN MACHINE LEARNING

  1. 1. Atau Tanaka - a.tanaka@gold.ac.uk Francisco Bernardo - f.bernardo@gold.ac.uk INTERACTIVE APPLICATIONS IN MACHINE LEARNING WORKSHOP Musical Gesture as Creative Interface Conference Universidade Católica Portuguesa 2016
  2. 2. BRIEFING • Presentation of materials • Hardware - Bitalino Dev Kit • Software - EMG Max patch, Wekinator, Blotar • Walkthrough for the workshop • Installation • Overview of EMG signal conditioning in Max • Sonification I • Regression with Machine Learning • Sonification II - Blotar~ • Free activity
  3. 3. MATERIALS • Hardware: • Bitalino Revolution Kit (x 10) • Electrodes (x 3) • Cables (x 1) • Software (folder in USB flash) • Bitalino Max External Object • Max Patch with LFP/RMS & abstractions • Wekinator 2.0.1
  4. 4. WALKTHROUGH • Pair Bitalino with your computer • Go to Bluetooth preferences on Mac OS X sys preferences • Turn-on Bluetooth; Turn on Bitalino; • Select Bitalino from list of available devices; • Confirm your Bitalino MAC address label; • Click Options, introduce pairing code “1234” • Check the state of Bitalino in BT devices list (paired, but not connected). • Rename your Bitalino with your unique identifier
  5. 5. WALKTHROUGH • Bitalino Plug’n’Play • Check back of the Bitalino board for EMG • Plug the cable to EMG socket of Bitalino • Glue electrodes in the arm (show best available positions of the arm) • Connect cables’ terminals to electrode • Middle cable (white) is reference. Please attach to non- fleshy arm area) • Red and black on muscle electrodes
  6. 6. WALKTHROUGH • Setting up Bitalino External object in Max • Make sure you have Max in 64bit mode (get info, switch off 32bit mode) • Start Max from Applications folder, not from the dock! • Connect (if problems with port - message shown in Max terminal, restart Max or even computer) • Start Max audio • Check EMG signal on visualiser
  7. 7. WALKTHROUGH • Conditioning Bitalino EMG signal with Max • Bitalino connection and modes • Visualising the signal • Data for sonification and control • Low Pass filter to smooth data • Smoothing - ~0.97 • Post gain - ~4.0 • Calibration - Toggle button to get local min/max - relax/tense • Sonification • Raw signal sonification • Out to MIDI (set mode Off -> Glissando -> )
  8. 8. WALKTHROUGH
  9. 9. WALKTHROUGH • Machine Learning setup with Wekinator • Setting OSC connection to signal source • Setting inputs and outputs • Recording, training and running the models • Connection to Blotar~ • Overview of Blotar~ object and path • Sonification with Blotar~
  10. 10. WALKTHROUGH • Install Wekinator • Install Wekinator from USB flash drive • Watch for security settings with the install of Wekinator 2.0.1 • Lauch Wekinator, • Check port 6448 • Click start listening • Set #inputs to 1, set #outputs to 9 • Press Next
  11. 11. WALKTHROUGH
  12. 12. WALKTHROUGH • Interactive Machine Learning loop with Wekinator • Verify OSC inputs are the expected (green status) • Record gesture #1 and map parameters • Press Preset #1 on Blotar patch • Check changes on Wekinator’s Output parameters • Relax arm, press Recording button • Press Stop button • Press Train button • Record gesture #2 do the same with tense arm • Press Run for performance mode with new data
  13. 13. WALKTHROUGH
  14. 14. Atau Tanaka - a.tanaka@gold.ac.uk Francisco Bernardo - f.bernardo@gold.ac.uk INTERACTIVE APPLICATIONS IN MACHINE LEARNING WORKSHOP Musical Gesture as Creative Interface Conference Universidade Católica Portuguesa 2016 THANK YOU!

×