Successfully reported this slideshow.

INTERACTIVE APPLICATIONS IN MACHINE LEARNING

0

Share

Loading in …3
×
1 of 14
1 of 14

INTERACTIVE APPLICATIONS IN MACHINE LEARNING

0

Share

Download to read offline

2016 - Porto International Conference on Musical Gesture as Creative Interface, Porto, Portugal

2016 - Porto International Conference on Musical Gesture as Creative Interface, Porto, Portugal

More Related Content

Related Books

Free with a 14 day trial from Scribd

See all

INTERACTIVE APPLICATIONS IN MACHINE LEARNING

  1. 1. Atau Tanaka - a.tanaka@gold.ac.uk Francisco Bernardo - f.bernardo@gold.ac.uk INTERACTIVE APPLICATIONS IN MACHINE LEARNING WORKSHOP Musical Gesture as Creative Interface Conference Universidade Católica Portuguesa 2016
  2. 2. BRIEFING • Presentation of materials • Hardware - Bitalino Dev Kit • Software - EMG Max patch, Wekinator, Blotar • Walkthrough for the workshop • Installation • Overview of EMG signal conditioning in Max • Sonification I • Regression with Machine Learning • Sonification II - Blotar~ • Free activity
  3. 3. MATERIALS • Hardware: • Bitalino Revolution Kit (x 10) • Electrodes (x 3) • Cables (x 1) • Software (folder in USB flash) • Bitalino Max External Object • Max Patch with LFP/RMS & abstractions • Wekinator 2.0.1
  4. 4. WALKTHROUGH • Pair Bitalino with your computer • Go to Bluetooth preferences on Mac OS X sys preferences • Turn-on Bluetooth; Turn on Bitalino; • Select Bitalino from list of available devices; • Confirm your Bitalino MAC address label; • Click Options, introduce pairing code “1234” • Check the state of Bitalino in BT devices list (paired, but not connected). • Rename your Bitalino with your unique identifier
  5. 5. WALKTHROUGH • Bitalino Plug’n’Play • Check back of the Bitalino board for EMG • Plug the cable to EMG socket of Bitalino • Glue electrodes in the arm (show best available positions of the arm) • Connect cables’ terminals to electrode • Middle cable (white) is reference. Please attach to non- fleshy arm area) • Red and black on muscle electrodes
  6. 6. WALKTHROUGH • Setting up Bitalino External object in Max • Make sure you have Max in 64bit mode (get info, switch off 32bit mode) • Start Max from Applications folder, not from the dock! • Connect (if problems with port - message shown in Max terminal, restart Max or even computer) • Start Max audio • Check EMG signal on visualiser
  7. 7. WALKTHROUGH • Conditioning Bitalino EMG signal with Max • Bitalino connection and modes • Visualising the signal • Data for sonification and control • Low Pass filter to smooth data • Smoothing - ~0.97 • Post gain - ~4.0 • Calibration - Toggle button to get local min/max - relax/tense • Sonification • Raw signal sonification • Out to MIDI (set mode Off -> Glissando -> )
  8. 8. WALKTHROUGH
  9. 9. WALKTHROUGH • Machine Learning setup with Wekinator • Setting OSC connection to signal source • Setting inputs and outputs • Recording, training and running the models • Connection to Blotar~ • Overview of Blotar~ object and path • Sonification with Blotar~
  10. 10. WALKTHROUGH • Install Wekinator • Install Wekinator from USB flash drive • Watch for security settings with the install of Wekinator 2.0.1 • Lauch Wekinator, • Check port 6448 • Click start listening • Set #inputs to 1, set #outputs to 9 • Press Next
  11. 11. WALKTHROUGH
  12. 12. WALKTHROUGH • Interactive Machine Learning loop with Wekinator • Verify OSC inputs are the expected (green status) • Record gesture #1 and map parameters • Press Preset #1 on Blotar patch • Check changes on Wekinator’s Output parameters • Relax arm, press Recording button • Press Stop button • Press Train button • Record gesture #2 do the same with tense arm • Press Run for performance mode with new data
  13. 13. WALKTHROUGH
  14. 14. Atau Tanaka - a.tanaka@gold.ac.uk Francisco Bernardo - f.bernardo@gold.ac.uk INTERACTIVE APPLICATIONS IN MACHINE LEARNING WORKSHOP Musical Gesture as Creative Interface Conference Universidade Católica Portuguesa 2016 THANK YOU!

×