2016 - Porto International Conference on Musical Gesture as Creative Interface, Porto, Portugal

1. Atau Tanaka - a.tanaka@gold.ac.uk
Francisco Bernardo - f.bernardo@gold.ac.uk
INTERACTIVE APPLICATIONS IN MACHINE LEARNING
WORKSHOP
Musical Gesture as Creative Interface Conference
Universidade Católica Portuguesa
2016

2. BRIEFING
• Presentation of materials
• Hardware - Bitalino Dev Kit
• Software - EMG Max patch, Wekinator, Blotar
• Walkthrough for the workshop
• Installation
• Overview of EMG signal conditioning in Max
• Sonification I
• Regression with Machine Learning
• Sonification II - Blotar~
• Free activity

3. MATERIALS
• Hardware:
• Bitalino Revolution Kit (x 10)
• Electrodes (x 3)
• Cables (x 1)
• Software (folder in USB flash)
• Bitalino Max External Object
• Max Patch with LFP/RMS & abstractions
• Wekinator 2.0.1

4. WALKTHROUGH
• Pair Bitalino with your computer
• Go to Bluetooth preferences on Mac OS X sys preferences
• Turn-on Bluetooth; Turn on Bitalino;
• Select Bitalino from list of available devices;
• Confirm your Bitalino MAC address label;
• Click Options, introduce pairing code “1234”
• Check the state of Bitalino in BT devices list (paired, but
not connected).
• Rename your Bitalino with your unique identifier

5. WALKTHROUGH
• Bitalino Plug’n’Play
• Check back of the Bitalino board for EMG
• Plug the cable to EMG socket of Bitalino
• Glue electrodes in the arm (show best available positions
of the arm)
• Connect cables’ terminals to electrode
• Middle cable (white) is reference. Please attach to non-
fleshy arm area)
• Red and black on muscle electrodes

6. WALKTHROUGH
• Setting up Bitalino External object in Max
• Make sure you have Max in 64bit mode (get info, switch off
32bit mode)
• Start Max from Applications folder, not from the dock!
• Connect (if problems with port - message shown in Max
terminal, restart Max or even computer)
• Start Max audio
• Check EMG signal on visualiser

7. WALKTHROUGH
• Conditioning Bitalino EMG signal with Max
• Bitalino connection and modes
• Visualising the signal
• Data for sonification and control
• Low Pass filter to smooth data
• Smoothing - ~0.97
• Post gain - ~4.0
• Calibration - Toggle button to get local min/max - relax/tense
• Sonification
• Raw signal sonification
• Out to MIDI (set mode Off -> Glissando -> )

8. WALKTHROUGH

9. WALKTHROUGH
• Machine Learning setup with Wekinator
• Setting OSC connection to signal source
• Setting inputs and outputs
• Recording, training and running the models
• Connection to Blotar~
• Overview of Blotar~ object and path
• Sonification with Blotar~

10. WALKTHROUGH
• Install Wekinator
• Install Wekinator from USB flash drive
• Watch for security settings with the install of Wekinator
2.0.1
• Lauch Wekinator,
• Check port 6448
• Click start listening
• Set #inputs to 1, set #outputs to 9
• Press Next

11. WALKTHROUGH

12. WALKTHROUGH
• Interactive Machine Learning loop with Wekinator
• Verify OSC inputs are the expected (green status)
• Record gesture #1 and map parameters
• Press Preset #1 on Blotar patch
• Check changes on Wekinator’s Output parameters
• Relax arm, press Recording button
• Press Stop button
• Press Train button
• Record gesture #2 do the same with tense arm
• Press Run for performance mode with new data

13. WALKTHROUGH

14. Atau Tanaka - a.tanaka@gold.ac.uk
Francisco Bernardo - f.bernardo@gold.ac.uk
INTERACTIVE APPLICATIONS IN MACHINE LEARNING
WORKSHOP
Musical Gesture as Creative Interface Conference
Universidade Católica Portuguesa
2016
THANK YOU!