Atau Tanaka - a.tanaka@gold.ac.uk Francisco Bernardo - f.bernardo@gold.ac.uk

INTERACTIVE APPLICATIONS IN MACHINE LEARNINGWORKSHOP

Musical Gesture as Creative Interface Conference

Universidade Católica Portuguesa

2016

BRIEFING

• Presentation of materials• Hardware - Bitalino Dev Kit • Software - EMG Max patch, Wekinator, Blotar

• Walkthrough for the workshop• Installation • Overview of EMG signal conditioning in Max • Sonification I • Regression with Machine Learning • Sonification II - Blotar~ • Free activity

MATERIALS

• Hardware:• Bitalino Revolution Kit (x 10) • Electrodes (x 3) • Cables (x 1)

• Software (folder in USB flash) • Bitalino Max External Object • Max Patch with LFP/RMS & abstractions • Wekinator 2.0.1

WALKTHROUGH

• Pair Bitalino with your computer• Go to Bluetooth preferences on Mac OS X sys preferences • Turn-on Bluetooth; Turn on Bitalino; • Select Bitalino from list of available devices; • Confirm your Bitalino MAC address label; • Click Options, introduce pairing code “1234” • Check the state of Bitalino in BT devices list (paired, but

not connected). • Rename your Bitalino with your unique identifier

WALKTHROUGH

• Bitalino Plug’n’Play• Check back of the Bitalino board for EMG • Plug the cable to EMG socket of Bitalino • Glue electrodes in the arm (show best available positions

of the arm) • Connect cables’ terminals to electrode

• Middle cable (white) is reference. Please attach to non-fleshy arm area)

• Red and black on muscle electrodes

WALKTHROUGH

• Setting up Bitalino External object in Max• Make sure you have Max in 64bit mode (get info, switch off

32bit mode) • Start Max from Applications folder, not from the dock! • Connect (if problems with port - message shown in Max

terminal, restart Max or even computer) • Start Max audio • Check EMG signal on visualiser

WALKTHROUGH

• Conditioning Bitalino EMG signal with Max• Bitalino connection and modes • Visualising the signal

• Data for sonification and control• Low Pass filter to smooth data

• Smoothing - ~0.97 • Post gain - ~4.0

• Calibration - Toggle button to get local min/max - relax/tense • Sonification

• Raw signal sonification • Out to MIDI (set mode Off -> Glissando -> )

WALKTHROUGH

WALKTHROUGH

• Machine Learning setup with Wekinator• Setting OSC connection to signal source • Setting inputs and outputs • Recording, training and running the models

• Connection to Blotar~• Overview of Blotar~ object and path • Sonification with Blotar~

WALKTHROUGH

• Install Wekinator• Install Wekinator from USB flash drive • Watch for security settings with the install of Wekinator

2.0.1 • Lauch Wekinator,

• Check port 6448 • Click start listening • Set #inputs to 1, set #outputs to 9 • Press Next

WALKTHROUGH

WALKTHROUGH

• Interactive Machine Learning loop with Wekinator• Verify OSC inputs are the expected (green status) • Record gesture #1 and map parameters

• Press Preset #1 on Blotar patch • Check changes on Wekinator’s Output parameters • Relax arm, press Recording button • Press Stop button • Press Train button

• Record gesture #2 do the same with tense arm • Press Run for performance mode with new data

WALKTHROUGH

Atau Tanaka - a.tanaka@gold.ac.uk Francisco Bernardo - f.bernardo@gold.ac.uk

INTERACTIVE APPLICATIONS IN MACHINE LEARNINGWORKSHOP

Musical Gesture as Creative Interface Conference

Universidade Católica Portuguesa

2016

THANK YOU!