TESP 2012 Drums Haptic Interface

14
TESP 2012 Haptics Summer Project Todokoro and Konyo Lab

description

Few days Arduino based project to develop sound (frequency) dependent haptic interface for simulated instruments on touch-screen devices like tablets or phones. Input is simply the audio signal. Could be expanded to real instruments for the enhancement of the feeling by using a microphone.

Transcript of TESP 2012 Drums Haptic Interface

Page 1: TESP 2012 Drums Haptic Interface

TESP 2012Haptics Summer Project

Todokoro and Konyo Lab

Page 2: TESP 2012 Drums Haptic Interface

The Team

Justinas MišeikisETH Zürich and CSIRO

Yeong-geol BAEChugnam national University, Korea

Abhinandan TripathiSummer Research Student, Tohoku Univ.

Page 3: TESP 2012 Drums Haptic Interface

Playing Music

Movement MusicInstrument

Sound

HapticFeeling

Emotion

Page 4: TESP 2012 Drums Haptic Interface

Modern Times

Page 5: TESP 2012 Drums Haptic Interface

The Problem

Movement MusicInstrument

Sound

HapticFeeling

Emotion

Page 6: TESP 2012 Drums Haptic Interface

SensivaAn augmented haptic system

Page 7: TESP 2012 Drums Haptic Interface

Simulation

Signal with various frequencySignal with various frequency

INPUT

Analyzed frequency

OUTPUT

Filtering

Page 8: TESP 2012 Drums Haptic Interface

Simulation - LabView

Input SignalFilter

Measure Amplitude

Output Signal

Block diagram of simulation program

Page 9: TESP 2012 Drums Haptic Interface

Simulation

Simulation User InterfaceOutput Signal

Input Signal AnalysisMode Selection

Generate Signal

Page 10: TESP 2012 Drums Haptic Interface

The Signal Flow

Spectrum AnalyzerSOUND

AMP 1(Right Hand)

AMP 1(Left Hand)

Actuator 2

Actuator 4

Actuator 3

ARDUINO

Actuator 1

63 Hz to 16 KHz

40 Hz to 400 HZ

Page 11: TESP 2012 Drums Haptic Interface

The Circuit Setup

Page 12: TESP 2012 Drums Haptic Interface

Demo

Look there!

Page 13: TESP 2012 Drums Haptic Interface

Discussion

● Works well with simulated drums

● Microphone input can be used

● Portable device

● Various instruments

● Additional effects

Page 14: TESP 2012 Drums Haptic Interface

Thank you!

Questions?