ARM AS A TOUCHSCREEN

Presented ByAbhijeet S. Kapse

Guided ByProf. S.B. Somani

1MITCOE

Introduction What is Skinput Principle of Skinput How it works Advantages Applications Future Implementation Conclusion

Overview

2MITCOE

Mobiles becomes ubiquitous Mobility, flexibility, responsiveness getting

more demands Devices with small sized have some

limitations Can’t make buttons and screens large without losing benefit of small sized Microsoft introduces new flesh-control input

technology-”Skinput”

Introduction

3MITCOE

Collaboration between Chris Harrison at Carnegie Mellon University and team of Microsoft research lab.

Touch-Screen gadgets have become popular due to the advantages they come with

Skinput turns the body into a touch-screen interface

What Is Skinput

4MITCOE

Skinput allow the users to simply tap their skin in order to control mobile applications

It applies the use of series of sensors to determine where user taps on their arms

Each part of body creates different types of vibrations depending on features of bones, muscle and tendons

Principle Of Skinput

5MITCOE

MITCOE

Pico-Projector

How It Works

Bluetooth

Bio-Acoustics

6

Pico-Projector: Small Sized Projector to Display menu Widely Used in Gadgets like Mobile ,

Camera

How It Works

7MITCOE

Bio-Acoustics: Study Of Sound waves inside living body When a finger taps the skin, distinct forms

of acoustics energy are produced- Longitudinal waves Transverse waves

How It Works

8MITCOE

Bio-Acoustics

Transverse Wave Propagation

Longitudinal Wave Propagation

• Finger Impacts creates transverse waves(ripples)

• Sensor is Activated as wave passes underneath it

• Finger impact creates longitudinal (compressive)waves

• Causes internal skeletal structure to vibrate

9MITCOE

Sensors

• Wave Sensor Armband

• Responsive to the Vibrations

10MITCOE

Vibrations are Captured from Sensors and

Converted to Digital signal form

This is connected to Mobile device Via Bluetooth

A Software to match sound frequencies to Specific skin

location is used

Corresponding Action is implemented in Device

Processing : Model

11MITCOE

Experimental Condition

Fingers •Tapping on tips of fingers• Accurately Interact with eyes free manner

Arm• Maximum Surface area• Provides 10 Different Locations

12MITCOE

Analysis:

Ten Channels of acoustic data generated by three finger taps on the Forearm, followed by three taps

on Wrist

13MITCOE

BMI Effect :

14MITCOE

No need to interact with the gadget directly. Don’t have to worry about keypad. People with larger fingers get trouble in

navigating tiny buttons and keyboards on mobile phones.

With Skinput that problem disappears. Can be used without visual screen

Advantages

15MITCOE

Mobile i-Pods Gaming Simpler Browsing System

Applications

16MITCOE

Small Sized Pico-projector Wrist watch size sensor armband

Future Implimentation

17MITCOE

We have presented the approach to appropriating the human body as an input surface.

We described a novel wearable bio acoustic array used to detect and localize finger taps on the hand and forearm.

Conclusion

18MITCOE

1) Chris Harrison, Desney Tan, and Dan Morris “Skinput: Appropriating the Skin as an Interactive Canvas” Microsoft Research 2011.

2) Chris Harrison, Scott E. Hudson “Scratch Input: Creating, Large

Inexpensive, Unpowered and Mobile Finger Input Surfaces” UIST 2008.3) Amento, B.Hill, W.Terveen “The Sound of one Hand: A wrist- mounted bio-acoustic fingertip gesture interface” CHI’02.4) Thomas Hahn “Future Human Computer Interaction with

special focus on input and output techniques” HCI March 2006.

References

19MITCOE

Thank You

20MITCOE