SIXTH SENSE TECHNOLOGY

Submitted By:SUSHMA SINGHEC(B)0906831087

PHYSICAL WORLD Objects ~ Gestures

Gestures ~ Interaction

INTERACTIVE ~TECHNOLOGIES

• Multi touch Systems• Flexible screens• Multi touch IWB (Interactive White

Boards)• Smart interactive Tablets & multi touch

desks• Microsoft Surface• SIXTH SENSE TECHNOLOGY

SOME OF INTERACTIVE TECHNOLOGIES

EARLIER EXPLORATIONS

• Gesture interface device

• Sticky notes

• Pen that can draw in 3-D

• Google Maps in a physical world

WHY SIXTH SENSE ????

• Here by Physical world is painted with the digital information.

• You can carry your digital world with you wherever you go.

• You can start with any wall or any surface as an interface even your palm.

INTRODUCTION Sixth Sense is a wearable gestural interface

that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.

Sixth Sense bridges the gap by bringing

intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand.

CONTD……………. It was developed by Pranav Mistry, a PhD

student in the Fluid Interfaces Group at the MIT Media Lab.

Sixth Sense comprises a pocket projector, a mirror, a camera and a smart phone. The hardware components are coupled in a pendant like mobile wearable device.

COMPONENTS Camera

• Projector

• Mirror

• Colored Markers

• Smart Phone/laptop

CAMERA

.Captures an object in view and tracks the user’s hand gestures.

• .It sends the data to smart phone.

• .It acts as a digital eye, connecting you to the world of digital information.

PROJECTOR• The projector projects

visual information enabling surfaces and physical objects to be used as interfaces.

• It displays data sent from the smart phone on any surface in view–object, wall, or person.

MIRROR

Mirror

• The usage of the mirror is significant as the projector angles pointing downwards from the neck. .

COLOR MARKERS• At the tip of the

user’s fingers.

• Helps the webcam to recognize the gestures.

• The movements and arrangements of these makers are interpreted into gestures.

SMART PHONE• A web enabled

smart phone in the user’s pocket processes the video data.

• Other software searches the web and interprets the hand gestures.

WORKING?• Images • Pictures • Gestures

Info on surface

captureSend for processing

Reflect on desired surface

Project image

Send Info

CAPABILITIES Recognizes hand movements Examples from online demonstrations:

Make frame with hands: camera takes picture Google map onto wall Draw circle on wrist: projects digital clock Movement of text book/web info onto page Airline ticket updates Draw @ symbol: check email for you Many more capabilities (it’s on youtube or TED

website)

APPLICATIONS

CHECK THE TIME• Check the time just by

drawing a circle on the wrist.

WATCH VIDEOS• Watch related videos

on the newspaper articles you are reading.

MAKE A CALL• To make a call, virtual

keypad is shown on your palm.

CALL UP A MAP• Call up the map and use

thumbs & index fingers to navigate through.

ZOOMING FEATURES• Zoom in & zoom out using

intuitive hand movements.

DRAWING APPLICATION• Drawing application by

tracking fingertip movements.

PEOPLE INFORMATION• Projects relevant

information regarding a person.

TAKE PICTURES• Click pictures just by

forming “framing gesture”.

ORGANIZE PHOTOS• Organize, sort & resize

pictures by projecting them on a surface.

GET PRODUCT INFORMATION

• Get product information by using image recognition technology.

BOOK INFORMATION• Get book reviews, ratings

& other relevant information.

GET FLIGHT UPDATES• Get flight updates

regarding timing of the flight.

ADVANTAGES• • Connectedness between world and information.

• • Data access directly from machine in real time.

• • Mind map the data anywhere.

• • Portable.

• Inexpensive. ⌠Cost: ~350$ ⌡ Software will be open source • Cool.

• • OPEN SOURCE.

CONCLUSION Integrating information to everyday objects

will not only help us to get rid of the digital divide, but will also help us in some way to stay human, to be more connected to our physical world.

THANK YOU……