Multitouch Game TableMultitouch Game TableSenior Design Fall 2006Senior Design Fall 2006

What we did right and what we did wrong…What we did right and what we did wrong…Aditya MittalAditya Mittal

James WallaceJames WallaceAlbert YouAlbert You

Paul FerraraPaul Ferrara

Recap of What we are doingRecap of What we are doing

We are building a touch screen game We are building a touch screen game tabletable

Last semester we developed 3 small Last semester we developed 3 small prototypes of a touch screenprototypes of a touch screen

The touch screens were created by The touch screens were created by using infrared LED’s shining into an using infrared LED’s shining into an acrylic sheet and detecting them acrylic sheet and detecting them with a webcam covered with camera with a webcam covered with camera film to act as an infrared camerafilm to act as an infrared camera

Prototype 1Prototype 1

The wooden frame was not sturdy, The wooden frame was not sturdy, this led to poor internal reflection of this led to poor internal reflection of the infrared wavelengths in the the infrared wavelengths in the acrylicacrylic

Immediately we proceeded to the Immediately we proceeded to the construction of prototype 2construction of prototype 2

Prototype 2Prototype 2

The soldering job on the LED’s was The soldering job on the LED’s was poor and the spacing between them poor and the spacing between them was badwas bad

There were simply not enough LED’s There were simply not enough LED’s installed into the frame leading to installed into the frame leading to poor contrast and lots of random IR poor contrast and lots of random IR detections artifacts in places where detections artifacts in places where no touches were madeno touches were made

Prototype 3Prototype 3

The best of the 3 prototypes with a sturdy The best of the 3 prototypes with a sturdy wooden frame, the LED’s spaced out evenly wooden frame, the LED’s spaced out evenly and enough of them to give good contrast and enough of them to give good contrast and detect finger(s)and detect finger(s)

The problem with this prototype was that it The problem with this prototype was that it still included additional noisy infrared still included additional noisy infrared detections along the side of the frame, detections along the side of the frame, coming from the LED’s sticking too far in coming from the LED’s sticking too far in and not being covered by the wooden frameand not being covered by the wooden frame

It was however good enough to help us lead It was however good enough to help us lead into the production of a full size touchscreeninto the production of a full size touchscreen

The DriverThe Driver

A basic driver was formulated for A basic driver was formulated for testing the prototype touch screentesting the prototype touch screen

This driver used direct show filtering This driver used direct show filtering to detect basic motions of the areas to detect basic motions of the areas of the screen being touched and of the screen being touched and display them as rectangles on the display them as rectangles on the screenscreen

No processing based upon these No processing based upon these detected areas was done yetdetected areas was done yet

The Driver (cont.)The Driver (cont.)

The current driver is very inefficient The current driver is very inefficient and uses up unnecessary CPU powerand uses up unnecessary CPU power

The current driver did not include The current driver did not include erosion filtering which reduces the erosion filtering which reduces the noisy image generated by the noisy image generated by the webcam which results in artifacts webcam which results in artifacts where there is no motion madewhere there is no motion made

Final CommentsFinal Comments

We are currently optimizing the driverWe are currently optimizing the driver Working on hand gesture algorithmsWorking on hand gesture algorithms Mirrors and Lens reflection Mirrors and Lens reflection

calculations for proper rear view calculations for proper rear view projection from the projectorprojection from the projector

We need to line up the back of the We need to line up the back of the acrylic with tracing paper for acrylic with tracing paper for projecting onto the surface so the projecting onto the surface so the projector image does not shine into projector image does not shine into the eyethe eye

Thank youThank you

Multitouch Gameboard TeamMultitouch Gameboard Team