1ECE Department

[I/O]³Input/Output Cubed

Kevin EykholtTom FinneranChris PitoniakShamit Som

2ECE Department

Problem Statement Problem:

• Time: Mistakes can be time-consuming to correct

• Visualization: It is hard to use a computer to make virtual 3D models

• Health Hazard: Long-term exposure to sculpting materials can cause significant health hazards

• Waste: Many iterations of physical models require materials that are not resused

3ECE Department

Effect on the Individual

It should allow the user to correct mistakes easily without having to restart the project

It should make computer modeling more intuitive and efficient for the user

We want this On this Current Approach

4ECE Department

Effect on Group Extensive work with sculpting materials exposes modelers to

dust, a significant health hazard• Long-term exposure to silica dust, common in ceramic

sculpting, can lead to Silicosis, a.k.a. “Potter’s Rot”

5ECE Department

Effect on Group

Need to reduce the amount of waste generated from failed project attempts

6ECE Department

Significance

3D Modeling covers many disciplines:• Entertainment: Movies, Games, Art

• Concept Art• Mechanical/Civil Engineering and Architecture

• Product mock-ups• Biology and Chemistry

• Displaying chemical structures• DNA and protein models

7ECE Department

Requirements Analysis: User Specifications

Use hand gestures to create, modify, and manipulate virtual 3D models

Display accurate, distortion-free holographic image

Respond to user inputs in real-time

Relatively inexpensive - <$1000

8ECE Department

Inputs and Outputs

Inputs• Hand Gestures

Outputs• Hologram• Virtual 3D Computer Model

9ECE Department

General Solution Block Diagram

InputHand Gesture Recognition

Output

3D Volumetric Display

Computer/Software

3D Object Data

Traditional 2D Representation

10ECE Department

Requirement Analysis – Technical Specifications Real-time response – <100ms update time No major power specifications – device is mains powered No major weight specifications – device is stationary Input Specifications:

• Respond to hand gestures• Recognize enough different gestures to distinguish between

different functions• 1 millimeter skeletal precision

Software Specifications:• Map input gestures to functions in the virtual 3D object space

• Object functions: creation, translation, rotation, scaling• Control functions: save, undo

• Display traditional 2D representation of virtual objects• Generate appropriate output for volumetric display

11ECE Department

Requirement Analysis – Technical Specifications Output:

• Distortion-free, volumetric image• 75 X 75 x 75 voxel resolution minimum• ≥20 FPS refresh rate• No smaller than a 2 inch cube display• Quiet operation (<30 dBa)

12ECE Department

Design Alternatives - Input

Kinect• About $100 on Amazon• Pros:

• Great for tracking large body movements• Widely available software support

• Cons:• Low precision finger tracking (>1mm)

13ECE Department

Design Alternatives - Software

3D Modeling Software:• Pros:

• Complex object manipulation is already implemented in the software

• Cons:• Expensive: Maya and 3DS

Max are $195 a month• Tough to programmatically

control due to lack of low-level access

14ECE Department

Design Alternatives - Output

Stacked Spinning LED Display• Pros:

• Cheaper components• Simple theory of operation

• Cons:• Low resolution• Mechanically complex• Difficult to transmit data due

to moving parts

15ECE Department

Design Alternatives - Output

Planar Spinning LED Display• Pros:

• Simple theory of operation• Cons:

• Low resolution• Mechanically complex• Prohibitively expensive

• 5000+ LEDs for decent resolution

• Control circuitry

• Difficult to transmit data due to moving parts

16ECE Department

Design Alternatives - Output

Helical Volumetric Sweep• Pros:

• Simple mechanical implementation

• Can transmit data over a cable• Cons:

• Difficult to focus on entire depth of volumetric sweep

• Complex real-time processing due to helical cross sections

17ECE Department

Our Solution - Block Diagram

Input

Output

Leap Motion

Input Parsing

Output Processing

2D Visual Diagnostic

Planar Volumetric Sweep Device

Projector

Data Processing

Output

Leap

M

oti

on

Sen

sor

Data

Data

Computer

18ECE Department

Input Concept - LEAPMotion

LEAPMotion sensor reads in hand motion, stores relevant data • Stores hand/finger positions into lists

to determine corresponding gesture Sensor can differentiate between

hand gestures• Swipes, finger clicks, circles, pinches

1mm skeletal precision

19ECE Department

Input Concept - Software

Map input gestures to specific manipulations

• Create, rotate, translate, scale, undo, save, etc

Virtual models displayed on the 2D visual diagnostic software

Planar cross sections are taken and sent to the output for 3D display

Using JOGL for rendering traditional 2D representation

20ECE Department

Output Concept

Piston converts rotary motion (supplied by motor) into constant, reciprocating linear motion

Projector and projection plane will be fixed relative to each other– eliminates focus issues• Possible issues with sourcing cable able to

withstand mechanical stress Projection screen must be thin and mostly

translucent• Slight opacity needed to successfully project

image visibly on both sides of screen

21ECE Department

Output Concept

Projector will project planar cross-sections of desired image• Software processing of planar cross sections

significantly easier to manage than helical cross sections

Fast enough reciprocation (~12Hz for 24fps interlaced) will allow for persistence-of-vision effects

Projection rate determines resolution in sweeping axis• Higher projection rate more sections per

cycle

22ECE Department

Team

Shamit Som - EEClass of 2014

Kevin Eykholt - CSEClass of 2014

Chris Pitoniak- CSEClass of 2014

Tom Finneran- CSEClass of 2014

Dennis Goeckel - ProfessorFaculty Advisor

23ECE Department

CDRMDR

Timeline

Leap Motion gesture

recognition

Basic Shape

Generation

Scaling, Translation,

Rotation

Leap Motion gesture mapping

Build volumetric

sweep frame

Add motor and ensure mechanical

stability

Conceptual design for software to projector interface

Chris

Kevin

Shamit

Tom

27 Oct 12 Nov 20 Nov 31 Dec 15 Jan 20 Feb 21 Mar

Generate planar cross

sections

Test and optimize

POV effect

Implement and test interface

Add projector

Integrate Full

system and test

Test gesture mapping

Test POV

Effect

24ECE Department

MDR Deliverables

Input:• Demonstrate Scaling and Rotation• Demonstrate interaction between Leap Motion and software

• Confirmed with 2D Visual Diagnostic

Output:• Create a volumetric sweep device

• Critical path to entire output system• Simple demonstration of POV effect