3D User Interface Hardware - UCF Department of EECS€¦ · 7 Spring 2008 CAP6938 – 3D User...
Transcript of 3D User Interface Hardware - UCF Department of EECS€¦ · 7 Spring 2008 CAP6938 – 3D User...
1
Spring 2008Spring 2008 CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr.
3D User Interface Hardware3D User Interface Hardware
Lecture #6: Input DevicesLecture #6: Input DevicesSpring 2008Spring 2008
Joseph J. LaViola Jr.Joseph J. LaViola Jr.
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Interaction WorkflowInteraction Workflow
2
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Lecture OutlineLecture Outline
Input device characteristicsInput device characteristicsDesktop devicesDesktop devicesTracking devicesTracking devices
positionpositioneyeeyeglovesgloves
3D mice3D miceDirect human inputDirect human inputBuilding special input devicesBuilding special input devices
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Input DevicesInput DevicesHardware that allows Hardware that allows the user to communicate the user to communicate with the systemwith the systemInput device vs. Input device vs. interaction techniqueinteraction techniqueSingle device can Single device can implement many Itsimplement many Its
3
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Input Device CharacteristicsInput Device Characteristics
Degrees of FreedomDegrees of Freedom ((DOFsDOFs) & ) & DOF DOF compositioncomposition (integral vs. separable)(integral vs. separable)Type of electronicsType of electronics: Digital vs. analog: Digital vs. analogRange of reported valuesRange of reported values: : discrete/continuous/hybriddiscrete/continuous/hybridData type of reported valuesData type of reported values: Boolean vs. : Boolean vs. integer vs. floating pointinteger vs. floating point
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
More Input Device More Input Device CharacteristicsCharacteristics
User action requiredUser action required: active/passive/hybrid: active/passive/hybridMethod of providing informationMethod of providing information: : ““pushpush””vs. vs. ““pullpull””Intended useIntended use: locator, valuator, choice, : locator, valuator, choice, ……Frame of referenceFrame of reference: relative vs. absolute: relative vs. absoluteProperties sensedProperties sensed: position, motion, force, : position, motion, force, ……
4
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Desktop Devices: KeyboardsDesktop Devices: Keyboards
Chord keyboardsChord keyboardsArmArm--mounted mounted keyboardskeyboards““SoftSoft”” keyboards keyboards (logical devices)(logical devices)
www.virtual-laser-keyboard.com
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Desktop Devices: Mice and Desktop Devices: Mice and TrackBallsTrackBalls
Many varietiesMany varieties2D input to 3DUI2D input to 3DUIRelative devicesRelative devices
5
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Desktop Devices: PenDesktop Devices: Pen--based based TabletsTablets
Absolute 2D deviceAbsolute 2D deviceEither direct or Either direct or indirectindirect
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Desktop Devices: JoysticksDesktop Devices: Joysticks
Isotonic vs. IsometricIsotonic vs. Isometric
6
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Desktop Devices: 6Desktop Devices: 6--DOF DevicesDOF Devices
6 6 DOFsDOFs without without trackingtrackingOften isometricOften isometricSpaceBallSpaceBall, , SpaceMouseSpaceMouse, , SpaceOrbSpaceOrb
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Tracking Devices: Position Tracking Devices: Position TrackersTrackers
Measure position and/or orientation of a sensorMeasure position and/or orientation of a sensorDegrees of freedom (Degrees of freedom (DOFsDOFs))Most VEs track the head Most VEs track the head
motion parallaxmotion parallaxnatural viewingnatural viewing
Types of trackersTypes of trackersmagneticmagneticmechanicalmechanicalacousticacousticinertialinertialvision/cameravision/camerahybridshybrids
7
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Other Uses For TrackersOther Uses For Trackers
Track hands, feet, etc.Track hands, feet, etc.““whole bodywhole body”” interactioninteractionmotion capture applicationmotion capture application
Correspondence between physical/virtual Correspondence between physical/virtual objectsobjects
propspropsspatial input devicesspatial input devices
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Tracking Physical Objects Tracking Physical Objects (Props)(Props)
8
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Magnetic TrackersMagnetic TrackersExample: Ascension BirdExample: Ascension BirdAdvantagesAdvantages
good rangegood rangeno line of sight issuesno line of sight issuesmoderately pricedmoderately priced
DisadvantagesDisadvantagesmetal or conductive metal or conductive material will distort the material will distort the magnetic fieldmagnetic fieldmagnetic field can magnetic field can interfere with nearby interfere with nearby monitorsmonitors
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Mechanical TrackersMechanical Trackers
Example: Example: FakespaceFakespace BOOM trackerBOOM trackerAdvantagesAdvantages
low latencylow latencyvery accuratevery accurate
DisadvantagesDisadvantagesbig and bulkybig and bulkyusually only one sensorusually only one sensorreduced mobilityreduced mobilityexpensiveexpensive
9
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Acoustic TrackersAcoustic TrackersExample: Logitech Fly Example: Logitech Fly MouseMouseAlso known as ultrasonic Also known as ultrasonic trackingtrackingAdvantagesAdvantages
no interference with no interference with metalmetalrelatively inexpensiverelatively inexpensive
DisadvantagesDisadvantagesline of sight issuesline of sight issuessensitive to certain sensitive to certain noisesnoises
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Inertial TrackingInertial TrackingExample: Example: InterSenseInterSenseIS300, IS300, WiimoteWiimoteAdvantagesAdvantages
no interference with no interference with metalmetallong rangelong rangeno need for transmitterno need for transmitter
DisadvantagesDisadvantagessubject to error subject to error accumulationaccumulationonly track orientationonly track orientation
10
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Optical/VisionOptical/Vision--based trackersbased trackers
ExsExs: : ViconVicon, , HiBallHiBall, , ARToolkitARToolkitAdvantagesAdvantages
accurateaccuratecan capture a large volumecan capture a large volumeallow for allow for untethereduntethered trackingtracking
DisadvantagesDisadvantagesimage processing image processing techniquestechniquesocclusion problemocclusion problem
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Hybrid TrackingHybrid Tracking
Example Example InterSenseInterSenseIS900IS900AdvantagesAdvantages
puts two or more puts two or more technologies together technologies together to improve accuracy, to improve accuracy, reduce latency, etcreduce latency, etc……
DisadvantagesDisadvantagesadds complexityadds complexity
11
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Tracking Devices: Eye TrackingTracking Devices: Eye Tracking
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Tracking Devices: BendTracking Devices: Bend--Sensing Sensing GlovesGloves
CyberGloveCyberGlove, 5DT, 5DTReports hand postureReports hand postureGesture:Gesture:
single posturesingle postureseries of posturesseries of posturesposture(s) + location posture(s) + location or motionor motion
12
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Tracking Devices: Pinch GlovesTracking Devices: Pinch Gloves
Conductive cloth at Conductive cloth at fingertipsfingertipsAny gesture of 2 to 10 Any gesture of 2 to 10 fingers, plus fingers, plus combinations of combinations of gesturesgestures> 115,000 gestures> 115,000 gestures
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
3D Mice3D Mice
Ring MouseRing MouseFly MouseFly MouseWandWandCubic MouseCubic MouseDragonflyDragonfly……
13
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
ShapeTapeShapeTape
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Human Input: SpeechHuman Input: Speech
Frees handsFrees handsAllows multimodal inputAllows multimodal inputNo special hardwareNo special hardwareSpecialized softwareSpecialized softwareIssues: recognition, ambient Issues: recognition, ambient noise, training, false noise, training, false positives, positives, ……
http://www.lindamoran.net/images/yelling.jpg
14
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Human Input: Bioelectric ControlHuman Input: Bioelectric Control
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Human Input: Body Sensing Human Input: Body Sensing DevicesDevices
15
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
More Human InputMore Human Input
Breathing device Breathing device --OSMOSEOSMOSEBrainBrain--body actuated body actuated controlcontrol
muscle movementsmuscle movementsthoughts!thoughts!
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Why Build 3D UI Devices?Why Build 3D UI Devices?Assist in designing new interaction techniquesAssist in designing new interaction techniquesImprove upon existing techniquesImprove upon existing techniquesProvide interfaces for specific 3D interactions and Provide interfaces for specific 3D interactions and applicationsapplicationsGive users more expressive powerGive users more expressive powerDevelop new interaction stylesDevelop new interaction stylesDevelop new and improved 3D interface hardwareDevelop new and improved 3D interface hardwareFun!!!!Fun!!!!
http://www.uni-weimar.de/cms/medien/virtual-reality/research/interfaces/input-device-and-interaction-techniques.html http://www.labri.fr/perso/hachet/CAT/
16
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Tools of the TradeTools of the TradeSensors, buttons, switches, controllers, Sensors, buttons, switches, controllers, etcetc……
www.futurlec.com
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
3D Input Device Building Strategies 3D Input Device Building Strategies Device functionDevice function
What will the device sense?What will the device sense?forceforcemotionmotionbutton pressesbutton presses
what physical device types are required?what physical device types are required?need to choose appropriate sensorsneed to choose appropriate sensors
digital/analogdigital/analogpressure, bend, potentiometers, pressure, bend, potentiometers, thermistorsthermistors
conductive cloth (great sensing material)conductive cloth (great sensing material)Sensor housingSensor housing
How will sensors be placed in the physical device?How will sensors be placed in the physical device?physical constraintsphysical constraintsphysical comfortphysical comfort
How to build the housing?How to build the housing?milling machinemilling machinevacuformvacuform devicedevice3D printer3D printerLego bricksLego bricksmodeling claymodeling clay
17
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Device ErgonomicsDevice ErgonomicsGood ergonomic design is Good ergonomic design is crucialcrucial
device housingdevice housingcontrol typescontrol types
Issues to considerIssues to considerdevice should be lightweightdevice should be lightweightavoid fatigueavoid fatiguesimple to usesimple to useeasy to reach buttons and easy to reach buttons and controlscontrolsavoid undue strainavoid undue straindondon’’t want to cause user paint want to cause user pain
http://www.it.bton.ac.uk/staff/lp22/CS133/haptics.html
CyberGrasp by Immersion
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Connecting Devices to the ComputerConnecting Devices to the ComputerNeed to connect device to the computerNeed to connect device to the computer
USBUSBserial portserial portBluetoothBluetooth
Often need a microcontroller (not always)Often need a microcontroller (not always)small computer that can interface with other small computer that can interface with other
electronic componentselectronic componentsPIC (PIC (www.microchip.comwww.microchip.com))BasicXBasicX--24 24 ---- easy to use easy to use
programming in Basicprogramming in Basichas nice development kithas nice development kit
A typical approachA typical approachbuild electronics with prototyping boardbuild electronics with prototyping boardwrite code in IDE and download to boardwrite code in IDE and download to boardtest and debugtest and debugput electronics on circuit boardput electronics on circuit boardwrite device driverwrite device driver www.basicx.com
18
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Software for the DeviceSoftware for the Device
Need to have software to use device in applicationsNeed to have software to use device in applicationsSeveral strategiesSeveral strategies
write driver from scratchwrite driver from scratchneed to know something about OS need to know something about OS –– low level support functionslow level support functionsunderstanding of serial/USB communication protocolsunderstanding of serial/USB communication protocolstypical functions typical functions –– open, close, read, writeopen, close, read, writeplug into APIplug into API
utilize existing software utilize existing software –– provide drivers for many devices and provide drivers for many devices and machinery to create new ones machinery to create new ones
VRPN VRPN –– developed at U. North Carolinadeveloped at U. North CarolinaVRJugglerVRJuggler –– developed at Iowa Statedeveloped at Iowa State
interface device toolkitsinterface device toolkitsPhidgetsPhidgetsII--CubeXCubeX
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Case Study 1 Case Study 1 –– Interaction SlippersInteraction Slippers
Providing more powerful Providing more powerful methods of expressionmethods of expressionOffload functionality to the Offload functionality to the useruser’’s feets feetInput DeviceInput Device
pair of commercial house pair of commercial house slippersslippersembedded Logitech Trackman embedded Logitech Trackman Live!Live!TMTM –– wireless trackballwireless trackballconductive clothconductive cloth
Allows for toe and heel tappingAllows for toe and heel tappingInteract with the Step WIMInteract with the Step WIM
miniature version of the world miniature version of the world place on the floorplace on the floortoe tap to invoke the WIM toe tap to invoke the WIM
19
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Case Study 2 Case Study 2 –– Reinventing the Reinventing the PinchPinchTMTM GloveGlove
Pinch GlovesPinch Glovesdetermines of two or more fingertips are determines of two or more fingertips are touchingtouchinguses conductive clothuses conductive clothdesigned for pinching and grabbing designed for pinching and grabbing gesturesgesturesat the time $2000at the time $2000had problems with reliabilityhad problems with reliability
Wanted to build custom deviceWanted to build custom deviceless expensive ($200)less expensive ($200)more flexibilitymore flexibility
not just pinching gesturesnot just pinching gesturesplugplug--nn--playplayallow for a variety of switchesallow for a variety of switches
www.fakespacelabs.com
Conductive Cloth Button
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Flex and Pinch InputFlex and Pinch InputDealing with input device Dealing with input device limitationslimitations
bend sensing gloves vs. pinch bend sensing gloves vs. pinch glovesglovesimprove existing interaction improve existing interaction techniquestechniques
Input DeviceInput Device16 conductive cloth contacts16 conductive cloth contactsused with bend sensing gloveused with bend sensing gloveCan be placed anywhereCan be placed anywhere
Improve image plane Improve image plane interaction techniquesinteraction techniques
allow user to activate allow user to activate selection with primary handselection with primary handmultiple flex button multiple flex button configurationsconfigurations
20
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
CavePaintingCavePainting TableTableImprove a specific applicationImprove a specific application
explore propexplore prop--based based interactioninteractionused for painting 3D scenesused for painting 3D scenes
Input DeviceInput Devicetracked paint brushtracked paint brushpaint cup propspaint cup props
uses conductive clothuses conductive clothbucket Toolbucket Toolmisc. knobs and switchesmisc. knobs and switches
Hold down brush button to Hold down brush button to paintpaintDip paint brush into paint Dip paint brush into paint cups to change strokescups to change strokesUse bucket to throw paintUse bucket to throw paint
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
FingerSleeveFingerSleeveInspiration for creating novel Inspiration for creating novel interaction techniquesinteraction techniquesPop through buttonsPop through buttons
use light and firm pressureuse light and firm pressureInput DeviceInput Device
worn on index fingerworn on index fingermade from elastic fabric and made from elastic fabric and flexible plasticflexible plastic6 DOF tracker attached to the 6 DOF tracker attached to the back of the sleeveback of the sleeveinteresting design issues with interesting design issues with button style and placementbutton style and placement
PrinciplePrinciplelight pressure used for temporary light pressure used for temporary actionactionactions confirmed by firm actions confirmed by firm pressurepressure
ZoomBackZoomBack TechniqueTechniquetemporary and permanent traveltemporary and permanent travel
Snapshot TechniqueSnapshot Technique
21
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Case Study 3 Case Study 3 –– 3motion3motion3D gesture interaction system3D gesture interaction system
developed by developed by KeirKeir et al. 2005, Digital et al. 2005, Digital Design Studio, Glasgow School of ArtDesign Studio, Glasgow School of Artdesigned as inexpensive tracking solutiondesigned as inexpensive tracking solutionused for gesture trackingused for gesture tracking
ComponentsComponentssingle chip 3single chip 3--axis linear accelerometeraxis linear accelerometerseveral buttonsseveral buttonswireless wireless bluetoothbluetooth communicationcommunicationsoftware SDKsoftware SDK
Tested in gaming environment and Tested in gaming environment and character manipulatorcharacter manipulatorUsed on cell phone to play virtual golfUsed on cell phone to play virtual golf
Can you say, Can you say, ““WiiWii””??
http://research.navisto.ch/publications.html
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
From Lab to Production (1)From Lab to Production (1)Chord Gloves
Mapes and Moshell (1995)PinchTM GlovesBy Fakespace
Cubic Mouse
Cubic Mouse
Fröhlich and Plate (2000)
By Fakespace
22
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
From Lab to Production (2)From Lab to Production (2)The CAT (Computer Action Table)
Hachet et al. (2003)
The CATBy
Immersion SAS
www.immersion.frHiBall 6D Tracker
Welch (1996)http://www.cs.unc.edu/~tracker/media/html/hiball.html
HiBallBy 3rd Tech
http://www.3rdtech.com/HiBall.htm
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Prototyping Toolkits Prototyping Toolkits –– PhidgetsPhidgetsPhidgetsPhidgets (Greenberg and (Greenberg and FitchettFitchett 2001) 2001) –– building blocks building blocks for low cost sensing/controlfor low cost sensing/control
uses USBuses USBclean separation of hardware and softwareclean separation of hardware and softwaresimple APIsimple APIDonDon’’t need to worry about t need to worry about
microprocessorsmicroprocessorscommunication protocolscommunication protocolssolderingsoldering
Variety of sensorsVariety of sensorstouchtouchlightlightforceforcevibrationvibrationrotationrotation
Other toolsOther toolsaccelerometersaccelerometersswitchesswitchesRFID tagsRFID tagsetcetc……
www.phidgets.com
Digital Inputs
Digital Outputs
Analog inputs
23
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Prototyping Toolkits Prototyping Toolkits –– II--CubeXCubeX
II--Cube (Cube (MulderMulder 1995) 1995) –– uses the Musical Instrument Device Interface uses the Musical Instrument Device Interface (MIDI)(MIDI)
MIDI MIDI –– protocol for communicating control informationprotocol for communicating control informationalso uses Bluetooth (wireless)also uses Bluetooth (wireless)similar advantages to similar advantages to PhidgetsPhidgets
no no microcontollermicrocontoller programmingprogrammingno circuit designno circuit designsoftware APIsoftware API
Variety of SensorsVariety of Sensorsairairtouchtouchbendbendtemperaturetemperaturemagneticmagneticlightlighttilttilt
infusionsystems.com
BioBeat SensorTouch Sensor
3D Acceleration Sensor
CAP6938 CAP6938 –– 3D User Interfaces for Games and Virtual Reality 3D User Interfaces for Games and Virtual Reality ©©Joseph J. LaViola Jr. Joseph J. LaViola Jr. Spring 2008Spring 2008
Next ClassNext Class
Selection and ManipulationSelection and ManipulationReadingsReadings
3DUI Book 3DUI Book –– Chapter 4Chapter 4