Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost...
-
Upload
sherilyn-russell -
Category
Documents
-
view
224 -
download
0
Transcript of Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost...
![Page 1: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/1.jpg)
Space Perception: the towards-away direction
The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction
![Page 2: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/2.jpg)
Lets think about space as a costof knowledge.
![Page 3: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/3.jpg)
The perception for action pathway
![Page 4: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/4.jpg)
The 3D vs 2D debate
Should we display abstract data in 3D? Depth cue theory Depth cues are environmental information
that tell us about space Can be applied somewhat independently
![Page 5: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/5.jpg)
Do these make any sense?
![Page 6: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/6.jpg)
![Page 7: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/7.jpg)
Depth Cues
Shape from Shading - texture Occlusion Perspective Shadows Stereo Motion parallax
![Page 8: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/8.jpg)
Perception of surface shape
Simple lighting model Light from above and at infinity Specular, Diffuse and Ambient
components Oriented texture can enhance shape
perception
![Page 9: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/9.jpg)
Lighting model
Lambertian, specular, ambient + cast shadows
![Page 10: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/10.jpg)
Standard lighting model
Specular refection
diffuse reflection =lambertian
Ambient illumination
![Page 11: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/11.jpg)
Examples
![Page 12: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/12.jpg)
ShadingSpecular reveals fine detail
![Page 13: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/13.jpg)
Cushion Tree Map Jarke Van Wijk
![Page 14: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/14.jpg)
Lighting
Simple lighting model Not photorealistic Single light source from above and at
infinity Specular for detail Cast shadows if scene is simple
![Page 15: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/15.jpg)
Contour and Shading
![Page 16: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/16.jpg)
Textures for surface orientation (Interrante)
![Page 17: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/17.jpg)
Understanding surface shape
Victoria Interrante
![Page 18: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/18.jpg)
Occlusion: The strongest depth cue
![Page 19: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/19.jpg)
Perspective
![Page 20: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/20.jpg)
Perspective
![Page 21: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/21.jpg)
![Page 22: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/22.jpg)
Perspective (Cockburn and McKenzie)
PerspectivePicture plane positionOcclusion
Picture plane position
Occlusion
![Page 23: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/23.jpg)
Atmospheric perspective
Reduce contrast with distance
“depth cueing” in CG
![Page 24: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/24.jpg)
![Page 25: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/25.jpg)
Structure from Motion
aa
ba
c
![Page 26: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/26.jpg)
Cast Shadows
![Page 27: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/27.jpg)
Stereo Vision Basics
aa
Right eyeScreen
Left eye
Panum's Fusional Area
disparity = -
![Page 28: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/28.jpg)
Stereopsis
Based on disparities A super acuity Only good near point of fixation Poor for large differences Double imaging possible for 1/10th deg.
![Page 29: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/29.jpg)
Frame Cancellation
![Page 30: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/30.jpg)
Relative Importance
, 96
Cutting, 1996
Depth
Con
trast
Depth (meters)
Occlusion0.001
0.01
0.1
1.0
1 10 100
Relative size
Height in field
Binoculardisparity
Motionparallax
Convergenceaccommodation
Aerial
![Page 31: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/31.jpg)
Task Based Space Perception
a
Task Planningand Execution
3D CognitiveModelof Environment
C1
C2
C3
C4
CN
a
C1
C2
C3
C4
CN
Task Planningand Execution
The important cues depend on the task
![Page 32: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/32.jpg)
Cue dependencies
Occlusion
Linear Perspective
StereoVergence Kinetic Depth
Texture gradients
Depth of focus
![Page 33: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/33.jpg)
Yes of course 3D can give us moreBut only if it supports some task Locomotion
Heading, occlusion, pathways Understanding the shape of surfaces
Shading, texture, stereo, motion Tracing paths in graphs
motion stereo (not shading, not motion) Local reaching
stereo – convergence – sometimes cast shadows
![Page 34: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/34.jpg)
Relative position
For fine judgments - threading a needle stereo is important +shadows, occlusion
For large scale judgments, perspective, motion parallax, linear perspective are all important. Stereo is not important
![Page 35: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/35.jpg)
![Page 36: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/36.jpg)
Random Graphs
![Page 37: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/37.jpg)
Glenn looking at a graph
![Page 38: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/38.jpg)
Fish Tank VR
![Page 39: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/39.jpg)
The task
![Page 40: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/40.jpg)
aaa
0
10
20
30
40
50
0 50 100 150 200 250 300
Number of Nodes
Stereo head coupled perspective
Stereo head coupled perspective2D
2DStereo perspectiveHead coupled perspective
Stereo +60%
Motion +130%
Stereo + Motion+200%
![Page 41: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/41.jpg)
How to generateMotion?
Passive rotation Hand coupled rotation Head-coupled
rotation
Time has does not vary much
Ste
reo
pass
ive
Pas
sive
rot
atio
n
2D
Per
spec
tive
Ste
reo
hand
Hea
d co
uple
d
Ste
reo
head
Ste
reo0
42
6
1012
8T
ime
(sec
)
Han
d co
uple
d
2D
Per
spec
tive
Ste
reo
10
20
30
Err
ors
(%)
Ste
reo
pass
ive
Pas
sive
rot
atio
n
Ste
reo
hand
Hea
d co
uple
d
Ste
reo
head
Han
d co
uple
d0
![Page 42: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/42.jpg)
Surface shape perception (Norman Todd and Phillips)
Note: Random textures on surfaces
Stereo and motion roughly equalNote large angular error ~ 20 degrees
Observation: Stereopsis is a super-acuity and relies on fine texture disparity gradients
L=lightingS=specularT = texture
![Page 43: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/43.jpg)
![Page 44: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/44.jpg)
Graham Sweet.
![Page 45: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/45.jpg)
Stereo Display Requirements
3D GIS data Comfortable stereo display Many orders of magnitude Better than normal stereopsis
![Page 46: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/46.jpg)
Stereo Vision Basics
aa
Right eyeScreen
Left eye
Panum's Fusional Area
disparity = -
![Page 47: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/47.jpg)
We Know That
Vergence and focus conflict Stereo perception is plastic (Wallack) Can be rapidly recalibrated (Judge and
Miles) There is a synergy with motion parallax Occlusion is a strong cue to depth
![Page 48: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/48.jpg)
Cyclopean Scale: (with Cyril Gobrecht)
a
OriginalScaled
![Page 49: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/49.jpg)
Cyclopean Scale Helps with
Vergence focus conflict Diplopia Disparity scaling Frame cancellation It works dynamically? Change the virtual eye separation
![Page 50: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/50.jpg)
Virtual Eye Separation
![Page 51: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/51.jpg)
Conclusion – 3D is better but only it adds something Space perception
depends on the task Occlusion the most
important depth cue – consider that windows rely on it
Perspective may not add anything by itself
Stereo important for close interaction
Motion important for 3D layout
Shape-from shading and texture important for surface perception (but non photorealist)
![Page 52: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/52.jpg)
Stereo technologies
Frame-sequential (shutter glasses) Polaroids Mirror stereoscope HMDs Color anaglyphs Chromadepth
Holograms
![Page 53: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/53.jpg)
Stereo shutter glassesAlternate right and left eye images on monitor. Syncronized shutters block right and left eyes in alternation
Monitor: 120 HzR,L eyes 60 Hz each
Problems: ghosting due to slowPhosphor decay.Lower resolutionCRT displays onlyExpensive glasses
![Page 54: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/54.jpg)
Polaroids
R
L
Silver screenPreserves polarization
Problems:ghosting
Advantages: Cheap glasses
![Page 55: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/55.jpg)
Anaglyphs
Problems:GhostingInability to use color
![Page 56: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/56.jpg)
Lenticular
To Right EyeTo Left Eye
The display uses cylindricalPrisms in vertical columns
Problems: reduced resolution, limited head position.Theoretical limits on resolution
What is wrong with this picture?
Works with LCD displays
![Page 57: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/57.jpg)
Mirror stereoscope
Advantages: no ghostingRetains full brightnessFull spatiotemporal resolution possible
Disadvantage: Fixed head position.
![Page 58: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/58.jpg)
HMD stereoscope
Different screens for each eye.
A high image quality is possible, but not currently available
![Page 59: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/59.jpg)
VR
What is it? What is it for? Perception/interaction
![Page 60: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/60.jpg)
Issue
Resolution Ghosting Vergence-focus conflict Occlusion Crossed disparities
![Page 62: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/62.jpg)
Fish Tank VR Head tracking, stereo, touch
![Page 63: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/63.jpg)
Desk Top VR
Interactive 3D
![Page 64: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/64.jpg)
CAVE
Head tracking – stereo Resolution problems Light scattering problems Vergence focus problem for near object Occlusion problems for near objects
![Page 65: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/65.jpg)
Data walls (near immersion) Stereo, no head tracking, wide screen
![Page 66: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/66.jpg)
Immersadesk
Head tracking, stereo
![Page 67: Space Perception: the towards- away direction The third dimension Depth Cues Tasks Navigation Cost of Knowledge Interaction.](https://reader035.fdocuments.net/reader035/viewer/2022062516/56649e605503460f94b5b094/html5/thumbnails/67.jpg)
Augmented reality (Feiner) Add text+images to real world See through glasses Very sensitive to head tracking Occlusion problems