Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's...
Transcript of Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's...
![Page 1: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/1.jpg)
1
Perceiving Motion and Events
Chienchih ChenYutian Chen
The computational problem of motion
• space-time diagrams: image structure as it changes over time
![Page 2: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/2.jpg)
2
The computational problem of motion
• space-time diagrams for some simple motion of a single dot
1. Stationary dot2. Constant velocity motion3. Harmonic motion4. Apparent motion(stroboscopic
motion)
p.467
Continuous Motion
An environmental object is considered to be moving if its position changes over time.
Motion perception thresholdex.• The blades of a window fan• The moon• The movement of clock hands
p469
![Page 3: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/3.jpg)
3
Adaptation and Aftereffects
• Adaptation
• Motion Aftereffects
o Waterfall illusiono Paradoxical motiono Spiral aftereffect
Where are they occurred in the visual system?There are both monocular and binocular components to the motion perception system.
Simultaneous Motion Contrast
If a stationary path of random dots is surrounded by a field of dots moving steadily downward, the central patch will appear to drift upward.
![Page 4: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/4.jpg)
4
Apparent Motion
Human visual system can be fooled into perceiving continuous motion from a sequence of "snapshots" or "frames" presented at the proper rate.
Early Gestalt Investigations
Two lights across a fixed distance turn on and off alternatively from very fast to very slow:
1. Simultaneous flickering2. Phi motion3. Beta motion4. Sequential alternation
p.472
![Page 5: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/5.jpg)
5
Korte's laws
Korte examined the quality of apparent motion as a function of the relations among three parameters: the alternation rate, the separation between the two points of light, and the intensity of the two lights.• Separation vs. intensity: Larger separations require higher
intensityes• Rate vs. intensity: Slower rates require higher intensities• Separation vs. rate: Larger separations require slower rates
Motion picture technology
• 24 frames per second lies squarely within the range that produces beta motion, the most convincing perception of smooth continuous movement
• A flicker rate of at least 60 times per second is needed for flicker fusion--in which a flickering light appears to be on continuously.
• Thus, 72 flashes and 24 frames per second to produce good perception of apparent motion.
• As for TV and videotape, each video frame is effectively presented twice by interlacing the odd- and even- numbered lines of the video image. 30 frames per second.
![Page 6: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/6.jpg)
6
The Correspondence Problem of Apparent Motion
Motion is perceived between corresponding objects, but which objects are the "corresponding" ones?
Wagon wheel illusion
![Page 7: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/7.jpg)
7
Do other factors affect correspondence problem?
Short-range VS. Long-range Apparent Motion
• Random-dot Kinematogram• Classical phenomena of apparent motion
![Page 8: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/8.jpg)
8
Short-range VS. Long-range Apparent Motion
• Short-range motion system is responsible for performance on Random-dot Kinematogram. And it is thought to occur fairly early in visual processing, before information from the two eyes has been integrated and before shape and color have been extensively analyzed.
• Long-range motion system is responsible for classical phenomena of apparent motion with large-scale, individual figures. It is thought to occur much later in visual processing,after information from the two eyes has been integrated.
The Aperture Problem
![Page 9: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/9.jpg)
9
The Barberpole illusion
Plaid grating
![Page 10: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/10.jpg)
10
Physiological Mechanisms
• The Magno and Parvo System• Cortical Analysis of Motion• Neuropsychology of Motion Perception
The Magno and Parvo System
In comparison to P cells, M cells respond rapidly to changes in stimulation, are highly sensitive to luminance contrast, have large receptive fields, and are low in spatial resolution. M cells are the first step in the visual system's analysis of image motion.
![Page 11: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/11.jpg)
11
Cortical Analysis of Motion
• Selective response to different directionso component cellso pattern cells
Neuropsychology of Motion Perception
• A patient was admitted to the hospital complaining of severe headaches, vertigo, nausea, and the inability to perceive motion. She reported that the world appeared to her as a series of frozen snapshots.
• Brain image tests indicated that the lesion in her brain was located in the border region between occipital and temporal cortex, clearly outside of primary visual cortex.
![Page 12: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/12.jpg)
12
Computational Theories
• Directionally selective cells play a crucial role in our ability to perceive motion.
• But, how?
Delay-and-Compare Networks
![Page 13: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/13.jpg)
13
Edge-Based Models
Analyze the change in illumination over time in conjunction withan edge detector
Spatial-Frequency-Based Models
![Page 14: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/14.jpg)
14
Integrating Local Motion
Integrating Local Motion
![Page 15: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/15.jpg)
15
next......
• Object Motion– Depth and Motion– Long-Range Apparent Motion– Dynamic Perceptual Organization
• Self-Motion and Optic Flow
![Page 16: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/16.jpg)
16
Image Motion Vs. Object Motion
• Image motion must be interpreted to provide information about the motion in environmental objects
• Image motion + movement of eye, head, body ...
=> motion constancy
Velocity Constancy
• Object speed, rather than image speed
• Good depth information is needed– Adjust speed of moving objects at different depth
(Rock, Hill, & Fineman, 1968)
![Page 17: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/17.jpg)
17
Depth and Motion
• When only motion information is present, does the visual system interpret differential motion in terms of depth?
• Rigid Motion in Depth (Gunnar Johansson 1950)
• Rigidity heuristic
The Kinetic Depth Effect (KDE)
• Experiment by Wallach and O’Connell (1953)
– Using a shadow-casting technique to present 2-D images of angular 3-D wire objects to observers
![Page 18: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/18.jpg)
18
• Rigidity Heuristic– All else being equal, if there is an interpretation in
which rigid motion can be perceived, it will be.• Correspondence Problem
– Unique points, such as vertices and endpoints (but not cross-points), appear to play an important role in the conditions required for veridical perception of rigid motion
What if the correspondence problem is solved incorrectly?
![Page 19: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/19.jpg)
19
The Stereo-Kinetic Effect
Perception of Nonrigid Motion
![Page 20: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/20.jpg)
20
Long-Range Apparent Motion
• Long-range apparent motion is fundamentally a 3-D, object-based perception
• Experiment by Shepard and Judd (1976)– Two sets of displays for picture-plane rotation (A) and 3-D rotation in depth (B)– Determine the fastest alternation rate for smooth rigid motion
• The process underlying apparent rotation is a continuous process that requires time to go through intermediate orientations, just as real objects do.
• The linear increase was virtually identical for the pairs related by picture-plane rotations and depth rotations.
![Page 21: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/21.jpg)
21
Geometrical Model• Map object motions to geometrical paths in a high-dimensional space
– Motion hyperspaceAny continuous motion can be represented as a continuous path within the higher-dimensional space.
– Path impletionThe visual system interprets apparent motion by traversing (impleting) one of many possible paths between corresponded points of the two displays.
– Maximum speedRigid apparent motion will be perceived if and only if the alternation rate is sufficiently slow that the shortest path along the rigid-rotation surface can be traversed at or below a maximum speed in the time between two displays.
Curved Apparent Motion• 1. A translation along a straight-
line path from left to right with a concomitant clockwise rotation about the center of the line– minimize the work required to move
the object
• 2. A global rotation about a point below the two lines in which the points on the line follow curved paths– minimize motion in kinematical
geometry
![Page 22: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/22.jpg)
22
Path-guided apparent motion
• The visual system has internalized the structure of motions in the real world to a remarkable degree
• Allowing it to fill in the most likely motion in apparent motion displays
Dynamic Perceptual Organization
• What regions are perceived to be part of the same object or group of objects? • How do we organize the motions of different objects? • How they move with respect to each other?
![Page 23: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/23.jpg)
23
Grouping by Movement
• Common fate: the tendency to group together units that move with the same velocity (direction and speed)
• Put back two or more parts of a single moving object separated by occluding objects
![Page 24: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/24.jpg)
24
• Common fate can destroy even the best natural camouflage
Configural Motion
![Page 25: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/25.jpg)
25
• The visual system performs a vector analysis of the motion of objects moving synchronously.– Motion vectors are decomposed in to two components:
common motion and relative motion
Induced Motion
• The moon is moving through the cloud rather than the cloud passes in front of the moon
Karl Duncker (1929/1937)• Two assumptions:
– 1. Sensitivity to relative motion– 2. Stationarity of the surrounding object
![Page 26: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/26.jpg)
26
Self-Motion and Optic Flow• Induced self-motion
• Two differences between induced self-motion and induced motion– 1. The motion of the environment is well above the threshold of absolute motion– 2. There is an initial period of veridical perception: You first perceive the drum as
rotating and yourself as stationary
Perceiving Self-Motion
Optic flow: the global patterns of retinal motion
• Direction
![Page 27: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/27.jpg)
27
Speed of Self-Motion
• Information about absolute speed is not available solely from optic flow– absolute distance is not available
• Time to contact:– the length of time it will take the observer to reach the surface toward
which he or she is heading under present motion conditions – t=distance/speed
A
A’
BB’
b
a
![Page 28: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/28.jpg)
28
Understanding Events
• How balls move when one collides with another?• How objects behave under gravitational free-fall when
dropped from a moving object?
Biological Motion
• Meaningless points when seated motionlessly
• Perceived as a person immediately and unmistakably when began to move
• Even walking versus jogging were easly discriminated
![Page 29: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/29.jpg)
29
Biological Motion
Biological Motion
![Page 30: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/30.jpg)
30
Perceiving Causation
• Launching effect• Triggering effect• Entraining effect
Perceiving Mass Relations
• Ricochet heuristic: When the incoming ball ricochets at a higher velocity than the forward motion of the initially stationary ball, the stationary ball is heavier than the incoming one
• Clobbering heuristic: When the stationary ball moves off with high velocity, the incoming ball is heavier than the stationary one
• The two heuristic conflict when the ricocheting ball moved more slowly than the ball it struck.
• Thus people appear to be recovering information about mass from visual information, but not with the quantitative precision and sophistication his analysis implied
![Page 31: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/31.jpg)
31
Perceiving Mass Relations
Intuitive Physics
![Page 32: Perceiving Motion and Events - Donald Bren School of ...majumder/vispercep/student08/... · Korte's laws Korte examined the quality of apparent motion as a function of the relations](https://reader034.fdocuments.net/reader034/viewer/2022042711/5f6c513cbe30f3246a06d4f4/html5/thumbnails/32.jpg)
32
Intuitive Physics
Intuitive Physics
One possibility is that the high-level cognitive system that is responsible for generating solutions to statically stated problems simply does not have access to the perceptual system's expertise in these domains
reason: many of the same people who favored the curved trajectory when presented with the static version of the C-tube problem chose the correct, straight trajectory in the dynamic version