Binding problems and feature integration theory. Feature detectors Neurons that fire to specific...
-
Upload
godwin-james-west -
Category
Documents
-
view
217 -
download
0
Transcript of Binding problems and feature integration theory. Feature detectors Neurons that fire to specific...
![Page 1: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/1.jpg)
Binding problems and feature integration theory
![Page 2: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/2.jpg)
Feature detectors
• Neurons that fire to specific features of a stimulus
• Pathway away from retina shows neurons that fire to more complex stimuli
• Cells that are feature detectors:– Simple cortical cell– Complex cortical cell– End-stopped cortical cell
![Page 3: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/3.jpg)
Single cell recording of neurons in the temporal lobe
An electrode is inserted in this area, and measure neural responses when stimuli are changed gradually
![Page 4: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/4.jpg)
![Page 5: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/5.jpg)
Neurons in this area respond to complex stimuli like those shown on the left.
![Page 6: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/6.jpg)
Selective adaptation
![Page 7: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/7.jpg)
![Page 8: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/8.jpg)
Selective adaptation to size
![Page 9: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/9.jpg)
![Page 10: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/10.jpg)
![Page 11: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/11.jpg)
1
2
3
4
5
6
7
8
9
10
11
12
![Page 12: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/12.jpg)
![Page 13: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/13.jpg)
1
2
3
4
5
6
7
8
9
10
11
12
![Page 14: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/14.jpg)
![Page 15: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/15.jpg)
![Page 16: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/16.jpg)
![Page 17: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/17.jpg)
Figure 3.30 How neurons that respond best to narrow (N), medium (M), and wide (W) bars respond to the medium-bar grating on the right of Figure 3.28. (a-b): Response before adaptation. (c) Response after adaptation to the wide-bar grating at the top left. (d) Response after adaptation to the narrow-bar grating on the bottom left.
![Page 18: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/18.jpg)
After Image
![Page 19: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/19.jpg)
![Page 20: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/20.jpg)
![Page 21: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/21.jpg)
After images:
Red Green
Green Red
Blue Yellow
Yellow Blue
R G B Y
Color perception
![Page 22: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/22.jpg)
R G B Yadaptation
adaptation
After image After image
![Page 23: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/23.jpg)
Binding problem
![Page 24: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/24.jpg)
Two visual pathways (what & where/how systems)
Image from Neuroscience, 2nd Ed. (2000).
![Page 25: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/25.jpg)
Columnar organization
• Neurons that respond to the same orientation are packed in the same column
Image courtesy of Dr. Paul Wellman and Neuroscience, 2nd Ed. (2000).
![Page 26: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/26.jpg)
Distributed coding; then what do you need?
Combining input
![Page 27: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/27.jpg)
• Feature integration theory by Treisman & Gelade– Attention plays a central role in solving the
binding problem.– Attention helps organize information.
![Page 28: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/28.jpg)
Attention and Figure-ground segregation
Depending on where you look at, the figure and the ground switch rapidly.
Attention plays some role in determining the figure and the ground.
![Page 29: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/29.jpg)
Attention and 3D structure
Depending on where to look at, you get different 3D structures.
![Page 30: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/30.jpg)
![Page 31: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/31.jpg)
![Page 32: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/32.jpg)
![Page 33: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/33.jpg)
Damage to the parietal lobe creates binding errors.
![Page 34: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/34.jpg)
![Page 35: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/35.jpg)
![Page 36: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/36.jpg)
Copies of the black (A) and
the white (B) vertical contour.
Copies of the black (A) and
the white (B) diagonal contour.
![Page 37: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/37.jpg)
Copies of the left sub-figure (A)
The right subfigure (B)
And the central sub-figure (C)
![Page 38: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/38.jpg)
Feature integration theory
• Attention is the “glue” that combines the information from the what and where systems.
![Page 39: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/39.jpg)
What can you predict from this theory?
• If you can’t attend, you can’t combine information.
Illusionary conjunction
![Page 40: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/40.jpg)
Demonstration• I will show you a scene quickly.
• Report first the black numbers.
• Report what you see at each of the 4 locations.
+++
Mask
![Page 41: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/41.jpg)
![Page 42: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/42.jpg)
+++++
![Page 43: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/43.jpg)
![Page 44: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/44.jpg)
![Page 45: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/45.jpg)
• Report first the black numbers.
• Report what you saw at each of the 4 locations.
![Page 46: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/46.jpg)
Illusionary conjunctions
• We tend to put different features from different objects together.
• Some brain damaged patients (parietal lobe) show illusionary conjunctions even when the patients were allowed to view the stimuli for 10 seconds.
![Page 47: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/47.jpg)
Visual search experiments
• Feature search– This is easy because you
find the target by looking for a single feature.
you don’t need attention
• Conjunction search– For this you need to combine
two or more features (color and orientation)
you need attention
• Looking for the target
![Page 48: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/48.jpg)
• Conjunction search– For this you need to
combine two or more features (color and orientation)
you need attention
– Because you can attend an item one at a time, the difficulty in the conjunction search increases proportional to the number of items in the stimulus frame.
– This is not the case in the feature search.
![Page 49: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/49.jpg)
Find Which is more difficult?
![Page 50: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/50.jpg)
Find Which is more difficult?
![Page 51: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/51.jpg)
Feature binding and attention (Treisman, 1988)
Experiments:Task
Given a stimulus frame containing visual items, subjects were asked to indicate whether or not a target item was present in the frame.
![Page 52: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/52.jpg)
Target:
![Page 53: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/53.jpg)
Target:
![Page 54: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/54.jpg)
Target:
![Page 55: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/55.jpg)
Target:
![Page 56: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/56.jpg)
Feature search vs. conjunction search
• Feature search– The target item has a unique feature.
• Conjunction search– You need to combine features to find the target.– You need attention.– Because you can attend only one item at a time,
the conjunction search becomes more difficult when more items are in the stimulus frame.
![Page 57: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/57.jpg)
Generality of the results:
Feature search Conjunction search
![Page 58: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/58.jpg)
Experiments:
• Measure accuracy and response times (conjunction cases vs. non-conjunction cases)
![Page 59: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/59.jpg)
![Page 60: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/60.jpg)
Response time
# of distractors
1000 ms
500ms
![Page 61: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/61.jpg)
Response time
# of distractors
1000 ms
500ms
![Page 62: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/62.jpg)
The physiology of attention
• How do you combine features?
• Synchrony hypothesis• When neurons in different parts of the cortex are
firing to the same object, the pattern of firing is synchronized (they fire at the same time, and in the same manner).
• So when neurons are firing in synchrony, the corresponding features are bound together.
![Page 63: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/63.jpg)
• Separate neurons respond to color (green, blue, white), contours (orientations), textures, so on.
• Synchrony hypothesis: – When the features come from
the same object (i.e., the woman), these neurons fire at the same time in the same manner.
– When the neurons fire at the same time and in the same manner, we perceive “binding” of features.
• Attention is likely to increase synchrony
![Page 64: Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.](https://reader035.fdocuments.net/reader035/viewer/2022070413/5697bfc01a28abf838ca3966/html5/thumbnails/64.jpg)
Attention
• Selecting information
• Enhancing information
• Combining information