Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where?...
Transcript of Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where?...
![Page 1: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/1.jpg)
![Page 2: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/2.jpg)
Recognition: Recognition: gnosiagnosia
Vision: knowing what is where?
Bottom-up and top-down strategies
![Page 3: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/3.jpg)
E E e e E e E E e e
![Page 4: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/4.jpg)
contourprimitives
organization of parts
objectmodel
Match to memory!
Recognition!!
context
TOP-DOWN
knowledgeBOTTOM-UP
![Page 5: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/5.jpg)
Bottom up approachBottom up approach
Primitives – featuresStructural analysisRecognition By Components —Biederman
![Page 6: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/6.jpg)
Bottom up approachBottom up approachPrimitives – features:
Hubel and Wiesel Treisman
![Page 7: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/7.jpg)
Shape Features:
Orientation CurvatureTerminatorSize
Anne Anne TreismanTreisman
![Page 8: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/8.jpg)
![Page 9: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/9.jpg)
![Page 10: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/10.jpg)
YES NO
TARGET
N = 36
NO POP OUT
![Page 11: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/11.jpg)
400
36302418126
800
1200
1600
Number of stimuli
Response tim
e (
ms)
YES
NO
2000
2400
2800
NO POP OUT
![Page 12: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/12.jpg)
Structural analysisStructural analysislaws of Gestalt:– simplicity– similarity– proximity– common fate
figure-ground grouping
![Page 13: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/13.jpg)
simplicity
common fate
similarity
![Page 14: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/14.jpg)
ABC
![Page 15: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/15.jpg)
![Page 16: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/16.jpg)
![Page 17: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/17.jpg)
![Page 18: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/18.jpg)
![Page 19: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/19.jpg)
V1 neuron
Neuron’s responsewhen the stimulus onthe RF is FIGURE
Neuron’s responsewhen the samepattern on the RF isNOT FIGURE
Receptive Field
Lamme, V. A. F. (1995). The neurophysiology of figure-ground segregationin primary visual cortex. Journal of Neuroscience, 15, 1605-1615.
![Page 20: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/20.jpg)
types of connections:– T junction– X junction– shadow– curvature– perspective
Structural analysisStructural analysis
--> occlusion--> transparency--> depth--> depth--> depth
![Page 21: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/21.jpg)
![Page 22: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/22.jpg)
Why are these imagesWhy are these imagesimpossible?impossible?
![Page 23: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/23.jpg)
![Page 24: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/24.jpg)
![Page 25: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/25.jpg)
![Page 26: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/26.jpg)
![Page 27: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/27.jpg)
![Page 28: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/28.jpg)
![Page 29: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/29.jpg)
![Page 30: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/30.jpg)
![Page 31: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/31.jpg)
![Page 32: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/32.jpg)
![Page 33: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/33.jpg)
![Page 34: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/34.jpg)
![Page 35: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/35.jpg)
![Page 36: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/36.jpg)
Recognition By ComponentsRecognition By ComponentsBiederman
![Page 37: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/37.jpg)
BiedermanBiederman: Recognition by Components (Geons)
Non accidental properties: correspondence between the world and the retina
Collinearity
Curvilinearity
Symmetry
Parallelism
Vertices
![Page 38: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/38.jpg)
GeonsGeons
![Page 39: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/39.jpg)
Top-down approachTop-down approach
memory knowledge familiarity physiological state
![Page 40: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/40.jpg)
![Page 41: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/41.jpg)
![Page 42: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/42.jpg)
![Page 43: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/43.jpg)
![Page 44: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/44.jpg)
![Page 45: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/45.jpg)
![Page 46: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/46.jpg)
Does attention help vision?Does attention help vision?
![Page 47: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/47.jpg)
Does our knowledge influenceDoes our knowledge influencewhat we see?what we see?
![Page 48: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/48.jpg)
Does our knowledge influenceDoes our knowledge influencewhat we see?what we see?
![Page 49: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/49.jpg)
![Page 50: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/50.jpg)
contourprimitives
organization of parts
objectmodel
Match to memory!
Recognition!!
context
TOP-DOWN
knowledgeBOTTOM-UP
![Page 51: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/51.jpg)
Anatomy & physiologyAnatomy & physiology what & where systemsMinskin, Ungerleider & Marco
prosopagnosia infero-temporal area: IT face selective neurons
object agnosia: John
![Page 52: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/52.jpg)
What
Where
What and Where systemsMishkin, Ungerleider & Macko (1983)
How systemHow system
Goodale and colleagues
![Page 53: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/53.jpg)
""the world is out of focus to my brainthe world is out of focus to my brain""John
1981: strokeoccipital lobes –> temporal lobes --> ventral pathway
What is wrong with John?What is wrong with John?prosopagnosiaobject agnosia achromatopsiano spatial orientationproblem with short-term memory with sight
![Page 54: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/54.jpg)
What is not wrong with John?What is not wrong with John?
acuity eye movements intelligence first memories from sounds, smell draw objects out of memories copy object line by line memory before the operation
![Page 55: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/55.jpg)
More about his vision:
intact registration of features trouble to put features together no top down influencemore information = better
![Page 56: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/56.jpg)
DFDFMilner & Goodale
Visual form Visual form agnosiaagnosia
34 years old womanDamage to the ventral pathway from carbon monoxide poisoning
![Page 57: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/57.jpg)
• Cannot copy,but can draw from memory
• Cannot visually match orientation
• Could “mail” an oriented paper
DFDF
![Page 58: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/58.jpg)
• One mechanism for judging orientation
• One mechanism for coordination ofvision & action
Double dissociationDouble dissociation: another patient can’t “mail” but is fine with judging line orientation.
Single dissociationSingle dissociation:
![Page 59: Recognition: gnosia · 2007. 3. 22. · Recognition: gnosia Vision: knowing what is where? Bottom-up and top-down strategies](https://reader036.fdocuments.net/reader036/viewer/2022071511/6130aaaa1ecc515869443e1a/html5/thumbnails/59.jpg)
contourprimitives
organization of parts
objectmodel
Match to memory!
Recognition!!
context
TOP-DOWN
knowledgeBOTTOM-UP