V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding?...
-
Upload
deborah-presley -
Category
Documents
-
view
216 -
download
0
Transcript of V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding?...
![Page 1: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/1.jpg)
V1 Physiology
![Page 2: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/2.jpg)
Questions
Hierarchies of RFs and visual areas
Is prediction equal to understanding?
Is predicting the mean responses enough?
General versus structural models?
What should a theory of V1 look like?
How is information represented in V1?
![Page 3: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/3.jpg)
The cortex
![Page 4: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/4.jpg)
Visual Areas in the Nonhuman Primate
Felleman & van Essen
![Page 5: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/5.jpg)
Visual Areas in the Nonhuman Primate
![Page 6: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/6.jpg)
Monkey LGN
![Page 7: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/7.jpg)
Monkey LGN
![Page 8: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/8.jpg)
Monkey V1 – Laminar organization
![Page 9: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/9.jpg)
Monkey V1 – Inputs
![Page 10: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/10.jpg)
Monkey V1 – Outputs
![Page 11: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/11.jpg)
Monkey V1 – Oculodominance Columns
![Page 12: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/12.jpg)
Monkey V1 – Oculodominance Columns
![Page 13: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/13.jpg)
Monkey V1 – CO patches (or blobs)
![Page 14: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/14.jpg)
Receptive field
Monkey V1 – Orientation Tuning
![Page 15: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/15.jpg)
Monkey V1 – Orientation Columns
![Page 16: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/16.jpg)
Orientation map
What generates the map?
How does it develop? What is the role of experience?
What is its functional significance (if any)?
How are receptive field properties distributed with respect to the map features (such as pinwheels)?
What is the relationship to other maps (retinotopy)?
Monkey V1 – Orientation Map
![Page 17: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/17.jpg)
Orientation columns Monkey V1 – The Ice Cube Model
![Page 18: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/18.jpg)
LGN cell
![Page 19: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/19.jpg)
V1 simple cell
![Page 20: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/20.jpg)
V1 complex cell
![Page 21: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/21.jpg)
Concentric on/off
Simple cells
Complex cells
Hyper-complex
Grandmother
Hierarchy of Receptive Fields
![Page 22: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/22.jpg)
Simple cells receptive fields
![Page 23: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/23.jpg)
Models v0.0
![Page 24: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/24.jpg)
Analysis of monosynaptic connections
Alonso, Usrey & Reid (2001)
Monosynaptic connectivity from thalamus to layer 4
![Page 25: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/25.jpg)
The “sign rule” of thalamo-cortical connectivity
Reid & Alonso (1995) Alonso, Usrey & Reid (2001)
Monosynaptic connectivity from thalamus to layer 4
![Page 26: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/26.jpg)
Expected response of linear RF to moving gratings
![Page 27: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/27.jpg)
Skottun et al (1991)
Yet F1/F0 distributions are bimodal
![Page 28: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/28.jpg)
There appears to be a continuum of responses
Priebe et al, 2004
![Page 29: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/29.jpg)
Priebe et al, 2004
Beware of bounded indices
![Page 30: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/30.jpg)
Laminar distribution of F1/F0
Same in cat (Peterson & Freeman; but see Martinez et al)
![Page 31: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/31.jpg)
Standard Models v1.0
![Page 32: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/32.jpg)
Conditional Stimulus Distributions
How are the original and conditional stimulus distributions different?
p s
P(s) P(s | spike)
Stochastic stimuli
![Page 33: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/33.jpg)
Standard Models v1.1
![Page 34: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/34.jpg)
Elaborating the LN model
![Page 35: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/35.jpg)
Carandini, Heeger & Movshon (1996)
Simple-cell nonlinearities: Saturation
![Page 36: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/36.jpg)
Carandini, Heeger & Movshon (1996)
Saturation depends on orientation
![Page 37: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/37.jpg)
Carandini, Heeger & Movshon (1996)
Simple-cell nonlinearities: Masking
![Page 38: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/38.jpg)
‘Non-specific’ gain control can shape tuning selectivity
![Page 39: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/39.jpg)
Prediction = Understanding?
![Page 40: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/40.jpg)
The linear-nonlinear model
![Page 41: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/41.jpg)
Simple cell receptive fields in V1
![Page 42: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/42.jpg)
Simple cell receptive fields in V1
![Page 43: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/43.jpg)
Simple cell receptive fields in V1
![Page 44: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/44.jpg)
Simple cell receptive fields in V1
![Page 45: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/45.jpg)
Simple cell receptive fields in V1
![Page 46: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/46.jpg)
Why this particular set of filters?
![Page 47: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/47.jpg)
Why is the cortical state important?
Cortical State, ( )s t
Stimulus, ( )x t Response, ( )r t
The response to sensory stimulation at any one time is a function of both the recent history of the stimulus and the cortical state.
If the ongoing cortical activity is noise then:
• Measure the mean response to sensory stimulus
• Measure how the mean response varies with stimulus parameters.
Going beyond the modeling of mean responses
![Page 48: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/48.jpg)
The ‘vending machine’ analogy
Current State, ( )s t
Stimulus, ( )x t Response, ( )r t
Count up to 75¢ and deliver a coke (a deterministic machine)
The vending machine analogy
![Page 49: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/49.jpg)
The ‘vending machine’ analogy
Count up to 75¢ and deliver a coke (a deterministic machine)
0¢
25¢
50¢
The vending machine analogy
![Page 50: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/50.jpg)
The ‘vending machine’ analogy
Current State, ( )s t
Stimulus, ( )x t Response, ( )r t
Count up to 75¢ and deliver a coke (a deterministic machine)
The vending machine analogy
![Page 51: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/51.jpg)
The ‘vending machine’ analogy
Saturday 23, 2004.
The response appears very noisy.On average, we get one positiveresponse every 3 stimuli.
The vending machine analogy
![Page 52: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/52.jpg)
The ‘vending machine’ analogy
Saturday 23, 2004.
The response appears very noisy.On average, we get one positiveresponse every 3 stimuli.
The source of the noise may be inthe mechanism delivering the coke,
The vending machine analogy
![Page 53: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/53.jpg)
Arieli et al (1996)
Single trial response
Single trial prediction
Mean response
Modeling the Mean Response – Is it sufficient?
![Page 54: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/54.jpg)
Modeling the Mean Response – Is it sufficient?
Supèr et al (2003)
![Page 55: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/55.jpg)
Seeking invariants of the population response
8 spikes
17 spikes
3 spikes
Vertical grating
Vertical grating
Vertical grating
Stimulus Response Percept
There must be some invariant feature in the population responses.
Asking about the ‘neural code’ is equivalent to asking what is this invariant (‘best clustering’ approach of Victor et al).
![Page 56: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/56.jpg)
Theory of Visual Area X
Representation: Area X is about representing natural signals optimally.
Estimation/Bayes: Area X is all about estimating the most likely stimulus (motion/contours/etc) given the statistics of natural signals.
Processing: Area X is doing some interesting image processing (for example, face detection)
Behavior: Area X is about using visual information for visually guided behavior (‘active vision’)
![Page 57: V1 Physiology. Questions Hierarchies of RFs and visual areas Is prediction equal to understanding? Is predicting the mean responses enough? General versus.](https://reader030.fdocuments.net/reader030/viewer/2022032516/56649c785503460f9492df42/html5/thumbnails/57.jpg)
Half-Time