Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz...

54
Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office) 2720 4184 (mobil) [email protected] www.nordita.dk/~hertz/course.html Texts: P Dayan and L F Abbott, Theoretical Neuroscience (MIT Press) W Gerstner and W Kistler, Spiking Neuron Models (Cambridge U Press) http://diwww.epfl.ch/~gerstner/SPNM/SPNM.html

Transcript of Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz...

Page 1: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Theoretical NeurosciencePhysics 405, Copenhagen University

Block 4, Spring 2007

John Hertz (Nordita)Office: rm Kc10, NBI Blegdamsvej

Tel 3532 5236 (office) 2720 4184 (mobil)[email protected]

www.nordita.dk/~hertz/course.html

Texts: P Dayan and L F Abbott, Theoretical Neuroscience (MIT Press)W Gerstner and W Kistler, Spiking Neuron Models (Cambridge U Press) http://diwww.epfl.ch/~gerstner/SPNM/SPNM.html

Page 2: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Outline

• Introduction: biological background, spike trains• Biophysics of neurons: ion channels, spike generation • Synapses: kinetics, medium- and long-term synaptic

modification• Mathematical analysis using simplified models• Network models:

– noisy cortical networks– primary visual cortex– associative memory– oscillations in olfactory circuits

Page 3: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Lecture I: Introduction

ca 1011 neurons/human brain

104/mm3

soma 10-50 m

axon length ~ 4 cm

total axon length/mm3 ~ 400 m

Page 4: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Cell membrane, ion channels, action potentials

Membrane potential: rest at ca -70 mvNa-K pump maintains excess K inside,Na outside

Na in: V rises,more channels open “spike”

Page 5: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Communication: synapses

Integrating synaptic input:

Page 6: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Brain anatomy: functional regions

Page 7: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Visual system

General anatomy Retina

Page 8: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Neural coding: firing rates depend on stimulus

Visual cortical neuron:variation with orientationof stimulus

Page 9: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Neural coding: firing rates depend on stimulus

Visual cortical neuron:variation with orientationof stimulus

Motor cortical neuron:variation with directionof movement

Page 10: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Neuronal firing is noisy

Motion-sensitive neuron in visual area MT: spike trains evoked by multiplepresentations of moving random-dotpatterns

Page 11: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Neuronal firing is noisy

Motion-sensitive neuron in visual area MT: spike trains evoked by multiplepresentations of moving random-dotpatterns

Intracellular recordings of membrane potential: Isolated neurons fire regularly; neurons in vivo do not:

Page 12: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Quantifying the response of sensory neurons

spike-triggered average stimulus (“reverse correlation”)

Page 13: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Examples of reverse correlation

Electric sensory neuron inelectric fish:s(t) = electric field

Motion-sensitive neuron in blowflyVisual system:s(t) = velocity of moving pattern invisual field

Note: non-additive effect for spikesvery close in time (t < 5 ms

Page 14: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Spike trains: Poisson process model

Homogeneous Poisson process: = rate = prob of firing per unit time,

i.e., prob of spike in interval

rtr )0(),[ tttt

Page 15: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Spike trains: Poisson process model

Homogeneous Poisson process: = rate = prob of firing per unit time,

i.e., prob of spike in interval

rtr )0(),[ tttt

Survivor function: probability of not firing in [0,t): S(t)

Page 16: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Spike trains: Poisson process model

Homogeneous Poisson process: = rate = prob of firing per unit time,

i.e., prob of spike in interval

rtr )0(),[ tttt

Survivor function: probability of not firing in [0,t): S(t)

rttStS

dttdSr

e)(

)(

/)(

Page 17: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Spike trains: Poisson process model

Homogeneous Poisson process: = rate = prob of firing per unit time,

i.e., prob of spike in interval

rtr )0(),[ tttt

Survivor function: probability of not firing in [0,t): S(t)

Probability of firing for the first time in [t, t +t)/ t :

rttStS

dttdSr

e)(

)(

/)(

Page 18: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Spike trains: Poisson process model

Homogeneous Poisson process: = rate = prob of firing per unit time,

i.e., prob of spike in interval

rtr )0(),[ tttt

Survivor function: probability of not firing in [0,t): S(t)

Probability of firing for the first time in [t, t +t)/ t :

rttStS

dttdSr

e)(

)(

/)(

rtrdt

tdStP e

)()(

Page 19: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Spike trains: Poisson process model

Homogeneous Poisson process: = rate = prob of firing per unit time,

i.e., prob of spike in interval

rtr )0(),[ tttt

Survivor function: probability of not firing in [0,t): S(t)

Probability of firing for the first time in [t, t +t)/ t :

(interspike interval distribution)

rttStS

dttdSr

e)(

)(

/)(

rtrdt

tdStP e

)()(

Page 20: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Homogeneous Poisson process (2)

Probability of exactly 1 spike in [0,T):

rTtTrT rtT rTrdtP eee)1( )(

0

Page 21: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Homogeneous Poisson process (2)

Probability of exactly 1 spike in [0,T):

rTtTrT rtT rTrdtP eee)1( )(

0

Probability of exactly 2 spikes in [0,T):

rTtTrttrT rtt

T rTrrdtdtP e)(eee)2( 221)()(

0 0 122121

2

Page 22: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Homogeneous Poisson process (2)

Probability of exactly 1 spike in [0,T):

rTtTrT rtT rTrdtP eee)1( )(

0

Probability of exactly 2 spikes in [0,T):

rTtTrttrT rtt

T rTrrdtdtP e)(eee)2( 221)()(

0 0 122121

2

… Probability of exactly n spikes in [0,T):

rTnT rT

nnP e)(

!

1)(

Page 23: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Homogeneous Poisson process (2)

Probability of exactly 1 spike in [0,T):

rTtTrT rtT rTrdtP eee)1( )(

0

Probability of exactly 2 spikes in [0,T):

rTtTrttrT rtt

T rTrrdtdtP e)(eee)2( 221)()(

0 0 122121

2

… Probability of exactly n spikes in [0,T):

rTnT rT

nnP e)(

!

1)( Poisson distribution

Page 24: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson distribution

rTn

T nrT

nP e!)(

)(

Pprobability of n spikes in interval of duration T:

Page 25: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson distribution

rTn

T nrT

nP e!)(

)(

Pprobability of n spikes in interval of duration T:

rTn Mean count:

Page 26: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson distribution

rTn

T nrT

nP e!)(

)(

Pprobability of n spikes in interval of duration T:

rTn Mean count:

variance: nrTnn 2)(

Page 27: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson distribution

rTn

T nrT

nP e!)(

)(

Pprobability of n spikes in interval of duration T:

rTn Mean count:

variance: nrTnn 2)( i.e., spikesnn

Page 28: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson distribution

rTn

T nrT

nP e!)(

)(

Pprobability of n spikes in interval of duration T:

rTn Mean count:

variance: nrTnn 2)( i.e., spikesnn

large : GaussianrT

Page 29: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson distribution

rTn

T nrT

nP e!)(

)(

Pprobability of n spikes in interval of duration T:

rTn Mean count:

variance: nrTnn 2)( i.e., spikesnn

large : GaussianrT

Page 30: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson process (2): interspike interval distribution

rtrtP e)(Exponential distribution: (like radioactive Decay)

Page 31: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson process (2): interspike interval distribution

rtrtP e)(

rt

1

Exponential distribution: (like radioactive Decay)

Mean ISI:

Page 32: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson process (2): interspike interval distribution

rtrtP e)(

rt

1

22

2 1)( t

rtt

Exponential distribution: (like radioactive Decay)

Mean ISI:

variance:

Page 33: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson process (2): interspike interval distribution

rtrtP e)(

rt

1

22

2 1)( t

rtt

1mean

devstd CV

Exponential distribution: (like radioactive Decay)

Mean ISI:

variance:

Coefficient of variation:

Page 34: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson process (3): correlation function

)()( f

ftttS Spike train:

Page 35: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson process (3): correlation function

)()( f

ftttS

rtS )(

Spike train:

mean:

Page 36: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Poisson process (3): correlation function

)())()()(()( rrtSrtSC

)()( f

ftttS

rtS )(

Spike train:

mean:

Correlation function:

Page 37: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Stationary renewal processDefined by ISI distribution P(t)

Page 38: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Stationary renewal processDefined by ISI distribution P(t)

Relation between P(t) and C(t):

Page 39: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Stationary renewal process

)())((1

)( 2 trtCr

tC

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Page 40: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Stationary renewal process

)())((1

)( 2 trtCr

tC

)'()'(')(

)'()'(')()(

0

0

ttCtPdttP

ttPtPdttPtC

t

t

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Page 41: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Stationary renewal process

)())((1

)( 2 trtCr

tC

)'()'(')(

)'()'(')()(

0

0

ttCtPdttP

ttPtPdttPtC

t

t

)()()()( CPPC

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Laplace transform:

Page 42: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Stationary renewal process

)())((1

)( 2 trtCr

tC

)'()'(')(

)'()'(')()(

0

0

ttCtPdttP

ttPtPdttPtC

t

t

)()()()( CPPC

)(1)(

)(

P

PC

Defined by ISI distribution P(t)

Relation between P(t) and C(t): define

Laplace transform:

Solve:

Page 43: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Fano factor

1

)( 2

Fnnn

F spike count variance / mean spike count

for stationary Poisson process

Page 44: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Fano factor

1

)( 2

Fnnn

F

dCTtStSdtdtn

rTdttSn

T T

T

)()'()(')(

)(

0 0

2

0

spike count variance / mean spike count

for stationary Poisson process

Page 45: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Fano factor

1

)( 2

Fnnn

F

dCTtStSdtdtn

rTdttSn

T T

T

)()'()(')(

)(

0 0

2

0

r

dC

F

)(

spike count variance / mean spike count

for stationary Poisson process

Page 46: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Fano factor

1

)( 2

Fnnn

F

dCTtStSdtdtn

rTdttSn

T T

T

)()'()(')(

)(

0 0

2

0

r

dC

F

)(

2CVF

spike count variance / mean spike count

for stationary Poisson process

for stationary renewal process (prove this)

Page 47: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Nonstationary point processes

Page 48: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Nonstationary point processes

Nonstationary Poisson process: time-dependent rate r(t)

Still have Poisson count distribution, F=1

Page 49: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Nonstationary point processes

Nonstationary Poisson process: time-dependent rate r(t)

Still have Poisson count distribution, F=1

Nonstationary renewal process: time-dependent ISI distribution

)()(0

tPtP t = ISI probability starting at t0

Page 50: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Experimental results (1)

Correlation functions

Page 51: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Experimental results (1)

Correlation functions Count variance vs mean

Page 52: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Experimental results (2)

ISI distribution

Page 53: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

Experimental results (2)

ISI distribution CV’s for many neurons

Page 54: Theoretical Neuroscience Physics 405, Copenhagen University Block 4, Spring 2007 John Hertz (Nordita) Office: rm Kc10, NBI Blegdamsvej Tel 3532 5236 (office)

homework

• Prove that the ISI distribution is exponential for a stationary Poisson process.

• Prove that the CV is 1 for a stationary Poisson process.• Show that the Poisson distribution approaches a Gaussian one for

large mean spike count.

• Prove that F = CV2 for a stationary renewal process.

• Show why the spike count distribution for an inhomogeneous Poisson process is the same as that for a homogeneous Poisson process with the same mean spike count.