Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical...

33
Dynamical systems in neuroscience Seth W. Egger

Transcript of Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical...

Page 1: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Dynamical systems in neuroscience

Seth W. Egger

Page 2: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

1. Comment on models

2. Introduction to dynamical systems

3. Linear dynamical systems

4. Stochastics

5. Evolution of probability density

6. Leaky integrate and fire neurons

Purpose: impart some basic intuition, introduction to common models and provide terminology

Page 3: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Comment on models

Classical mechanics Relativistic mechanics Quantum mechanics

No model is “right”! Models are only useful or not useful in making predictions and providing insight

Page 4: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

What is meant by “dynamical system”?

Quite simply, a set of variables with time-dependence:

x(t)

y(t) y(t+∆t)∆y

x(t+∆t)∆x = f[y(t)]

= f[x(t)]

Page 5: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Dynamic systems and differential equations

Page 6: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Simple, linear system

a<0 a>0

a=0

Stable Unstable

Page 7: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

System of two variables

Page 8: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Phase plane of the system

x

y

Page 9: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Nullcline: points in space where the value of a variable does not change with time

x

y

Fixed point

Page 10: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Solutions of linear differential equations

Generalizes differential equations to arbitrary number of dimensions

Page 11: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Solutions of linear dynamical systems: Eigenvalues of the matrix, M

Real axis

Imag

inar

y ax

is

Page 12: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Caution!

● Biological systems are not generally linear!● Linear models often provide a good approximation to

complex systems● Studying linear models provides intuition about dynamical

systems

Page 13: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Example from neuroscience

Hodgkin and Huxley (1952)

Model

Data

Page 14: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Stochasticity and dynamic systems

vMassive

convergence of inputsItotal(t)

Page 15: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Stochasticity and dynamic systems

v

Driving input: I(t)

Random fluctuations:

η(t)

Itotal(t) = I(t) + η(t)

Page 16: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Stochastic differential equations

Ornstein-Uhlenbeck process

Page 17: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Ornstein-Uhlenbeck process: just noise

Page 18: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

What is the probability of v = V at some time, t?p(v = V,t)

t

Page 19: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Distribution of v a short time after initiation of the process: p(v,∆t)

v(0) v(0+∆t)

Page 20: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

What is the distribution of v at the next time step?

v(∆t) v(2∆t)

Page 21: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

What is the distribution of v?v(∆t) v(2∆t)

Page 22: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

v(t-∆t) v(t) = V v(t+∆t)

Alternative approach: track the changes in probability for a given bin

Page 23: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Temporal evolution of the probability distribution

r/2

∆vp(v = V,t)

r/2

r/2r/2

v(t)

Page 24: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Fokker-Planck: diffusion

Page 25: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Ornstein-Uhlenbeck: just drift

Page 26: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Fokker-Planck: drift

a

∆vp(v = V,t)

a

v(t)

Page 27: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

The full Fokker-Planck equation

For the Ornstein-Uhlenbeck process considered:

General solution:

Page 28: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Leaky integrate-and-fire (LIF) model neuron

Voltage of the neuron Resting potentialLeak conductance Input Noise

Where are the action potentials?

Threshold

Page 29: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Boundary condition: spike and reset

Spikes

Reset potential

Page 30: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Boundary condition: augmenting Fokker-Planck

Page 31: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Example: predicting the time of the next spike

Pillow et. al. 2005

Page 32: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Other applications: inference over time

Stochastic differential equations

Observation model

Page 33: Dynamical systems in neuroscience · 2017-11-28 · Comment on models 2. Introduction to dynamical systems 3. Linear dynamical systems 4. Stochastics 5. Evolution of probability density

Suggested reading

Digestible reference for introduction to dynamical systems in neuroscience (no stochastics!)Izhikevich, E. M. (2007). Dynamical systems in neuroscience. MIT press.

General reference for dynamical systems in neuroscience

Ermentrout, G. B., and Terman, D. H. (2010). Mathematical foundations of neuroscience. Springer Science & Business Media.

Gerstner, W., Kistler, W. M., Naud, R., and Paninski, L. (2014). Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition. Cambridge University Press.

Specific examples of the use of SDEs in neuroscience

Laing, C., and Lord, G. J. (2009). Stochastic Methods in Neuroscience. OUP Oxford.