Top Banner
Neural Dynamics Gregor Schöner [email protected]
28

4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Aug 01, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Neural Dynamics

Gregor Schö[email protected]

Page 2: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation

how to represent the inner state of the Central Nervous System?

=> activation concept

source1 source2

Page 3: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation

neural state variables

membrane potential of neurons?

spiking rate?

... population activation...

Page 4: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation

activation as a real number, abstracting from biophysical details

low levels of activation: not transmitted to other systems (e.g., to motor systems)

high levels of activation: transmitted to other systems

as described by sigmoidal threshold function

zero activation defined as threshold of that function

0.5

1

0

g(u)

u

Page 5: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation

compare to connectionist notion of activation:

same idea, but tied to individual neurons

compare to abstract activation of production systems (ACT-R, SOAR)

quite different... really a function that measures how far a module is from emitting its output...

Page 6: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation dynamics

activation evolves in continuous time

no evidence for a discretization of time, for spike timing to matter for behavior

evidence for continuous online updating target jumps

trajectory isadjustedonline

Page 7: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation dynamics

activation evolves continuously in continuous time

no evidence for a discrete events mattering...

evidence for continuity: visual inertia

http://anstislab.ucsd.edu

Page 8: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation dynamics

activation variables u(t) as time continuous functions...

what function f?

⌧ u̇(t) = f(u)

du(t)/dt

u(t)

Page 9: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation dynamics

start with f=0

⌧ u̇ = ⇠t

time, t

u(t)

restinglevel

du/dt

uresting level

probability distributionof perturbations

Page 10: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Activation dynamics

need stabilization

⌧ u̇ = �u+ h+ ⇠t.

time, t

du/dt

u

u(t)

resting level

restinglevel

Page 11: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Neural dynamics

In a dynamical system, the present predicts the future: given the initial level of activation u(0), the activation at time t: u(t) is uniquely determined

du(t)

dt= u̇(t) = �u(t) + h (h < 0)

du/dt = f(u)

u

restinglevel

vector-field

Page 12: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Neural dynamicsstationary state=fixed point= constant solution

stable fixed point: nearby solutions converge to the fixed point=attractor

du(t)

dt= u̇(t) = �u(t) + h (h < 0)

du/dt = f(u)

u

restinglevel

vector-field

Page 13: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Neural dynamics

exponential relaxation to fixed-point attractors

=> time scale

⌧ u̇(t) = �u(t) + h

du/dt = f(u)

u

restinglevel

vector-field

time

u(t)u(0)

u(0)/e

u( )

Page 14: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Neural dynamics

attractor structures ensemble of solutions=flow

⌧ u̇(t) = �u(t) + h

du/dt = f(u)

u

restinglevel

vector-field

0 0.05 0.1 0.15 0.2 0.25 0.3

time, t

u(t)

restinglevel

Page 15: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

Neuronal dynamics

inputs=contributions to the rate of change

positive: excitatory

negative: inhibitory

=> shifts the attractor

activation tracks this shift (stability)

⌧ u̇(t) = �u(t) + h + inputs(t)

u

h+s

input, s

restinglevel, h

du/dt

time, t

u(t)

resting level, h

g(u(t))

input, s

Page 16: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

=> simulation

Page 17: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

⇥ u̇(t) = �u(t) + h + S(t) + c�(u(t))

Neuronal dynamics with self-excitation

stimulus

input

output

self-excitationu cs

Page 18: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

⇥ u̇(t) = �u(t) + h + S(t) + c�(u(t))

Neuronal dynamics with self-excitation

u

du/dt

restinglevel, h

0.5

1

0

g(u)

u

Page 19: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

=> this is nonlinear dynamics!

Neuronal dynamics with self-excitation

u

du/dt

restinglevel, h

Page 20: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

stimulus input

Neuronal dynamics with self-excitation

u

du/dt

restinglevel, h

input strength

Page 21: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

bistable regime at intermediate stimulus strength

=> essentially nonlinear!

Neuronal dynamics with self-excitation

u

du/dt

time, t

u(t)<0

u(t)>0

Page 22: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

with varying input strength system goes through two instabilities: the detection and the reverse detection instability

Neuronal dynamics with self-excitation

u

du/dt

restinglevel, h

input strength

Page 23: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

with varying input strength system goes through two instabilities: the detection and the reverse detection instability

Neuronal dynamics with self-excitation

u

du/dt

restinglevel, h

input strength

Page 24: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

detection instability

u

du/dt fixed point

unstable

stablestimulusstrength

stimulusstrength

Neuronal dynamics with self-excitation

Page 25: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

with varying input strength system goes through two instabilities: the detection and the reverse detection instability

Neuronal dynamics with self-excitation

u

du/dt

restinglevel, h

input strength

Page 26: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

reverse detection instability

u

du/dt fixed point

unstable

stable

stimulusstrength

stimulusstrength

Neuronal dynamics with self-excitation

Page 27: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

signature of instabilities: hysteresis

time, t

u(t)

detection instability

reversedetection instability

Neuronal dynamics with self-excitation

Page 28: 4 Neural Dyn tutorial - Ruhr University Bochum · B 0 g(u) u . Activation compare to connectionist notion of activation: same idea, but tied to individual neurons compare to abstract

=> simulation