Spike response model

The spike response model (SRM) is a spiking neuron model in which spikes are generated by either a deterministic or a stochastic threshold process. In the SRM, the membrane voltage V is described as a linear sum of the postsynaptic potentials (PSPs) caused by spike arrivals to which the effects of refractoriness and adaptation are added. The threshold is either fixed or dynamic. In the latter case it increases after each spike. The SRM is flexible enough to account for a variety of neuronal firing pattern in response to step current input. The SRM has also been used in the theory of computation to quantify the capacity of spiking neural networks; and in the neurosciences to predict the subthreshold voltage and the firing times of cortical neurons during stimulation with a time-dependent current stimulation. The name Spike Response Model points to the property that the two important filters $\varepsilon$ and $\eta$ of the model can be interpreted as the response of the membrane potential to an incoming spike (response kernel $\varepsilon$, the PSP) and to an outgoing spike (response kernel $\eta$, also called refractory kernel). The SRM has been formulated in continuous time and in discrete time. The SRM can be viewed as a generalized linear model (GLM) or as an (integrated version of) a generalized integrate-and-fire model with adaptation.

Model equations for SRM in continuous time

In the SRM, at each moment in time t, a spike can be generated stochastically with instantaneous stochastic intensity or 'escape function'

$\rho (t)=f(V(t)-\vartheta (t))$

that depends on the momentary difference between the membrane voltage V(t) and the dynamic threshold $\vartheta (t)$.

The membrane voltage V(t) at time t is given by

$V(t)=\sum _{f}\eta (t-t^{f})+\int _{0}^{\infty }\kappa (s)I(t-s)\,ds+V_{\mathrm {rest} }$

where t^f is the firing time of spike number f of the neuron, V_rest is the resting voltage in the absence of input, I(t-s) is the input current at time t − s and $\kappa (s)$ is a linear filter (also called kernel) that describes the contribution of an input current pulse at time t − s to the voltage at time t. The contributions to the voltage caused by a spike at time $t^{f}$ are described by the refractory kernel $\eta (t-t^{f})$. In particular,

$\eta (t-t^{f})$ describes the time course of the action potential starting at time $t^{f}$ as well as the spike-afterpotential.

The dynamic threshold $\vartheta (t)$ is given by

$\vartheta (t)=\vartheta _{0}+\sum _{f}\theta _{1}(t-t^{f})$

where $\vartheta _{0}$ is the firing threshold of an inactive neuron and $\theta _{1}(t-t^{f})$ describes the increase of the threshold after a spike at time $t^{f}$. In case of a fixed threshold [i.e., $\theta _{1}(t-t^{f})$=0], the refractory kernel $\eta (t-t^{f})$ should include only the spike-afterpotential, but not the shape of the spike itself.

A common choice for the 'escape rate' $f$ (that is consistent with biological data) is

$f(V-\vartheta )={\frac {1}{\tau _{0}}}\exp[\beta (V-\vartheta )]$

where $\tau _{0}$ is a time constant that describes how quickly a spike is fired once the membrane potential reaches the threshold and $\beta$ is a sharpness parameter. For $\beta \to \infty$ the threshold becomes sharp and spike firing occurs deterministically at the moment when the membrane potential hits the threshold from below. The sharpness value found in experiments is $1/\beta \approx 4mV$ which that neuronal firing becomes non-neglibable as soon the membrane potential is a few mV below the formal firing threshold. The escape rate process via a soft threshold is reviewed in Chapter 9 of the textbook Neuronal Dynamics.

In a network of N SRM neurons $1\leq i\leq N$, the membrane voltage of neuron $i$ is given by

$V_{i}(t)=\sum _{f}\eta _{i}(t-t_{i}^{f})+\sum _{j=1}^{N}w_{ij}\sum _{f'}\varepsilon _{ij}(t-t_{j}^{f'})+V_{\mathrm {rest} }$

where $t_{j}^{f'}$ are the firing times of neuron j (i.e., its spike train), and $\eta _{i}(t-t_{i}^{f})$ describes the time course of the spike and the spike after-potential for neuron i, $w_{ij}$ and $\varepsilon _{ij}(t-t_{j}^{f'})$ describe the amplitude and time course of an excitatory or inhibitory postsynaptic potential (PSP) caused by the spike $t_{j}^{f'}$ of the presynaptic neuron j. The time course $\varepsilon _{ij}(s)$ of the PSP results from the convolution of the postsynaptic current $I(t)$ caused by the arrival of a presynaptic spike from neuron j.

Model equations for SRM in discrete time

For simulations, the SRM is usually implemented in discrete time. In time step $t_{n}$ of duration $\Delta t$, a spike is generated with probability

$P_{F}(t_{n})=F(V(t_{n})-\vartheta (t_{n}))$

that depends on the momentary difference between the membrane voltage V and the dynamic threshold $\vartheta$. The function F is often taken as a standard sigmoidal $F(x)=0.5[1+\tanh(\gamma x)]$ with steepness parameter $\gamma$. But the functional form of F can also be calculated from the stochastic intensity $f$ in continuous time as $F(y_{n})\approx 1-\exp[y_{n}\,\Delta t]$ where $y_{n}=V(t_{n})-\vartheta (t_{n})$ is the distance to threshold.

The membrane voltage $V(t_{n})$ in discrete time is given by

$V(t_{n})=\sum _{f}\eta (t_{n}-t^{f})+\sum _{m=1}^{\infty }\kappa (m\,\Delta t)I(t_{n}-m\,\Delta t)+V_{\mathrm {rest} }$

where t^f is the discretized firing time of the neuron, V_rest is the resting voltage in the absence of input, and $I(t_{k})$ is the input current at time $t_{k}$ (integrated over one time step). The input filter $\kappa (s)$ and the spike-afterpotential $\eta (s)$ are defined as in the case of the SRM in continuous time.

For networks of SRM neurons in discrete time we define the spike train of neuron j as a sequence of zeros and ones, $\{X_{j}(t_{m})\in \{0,1\};m=1,2,3,\dots \}$ and rewrite the membrane potential as

$V_{i}(t_{n})=\sum _{m}\eta _{i}(t_{n}-t_{m})X_{i}(t_{m})+\sum _{j}w_{ij}\sum _{m}\varepsilon _{ij}(t_{n}-t_{m})X_{j}(t_{m})+V_{\mathrm {rest} }$

In this notation, the refractory kernel $\kappa (s)$ and the PSP shape $\varepsilon _{ij}(s)$ can be interpreted as linear response filters applied to the binary spike trains $X_{j}$.

Main applications of the SRM

Theory of computation with pulsed neural networks

Since the formulation as SRM provides an explicit expression for the membrane voltage (without the detour via a differential equations), SRMs have been the dominant mathematical model in a formal theory of computation with spiking neurons.

Prediction of voltage and spike times of cortical neurons

The SRM with dynamic threshold has been used to predict the firing time of cortical neurons with a precision of a few milliseconds. Neurons were stimulated, via current injection, with time-dependent currents of different means and variance while the membrane voltage was recorded. The reliability of predicted spikes was close to the intrinsic reliability when the same time-dependent current was repeated several times. Moreover, extracting the shape of the filters $\kappa (s)$ and $\eta (s)$ directly from the experimental data revealed that adaptation extends over time scales from tens of milliseconds to tens of seconds. Thanks to the convexity properties of the likelihood in Generalized Linear Models, parameter extraction is efficient.

Associative memory in networks of spiking neurons

SRM0 neurons have been used to construct an associative memory in a network of spiking neurons. The SRM network which stored a finite number of stationary patterns as attractors using a Hopfield-type connectivity matrix was one of the first examples of attractor networks with spiking neurons.

Population activity equations in large networks of spiking neurons

For SRM neurons, an important variable characterizing the internal state of the neuron is the time since the last spike (or 'age' of the neuron) which enters into the refractory kernel $\eta (s)$. The population activity equations for SRM neurons can be formulated alternatively either as integral equations, or as partial differential equations for the 'refractory density'. Because the refractory kernel may include a time scale slower than that of the membrane potential, the population equations for SRM neurons provide powerful alternatives to the more broadly used partial differential equations for the 'membrane potential density'. Reviews of the population activity equation based on refractory densities can be found in as well in Chapter 14 of the textbook Neuronal Dynamics.

Spike patterns and temporal code

SRMs are useful to understand theories of neural coding. A network SRM neurons has stored attractors that form reliable spatio-temporal spike patterns (also known as synfire chains) example of temporal coding for stationary inputs. Moreover, the population activity equations for SRM exhibit temporally precise transients after a stimulus switch, indicating reliable spike firing.

4. History and relation to other models

The Spike Response Model has been introduced in a series of papers between 1991 and 2000. The name Spike Response Model probably appeared for the first time in 1993. Some papers used exclusively the deterministic limit with a hard threshold others the soft threshold with escape noise. Precursors of the Spike Response Model are the integrate-and-fire model introduced by Lapicque in 1907 as well as models used in auditory neuroscience.

SRM0

An important variant of the model is SRM0 which is related to time-dependent nonlinear renewal theory. The main difference to the voltage equation of the SRM introduced above is that in the term containing the refractory kernel $\eta (s)$ there is no summation sign over past spikes: only the most recent spike matters. The model SRM0 is closely related to the inhomogeneous Markov interval process and to age-dependent models of refractoriness.

GLM

The equations of the SRM as introduced above are equivalent to Generalized Linear Models in neuroscience (GLM). In the neuroscience, GLMs have been introduced as an extension of the Linear-Nonlinear-Poisson model (LNP) by adding self-interaction of an output spike with the internal state of the neuron (therefore also called 'Recursive LNP'). The self-interaction is equivalent to the kernel $\eta (s)$ of the SRM. The GLM framework enables to formulate a maximum likelihood approach applied to the likelihood of an observed spike train under the assumption that an SRM could have generated the spike train. Despite the mathematical equivalence there is a conceptual difference in interpretation: in the SRM the variable V is interpreted as membrane voltage whereas in the recursive LNP it is a 'hidden' variable to which no meaning is assigned. The SRM interpretation is useful if measurements of subthreshold voltage are available whereas the recursive LNP is useful in systems neuroscience where spikes (in response to sensory stimulation) are recorded extracellulary without access to the subthreshold voltage.

Adaptive leaky integrate-and-fire models

A leaky integrate-and-fire neuron with spike-triggered adaptation has a subthreshold membrane potential generated by the following differential equations

$\tau _{\mathrm {m} }{\frac {dV(t)}{dt}}=RI(t)-[V(t)-E_{\mathrm {rest} }]-R\sum _{k}w_{k}$

$\tau _{k}{\frac {dw_{k}(t)}{dt}}=-w_{k}+b_{k}\tau _{k}\sum _{f}\delta (t-t^{f})$

where $\tau _{m}$ is the membrane time constant and w_k is an adaptation current number, with index k, E_rest is the resting potential and t^f is the firing time of the neuron and the Greek delta denotes the Dirac delta function. Whenever the voltage reaches the firing threshold the voltage is reset to a value V_r below the firing threshold. Integration of the linear differential equations gives a formula identical to the voltage equation of the SRM. However, in this case, the refractory kernel $\eta (s)$ does not include the spike shape but only the spike-afterpotential. In the absence of adaptation currents, we retrieve the standard LIF model which is equivalent to a refractory kernel $\eta (s)$ that decays exponentially with the membrane time constant $\tau _{m}$.

External links

• Spike Response Model, Chapter 6.4 of the textbook Neuronal Dynamics
• 'soft threshold' and escape noise, Chapter 9 of the textbook Neuronal Dynamics
• Quasi-Renewal Theory Chapter 14 of the textbook Neuronal Dynamics.
• Spike Response Model, from Scholarpedia