Original Research ARTICLE
Traveling pulses in a stochastic neural field model of direction selectivity
- Department of Mathematics, University of Utah, Salt Lake City, UT, USA
We analyze the effects of extrinsic noise on traveling pulses in a neural field model of direction selectivity. The model consists of a one-dimensional scalar neural field with an asymmetric weight distribution consisting of an offset Mexican hat function. We first show how, in the absence of any noise, the system supports spontaneously propagating traveling pulses that can lock to externally moving stimuli. Using a separation of time-scales and perturbation methods previously developed for stochastic reaction-diffusion equations, we then show how extrinsic noise in the activity variables leads to a diffusive-like displacement (wandering) of the wave from its uniformly translating position at long time-scales, and fluctuations in the wave profile around its instantaneous position at short time-scales. In the case of freely propagating pulses, the wandering is characterized by pure Brownian motion, whereas in the case of stimulus-locked pulses, it is given by an Ornstein–Uhlenbeck process. This establishes that stimulus-locked pulses are more robust to noise.
Continuum neural field models represent the large-scale dynamics of spatially structured networks of neurons in terms of non-linear integro-differential equations, whose associated integral kernels represent the spatial distribution of neuronal synaptic connections (Wilson and Cowan, 1972, 1973; Amari, 1977). As in the case of non-linear partial differential equation (PDE) models of diffusively coupled excitable systems (Keener, 1981; Kuramoto, 1984), non-local neural fields can exhibit a diverse range of spatiotemporal dynamics, including solitary traveling fronts and pulses, stationary pulses, and spatially localized oscillations (breathers), spiral waves, and Turing-like patterns. See, for example, the reviews Ermentrout (1998), Coombes (2005), and Bressloff (2012). In recent years, neural fields have been used to model a wide range of neurobiological phenomena, including wave propagation in cortical slices (Pinto and Ermentrout, 2001; Richardson et al., 2005) and in vivo (Huang et al., 2004), geometric visual hallucinations (Ermentrout and Cowan, 1979; Bressloff et al., 2001), EEG rhythms (Nunez, 1995; Robinson et al., 2001; Liley et al., 2002; Steyn-Ross et al., 2003), orientation tuning in primary visual cortex (V1) (Ben-Yishai et al., 1995; Somers et al., 1995), short term working memory (Camperi and Wang, 1998; Laing and Chow, 2002), control of head direction (Zhang, 1996), direction selectivity (Xie and Giese, 2002), motion perception (Giese, 1999), and binocular rivalry waves (Bressloff and Webber, 2012a). One particularly useful feature of neural fields is that analytical techniques for solving these integro-differential equations can be adapted from previous studies of non-linear PDEs. These include regular and singular perturbation methods, weakly non-linear analysis and pattern formation, symmetric bifurcation theory, Evans functions and wave stability, and homogenization theory (Bressloff, 2012). In particular, we have recently shown how perturbation methods for studying fluctuating fronts in reaction-diffusion PDEs (Schimansky-Geier et al., 1983; de Pasquale et al., 1992; Armero et al., 1998; Sagues et al., 2007) can be extended to the problem of front propagation in stochastic neural fields (Bressloff and Webber, 2012b), and have used this to investigate the effects of noise on binocular rivalry waves (Webber and Bressloff, submitted). Such methods exploit a separation of time-scales in which there is a diffusive-like displacement (wandering) of the front from its uniformly translating position at long time-scales, and fluctuations in the front profile around its instantaneous position at short time-scales.
In this paper, we extend our theory of wave propagation in stochastic neural fields to the case of a neural field that supports traveling pulses rather than fronts. A typical mechanism for generating traveling pulses in an excitatory network is to include some form of slow adaptation, such as spike frequency adaptation (Pinto and Ermentrout, 2001; Coombes and Owen, 2005) or synaptic depression (Kilpatrick and Bressloff, 2010a,b), which suppresses the trailing edge of the wave. One of the motivations for considering excitatory neural fields is that traveling pulses are observed in in vitro cortical slices that have been disinhibited. Here we consider an alternative mechanism for generating pulses, based on asymmetric excitatory/inhibitory synaptic connections. Such a network architecture supports freely propagating pulses without any adaptation, and has been proposed as a simple recurrent mechanism for generating direction selectivity in a network driven by moving stimuli (Mineiro and Zipser, 1998; Xie and Giese, 2002). Most classical models for the direction selectivity of cortical neurons are based on feedforward mechanisms, namely, the linear or non-linear spatiotemporal filtering of afferent thalamo-cortical inputs (Reichardt, 1961; Adelson and Bergen, 1985; Koch and Poggio, 1985; van Santen and Sperling, 1985). Some of these models also involve a combination of lagged (time-delayed) and non-lagged inputs (Saul and Humphrey, 1990; Baker and Bair, 2012). However, there is now considerable experimental data demonstrating that the response of cortical cells is strongly influenced by intracortical circuitry. This has motivated a number of modeling studies that show how direction selectivity can be reproduced by recurrent neural network models with asymmetric lateral excitatory or inhibitory connections and non-direction-selective inputs (Suarez et al., 1995; Maex and Urban, 1996; Mineiro and Zipser, 1998; Xie and Giese, 2002). In this paper, we base our investigation of stochastic traveling pulses on the particular version introduced by Xie and Giese (2002).
The main results of the paper are as follows. We first analyze freely propagating pulses and stimulus-locked pulses in the deterministic case, expanding the analysis of Xie and Giese (2002). In particular, we construct a stability diagram showing the existence and stability of stimulus-locked pulses as a function of stimulus velocity and amplitude. We then turn to a corresponding stochastic version of the model. We show how extrinsic noise in the activity variable leads to a diffusive-like displacement (wandering) of the wave from its uniformly translating position at long time-scales, and fluctuations in the wave profile around its instantaneous position at short time-scales. In the case of freely propagating pulses, the wandering is characterized by pure Brownian motion, whereas in the case of stimulus-locked pulses, it is given by an Ornstein–Uhlenbeck process. This establishes that stimulus-locked pulses are more robust to noise. One major difference between pulses and fronts is that, in principle, noise could significantly affect both the location (center-of-mass) and width of the pulse. We find that fluctuations in the width can be neglected in the case of freely propagating pulses, whereas the saturation of the mean-square displacement of the center-of-mass of the pulse for stimulus-locked pulses means that fluctuations in pulse width can no longer be ignored.
Materials and Methods
Neural Field Model of Direction Selectivity
In this paper we consider a scalar neural field equation of the form
Here u(x, t) is a measure of activity (current or voltage) within a local population of excitatory and inhibitory neurons at position x ∈ ℝ and time t, τ is a membrane time constant (of order 10 msec), w(x) denotes the spatial distribution of synaptic connections between local populations, F(u) is a non-linear firing rate function and h(x, t) is an external input. (We fix the time-scale by setting τ = 1). F is usually taken to be a sigmoid function
with gain γ and threshold κ. In the high-gain limit γ → ∞, this reduces to the Heaviside function
The function w(x − x') represents the distribution of synaptic weights from the local population at x' to the population at x. Usually, w is taken to be a symmetric or even function such that w(x) = w(−x). A common choice for the weight distribution is a “Mexican hat” function, with a center excitatory region surrounded by flanking inhibitory regions. As originally shown by Amari (1977), symmetric Mexican hat functions tend to support stationary activity “bumps.” Following Xie and Giese (2002), however, we will use an asymmetric Mexican hat function whose maximum is offset by an amount x0, that is w(x−x0) = w(−[x−x0]); the resulting neural field then supports freely propagating pulses that depend on the degree of offset. Note that such a choice should be contrasted with a symmetric function w with peaks offset from zero see e.g., (Hutt and Atay, 2005). In the case of exponential functions, w takes the form (see Figure 1)
Figure 1. Plot of weight distribution for various values of the shift x0. Here ae = 5, ai = 1, σe = 0.42, and σi = 0.1.
where ae > ai and σe > σi. Setting x0 = 0 recovers the standard Mexican hat function. Note that one could equally use other functions such as a difference-of-Gaussians without changing the main results of the paper; the advantage of exponentials is that one can carry out explicit calculations.
Finally, the external input h(x, t) consists of two components:
Here I(x − vt) represents an external pulse-like stimulus moving with constant speed v and amplitude I0, whereas the second term represents an extrinsic, multiplicative noise source. In particular, ξ(x, t) is a Gaussian process with zero mean and two-point correlations
Thus the noise is white in time and colored in space with correlation length λ. Formally speaking, η(x, t)dt = dW(x, t) where dW(x, t) is a corresponding Wiener process. The amplitude of the noise is determined by the parameter ∈, and the function g(u) incorporates any activity-dependence. Note that (Xie and Giese, 2002) only considered the deterministic case (∈ = 0). They showed how the deterministic neural field supports freely propagating pulses of fixed speed c when I0 = 0. This then provides a mechanism for direction selectivity, since these pulses can lock to a moving stimulus of speed v provided that |c − v| is sufficiently small; the range of locking depends on the amplitude I0. In this paper, we develop a more systematic analysis of stimulus-locking in the absence of noise, and then investigate the effects of noise on both freely propagating and stimulus-locked pulses.
Determinstic Neural Field
We begin by analyzing traveling pulse solutions of the neural field Equation (1) in the absence of noise (∈ = 0). Following the original formulation of Amari (1977), we investigate the existence and stability of traveling pulses by setting the firing rate function to be the Heaviside (Equation 3).
Freely propagating pulses
For the moment, suppose that there are no external inputs so that h(x, t) = 0 in Equation (1). A traveling pulse of velocity c is then defined according to u(x, t) = U(ξ), with ξ = x − ct a traveling wave coordinate such that limξ→±∞ U(ξ) = 0. Moreover, the wave profile is restricted to be super threshold in a connected interval of width d. Since the neural field is equivariant with respect to uniform translations (in the absence of external stimuli), we choose the two threshold crossing points to be
Thus, U(ξ) > κ for 0 < ξ < d, U(ξ) < κ for ξ < 0, and ξ > d. It turns out the wave travels in the same direction as the offset so we restrict ourselves to the case x0 > 0 and c > 0. Substituting the traveling pulse solution into Equation (1) gives
Multiplying both sides by e−ξ/c and integrating gives the following equation for the wave solution:
It is convenient to express the weight function in piecewise form as follows:
We then obtain a piecewise expression for W(ξ) of the form
We then have
with ξ1 = ∞, ξ2 = x0 + d and ξ3 = x0.
Having obtained the piecewise wave profile U(ξ), the threshold conditions (Equation 7) can now be used to determine the pulse speed c and width d; the resulting transcendental equations have to be solved numerically. Figure 2 shows solutions for the pulse speed and width as functions of the threshold. It turns out that the solution with slower speed (and larger width) is stable (see below). This differs from traveling pulse solutions found in adaptive neural fields, where the faster wave (with larger width) tends to be stable (Pinto and Ermentrout, 2001; Kilpatrick and Bressloff, 2010a). Figure 3A shows a typical pulse waveform and Figure 3B shows a numerical simulation of the neural field Equation (1) using the wave solution as the initial condition. The pulse propagates at the predicted speed without changing shape significantly. This occurs because the parameters were chosen to make the pulse solution linearly stable.
Figure 2. (A) Plots of pulse speed c and (B) pulse width d as a function of the threshold κ. Weight parameters are as in Figure 1 with offset x0 = 3. Stable (unstable) branches are indicated by black (gray) curves.
Figure 3. (A) Plot of traveling wave profile U(ξ) obtained analytically. Same parameters as Figure 2 for threshold κ = 4. (B) Spacetime plot of a traveling pulse using the profile of (A) as the initial condition. High (low) activity indicated by light (gray).
In order to determine the linear stability of a traveling pulse solution U(ξ) in the moving frame, we linearize Equation (1) with h(x, t) = 0 by setting
and Taylor expanding to first order in ϕ. This gives
In the case of the Heaviside rate function (Equation 3), we have
Moreover, differentiating Equation (9) with respect to ξ shows that
Substituting the previous two results into Equation (13) gives
where κ is the threshold. Looking for solutions of the form
then leads to the spectral problem
We take the linear operator ℒ to act on a Banach space ℬ of continuous, bounded functions ψ(ξ) that are defined for ξ ∈ ℝ, and that decay exponentially as ξ→±∞. Let σ(ℒ) denote the spectrum of the linear operator ℒ, and define the associated resolvent operator according to ℛλ ≡(ℒ − λ I)−1, where I is the identity operator. The spectrum can be defined as those values of λ for which is not bijective. The spectrum is composed of three disjoint sets, the point or discrete spectrum, the residual spectrum, and the continuous spectrum. The point spectrum is defined as the values of λ (eigenvalues) for which the resolvent does not exist. The residual spectrum are the spectral values for which the resolvent exists but is not defined on a dense subset of ℬ. The continuous spectrum are the spectral values for which the resolvent exists and is densely defined but is unbounded (Kreyszig, 1978). Given these definitions, the traveling pulse is said to be linearly stable if (1) Re(λ) < 0 for all λ ın σ(ℒ), λ ≠ 0 and (2) the zero eigenvalue is simple. The existence of a zero eigenvalue with corresponding eigenfunction ϕ(ξ, t) = U′(ξ) reflects translation invariance, and immediately follows from differentiating (Equation 9) with respect to ξ.
We first consider the discrete spectrum by solving the eigenvalue equation
where we have introduced the constants
Multiplying both sides by e−(λ + 1)ξ/c and integrating gives
which can be rewritten in the more compact form
The eigenvalues are now determined by imposing self-consistency at ξ = 0 and ξ = d. Setting ξ = 0 and ξ = d in Equation (18) leads to the vector equation
This has a non-trivial solution if and only if the determinant of the matrix is zero. The determinant expressed as a function of λ, ℰ(λ), is a complex analytic function known as the Evans function:
Thus, the zeros of the Evans function determine the discrete spectrum of the linear operator formed by linearizing the neural field equation about the pulse solution. Evans functions were originally introduced within the context of the stability of solitary pulses in diffusive Hodgkin–Huxley type equations describing action potential propagation in nerve axons (Evans, 1975). Since then the Evans function construction has been extended to a wide range of PDEs, see the review (Sandstede, 2002). It has also recently been applied to neural field equations (Zhang, 2003; Coombes and Owen, 2004; Rubin, 2004; Folias and Bressloff, 2005; Pinto et al., 2005; Sandstede, 2007) and more general non-local problems (Kapitula et al., 2004). An example plot of the real and imaginary parts of ℰ(λ) = 0 on the complex plane is shown in Figure 4. It can be seen that there is a zero eigenvalue and one negative real eigenvalue, indicating that the corresponding traveling pulse is linearly stable.
Figure 4. Graphs of the zero sets of the real (dark curves) and imaginary (light curves) parts of the Evans function determining the stability of a freely propagating pulse; intersection points (filled circles) indicate eigenvalues. The line Im λ = −1 indicates the essential spectrum. Same parameter values as Figure 3.
To find the essential spectrum, which is the union of the residual and continuous spectra, we will derive an explicit expression for the resolvent ℛλ. We start by writing an inhomogeneous equation of the form , where h(ξ) represents a general function from the Banach space ℬ. This can be manipulated as before to give
By evaluating at ξ = 0 and ξ = d as before, we arrive at the following vector equation, which differs from (Equation 20) only on the right-hand side:
Since we are looking for spectral values outside the discrete spectrum, the determinant of the matrix satisfies ℰ(λ)≠ 0. Therefore, multiplying both sides by the inverse matrix yields expressions for ψ(0) and ψ(d) in terms of h:
Substituting into Equation (22) gives the following expression for the resolvent operator, of the form ℛλh = ϕ:
The resolvent is well-defined for all h in ℬ, so the residual spectrum of ℒ is empty. To find the continuous spectrum, we Fourier transform Equation (23):
It follows that the resolvent operator is unbounded when is unbounded. Equation (19) implies that
Hence, is unbounded for λ = −1−2π ikc so that the continuous spectrum of ℒ is a vertical line in the complex plane at Re(λ) = −1. Since Re(λ) < 0, the continuous spectrum will not make any pulse solution of our model unstable.
Now suppose that the neural field is driven by a moving external pulse stimulus of speed v so that Equation (1) becomes
In order to study the existence of stimulus-locked pulses, we will define a “stimulus coordinate” ξ = x − vt and look for pulse solutions that move at the same speed as the stimulus, that is, u(x, t) = U(ξ) with
For concreteness, the stimulus will be represented by a rectangular wave of amplitude I0 and width d, defined formally as
Since translation invariance no longer holds, it is necessary to determine both threshold crossing points, which we denote by ξ = d1 and ξ = d2. Proceeding in a similar fashion to the case of freely propagating pulses, we find that
where z0 = ∞ if v > 0, z0 = −∞ if v < 0, and
The latter can be expressed in the piecewise form
where w1 and w2 are defined as in Equation (10). After evaluating the integrals along similar lines to section “Neural Field Model of Direction Selectivity,” we obtain the following expressions for the pulse solution, defined independently for positive and negative stimulus directions:
v > 0:
for ξ1 = ∞, ξ2 = x0 + d2, ξ3 = x0 + d1, and
v < 0:
for ξ3 = −∞, ξ2 = x0 + d1, ξ1 = x0 + d2, and
The threshold crossing points (d1 and d2) are determined in the same way the pulse speed and width were determined in the no-stimulus case, which is by numerically solving a system of two transcendental equations. The first equation is given by U3(d1) = κ. The second equation is U3(d2) = κ if d2 < x0 + d1, else it is given by U2(d2) = κ. Figure 5 shows a plot of d1 (black curves) and d2 (gray curves) vs. the threshold κ. It can be seen that for a certain range of thresholds there exists more than one stable/unstable pair of pulses. Figure 6 shows the linear stability and the number of solutions for different combinations of stimulus speed (v) and strength (I0). The offset x0 = 3 and the corresponding spontaneous wave speed is c = 4. (Note that for smaller offsets x0 and thus smaller wave speeds c, one finds stimulus-locked waves for negative values of v). The stability of solutions in the presence of a stimulus is determined in much the same way as without a stimulus. We again define u(x, t) = U(ξ) + ϕ(ξ,t) and look at the behavior of the perturbations described by ϕ(ξ, t). Substituting into Equation (26), the stimulus term drops out when we perform the linearization, so that
Figure 5. Plot of leading threshold crossing position d2 (gray curves) and trailing threshold crossing position d1 (black curves) of stimulus-locked pulses as a function of threshold κ. There exists at most one stable pulse (indicated by arrows) and up to three unstable pulses. Weight parameters as in Figure 2 and κ = 4. Stimulus parameters are d = 5, I0 = 5, and v = 5.
Figure 6. Stability diagram for stimulus-locked pulses in (v, I0)-parameter space. Weight parameters as in Figure 2, κ = 4, and d = 5. Emerging from the stable pulse solution when I0 = 0 is a tongue consisting of a stable/unstable pair of pulses (light gray). Similarly, emerging from the unstable solution when I0 = 0 is a tongue consisting of two unstable pulses (medium gray). As I0 increases within a tongue an unstable pulse can disappear due to the development of multiple super-threshold regions (indicated by solid curves). All solutions coexist when tongues overlap (dark gray).
Setting ϕ(ξ, t) = eλtϕ ultimately yields the spectral problem
The corresponding Evans function is now
It is easy to establish as before that the residual spectrum is empty and that the continuous spectrum consists of a vertical line in the complex plane at Re(λ) = −1. So the stability is again determined only by the discrete spectrum, which consists of the zeros of the Evans function. Figure 7A shows an example of a numerical simulation of a stable stimulus-locked pulse solution of Equation (26) with the analytical pulse solution U(x) as an initial condition. Figure 7B shows the same simulation except with the zero initial condition u(x,0) = 0. It can be seen from Figure 7C that both initial conditions converge to the same pulse profile.
Figure 7. Space-time plots of a stimulus-locked pulse for (A) u(x, 0) = U(x) and (B) u(x, 0) = 0. Both initial conditions converge to the same wave profile in the large t limit as indicated in (C) for t = 50. Weight parameters as in Figure 2 and κ = 4. Stimulus parameters are d = 5, I0 = 8, and v = 3.
Stochastic Neural Field
Several recent studies have considered stochastic versions of neural field equations that are based on a corresponding Langevin equation formulation (Brackley and Turner, 2007; Hutt et al., 2008; Faugeras et al., 2009; Bressloff and Webber, 2012b). Motivated by these examples, we consider the following Langevin equation (or stochastic PDE) for the stochastic activity variable U(x, t), which is a rewriting of Equation (1) with h(x, t) given by Equation (5) for I0 = 0 and ϵ > 0:
where dW(x, t) is an independent Wiener process with zero mean and correlation given by
Here λ is the spatial correlation length of the noise such that C(x/λ)→ δ(x) in the limit λ → 0, and ϵ determines the strength of the noise, which is assumed to be weak. For the sake of generality, we take the noise to be multiplicative rather than additive; however, the main results of the paper hold for both. Following standard formulations of Langevin equations (Gardiner, 2009), the multiplicative noise term is taken to be of Stratonovich form in the case of extrinsic noise. Note, however, that an alternative formulation of stochastic neural field theory has been developed in terms of a neural master equation (Buice and Cowan, 2007; Bressloff, 2009, 2010; Buice et al., 2010), in which the underlying deterministic equations are recovered in the thermodynamic limit N→ ∞, where N is a measure of the system size of each local population. In the case of large but finite N, a Kramers-Moyal expansion of the master equation yields a Langevin neural field equation with multiplicative noise of the Ito form Bressloff (2009, 2010). Multiplicative noise in the Stratonovich sense causes a shift in the speed and width of the pulse. This happens because 〈 g(U)dW〉≠ 0, even though 〈 dW〉 = 0. We can use Novikov's theorem (Novikov, 1965) to calculate the former average:
The average can also be calculated by Fourier transforming Equation (31) and taking averages using the corresponding Fokker–Planck equation (Armero et al., 1998; Bressloff and Webber, 2012b). In the limit that λ approaches 0, we set C(0) → 1/Δx, where Δx is a lattice cut-off that can be identified with the spatial discretization step size in numerical simulations (Bressloff and Webber, 2012b). Following Ref. Armero et al. (1998), we rewrite Equation (31) so the fluctuating term has zero mean:
The stochastic process R has zero mean and correlation
Separation of time-scales
The effects of additive or multiplicative extrinsic noise on traveling waves can be analyzed using multiple time-scale methods originally developed for reaction-diffusion equations (Schimansky-Geier et al., 1983; de Pasquale et al., 1992; Armero et al., 1998; Sagues et al., 2007), which were recently extended to neural field equations in Ref. Bressloff and Webber (2012b). The main idea is to assume that the fluctuating term generates two distinct phenomena that occur on different time-scales: a diffusive-like displacement of the traveling wave from its uniformly translating position at long time-scales, and fluctuations in the wave profile around its instantaneous position at short time-scales. It is important to point out that, in contrast to traveling front solutions of scalar neural field equations (Bressloff and Webber, 2012b), we are now considering traveling pulse solutions. Thus in addition to the center-of-mass of the traveling pulse wave, which moves with speed c in the absence of noise, there is an additional degree of freedom corresponding to the “width” of the pulse. (In the case of a Heaviside rate function, the width Δ is determined by the threshold crossing points). For simplicity, we assume that the width of the wave is only weakly affected by the noise; this is consistent with what is found numerically. We now express the solution U of Equation (33) as a combination of a fixed wave profile U0 that is displaced by an amount Δ(t) from its uniformly translating position ξ = x−cϵt, where cϵ is a noise-dependent speed, and a time-dependent fluctuation Φ in the wave shape about its instantaneous position:
The wave profile U0 and associated wave speed/width cϵ, Δϵ are obtained by solving the modified deterministic equation
The results depend on ϵ due to the ϵ-dependence of h. Equation (38) is chosen so that that to leading order, the stochastic variable Δ(t) undergoes unbiased Brownian motion with a diffusion coefficient D(ϵ) = (ϵ) (see below). The next step is to substitute the decomposition Equation (37) into (33) and expand to first order in (ε1/2):
where we have set ξΔ = ξ − Δ(t) and ξΔ' = ξ' − Δ(t). We now use Equation (38) for U0, after shifting ξ→ ξ − Δ(t), to eliminate terms and then divide through by . This gives the inhomogeneous equation to (ϵ1/2)
where the non-self-adjoint linear operator
is defined for all functions A(ξ) in ℒ2(ℝ). Note that for all terms in Equation (40) to be of the same order we have taken Δ(t) = (ε1/2). It then follows that U0(ξ − Δ(t)) = U0(ξ) + (ε1/2) etc., and Equation (39) reduces to
If U0(ξ) were a traveling front solution of a neural field model with a symmetric, excitatory weight distribution w, then it could be proven that the operator has a 1D null space spanned by U0'(ξ) (Ermentrout and McLeod, 1993)). We will assume that such a result carries over to traveling pulse solutions of a neural field with w given by an asymmetric Mexican hat function; the fact that U0'(ξ) belongs to the null space follows immediately from differentiating Equation (38) with respect to ξ. We then have the solvability condition for the existence of a non-trivial bounded solution of Equation (41), namely, that the inhomogeneous part is orthogonal to all elements of the null space of the adjoint operator . The latter is defined with respect to the inner product
Integrating by parts and using (Equation 14) leads to
We will assume that the null space of the adjoint operator is also one-dimensional and is spanned by some yet to be determined function . (In the case of a Heaviside firing function, we will determine the null space explicitly). Hence, we can write the solvability condition as
which leads directly to the stochastic differential equation
Using the lowest order approximations dR(U0,ξ, t) = g(U0(ξ))dW(ξ, t), we deduce that [for Δ(0) = 0]
where D(ϵ) is the effective diffusivity
Explicit results for heaviside rate function
In order to illustrate the above analysis, we consider a particular example where the mean speed cϵ and diffusion coefficient D(ϵ) can be calculated explicitly. That is, set g(U) = g0U for the multiplicative noise term and take F(U) = H(u − κ). (The constant g0 has units of ). Note that the choice for g(U) can be interpreted physiologically in terms of an effective modification in the membrane time constant of neurons due to stochastic background synaptic activity (Bernander et al., 1991; Rapp et al., 1992; Bressloff, 1994). The deterministic Equation (38) for U0 then reduces to
where Γ(ϵ) = (1 − ϵ C(0)g20)/cϵ. Hence,
The deterministic pulse profile can be evaluated along identical lines to section “Neural Field Model of Direction Selectivity.” In order to calculate the diffusion coefficient, it is first necessary to determine the null vector of the adjoint linear operator . Substituting F(U) = H(U − κ) and g(U) = g0U into Equation (42) shows that
Substituting into Equation (47) shows that
Differentiating Equation (46) shows that U'(ξ) = b(ξ) − b(ξ − Δ), so that we obtain the vector equation
The matrix has rank 1, confirming that the linear operator has a 1D null-space. The latter is spanned by the function
In Figure 8 we show the temporal evolution of a freely propagating stochastic traveling pulse, which is obtained by numerically solving the Langevin Equation (31) for F(U) = H(U − κ), g(U) = U and the asymmetric difference-of-exponentials (Equation 4). Note that the location of the stochastic wave appears to coincide with the underlying mean solution. However, over longer time-scales the wandering of the pulse about its mean position would be seen. In Figure 9 we plot the mean position and variance σ2X(t) of the leading and trailing edges of the pulse as a function of t. It can be seen that they all vary linearly with t, consistent with the assumption that there is a diffusive-like displacement of the center-of-mass of the pulse from its uniformly translating position at long time-scales. The slopes of these curves then determine the effective wave speed and diffusion coefficient according to ~ cεt and σ2X(t)~ 2 D(ε) t. Both the leading and trailing edges exhibit the same speeds and diffusivities (after a transient phase). The transients are caused by fluctuations in the mean width of the pulse which can be neglected for large t, where the difference in the size of fluctuations of the leading and trailing edges can be neglected.
Figure 8. Numerical simulation of freely propagating pulse solution of the stochastic neural field Equation (31) for a Heaviside rate function F(U) = H(U − κ) with κ = 4, and weight function (Equation 4) with ae = 5, ai = 1, σe = 0.42, σi = 0.1, and x0 = 3. The multiplicative noise is taken to be g(U) = U, the noise strength is ϵ = 0.005, and C(0) = 10. The wave profile is shown at successive times (A) t = 0 (B) t = 12 (C) t = 18, and (D) t = 24, with the initial profile at t = 0 given byequation U0. In numerical simulations we take the discrete space and time steps Δx = 0.1, Δt = 0.01. The deterministic part U0 of the stochastic wave is shown by the black curves.
Figure 9. (A) Plot of mean position of leading (blue) and trailing (black) edges of pulse as a function of time t averaged over N = 4096 trials. (B) Corresponding plots of the variance σ2X(t). Same parameter values as Figure 8.
In order to find the mean location of the leading or trailing edge of the pulse as a function of time, we numerically carry out a large number of level set position measurements. That is, we determine the positions Xa(t) such that U(Xa(t), t) = a, for various level set values a and then define the mean location to be , where the expectation is first taken with respect to the sampled values a and then averaged over N trials. The corresponding variance is given by . In order to compare the numerical results with our theoretical analysis, we assume that Xa(t) = Δ(t) + cϵt +xa(0) for each a on either the leading or trailing edge. It then follows that = cϵt + xa(0) and σ2X(t) = 〈 Δ(t)2〉. In Figure 10 we plot the numerically estimated diffusion coefficient for various values of the threshold κ and compare these to the corresponding theoretical curves obtained using the above analysis. It can be seen that there is excellent agreement with our theoretical predictions. Finally, note that we can also use the level set data to estimate fluctuations in the width of the pulse. Suppose that Xd(t) and Yd(t) denote the threshold crossing points of the leading and trailing edges of the pulse at time t. Then the stochastic width of the pulse can be defined according to D(t) = Xd(t) − Yd(t). We find that after a transient phase, 〈 D(t)2〉 − 〈 D(t)〉 2 « σ2X(t).
Figure 10. Plot of diffusion coefficient D(ε) as a function of threshold κ. Numerical results (“+” for leading edge,“X” for trailing edge) are obtained by averaging over N = 4096 trials starting from the initial condition given by U0. Corresponding theoretical predictions (solid curves) for D(ε) are based on Equation (44). Other parameters as in Figure 8.
We now add a stimulus term I to the stochastic neural field Equation (33), that is
where the stimulus is again a rectangular wave of amplitude I0 and width d, moving with speed v. Here h and dR are defined by Equations (34) and (35). The stochastic activity variable is now decomposed according to Equation (37), with ξ = x − vt, and the modified deterministic equation
Through a similar process as in the previous section, we expand to (ϵ1/2) to obtain the inhomogeneous equation
where is defined as in Equation (40) but with cϵ → v. The solvability condition is now
This can be manipulated to give, to leading order, the Ornstein–Uhlenbeck equation (Gardiner, 2009):
Solving the stochastic differential equation in Equation (55) and taking averages shows that 〈Δ(t)〉 = Δ(0)e − At and
where D(ϵ) is given by Equation (44) except for a modified null vector . Thus the variance of Δ(t) approaches D(ϵ)/A in the large t limit.
As in the case of freely propagating pulses, we can explicitly solve for and thus calculate the diffusion coefficient D(ϵ) when F(U) = H(U − κ) and g(U) = U. Since the steps are similar to the previous case, we simply present our results here. In Figure 11 we show the temporal evolution of a single stimulus-locked front, which is obtained by numerically solving the Langevin Equation (51) for F(U) = H(U − κ), g(U) = U and the weight distribution (Equation 4). The external input is taken to be a square pulse of amplitude I0 = 5, width d = 5, and speed v = 5. Next we determine the mean and variance σ2X(t) of the position of the leading and trailing edges by averaging over level sets along identical lines to the freely-propagating case. The results are shown in Figure 12. It can be seen that, as predicted by the analysis, varies linearly with t with a slope equal to the stimulus speed v = 5. Moreover, the variance σ2X(t) approaches a constant value as t → ∞ for both the trailing and leading edges. Thus, we find that stimulus-locked pulses are much more robust to noise than freely propagating pulses, since the variance of the mean position of the leading and trailing edges saturate as t→ ∞. Consequently, stimulus locking persists in the presence of noise over most of the parameter range for which stimulus locking is predicted to occur. However, the trailing edge has an asymptotic variance that is at least an order of magnitude larger than the leading edge, which implies that fluctuations in the width of the pulse can no longer be neglected.
Figure 11. Numerical simulation showing the propagation of a stimulus-locked pulse solution of the stochastic neural field Equation (51). The external input is taken to be a square pulse with amplitude I0 = 5, width d = 5, and speed v = 5. All other parameters are as in Figure 8. The wave profile is shown at successive times (A) t = 0 (B) t = 6 (C) t = 12, and (D) t = 24, with the initial profile at t = 0 given by the solution U0. In numerical simulations we take the discrete space and time steps Δ x = 0.1,Δ t = 0.01.
Figure 12. (A) Plot of mean position of leading (blue) and trailing (black) edges of stimulus-locked pulse as a function of time t averaged over N = 1000 trials. (B,C) Corresponding plots of the variance σ2X(t) of the leading and trailing edges. Same parameter values as Figure 11.
In this paper we have explored the effects of extrinsic noise on propagating pulses in a one-dimensional scalar neural field with asymmetric weights. Such a network has previously been proposed as a continuum model of direction selectivity. We have shown that the effects of noise on the wandering of the mean front position depends on properties of the underlying deterministic pulse. In the case of a freely propagating pulse, we find diffusive wandering with the mean square displacement growing linearly with time t. Moreover, in the large time limit, fluctuations in the width of the pulse can be neglected. On the other hand, if the pulse is locked to a moving pulse-like stimulus, then the wandering is described by an Ornstein–Uhlenbeck process and the mean square displacement saturates in the long time limit. However, we find that fluctuations in the pulse width can no longer be ignored.
In summary, this paper further illustrates how methods developed for studying wave propagation in stochastic PDEs can be adapted to study wave propagation in stochastic neural fields. As we have previously found for fronts, stimulus-locked waves are more robust to noise, which is a desirable property of a network performing some form of stimulus-processing such as direction selectivity.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Armero, J., Casademunt, J., Ramirez-Piscina, L., and Sancho, J. M. (1998). Ballistic and diffusive corrections to front propagation in the presence of multiplicative noise. Phys. Rev. E 58, 5494–5500.
Bernander, O., Douglas, R. J., Martin, K. A. C., and Koch, C. (1991). Synaptic background activity influences spatiotemporal integration in single pyramidal cells. Proc. Natl. Acad. Sci. U.S.A. 88, 11569–11573.
Bressloff, P. C., Cowan, J. D., Golubitsky, M., Thomas, P. J., and Wiener, M. (2001). Geometric visual hallucinations, Euclidean symmetry and the functional architecture of striate cortex. Phil. Trans. R. Soc. Lond. B 356, 299–330.
Faugeras, O., Touboul, J., and Cessac, B. (2009). A constructive mean–field analysis of multi–population neural networks with random synaptic weights and stochastic inputs. Front. Compt. Neurosci. 3:1. doi: 10.3389/neuro.10.001.2009
Hutt, A., Longtin, A., and Schimansky-Geier, L. (2008). Additive noise-induces turing transitions in spatial systems with application to neural fields and the swift-hohenberg equation. Physica D 237, 755–773.
Reichardt, W. (1961). “Autocorrelation, a principle for the evaluation of sensory information by the central nervous system,” in Sensory Communication, ed A. Rosenblith (Cambridge, MA: MIT Press), 303–317.
Steyn-Ross, M. L., Steyn-Ross, D. A., Sleigh, J. W., and Whiting, D. R. (2003). Theoretical predictions for spatial covariance of the electroencephalographic signal during the anesthetic-induced phase transition: increased correlation length and emergence of spatial self-organization. Phys. Rev. E 68, 021902.
Keywords: stochastic processes, traveling waves, neural field theory, direction selectivity, stimulus-driven
Citation: Bressloff PC and Wilkerson J (2012) Traveling pulses in a stochastic neural field model of direction selectivity. Front. Comput. Neurosci. 6:90. doi: 10.3389/fncom.2012.00090
Received: 24 September 2012; Accepted: 10 October 2012;
Published online: 29 October 2012.
Edited by:Dimitris Pinotsis, University College London, UK
Copyright © 2012 Bressloff and Wilkerson. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: Paul C. Bressloff, Department of Mathematics, University of Utah, 155 South 1400 East, Salt Lake City, UT 84112, USA. e-mail: email@example.com