Alternation of up and down states at a dynamical phase-transition of a neural network with spatiotemporal attractors

1. Introduction

Spontaneous cortical activity, i.e., ongoing activity in the absence of sensory stimulation, can show very complex collective features, with, in some cases, the membrane potential making spontaneous transitions between two different levels called up and down states (Steriade et al., 1993; Cowan and Wilson, 1994; Cossart et al., 2003; Shu et al., 2003). This alternation of “down states” of network quiescence and “up states” of generalized spiking and neuronal depolarization, have been observed to occur spontaneously in a variety of systems and conditions, both in vitro (Plenz and Kitai, 1998; Cossart et al., 2003; Shu et al., 2003) and in vivo during slow-wave sleep, anaesthesia and quiet waking (Petersen et al., 2003; Luczak et al., 2007) The precise mechanism by which these up states transitions occur is still unclear, but it seems to rely on network mechanisms (Cossart et al., 2003). Up states transitions are almost abolished by pharmacological blockers such as glutamate receptor antagonists (Cossart et al., 2003; Shu et al., 2003) and totally abolished by glutamate and GABA receptor antagonists (Cossart et al., 2003).

Results on in vitro and in vivo up states has suggested that this spontaneous activity occurred in a highly structured way, with repeating spatiotemporal patterns of cellular activity (Cossart et al., 2003; Luczak and MacLean, 2012). Because of their stereotyped spatio-temporal dynamics, it has been conjectured that network up states are circuit attractors (Cossart et al., 2003). Transitions between down and up states can also be evoked by sensory stimulation (Petersen et al., 2003), and interestingly evoked activity patterns are similar to the up states produced spontaneously (Luczak et al., 2007). Also in vitro, in thalamo-cortical slices, the patterns of activity evoked by thalamic stimulation were similar to the patterns of activity that occurred during the up states spontaneously (Luczak and MacLean, 2012).

Many experimental results, both in cell cultures and slices as well as in vivo (Gireesh and Plenz, 2008; Petermann et al., 2009; Ribeiro et al., 2010; Plenz, 2012; Haimovici et al., 2013), have also supported the idea that the brain operates near the critical point of a phase transition (Plenz and Thiagarajan, 2007; Chialvo, 2010; Plenz, 2012; Tagliazucchi et al., 2012; Yang et al., 2012; Plenz, 2013; Shew and Plenz, 2013). Neuronal avalanches, i.e., cascade of activity with power law distribution of size and durations (Beggs and Plenz, 2003; Mazzoni et al., 2007; Plenz and Thiagarajan, 2007; Pasquale et al., 2008; Plenz, 2012), are only one of the observed proprieties suggestive of criticality. Criticality is very advantageous for the brain, in terms of optimization of dynamical range, information transmission and capacity (large repertoire of diverse activity patterns) (Kinouchi and Copelli, 2006; Deco et al., 2013; Shew and Plenz, 2013).

All these intriguing results on spontaneous dynamics support the long-lasting hypothesis that brain can move in a landscape with multiple dynamical attractors, and that up states may be the result of the system falling in one of these attractors. From this point of view, the spontaneous fluctuations between up and down state may be the signature of the system posed at a non-equilibrium phase transition, where system fluctuates in the landscape, and flexibly switches from one state to another. Several models have been proposed as explanations for the avalanche power law distributions that emerge in spontaneous cortical activity (Kinouchi and Copelli, 2006; Levina et al., 2007; Plenz and Thiagarajan, 2007; de Arcangelis and Herrmann, 2010; Millman et al., 2010; Lombardi et al., 2012, in preparation; Yang et al., 2012; Scarpetta and de Candia, 2013), and many have discussed the emergence of up and down states in terms of attractor states of a dynamical systems (Holcman and Tsodyks, 2006; Parga and Abbott, 2007; Millman et al., 2010), or self-organized criticality (Lombardi et al., 2012, in preparation). To get bistability, in Parga and Abbott (2007) IF neurons were augmented with a non-linear membrane current, while in Holcman and Tsodyks (2006) and Millman et al. (2010) the crucial role of activity-dependent short-term synaptic depression was pointed out. For example in the attractor model discussed in Holcman and Tsodyks (2006) the mean time the network spends in the down state is comparable to the mean time it takes for the synapses to recover from a certain depressed activity.

In this paper, we study a model that captures not only the emergence of neural avalanches and up and down states, but also additional features of spontaneous activity, such as the stable recurrence of particular spatiotemporal patterns. In particular, recurrence of spatiotemporal patterns has been observed within up states (Luczak and MacLean, 2012, and refs therein), and also neuronal avalanches seem to be highly repeatable, and can be clustered into statistically significant families of activity patterns that satisfy several requirements of a memory substrate (Beggs and Plenz, 2004; Stewart and Plenz, 2006; Gireesh and Plenz, 2008). The model is a network of leaky integrate-and-fire (LIF) neurons, whose connections have synaptic strengths designed in order to store in the network a set of spatiotemporal patterns. The network shows two distinct regimes, a regime of collective replay activity for high connection strength or high noise, and a regime of no activity for low connection strength or low noise. Between these two distinct regimes, it appears a region where noise is able to switch between periods of quiescence (down states) and periods of high rate coherent activity (up states). At a finer temporal scale, within up states, one observes neural avalanches with power law size and duration distributions. In this model, fluctuations between up and down states emerge even in absence of short-term depression, or of any kind of single neuron bistability. It's a network effect, the results of a structured connectivity, that produce multiple dynamical attractors. Near the non-equilibrium phase-transition separating the two regimes in which the network remains permanently in either the up or the down state, one observes high fluctuations, induced by noise, with emergences of transient up states. The mean time the network spends in the down or in the up state is related to noise intensity and connection strength.

2. Material and Methods

2.1. The Model

We model the neurons as leaky integrate-and-fire (LIF) units. The postsynaptic membrane potential of neuron i, when the neuron does not emit a spike, is given by the equation

$\begin{array}{cc}\frac{d{V}_i(t)}{dt}=-\frac{V_i(t)}{{\tau }_m}+\frac{I_i(t)}{C},& (1)\end{array}$

where τ_m is the characteristic time of the membrane, C the membrane capacity, and I_i(t) the total current input to neuron i. The input is given by

$\begin{array}{cc}{I}_i(t)={\displaystyle \sum _j{\displaystyle \sum _{t_i<t_j<t}\frac{Q_{ij}}{{\tau }_s}}}{e}^{-(t-t_j)/{\tau }_s}+{\displaystyle \sum _{t_i<{\widehat{t}}_i<t}\frac{{\widehat{Q}}_i}{{\tau }_s}}{e}^{-(t-{\widehat{t}}_i)/{\tau }_s}& (2)\end{array}$

where t_j are the spike times of neuron j, Q_ij is the total charge released at the synapse between neuron i and j, τ_s is the characteristic time of the synapse, ${\widehat{t}}_i$ are the times of noise events releasing a random charge ${\widehat{Q}}_i$ at some point of the membrane of neuron i, and the sum is extended to the spikes t_j and noise events ${\widehat{t}}_i$ between the last spike t_i of neuron i, and the present time t. Defining J_ij = Q_ij/[C(1 − τ_s/τ_m)] and ${\widehat{J}}_i={\widehat{Q}}_i/[C(1-{\tau }_s/{\tau }_m)]$, we therefore have (Gerstner et al., 1993; Gerstner and Kistler, 2002)

$\begin{array}{cc}{V}_i(t)={\displaystyle \sum _j{\displaystyle \sum _{t_i<t_j<t}{J}_{ij}}}ϵ(t-t_j)+{\displaystyle \sum _{t_i<{\widehat{t}}_i<t}{\widehat{J}}_i}ϵ(t-{\widehat{t}}_i)& (3)\end{array}$

where ϵ(t) = e^−t/τ_m − e^−t/τ_s. When the potential V_i(t) reaches the threshold value Θ_i, the neuron i emits a spike, and its potential is reset to the base value V_i = 0. In the present paper we set the same threshold Θ_i ≡ Θ for all the neurons, τ_m = 10 ms, τ_s = 5 ms, we extract the times ${\widehat{t}}_i$ of noise events from a Poissonian distribution with a rate ρ = 1 ms⁻¹ for each neuron, and extract Ĵ_i from a Gaussian distribution with zero mean and standard deviation $\sqrt{\frac{\alpha }{\rho }{\displaystyle {\sum }_j{J}_{ij}^2}}$. The constant α, which has the dimension of a rate, sets the “noise level” of the network.

The synapse strengths J_ij are held fixed during the simulation (no short term plasticity). They are set at the beginning with a “learning procedure” (Scarpetta et al., 2001, 2002; Scarpetta and Marinaro, 2005; Scarpetta and Giacco, 2012; Scarpetta et al., 2013), inspired to spike time dependent plasticity (STDP) (Markram et al., 1997, 2011). During this initial “learning procedure,” we store P patterns in the network connections. A pattern μ = 1, …, P is a phase-coded spike train of period T^μ, with one spike per neuron and per cycle, where the activity of neuron i is given by

$\begin{array}{cc}{x}_i^{\mu }(t)={\displaystyle \sum _{n=-\infty }^{\infty }\delta }\left[t-(t_i^{\mu }+n{T}^{\mu })\right].& (4)\end{array}$

The times t^μ_i are given by $\left(\frac{{\varphi }_i^{\mu }}{2\pi }\right)T^{\mu }$, where ϕ^μ_i are phases chosen randomly in [0, 2π) and then kept fixed, that give the “order of spiking” of neurons within pattern μ. Therefore, during the initial learning procedure, the network is forced to replay pattern μ, and the connections evolve due to STDP, so that in the interval [−T, 0] the change in the connection J_ij is given by

$\begin{array}{cc}\begin{array}{l}\delta J_{ij}=H_i\left(\frac{T^{\mu }}{T}\right){\displaystyle \underset{-T}{\overset{0}{\int }}\text{}}\text{}dt{\displaystyle \underset{-T}{\overset{0}{\int }}\text{}}\text{}d{t}^{\prime }{x}_i(t)A\left(t-t^{\prime }\right)x_j\left(t^{\prime }\right)\\ =H_i{\displaystyle \sum _{n=-\infty }^{\infty }A}\left(t_j^{\mu }-t_i^{\mu }+n{T}^{\mu }\right).\end{array}& (5)\end{array}$

where H_i is a constant depending on the postsynaptic neuron i that sets the strength of the connections, $\frac{T^{\mu }}{T}$ is a normalization factor, x_j(t) is the activity of the presynaptic neuron at time t, and x_i(t) the activity of the postsynaptic one. In STDP, the learning window A(τ) is the measure of the strength of the synaptic change when a time delay τ occurs between pre and post-synaptic spikes. The window A(τ) is the one introduced and motivated by Abarbanel et al. (2002), with the same parameters used in Abarbanel et al. (2002) to fit the experimental data of Bi and Poo (1998), see Figure 1. This function satisfies the balance condition ∫^∞_−∞ A(τ) dτ = 0. Notably, when A(τ) is used in Equation (5) to learn phase-coded patterns with uniformly distributed phases, then the balance condition assures that the sum of the connections on the single neuron ∑_j J_ij is of order $1/\sqrt{N}$, and therefore, it assures a balance between excitation and inhibition (Scarpetta et al., 2010). Note that, as we are studying a network of excitatory neurons, the negative connections have to be thought as connections mediated by fast inhibitory interneurons. When multiple phase-coded patterns are stored, the learned connections are simply the sum of the contributions from individual patterns, namely,

$\begin{array}{cc}{J}_{ij}={\displaystyle \sum _{\mu =1}^P\delta }{J}_{ij}^{\mu }.& (6)\end{array}$

FIGURE 1

Figure 1. The kernel A(τ) used in Equation (5), given by A(τ) = a_p e^−τ/T_p − a_D e^{−η τ/T_p} if τ > 0 and A(τ) = a_p e^ητ/T_D − a_D e^τ/T_D if τ < 0, with a_p = [1 + ηT_p/T_D]⁻¹, a_D = [η + T_p/T_D]⁻¹, T_p = 10.2 ms, T_D = 28.6 ms, and η = 4.

Throughout the paper we use a number of neurons N = 3000, a period T^μ = 333 ms, and a number of patterns P = 2. Moreover we use two values for the strengths H_i of the connections in Equation (5). A value H₀ for “normal” neurons, and a value H₁ = 3H₀ for “leader neurons,” that are chosen for each pattern μ as a fraction of 3% of the neurons that have consecutive phases, for example the lowest phases in the interval [0, 2π). Note that the values of H₀ are expressed in units of the threshold Θ of the neurons. The role of these few “leader” neurons, with higher incoming connection strenghts, is that of collect and amplify activity initiated by noise, and give rise to a cue able to initiate the short collective replay.

After the learning procedure, we perform a pruning procedure, by which only a fraction of the N(N − 1) connections J_ij survives. Namely, for each neuron i, we take all the incoming connections J_ij, and separately consider the positive (excitatory), and the negative (inhibitory) ones. As for the positive ones, we delete a fixed fraction f⁺_prune of them that have the lowest value. Then, we delete a fraction f^−,i_prune, that can depend on the neuron i, of the negative connections that have the lowest (absolute) value, choosing f^−,i_prune so that the sum of the incoming connections to neuron i at the end is as close as possible to zero. Throughout the paper we use f⁺_prune = 70%. As a consequence, at the end of the pruning process, about 12% of the N(N − 1) connections survived as positive connections, and 27% as negative connections, with statistical fluctuations of order of $1/\sqrt{N}$. After the learning and pruning procedure is applied, the dynamics of the network is studied with the connections J_ij fixed, that is we do not apply STDP nor short term depression.

3. Results

We studied the dynamics of the network with N = 3000 neurons as a function of two parameters, the parameter H₀ setting the strengths of the connections, and the parameter α setting the noise level. The former is expressed in units of the threshold Θ of the neurons, while the latter has dimensions of ms⁻¹. We started with a network with all the potentials V_i(0) = 0, and let the system evolve subjected to Equation (1). We discarded the first 60 s of the dynamics, to avoid considering the transient, and analyzed the dynamics for a total of 10⁷ spikes, or 1200 s, whichever condition was met before¹. The simulated time was therefore between 180 and 1200 s, depending on the average spiking rate of the neurons. For each value of the pair of parameters H₀ and α, we average the results over four realizations of the patterns, that is of the quenched random phases ϕ^μ_i.

3.1. Spiking Rate Distribution and Dynamical Regimes

In Figure 2A we show the average spiking rate in Hz per neuron, as a function of the noise level α and the connection strengths H₀. While the average rate increases continuously as either of the parameters is increased, the distribution of the rates in a finite interval of time changes qualitatively. We bin the time in 1 ms intervals, evaluate the rate in Hz per neuron for every interval, and compute the distribution of the rates. For low connection strength, or low noise, the distribution is nearly exponential (see Figure 3A), with an average rate lower than 2 Hz. For high connection strength and high noise, the distribution is nearly Gaussian (see Figure 3C), with an average rate higher than 13 Hz. In an intermediate region the distribution is bimodal (see Figure 3B), and shows both peaks, one exponential at low rates, and one Gaussian at high rates with a minimum in the distribution. This three different regimes are shown in Figure 2B with different colors. The intermediate bimodal regime resembles the phase coexistence observed in a first order equilibrium phase-transition, even though in our case the transition is a non-equilibrium one.

FIGURE 2

Figure 2. (A) The average spiking rate in Hz per neuron, as a function of the noise level α and the connection strengths H₀. (B) Shape of the firing rate distribution: nearly exponential (yellow), nearly Gaussian (red), or bimodal (green). The letters on the plot mark the points whose rate distribution is shown in Figure 3, and whose activity is shown as a raster plot in Figure 4. As a function of the noise level α and the connection strengths H₀ we identify a region with bimodal rate distribution with alternation of up and down states (green), which separates the two distinct regimes of low nearly exponential firing rate (yellow) and the regime with nearly Gaussian high firing collective activity (red).

FIGURE 3

Figure 3. Distribution of the spiking rates on time intervals of 1 ms, for (A) H₀/Θ = 0.207, α = 0.04 ms⁻¹, (B) H₀/Θ = 0.221, α = 0.06 ms⁻¹, (C) H₀/Θ = 0.250, α = 0.08 ms⁻¹. These parameters correspond to the points marked with the letters A, B, and C in Figure 2B.

The qualitative difference in the distribution of the spiking rates, corresponds to a different dynamical behavior. At low rates, when the distribution is nearly exponential with a maximum at zero rate, the dynamical behavior is dominated by noise. The potential of neurons is governed by a Ornstein–Uhlenbeck process, and with some probability crosses the threshold giving rise to a spike, that is not able, however, to generate a spreading activity in the network (Figure 4A). On the other hand, in the high rate regime, the noise triggers the replay of one of the patterns encoded in the network (Figure 4C). In this case, once the replay of the pattern has started, the noise is not able to stop it, so that the replay is permanent². The intermediate regime, corresponding to a bimodal distribution of the rates, is shown in Figure 4B. In this case the noise is able to start the replay of a pattern, but also to stop it, so that the activity is intermittent, and resembles the experimentally observed alternation of up and down states. The firing rate is high in the “up” state (during short replays) and is low during “down” states, therefore the distribution of the rates is bimodal. The corresponding region, shown with green dots in Figure 2B, separates the regimes of permanent collective replay of spatiotemporal pattern (red) and the region of quiescence with low activity (yellow). Such non-equilibrium phase transition has been recently studied in a similar model (Scarpetta and de Candia, 2013, 2014) showing that in the region where the order parameter, which measures the similarity between spontaneous dynamics and the stored dynamic patterns, passes from zero to one, the fluctuations of the order parameter are maximized.

FIGURE 4

Figure 4. Raster plots for the same three set of parameters of Figure 3. The same identical spike train is shown two times, in the up and down panel, corresponding to two different sorting of the neurons on the vertical axis. The sorting order is done according to the order of pattern number 2 in the upper panels, while sorting is done with respect to pattern number 1 in the lower panel. Emergence of collective dynamics which replays one of the pattern appears in the raster plot like a sawtooth, if the neurons are sorted on the vertical axes in the order to the same pattern that is being replayed. Low rate activity is shown in (A), corresponding to the nearly exponential rate distribution shown in Figure 3A. Alternation of states of quiescence with states of higher activity is shown in (B), corresponding to Figure 3B. During the states of higher activity a collective coherent replay of one of the two stored patterns emerges. In this regime the noise is able to initiate a short collective replay of a pattern, and also to stop it. In the picture (B) we can see that both patterns are initiated intermittently, a short replay of pattern 2 is followed by a quiescence period and then by a short pattern 1 replay. Raster plot in picture (C) shows a regime with stable attractors, with permanent replay of pattern 2.

Note that the replay of a pattern appears in the raster plot of Figure 4 as a sawtooth, when the neurons are sorted on the vertical axes in the order of the pattern that is being replayed. On the other hand, it appears as completely random when the neurons are sorted in another way, for example in the order of a pattern that is not being replayed. The alternation of states seen in the raster plot in the bimodal region (Figure 4B) resembles the alternation of up and down states observed to occur spontaneously. Notably, as reviewed in Luczak and MacLean (2012), there are experimental evidences that during the up states often neurons activate in a surprisingly similar sequential order, reproducing default spatiotemporal patterns.

3.2. Avalanches Size and Time Distribution

In the intermediate regime, where the network alternates between up and down states, we observe that inside the periods of high firing rate (up states), at a finer level, the activity is made of a series of cascades or “avalanches,” separated by short drops in the rate. Cortical activity cascades that follow precise power laws, i.e., neural avalanches, have been observed experimentally during spontaneous cortical activity in vitro and in vivo (Plenz, 2012, and references therein).

Experimentally neural avalanches are defined in terms of local field potential recorded at electrodes, that average the activity of many neurons. In our model, we have to distinguish between the few spikes generated by noise, that we want to characterize as no activity, and the spikes generated when a collective pattern is replayed, that represent instead an activity in the network. Due to the separation we have seen on the global spiking rates, with rates lower than 2 Hz corresponding to no activity, and rates larger than 13 Hz representing the collective replay of a pattern, we identify “avalanches” as consecutive time bins with a rate higher than a threshold R_min = 7 Hz. Successive time bins are concatenated until an empty bin (rate lower then R_min) is reached, at which the concatenation process stops.

We define the size of an avalanche as the total number of spikes, that is the integral of the rates over the avalanche duration. In Figure 5 we show the distribution of the sizes (A) and durations (C) of the avalanches for H₀/Θ = 0.221, α = 0.06, that corresponds to point B in Figure 2B. Note that the distributions are well described by power laws, with exponent 3/2 for the sizes and 2 for the durations, as experimentally observed (Plenz, 2012). Such a behavior is quite robust, and is observed generically in the region of the non-equilibrium transition between the replay and non-replay of spatiotemporal patterns (Scarpetta and de Candia, 2013). It does not depend on the precise value of the R_min chosen. Indeed, as shown in Figure 5B, the size distribution follows approximately the same power law in a range of R_min from R_min = 5 Hz to R_min = 9 Hz.

FIGURE 5

Figure 5. The size (A) and duration (C) distribution of the avalanches for H₀ = 0.221, α = 0.06, point B in Figure 2B. In (B) we show the dependence of the size distribution on the threshold rate R_min.

3.3. Waiting Times Between Avalanches and Up and Down States

We have computed the distribution P(Δt) of the waiting times between successive avalanches. In Figure 6A we show the distribution for synaptic strength H₀/Θ = 0.214, 0.221, and 0.228, and noise α = 0.06 ms⁻¹, in the region where the rate distribution is bimodal. The middle (red) curve at H₀/Θ = 0.221 corresponds to point B in Figure 2B. The distribution presents a regime between 10 and 50 ms characterized by a power law with exponent −3, preceded by a regime with a lower slope. For times larger than 50 ms, the distribution shows a broad plateau, that is longer the lower the noise, or the strength of the connections.

FIGURE 6

Figure 6. (A) Waiting time distribution P(Δt) between avalanches, for H₀/Θ = 0.214, 0.221, and 0.228, and α = 0.06 ms⁻¹, that is for parameters where the rate distribution is bimodal. The middle curve (red) for H₀/Θ = 0.221 corresponds to point B in Figure 2B, while the green and blue curves to points next to point B to the right and to the left. (B) Same data of (A), with a different definition of the probability distribution P(Δt) (see text).

A power law regime in the waiting times between avalanches has been observed also experimentally, for example in freely behaving rats (Ribeiro et al., 2010), or in cortical slices (Lombardi et al., 2012, in preparation). The second regime, corresponding to large waiting times, is also observed in Lombardi et al. (2012, in preparation).

The power law regime corresponds to waiting times between successive avalanches within the same up state. The power law in the distribution indicates temporal correlation, i.e., that consecutive avalanches belonging to the same up state are correlated. Indeed in our model the up state is the result of the system falling in one of the many metastable spatiotemporal pattern attractors, corresponding to a collective replay activity. The large bump at long times in the waiting time distribution is related on the other hand to down states, that is intervals in which the network does not replay any of the encoded patterns.

We have plotted data of Figure 6A also in an alternative way. While P(Δt)δt is the probability of observing a waiting time between Δt and Δt + δt, in Figure 6B we plot P(Δt), where P(Δt)δλ is the probability of observing a waiting time between Δt and Δt(1 + δλ). Note that P(Δt) = P(Δt)Δt. With this alternative definition, the distribution becomes non-monotonic, with a pronounced maximum at high values of Δt, and the exponent of the initial power law becomes −2.

In Figure 7 we show the distribution P(Δt) in the region of high activity, marked in red in Figure 2B. In this case the replay of the pattern becomes continuous, and therefore the plateau at long times, in the distribution of waiting times, disappears. The distribution therefore shows only the power law regime, as shown in Figure 7, corresponding to the point in phase space marked with letter C in Figure 2B. On the other hand, in the region of low activity, marked in yellow in Figure 2B, avalanches become very sparse, so that the distribution of waiting times is different from zero only for very long times, and in this case the initial power law regime disappears.

FIGURE 7

Figure 7. The distribution of waiting times P(Δt) in the region of high activity, for H₀/Θ = 0.250, α = 0.08 ms⁻¹ (point C in Figure 2B). In this case the plateau at high values of the waiting time, corresponding to down states, disappears, because the replay of the patterns becomes continuous, and only the power law, corresponding to the concatenation of correlated avalanches inside an up state, is observed.

As in Lombardi et al. (2012), we define the up states as periods of high activity characterized by the concatenation of consecutive avalanches with waiting times lower than T_max = 50 ms, the maximum time falling inside the power law regime of waiting times. Successive avalanches are concatenated until a waiting time larger than T_max is reached, at which the concatenation process stops. Similarly, down states are defined as a concatenation of waiting times larger than T_max. An isolated avalanche preceded and followed by a waiting time larger than T_max does not stop the down state.

In Figure 8 we show the distribution of the durations of down and up states, for the same parameters of Figure 6. The distribution of durations of down states (Figure 8A) is well fitted by an exponential (continuous lines in the figure), showing that the transition from down to up states is controlled by a Poissonian probability, due to the noise focusing that triggers a replay of one of the patterns encoded in the network. On the other hand, the distribution of durations of up states cannot be fitted by an exponential as well as the one of down states, except for a narrow interval at large times. Indeed, one observes an excess of durations around 100 ms, that corresponds in the model to the duration of one period of the replayed pattern. Moreover, when one approaches the region of parameter space where the replay of the patterns becomes continuous, the distributions show significant deviations from the exponential also for large times, and could be better fitted by a stretched exponential. This is apparent going from blue to red and green curves in Figure 8B, that are all in the bimodal region, but get closer and closer to the region of self-sustained replay. Note that, when one goes deep inside the region of self-sustained replay, no down states are observed in practice, and up states last for a time of the order of the experimental time.

FIGURE 8

Figure 8. Distribution of the durations of down (A) and up (B) states, for the same parameters of Figure 6. Continuous lines are exponential fits to the distributions. Durations of down states are well fitted by an exponential, while durations of up states show some deviations both at short and at large times.

3.4. Behavior in Presence of Short Term Depression

It has been conjectured that the alternation between up and down states depends crucially on the short term synaptic depression (STSD). As we have shown, in our model this instability between up and down states is present even in absence of short term depression, and is due instead to the particular structure of connections, that are far from being random. Such structure determines in the network a large transition region of phase space, where there is a co-presence of both dynamical attractor states, corresponding to the replay of the patterns encoded, and the attractor corresponding to quiescence of the network.

However, as short term depression is present in real synapses in the brain, we show here that it does not invalidate the behavior displayed by the model considered here, but changes only the parameters, such as the strength of connections, where the transition region appears. We have added STSD in the model, implementing a dynamics on the connections J_ij according to the equation

$\frac{d{J}_{ij}}{dt}=\frac{1}{{\tau }_r}(J_{ij}^0-J_{ij}),$

where J⁰_ij are the connections given by Equation (6), and τ_r = 10 ms is the recovery time of synapses. Moreover, we depress J_ij by a factor f_stsd = 0.5, every time the presynaptic neuron j fires a spike.

In Figure 9A, we show the distribution of the rates, evaluated as in Figure 3, in absence of STSD for H₀/Θ = 0.221 (point B in Figure 2), and in presence of STSD for H₀/Θ = 0.221 and 0.231. Note that, for the same synaptic strength at rest, the effect of STSD is to lower the fraction of time in which the network is in the up state. However, for a slightly higher H₀/Θ, the distribution is very similar to the one without STSD. In Figure 9B, we show the raster plot in the case of H₀/Θ = 0.231 and τ_r = 10 ms, showing a behavior very similar to the one displayed in Figure 4B, with the alternation of up and down states, and of different patterns replayed in the up states. Therefore, the effect of STSD is to slightly shift the region of the phase space in which the transition is observed.

FIGURE 9

Figure 9. (A) Distribution of the rates, evaluated as in Figure 3, in absence of STSD for H₀/Θ = 0.221 (point B in Figure 2), and in presence of STSD for H₀/Θ = 0.221 and 0.231. (B) Raster plot of the network with STSD, in the case of H₀/Θ = 0.231 and τ_r = 10 ms. Alternation of up and down states is similar to the case of Figure 4B.

4. Discussion

Our model is the first, to our knowledge, that describe both neural avalanches, recurrences of spatiotemporal patterns, and alternation of up and down states, in a single minimal model.

Differently from our previous work (Scarpetta and de Candia, 2013) here we study a sparse connectivity, which is a results of a competitive pruning process applied after the learning procedure. Moreover while we previously introduced heterogeneity in the network topology using neurons with different spiking thresholds, here we show that avalanches initiation may be initiated by the interplay between miniatures noise and the heterogeneity in the strengths of connections, in agreement with recent experimental results (Orlandi et al., 2013).

The model shows a region of low activity, with Poissonian spiking rate, and a region of high activity, characterized by the continuous replay of one of the multiple attractors stored in the network connections, depending on the value of synaptic strength and noise intensity. In the region of phase space separating these two regimes, one observes an alternation of periods of quiescence (down states) and periods of high correlated activity (up states), corresponding to an intermittent replay of the patterns. At a finer temporal scale, up states are made of a sequence of avalanches, showing power law distribution of sizes and durations. In this model the alternation of up and down states does not depend on a kind on neuron bistability, nor on synaptic depression, but is rather a network effect, the result of a structured connectivity, that produces multiple dynamical attractors, and of the fact that at the non-equilibrium phase transition the network dynamics fluctuates between different metastable basins of attraction.

Therefore, such complex dynamics appears at a dynamical transition between disordered Poissonian activity, and an ordered permanent dynamical state. In such region, the network is able to respond to external inputs in a flexible way, switching effectively between different modes of operation, corresponding to the different basins of attraction, that may be connected to functionally relevant behavior.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Footnotes

1. ^This is the time appearing in Equation (1), not the CPU time needed to perform the simulations, that ranged between 1 and 5 h.

2. ^Note that, once the replay of the pattern has started, it is able to sustain itself, provided the synaptic strengths are larger than some threshold (Scarpetta et al., 2010; Scarpetta and Giacco, 2012), so that with a suitable triggering it is possible to observe the continuous replay of the pattern down to α = 0.

References

Abarbanel, H., Huerta, R., and Rabinovich, M. I. (2002). Dynamical model of long-term synaptic plasticity. PNAS 99, 10132–10137. doi: 10.1073/pnas.132651299

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Beggs, J., and Plenz, D. (2003). Neuronal avalanches in neocortical circuits. J. Neurosci. 23, 11167–11177. Available online at: http://www.jneurosci.org/content/23/35/11167.full

Pubmed Abstract | Pubmed Full Text

Beggs, J. M., and Plenz, D. (2004). Neuronal avalanches are diverse and precise activity patterns that are stable for many hours in cortical slice cultures. J. Neurosci. 24, 5216–5229. doi: 10.1523/JNEUROSCI.0540-04.2004

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Bi, G. Q., and Poo, M. M. (1998). Precise spike timing determines the direction and extent of synaptic modifications in cultured hippocampal neurons. J. Neurosci. 18, 10464–10472.

Pubmed Abstract | Pubmed Full Text

Chialvo, D. (2010). Emergent complex neural dynamics. Nat. Phys. 6, 744–750. doi: 10.1038/nphys1803

CrossRef Full Text

Cossart, R., Aronov, D., and Yuste, R. (2003). Attractor dynamics of network UP states in the neocortex. Nature 423, 283–288. doi: 10.1038/nature01614

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Cowan, R. L., and Wilson, C. J. (1994). Spontaneous firing patterns and axonal projections of single corticostriatal neurons in the rat medial agranular cortex. J. Neurophysiol. 71, 17–32.

Pubmed Abstract | Pubmed Full Text

de Arcangelis, L., and Herrmann, H. J. (2010). Learning as a phenomenon occurring in a critical state. PNAS 107, 3977–3981. doi: 10.1073/pnas.0912289107

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Deco, G., Jirsa, V. K., and McIntosh, A. R. (2013). Resting brains never rest: computational insights into potential cognitive architectures. Trends Neurosci. 36, 268–274. doi: 10.1016/j.tins.2013.03.001

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Gerstner, W., and Kistler, W. (2002). Spiking Neuron Models: Single Neurons, Populations, Plasticity. Cambridge, MA: Cambridge University Press. doi: 10.1017/CBO9780511815706

CrossRef Full Text

Gerstner, W., Ritz, R., and van Hemmen, J. L. (1993). Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns. Biol. Cybern. 69, 503–515. doi: 10.1007/BF00199450

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Gireesh, E. D., and Plenz, D. (2008). Neuronal avalanches organize as nested theta and beta/gamma-oscillations during development of cortical layer 2/3. Proc. Natl. Acad. Sci. U.S.A. 105, 7576–7581. doi: 10.1073/pnas.0800537105

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Haimovici, A., Tagliazucchi, E., Balenzuela, P., and Chialvo, D. R. (2013). Brain organization into resting state networks emerges at criticality on a model of the human connectome. PRL 110, p178101. doi: 10.1103/PhysRevLett.110.178101

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Holcman, D., and Tsodyks, M. (2006). The emergence of up and down states in cortical networks. PLoS Comput. Biol. 2:e23. doi: 10.1371/journal.pcbi.0020023

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Kim and Jeong (2013). The roles of short-term plasticity and synaptic weights in self-organized criticality. BMC Neurosci. 14:P192. doi: 10.1186/1471-2202-14-S1-P192. Available online at: http://www.biomedcentral.com/1471-2202/14/S1/P192

CrossRef Full Text

Kinouchi, O., and Copelli, M. (2006). Optimal dynamical range of excitable networks at criticality. Nat. Phys. 2, 348–352. doi: 10.1038/nphys289

CrossRef Full Text

Levina, A., Herrmann, J. M., and Geisel, T. (2007). Dynamical synapses causing self-organized criticality in neural networks. Nat. Phys. 3, 857–860. doi: 10.1038/nphys758

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Lombardi, F., Herrmann, H. J., Perrone-Capano, C., Plenz, D., and de Arcangelis, L. (2012). Balance between excitation and inhibition controls the temporal organization of neuronal avalanches. PRL 108, 228703. doi: 10.1103/PhysRevLett.108.228703

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Luczak, A., Barthó, P., Marguet, S. L., Buzsáki, G., and Harris, K. D. (2007). Sequential structure of neocortical spontaneous activity in vivo. PNAS 104, 347–352. doi: 10.1073/pnas.0605643104

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Luczak, A., and MacLean, J. N. (2012). Default activity patterns at the neocortical microcircuit level. Front. Integr. Neurosci. 6:30. doi: 10.3389/fnint.2012.00030

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Markram, H., Lubke, J., Frotsher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213–215. doi: 10.1126/science.275.5297.213

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Markram, H., Gerstner, W., and Sjostrom, P. J. (2011). A history of spike-timing-dependent plasticity. Front. Synaptic Neurosci. 3:4. doi: 10.3389/fnsyn.2011.00004

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Mazzoni, A., Broccard, F. D., Garcia-Perez, E., Bonifazi, P., Ruaro, M. E., and Torre, V. (2007). On the dynamics of the spontaneous activity in neuronal networks. PLoS ONE 2:e439. doi: 10.1371/journal.pone.0000439

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Millman, D., Mihalas, S., Kirkwood, A., and Niebur, E. (2010). Self-organized criticality occurs in non-conservative neuronal networks during up states. Nat. Phys. 10, 801–805. doi: 10.1038/nphys1757

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Orlandi, J. G., Soriano, J., Alvarez-Lacalle, E., Teller, S., and Casademunt, J. (2013). Noise focusing and the emergence of coherent activity in neuronal cultures. Nat. Phys. 9, 582–590. doi: 10.1038/nphys2686

CrossRef Full Text

Parga, N., and Abbott, L. (2007). Network model of spontaneous activity exhibiting synchronous transitions between up and down states. Front. Neurosci. 1, 57–66. doi: 10.3389/neuro.01.1.1.004.2007

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Pasquale, V., Massobrio, P., Bologna, L. L., Chiappalone, M., and Martinoia, S. (2008). Self-organization and neuronal avalanches in networks of dissociated cortical neurons. Neuroscience 153, 1354–1369. doi: 10.1016/j.neuroscience.2008.03.050

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Petermann, T., Thiagarajan, T. C., Lebedev, M. A., Nicolelis, M. A. L., Chialvo, D. R., and Plenz, D. (2009). Spontaneous cortical activity in awake monkeys composed of neuronal avalanches. Proc. Natl. Acad. Sci. U.S.A. 106, 15921–15926. doi: 10.1073/pnas.0904089106

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Petersen, C., Hahn, T., Mehta, M., Grinvald, A., and Sakmann, B. (2003). Interaction of sensory responses with spontaneous depolarization in layer 2/3 barrel cortex. PNAS 100, 13638–13643. doi: 10.1073/pnas.2235811100

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Plenz, D. (2012). Neuronal avalanches and coherence potentials. Eur. Phys. J. Special Topics 205, 259–301. doi: 10.1140/epjst/e2012-01575-5

CrossRef Full Text

Plenz, D. (2013). The critical brain. Physics 6, 47. doi: 10.1103/Physics.6.47

CrossRef Full Text

Plenz, D., and Kitai, S. T. (1998). Up and down states in striatal medium spiny neurons simultaneously recorded with spontaneous activity in fast-spiking interneurons studied in cortex-striatum-substantia nigra organotypic cultures. J. Neurosci. 18, 266–283.

Pubmed Abstract | Pubmed Full Text

Plenz, D., and Thiagarajan, T. (2007). The organizing principles of neuronal avalanches: cell assemblies in the cortex? Trends Neurosci. 30, 101–110. doi: 10.1016/j.tins.2007.01.005

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Ribeiro, T. L., Copelli, M., Caixeta, F., Belchior, H., Chialvo, D. R., Nicolelis, M. A. L., et al. (2010). Spike avalanches exhibit universal dynamics across the sleep-wake cycle. PLoS ONE 5:e14129. doi: 10.1371/journal.pone.0014129

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Scarpetta, S., and de Candia, A. (2013). Neural avalanches at the critical point between replay and non-replay of spatiotemporal patterns. PLoS ONE 8:e64162. doi: 10.1371/journal.pone.0064162

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Scarpetta, S., and de Candia, A. (2014). “Effects of pruning on phase-coding and storage capacity of a spiking network,” in Recent Advances of Neural Network Models and Applications, eds S. Bassis, A. Esposito, and F. C. Morabito (Switzerland: Springer), 125–131. doi: 10.1007/978-3-319-04129-2_13

CrossRef Full Text

Scarpetta, S., and Giacco, F. (2012). Associative memory of phase-coded spatiotemporal patterns in leaky integrate and fire network. J. Comput. Neurosci. 34, 319–336. doi: 10.1007/s10827-012-0423-7

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Scarpetta, S., and Marinaro, M. (2005). A learning rule for place fields in a cortical model: theta phase precession is a network effect. Hippocampus 15, 979–989. doi: 10.1002/hipo.20124

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Scarpetta, S., Zhaoping, L., and Hertz, J. (2001). Spike-timing-dependent learning for oscillatory networks. Adv. Neural Inform. Process. Syst. 13, 152–158. Available online at: http://papers.nips.cc/paper/1828-spike-timing-dependent-learning-for-oscillatory-networks

Scarpetta, S., Zhaoping, L., and Hertz, J. (2002). Hebbian imprinting and retrieval in oscillatory neural networks. Neural Comput. 14, 2371–2396. doi: 10.1162/08997660260293265

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Scarpetta, S., de Candia, A., and Giacco, F. (2010). Storage of phase-coded patterns via STDP in fully-connected and sparse network: a study of the network capacity. Front. Synaptic Neurosci. 2:32. doi: 10.3389/fnsyn.2010.00032

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Scarpetta, S., Giacco, F., Lombardi, F., and de Candia, A. (2013). Effects of poisson noise in a IF model with STDP and spontaneous replay of periodic spatiotemporal patterns, in absence of cue stimulation. Biosystems 112, 258–264. doi: 10.1016/j.biosystems.2013.03.017

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Shew, W. L., and Plenz, D. (2013). The functional benefits of criticality in the cortex. Neuroscientist 19, 88–100. doi: 10.1177/1073858412445487

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Shu, Y., Hasenstaub, A., and McCormick, D. A. (2003). Turning on and off recurrent balanced cortical activity. Nature 423, 288–293. doi: 10.1038/nature01616

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Steriade, M., Nunez, A., and Amzica, F. (1993). Intracellular analysis of relations between the slow (1 Hz) neocortical oscillation and other sleep rhythms of the electroencephalogram. J. Neurosci. 13, 3266–3283.

Pubmed Abstract | Pubmed Full Text

Stewart, C. V., and Plenz, D. (2006). Inverted-u profile of dopamine-nmda-mediated spontaneous avalanche recurrence in superficial layers of rat prefrontal cortex. J. Neurosci. 26, 8148–8159. doi: 10.1523/JNEUROSCI.0723-06.2006

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Tagliazucchi, E., Balenzuela, P., Fraiman, D., and Chialvo, D. (2012). Criticality in large-scale brain fMRI dynamics unveiled by a novel point process analysis. Front. Physiol. 3:15. doi: 10.3389/fphys.2012.00015

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text

Yang, H., Shew, W. L., Roy, R., and Plenz, D. (2012). Maximal variability of phase synchrony in cortical networks with neuronal avalanches. J. Neurosci. 32, 1061–1072. doi: 10.1523/JNEUROSCI.2771-11.2012

Pubmed Abstract | Pubmed Full Text | CrossRef Full Text