Cortical Variability and Challenges for Modeling Approaches
- 1Department of Computing and Informatics, Faculty of Science and Technology, Bournemouth University, Bournemouth, UK
- 2Bernstein Center for Computational Neuroscience, Medical Faculty Mannheim and Heidelberg University, Mannheim, Germany
The functional role of the observed neuronal variability (the disparity in neural responses across multiple instances of the same experiment) is again receiving close attention in Computational and Systems Neuroscience (e.g., Durstewitz et al., 2010; Moreno-Bote et al., 2011; Oram, 2011; Beck et al., 2012; Churchland and Abbott, 2012; Brunton et al., 2013; Masquelier, 2013; Mattia et al., 2013; Balaguer-Ballester et al., 2014; Renart and Machens, 2014; Bujan et al., 2015; Lin et al., 2015; Pachitariu et al., 2015; Arandia-Romero et al., 2016; Doiron et al., 2016; McDonnell et al., 2016). Special consideration is currently given to understanding how spiking (Bujan et al., 2015; Deneve and Machens, 2016; Doiron et al., 2016; Hartmann et al., 2016; Landau et al., 2016) and phenomenological (Goris et al., 2014; Lin et al., 2015; Mochol et al., 2015; Arandia-Romero et al., 2016; Doiron et al., 2016) models account for the wide range of classical and new phenomena associated with trial-to-trial uncorrelated activity.
Specifically, it has often been proposed that a network state characterized by largely asynchronous spike times whilst maintaining slow oscillations in the firing-rates, may represent the default spontaneous cortical mode (e.g., Sanchez-Vives and Mattia, 2014; Deneve and Machens, 2016; Sancristobal et al., 2016); and similar states could also underlie observed stimulus-driven variability in rate (Litwin-Kumar and Doiron, 2012; Deneve and Machens, 2016; Hartmann et al., 2016). However, the way in which such a computationally advantageous network state for neural coding is achieved can differ substantially between modeling approaches; this challenge will be the focus of this manuscript.
Predictable Components of Neuronal Variability
The view that the intrinsic stochasticity of single cell activity is the major source of variability has been questioned multiple times over the last decades by modeling (van Vreeswijk and Sompolinsky, 1996; Amit and Brunel, 1997; Shadlen and Newsome, 1998; Deneve et al., 2001; Stein et al., 2005; Faisal et al., 2008; Renart et al., 2010; Rabinovich and Varona, 2011; Masquelier, 2013; Stiefel et al., 2013; Rabinovich et al., 2014; Deneve and Machens, 2016; Hartmann et al., 2016) and empirical studies (e.g., Bryant and Segundo, 1976; Mainen and Sejnowski, 1995; Britten et al., 1996; Stein et al., 2005). It is well known that essentially deterministic networks of balanced excitation and inhibition are able to generate a weakly correlated, often chaotic attractor state which presents Poissonian statistical properties like the observed activity (van Vreeswijk and Sompolinsky, 1996; Amit and Brunel, 1997; Shadlen and Newsome, 1998; Sussillo and Abbott, 2009; Litwin-Kumar and Doiron, 2012). However, such a chaotic state is a non-mandatory modeling choice: recently, a range of models has shown that part of the observed variability may also be explained by a different class of deterministic processes (Beck et al., 2012; Mattia et al., 2013; Renart and Machens, 2014; Bujan et al., 2015; Abbott et al., 2016; Deneve and Machens, 2016; Doiron et al., 2016; Gillary and Niebur, 2016; Hartmann et al., 2016) such as the lack of specificity in top-down processing of cognitively complex tasks (Beck et al., 2012).
At the same time, empirical studies found mounting evidence of deterministic patterns for some of the trial to trial variability. For example, a range of indexes (Shadlen and Newsome, 1998; Churchland and Abbott, 2012; Marcos et al., 2013) suggest that variance is systematically reduced at the stimulus onset (Churchland et al., 2010); and in general shows a predictable trend during different events of the task (Churchland et al., 2006, 2010; Churchland and Abbott, 2012; Ledberg et al., 2012; Renart and Machens, 2014). Thus, there seems to be an increasing consensus in that at least part of the trial to trial variability shows a deterministic pattern which may play a functional role; and hence cannot be simply neglected (Balaguer-Ballester et al., 2011, 2014; Masquelier, 2013; Ecker et al., 2014; Goris et al., 2014; Renart and Machens, 2014; Lin et al., 2015; Schölvinck et al., 2015; Arandia-Romero et al., 2016; Hartmann et al., 2016).
Nevertheless, despite such recent advances, the mapping between the cognitive state and variability is still challenging. For instance, on the one hand, correlated rate variability between pairs of neurons is often reduced by top-down attentional processes (e.g., Cohen and Maunsell, 2009; Mitchell et al., 2009; Cohen and Kohn, 2011; Doiron et al., 2016). On the other hand, the opposite can be observed when attention is highly variable across trials (Roelfsema et al., 2004; Renart and Machens, 2014; Ruff and Cohen, 2014); and such noise correlation analyses show a variety of mixed results (Cohen and Kohn, 2011; Eyherabide and Samengo, 2013; Moreno-Bote et al., 2014; Ruff and Cohen, 2014, 2016; Doiron et al., 2016).
Importantly, compelling evidence suggests that a substantial portion of the spontaneous and evoked total and shared variability is attributable to global fluctuations (Ecker et al., 2014, 2016; Goris et al., 2014; Mochol et al., 2015; Pachitariu et al., 2015; Schölvinck et al., 2015; Arandia-Romero et al., 2016); and this has direct implications in neural coding in visual (Lin et al., 2015; Arandia-Romero et al., 2016; Ecker et al., 2016) and in auditory areas (Mochol et al., 2015; Pachitariu et al., 2015). For instance, high population activity in monkey V1 increases the information that a subset of neuronal ensembles carry about stimulus orientation, only the ones that show a strong multiplicative modulation. In contrast, the stimulus-decoding information of such multiplicative ensembles plummets for low global activity states; whilst information increases in the group additively-modulated neurons in the population (Arandia-Romero et al., 2016).
Global modulations could either stem from the default up/down state of ongoing activity (Mochol et al., 2015) or from fluctuations within a single state (Arandia-Romero et al., 2016). When controlled for this global co-modulations, noise correlations are often negligible (Renart et al., 2010), but not always (Pachitariu et al., 2015; Arandia-Romero et al., 2016). Moreover, stimulus-driven input statistics can also have a strong contribution to the observed evoked variability in parallel to the global network state (Oram, 2011; Bujan et al., 2015; Pachitariu et al., 2015; Doiron et al., 2016; Landau et al., 2016) and explain noise correlations dynamics (Bujan et al., 2015).
This complex variety of results has been recently analyzed using a range of phenomenological and spiking models. These recent modeling efforts aim to pin down when precisely during the course of the trial (Moreno-Bote et al., 2014; Bujan et al., 2015; Doiron et al., 2016) and in which specific network state (Arandia-Romero et al., 2016) noise correlations are informative or deleterious for neural coding (Ecker et al., 2014, 2016; Moreno-Bote et al., 2014; Lin et al., 2015; Pachitariu et al., 2015; Schölvinck et al., 2015; Arandia-Romero et al., 2016; Doiron et al., 2016).
Diversity of Theoretical Approaches
The consensus on the network origin of a substantial part of cortical variability led to the development of a multitude of models for explaining the underlying neuronal mechanisms of the asynchronous state (e.g., Boerlin et al., 2013; Deco et al., 2014; Ostojic, 2014; Barral and Reyes, 2016; Hartmann et al., 2016; Rosenbaum et al., 2017). A linking theme in these approaches is the crucial contribution of fast inhibition in recurrent networks; which is negatively correlated with excitation and strong enough to counterbalance it to different degrees (Renart et al., 2010; Deneve and Machens, 2016).
This scenario is currently the subject of a lively debate; and a variety of processing architectures of spiking units have been developed to explain the observed variability phenomena from different perspectives. It has recently been proposed that a much tighter synchronization between excitation and inhibition than considered so far, at the spike level, has an even stronger experimental support and would enable the network to operate optimally by reducing the minimum coding error (Renart et al., 2010; Boerlin et al., 2013; Abbott et al., 2016; Deneve and Machens, 2016). The precise way in which the asynchronous state is achieved however, is not unique. For example, connectivity weights are specifically learnt in the design termed spike-coding network (Boerlin et al., 2013; Schwemmer et al., 2015; Abbott et al., 2016; Deneve and Machens, 2016); whilst connectivity is clustered in Litwin-Kumar and Doiron (2012), shaped by plasticity in Vogels et al. (2011) and Landau et al. (2016) and much less structured in many other dense (Renart et al., 2010; Abbott et al., 2016) or sparse (Ostojic, 2014) networks.
In contrast, other recent approaches rely on non-closely balanced excitatory-inhibitory dynamics in networks of simplified units. For instance, Hartmann et al. (2016) proposed a fully deterministic approach to describe spontaneous and stimulus evoked variability; consisting of an architecture of schematic noise-free units. In this approach, excitatory connectivity is specifically set by plasticity and homeostasis; and is not necessarily balanced. In Deco et al. (2014), the spontaneous state also stems from not necessarily tightly balanced architectures, where elements are field equations derived from spiking units with background input noise. In this and related models, connectivity is also set; but in the latter case local inhibition is regulated by a different homeostatic control. In addition, it has been recently shown that most of the evoked variability could be accounted for by essentially feedforward architectures (Bujan et al., 2015; Doiron et al., 2016).
Asymmetry and slightly unbalanced configurations are also considered to promote the so called metastable state (Mattia et al., 2013; Tognoli and Kelso, 2014a,b; Deco and Kringelbach, 2016), in which high dimensional ensembles flexibly re-organize, synchronize and disengage, possibly by changing their role in a high-dimensional setting (Lapish et al., 2015; Fusi et al., 2016). Such state also exhibits advantageous computational properties (Hellyer et al., 2015; Deco and Kringelbach, 2016). In an instantiation of such ideas, essentially deterministic structures of simplified units generate itinerancy through robust transient states. These states enable the model to process cognitive entities without the compelling need for attractors (Rabinovich et al., 2008, 2014; Varona and Rabinovich, 2016). Moreover, combinations of attractor-based and transient-based computations could also underlie motor plans (Mattia et al., 2013). Other state-dependent computational ingredients such as neuromodulation could also play a major role in shaping the observed variability (Mattia et al., 2013; Lapish et al., 2015; Doiron et al., 2016).
Future Challenges for Models
This non-exhaustive summary of few recent examples suggests the availability of a plethora of recurrent and feedforward network models for understanding the source of variability during cognitive processing and in the resting state. These configurations often differ at least in the level of detail of the computational units, in the connectivity structure and in the degree of balance between excitation and inhibition (Figure 1).
Figure 1. Three dimensions in models of neuronal variability. The diamond shows an example of a spiking model with random connectivity and a tight Excitation/Inhibition (E/I) balance as in Renart et al., 2010; the circle represents a substantially different modeling choice such as in Hartmann et al., 2016. A range of modeling approaches typically fall between these two examples (triangles); such as semi-structured connectivity architectures which modulate the E/I balanced dynamics in realistic networks (Litwin-Kumar and Doiron, 2012; Landau et al., 2016).
This challenging scenario perhaps compels to the development of novel approaches for probing the networks in order to identify the suitable architecture or architectures for each specific cognitive process and cortical area. However, the question remains how to effectively dissect a recurrent network, beyond the linearization of the network dynamics, in order to investigate the components originating the asynchronous state (Sussillo, 2014). Recently, Doiron et al. (2016) proposed a framework to identify the physiological processes underlying decorrelation in feedforward circuits by analysing state-dependent correlations in different time windows. However, applying this approach is more problematic in recurrent circuits when coupling is not weak and is highly nonlinear; as is often the case in models.
Hence, inferring which level of detail and architecture are mostly probably responsible for the neuronal variability phenomena is perhaps one of the major challenges for the next years, which possibly requires the development of novel theoretical tools for scrutinizing network behavior.
The author conceived and wrote the manuscript.
This paper has been funded by Bournemouth University. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Conflict of Interest Statement
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author wants to thank very much the three reviewers for their valuable comments.
Amit, D. J., and Brunel, N. (1997). Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. Cereb. Cortex 7, 237–252. doi: 10.1093/cercor/7.3.237
Arandia-Romero, I., Tanabe, S., Drugowitsch, J., Kohn, A., and Moreno-Bote, R. (2016). Multiplicative and additive modulation of neuronal tuning with population activity affects encoded information. Neuron 89, 1305–1316. doi: 10.1016/j.neuron.2016.01.044
Balaguer-Ballester, E., Lapish, C., Seamans, J., and Durstewitz, D. (2011). Attracting dynamics of frontal cortex ensembles during memory guided decision making. PLoS Comput. Biol. 7:e1002057. doi: 10.1371/journal.pcbi.1002057
Beck, J., Ma, W. J., Pitkow, X., Latham, P. E., and Pouget, A. (2012). Not noisy, just wrong: the role of suboptimal inference in behavioral variability. Neuron 74, 33–39. doi: 10.1016/j.neuron.2012.03.016
Britten, K., Newsome, W., Shadlen, M., Celebrini, S., and Movshon, J. (1996). A relationship between behavioral choice and the visual responses of neurons in macaque mt. Vis. Neurosci. 13, 87–100. doi: 10.1017/S095252380000715X
Bujan, A. F., Aertsen, A., and Kumar, A. (2015). Role of input correlations in shaping the variability and noise correlations of evoked activity in the neocortex. J. Neurosci. 35, 8611–8625. doi: 10.1523/JNEUROSCI.4536-14.2015
Churchland, M. M., Yu, B. M., Cunningham, J. P., Sugrue, L. P., Cohen, M. R., Corrado, G. S., et al. (2010). Stimulus onset quenches neural variability: a widespread cortical phenomenon. Nat. Neurosci. 13, 369–378. doi: 10.1038/nn.2501
Churchland, M. M., Yu, B. M., Ryu, S. I., Santhanam, G., and Shenoy, K. V. (2006). Neural variability in premotor cortex provides a signature of motor preparation. J. Neurosci. 26, 3697–3712. doi: 10.1523/JNEUROSCI.3762-05.2006
Deco, G., and Kringelbach, M. L. (2016). Metastability and coherence: extending the communication through coherence hypothesis using a whole-brain computational perspective. Trends Neurosci. 39, 125–135. doi: 10.1016/j.tins.2016.01.001
Deco, G., Ponce-Alvarez, A., Hagmann, P., Romani, G. L., Mantini, D., and Corbetta, M. (2014). How local excitation–inhibition ratio impacts the whole brain dynamics. J. Neurosci. 34, 7886–7898. doi: 10.1523/JNEUROSCI.5068-13.2014
Durstewitz, D., Vittoz, N. M., Floresco, S. B., and Seamans, J. K. (2010). Abrupt transitions between prefrontal neural ensemble states accompany behavioral transitions during rule learning. Neuron 66, 438–448. doi: 10.1016/j.neuron.2010.03.029
Ecker, A., Berens, P., Cotton, R., Subramaniyan, M., Denfield, G., Cadwell, C., et al. (2014). State dependence of noise correlations in macaque primary visual cortex. Neuron 82, 235–248. doi: 10.1016/j.neuron.2014.02.006
Ecker, A. S., Denfield, G. H., Bethge, M., and Tolias, A. S. (2016). On the structure of neuronal population activity under fluctuations in attentional state. J. Neurosci. 36, 1775–1789. doi: 10.1523/JNEUROSCI.2044-15.2016
Hartmann, C., Lazar, A., Nessler, B., and Triesch, J. (2016). Where is the noise? key features of spontaneous activity and neural variability arise through learning in a deterministic network. PLoS Comput. Biol. 11:e1004640. doi: 10.1371/journal.pcbi.1004640
Hellyer, P. J., Scott, G., Shanahan, M., Sharp, D. J., and Leech, R. (2015). Cognitive flexibility through metastable neural dynamics is disrupted by damage to the structural connectome. J. Neurosci. 35, 9050–9063. doi: 10.1523/JNEUROSCI.4648-14.2015
Landau, I. D., Egger, R., Dercksen, V. J., Oberlaender, M., and Sompolinsky, H. (2016). The impact of structural heterogeneity on excitation-inhibition balance in cortical networks. Neuron 92, 1106–1121. doi: 10.1016/j.neuron.2016.10.027
Lapish, C. C., Balaguer-Ballester, E., Seamans, J. K., Phillips, A. G., and Durstewitz, D. (2015). Amphetamine exerts dose-dependent changes in prefrontal cortex attractor dynamics during working memory. J. Neurosci. 35, 10172–10187. doi: 10.1523/JNEUROSCI.2421-14.2015
Ledberg, A., Montagnini, A., Coppola, R., and Bressler, S. L. (2012). Reduced variability of ongoing and evoked cortical activity leads to improved behavioral performance. PLoS ONE 7:e43166. doi: 10.1371/journal.pone.0043166
Marcos, E., Pani, P., Brunamonti, E., Deco, G., Ferraina, S., and Verschure, P. (2013). Neural variability in premotor cortex is modulated by trial history and predicts behavioral performance. Neuron 78, 249–255. doi: 10.1016/j.neuron.2013.02.006
Mattia, M., Pani, P., Mirabella, G., Costa, S., Del Giudice, P., and Ferraina, S. (2013). Heterogeneous attractor cell assemblies for motor planning in premotor cortex. J. Neurosci. 33, 11155–11168. doi: 10.1523/JNEUROSCI.4664-12.2013
McDonnell, M. D., Goldwyn, J. H., and Lindner, B. (2016). Editorial: neuronal stochastic variability: influences on spiking dynamics and network activity. Front. Comput. Neurosci. 10:38. doi: 10.3389/fncom.2016.00038
Mochol, G., Hermoso-Mendizabal, A., Sakata, S., Harris, K. D., and de la Rocha, J. (2015). Stochastic transitions into silence cause noise correlations in cortical circuits. Proc. Natl. Acad. Sci. U.S.A. 112, 3529–3534. doi: 10.1073/pnas.1410509112
Roelfsema, P. R., Lamme, V. A., and Spekreijse, H. (2004). Synchrony and covariation of firing rates in the primary visual cortex during contour grouping. Nat. Neurosci. 7, 982–991. doi: 10.1038/nn1304
Sancristobal, B., Rebollo, B., Boada, P., Sanchez-Vives, M. V., and Garcia-Ojalvo, J. (2016). Collective stochastic coherence in recurrent neuronal networks. Nat. Phys. 12, 881–887. doi: 10.1038/nphys3739
Schölvinck, M. L., Saleem, A. B., Benucci, A., Harris, K. D., and Carandini, M. (2015). Cortical state determines global variability and correlations in visual cortex. J. Neurosci. 35, 170–178. doi: 10.1523/JNEUROSCI.4994-13.2015
Schwemmer, M. A., Fairhall, A. L., Deneve, S., and Shea-Brown, E. T. (2015). Constructing precisely computing networks with biophysical spiking neurons. J. Neurosci. 35, 10112–10134. doi: 10.1523/JNEUROSCI.4951-14.2015
Keywords: metastability, excitation-inhibition balance, cortical variability, neuronal variability, recurrent networks, trial to trial variability
Citation: Balaguer-Ballester E (2017) Cortical Variability and Challenges for Modeling Approaches. Front. Syst. Neurosci. 11:15. doi: 10.3389/fnsys.2017.00015
Received: 18 October 2016; Accepted: 06 March 2017;
Published: 04 April 2017.
Edited by:Gilad Silberberg, Karolinska Institutet, Sweden
Reviewed by:Maurizio Mattia, Istituto Superiore di Sanità, Italy
Arvind Kumar, Royal Institute of Technology, Sweden
Iñigo Arandia-Romero, Pompeu Fabra University, Spain
Copyright © 2017 Balaguer-Ballester. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Emili Balaguer-Ballester, email@example.com