Spike-timing-dependent plasticity: a comprehensive overview
- 1Brain Mind Institute Life Science, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
- 2Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland
- 3Department of Neurology and Neurosurgery, Centre for Research in Neuroscience, The Research Institute of the McGill University Health Centre, Montreal, QC, Canada
Why Timing Matters
A neuron embedded in a neuronal network is bombarded with thousands of inputs every minute. But which ones are important? Which information should the neuron listen to and pass along to downstream neurons?
During brain development and during learning, this is a formidable problem that the vast majority of neurons in the brain have to solve – how to correctly choose and fine-tune the inputs from one’s neighbors without any other information than that which is received from these neighbors themselves. Some of these neighbors provide good information while others do not. Who to trust? How can you determine who to pay attention to?
Many decades ago, the Canadian neuropsychologist Hebb (1949), the Polish neurophysiologist Konorski (1948), as well as the Spanish anatomist Ramón y Cajal (1894) all had similar ideas that could potentially help explain how neurons wire up. The basic idea was essentially that – in the words of the present-day neuroscientist Shatz (1992) – “cells that fire together, wire together.” In other words, if things keep happening more or less simultaneously, you may assume that there is a common cause for the firing. More importantly, if one of the cell is active systematically just slightly before another, the firing of the first one might have a causal link to the firing of the second one and this causal link could be remembered by increasing the wiring of connections, a notion we call synaptic plasticity. In short, timing matters because it may indicate causality.
Even though Hebb did propose an ordering of firing in his “phase sequences” (Hebb, 1949), the view that coincident activity in connected neurons is what matters in plasticity practically dominated modern neuroscience research well into the mid 1990s. Although some few studies had indeed been carried out prior to this (e.g., Levy and Steward, 1983), neuroscientists typically did not consider the precise timing of inputs in their synaptic plasticity experiments. But this changed rapidly when a flurry of studies were published in the mid 1990s. Theoreticians realized just how important temporal order was for conveying and storing information in neuronal circuits, and to hook them up correctly. And experimenters realized that they had almost completely ignored this one factor – time – in their experiments, while they at the same time saw how the synaptic connections of the brain had mechanisms in place that clearly should make them acutely sensitive to timing. Thus the field of Spike-Timing-Dependent Plasticity – or STDP – was born, via the first key studies of Henry Markram (Markram and Sakmann, 1995; Markram et al., 1997) and Gerstner et al. (1996).
With STDP, a neuron embedded in a neuronal network can determine which neighboring neurons are worth listening to by potentiating those inputs that predict its own spiking activity. However, the neuron in question pays less attention to those neighboring neurons that fail to do this. In other words, the neuron pays less attention to neighbors speaking gibberish. The net result is that our sample neuron can integrate inputs with predictive power and transform this is into a meaningful predictive output, even though the meaning itself is not strictly known by the neuron. In STDP we thus have a very simple and elegant algorithm for appropriately hooking up neurons in the brain. Little wonder that there has been so much excitement surrounding the discovery of STDP.
The STDP Research Topic: A Brief Introduction
This Frontiers Research Topic eBook has been divided into eight sections, of which six contain reviews and two comprise original research articles. The first section is called The Conceptual Development of STDP, and deals with the history leading up to the discovery of STDP. Markram et al. (2011) outlines the history of timing in plasticity, beginning with Aristotle some 2000 years ago. Sjöström and Gerstner (2010) next define and briefly outline the STDP concept. Because the history of anything is necessarily subjective, this section also includes personal accounts, published as Opinion pieces. Contributors include the Nobel prize winner Cooper (2010), who famously helped outline the Bienenstock–Cooper–Munro theory of metaplasticity (Bienenstock et al., 1982); the electrophysiologist Levy (2010), who arguably carried out some of the very first timing-dependence experiments in plasticity (Levy and Steward, 1983); and the theoretician Gerstner (2010), who in a theoretical study (Gerstner et al., 1996) independently predicted and anticipated Henry Markram’s report of STDP (Markram and Sakmann, 1995; Markram et al., 1997).
In the second section, The Biological Relevance of STDP is discussed. Lisman and Spruston (2010) are first out and argue that STDP is limited plasticity paradigm that cannot unify the field of plasticity, because its biological relevance is overrated. This is an important criticism – which the authors have made before (Lisman and Spruston, 2005) – that researchers in the STDP field should take to heart and try to address. Schulz (2010) develops this point, making the case that plasticity in the intact brain is likely to be much more complicated than in simple in vitro experiments. In a more specific argument, Shouval et al. (2010) suggest that STDP is in reality a result of something more fundamental, which they propose is intracellular calcium signals. In addition, they argue in favor of mechanism-driven modeling, rather than theory driven by phenomenology. Fregnac et al. (2010) make the case that there is limited evidence supporting an actual functional role of STDP in the intact brain, an important point that should be compared to those of Schulz (2010) and of Lisman and Spruston (2010). By comparing two different induction protocols, they conclude that classical STDP might be limited to the critical period in vivo. Finally, Buchanan and Mellor (Buchanan et al., 2010) focus on STDP in the hippocampus, showing that for this brain region the experimental literature seems to be particularly fraught with disagreement. But there is common ground, which is defined by post-synaptic calcium transients, thus echoing the point made by Shouval et al. (2010).
Section three deals with Mechanisms: Inducing, Expressing, and Controlling STDP. Seguing from the previous section, Graupner and Brunel (2010) begin by providing an overview of biophysical models of synaptic plasticity, including those based on calcium and those based on signaling cascades, with a special emphasis on bistable synapses. Following on this, Froemke et al. (2010b) explore how STDP depends on where the synapse is located in the dendritic arbor, and what the functional consequences of this location dependence might be (for a related article here-in, see Clopath and Gerstner, 2010). Turning next to the pre-synaptic side and how it governs STDP, Rodriguez-Moreno et al. (2010) overview recent findings on the role of pre-synaptically located NMDA receptors in timing-dependent long-term depression (cf. Duguid and Sjöström, 2006). But pre or post-synaptic mechanisms cannot suffice – as Pawlak et al. (2010) show in the ensuing paper, STDP must be somehow controlled by a third factor, which is likely a neuromodulatory gate. Finally, Froemke et al. (2010a) discuss the consequences of temporally non-linear spike-pair interactions in STDP. They show that factors such as spike triplets and rate also determine plasticity, although differently in neocortex compared to hippocampus.
This brings us to the next set of questions: Does STDP always look the same? In fact, has STDP been found at all synapse types? In section four, these and other questions are addressed as we learn about The Diverse Phenomenology of STDP. Shulz and Jacob (2010) compare STDP in different species and brain regions, in particular in vivo, and find that variability depends not only on synapse type, but also on network state and neuromodulation, thus arguing for the need for more research. Müller-Dahlhaus et al. (2010) report on STDP-like changes in the human brain as evidenced by transcranial magnetic stimulation. Richards et al. (2010) subsequently report on in vivo STDP in the optic tectum of the tadpole, Xenopuslaevis, where some of the first evidence for the existence of STDP was found. So far, we have focused on the plasticity of excitation, but it is important not to neglect the plasticity of inhibitory circuits, as is pointed out in the review by Lamsa et al. (2010). After this, Roberts and Leen (2010) discuss the role of anti-Hebbian STDP in computational features such as predictive sensory cancelation and novelty detection in the electrosensory system of the weakly electric fish. Next, Fino and Venance (2010) overview the state of the striatal STDP field, where some conflicting results have been reported. The authors argue that these discrepancies are due to diversity in synaptic learning rules across different cell types, but probably also to experimental conditions. Finally, Larsen et al. (2010) review STDP in the sensory neocortex, arguing that the properties of STDP change over development, to achieve optimal tuning of neurons as conditions change with maturation. To conclude, STDP exists in humans, tadpole, and electric fish alike, but it may vary with the specific cell and synapse type as well as with developmental stage.
Timing is not everything, however, and in section five, titled STDP and Beyond, we learn about other forms of plasticity and how they interact with timing-dependent learning rules. Watt and Desai (2010) discuss how homeostatic plasticity is necessary for a neuron to keep its cool as the world changes, for example as inputs connect up during development. Such homeostatic plasticity may act on synapses or on the excitability of the cell itself. Debanne and Poo (2010) go beyond the synapse to the plasticity of intrinsic excitability of the pre or the post-synaptic cell, overviewing how this is linked to the induction of STDP, as well as what its spatial extent is.
In section six, entitled STDP: Consequences in Health and Disease, the impact of STDP on circuits is discussed. Butts and Kanold (2010) make the interesting argument that – because early activity patterns typically do not possess the fast correlation structures that STDP is sensitive to, but mature activity patterns do – STDP may first be masked, only to emerge later in development and be present in the mature brain (for a different view, see Fregnac et al., 2010). Next up is Gilson et al. (2010), who explore STDP in recurrent neuronal networks. Although several theoretical studies have explored the role of STDP in individual cells, Gilson et al. (2010) discuss the consequences of STDP in the circuit, with a focus on weight dynamics and the evolution of different network structures. Finally, Meredith and Mansvelder (2010) overview STDP in neurodevelopmental learning disorders, using the Fragile X syndrome as a starting point. They propose that studying STDP in a disease context may provide an opportunity to link cognition and learning rules.
The two last sections consist of original research articles grouped into theoretical and experimental studies. Due to lack of space, we regrettably cannot introduce these contributions individually here.
Concluding Remarks
There is no doubt that STDP is a novel plasticity paradigm of great interest that holds particular promise for biological and computational relevance. STDP has in fact dramatically reshaped the field of synaptic plasticity over the past decade or so. But this is not to say that STDP has been a panacea for all problems neuroscientific. Clearly cells that fire together wire together, there is no doubt about that, so the coming of STDP has not rendered the classical literature obsolete by any means. Also, the advent of STDP has raised many questions. Can we really be sure that STDP actually happens in the intact brain? Most studies have been carried out in a dish, after all, so we should not assume that these artificial activity patterns imposed on the tissue in the dish are necessarily relevant. If STDP does exist, does it exist in all animal species? After all, if STDP is inherently important for brain functioning, it should have been relatively preserved by evolution. And should there not be a way of turning STDP on and off? It does not seem to be the case that we constantly learn and rewire our brains to every stimulus we encounter; our brains are quite selective filters when it comes to information storage. If the STDP paradigm shift is to be more than a revolution in a dish, a much-improved understanding of this phenomenon is desperately and urgently needed. This Frontiers Research Topic eBook on STDP has aimed to help achieve precisely this, by comprehensively overviewing what is known, outlining what is not known, highlighting controversy, and pointing out where we need to direct our research efforts next. This research is important, because it is about how your brain works.
References
Bienenstock, E. L., Cooper, L. N., and Munro, P. W. (1982). Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J. Neurosci. 2, 32–48.
Buchanan, K., Elgar, D., Blackman, A., Tudor Jones, A., and Sjöström, P. (2010). Differential expression of presynaptic NMDA receptors in neocortex. FENS Abstr. 5, 014.2.
Butts, D. A., and Kanold, P. O. (2010). The applicability of spike time dependent plasticity to development. Front. Synaptic Neurosci. 2:30.
Clopath, C., and Gerstner, W. (2010). Voltage and spike timing interact in STDP – a unified model. Front. Synaptic Neurosci. 2:25.
Debanne, D., and Poo, M. M. (2010). Spike-timing dependent plasticity beyond synapse – pre- and post-synaptic plasticity of intrinsic neuronal excitability. Front. Synaptic Neurosci. 2:21.
Duguid, I., and Sjöström, P. J. (2006). Novel presynaptic mechanisms for coincidence detection in synaptic plasticity. Curr. Opin. Neurobiol. 16, 312–322.
Fino, E., and Venance, L. (2010). Spike-timing dependent plasticity in the striatum. Front. Synaptic Neurosci. 2:6.
Fregnac, Y., Pananceau, M., Rene, A., Huguet, N., Marre, O., Levy, M., and Shulz, D. E. (2010). A re-examination of Hebbian-covariance rules and spike timing-dependent plasticity in cat visual cortex in vivo. Front. Synaptic Neurosci. 2:147.
Froemke, R. C., Debanne, D., and Bi, G.-Q. (2010a). Temporal modulation of spike-timing-dependent plasticity. Front. Synaptic Neurosci. 2:19.
Froemke, R. C., Letzkus, J. J., Kampa, B. M., Hang, G. B., and Stuart, G. J. (2010b). Dendritic synapse location and neocortical spike-timing-dependent plasticity. Front. Synaptic Neurosci. 2:29.
Gerstner, W. (2010). From Hebb rules to spike-timing-dependent plasticity: a personal account. Front. Synaptic Neurosci. 2:151.
Gerstner, W., Kempter, R., van Hemmen, J. L., and Wagner, H. (1996). A neuronal learning rule for sub-millisecond temporal coding. Nature 383, 76–81.
Gilson, M., Burkitt, A., and Van Hemmen, L. J. (2010). STDP in recurrent neuronal networks. Front. Comput. Neurosci. 4:23.
Graupner, M., and Brunel, N. (2010). Mechanisms of induction and maintenance of spike-timing dependent plasticity in biophysical synapse models. Front. Comput. Neurosci. 4:23.
Konorski, J. (1948). Conditioned Reflexes and Neuron Organization. Cambridge: Cambridge University Press.
Lamsa, K. P., Kullmann, D. M., and Woodin, M. A. (2010). Spike-timing dependent plasticity in inhibitory circuits. Front. Synaptic Neurosci. 2:8.
Larsen, R. S., Rao, D., Manis, P. B., and Philpot, B. D. (2010). STDP in the developing sensory neocortex. Front. Synaptic Neurosci. 2:9.
Levy, W. B. (2010). Discovering associative long-term synaptic modification and timing dependence of plasticity – a very brief and personal history. Front. Synaptic Neurosci. 2:149.
Levy, W. B., and Steward, O. (1983). Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus. Neuroscience 8, 791–797.
Lisman, J., and Spruston, N. (2005). Postsynaptic depolarization requirements for LTP and LTD: a critique of spike timing-dependent plasticity. Nat. Neurosci. 8, 839–841.
Lisman, J., and Spruston, N. (2010). Questions about STDP as a general model of synaptic plasticity. Front. Synaptic Neurosci. 2:140. doi: 10.3389/fnsyn.2010.00140
Markram, H., Gerstner, W., and Sjöström, P. J. (2011). A history of spike-timing-dependent plasticity. Front. Synaptic Neurosci. 3:4. doi: 10.3389/fnsyn.2011.00004
Markram, H., Lübke, J., Frotscher, M., and Sakmann, B. (1997). Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275, 213–215.
Markram, H., and Sakmann, B. (1995). Action potentials propogating back into dendrites triggers changes in efficacy of single-axon synapses between layer V pyramidal cells. Soc. Neurosci. Abstr. 21, 2007.
Meredith, R. M., and Mansvelder, H. D. (2010). STDP and mental retardation: dysregulation of dendritic excitability in fragile X syndrome. Front. Synaptic Neurosci. 2:10. doi: 10.3389/fnsyn.2010.00010
Müller-Dahlhaus, F., Ziemann, U., and Classen, J. (2010). Plasticity resembling spike-timing dependent synaptic plasticity: the evidence in human cortex. Front. Synaptic Neurosci. 2:34. doi: 10.3389/fnsyn.2010.00034
Pawlak, V., Wickens, J. R., Kirkwood, A., and Kerr, J. N. D. (2010). Timing is not everything: neuromodulation opens the STDP gate. Front. Synaptic Neurosci. 2:146. doi: 10.3389/fnsyn.2010.00146
Ramón y Cajal, S. (1894). The Croonian lecture: la fine structure des centres nerveux. Proc. R. Soc. Lond. B Biol. Sci. 4, 444–468.
Richards, B. A., Aizenman, C. D., and Akerman, C. J. (2010). In vivo spike-timing-dependent plasticity in the optic tectum of Xenopus laevis. Front. Synaptic Neurosci. 2:7. doi: 10.3389/fnsyn.2010.00007
Roberts, P. D., and Leen, T. K. (2010). Anti-hebbian spike-timing-dependent plasticity and adaptive sensory processing. Front. Comput. Neurosci. 4:156. doi: 10.3389/fncom.2010.00156
Rodriguez-Moreno, A., Banerjee, A., and Paulsen, O. (2010). Presynaptic NMDA receptors and spike timing-dependent long-term depression at cortical synapses. Front. Synaptic Neurosci. 2:18. doi: 10.3389/fnsyn.2010.00018
Schulz, J. M. (2010). Synaptic plasticity in vivo: more than just spike-timing? Front. Synaptic Neurosci. 2:150. doi: 10.3389/fnsyn.2010.00150
Shouval, H. Z., Wang, S. S.-H., and Wittenberg, G. M. (2010). Spike timing dependent plasticity: a consequence of more fundamental learning rules. Front. Comput. Neurosci. 4:19. doi: 10.3389/fncom.2010.00019
Shulz, D. E., and Jacob, V. (2010). Spike timing dependent plasticity in the intact brain: counteracting spurious spike coincidences. Front. Synaptic Neurosci. 2:137. doi: 10.3389/fnsyn.2010.00137
Sjöström, P. J., and Gerstner, W. (2010). Spike-timing dependent plasticity. Scholarpedia J. 5, 1362.
Citation: Markram H, Gerstner W and Sjöström PJ (2012) Spike-timing-dependent plasticity: a comprehensive overview. Front. Syn. Neurosci. 4:2. doi: 10.3389/fnsyn.2012.00002
Received: 12 June 2012; Accepted: 21 June 2012;
Published online: 12 July 2012.
Edited by:
Mary B. Kennedy, Caltech, USAReviewed by:
Mary B. Kennedy, Caltech, USACopyright: © 2012 Markram, Gerstner and Sjöström. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in other forums, provided the original authors and source are credited and subject to any copyright notices concerning any third-party graphics etc.
*Correspondence: jesper.sjostrom@mcgill.ca