Abstract
Fast learning designates the behavioral and neuronal mechanisms underlying the acquisition of a long-term memory trace after a unique and brief experience. As such it is opposed to incremental, slower reinforcement or procedural learning requiring repetitive training. This learning process, found in most animal species, exists in a large spectrum of natural behaviors, such as one-shot associative, spatial, or perceptual learning, and is a core principle of human episodic memory. We review here the neuronal and synaptic long-term changes associated with fast learning in mammals and discuss some hypotheses related to their underlying mechanisms. We first describe the variety of behavioral paradigms used to test fast learning memories: those preferentially involve a single and brief (from few hundred milliseconds to few minutes) exposures to salient stimuli, sufficient to trigger a long-lasting memory trace and new adaptive responses. We then focus on neuronal activity patterns observed during fast learning and the emergence of long-term selective responses, before documenting the physiological correlates of fast learning. In the search for the engrams of fast learning, a growing body of evidence highlights long-term changes in gene expression, structural, intrinsic, and synaptic plasticities. Finally, we discuss the potential role of the sparse and bursting nature of neuronal activity observed during the fast learning, especially in the induction plasticity mechanisms leading to the rapid establishment of long-term synaptic modifications. We conclude with more theoretical perspectives on network dynamics that could enable fast learning, with an overview of some theoretical approaches in cognitive neuroscience and artificial intelligence.
Fast Learning Behaviors
Fast learning mechanisms are best characterized in one-shot or single-trial learning paradigms which lead to memory formation after a single and brief (few hundred milliseconds to few minutes) exposure to relevant stimuli (Figures 1A–D). Indeed, what distinguishes fast learning are the features of the encoding stage (or learning experience): fast learning refers here to situations where memory traces are rapidly formed without requiring repetitions of the learning experience.
Figure 1
One-shot learning pathways to long-term synaptic plasticity. (A–D) Four examples of one-shot learning tasks: associative visuomotor learning (A), recognition of a novel stimulus (B), one-shot spatial learning in a maze (C), and conditioned taste aversion (CTA; D). (E,F) Associated spike patterns include sparse firing (E) or a few bursts (F). (E) Sparse firing (right panel) is illustrated by two-photon imaging recording of the primary visual cortex (V1) of an awake and behaving monkey during associative visuomotor learning (fixation task). Very few V1 neurons respond strongly to the natural visual stimuli considered (left panel), with a sharp peak in the rank-ordered distribution of population calcium-responses. Adapted from Tang et al. (2018). (F) Somatic, and dendritic patch-clamp whole-cell in vivo recordings in pyramidal cells of the visual cortex in mice show the emergence of few orientation-tuned somatic bursts and active dendritic events during the presentation of square-wave grating visual stimuli. Adapted from Smith et al. (2013). (G) With a spike-timing-dependent plasticity (STDP) paradigm, few spike pairs induce eCB-dependent long-term potentiation (LTP) at cortico-striatal synapses in rat brain slices. Top: protocol: 10 post-pre pairings of cortical stimulation and striatal spike, with a delay between pre- and postsynaptic activity centered at Δt (−20 ms) with jitter to mimic noisy in vivo inputs, lower-right panel (std σΔt = 6.4 ms). The lower left panel shows the progressive establishment of LTP (n = 9 cells). Adapted from Cui et al. (2018b). (H) A single burst evokes a long-term depression (LTD) at layer 5 V1 pyramidal neuron in a rat brain slice. Top panel, somatic current recording upon single burst stimulation with the second peak reflecting a local dendritic spike. The bottom panel, averaged time-courses of LTD induced by a single burst (n = 8 cells). Adapted from Holthoff et al. (2004). In (H,G) arrows indicate the stimulation protocol. Permissions for the copyright of the adapted Figures in panels (E–H) have been obtained.
In animal models, a single exploration of a new place or novel objects can evoke long-lasting memories, as assessed in rodents using the delayed-matching-to-place task in a watermaze or novel object recognition (Ennaceur and Delacour, 1988; Steele and Morris, 1999; Nakazawa et al., 2003; Clarke et al., 2010). Paradigms using positive or negative reinforcement are also used to boost one-shot associative learning. Examples from rodents include odor-reward associations (Roullet et al., 1997; Armstrong et al., 2006), fear conditioning, and inhibitory avoidance tasks (Venable and Kelly, 1990; Izquierdo et al., 1997; Sacchetti et al., 2002; Vale et al., 2017) or conditioned taste aversion (CTA; Escobar et al., 2002). Positively reinforced one-shot learning of multiple visuomotor associations has also been reported in pigeons and baboons (Cook and Fagot, 2009).
In humans, episodic memory, referring to the formation and maintenance of memory traces of unique experiences, illustrates well fast learning. It should be noted that the existence of episodic memory in non-human mammals has remained controversial in the literature (Clayton et al., 2001; Fellini and Morellini, 2013). Behavioral tests in humans have focused on the familiarity and recollection components of episodic memory, using respectively forced recognition tasks (Standing et al., 1970; Rutishauser et al., 2006) and source memory tests (Jacoby, 1991; Harlow and Donaldson, 2013). One-shot associative learning can be used to test additional aspects of episodic memory, such as objects-place associations (Ison et al., 2015; Brodt et al., 2018). One-shot associative learning can also extend to more abstract representations and semantic memories, such as in learning new words (Carey and Bartlett, 1978), concepts, or object categories (Biederman, 1987).
Neuronal Activity During Fast Learning
In vivo recordings of spiking activity during a fast learning experience reveal sparse activity modulation and the occurrence of few bursting events (Figures 1E,F). During a ~1 s visual stimulation, few neurons from human or monkey anterior and medial temporal cortical lobes and basolateral amygdala (BLA) fire ~5–20 spikes (Messinger et al., 2001; Rutishauser et al., 2006; Ison et al., 2015). These brief presentations of a novel stimulation can however induce significant changes in neuronal activity lasting for at least 10 h (Fried et al., 1997; Xiang and Brown, 1998; Rutishauser et al., 2006) and even allow distinguishing between subjects having perceived the stimulus as a novel or familiar (Fried et al., 1997; Rutishauser et al., 2006). During active touch or passive sensing, sparse activity is also detected in the visual, somatosensory, and auditory cortices, with 0.5–5% of neurons increasing their firing rates in cats, ferrets, or rodents (Yao et al., 2007; Hromádka et al., 2008; Jadhav et al., 2009; O’Connor et al., 2010; Tang et al., 2018; Yoshida and Ohki, 2020; Figure 1E). Such sparse activity is accompanied by the emission of bursts in pyramidal cells, coupled to active dendritic events, in sensory cortices and in the hippocampus (Xu et al., 2012; Smith et al., 2013; Takahashi et al., 2016; Manita et al., 2017; Figure 1F). Moreover, a single presentation of a sensory stimulus induces short-term reverberatory patterns in spontaneous activity during at least a few minutes (Yao et al., 2007), and persistent changes in receptive fields, lasting for several hours (Fritz et al., 2003). Similarly, a single passage in a maze, inducing few bursting events (O’Keefe and Recce, 1993; Epsztein et al., 2011), leads to new stable place fields (Mehta et al., 2000; Bittner et al., 2017). After visuo- and odor-motor association fast learning tasks, long-lasting task-related responses emerge rapidly in the prefrontal cortex and striatum (Pasupathy and Miller, 2005; Cromer et al., 2011) and in the striatal olfactory tubercle (Millman and Murthy, 2020). Similar phenomena are observed in the auditory cortex during the very first fear conditioning trials (Edeline et al., 1993) or in the BLA-projecting neurons of the gustatory cortex after CTA (Lavi et al., 2018).
Altogether, despite the low number of spikes or bursting events, the induction of persistent selective responses can be initiated after a single or few stimulus presentations across the brain and thus serve as neural indicators of acquired memory traces.
Fast Learning-Induced Neuronal Long-Term Changes
Long-term changes have been reported subsequently to various fast learning tasks. In particular, some studies identified such long-term changes in cells activated during the learning experience, thus giving privileged access to understanding the nature of fast learning engrams, that are the set of “enduring physical and/or chemical changes elicited by learning and that underlie a newly formed memory” (Josselyn et al., 2015; Tonegawa et al., 2015; Josselyn and Tonegawa, 2020).
Fast Learning-Induced Structural, Synaptic, and Intrinsic Plasticity Changes
One-shot learning tasks can be sufficient to activate some immediate-early genes or cellular transcription factors in hippocampal, BLA, or cortical neurons (Radulovic et al., 1998; Sananbenesi et al., 2002; Miyashita et al., 2009; Liu et al., 2012; Fellini and Morellini, 2013; Tayler et al., 2013). Such markers, in conjunction with genetic manipulations, have been used to identify engram cells in fast learning tasks, by tracing active cells during memory encoding and reactivated cells during retrieval (Tayler et al., 2013; Denny et al., 2014; DeNardo et al., 2019), or by manipulating their activity (Han et al., 2009; Choi et al., 2011; Liu et al., 2012; Josselyn and Tonegawa, 2020).
Long-term structural and synaptic plasticity changes have been reported in subcortical areas after a fast learning experience and specifically linked to engram cells in fear conditioning protocols: in vivo measurements of field-EPSPs reveal long-term potentiation (LTP) in rat dentate gyrus during spatial exploration, and at CA3-CA1 synapses after novel object recognition or an inhibitory avoidance task in mice (Moser et al., 1993; Whitlock et al., 2006; Clarke et al., 2010). Pharmacological manipulations and ex vivo electrophysiology support these findings, through the observation of synaptic plasticity occlusion or the facilitation of plasticity induction under subthreshold stimulation protocols (Sacchetti et al., 2002; Nakazawa et al., 2003; Whitlock et al., 2006; Romberg et al., 2013). Furthermore, a single contextual fear conditioning induces a structural and functional potentiation between CA3 and CA1 engram cells, with increased spine size and number, and ex vivo LTP expression (Choi et al., 2018), as well as a presynaptic LTP between cortical inputs and BLA engram cells (Nonaka et al., 2014).
Long-term intrinsic plasticity changes are also evoked by a one-shot learning experience: hippocampal neurons activated by a single fear conditioning protocol become more excitable during several days, thus potentially facilitating subsequent learning (Crestani et al., 2018), and changes in membrane excitability correlate with freezing levels and can be reversed after a single extinction trial (McKay et al., 2009). Interestingly, the magnitude of the increase in membrane excitability is comparable to those reported after repeated trials of conditioning protocols (Moyer et al., 1996; Saar et al., 1998; Song et al., 2012; Sehgal et al., 2014).
Fast Learning Neocortical Engrams
While fast learning mechanisms have historically been associated to allocortical and subcortical areas (McClelland et al., 1995; Buschman and Miller, 2014), rapid formation of neocortical engrams have been uncovered in several fast learning tasks (Hofstetter et al., 2016; Kitamura et al., 2017; Brodt et al., 2018; Hebscher et al., 2019). First, the formation of neocortical engrams rapidly occurs in parallel to subcortical and allocortical changes and contributes to early system consolidation mechanisms: after a contextual fear conditioning, prefrontal neurons immediately engage in the formation of memory engrams, that progressively become functional with a maturation process requiring hippocampal and BLA inputs, and serve as long-lasting memory traces while hippocampal engram cells become silent during remote memory retrieval (Tayler et al., 2013; Kitamura et al., 2017; Matos et al., 2019). Furthermore, synaptic changes rapidly emerge in cortical-dependent one-shot learning tasks, such as after new word learning in human cortical areas involved in language and reading (Hofstetter et al., 2016), or in the perirhinal cortex during recognition memory (Brown and Banks, 2015). Also, after CTA, long-term actin rearrangements occur in gustatory and prelimbic cortices (Bi et al., 2010), and N-methyl-D-aspartate receptor (NMDAR)-mediated LTP at BLA-cortical synapses is occluded in vivo for at least 5 days (Escobar et al., 2002; Rodríguez-Durán et al., 2011).
These experiments suggest that the neural correlates of one-shot learning experience engage molecular machinery and cellular processes similar to those reported after repetitive training, such as the long-term activation of the same genetic markers, the establishment of long-term synaptic and structural changes, or the requirement for NMDA receptors. Yet, several questions remain to be elucidated, such as the modalities of induction and the extent (both in terms of magnitude and number of cells engaged) of fast learning-induced changes compared with repetitive training.
Deconstructing Fast Learning Synaptic Plasticity Mechanisms
In light of the aforementioned results and given the neuronal activity patterns observed during fast learning, we now present some hypotheses on the induction mechanisms of fast learning-induced synaptic changes. Two natural hypotheses ensue: fast learning could constitute a condensed version of synaptic events similar to those occurring during repetitive learning and/or fast learning could be enabled by intrinsically stronger synaptic events. In the former scenario, the difference between the two learning processes would lie in the sensitivity of plasticity induction, a factor that could be modulated by the initial state of the synapses (with for instance more or less available membrane voltage-gated channels) or the efficiency of neuromodulatory systems. In the latter scenario, fewer synaptic events may be needed to initiate long-term changes, such that a one-shot exposure may be sufficient to drive the formation of a memory trace. The excitability of the active cells and/or the activation of some specific membrane channels could promote the generation of larger events, such as amplificatory dendritic phenomena or larger post-synaptic responses leading to stronger calcium influx.
Due to the sparsity of direct links between neuronal activity and synaptic changes of engram cells, we mostly refer here to in vitro electrophysiological experiments using brief stimulation protocols, mimicking activity patterns observed during a fast learning experience, and capable of inducing long-term synaptic plasticity in randomly selected neurons (Figures 1G,H, 2). We also examine the impact of additional factors such as short-term intrinsic changes and neuromodulators. The following experiments provide first insights into the putative induction mechanisms, but further work is needed to apply similar protocols on to-be engram cells and link their artificially-induced long-term changes to learning, as well as to observe in vivo natural plasticity rules.
Figure 2
Elementary cellular mechanisms of fast learning. Schematic diagram of the putative cellular mechanisms leading from a one-shot experience to a long term memory. A one-shot experience leads a small fraction of cells to fire a few spikes (sparse network activity, left), and/or few bursts accompanied by active dendritic events (right). Neuromodulators can also be released, particularly in the presence of salient elements in the stimulus (e.g., novelty or rewards). In vitro evidence showed that neuromodulators play a role in the selection of patterns, as well as in the induction of short-term changes in excitability that could prime neurons to become engram cells. Neuromodulators can also lower the synaptic plasticity induction threshold, thereby facilitating long-term plasticity. Such long-term plasticity can then be consolidated by specific gene expression, structural changes, or reverberatory activity, altogether leading to the emergence of long-term memory following a single experience.
Induction of Long-Term Synaptic Plasticity Under Sparse and Burst Firing
Sparse Firing
Only a few spikes may be transmitted between neurons during a one-shot experience: this constraint could potentially conflict with the classic Hebbian framework requiring repetition or persistence of a given activity pattern to induce stable long-term synaptic plasticity (Hebb, 1949). Yet, in vitro studies demonstrate that few coincident activities can be sufficient to induce spike-timing-dependent plasticity (STDP) in several brain areas. No more than ~10–15 spike-EPSP pairings between L2/3 pyramidal cells of the visual cortex are sufficient to induce Hebbian LTP, while LTD induction requires ~30 spikes (Froemke et al., 2006), with classical induction STDP protocols relying on 75–150 pairings. Interestingly, LTP magnitude is not affected by adding more pairings, suggesting a potentially rapid memory acquisition through the induction of an abrupt all-or-none LTP in response to minimal stimulation, as observed at CA3-CA1 synapses (Petersen et al., 1998). Moreover, in striatal projecting neurons and in L5 pyramidal cells of the somatosensory cortex, in vitro STDP paradigms involving ~5–15 cortico-striatal pairings induce an endocannabinoid-mediated LTP (eCB-LTP; Cui et al., 2015, 2016, 2018a; Xu et al., 2018; Gangarossa et al., 2020; Figure 1G). This LTP disappears for 25–50 pairings, only to re-emerge at 75 pairings as an NMDAR-mediated LTP (NMDAR-LTP). Importantly, eCB-LTP is more robust to spike jittering compared to NMDAR-LTP, and can thus arise in a noisy environment (Cui et al., 2018b; Figure 1G). Such a phenomenon could be critical to fast learning since the reliability of spiking activity in response to sensory stimuli might not yet be fully established (Yao et al., 2007). Interestingly, a recent study establishes that transient (10 s to 5 min) neuronal activation as well as a 1-min presentation of flashing visual stimuli specifically activate the MAPK/ERK signaling, and are sufficient to induce the first wave of primary response genes (Tyssowski et al., 2018).
Burst and Active Dendritic Events
Since bursts are transmitted more efficiently than isolated spikes, they could increase the signal-to-noise ratio of the network information transmission, and therefore appear as a privileged signal for inducing long-term changes during fast learning (Lisman, 1997; Krahe and Gabbiani, 2004; Figure 2). Indeed, triggering a single synaptic stimulation of L5 pyramidal neurons of the visual cortex induces LTD in vitro, only if the paired excitatory postsynaptic potential (EPSP) produces an NMDAR-dependent dendritic spike (Holthoff et al., 2004; Figure 1H). Similarly, a single burst of activity in Schaffer collaterals induces LTP, under the condition of triggering a postsynaptic dendritic spike and activating NMDAR and L-type voltage-gated calcium channels in CA1 pyramidal cells (Pike et al., 1999; Wittenberg and Wang, 2006; Remy and Spruston, 2007). Importantly, a pioneer in vivo study by Bittner et al. (2017) shows that during spatial navigation, spatially tuned entorhinal and CA3 inputs arriving 2–3 s before or after a CA1 post-synaptic calcium plateau potential can induce NMDAR-LTP and new place fields in CA1 pyramidal cells, thus paving the way for behavioral time-scale plasticity. These findings, also replicated in vitro (Bittner et al., 2017), bridge the gap between the timescales of behavioral learning and synaptic changes, and offer an alternative mechanism to a purely Hebbian framework that may be at stake in episodic-like memories.
Factors Facilitating Long-Term Synaptic Plasticity Under Sparse and Burst Firing
Intrinsic Plasticity
Changes in neuronal excitability not only support synaptic changes as described above but can also act as a short-term priming mechanism (Figure 2). Indeed, intrinsic modulation of neuronal excitability generally has a lower induction threshold than synaptic plasticity and could contribute to induce early changes in neuronal activity (Titley et al., 2017) that will later favor the establishment of synaptic plasticity, even under sparse activity (Sah and Bekkers, 1996; Louise Faber et al., 2005). In this sense, artificially elevating neuron excitability selectively in vivo reveals place-cell activity in previously silent neurons (Lee et al., 2012) and turns these neurons into engram cells during a fear memory paradigm (Yiu et al., 2014). Interestingly, neurons of the piriform cortex are initially more excitable in fast learners compared to slow learners, with differences disappearing as their performance on the odor-discrimination task converges upon stimulus repetitions (Cohen-Matsliah et al., 2009).
Neuromodulation
Exposure to novel or salient stimuli releases neuromodulators necessary for spatial memory, context, and object recognition or one-shot emotional learning (Duszkiewicz et al., 2019; Likhtik and Johansen, 2019). Importantly, neuromodulators can favor the occurrence of specific synaptic events and neuronal activity patterns as well as lower the threshold for inducing long-term synaptic changes (Figure 2). Acetylcholine amplifies cue encoding at sensory cortical sites through inhibition, which allows the emission of larger bursts in presence of meaningful stimuli (Froemke et al., 2007; Letzkus et al., 2011). Also, under the presence of a cholinergic agonist, a single burst at the peak or trough of theta-rhythms induces in vitro LTP or depotentiation at CA3-CA1 synapses respectively (Huerta and Lisman, 1995). In the same vein, single burst-mediated LTP is more efficient with GABAergic transmission antagonists, suggesting that the excitation/inhibition balance, partly under neuromodulatory control, shapes the induction of fast learning plasticity (Remy and Spruston, 2007). Finally, dopamine expands the time window for NMDAR-LTP induction at CA3-CA1 synapses in vitro and decreases the threshold number of spike pairs (from 100 to 5–10) required for LTP (Zhang et al., 2009).
Reverberating Activity, as a Bypass to Sparse Firing
In addition to plasticity rules activated by small numbers of spikes, spontaneous replications of the associated neuronal activity may contribute to consolidating one-shot memories according to the classical Hebbian framework (Figure 2). Reverberating activity is observed especially during slow-wave sleep up to 48 h after a transient tactile exploration of novel objects (Ribeiro et al., 2004), and replay of past trajectories, in awake or asleep animals, is associated to memory consolidation in the hippocampus, ventral striatum and neocortex (Wilson and McNaughton, 1994; Hoffman and McNaughton, 2002; Pennartz et al., 2004; Ólafsdóttir et al., 2018). Interestingly, the awake replay is more prevalent and precise for trajectories in novel environments or associated with salient elements (e.g., a reward, Carr et al., 2011) and could thus particularly reinforce memory traces of unique salient experience.
Reconstructing Fast Learning in Neuronal Networks
Fast Learning and Slow-Fast Network Dynamics
If fast learning is best epitomized in one- or very few-shots learning tasks, it may also apply to the initial stages of repetitive and sustained training (Karni et al., 1998; Muellbacher et al., 2002; Costa et al., 2004; Qu et al., 2010; Law et al., 2014). As such, cortical engrams emerge in one-shot learning tasks as described above, but also in the initial phases of procedural learning (Karni et al., 1998; Muellbacher et al., 2002; Qu et al., 2010). Importantly, cortical representations acquired slowly over time are also essential in guiding future fast learning, which usually relies on prior knowledge and existing schemata such as when learning associations between known elements or novel words (Tse et al., 2007, 2011; Hebscher et al., 2019). Thus, one should keep in mind that fast and slow cortical dynamics are closely intertwined as exemplified in tasks necessitating high levels of cognitive flexibility (Pasupathy and Miller, 2005; Tse et al., 2007; Durstewitz et al., 2010; Siniscalchi et al., 2016; Perich et al., 2018; Remington et al., 2018; Rikhye et al., 2018).
How to Control Learning Speed?
If fast learning can confer strong advantages, e.g., in survival-threatening situations, this strategy is not always adapted and can potentially lead to detrimental responses, such as superstitious behaviors, when an outcome is too rapidly associated with the wrong cause. Typically, procedural learning based on trial-and-error, or reinforcement learning, in which a trade-off slowly balances exploration and exploitation, necessitates several sessions before reaching an optimal behavior. Hence, control of the learning speed or meta-learning should also be seen as a critical component of the learning process. Yet, little is known about how the brain is implementing and switching between different learning strategies. Recent studies highlight how an accurate tracking of feedback (Mao et al., 2019) or stimulus saliency (Ceballo et al., 2019), amplified by cortical ensembles, parallels with learning speed. The degree of uncertainty of stimulus-outcome associations also regulates the learning speed in humans and controls the coupling strength between the hippocampus and ventrolateral prefrontal cortex (Lee et al., 2015).
A Computational Perspective on a Fast Learning
Physiologically realistic models of fast learning have remained scarce and may require the development of new synaptic learning paradigms (Brea and Gerstner, 2016). Yet, phenomenological models of fast learning and machine learning algorithms have proposed various mechanisms providing a guide for the development of physiological models and offer testable hypotheses for experimentalists. Fast learning is affected with particular severity by two critical difficulties and exacerbates Hebb’s sensitivity-stability dilemma (Hebb, 1949): (i) small sample sizes hamper generalization capabilities and pattern inference; and (ii) catastrophic interference, the abrupt forgetting of previously learned information, can be easily encountered due to the high plasticity rates required by fast learning (McCloskey and Cohen, 1989; Ratcliff, 1990). To overcome these difficulties, various theories have been proposed. Synapses with hierarchical plasticity levels (Fusi et al., 2005) or selective consolidation of synapses (Leimer et al., 2019) allow fast acquisition and better retention of memories. In cognitive neurosciences, three key principles stand out as crucial for fast learning (Lake et al., 2017): the ability to compose simple primitives (and therefore use prior learning), identify causalities, and meta-learning (i.e., learning to learn). Combined in a generative hierarchical Bayesian framework, these mechanisms allowed the acquisition of new concepts after a single presentation, with performance comparable to human best one-shot learners (Lake et al., 2011, 2015).
In machine learning, various methods were developed to learn from few examples (Botvinick et al., 2019; Wang et al., 2020), with applications to an inference of situations with intrinsically limited samples (Shu et al., 2018) or for the prediction of rare events (Kaiser et al., 2017). In particular, data augmentation methods consist in adding to the dataset copies of the original data, modified according to specific rules, such as imposing invariances (Perez and Wang, 2017). Such repetitions of slightly modified stimuli could be akin to a sort of reverberating activity or replays. Concept(transfer, or multitask)learning consists in using and combining prior knowledge, potentially acquired from learning other tasks. These techniques integrate task-specific fast-learning modules and generic modules that learn from various tasks on generally slower timescales. These generic modules either transfer to the fast learning task a generic skill needed (Pan and Yang, 2009) or guide the task in the process of learning (Schaul and Schmidhuber, 2010; Finn et al., 2017). This typically echoes the aforementioned slow-fast plasticity interactions between brain areas. Recently, computational models of meta-learning have shown how a natural division of labor into functionally specialized clusters may arise in the prefrontal cortex, thus making it possible to compose multiple task elements for rapidly learning new tasks (Wang et al., 2018; Yang et al., 2019). Finally, adding external memories (Graves et al., 2014; Weston et al., 2014), storing past experiences (if not all, the most recent or most salient) allows few-shot learning and can further be combined with meta-learning algorithms to increase learning efficiency (Santoro et al., 2016; Ritter et al., 2018).
Conclusion
Fast learning is thus a crucial component in daily life memory acquisition that involves one-shot learning experiences. If fast learning can be characterized by the brevity and rarity (or even uniqueness) of the learning experience, the processes involved in memory acquisition and maintenance are embedded in multiple timescales, considering their interactions with meta-learning and consolidation systems. While current findings have lifted part of the veil on fast learning engrams, several mechanisms remain to be further elucidated. In particular, causal interactions between minimal activity patterns and the induction of long-term changes during one-shot learning task remain to be further explored in vivo, as well as the cellular and molecular determinants controlling the learning speed across brain areas and in different contexts. These elucidations could uncover additional components of cellular and synaptic-based learning rules and would allow the development of more physiological models of fast learning.
Statements
Author contributions
CP wrote the “Fast Learning Behaviors, Neuronal Activity During Fast Learning, Fast Learning-Induced Neuronal Long-term Changes, Deconstructing Fast Learning Synaptic Plasticity Mechanisms, and Reconstructing Fast Learning in Neuronal Networks” sections and designed (Figures 1, 2). JT wrote the “A Computational Perspective on a Fast Learning” section and designed Figure 2. LV edited all versions of the manuscript and designed the Figures 1, 2. All authors contributed to the article and approved the submitted version.
Funding
CP was supported by Ecole Normale Supérieure PhD fellowship. This work was supported by grants from the Fondation du Collège de France and the CRCPEN.
Acknowledgments
We thank Gaëtan Vignoud and Nicolas Gervasi for helpful suggestions and critical comments.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- BLA
basolateral amygdala
- CTA
conditioned taste aversion
- eCB
endocannabinoid
- EPSP
excitatory postsynaptic potential
- LTD
long-term depression
- LTP
long-term potentiation
- mPFC
medial prefrontal cortex
- NMDAR
N-methyl-D-aspartate receptor
- NMDAR-LTP
NMDAR-mediated LTP
- STDP
spike-timing-dependent plasticity.
Abbreviations
References
1
Armstrong C. M. DeVito L. M. Cleland T. A. (2006). One-trial associative odor learning in neonatal mice. Chem. Senses31, 343–349. 10.1093/chemse/bjj038
2
Bi A.-L. Wang Y. Li B.-Q. Wang Q.-Q. Ma L. Yu H. et al . (2010). Region-specific involvement of actin rearrangement-related synaptic structure alterations in conditioned taste aversion memory. Learn. Mem.17, 420–427. 10.1101/lm.1772310
3
Biederman I. (1987). Recognition-by-components: a theory of human image understanding. Psychol. Rev.94, 115–147. 10.1037/0033-295X.94.2.115
4
Bittner K. C. Milstein A. D. Grienberger C. Romani S. Magee J. C. (2017). Behavioral time scale synaptic plasticity underlies CA1 place fields. Science357, 1033–1036. 10.1126/science.aan3846
5
Botvinick M. B. Ritter S. Wang J. X. Kurth-Nelson Z. Blundell C. Hassabis D. (2019). Reinforcement learning, fast, and slow. Trends Cogn. Sci.23, 408–422. 10.1016/j.tics.2019.02.006
6
Brea J. Gerstner W. (2016). Does computational neuroscience need new synaptic learning paradigms?Curr. Opin. Behav. Sci.11, 61–66. 10.1016/j.cobeha.2016.05.012
7
Brodt S. Gais S. Beck J. Erb M. Scheffler K. Schönauer M. (2018). Fast track to the neocortex: a memory engram in the posterior parietal cortex. Science362, 1045–1048. 10.1126/science.aau2528
8
Brown M. W. Banks P. J. (2015). In search of a recognition memory engram. Neurosci. Biobehav. Rev.50, 12–28. 10.1016/j.neubiorev.2014.09.016
9
Buschman T. J. Miller E. K. (2014). Goal-direction and top-down control. Philos. Trans. R. Soc. B. Biol. Sci.369:20130471. 10.1098/rstb.2013.0471
10
Carey S. Bartlett E. (1978). Acquiring a single new word. Proc. Stanf. Child Lang. Conf.15, 17–29.
11
Carr M. F. Jadhav S. P. Frank L. M. (2011). Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat. Neurosci.14, 147–153. 10.1038/nn.2732
12
Ceballo S. Bourg J. Kempf A. Piwkowska Z. Daret A. Pinson P. et al . (2019). Cortical recruitment determines learning dynamics and strategy. Nat. Commun.10:1479. 10.1038/s41467-019-09450-0
13
Choi J.-H. Sim S.-E. Kim J.-I. Choi D. I. Oh J. Ye S. et al . (2018). Interregional synaptic maps among engram cells underlie memory formation. Science360, 430–435. 10.1126/science.aas9204
14
Choi G. B. Stettler D. D. Kallman B. R. Bhaskar S. T. Fleischmann A. Axel R. (2011). Driving opposing behaviors with ensembles of piriform neurons. Cell146, 1004–1015. 10.1016/j.cell.2011.07.041
15
Clarke J. R. Cammarota M. Gruart A. Izquierdo I. Delgado-Garcia J. M. (2010). Plastic modifications induced by object recognition memory processing. Proc. Natl. Acad. Sci. U S A107, 2652–2657. 10.1073/pnas.0915059107
16
Clayton N. S. Griffiths D. P. Emery N. J. Dickinson A. (2001). Elements of episodic-like memory in animals. Philos. Trans. R. Soc. B. Biol. Sci.356, 1483–1491. 10.1098/rstb.2001.0947
17
Cohen-Matsliah S. I. Rosenblum K. Barkai E. (2009). Olfactory-learning abilities are correlated with the rate by which intrinsic neuronal excitability is modulated in the piriform cortex. Eur. J. Neurosci.30, 1339–1348. 10.1111/j.1460-9568.2009.06894.x
18
Cook R. Fagot J. (2009). First trial rewards promote 1-trial learning and prolonged memory in pigeon and baboon. Proc. Natl. Acad. Sci. U S A106, 9530–9533. 10.1073/pnas.0903378106
19
Costa R. M. Cohen D. Nicolelis M. A. L. (2004). Differential corticostriatal plasticity during fast and slow motor skill learning in mice. Curr. Biol.14, 1124–1134. 10.1016/j.cub.2004.06.053
20
Crestani A. P. Krueger J. N. Barragan E. V. Nakazawa Y. Nemes S. E. Quillfeldt J. A. et al . (2018). Metaplasticity contributes to memory formation in the hippocampus. Neuropsychopharmacology44, 408–414. 10.1038/s41386-018-0096-7
21
Cromer J. A. Machon M. Miller E. K. (2011). Rapid association learning in the primate prefrontal cortex in the absence of behavioral reversals. J. Cogn. Neurosci.23, 1823–1828. 10.1162/jocn.2010.21555
22
Cui Y. Paillé V. Xu H. Genet S. Delord B. Fino E. et al . (2015). Endocannabinoids mediate bidirectional striatal spike-timing-dependent plasticity. J. Physiol.593, 2833–2849. 10.1113/JP270324
23
Cui Y. Perez S. Venance L. (2018a). Endocannabinoid-LTP mediated by CB1 and TRPV1 receptors encodes for limited occurrences of coincident activity in neocortex. Front. Cell. Neurosci.12:182. 10.3389/fncel.2018.00182
24
Cui Y. Prokin I. Mendes A. Berry H. Venance L. (2018b). Robustness of STDP to spike timing jitter. Sci. Rep.8:8139. 10.1038/s41598-018-26436-y
25
Cui Y. Prokin I. Xu H. Delord B. Genet S. Venance L. et al . (2016). Endocannabinoid dynamics gate spike-timing dependent depression and potentiation. eLife5:e13185. 10.7554/eLife.13185
26
DeNardo L. A. Liu C. D. Allen W. E. Adams E. L. Friedmann D. Fu L. et al . (2019). Temporal evolution of cortical ensembles promoting remote memory retrieval. Nat. Neurosci.22, 460–469. 10.1038/s41593-018-0318-7
27
Denny C. A. Kheirbek M. A. Alba E. L. Tanaka K. F. Brachman R. A. Laughman K. B. et al . (2014). Hippocampal memory traces are differentially modulated by experience, time, and adult neurogenesis. Neuron83, 189–201. 10.1016/j.neuron.2014.05.018
28
Durstewitz D. Vittoz N. M. Floresco S. B. Seamans J. K. (2010). Abrupt transitions between prefrontal neural ensemble states accompany behavioral transitions during rule learning. Neuron66, 438–448. 10.1016/j.neuron.2010.03.029
29
Duszkiewicz A. J. McNamara C. G. Takeuchi T. Genzel L. (2019). Novelty and dopaminergic modulation of memory persistence: a tale of two systems. Trends Neurosci.42, 102–114. 10.1016/j.tins.2018.10.002
30
Edeline J. M. Pham P. Weinberger N. M. (1993). Rapid development of learning-induced receptive field plasticity in the auditory cortex. Behav. Neurosci.107, 539–551. 10.1037//0735-7044.107.4.539
31
Ennaceur A. Delacour J. (1988). A new one-trial test for neurobiological studies of memory in rats. 1: behavioral data. Behav. Brain Res.31, 47–59. 10.1016/0166-4328(88)90157-x
32
Epsztein J. Brecht M. Lee A. K. (2011). Intracellular determinants of hippocampal CA1 place and silent cell activity in a novel environment. Neuron70, 109–120. 10.1016/j.neuron.2011.03.006
33
Escobar M. L. Alcocer I. Bermúdez-Rattoni F. (2002). In vivo effects of intracortical administration of NMDA and metabotropic glutamate receptors antagonists on neocortical long-term potentiation and conditioned taste aversion. Behav. Brain Res.129, 101–106. 10.1016/s0166-4328(01)00329-1
34
Fellini L. Morellini F. (2013). Mice create what-where-when hippocampus-dependent memories of unique experiences. J. Neurosci.33, 1038–1043. 10.1523/JNEUROSCI.2280-12.2013
35
Finn C. Abbeel P. Levine S. (2017). Model-agnostic meta-learning for fast adaptation of deep networks. arXiv:1703.03400 [Preprint].
36
Fried I. MacDonald K. A. Wilson C. L. (1997). Single neuron activity in human hippocampus and amygdala during recognition of faces and objects. Neuron18, 753–765. 10.1016/s0896-6273(00)80315-3
37
Fritz J. Shamma S. Elhilali M. Klein D. (2003). Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex. Nat. Neurosci.6, 1216–1223. 10.1038/nn1141
38
Froemke R. C. Merzenich M. M. Schreiner C. E. (2007). A synaptic memory trace for cortical receptive field plasticity. Nature450, 425–429. 10.1038/nature06289
39
Froemke R. C. Tsay I. A. Raad M. Long J. D. Dan Y. (2006). Contribution of individual spikes in burst-induced long-term synaptic modification. J. Neurophysiol.95, 1620–1629. 10.1152/jn.00910.2005
40
Fusi S. Drew P. J. Abbott L. F. (2005). Cascade models of synaptically stored memories. Neuron45, 599–611. 10.1016/j.neuron.2005.02.001
41
Gangarossa G. Perez S. Dembitskaya Y. Prokin I. Berry H. Venance L. (2020). BDNF controls bidirectional endocannabinoid plasticity at corticostriatal synapses. Cereb. Cortex30, 197–214. 10.1093/cercor/bhz081
42
Graves A. Wayne G. Danihelka I. (2014). Neural turing machines. arXiv:1410.5401 [Preprint].
43
Han J.-H. Kushner S. A. Yiu A. P. Hsiang H.-L. L. Buch T. Waisman A. et al . (2009). Selective erasure of a fear memory. Science323, 1492–1496. 10.1126/science.1164139
44
Harlow I. M. Donaldson D. I. (2013). Source accuracy data reveal the thresholded nature of human episodic memory. Psychon. Bull. Rev.20, 318–325. 10.3758/s13423-012-0340-9
45
Hebb D. (1949). The Organization of Behavior.New York, NY: Wiley.
46
Hebscher M. Wing E. Ryan J. Gilboa A. (2019). Rapid cortical plasticity supports long-term memory formation. Trends Cogn. Sci.23, 989–1002. 10.1016/j.tics.2019.09.009
47
Hoffman K. L. McNaughton B. L. (2002). Coordinated reactivation of distributed memory traces in primate neocortex. Science297, 2070–2073. 10.1126/science.1073538
48
Hofstetter S. Friedmann N. Assaf Y. (2016). Rapid language-related plasticity: microstructural changes in the cortex after a short session of new word learning. Brain Struct. Funct.222, 1231–1241. 10.1007/s00429-016-1273-2
49
Holthoff K. Kovalchuk Y. Yuste R. Konnerth A. (2004). Single-shock LTD by local dendritic spikes in pyramidal neurons of mouse visual cortex. J. Physiol.560, 27–36. 10.1113/jphysiol.2004.072678
50
Hromádka T. DeWeese M. R. Zador A. M. (2008). Sparse representation of sounds in the unanesthetized auditory cortex. PLoS Biol.6:e16. 10.1371/journal.pbio.0060016
51
Huerta P. T. Lisman J. E. (1995). Bidirectional synaptic plasticity induced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron15, 1053–1063. 10.1016/0896-6273(95)90094-2
52
Ison M. J. Quian Quiroga R. Fried I. (2015). Rapid encoding of new memories by individual neurons in the human brain. Neuron87, 220–230. 10.1016/j.neuron.2015.06.016
53
Izquierdo I. Quillfeldt J. A. Zanatta M. S. Quevedo J. Schaeffer E. Schmitz P. K. et al . (1997). Sequential role of hippocampus and amygdala, entorhinal cortex and parietal cortex in formation and retrieval of memory for inhibitory avoidance in rats. Eur. J. Neurosci.9, 786–793. 10.1111/j.1460-9568.1997.tb01427.x
54
Jacoby L. L. (1991). A process dissociation framework: separating automatic from intentional uses of memory. J. Mem. Lang.30, 513–541. 10.1016/0749-596x(91)90025-f
55
Jadhav S. P. Wolfe J. Feldman D. E. (2009). Sparse temporal coding of elementary tactile features during active whisker sensation. Nat. Neurosci.12, 792–800. 10.1038/nn.2328
56
Josselyn S. A. Köhler S. Frankland P. W. (2015). Finding the engram. Nat. Rev. Neurosci.16, 521–534. 10.1038/nrn4000
57
Josselyn S. A. Tonegawa S. (2020). Memory engrams: recalling the past and imagining the future. Science367:eaaw4325. 10.1126/science.aaw4325
58
Kaiser L. Nachum O. Roy A. Bengio S. (2017). Learning to remember rare events. arXiv:1703.03129 [Preprint].
59
Karni A. Meyer G. Rey-Hipolito C. Jezzard P. Adams M. Turner R. et al . (1998). The acquisition of skilled motor performance: fast and slow experience-driven changes in primary motor cortex. Proc. Natl. Acad. Sci. U S A95, 861–868. 10.1073/pnas.95.3.861
60
Kitamura T. Ogawa S. Roy D. Okuyama T. Morrissey M. Smith L. et al . (2017). Engrams and circuits crucial for systems consolidation of a memory. Science356, 73–78. 10.1126/science.aam6808
61
Krahe R. Gabbiani F. (2004). Burst firing in sensory systems. Nat. Rev. Neurosci.5, 13–23. 10.1038/nrn1296
62
Lake B. Salakhutdinov R. Gross J. Tenenbaum J. (2011). “One shot learning of simple visual concepts,” in Proceedings of the 33rd Annual Conference of the Cognitive Science Society, Phoenix, AZ, 172.
63
Lake B. Salakhutdinov R. Tenenbaum J. (2015). Human-level concept learning through probabilistic program induction. Science350, 1332–1338. 10.1126/science.aab3050
64
Lake B. Ullman T. Tenenbaum J. Gershman S. (2017). Building machines that learn and think like people. Behav. Brain Sci.40:e253. 10.1017/S0140525X16001837
65
Lavi K. Jacobson G. Rosenblum K. Lüthi A. (2018). Encoding of conditioned taste aversion in cortico-amygdala circuits. Cell Rep.24, 278–283. 10.1016/j.celrep.2018.06.053
66
Law A. Rivlis G. Schieber M. (2014). Rapid acquisition of novel interface control by small ensembles of arbitrarily selected primary motor cortex neurons. J. Neurophysiol.112, 1528–1548. 10.1152/jn.00373.2013
67
Lee D. Lin B. Lee A. (2012). Hippocampal place fields emerge upon single-cell manipulation of excitability during behavior. Science337, 849–853. 10.1126/science.1221489
68
Lee S. O’Doherty J. Shimojo S. (2015). Neural computations mediating one-shot learning in the human brain. PLoS Biol.13:e1002137. 10.1371/journal.pbio.1002137
69
Leimer P. Herzog M. Senn W. (2019). Synaptic weight decay with selective consolidation enables fast learning without catastrophic forgetting. BioRxiv:613265 [Preprint].
70
Letzkus J. Wolff S. Meyer E. Tovote P. Courtin J. Herry C. et al . (2011). A disinhibitory microcircuit for associative fear learning in the auditory cortex. Nature480, 331–335. 10.1038/nature10674
71
Likhtik E. Johansen J. (2019). Neuromodulation in circuits of aversive emotional learning. Nat. Neurosci.22, 1586–1597. 10.1038/s41593-019-0503-3
72
Lisman J. (1997). Bursts as a unit of neural information: making unreliable synapses reliable. Trends Neurosci.20, 38–43. 10.1016/S0166-2236(96)10070-9
73
Liu X. Ramirez S. Pang P. Puryear C. Govindarajan A. Deisseroth K. et al . (2012). Optogenetic stimulation of a hippocampal engram activates fear memory recall. Nature484, 381–385. 10.1038/nature11028
74
Louise Faber E. S. Delaney A. J. Sah P. (2005). SK channels regulate excitatory synaptic transmission and plasticity in the lateral amygdala. Nat. Neurosci.8, 635–641. 10.1038/nn1450
75
Manita S. Miyakawa H. Kitamura K. Murayama M. (2017). Dendritic spikes in sensory perception. Front. Cell. Neurosci.11:29. 10.3389/fncel.2017.00029
76
Mao H. Yuan Y. Si J. (2019). Cortical neural modulation by previous trial outcome differentiates fast- from slow-learning rats on a visuomotor directional choice task. J. Neurophysiol.121, 50–60. 10.1152/jn.00950.2016
77
Matos M. R. Visser E. Kramvis I. van der Loo R. Gebuis T. Zalm R. et al . (2019). Memory strength gates the involvement of a CREB-dependent cortical fear engram in remote memory. Nat. Commun.10:2315. 10.1038/s41467-019-10266-1
78
McClelland J. McNaughton B. O’Reilly R. (1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol. Rev.102, 419–457. 10.1037/0033-295X.102.3.419
79
McCloskey M. Cohen N. (1989). Catastrophic interference in connectionist networks: the sequential learning problem. Psychol. Learn. Motiv.24, 109–165. 10.1016/s0079-7421(08)60536-8
80
McKay B. Matthews E. Oliveira F. Disterhoft J. (2009). Intrinsic neuronal excitability is reversibly altered by a single experience in fear conditioning. J. Neurophysiol.102, 2763–2770. 10.1152/jn.00347.2009
81
Mehta M. Quirk M. Wilson M. (2000). Experience-dependent asymmetric shape of hippocampal receptive fields. Neuron25, 707–715. 10.1016/s0896-6273(00)81072-7
82
Messinger A. Squire L. Zola S. Albright T. (2001). Neuronal representations of stimulus associations develop in the temporal lobe during learning. Proc. Natl. Acad. Sci. U S A98, 12239–12244. 10.1073/pnas.211431098
83
Millman D. Murthy V. (2020). Rapid learning of odor-value association in the olfactory striatum. J. Neurosci.40, 4335–4347. 10.1523/JNEUROSCI.2604-19.2020
84
Miyashita T. Kubik S. Haghighi N. Steward O. Guzowski J. (2009). Rapid activation of plasticity-associated gene transcription in hippocampal neurons provides a mechanism for encoding of one-trial experience. J. Neurosci.29, 898–906. 10.1523/JNEUROSCI.4588-08.2009
85
Moser E. Moser M. Andersen P. (1993). Synaptic potentiation in the rat dentate gyrus during exploratory learning. Neuroreport5, 317–320. 10.1097/00001756-199312000-00035
86
Moyer J. R. Jr. Thompson L. T. Disterhoft J. F. (1996). Trace eyeblink conditioning increases CA1 excitability in a transient and learning-specific manner. J. Neurosci.16, 5536–5546. 10.1523/JNEUROSCI.16-17-05536.1996
87
Muellbacher W. Ziemann U. Wissel J. Dang N. Kofler M. Facchini S. et al . (2002). Early consolidation in human primary motor cortex. Nature415, 640–644. 10.1038/nature712
88
Nakazawa K. Sun L. Quirk M. Rondi-Reig L. Wilson M. Tonegawa S. (2003). Hippocampal CA3 NMDA receptors are crucial for memory acquisition of one-time experience. Neuron38, 305–315. 10.1016/s0896-6273(03)00165-x
89
Nonaka A. Toyoda T. Miura Y. Hitora-Imamura N. Naka M. Eguchi M. et al . (2014). Synaptic plasticity associated with a memory engram in the basolateral amygdala. J. Neurosci.34, 9305–9309. 10.1523/JNEUROSCI.4233-13.2014
90
O’Connor D. Peron S. Huber D. Svoboda K. (2010). Neural activity in barrel cortex underlying vibrissa-based object localization in mice. Neuron67, 1048–1061. 10.1016/j.neuron.2010.08.026
91
O’Keefe J. Recce M. (1993). Phase relationship between hippocampal place units and the EEG theta rhythm. Hippocampus3, 317–330. 10.1002/hipo.450030307
92
Ólafsdóttir H. Bush D. Barry C. (2018). The role of hippocampal replay in memory and planning. Curr. Biol.28, R37–R50. 10.1016/j.cub.2017.10.073
93
Pan S. Yang Q. (2009). A survey on transfer learning. IEEE Trans. Knowledge Data Eng.22, 1345–1359. 10.1109/TKDE.2009.191
94
Pasupathy A. Miller E. (2005). Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature433, 873–876. 10.1038/nature03287
95
Pennartz C. Lee E. Verheul J. Lipa P. Barnes C. McNaughton B. (2004). The ventral striatum in off-line processing: ensemble reactivation during sleep and modulation by hippocampal ripples. J. Neurosci.24, 6446–6456. 10.1523/JNEUROSCI.0575-04.2004
96
Perez L. Wang J. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv:1712.04621 [Preprint].
97
Perich M. Gallego J. Miller L. (2018). A neural population mechanism for rapid learning. Neuron100, 964.e7–976.e7. 10.1016/j.neuron.2018.09.030
98
Petersen C. Malenka R. Nicoll R. Hopfield J. (1998). All-or-none potentiation at CA3-CA1 synapses. Proc. Natl. Acad. Sci. U S A95, 4732–4737. 10.1073/pnas.95.8.4732
99
Pike F. Meredith R. Olding A. Paulsen O. (1999). Postsynaptic bursting is essential for ‘Hebbian’ induction of associative long-term potentiation at excitatory synapses in rat hippocampus. J. Physiol.518, 571–576. 10.1111/j.1469-7793.1999.0571p.x
100
Qu Z. Song Y. Ding Y. (2010). ERP evidence for distinct mechanisms of fast and slow visual perceptual learning. Neuropsychologia48, 1869–1874. 10.1016/j.neuropsychologia.2010.01.008
101
Radulovic J. Kammermeier J. Spiess J. (1998). Relationship between Fos production and classical fear conditioning: effects of novelty, latent inhibition and unconditioned stimulus preexposure. J. Neurosci.18, 7452–7461. 10.1523/JNEUROSCI.18-18-07452.1998
102
Ratcliff R. (1990). Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. Psychol. Rev.97, 285–308. 10.1037/0033-295x.97.2.285
103
Remington E. Narain D. Hosseini E. Jazayeri M. (2018). Flexible sensorimotor computations through rapid reconfiguration of cortical dynamics. Neuron98, 1005.e5–1019.e5. 10.1016/j.neuron.2018.05.020
104
Remy S. Spruston N. (2007). Dendritic spikes induce single-burst long-term potentiation. Proc. Natl. Acad. Sci. U S A104, 17192–17197. 10.1073/pnas.0707919104
105
Ribeiro S. Gervasoni D. Soares E. Zhou Y. Lin S. Pantoja J. et al . (2004). Long-lasting novelty-induced neuronal reverberation during slow-wave sleep in multiple forebrain areas. PLoS Biol.2:e24. 10.1371/journal.pbio.0020024
106
Rikhye R. Gilra A. Halassa M. (2018). Thalamic regulation of switching between cortical representations enables cognitive flexibility. Nat. Neurosci.21, 1753–1763. 10.1038/s41593-018-0269-z
107
Ritter S. Wang J. Kurth-Nelson Z. Jayakumar S. Blundell C. Pascanu R. et al . (2018). Been there, done that: meta-learning with episodic recall. Int. Conf. Mach. Learn., 4351–4360.
108
Rodríguez-Durán L. Castillo D. Moguel-González M. Escobar M. (2011). Conditioned taste aversion modifies persistently the subsequent induction of neocortical long-term potentiation in vivo. Neurobiol. Learn. Mem.95, 519–526. 10.1016/j.nlm.2011.03.003
109
Romberg C. Yang S. Melani R. Andrews M. R. Horner A. E. Spillantini M. G. et al . (2013). Depletion of perineuronal nets enhances recognition memory and long-term depression in the perirhinal cortex. J. Neurosci.33, 7057–7065. 10.1523/JNEUROSCI.6267-11.2013
110
Roullet P. Mileusnic R. R. Rose S. Sara S. (1997). Neural cell adhesion molecules play a role in rat memory formation in appetitive as well as aversive tasks. Neuroreport8, 1907–1911. 10.1097/00001756-199705260-00023
111
Rutishauser U. Mamelak A. Schuman E. (2006). Single-trial learning of novel stimuli by individual neurons of the human hippocampus-amygdala complex. Neuron49, 805–813. 10.1016/j.neuron.2006.02.015
112
Saar D. Grossman Y. Barkai E. (1998). Reduced after-hyperpolarization in rat piriform cortex pyramidal neurons is associated with increased learning capability during operant conditioning. Eur. J. Neurosci.10, 1518–1523. 10.1046/j.1460-9568.1998.00149.x
113
Sacchetti B. Lorenzini C. Baldi E. Bucherelli C. Roberto M. Tassoni G. et al . (2002). Time-dependent inhibition of hippocampal LTP in vitro following contextual fear conditioning in the rat. Eur. J. Neurosci.15, 143–150. 10.1046/j.0953-816x.2001.01844.x
114
Sah P. Bekkers J. (1996). Apical dendritic location of slow after hyperpolarization current in hippocampal pyramidal neurons: implications for the integration of long-term potentiation. J. Neurosci.16, 4537–4542. 10.1523/JNEUROSCI.16-15-04537.1996
115
Sananbenesi F. Fischer A. Schrick C. Spiess J. Radulovic J. (2002). Phosphorylation of hippocampal Erk-1/2, Elk-1 and p90-Rsk-1 during contextual fear conditioning: interactions between Erk-1/2 and Elk-1. Mol. Cell. Neurosci.21, 463–476. 10.1006/mcne.2002.1188
116
Santoro A. Bartunov S. Botvinick M. Wierstra D. Lillicrap T. (2016). Meta-learning with memory-augmented neural networks. Int. Conf. Mach. Learn., 1842–1850.
117
Schaul T. Schmidhuber J. (2010). Metalearning. Scholarpedia5:4650.
118
Sehgal M. Ehlers V. L. Moyer J. R. Jr. (2014). Learning enhances intrinsic excitability in a subset of lateral amygdala neurons. Learn. Mem.21, 161–170. 10.1101/lm.032730.113
119
Shu J. Xu Z. Meng D. (2018). Small sample learning in big data era. arXiv:1808.04572 [Preprint].
120
Siniscalchi M. Phoumthipphavong V. Ali F. Lozano M. Kwan A. (2016). Fast and slow transitions in frontal ensemble activity during flexible sensorimotor behavior. Nat. Neurosci.19, 1234–1242. 10.1038/nn.4342
121
Smith S. Smith I. Branco T. Häusser M. (2013). Dendritic spikes enhance stimulus selectivity in cortical neurons in vivo. Nature503, 115–120. 10.1038/nature12600
122
Song C. Detert J. A. Sehgal M. Moyer J. R. Jr. (2012). Trace fear conditioning enhances synaptic and intrinsic plasticity in rat hippocampus. J. Neurophysiol.107, 3397–3408. 10.1152/jn.00692.2011
123
Standing L. Conezio J. Haber R. (1970). Perception and memory for pictures: single-trial learning of 2500 visual stimuli. Psychon. Sci.19, 73–74. 10.3758/BF03337426
124
Steele R. J. Morris R. G. (1999). Delay-dependent impairment of a matching-to-place task with chronic and intrahippocampal infusion of the NMDA-antagonist D-AP5. Hippocampus9, 118–136. 10.1002/(SICI)1098-1063(1999)9:2<118::AID-HIPO4>3.0.CO;2-8
125
Takahashi N. Oertner T. Hegemann P. Larkum M. (2016). Active cortical dendrites modulate perception. Science354, 1587–1590. 10.1126/science.aah6066
126
Tang S. Zhang Y. Li Z. Li M. Liu F. Jiang H. et al . (2018). Large-scale two-photon imaging revealed super-sparse population codes in the V1 superficial layer of awake monkeys. eLife7:e33370. 10.7554/eLife.33370
127
Tayler K. Tanaka K. Reijmers L. Wiltgen B. (2013). Reactivation of neural ensembles during the retrieval of recent and remote memory. Curr. Biol.23, 99–106. 10.1016/j.cub.2012.11.019
128
Titley H. Brunel N. Hansel C. (2017). Toward a neurocentric view of learning. Neuron95, 19–32. 10.1016/j.neuron.2017.05.021
129
Tonegawa S. Liu X. Ramirez S. Redondo R. (2015). Memory engram cells have come of age. Neuron87, 918–931. 10.1016/j.neuron.2015.08.002
130
Tse D. Langston R. Kakeyama M. Bethus I. Spooner P. Wood E. et al . (2007). Schemas and memory consolidation. Science316, 76–82. 10.1126/science.1135935
131
Tse D. Takeuchi T. Kakeyama M. Kajii Y. Okuno H. Tohyama C. et al . (2011). Schema-dependent gene activation and memory encoding in neocortex. Science333, 891–895. 10.1126/science.1205274
132
Tyssowski K. M. DeStefino N. R. Cho J. H. Dunn C. J. Poston R. G. Carty C. E. et al . (2018). Different neuronal activity patterns induce different gene expression programs. Neuron98, 530.e11–546.e11. 10.1016/j.neuron.2018.04.001
133
Vale R. Evans D. Branco T. (2017). Rapid spatial learning controls instinctive defensive behavior in mice. Curr. Biol.27, 1342–1349. 10.1016/j.cub.2017.03.031
134
Venable N. Kelly P. (1990). Effects of NMDA receptor antagonists on passive avoidance learning and retrieval in rats and mice. Psychopharmacology100, 215–221. 10.1007/BF02244409
135
Wang J. Kurth-Nelson Z. Kumaran D. Tirumala D. Soyer H. Leibo J. et al . (2018). Prefrontal cortex as a meta-reinforcement learning system. Nat. Neurosci.21, 860–868. 10.1038/s41593-018-0147-8
136
Wang Y. Yao Q. Kwok J. Ni L. (2020). Generalizing from a few examples: a survey on few-shot learning. arXiv:1904.05046 [Preprint].
137
Weston J. Chopra S. Bordes A. (2014). Memory networks. arXiv:1410.3916 [Preprint].
138
Whitlock J. R. Heynen A. J. Shuler M. G. Bear M. F. (2006). Learning induces long-term potentiation in the hippocampus. Science313, 1093–1097. 10.1126/science.1128134
139
Wilson M. A. McNaughton B. L. (1994). Reactivation of hippocampal ensemble memories during sleep. Science265, 676–679. 10.1126/science.8036517
140
Wittenberg G. Wang S. (2006). Malleability of spike-timing-dependent plasticity at the CA3-CA1 synapse. J. Neurosci.26, 6610–6617. 10.1523/JNEUROSCI.5388-05.2006
141
Xiang J. Brown M. (1998). Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe. Neuropharmacology37, 657–676. 10.1016/s0028-3908(98)00030-6
142
Xu N. Harnett M. T. Williams S. R. Huber D. O’Connor D. H. Svoboda K. et al . (2012). Nonlinear dendritic integration of sensory and motor input during an active sensing task. Nature492, 247–251. 10.1038/nature11601
143
Xu H. Perez S. Cornil A. Detraux B. Prokin I. Cui Y. et al . (2018). Dopamine-endocannabinoid interactions mediate spike-timing-dependent potentiation in the striatum. Nat. Commun.9:4118. 10.1038/s41467-018-06409-5
144
Yang G. R. Joglekar M. R. Song H. F. Newsome W. T. Wang X.-J. (2019). Task representations in neural networks trained to perform many cognitive tasks. Nat. Neurosci.22, 297–306. 10.1038/s41593-018-0310-2
145
Yao H. Shi L. S. Han F. Gao H. Dan Y. (2007). Rapid learning in cortical coding of visual scenes. Nat. Neurosci.10, 772–778. 10.1038/nn1895
146
Yiu A. P. Mercaldo V. Yan C. Richards B. Rashid A. Hsiang H.-L. L. et al . (2014). Neurons are recruited to a memory trace based on relative neuronal excitability immediately before training. Neuron83, 722–735. 10.1016/j.neuron.2014.07.017
147
Yoshida T. Ohki K. (2020). Natural images are reliably represented by sparse and variable populations of neurons in visual cortex. Nat. Commun.11:872. 10.1038/s41467-020-14645-x
148
Zhang J.-C. Lau P.-K. Bi G.-Q. (2009). Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proc. Natl. Acad. Sci. U S A106, 13028–13033. 10.1073/pnas.0900546106
Summary
Keywords
fast learning, one-shot learning (OSL), memory engram, synaptic plasticity (LTP/LTD), neuromodulation, neurocomputational models, artificial intelligence
Citation
Piette C, Touboul J and Venance L (2020) Engrams of Fast Learning. Front. Cell. Neurosci. 14:575915. doi: 10.3389/fncel.2020.575915
Received
24 June 2020
Accepted
24 September 2020
Published
28 October 2020
Volume
14 - 2020
Edited by
Robert C. Froemke, New York University, United States
Reviewed by
Helen Barron, University of Oxford, United Kingdom; Andreas Toft Sørensen, University of Copenhagen, Denmark
Updates
Copyright
© 2020 Piette, Touboul and Venance.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Laurent Venance laurent.venance@college-de-france.fr
Specialty section: This article was submitted to Cellular Neurophysiology, a section of the journal Frontiers in Cellular Neuroscience
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.