Skip to main content

GENERAL COMMENTARY article

Front. Psychol., 21 February 2017
Sec. Cognitive Science
This article is part of the Research Topic What Next - The Cognition of Sequences View all 12 articles

Commentary: Distinct neural mechanisms for remembering when an event occurred

  • 1Department of Psychology, New York University, New York, NY, USA
  • 2Center for Neural Science, New York University, New York, NY, USA

A commentary on
Distinct neural mechanisms for remembering when an event occurred

by Jenkins, L. J., and Ranganath, C. (2016). Hippocampus 26, 554–559. doi: 10.1002/hipo.22571

Memory for the relative order of events is a critical feature of episodic remembering that is thought to rely on hippocampal processes (Eichenbaum, 2013; Davachi and DuBrow, 2015). However, there are multiple ways in which the hippocampus may support order memory. Here, we review a recent fMRI paper by Jenkins and Ranganath (2016) investigating two potential memory mechanisms that may support recency discrimination. To briefly summarize, participants were scanned while encoding sequences of object images and were subsequently tested on which of two objects had been presented more recently. The authors examined neural patterns during encoding that predicted later recency judgments and found evidence that item strength and context differentiation support order memory. Our goal here is to provide a theoretical perspective on these and related findings to highlight how numerous mechanisms may support order memory and how fMRI can be leveraged to test competing theories.

Perhaps the most intuitive way to evaluate the order of two items is to compare how strong they are in memory. Since memory strength decays over time, an item's current strength can provide an estimate of how much time passed since it was encountered (Hinrichs, 1970). To determine which of two items occurred more recently, one strategy might be to simply select the one that has the higher activation strength (Hintzman, 2005, c.f. Hintzman, 2010). Jenkins and Ranganath (2016) found evidence in line with a strength-based temporal representation in the prefrontal (PFC) and medial temporal lobe cortices including the perirhinal cortex, which has been consistently implicated in encoding item strength (Aggleton and Brown, 1999; Davachi, 2006; Diana et al., 2007; Eichenbaum et al., 2007). Specifically, these regions showed greater activation during the initial encoding of items later endorsed as more recent regardless of their true temporal position. While these results are consistent an item-strength comparison account of recency judgments, an alternative retrieval process called scanning could show similar effects at encoding. Backwards scanning models propose that memoranda are sequentially sampled from the end until reaching an item with a sufficient match to one of the recency probes (Hacker, 1980; Howard et al., 2015). Thus, if the more recent item was not encoded strongly enough, it could be bypassed in favor of the stronger, earlier item, consistent with the findings of Jenkins and Ranganath.

Another possibility is that recency judgments could be supported by a comparison of the contexts associated with the objects during encoding. Prominent memory theories propose that items are bound to a temporal context representation that gradually changes over time (Howard and Kahana, 2002; Polyn et al., 2009). Jenkins and Ranganath suggest that this representation may be used to guide recency judgments, presumably by a process that compares the retrieved contexts of the two items and selects the item whose associated context is most similar to the current state. The more differentiated the two retrieved contexts are, the easier it should be to make the comparison. The authors find evidence for this “context differentiation” account in bilateral hippocampus as well as in regions of the medial and anterior PFC. Specifically, the more dissimilar the fMRI patterns were during the encoding of the two items, the better performance was on later recency discrimination. Assuming that pattern dissimilarity reflects a change in the intervening context above and beyond differences between the items themselves, this suggests that context differentiation leads to better order memory because the items' contexts are more discriminable at retrieval. Note, however, that neural patterns at retrieval were not examined.

The item strength and context differentiation accounts of order memory are similar in that they are both based on estimating and comparing distances of the two items between encoding and retrieval. However, there are at least two other major classes of theories of temporal representation—those that are based on the absolute time or position at which an event occurred (i.e., location-based) and those that are based on relative time or position (Friedman, 1993). One example of a model that encodes relative position is associative chaining, in which each item in a sequence is directly linked to its neighbors (e.g., Lewandowsky and Murdock, 1989). The temporal context theories described above are actually closely related to associative chaining. However, rather than employing direct item-item links, temporal context theory proposes that neighboring items are linked indirectly through their associated context representation (Howard and Kahana, 2002). These associations allow an item's retrieved context to elicit retrieval of nearby items that share a similar temporal context. Thus, an alternate account of temporal context in recency judgments might predict that retrieving the context associated with the recency items may lead to the reactivation of the intervening sequence, since the intervening items share context with both recency probes. These sequential associations may in turn provide the relative order information necessary to make accurate recency judgments. Note, a similar retrieval process applied to a location-based temporal representation (e.g., Howard et al., 2015) could also retrieve sequential associations with more absolute temporal precision.

There is evidence supporting this associative account of recency discrimination in episodic memory from both behavioral and fMRI work. Behaviorally, intervening boundaries have been shown to disrupt associative binding (Zwaan and Radvansky, 1998; Ezzyat and Davachi, 2011) and impair order memory (DuBrow and Davachi, 2013; Horner et al., 2016). There is also evidence that, when making recency judgments, the intervening sequence is incidentally reactivated (DuBrow and Davachi, 2013, 2014). Importantly, in this design, hippocampal pattern similarity was related to successful recency judgments (DuBrow and Davachi, 2014) in contrast to the hippocampal pattern dissimilarity reported by Jenkins and Ranganath. One possibility is that these conflicting results may be due to differences in the processes engaged during encoding. DuBrow and Davachi promoted the use of associative encoding, which has been shown to influence behavioral and neural order memory effects (Konishi et al., 2006; Jonker and Macleod, 2016). In contrast, the use of a single stimulus category in Jenkins and Ranganath may have promoted a differentiation strategy. Indeed, hippocampal differentiation of items that share similar features or associates has been shown to lead to better memory (LaRocque et al., 2013; Hulbert and Norman, 2015; Schlichting et al., 2015; Favila et al., 2016). Thus, it is not clear to what extent hippocampal patterns in these studies indexed context per se, as opposed to processes that either promote maintenance (pattern similarity) or differentiation (pattern dissimilarity).

The study by Jenkins and Ranganath is an important contribution to the literature on temporal memory (for recent reviews, see Howard and Eichenbaum, 2013; Eichenbaum, 2014; Davachi and DuBrow, 2015; Ranganath and Hsieh, 2016). Together with previous data, this work suggests that no singular mechanism supports all order memory, but instead multiple temporal representations and retrieval mechanisms may coexist. This work also highlights the importance of considering how distinct cognitive processes that can be localized to the same brain region may give rise to similar behaviors, in this case successful order memory, despite different underlying mechanisms. Indeed, while a wealth of data implicates the hippocampus in temporal memory, the mechanisms attributed to it have been wide ranging and include each class of theories discussed above—relative distance supported by context differentiation (Manns et al., 2007; Ezzyat and Davachi, 2014; Jenkins and Ranganath, 2016), relative order supported by sequential binding (Tubridy and Davachi, 2011; Schapiro et al., 2012; DuBrow and Davachi, 2014), and location information supported by positional coding (Hsieh et al., 2014; Kalm and Norris, 2014). In the Jenkins and Ranganath study alone, the hippocampus showed both item strength and context differentiation effects at encoding. Another recent study showed that associative and distance-based order judgments engaged the hippocampus equally (Lieberman et al., 2016). Moving forward by using explicit models to compare the predictions of different temporal memory theories will help specify the precise computational role(s) of a given brain region (e.g., Kalm and Norris, 2014). In addition, collecting data during both encoding and retrieval would allow the underlying representation of temporal order to be evaluated separately from the decision process, and in turn, capture more individual variability in order memory judgments. Manipulating access to temporal information within the same study will also be necessary to determine whether different mechanisms could be employed adaptively depending on available sources of information and current retrieval goals. For example, lengthening the interval between items may flip the relative reliance on associative vs. distance-based information and may be indexed by the influence of pattern similarity vs. dissimilarity, respectively, on accuracy. Ultimately, examining whether and how these processes may tradeoff at different timescales and under various encoding and retrieval conditions will be critical for establishing a comprehensive model of temporal memory.

Author Contributions

All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.

Funding

This work is supported by the National Institute of Mental Health (RO1-MH074692) and the National Science Foundation (DGE 0813964).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Aggleton, J. P., and Brown, M. W. (1999). Episodic memory, amnesia, and the hippocampal-anterior thalamic axis. Behav. Brain Sci. 22, 425–444. doi: 10.1017/S0140525X99002034

PubMed Abstract | CrossRef Full Text | Google Scholar

Davachi, L. (2006). Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16, 693–700. doi: 10.1016/j.conb.2006.10.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Davachi, L., and DuBrow, S. (2015). How the hippocampus preserves order: the role of prediction and context. Trends Cogn. Sci. 19, 92–99. doi: 10.1016/j.tics.2014.12.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Diana, R. A., Yonelinas, A. P., and Ranganath, C. (2007). Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn. Sci. 11, 379–386. doi: 10.1016/j.tics.2007.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

DuBrow, S., and Davachi, L. (2013). The influence of context boundaries on memory for the sequential order of events. J. Exp. Psychol. Gen. 142, 1277–1286. doi: 10.1037/a0034024

PubMed Abstract | CrossRef Full Text | Google Scholar

DuBrow, S., and Davachi, L. (2014). Temporal memory is shaped by encoding stability and intervening item reactivation. J. Neurosci. 34, 13998–14005. doi: 10.1523/JNEUROSCI.2535-14.2014

PubMed Abstract | CrossRef Full Text | Google Scholar

Eichenbaum, H. (2013). Memory on time. Trends Cogn. Sci. 17, 81–88. doi: 10.1016/j.tics.2012.12.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Eichenbaum, H. (2014). Time cells in the hippocampus: a new dimension for mapping memories. Nat. Rev. Neurosci. 15, 732–744. doi: 10.1038/nrn3827

PubMed Abstract | CrossRef Full Text | Google Scholar

Eichenbaum, H., Yonelinas, A., and Ranganath, C. (2007). The medial temporal lobe and recognition memory. Annu. Neview Neurosci. 30, 123–152. doi: 10.1146/annurev.neuro.30.051606.094328

PubMed Abstract | CrossRef Full Text | Google Scholar

Ezzyat, Y., and Davachi, L. (2011). What constitutes an episode in episodic memory? Psychol. Sci. 22, 243–252. doi: 10.1177/0956797610393742

PubMed Abstract | CrossRef Full Text | Google Scholar

Ezzyat, Y., and Davachi, L. (2014). Similarity Breeds Proximity: Pattern Similarity within and across Contexts Is Related to Later Mnemonic Judgments of Temporal Proximity. Neuron 81, 1179–1189. doi: 10.1016/j.neuron.2014.01.042

PubMed Abstract | CrossRef Full Text | Google Scholar

Favila, S. E., Chanales, A. J. H., and Kuhl, B. A. (2016). Experience-dependent hippocampal pattern differentiation prevents interference during subsequent learning. Nat. Commun. 7:11066. doi: 10.1038/ncomms11066

PubMed Abstract | CrossRef Full Text | Google Scholar

Friedman, W. J. (1993). Memory for the time of past events. Psychol. Bull. 113, 44–66. doi: 10.1037/0033-2909.113.1.44

CrossRef Full Text | Google Scholar

Hacker, M. J. (1980). Speed and accuracy of recency judgments for events in short-term memory. J. Exp. Psychol. Hum. Learn. Mem. 6, 651–675. doi: 10.1037/0278-7393.6.6.651

CrossRef Full Text | Google Scholar

Hinrichs, J. V. (1970). A two-process memory-strength theory for judgment of recency. Psychol. Rev. 77, 223–233. doi: 10.1037/h0029101

CrossRef Full Text | Google Scholar

Hintzman, D. L. (2005). Memory strength and recency judgments. Psychon. Bull. Rev. 12, 858–864. doi: 10.3758/BF03196777

PubMed Abstract | CrossRef Full Text | Google Scholar

Hintzman, D. L. (2010). How does repetition affect memory? Evidence from judgments of recency. Mem. Cognit. 38, 102–115. doi: 10.3758/MC.38.1.102

PubMed Abstract | CrossRef Full Text | Google Scholar

Horner, A. J., Bisby, J. A., Wang, A., Bogus, K., and Burgess, N. (2016). The role of spatial boundaries in shaping long-term event representations. Cognition 154, 151–164. doi: 10.1016/j.cognition.2016.05.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Howard, M. W., and Eichenbaum, H. (2013). The hippocampus, time, and memory across scales. J. Exp. Psychol. Gen. 142, 1211–1230. doi: 10.1037/a0033621

PubMed Abstract | CrossRef Full Text | Google Scholar

Howard, M. W., and Kahana, M. J. (2002). A distributed representation of temporal context. J. Math Psychol. 46, 269–299. doi: 10.1006/jmps.2001.1388

CrossRef Full Text | Google Scholar

Howard, M. W., Shankar, K. H., Aue, W. R., and Criss, A. H. (2015). A distributed representation of internal time. Psychol. Rev. 122, 24–53. doi: 10.1037/a0037840

PubMed Abstract | CrossRef Full Text | Google Scholar

Hsieh, L.-T., Gruber, M. J., Jenkins, L. J., and Ranganath, C. (2014). Hippocampal activity patterns carry information about objects in temporal context. Neuron 81, 1165–1178. doi: 10.1016/j.neuron.2014.01.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Hulbert, J. C., and Norman, K. A. (2015). Neural differentiation tracks improved recall of competing memories following interleaved study and retrieval practice. Cereb. Cortex 25, 3994–4008. doi: 10.1093/cercor/bhu284

PubMed Abstract | CrossRef Full Text | Google Scholar

Jenkins, L. J., and Ranganath, C. (2016). Distinct neural mechanisms for remembering when an event occurred. Hippocampus 26, 554–559. doi: 10.1002/hipo.22571

PubMed Abstract | CrossRef Full Text | Google Scholar

Jonker, T. R., and Macleod, C. M. (2016). Not all order memory is equal : test demands reveal dissociations in memory for sequence information. J. Exp. Psychol. Learn. Mem. Cogn. 43, 177–188. doi: 10.1037/xlm0000301

PubMed Abstract | CrossRef Full Text | Google Scholar

Kalm, K., and Norris, D. (2014). The representation of order information in auditory-verbal short-term memory. J. Neurosci. 34, 6879–6886. doi: 10.1523/JNEUROSCI.4104-13.2014

PubMed Abstract | CrossRef Full Text | Google Scholar

Konishi, S., Asari, T., Jimura, K., Chikazoe, J., and Miyashita, Y. (2006). Activation shift from medial to lateral temporal cortex associated with recency judgements following impoverished encoding. Cereb. Cortex 16, 469–474. doi: 10.1093/cercor/bhi126

PubMed Abstract | CrossRef Full Text | Google Scholar

LaRocque, K., Smith, M., Carr, V. A., Witthoft, N., Grill-spector, K., and Wagner, A. D. (2013). Global similarity and pattern separation in the human medial temporal lobe predict subsequent memory. J. Neurosci. 33, 5466–5474. doi: 10.1523/JNEUROSCI.4293-12.2013

PubMed Abstract | CrossRef Full Text | Google Scholar

Lewandowsky, S., and Murdock, B. B. (1989). Memory for serial order. Psychol. Rev. 96, 25–57. doi: 10.1037/0033-295X.96.1.25

PubMed Abstract | CrossRef Full Text | Google Scholar

Lieberman, J. S., Kyle, C. T., Schedlbauer, A., Stokes, J., and Ekstrom, A. D. (2016). A tale of two temporal coding strategies: common and dissociable brain regions involved in recency versus associative temporal order retrieval strategies. J. Cogn. Neurosci. doi: 10.1162/jocn_a_01081. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Manns, J. R., Howard, M. W., and Eichenbaum, H. (2007). Gradual changes in hippocampal activity support remembering the order of events. Neuron 56, 530–540. doi: 10.1016/j.neuron.2007.08.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Polyn, S. M., Norman, K. A., and Kahana, M. J. (2009). A context maintenance and retrieval model of organizational processes in free recall. Psychol. Rev. 116, 129–156. doi: 10.1037/a0014420

PubMed Abstract | CrossRef Full Text | Google Scholar

Ranganath, C., and Hsieh, L.-T. (2016). The hippocampus: a special place for time. Ann. N.Y. Acad. Sci. 1369, 93–110. doi: 10.1111/nyas.13043

PubMed Abstract | CrossRef Full Text | Google Scholar

Schapiro, A., Kustner, L., and Turk-Browne, N. (2012). Shaping of object representations in the human medial temporal lobe based on temporal regularities. Curr. Biol. 22, 1622–1627. doi: 10.1016/j.cub.2012.06.056

PubMed Abstract | CrossRef Full Text | Google Scholar

Schlichting, M. L., Mumford, J. A., and Preston, A. R. (2015). Learning-related representational changes reveal dissociable integration and separation signatures in the hippocampus and prefrontal cortex. Nat. Commun. 6:8151. doi: 10.1038/ncomms9151

PubMed Abstract | CrossRef Full Text | Google Scholar

Tubridy, S., and Davachi, L. (2011). Medial temporal lobe contributions to episodic sequence encoding. Cereb. Cortex 21, 272–280. doi: 10.1093/cercor/bhq092

PubMed Abstract | CrossRef Full Text | Google Scholar

Zwaan, R. A., and Radvansky, G. A. (1998). Situation models in language comprehension and memory. Psychol. Bull. 123, 162–185. doi: 10.1037/0033-2909.123.2.162

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: temporal order memory, temporal context, sequence memory, recency discrimination, hippocampus

Citation: DuBrow S and Davachi L (2017) Commentary: Distinct neural mechanisms for remembering when an event occurred. Front. Psychol. 8:189. doi: 10.3389/fpsyg.2017.00189

Received: 10 June 2016; Accepted: 30 January 2017;
Published: 21 February 2017.

Edited by:

Snehlata Jaswal, L M Thapar School of Management, India

Reviewed by:

Marc Howard, Boston University, USA
Christopher MacDonald, Massachusetts Institute of Technology, USA
Andy C. H. Lee, University of Toronto Scarborough, Canada
Gabriel Radvansky, University of Notre Dame, USA

Copyright © 2017 DuBrow and Davachi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sarah DuBrow, sdubrow@nyu.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.