Sarah DuBrow
Lila Davachi- 1Department of Psychology, New York University, New York, NY, USA
- 2Center for Neural Science, New York University, New York, NY, USA
A commentary on
Distinct neural mechanisms for remembering when an event occurred
by Jenkins, L. J., and Ranganath, C. (2016). Hippocampus 26, 554–559. doi: 10.1002/hipo.22571
Memory for the relative order of events is a critical feature of episodic remembering that is thought to rely on hippocampal processes (Eichenbaum, 2013; Davachi and DuBrow, 2015). However, there are multiple ways in which the hippocampus may support order memory. Here, we review a recent fMRI paper by Jenkins and Ranganath (2016) investigating two potential memory mechanisms that may support recency discrimination. To briefly summarize, participants were scanned while encoding sequences of object images and were subsequently tested on which of two objects had been presented more recently. The authors examined neural patterns during encoding that predicted later recency judgments and found evidence that item strength and context differentiation support order memory. Our goal here is to provide a theoretical perspective on these and related findings to highlight how numerous mechanisms may support order memory and how fMRI can be leveraged to test competing theories.
Perhaps the most intuitive way to evaluate the order of two items is to compare how strong they are in memory. Since memory strength decays over time, an item's current strength can provide an estimate of how much time passed since it was encountered (Hinrichs, 1970). To determine which of two items occurred more recently, one strategy might be to simply select the one that has the higher activation strength (Hintzman, 2005, c.f. Hintzman, 2010). Jenkins and Ranganath (2016) found evidence in line with a strength-based temporal representation in the prefrontal (PFC) and medial temporal lobe cortices including the perirhinal cortex, which has been consistently implicated in encoding item strength (Aggleton and Brown, 1999; Davachi, 2006; Diana et al., 2007; Eichenbaum et al., 2007). Specifically, these regions showed greater activation during the initial encoding of items later endorsed as more recent regardless of their true temporal position. While these results are consistent an item-strength comparison account of recency judgments, an alternative retrieval process called scanning could show similar effects at encoding. Backwards scanning models propose that memoranda are sequentially sampled from the end until reaching an item with a sufficient match to one of the recency probes (Hacker, 1980; Howard et al., 2015). Thus, if the more recent item was not encoded strongly enough, it could be bypassed in favor of the stronger, earlier item, consistent with the findings of Jenkins and Ranganath.
Another possibility is that recency judgments could be supported by a comparison of the contexts associated with the objects during encoding. Prominent memory theories propose that items are bound to a temporal context representation that gradually changes over time (Howard and Kahana, 2002; Polyn et al., 2009). Jenkins and Ranganath suggest that this representation may be used to guide recency judgments, presumably by a process that compares the retrieved contexts of the two items and selects the item whose associated context is most similar to the current state. The more differentiated the two retrieved contexts are, the easier it should be to make the comparison. The authors find evidence for this “context differentiation” account in bilateral hippocampus as well as in regions of the medial and anterior PFC. Specifically, the more dissimilar the fMRI patterns were during the encoding of the two items, the better performance was on later recency discrimination. Assuming that pattern dissimilarity reflects a change in the intervening context above and beyond differences between the items themselves, this suggests that context differentiation leads to better order memory because the items' contexts are more discriminable at retrieval. Note, however, that neural patterns at retrieval were not examined.
The item strength and context differentiation accounts of order memory are similar in that they are both based on estimating and comparing distances of the two items between encoding and retrieval. However, there are at least two other major classes of theories of temporal representation—those that are based on the absolute time or position at which an event occurred (i.e., location-based) and those that are based on relative time or position (Friedman, 1993). One example of a model that encodes relative position is associative chaining, in which each item in a sequence is directly linked to its neighbors (e.g., Lewandowsky and Murdock, 1989). The temporal context theories described above are actually closely related to associative chaining. However, rather than employing direct item-item links, temporal context theory proposes that neighboring items are linked indirectly through their associated context representation (Howard and Kahana, 2002). These associations allow an item's retrieved context to elicit retrieval of nearby items that share a similar temporal context. Thus, an alternate account of temporal context in recency judgments might predict that retrieving the context associated with the recency items may lead to the reactivation of the intervening sequence, since the intervening items share context with both recency probes. These sequential associations may in turn provide the relative order information necessary to make accurate recency judgments. Note, a similar retrieval process applied to a location-based temporal representation (e.g., Howard et al., 2015) could also retrieve sequential associations with more absolute temporal precision.
There is evidence supporting this associative account of recency discrimination in episodic memory from both behavioral and fMRI work. Behaviorally, intervening boundaries have been shown to disrupt associative binding (Zwaan and Radvansky, 1998; Ezzyat and Davachi, 2011) and impair order memory (DuBrow and Davachi, 2013; Horner et al., 2016). There is also evidence that, when making recency judgments, the intervening sequence is incidentally reactivated (DuBrow and Davachi, 2013, 2014). Importantly, in this design, hippocampal pattern similarity was related to successful recency judgments (DuBrow and Davachi, 2014) in contrast to the hippocampal pattern dissimilarity reported by Jenkins and Ranganath. One possibility is that these conflicting results may be due to differences in the processes engaged during encoding. DuBrow and Davachi promoted the use of associative encoding, which has been shown to influence behavioral and neural order memory effects (Konishi et al., 2006; Jonker and Macleod, 2016). In contrast, the use of a single stimulus category in Jenkins and Ranganath may have promoted a differentiation strategy. Indeed, hippocampal differentiation of items that share similar features or associates has been shown to lead to better memory (LaRocque et al., 2013; Hulbert and Norman, 2015; Schlichting et al., 2015; Favila et al., 2016). Thus, it is not clear to what extent hippocampal patterns in these studies indexed context per se, as opposed to processes that either promote maintenance (pattern similarity) or differentiation (pattern dissimilarity).
The study by Jenkins and Ranganath is an important contribution to the literature on temporal memory (for recent reviews, see Howard and Eichenbaum, 2013; Eichenbaum, 2014; Davachi and DuBrow, 2015; Ranganath and Hsieh, 2016). Together with previous data, this work suggests that no singular mechanism supports all order memory, but instead multiple temporal representations and retrieval mechanisms may coexist. This work also highlights the importance of considering how distinct cognitive processes that can be localized to the same brain region may give rise to similar behaviors, in this case successful order memory, despite different underlying mechanisms. Indeed, while a wealth of data implicates the hippocampus in temporal memory, the mechanisms attributed to it have been wide ranging and include each class of theories discussed above—relative distance supported by context differentiation (Manns et al., 2007; Ezzyat and Davachi, 2014; Jenkins and Ranganath, 2016), relative order supported by sequential binding (Tubridy and Davachi, 2011; Schapiro et al., 2012; DuBrow and Davachi, 2014), and location information supported by positional coding (Hsieh et al., 2014; Kalm and Norris, 2014). In the Jenkins and Ranganath study alone, the hippocampus showed both item strength and context differentiation effects at encoding. Another recent study showed that associative and distance-based order judgments engaged the hippocampus equally (Lieberman et al., 2016). Moving forward by using explicit models to compare the predictions of different temporal memory theories will help specify the precise computational role(s) of a given brain region (e.g., Kalm and Norris, 2014). In addition, collecting data during both encoding and retrieval would allow the underlying representation of temporal order to be evaluated separately from the decision process, and in turn, capture more individual variability in order memory judgments. Manipulating access to temporal information within the same study will also be necessary to determine whether different mechanisms could be employed adaptively depending on available sources of information and current retrieval goals. For example, lengthening the interval between items may flip the relative reliance on associative vs. distance-based information and may be indexed by the influence of pattern similarity vs. dissimilarity, respectively, on accuracy. Ultimately, examining whether and how these processes may tradeoff at different timescales and under various encoding and retrieval conditions will be critical for establishing a comprehensive model of temporal memory.
Author Contributions
All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.
Funding
This work is supported by the National Institute of Mental Health (RO1-MH074692) and the National Science Foundation (DGE 0813964).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Aggleton, J. P., and Brown, M. W. (1999). Episodic memory, amnesia, and the hippocampal-anterior thalamic axis. Behav. Brain Sci. 22, 425–444. doi: 10.1017/S0140525X99002034
Davachi, L. (2006). Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16, 693–700. doi: 10.1016/j.conb.2006.10.012
Davachi, L., and DuBrow, S. (2015). How the hippocampus preserves order: the role of prediction and context. Trends Cogn. Sci. 19, 92–99. doi: 10.1016/j.tics.2014.12.004
Diana, R. A., Yonelinas, A. P., and Ranganath, C. (2007). Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn. Sci. 11, 379–386. doi: 10.1016/j.tics.2007.08.001
DuBrow, S., and Davachi, L. (2013). The influence of context boundaries on memory for the sequential order of events. J. Exp. Psychol. Gen. 142, 1277–1286. doi: 10.1037/a0034024
DuBrow, S., and Davachi, L. (2014). Temporal memory is shaped by encoding stability and intervening item reactivation. J. Neurosci. 34, 13998–14005. doi: 10.1523/JNEUROSCI.2535-14.2014
Eichenbaum, H. (2014). Time cells in the hippocampus: a new dimension for mapping memories. Nat. Rev. Neurosci. 15, 732–744. doi: 10.1038/nrn3827
Eichenbaum, H., Yonelinas, A., and Ranganath, C. (2007). The medial temporal lobe and recognition memory. Annu. Neview Neurosci. 30, 123–152. doi: 10.1146/annurev.neuro.30.051606.094328
Ezzyat, Y., and Davachi, L. (2011). What constitutes an episode in episodic memory? Psychol. Sci. 22, 243–252. doi: 10.1177/0956797610393742
Ezzyat, Y., and Davachi, L. (2014). Similarity Breeds Proximity: Pattern Similarity within and across Contexts Is Related to Later Mnemonic Judgments of Temporal Proximity. Neuron 81, 1179–1189. doi: 10.1016/j.neuron.2014.01.042
Favila, S. E., Chanales, A. J. H., and Kuhl, B. A. (2016). Experience-dependent hippocampal pattern differentiation prevents interference during subsequent learning. Nat. Commun. 7:11066. doi: 10.1038/ncomms11066
Friedman, W. J. (1993). Memory for the time of past events. Psychol. Bull. 113, 44–66. doi: 10.1037/0033-2909.113.1.44
Hacker, M. J. (1980). Speed and accuracy of recency judgments for events in short-term memory. J. Exp. Psychol. Hum. Learn. Mem. 6, 651–675. doi: 10.1037/0278-7393.6.6.651
Hinrichs, J. V. (1970). A two-process memory-strength theory for judgment of recency. Psychol. Rev. 77, 223–233. doi: 10.1037/h0029101
Hintzman, D. L. (2005). Memory strength and recency judgments. Psychon. Bull. Rev. 12, 858–864. doi: 10.3758/BF03196777
Hintzman, D. L. (2010). How does repetition affect memory? Evidence from judgments of recency. Mem. Cognit. 38, 102–115. doi: 10.3758/MC.38.1.102
Horner, A. J., Bisby, J. A., Wang, A., Bogus, K., and Burgess, N. (2016). The role of spatial boundaries in shaping long-term event representations. Cognition 154, 151–164. doi: 10.1016/j.cognition.2016.05.013
Howard, M. W., and Eichenbaum, H. (2013). The hippocampus, time, and memory across scales. J. Exp. Psychol. Gen. 142, 1211–1230. doi: 10.1037/a0033621
Howard, M. W., and Kahana, M. J. (2002). A distributed representation of temporal context. J. Math Psychol. 46, 269–299. doi: 10.1006/jmps.2001.1388
Howard, M. W., Shankar, K. H., Aue, W. R., and Criss, A. H. (2015). A distributed representation of internal time. Psychol. Rev. 122, 24–53. doi: 10.1037/a0037840
Hsieh, L.-T., Gruber, M. J., Jenkins, L. J., and Ranganath, C. (2014). Hippocampal activity patterns carry information about objects in temporal context. Neuron 81, 1165–1178. doi: 10.1016/j.neuron.2014.01.015
Hulbert, J. C., and Norman, K. A. (2015). Neural differentiation tracks improved recall of competing memories following interleaved study and retrieval practice. Cereb. Cortex 25, 3994–4008. doi: 10.1093/cercor/bhu284
Jenkins, L. J., and Ranganath, C. (2016). Distinct neural mechanisms for remembering when an event occurred. Hippocampus 26, 554–559. doi: 10.1002/hipo.22571
Jonker, T. R., and Macleod, C. M. (2016). Not all order memory is equal : test demands reveal dissociations in memory for sequence information. J. Exp. Psychol. Learn. Mem. Cogn. 43, 177–188. doi: 10.1037/xlm0000301
Kalm, K., and Norris, D. (2014). The representation of order information in auditory-verbal short-term memory. J. Neurosci. 34, 6879–6886. doi: 10.1523/JNEUROSCI.4104-13.2014
Konishi, S., Asari, T., Jimura, K., Chikazoe, J., and Miyashita, Y. (2006). Activation shift from medial to lateral temporal cortex associated with recency judgements following impoverished encoding. Cereb. Cortex 16, 469–474. doi: 10.1093/cercor/bhi126
LaRocque, K., Smith, M., Carr, V. A., Witthoft, N., Grill-spector, K., and Wagner, A. D. (2013). Global similarity and pattern separation in the human medial temporal lobe predict subsequent memory. J. Neurosci. 33, 5466–5474. doi: 10.1523/JNEUROSCI.4293-12.2013
Lewandowsky, S., and Murdock, B. B. (1989). Memory for serial order. Psychol. Rev. 96, 25–57. doi: 10.1037/0033-295X.96.1.25
Lieberman, J. S., Kyle, C. T., Schedlbauer, A., Stokes, J., and Ekstrom, A. D. (2016). A tale of two temporal coding strategies: common and dissociable brain regions involved in recency versus associative temporal order retrieval strategies. J. Cogn. Neurosci. doi: 10.1162/jocn_a_01081. [Epub ahead of print].
Manns, J. R., Howard, M. W., and Eichenbaum, H. (2007). Gradual changes in hippocampal activity support remembering the order of events. Neuron 56, 530–540. doi: 10.1016/j.neuron.2007.08.017
Polyn, S. M., Norman, K. A., and Kahana, M. J. (2009). A context maintenance and retrieval model of organizational processes in free recall. Psychol. Rev. 116, 129–156. doi: 10.1037/a0014420
Ranganath, C., and Hsieh, L.-T. (2016). The hippocampus: a special place for time. Ann. N.Y. Acad. Sci. 1369, 93–110. doi: 10.1111/nyas.13043
Schapiro, A., Kustner, L., and Turk-Browne, N. (2012). Shaping of object representations in the human medial temporal lobe based on temporal regularities. Curr. Biol. 22, 1622–1627. doi: 10.1016/j.cub.2012.06.056
Schlichting, M. L., Mumford, J. A., and Preston, A. R. (2015). Learning-related representational changes reveal dissociable integration and separation signatures in the hippocampus and prefrontal cortex. Nat. Commun. 6:8151. doi: 10.1038/ncomms9151
Tubridy, S., and Davachi, L. (2011). Medial temporal lobe contributions to episodic sequence encoding. Cereb. Cortex 21, 272–280. doi: 10.1093/cercor/bhq092
Keywords: temporal order memory, temporal context, sequence memory, recency discrimination, hippocampus
Citation: DuBrow S and Davachi L (2017) Commentary: Distinct neural mechanisms for remembering when an event occurred. Front. Psychol. 8:189. doi: 10.3389/fpsyg.2017.00189
Received: 10 June 2016; Accepted: 30 January 2017;
Published: 21 February 2017.
Edited by:
Snehlata Jaswal, L M Thapar School of Management, IndiaReviewed by:
Marc Howard, Boston University, USAChristopher MacDonald, Massachusetts Institute of Technology, USA
Andy C. H. Lee, University of Toronto Scarborough, Canada
Gabriel Radvansky, University of Notre Dame, USA
Copyright © 2017 DuBrow and Davachi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sarah DuBrow, sdubrow@nyu.edu