Memory for the relative order of events is a critical feature of episodic remembering that is thought to rely on hippocampal processes (Eichenbaum, 2013; Davachi and DuBrow, 2015). However, there are multiple ways in which the hippocampus may support order memory. Here, we review a recent fMRI paper by Jenkins and Ranganath (2016) investigating two potential memory mechanisms that may support recency discrimination. To briefly summarize, participants were scanned while encoding sequences of object images and were subsequently tested on which of two objects had been presented more recently. The authors examined neural patterns during encoding that predicted later recency judgments and found evidence that item strength and context differentiation support order memory. Our goal here is to provide a theoretical perspective on these and related findings to highlight how numerous mechanisms may support order memory and how fMRI can be leveraged to test competing theories.
Perhaps the most intuitive way to evaluate the order of two items is to compare how strong they are in memory. Since memory strength decays over time, an item's current strength can provide an estimate of how much time passed since it was encountered (Hinrichs, 1970). To determine which of two items occurred more recently, one strategy might be to simply select the one that has the higher activation strength (Hintzman, 2005, c.f. Hintzman, 2010). Jenkins and Ranganath (2016) found evidence in line with a strength-based temporal representation in the prefrontal (PFC) and medial temporal lobe cortices including the perirhinal cortex, which has been consistently implicated in encoding item strength (Aggleton and Brown, 1999; Davachi, 2006; Diana et al., 2007; Eichenbaum et al., 2007). Specifically, these regions showed greater activation during the initial encoding of items later endorsed as more recent regardless of their true temporal position. While these results are consistent an item-strength comparison account of recency judgments, an alternative retrieval process called scanning could show similar effects at encoding. Backwards scanning models propose that memoranda are sequentially sampled from the end until reaching an item with a sufficient match to one of the recency probes (Hacker, 1980; Howard et al., 2015). Thus, if the more recent item was not encoded strongly enough, it could be bypassed in favor of the stronger, earlier item, consistent with the findings of Jenkins and Ranganath.
Another possibility is that recency judgments could be supported by a comparison of the contexts associated with the objects during encoding. Prominent memory theories propose that items are bound to a temporal context representation that gradually changes over time (Howard and Kahana, 2002; Polyn et al., 2009). Jenkins and Ranganath suggest that this representation may be used to guide recency judgments, presumably by a process that compares the retrieved contexts of the two items and selects the item whose associated context is most similar to the current state. The more differentiated the two retrieved contexts are, the easier it should be to make the comparison. The authors find evidence for this “context differentiation” account in bilateral hippocampus as well as in regions of the medial and anterior PFC. Specifically, the more dissimilar the fMRI patterns were during the encoding of the two items, the better performance was on later recency discrimination. Assuming that pattern dissimilarity reflects a change in the intervening context above and beyond differences between the items themselves, this suggests that context differentiation leads to better order memory because the items' contexts are more discriminable at retrieval. Note, however, that neural patterns at retrieval were not examined.
The item strength and context differentiation accounts of order memory are similar in that they are both based on estimating and comparing distances of the two items between encoding and retrieval. However, there are at least two other major classes of theories of temporal representation—those that are based on the absolute time or position at which an event occurred (i.e., location-based) and those that are based on relative time or position (Friedman, 1993). One example of a model that encodes relative position is associative chaining, in which each item in a sequence is directly linked to its neighbors (e.g., Lewandowsky and Murdock, 1989). The temporal context theories described above are actually closely related to associative chaining. However, rather than employing direct item-item links, temporal context theory proposes that neighboring items are linked indirectly through their associated context representation (Howard and Kahana, 2002). These associations allow an item's retrieved context to elicit retrieval of nearby items that share a similar temporal context. Thus, an alternate account of temporal context in recency judgments might predict that retrieving the context associated with the recency items may lead to the reactivation of the intervening sequence, since the intervening items share context with both recency probes. These sequential associations may in turn provide the relative order information necessary to make accurate recency judgments. Note, a similar retrieval process applied to a location-based temporal representation (e.g., Howard et al., 2015) could also retrieve sequential associations with more absolute temporal precision.
There is evidence supporting this associative account of recency discrimination in episodic memory from both behavioral and fMRI work. Behaviorally, intervening boundaries have been shown to disrupt associative binding (Zwaan and Radvansky, 1998; Ezzyat and Davachi, 2011) and impair order memory (DuBrow and Davachi, 2013; Horner et al., 2016). There is also evidence that, when making recency judgments, the intervening sequence is incidentally reactivated (DuBrow and Davachi, 2013, 2014). Importantly, in this design, hippocampal pattern similarity was related to successful recency judgments (DuBrow and Davachi, 2014) in contrast to the hippocampal pattern dissimilarity reported by Jenkins and Ranganath. One possibility is that these conflicting results may be due to differences in the processes engaged during encoding. DuBrow and Davachi promoted the use of associative encoding, which has been shown to influence behavioral and neural order memory effects (Konishi et al., 2006; Jonker and Macleod, 2016). In contrast, the use of a single stimulus category in Jenkins and Ranganath may have promoted a differentiation strategy. Indeed, hippocampal differentiation of items that share similar features or associates has been shown to lead to better memory (LaRocque et al., 2013; Hulbert and Norman, 2015; Schlichting et al., 2015; Favila et al., 2016). Thus, it is not clear to what extent hippocampal patterns in these studies indexed context per se, as opposed to processes that either promote maintenance (pattern similarity) or differentiation (pattern dissimilarity).
The study by Jenkins and Ranganath is an important contribution to the literature on temporal memory (for recent reviews, see Howard and Eichenbaum, 2013; Eichenbaum, 2014; Davachi and DuBrow, 2015; Ranganath and Hsieh, 2016). Together with previous data, this work suggests that no singular mechanism supports all order memory, but instead multiple temporal representations and retrieval mechanisms may coexist. This work also highlights the importance of considering how distinct cognitive processes that can be localized to the same brain region may give rise to similar behaviors, in this case successful order memory, despite different underlying mechanisms. Indeed, while a wealth of data implicates the hippocampus in temporal memory, the mechanisms attributed to it have been wide ranging and include each class of theories discussed above—relative distance supported by context differentiation (Manns et al., 2007; Ezzyat and Davachi, 2014; Jenkins and Ranganath, 2016), relative order supported by sequential binding (Tubridy and Davachi, 2011; Schapiro et al., 2012; DuBrow and Davachi, 2014), and location information supported by positional coding (Hsieh et al., 2014; Kalm and Norris, 2014). In the Jenkins and Ranganath study alone, the hippocampus showed both item strength and context differentiation effects at encoding. Another recent study showed that associative and distance-based order judgments engaged the hippocampus equally (Lieberman et al., 2016). Moving forward by using explicit models to compare the predictions of different temporal memory theories will help specify the precise computational role(s) of a given brain region (e.g., Kalm and Norris, 2014). In addition, collecting data during both encoding and retrieval would allow the underlying representation of temporal order to be evaluated separately from the decision process, and in turn, capture more individual variability in order memory judgments. Manipulating access to temporal information within the same study will also be necessary to determine whether different mechanisms could be employed adaptively depending on available sources of information and current retrieval goals. For example, lengthening the interval between items may flip the relative reliance on associative vs. distance-based information and may be indexed by the influence of pattern similarity vs. dissimilarity, respectively, on accuracy. Ultimately, examining whether and how these processes may tradeoff at different timescales and under various encoding and retrieval conditions will be critical for establishing a comprehensive model of temporal memory.
Funding
This work is supported by the National Institute of Mental Health (RO1-MH074692) and the National Science Foundation (DGE 0813964).
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Statements
Author contributions
All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AggletonJ. P.BrownM. W. (1999). Episodic memory, amnesia, and the hippocampal-anterior thalamic axis. Behav. Brain Sci.22, 425–444. 10.1017/S0140525X99002034
2
DavachiL. (2006). Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol.16, 693–700. 10.1016/j.conb.2006.10.012
3
DavachiL.DuBrowS. (2015). How the hippocampus preserves order: the role of prediction and context. Trends Cogn. Sci.19, 92–99. 10.1016/j.tics.2014.12.004
4
DianaR. A.YonelinasA. P.RanganathC. (2007). Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn. Sci.11, 379–386. 10.1016/j.tics.2007.08.001
5
DuBrowS.DavachiL. (2013). The influence of context boundaries on memory for the sequential order of events. J. Exp. Psychol. Gen.142, 1277–1286. 10.1037/a0034024
6
DuBrowS.DavachiL. (2014). Temporal memory is shaped by encoding stability and intervening item reactivation. J. Neurosci.34, 13998–14005. 10.1523/JNEUROSCI.2535-14.2014
7
EichenbaumH. (2013). Memory on time. Trends Cogn. Sci.17, 81–88. 10.1016/j.tics.2012.12.007
8
EichenbaumH. (2014). Time cells in the hippocampus: a new dimension for mapping memories. Nat. Rev. Neurosci.15, 732–744. 10.1038/nrn3827
9
EichenbaumH.YonelinasA.RanganathC. (2007). The medial temporal lobe and recognition memory. Annu. Neview Neurosci.30, 123–152. 10.1146/annurev.neuro.30.051606.094328
10
EzzyatY.DavachiL. (2011). What constitutes an episode in episodic memory?Psychol. Sci.22, 243–252. 10.1177/0956797610393742
11
EzzyatY.DavachiL. (2014). Similarity Breeds Proximity: Pattern Similarity within and across Contexts Is Related to Later Mnemonic Judgments of Temporal Proximity. Neuron81, 1179–1189. 10.1016/j.neuron.2014.01.042
12
FavilaS. E.ChanalesA. J. H.KuhlB. A. (2016). Experience-dependent hippocampal pattern differentiation prevents interference during subsequent learning. Nat. Commun.7:11066. 10.1038/ncomms11066
13
FriedmanW. J. (1993). Memory for the time of past events. Psychol. Bull.113, 44–66. 10.1037/0033-2909.113.1.44
14
HackerM. J. (1980). Speed and accuracy of recency judgments for events in short-term memory. J. Exp. Psychol. Hum. Learn. Mem.6, 651–675. 10.1037/0278-7393.6.6.651
15
HinrichsJ. V. (1970). A two-process memory-strength theory for judgment of recency. Psychol. Rev.77, 223–233. 10.1037/h0029101
16
HintzmanD. L. (2005). Memory strength and recency judgments. Psychon. Bull. Rev.12, 858–864. 10.3758/BF03196777
17
HintzmanD. L. (2010). How does repetition affect memory? Evidence from judgments of recency. Mem. Cognit.38, 102–115. 10.3758/MC.38.1.102
18
HornerA. J.BisbyJ. A.WangA.BogusK.BurgessN. (2016). The role of spatial boundaries in shaping long-term event representations. Cognition154, 151–164. 10.1016/j.cognition.2016.05.013
19
HowardM. W.EichenbaumH. (2013). The hippocampus, time, and memory across scales. J. Exp. Psychol. Gen.142, 1211–1230. 10.1037/a0033621
20
HowardM. W.KahanaM. J. (2002). A distributed representation of temporal context. J. Math Psychol.46, 269–299. 10.1006/jmps.2001.1388
21
HowardM. W.ShankarK. H.AueW. R.CrissA. H. (2015). A distributed representation of internal time. Psychol. Rev.122, 24–53. 10.1037/a0037840
22
HsiehL.-T.GruberM. J.JenkinsL. J.RanganathC. (2014). Hippocampal activity patterns carry information about objects in temporal context. Neuron81, 1165–1178. 10.1016/j.neuron.2014.01.015
23
HulbertJ. C.NormanK. A. (2015). Neural differentiation tracks improved recall of competing memories following interleaved study and retrieval practice. Cereb. Cortex25, 3994–4008. 10.1093/cercor/bhu284
24
JenkinsL. J.RanganathC. (2016). Distinct neural mechanisms for remembering when an event occurred. Hippocampus26, 554–559. 10.1002/hipo.22571
25
JonkerT. R.MacleodC. M. (2016). Not all order memory is equal : test demands reveal dissociations in memory for sequence information. J. Exp. Psychol. Learn. Mem. Cogn.43, 177–188. 10.1037/xlm0000301
26
KalmK.NorrisD. (2014). The representation of order information in auditory-verbal short-term memory. J. Neurosci.34, 6879–6886. 10.1523/JNEUROSCI.4104-13.2014
27
KonishiS.AsariT.JimuraK.ChikazoeJ.MiyashitaY. (2006). Activation shift from medial to lateral temporal cortex associated with recency judgements following impoverished encoding. Cereb. Cortex16, 469–474. 10.1093/cercor/bhi126
28
LaRocqueK.SmithM.CarrV. A.WitthoftN.Grill-spectorK.WagnerA. D. (2013). Global similarity and pattern separation in the human medial temporal lobe predict subsequent memory. J. Neurosci.33, 5466–5474. 10.1523/JNEUROSCI.4293-12.2013
29
LewandowskyS.MurdockB. B. (1989). Memory for serial order. Psychol. Rev.96, 25–57. 10.1037/0033-295X.96.1.25
30
LiebermanJ. S.KyleC. T.SchedlbauerA.StokesJ.EkstromA. D. (2016). A tale of two temporal coding strategies: common and dissociable brain regions involved in recency versus associative temporal order retrieval strategies. J. Cogn. Neurosci. [Epub ahead of print]. 10.1162/jocn_a_01081
31
MannsJ. R.HowardM. W.EichenbaumH. (2007). Gradual changes in hippocampal activity support remembering the order of events. Neuron56, 530–540. 10.1016/j.neuron.2007.08.017
32
PolynS. M.NormanK. A.KahanaM. J. (2009). A context maintenance and retrieval model of organizational processes in free recall. Psychol. Rev.116, 129–156. 10.1037/a0014420
33
RanganathC.HsiehL.-T. (2016). The hippocampus: a special place for time. Ann. N.Y. Acad. Sci.1369, 93–110. 10.1111/nyas.13043
34
SchapiroA.KustnerL.Turk-BrowneN. (2012). Shaping of object representations in the human medial temporal lobe based on temporal regularities. Curr. Biol.22, 1622–1627. 10.1016/j.cub.2012.06.056
35
SchlichtingM. L.MumfordJ. A.PrestonA. R. (2015). Learning-related representational changes reveal dissociable integration and separation signatures in the hippocampus and prefrontal cortex. Nat. Commun.6:8151. 10.1038/ncomms9151
36
TubridyS.DavachiL. (2011). Medial temporal lobe contributions to episodic sequence encoding. Cereb. Cortex21, 272–280. 10.1093/cercor/bhq092
37
ZwaanR. A.RadvanskyG. A. (1998). Situation models in language comprehension and memory. Psychol. Bull.123, 162–185. 10.1037/0033-2909.123.2.162
Summary
Keywords
temporal order memory, temporal context, sequence memory, recency discrimination, hippocampus
Citation
DuBrow S and Davachi L (2017) Commentary: Distinct neural mechanisms for remembering when an event occurred. Front. Psychol. 8:189. doi: 10.3389/fpsyg.2017.00189
Received
10 June 2016
Accepted
30 January 2017
Published
21 February 2017
Volume
8 - 2017
Edited by
Snehlata Jaswal, L M Thapar School of Management, India
Reviewed by
Marc Howard, Boston University, USA; Christopher MacDonald, Massachusetts Institute of Technology, USA; Andy C. H. Lee, University of Toronto Scarborough, Canada; Gabriel Radvansky, University of Notre Dame, USA
Updates
Copyright
© 2017 DuBrow and Davachi.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sarah DuBrow sdubrow@nyu.edu
This article was submitted to Cognitive Science, a section of the journal Frontiers in Psychology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.