A commentary has been posted on this article:
Response: Commentary: Pupil old/new effects reflect stimulus encoding and decoding in short-term memory
Alex Kafkas
Daniela Montaldi- Memory Research Unit, Division of Neuroscience and Experimental Psychology, School of Biological Sciences, University of Manchester, Manchester, UK
A commentary on
Pupil old/new effects reflect stimulus encoding and decoding in short-term memory
by Brocher, A., and Graf, T. (2016). Psychophysiology 53, 1823–1835. doi: 10.1111/psyp.127701
The pupil response has emerged as a measure of long-term memory encoding (Kafkas and Montaldi, 2011, 2015a; Papesh et al., 2012) and retrieval (Võ et al., 2008; Kafkas and Montaldi, 2012, 2015b) in recognition memory tasks. At retrieval, the pupil dilates more for old than new stimuli; the pupil old/new effect (Võ et al., 2008). Moreover, pupil response patterns have been found to discriminate between familiar and recollected stimuli (Otero et al., 2011; Kafkas and Montaldi, 2012). Familiarity and recollection are kinds of memory that support an “old” response in a recognition memory task; a recollected stimulus brings to mind associative information from the encoding event, while a familiar stimulus does not. The increased pupil dilation characterizing old stimuli does not just reflect the recovery of associative information (i.e., recollection) as familiar stimuli also produce larger dilation patterns relative to new (Kafkas and Montaldi, 2015b).
Recently, Brocher and Graf (2016) replicated the pupil old/new effect in a series of experiments manipulating variables that have previously been shown to differentially modulate ERP components assumed to be the signatures of familiarity and recollection. Unlike previous research, however, they did not measure familiarity and recollection performance, while still concluding that pupil responses do not distinguish between these forms of memory. Here we discuss several issues of concern regarding terminology, methodology and logic of data interpretation. We note two critical errors in terminology and one critical error of reporting on a published paper. First, Borcher and Graf refer to their retrieval phase, which is in fact a recognition task, as the “recall phase.” This distinction is absolutely critical to memory theory; “recall” involves bringing to mind information, and does not describe the old/new recognition paradigm where such retrieval may occur but is certainly not necessary. Second, as the title suggests, the authors argue that their findings “are compatible with the view that pupil old/new effects reflect strength of memory traces in short-term memory” (Brocher and Graf, 2016, p. 1832), however, their reported experiments only made use of long-term memory paradigms. Short-term memory, characterized by limited capacity and short-term retention was not investigated in their study so the use of the term is inaccurate and misleading. More specifically, although their experiments are characterized by relatively short periods of sustained encoding of a series of items followed immediately by testing, the timing is not consistent with a short-term memory explanation. A short-term memory task, requires that items are tested immediately after one, or at most, a very few presentations, but in the Brocher and Graf tasks, a block of 40 stimuli, which far exceeds the capacity of short-term memory, was encoded before test. This is not to say that short-term memory manipulations can have no potential effect on the pupil response, they may, but Brocher and Graf have not demonstrated this, and their effects can only be attributed to long-term memory. Moreover, their interpretation fails to acknowledge the rapidly growing literature replicating findings showing the sensitivity of the pupil response to long-term memory (Võ et al., 2008; Kafkas and Montaldi, 2011, 2012, 2015a,b; Otero et al., 2011; Papesh et al., 2012). Thirdly, we would like to clarify a point made in relation to our publication (Kafkas and Montaldi, 2015b) which Brocher and Graf discuss. They state that when a simpler decision was made by participants, in Kafkas and Montaldi (2015b), the pupil old/new effect was not replicated. To the contrary, our finding was quite the opposite; we clearly reported that the sensitivity of the pupil to old/new responses was maintained with simple decisions, and was therefore independent of task complexity.
Our final concern relates to a set of assumptions, or inferences, made by Brocher and Graf, which although unjustified, are used to support much of what they conclude regarding recollection and familiarity. The authors overarching assumption is that if a cognitive variable differentially affects the ERP components of familiarity and recollection, then it should also differentially affect the pupil responses. This is a very flawed misconception based on a set of three unsupported assumptions: (a) equivalence between the sources of the ERP signals and pupil response signals, (b) that two distinct ERP components (frontal and parietal) incontrovertibly reflect familiarity and recollection memory, and (c) that the manipulated cognitive variables modulate familiarity and/or recollection in a reliable way across all tasks. In relation to the first assumption, there is no reason to assume equivalence between the ERP and pupil response signals, which are controlled by different neurophysiological systems (e.g., Beatty and Lucero-Wagoner, 2000 for pupil response; Buzsáki et al., 2012 for ERP). EEG measures cortical activity while the pupil response measures autonomic (not central) nervous system activity and provides a summative outcome indicator of underlying cognitive processing whose source cannot be spatially localized. Regarding the second assumption, the specificity of the presumed familiarity and recollection ERP components remains under investigation (as Brocher and Graf themselves imply) and therefore to use them as strong proxies for different forms of memory is unjustified. Indeed this type of reverse inference has been heavily criticized, even with fMRI, where spatial resolution is orders of magnitude better (e.g., Poldrack, 2006). The third assumption involves a similar inference, and is that manipulations of lexicality, valence and word frequency elicit differential effects on familiarity and recollection that are robust, reliable and predictable across all tasks and, when manipulated, can be used to interpret pupil effects as reflecting either recollection, familiarity or both. The logic is clear, but unfortunately, the evidence on which this assumption is based is not strong; first because the relationship between such factors and memory performance or ERPs varies across studies and task demands (see Gardiner and Java, 1990; but see Perfect and Dasgupta, 1997) and second because some of the evidence the authors draw on is very tenuous. For example, their hypothesis in the valance experiment (Experiment 2) is based on the flawed argument that because two studies (Van Strien et al., 2009; Xu et al., 2015) have found stronger old/new familiarity ERP signals (FN400) for either positive or negative pictures, but equally sensitive old/new recollection ERP signals (LPC) for these stimuli, the lack of difference in the pupil old/new effect for positive and negative pictures in their Experiment 2 would imply that the pupil signal reflects recollection. There is no justification for this reverse inference, which is highly misguided.
In conclusion, while Brocher and Graf “challenge the view that pupil old/new effects can be directly mapped onto familiarity and/or recollection” (Brocher and Graf, 2016, p. 1829), we argue that using ERP signals as proxies for behavioral responses, is misleading and falls far short of what is needed to establish the conclusions the authors wish to draw, as does the dependence on predictions derived from ERP old/new effects that have no bearing on pupil activity. We suggest that the minimum requirement to establish this challenge, especially considering the substantial evidence to the contrary, involves directly testing recollection and familiarity while collecting pupil data, as done in other studies. If this were carried out, the authors' conclusions would not be dependent on any of the unsubstantiated assumptions and inferences we highlight.
Author Contributions
AK and DM wrote the paper. Both authors approved the manuscript for publication.
Funding
AK is supported by the Wellcome Trust (Grant number 094597).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
1. ^Psychophysiology, the journal in which Brocher and Graf study was published, does not accept commentaries on published papers; therefore the present commentary was only submitted to Frontiers in Psychology.
References
Beatty, J., and Lucero-Wagoner, B. (2000). “The pupillary system,” in Handbook of Psychophysiology, eds J. T. Cacioppo, L. G. Tassinary, and G. G. Berntson (New York, NY: Cambridge University Press), 142–162.
Brocher, A., and Graf, T. (2016). Pupil old/new effects reflect stimulus encoding and decoding in short-term memory. Psychophysiology 53, 1823–1835. doi: 10.1111/psyp.12770
Buzsáki, G., Anastassiou, C. A., and Koch, C. (2012). The origin of extracellular fields and currents EEG, ECoG, LFP and spikes. Nat. Rev. Neurosci. 13, 407–420. doi: 10.1038/nrn3241
Gardiner, J. M., and Java, R. I. (1990). Recollective experience in word and nonword recognition. Mem. Cognit. 18, 23–30.
Kafkas, A., and Montaldi, D. (2011). Recognition memory strength is predicted by pupillary responses at encoding while fixation patterns distinguish recollection from familiarity. Q. J. Exp. Psychol. 64, 1971–1989. doi: 10.1080/17470218.2011.588335
Kafkas, A., and Montaldi, D. (2012). Familiarity and recollection produce distinct eye movement, pupil and medial temporal lobe responses when memory strength is matched. Neuropsychologia 50, 3080–3093. doi: 10.1016/j.neuropsychologia.2012.08.001
Kafkas, A., and Montaldi, D. (2015a). Striatal and midbrain connectivity with the hippocampus selectively boosts memory for contextual novelty. Hippocampus 25, 1262–1273. doi: 10.1002/hipo.22434
Kafkas, A., and Montaldi, D. (2015b). The pupillary response discriminates between subjective and objective familiarity and novelty. Psychophysiology 52, 1305–1316. doi: 10.1111/psyp.12471
Otero, S. C., Weekes, B. S., and Hutton, S. B. (2011). Pupil size changes during recognition memory. Psychophysiology 48, 1346–1353. doi: 10.1111/j.1469-8986.2011.01217.x
Papesh, M. H., Goldinger, S. D., and Hout, M. C. (2012). Memory strength and specificity revealed by pupillometry. Int. J. Psychophysiol. 83, 56–64. doi: 10.1016/j.ijpsycho.2011.10.002
Perfect, T. J., and Dasgupta, Z. R. (1997). What underlies the deficit in reported recollective experience in old age? Mem. Cognit. 25, 849–858. doi: 10.3758/BF03211329
Poldrack, R. (2006). Can cognitive processes be inferred from neuroimaging data? Trends Cogn. Sci. 10, 59–63. doi: 10.1016/j.tics.2005.12.004
Van Strien, J. W., Langeslag, S. J., Strekalova, N. J., Gootjes, L., and Franken, I. H. (2009). Valence interacts with the early ERP old/new effect and arousal with the sustained ERP old/new effect for affective pictures. Brain Res. 1251, 223–235. doi: 10.1016/j.brainres.2008.11.027
Võ, M. L.-H., Jacobs, A. M., Kuchinke, L., Hofmann, M., Conrad, M., Schacht, A., et al. (2008). The coupling of emotion and cognition in the eye: introducing the pupil old/new effect. Psychophysiology 45, 130–140. doi: 10.1111/j.1469-8986.2007.00606.x
Keywords: pupil response, recognition memory, familiarity, recollection, old/new effect
Citation: Kafkas A and Montaldi D (2017) Commentary: Pupil old/new effects reflect stimulus encoding and decoding in short-term memory. Front. Psychol. 8:277. doi: 10.3389/fpsyg.2017.00277
Received: 31 January 2017; Accepted: 14 February 2017;
Published: 28 February 2017.
Edited by:
Gesualdo M. Zucco, University of Padua, ItalyReviewed by:
Richard Stevenson, Macquarie University, AustraliaCopyright © 2017 Kafkas and Montaldi. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alex Kafkas, alexandros.kafkas@manchester.ac.uk