Impact Factor 2.089

The world's most-cited Multidisciplinary Psychology journal

Opinion ARTICLE

Front. Psychol., 06 March 2017 | https://doi.org/10.3389/fpsyg.2017.00222

Pre-Cueing Effects: Attention or Mental Imagery?

  • 1Philosophy and Cognitive Neuroscience Research Unit, Aarhus University, Aarhus, Denmark
  • 2Centre for Philosophical Psychology, University of Antwerp, Antwerp, Belgium
  • 3Department of Philosophy, University of Antwerp, Antwerp, Belgium
  • 4Peterhouse, University of Cambridge, Cambridge, England

Attention and Cognitive Penetrability

Much has been written recently about cognitive penetration. If there are perceptual computations that are directly influenced by the information content of certain cognitive states such that the changes in the output of these computations can be accounted for in terms of the content of the penetrating cognitive states, we can talk about the cognitive penetration of perceptual processing.1

When considering the possible mechanisms that could mediate cognitive penetration, attention, traditionally, is quickly sidelined as a phenomenon that is trivially unable to exert the right kind of effect on perception. Even if the allocation of goal-directed (top-down, endogenous) attention is driven by the content of certain cognitive states (i.e., goal representations), it does not have a direct influence on perceptual processing itself. For, according to the traditional characterization, attention acts as a filter, a gatekeeper (Broadbent, 1958), or a spotlight (Posner, 1980) that selects and enhances certain signals (corresponding to attended stimuli) while attenuating or filtering out competing signals “prior to the operation of early vision” (Pylyshyn, 1999: p. 344).

This traditional understanding has recently been questioned by empirical findings demonstrating that attention is not a passive gatekeeper mechanism acting before the start of perceptual processing, but rather an active modulator of perceptual computations that is able to exert many different effects at many different levels of the perceptual hierarchy (see e.g., Reynolds and Chelazzi, 2004; Nanay, 2010b; Noudoost et al., 2010; Carrasco, 2011, 2014; Lupyan, 2015; Wu, in press).

However, despite this transition from seeing attention as passive gatekeeper to seeing it as an active modulator, opponents still argue against attention-mediated cognitive penetration on the basis of the filter-like nature of attention. As Firestone and Scholl have recently put it, attending is “importantly analogous to seeing through a tinted lens —merely increasing sensitivity to certain features rather than others” (Firestone and Scholl, 2017: p. 23, but see also Lupyan, in press).

Pre-Cueing and Attentional Modulation

Thinking about attention as a filter, even in the light of recent experimental data and conceptual shift is supported by some of the empirical findings.

At the behavioral level, attention increases processing efficiency: The allocation of attention enhances detection rates, speeds reaction times, increases accuracy (Posner, 1980; Posner et al., 1980; Castiello and Umiltà, 1990; Carrasco, 2011). Neural level studies suggest that attention achieves all these by enhancing the neural signals encoding the stimulus-features in question, i.e., by modulating the behavior of sensory neurons in various ways, including amplifying neural responses (Carrasco, 2011), sharpening response functions (Martinez-Trujillo and Treue, 2004; Maunsell and Treue, 2006), and remapping receptive fields (Anton-Erxleben and Carrasco, 2013). Most importantly from our present perspective, attention amplifies neural responses via multiplicative effects like evoking response gain or contrast gain, and also via additive effects like increasing baseline activity (Buracas and Boynton, 2007; Carrasco, 2011; Cutrone et al., 2014).

Pre-stimulus cues increase related baseline activity well before the occurrence of the stimulus (Chawla et al., 1999; Reynolds et al., 2000). This enhanced baseline or spontaneous activity correlates with increased behavioral performance such that subjects with large modulation of baseline activity perform better once the stimulus is presented (Giesbrecht et al., 2006). That is, with a pre-stimulus boost of the spontaneous activity of neurons tuned toward a target the sensitivity of these neurons is increased, and therefore stimulus processing is enhanced.

One way of describing these findings, and one that is standard in the literature, is that this is an attentional effect. When attention is turned toward a specific spatial region or a particular feature value, the activity of cortical neurons selectively responding to the specific spatial region or particular feature value increases. Pre-cueing studies show that this can even be true without the presence of any stimuli in the specific region or with the particular feature. In those cases, top-down attentional modulation increases the activity of those neurons which are sensitive to the spatial position or feature value indicated by the endogenous pre-cue. Since this process is driven by cognitive contents, this provides a nice demonstration of the cognitive penetration of perception by attention.

However, if we construe these studies this way, then the concept of attention at play here will be attention that does act very much like a filter—not as a mere gatekeeper simply letting through some stimuli while blocking others, but as a more advanced filter that is able to modulate certain features of the light passing through it. Also note that attention exerts this effect before stimulus presentation, i.e., well before the start of stimulus processing. That is, in these cases it seems that the opponent of attention mediated cognitive penetration could run a very simple objection: Attention does not seem to affect perceptual processing itself, not at least in a direct way; it only increases the sensitivity of processing units, readying them for the stimuli to come. In short, everything the pre-cueing studies show us about attention would be consistent with a Pylyshyn-esque picture of cognitive impenetrability: There are top-down attentional effects at the entry-level of perceptual processing, but not afterwards.

Pre-Cueing and Mental Imagery

As we have seen, the claim that pre-cueing studies show that perception is cognitively penetrated by means of attentional mechanisms is problematic. Nevertheless, we do want to argue that pre-cueing studies show that perception is cognitively penetrated—not via the mediation of attention, but via mental imagery. In what follows we will argue that cue-induced mental imagery provides a channel through which cognitive states can exert such effects on perception that fulfill the requirements of cognitive penetration.

The concept of mental imagery has been controversial, but we want to use a fairly non-demanding characterization, going back to Kosslyn, Behrmann, and Jeannerod: “Visual mental imagery is “seeing” in the absence of the appropriate immediate sensory input, auditory mental imagery is “hearing” in the absence of the immediate sensory input, and so on. Imagery is distinct from perception, which is the registration of physically present stimuli.” (Kosslyn et al., 1995, p. 1335). This is the sense in which contemporary psychology and neuroscience (but not philosophy) talks about mental imagery. Just one example from a recent review article: “We use the term “mental imagery” to refer to representations […] of sensory information without a direct external stimulus” (Pearson et al., 2015). We can summarize this concept as “perceptual processing that is not triggered by corresponding sensory stimulation in the relevant sense-modality” (Nanay, 2016).

Note that mental imagery, understood this way does not have to be voluntary, it is often involuntary (in flash-backs or in the case of earworms). It does not have to be conscious either (if sensory stimulation-driven perceptual processing can be unconscious, then so can perceptual processing that is not triggered by corresponding sensory stimulation). And while it is typically driven by top-down information, it can also be triggered laterally (by information in another sense modality) or in a bottom-up manner (as in the case of the blind spot, where the information is provided by the regions of the retina around the blind spot). It is also important to note that by “perceptual processing” what is meant in these definitions is “early cortical processing”—in the case of the visual sense modality, for example, we have early cortical activation in the primary visual cortex that does not correspond to the retinal activation.

Pre-cueing studies could be interpreted in this theoretical framework as instances of mental imagery: Pre-cueing induces early perceptual processing (as early as V1) that is not triggered by corresponding sensory stimulation in the relevant sense modality (that is, by corresponding retinal activation). In other words, given the definition of mental imagery above, pre-cueing induces mental imagery of the pre-cued feature. This is true of pre-cueing for a number of features, such as shape, color, and motion (see Shibata et al., 2008 for a good summary, see also Zhuang and Papathomas, 2011).

Mental imagery interacts with the perceptual processing of stimuli at all relevant stages of the perceptual hierarchy, starting with the earliest one. Early cortical processing of presented stimulus during mental imagery leads to a mixed imagery/perception state, where the activation of the V1, for example, is partially determined by the visual stimulus and partly by mental imagery. This is the clearest in the studies of illusory contours, where the early perceptual processing of illusory contours (in V1 and V2) is a mixture of amodal completion (which comes out as mental imagery according to our definition) and stimulus-driven processes (Kovács et al., 1995; Sugita, 1999; Bakin et al., 2000; Lee and Nguyen, 2001; Komatsu, 2006; Hedgé et al., 2008; Lommertzen et al., 2009; Vrins et al., 2009; Nanay, 2010a; Smith and Muckli, 2010; Bushnell et al., 2011; Shibata et al., 2011; Lee et al., 2012; Pan et al., 2012; Ban et al., 2013; Emmanouil and Ro, 2014; Hazenberg et al., 2014; Scherzer and Ekroll, 2015).

Some instances of amodal completion may be fully bottom-up driven, like the completion of simple shapes purely on the basis of Gestalt forms (that can go against our best judgments). But some other times, amodal completion is driven in a top-down manner, for example, in the case of seeing the cat behind the picket fence. Depending on what cats I encountered before, the way I complete this figure would be very different. The same goes for the amodal completion of letters and words.

One experimentally controlled study of top-down driven amodal completion (that is, mental imagery according to the definition above) and the way it interacts with perception comes from studies of how we perceive two-tone pictures before and after information is given about what the picture is of Teufel et al. (2015). Here, the mental imagery we use to complete the illusory contours very much depends on top-down information and this influences very early (V1) perceptual processing.

Because of the multiple and very early interactions between the perceptual processing of stimuli and mental imagery, mental imagery influences the way stimuli will get processed throughout perception (as opposed to exerting modulatory effects only at the input of early perceptual processing) thereby avoiding Pylyshyn-esque lines of objection. And given that most instances of mental imagery depend on content-driven top-down influences (Macpherson, 2012), this means that mental imagery can modulate perceptual computations in a direct, top-down, content sensitive manner.

This is our argument for the claim that pre-cueing studies show that perception is cognitively penetrated via mental imagery. It is important to be clear about the relation between attention and mental imagery here. We do not want to question the role of attention in pre-cueing studies. After all, it is attention that is being pre-cued. The pre-cue draws attention to certain features, which via top-down connections induces mental imagery for the pre-cued properties, which, then, after stimulus-presentation, interacts with and influences the online computations that process stimulus features. That is, what mediates the cognitive penetration of perceptual processing is not pre-cued attention, but cue-induced mental imagery.

Author Contributions

All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.

Funding

The study was supported by the Danish Council for Independent Research & FP7 Marie Curie Actions - COFUND DFF-Mobilex Mobility Grant 1321-00165, and the FWO Postdoctoral Fellowship 1.2.B39.14N (PF).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Footnotes

1. ^See, for example, the much-cited passage from Zenon Phylyshyn: “if a system is cognitively penetrable then the function it computes is sensitive, in a semantically coherent way, to the organism's goals and beliefs, that is, it can be altered in a way that bears some logical relation to what the person knows” (Pylyshyn, 1999: p. 343). Pylyshyn was interested in the cognitive penetrability of early visual processing, whereas in contemporary discussion the emphasis has been shifted to perceptual processing underlying conscious experiences (Macpherson, 2012, see also Teufel and Nanay, 2017 on the distinction). We will concentrate on the former question here. Recently, Raftopoulos (2009, 2014) has offered a definition of early vision in terms of perceptual processing occurring within 120 ms after stimulus presentation (see also Raftopoulos and Zeimbekis, 2015). Our focus on pre-cueing effects ensures that our claims are applicable even to this characterization of early visual processing.

References

Anton-Erxleben, K., and Carrasco, M. (2013). Attentional enhancement of spatial resolution: linking behavioural and neurophysiological evidence. Nat. Rev. Neurosci. 14, 188–200. doi: 10.1038/nrn3443

PubMed Abstract | CrossRef Full Text | Google Scholar

Bakin, J., Nakayama, K., and Gilbert, C. (2000). Visual responses in monkey areas V1 and V2 to threedimensional surface configurations. J. Neurosci. 20, 8188–8198.

PubMed Abstract | Google Scholar

Ban, H., Yamamoto, H., Hanakawa, T., Urayama, S., Aso, T., Fukuyama, H., et al. (2013). Topographic representation of an occluded object and the effects of spatiotemporal context in human early visual areas. J. Neurosci. 33, 16992–17007. doi: 10.1523/JNEUROSCI.1455-12.2013

PubMed Abstract | CrossRef Full Text | Google Scholar

Broadbent, D. E. (1958). Perception and Communication. Elmsford, NY: Pergamon Press.

Google Scholar

Buracas, G. T., and Boynton, G. M. (2007). The effect of spatial attention on contrast response functions in human visual cortex. J. Neurosci. 27, 93–97. doi: 10.1523/JNEUROSCI.3162-06.2007

PubMed Abstract | CrossRef Full Text | Google Scholar

Bushnell, B. N., Harding, P. J., Kosai, Y., and Pasupathy, A. (2011). Partial occlusion modulates contour-based shape encoding in primate area V4. J. Neurosci. 31, 4012–4024. doi: 10.1523/JNEUROSCI.4766-10.2011

PubMed Abstract | CrossRef Full Text | Google Scholar

Carrasco, M. (2011). Visual attention: The past 25 years. Vision Res. 51, 1484–1525. doi: 10.1016/j.visres.2011.04.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Carrasco, M. (2014). “Spatial covert attention: Perceptual modulation,” in The Oxford Handbook of Attention, eds A. C. Nobre and S. Kastner (Oxford: OUP), 183–230.

Google Scholar

Castiello, U., and Umilttà, C. (1990). Size of the attentional focus and efficiency of processing. Acta Psychol. 73, 195–209.

PubMed Abstract | Google Scholar

Chawla, D., Rees, G., and Friston, K. J. (1999). The physiological basis of attentional modulation in extrastriate visual areas. Nat. Neurosci. 2, 671–676.

PubMed Abstract | Google Scholar

Cutrone, E. K., Heeger, D. J., and Carrasco, M. (2014). Attention enhances contrast appearance via increased input baseline of neural responses. J. Vis. 14:16. doi: 10.1167/14.14.16

PubMed Abstract | CrossRef Full Text | Google Scholar

Emmanouil, T., and Ro, T. (2014). Amodal completion of unconsciously presented objects. Psychon. Bull. Rev. 21, 1188–1194. doi: 10.3758/s13423-014-0590-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Firestone, C., and Scholl, B. (2017). Cognition does not affect perception: evaluating the evidence for “top-down” effects. Behav. Brain Sci. doi: 10.1017/S0140525X15000965. [Epub ahead of print].

CrossRef Full Text | Google Scholar

Giesbrecht, B., Weissman, D. H., Woldorff, M. G., and Mangun, G. R. (2006). Pre-target activity in visual cortex predicts behavioral performance on spatial and feature attention tasks. Brain Res. 1080, 63–72. doi: 10.1016/j.brainres.2005.09.068

PubMed Abstract | CrossRef Full Text | Google Scholar

Hazenberg, S. J., Jongsma, M. L., Koning, A., and van Lier, R. (2014). Differential familiarity effects in amodal completion: support from behavioral and electrophysiological measurements. J. Exp. Psychol. Hum. Percept. Perform. 40, 669–684. doi: 10.1037/a0034689

PubMed Abstract | CrossRef Full Text | Google Scholar

Hedgé, J., Fang, F., Murray, S. O., and Kersten, D. (2008). Preferential responses to occluded objects in the human visual cortex. J. Vis. 8, 16–35. doi: 10.1167/8.4.16

CrossRef Full Text

Komatsu, H. (2006). The neural mechanisms of perceptual filling-in. Nat. Rev. Neurosci. 7, 220–231. doi: 10.1038/nrn1869

PubMed Abstract | CrossRef Full Text | Google Scholar

Kosslyn, S. M., Behrmann, M., and Jeannerod, M. (1995). The cognitive neuroscience of mental imagery. Neuropsychologia 33, 1335–1344.

PubMed Abstract

Kovács, G., Vogels, R., and Orban, G. A. (1995). Selectivity of macaque inferior temporal neurons for partially occluded shapes. J. Neurosci. 15, 1984–1997.

PubMed Abstract | Google Scholar

Lee, S. H., Kwan, A. C., Zhang, S., Phoumthipphavong, V., Flannery, J. G., Masmanidis, S. C., et al. (2012). Activation of specific interneurons improves V1 feature selectivity and visual perception. Nature 488 379–383. doi: 10.1038/nature11312

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, T. S., and Nguyen, M. (2001). Dynamics of subjective contour formation in the early visual cortex. Proc. Natl. Acad. Sci. U.S.A. 98, 1907–1911. doi: 10.1073/pnas.98.4.1907

PubMed Abstract | CrossRef Full Text | Google Scholar

Lommertzen, J., Van Lier, R., and Meulenbroek, R. (2009). Grasping partly occluded objects: effects of global stimulus information on Action. Perception 38, 200–214.

PubMed Abstract | Google Scholar

Lupyan, G. (2015). Cognitive penetrability of perception in the age of prediction: predictive systems are penetrable systems. Rev. Philos. Psychol. 6, 547–569. doi: 10.1007/s13164-015-0253-4

CrossRef Full Text | Google Scholar

Lupyan, G. (in press). Not even wrong: the “it's just X” fallacy. Behav. Brain Sci. doi: 10.1017/S0140525X15002721

CrossRef Full Text | Google Scholar

Macpherson, F. (2012). Cognitive penetration of colour experience: rethinking the issue in light of an indirect mechanism. Philos. Phenomenol. Res. 84, 24–62. doi: 10.1111/j.1933-1592.2010.00481.x

CrossRef Full Text | Google Scholar

Martinez-Trujillo, J. C., and Treue, S. (2004). Feature-based attention increases the selectivity of population responses in primate visual cortex. Curr. Biol. 14, 744–751. doi: 10.1016/j.cub.2004.04.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Maunsell, J. H. R., and Treue, S. (2006). Feature-based attention in visual cortex. Trends Neurosci. 29, 317–322. doi: 10.1016/j.tins.2006.04.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Nanay, B. (2010a). Perception and imagination: amodal perception as mental imagery. Philos. Stud. 150, 239–254. doi: 10.1007/s11098-009-9407-5

CrossRef Full Text | Google Scholar

Nanay, B. (2010b). Attention and perceptual content. Analysis 70, 263–270. doi: 10.1093/analys/anp165

CrossRef Full Text | Google Scholar

Nanay, B. (2016). Hallucination as mental imagery. J. Conscious. Stud. 23, 65–81.

Google Scholar

Noudoost, B., Chang, M. H., Steinmetz, N. A., and Moore, T. (2010). Top-down control of visual attention. Curr. Opin. Neurobiol. 20, 183–190. doi: 10.1016/j.conb.2010.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Pan, Y., Chen, M., Yin, J., An, X., Zhang, X., Lu, Y., et al. (2012). Equivalent representation of real and illusory contours in macaque V4. J. Neurosci. 32, 6760–6770. doi: 10.1523/JNEUROSCI.6140-11.2012

PubMed Abstract | CrossRef Full Text | Google Scholar

Pearson, J., Naselaris, T., Holmes, E. A., and Kosslyn, S. M. (2015). Mental imagery: functional mechanisms and clinical applications. Trends Cogn. Sci. 19, 590–602. doi: 10.1016/j.tics.2015.08.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Posner, M. I. (1980). Orienting of attention. Q. J. Exp. Psychol. 32, 3–25.

PubMed Abstract | Google Scholar

Posner, M. I., Snyder, C. R. R., and Davidson, B. J. (1980). Attention and the detection of signals. J. Exp. Psychol. Gen. 109, 160–174.

PubMed Abstract | Google Scholar

Pylyshyn, Z. (1999). Is vision continuous with cognition? The case for cognitive impenetrability of visual perception. Behav. Brain Sci. 22, 341–365.

PubMed Abstract | Google Scholar

Raftopoulos, A. (2009). Cognition and Perception. Cambridge, MA: MIT Press.

Google Scholar

Raftopoulos, A. (2014). The cognitive impenetrability of the content of early vision is a necessary and sufficient condition for purely nonconceptual content. Philos. Psychol. 27, 601–620. doi: 10.1080/09515089.2012.729486

CrossRef Full Text | Google Scholar

Raftopoulos, A., and Zeimbekis, J. (2015). “The cognitive penetrability of perception—An overview,” in The Cognitive Penetrability of Perception: New Philosophical Perspectives, eds J. Zembeiskis and T. Raftopolous (Oxford: OUP), 1–56.

Reynolds, J. H., and Chelazzi, L. (2004). Attentional modulation of visual processing. Annu. Rev. Neurosci. 27, 611–647. doi: 10.1146/annurev.neuro.26.041002.131039

PubMed Abstract | CrossRef Full Text | Google Scholar

Reynolds, J. H., Pasternak, T., and Desimone, R. (2000). Attention increases sensitivity of V4 neurons. Neuron 26, 703–714.

PubMed Abstract | Google Scholar

Scherzer, T. R., and Ekroll, V. (2015). Partial modal completion under occlusion: what do modal and amodal percepts represent. J. Vis. 15, 1–20. doi: 10.1167/15.1.22

PubMed Abstract | CrossRef Full Text | Google Scholar

Shibata, K., Watanabe, T., Sasaki, Y., and Kawato, M. (2011). Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation. Science 334, 1413–1415. doi: 10.1126/science.1212003

PubMed Abstract | CrossRef Full Text | Google Scholar

Shibata, K., Yamagishi, N., Goda, N., Yoshioka, T., Yamashita, O., Sato, M., et al. (2008). The effects of feature attention on prestimulus cortical activity in the human visual system. Cereb. Cortex 18, 1664–1675. doi: 10.1093/cercor/bhm194

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, F. W., and Muckli, L. (2010). Nonstimulated early visual areas carry information about surrounding context. Proc. Natl. Acad. Sci. U.S.A. 107, 20099–20103. doi: 10.1073/pnas.1000233107

PubMed Abstract | CrossRef Full Text | Google Scholar

Sugita, Y. (1999). Grouping of image fragments in primary visual cortex. Nature 401, 269–272.

PubMed Abstract | Google Scholar

Teufel, C., and Nanay, B. (2017). How to (and how not to) think about top-down influences on perception. Conscious. Cogn. 47, 17–25. doi: 10.1016/j.concog.2016.05.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Teufel, C., Subramaniam, N., Dobler, V., Perez, J., Finnemann, J., Mehta, P. R., et al. (2015). Shift toward prior knowledge confers a perceptual advantage in early psychosis and psychosis-prone healthy individuals. Proc. Natl. Acad. Sci. U.S.A. 112, 13401–13406. doi: 10.1073/pnas.1503916112

PubMed Abstract | CrossRef Full Text | Google Scholar

Vrins, S., De Wit, T. C. J., and Van Lier, R. (2009). Bricks, butter, and slices of cucumber: investigating semantic influences in amodal completion. Perception 38, 17–29.

PubMed Abstract | Google Scholar

Wu, W. (in press). Shaking up the mind's ground floor: the cognitive penetration of visual attention. J. Philos.

Google Scholar

Zhuang, X., and Papathomas, T. V. (2011). Cue relevance effects in conjunctive visual search: cueing for location, color and orientation. J. Vis. 11:6. doi: 10.1167/11.7.6

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: attentional modulation, baseline activity, filtering, mental imagery, cognitive penetration

Citation: Fazekas P and Nanay B (2017) Pre-Cueing Effects: Attention or Mental Imagery? Front. Psychol. 8:222. doi: 10.3389/fpsyg.2017.00222

Received: 23 September 2016; Accepted: 06 February 2017;
Published: 06 March 2017.

Edited by:

Athanassios Raftopoulos, University of Cyprus, Cyprus

Reviewed by:

John Zeimbekis, University of Patras, Greece

Copyright © 2017 Fazekas and Nanay. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Peter Fazekas, peter.fazekas@cas.au.dk