Abstract
Lexical selection—both during reading aloud and speech production—involves selecting an intended word, while ignoring irrelevant lexical activation. This process has been studied by the use of interference tasks. Examples are the Stroop task, where participants ignore the written color word and name the color of the ink, picture–word interference tasks, where participants name a picture while ignoring a super-imposed written word, or word–word interference (WWI) tasks, where two words are presented and the participants need to respond to only one, based on an pre-determined visual feature (e.g., color, position). Here, we focus on the WWI task: it is theoretically impossible for existing models to explain how the cognitive system can respond to one stimulus and block the other, when they are presented by the same modality (i.e., they are both words). We describe a solution that can explain performance on the WWI task: drawing on the literature on visual attention, we propose that the system creates an object file for each perceived object, which is continuously updated with increasingly complete information about the stimulus, such as the task-relevant visual feature. Such a model can account for performance on all three tasks.
Introduction
The cognitive system is often confronted with a set of stimuli, where one stimulus requires a response while others need to be ignored. This phenomenon is relevant to the process of lexical selection (): here, a target word needs to be produced, while irrelevant information (e.g., a semantically related word, or the word’s translation for multi-linguals) is ignored. This is only one step in the complex process of speech production, but it has been subject to some attention and controversy (e.g., ; ; ; ).
Here, we consider whether existing models of lexical selection can adequately account for performance on three tasks that have been used to study the process of word selection in speech production: the Stroop task (; ; ), the picture–word interference (PWI) task (; ; ), and the word–word interference (WWI) task (; ; ). These experimental tasks have in common the process of selecting a target, to which the participant needs to respond (e.g., by reading aloud, a lexical decision, or semantic categorization), and the need to ignore an irrelevant stimulus, the distractor. In the Stroop task the target is usually the font color and the distractor is the written color word, for the PWI task the target is a picture and the distractor a super-imposed written word, and for the WWI task the parti-cipants are presented with two words and need to respond to one based on a pre-determined characteristic (e.g., color, position).
A model of how the cognitive system performs selection should be able to explain performance on all three of these tasks. We argue that contemporary theories fail to account for performance on the WWI task, as it is theoretically impossible for the system in these models to ignore a distractor of the same type as a target (i.e., when both are words). We describe a model that can account for performance on all three tasks by creating a token, which combines, for each visual object, its identity with task-relevant visual features. We conclude with a brief discussion of how this model may account for phenomena in the more ecologically valid tasks of speech production and text reading.
In the current paper, we address an issue that arises in interference tasks: how does the system know which potentially activated lexical node belongs to the target, and which to the distractor? This is different—and logically preceding—from asking how relevant lexical entries are activated. The problem here is understanding how a given pattern of activation in memory is linked back to the stimulus evoking it. Ultimately, the task is to respond to only one of the two stimuli simultaneously presented, and so, the system needs to know that a given response corresponds to a given stimulus to decide what to process and what to gate.
Previous Solutions
Any explanation of performance on the Stroop and PWI interference tasks relies on the concept of mental lexicons (; but see , , , for an alternative account of lexical knowledge). To explain the Stroop and PWI tasks, the mental lexicon needs to include three different domain-specific input modules: a color system (CS), a picture lexicon (PL), and an orthographic lexicon (OL). In addition, it needs a semantic system and a phonological output module. Each input module comprises a collection of domain-specific units, where each unit corresponds to a given element in that domain (e.g., each unit in the PL represents the structural description of an object), and is activated if that element is presented as input stimulus. Once a unit in one of the input modules is activated, it sends activation to the connected units in the semantic and phonological modules. In contrast to the units in the CS and PL, units in the OL also directly activate units in the phonological output lexicon, rather than only indirectly via the semantic system.
The existing proposals of performance on the PWI and Stroop are intrinsically linked to the notion of modality-specific input lexicons. These models achieve selective target activation based on a simple principle: in a PWI or Stroop task, the system needs to block the information from the wrong module. The system needs to monitor the activation in the input modules, because monitoring the activation in the later stages (i.e., the semantic system or phonological lexicon) would not provide the means to distinguish between information from different modes of input. Then, the system could deactivate the distractor activation, if it detects that it is sent from the distractor module which, in the case of the Stroop and PWI tasks, is the OL. Such deactivation could be achieved by disrupting processing of a stimulus that is provided by the “wrong” module.
Proposals along these lines have been made by several authors. describe a parallel-distributed-processing computational model that can simulate results from Stroop-like tasks. Task instructions (ignore the written word vs. ignore the color of the font) are implemented as two input units that, via a set of hidden units, increase the activation for their respective target mode, and inhibit the stimulus provided by the distractor mode. WEAVER++ (), a leading computational model of word production, has been programmed to account for results on both Stroop and PWI tasks (). Like the model of the system tracks the input source of each stimulus: When activation spreads along the connections of the model’s network, it leaves activation tags at each node (). These tags specify the source of the activation, and thus, in a PWI experiment, there are tags for both the picture stimulus and for the printed word stimulus: a response is selected only if its source tag corresponds to the picture.
These mechanisms rest on the same basic intuition, that pictures, colors, and printed words are inherently different. If the system can track the nature of a given item, it can distinguish targets from distractors. The identity of each stimulus does not influence these processes, since this would imply that the system knows the identity of the item before recognizing the item itself; instead, it only needs to classify the item in input as a member of the category of pictures (or colors, or printed words).
This family of explanations works when the two stimuli are processed through different input modules, but when the stimuli are of the same nature, it runs into fatal trouble. In a WWI task, participants are presented with two words simultaneously and are required to read one word while ignoring the other. Target and distractor can be distinguished because of their relative spatial position (; ), because of the different colors (), or their temporal order (). Akin to the PWI task, evidence suggests that distractor affects target processing: unrelated low frequency distractors interfere more than unrelated high frequency distractor (), target and distractor frequency exert additive effects on target processing (), and semantically related distractors facilitate target processing (; ). This demonstrates that the distractors activate their orthographic and semantic representations to some extent. Therefore, accounting for the performance in the WWI task requires a mechanism that traces the source of the activation so that the system knows what has been activated by the distractor and what has been activated by the target. This mechanism, however, cannot be monitoring, tagging or biasing activation of a specific input module, because both stimuli in the WWI task are printed words, and activate nodes in the same module.
An Alternative Approach
A model that could perform input control in the Stroop, PWI and WWI tasks would need to achieve the following: (1) at an early processing stage, it needs to assign the task-relevant visual feature to the stimulus, (2) the distractor is processed to some degree, and (3) when articulation occurs, the distractor has been suppressed (in the behavioral data, it is very rare for errors to occur, where the distractor is articulated instead of the target). Furthermore, to reflect psychologically valid mechanisms, the model should be applicable to all three tasks, as well as the extensive literature on visual attention and object recognition ().
This problem has been described by , who stated, about logogen model, that it “lacks a specific mechanism for relating particular logogen outputs to the particular stimuli that evoked them. In particular where more than one word, or nameable item, is presented at the same time, a mechanism is clearly required to integrate appropriately the nominal identities of the items—their logogen output—with their other physical attributes—location, color, size, etc.” (p. 525). proposed solution is a mechanism which binds the word’s pre-categorical perceptual features with the word’s identity, or orthographic features, to form an episode. Once the task-dependent visual characteristics are linked to their respective orthographic information, the system knows which of the two lexical representations correspond to the target and which corresponds to the distractor, and the appropriate decision of what to read and what to ignore can be made. This approach is different from those explicitly proposed to account for interference tasks, because it does not require the tracking the input modes of each stimulus. Importantly, the idea of binding various attributed of the stimulus could be applied to explain how participants perform the WWI task as well as the PWI and Stroop tasks. In the following section, we describe a specified model based on suggestion, and how it could account for performance on interference as well as reading tasks.
Creating Proto-Words: Binding Visual Features
Upon stimulus presentation, the first step for the model is to detect that the display consists of two objects. In the WWI task, the system perceives the words as objects due to their visual distinctiveness compared to the background, and creates abstract representations for each of these objects. This lower-level selection process has been studied in great detail by researchers of visual attention. According to object file theories (e.g., ; ; ), a “file” is created for each object, which can be subsequently filled with continuously updated information about the object’s characteristics. At this stage, the objects have not yet been identified as words, but instead are organized bundles of the visual features of the word (“proto-words” in their terms).
Orthographic Processing
As soon as proto-words are created, orthographic processing can be initiated, as two functionally independent sets of letter detectors—one for each proto-word—are constructed. After the creation of the letter sets, lexical processing can be initiated. The lexical processing stage creates a bottleneck, as only one word can undergo lexical processing at a given point in time (). When the system is faced with multiple written words, it is assumed that the foveated word is prioritized (; ). This attentional gradient reflects the anatomy of the retina, where increasing distance from the fovea results in poorer spatial resolution. A further assumption of the model is that lexical processing is ballistic: once lexical processing of the item is initiated, it cannot be deactivated until identification has occurred.
During lexical processing, entries in the OL are activated, and this activation propagates—in an interactive and cascaded fashion—forward to the subsequent processing levels (). The model posits the presence of an identification threshold in the orthographic input lexicon: as soon as this threshold is reached, the word can be treated as a tokenized instance of the type activation in the OL.
Creating a Token: The Binding Visual and Orthographic Information and the Transfer to Verbal Working Memory
A token thus serves to bind the orthographic information to the specific instance of its occurrence, including the word’s non-orthographic characteristics. This process is based on the Simultaneous Type, Serial Token (TS2) model of . In the TS2 model, the token does not contain the information of the corresponding type: in the case of the WWI task, the token is created once an activation threshold in the OL is reached, meaning that subsequent cascaded processing is still required to activate semantic or phonological information. Thus, the token, rather than containing all of the information that is relevant for word production and semantic processing, acts as a pointer to where this information can be found. Subsequent processing is required to bind the newly created token to the activation in the phonological and semantic lexicons, as well as to its visual, pre-categorical representation. At this stage the system can continue processing that stimulus if it occupies the position of the target, or trigger deactivation if it occupies the position of the distractor. Once the relevant information associated with the token is bound, the task-relevant information is transferred to the phonological loop of working memory (; ). From there, articulation of the target is initiated, and the correct response can be articulated.
Beyond the WWI Task: Relevance of the Model to Other Settings
By using object files and tokens, the model described above proposes a mechanism by which the system can perform the WWI task. As we argue, it is theoretically impossible within existing proposals to account for the fact that the human participants are capable of ignoring a distractor while processing a target when these stem from the same source of input. Furthermore, the model allows for greater flexibility in incorporating visuo-attentional processes which may affect performance on interference tasks. This would provide a fruitful avenue for future research.
Future research is needed to establish how the model can account for performance on the PWI and Stroop tasks. Due to the similar nature of the three tasks, a mechanism explaining performance on one should be applicable to the other task, with relatively minor, task-specific modifications. The principle of creating object files and tokens could theoretically also work for the Stroop and PWI tasks. However, it would be a challenge for the model to create two files for a single visual object. In the case of the Stroop task, for example, the stimulus is a word written in a specific color, and the system needs to create a separate file for two aspects of the same stimulus. Beyond experimental scenarios, it is also worth considering whether the model could be applied to more naturalistic scenarios, and specifically, how it relates to word production and sentence reading.
Interference Tasks and Word Production
The PWI interference task plays a central role in studying lexical selection in speech production (see , for a review). It is argued that the system, when translating a concept node to a phonological word form, needs to block competing word forms, thus posing a similar problem to the system as a PWI task. This view is not uncontroversial: it has been pointed out that in addition, the PWI task requires visuo-attentional, decision and selection processes that are not employed during speech production (; ; ). The degree to which the selection process involved in the PWI, WWI, and Stroop tasks—and in the model—reflects the selection process underlying lexical selection remains an open question. From a methodological perspective, a model which explains at least a proportion of the selection processes underlying the PWI task can help to isolate the task’s non-linguistic components from those that are directly related to the selection of a lexical node during speech production.
Selecting Words During Reading
We argue that the WWI and the model in particular capture a cognitive mechanism that is particularly useful for text reading: namely, selecting a target word while ignoring the information provided by the surrounding words. Generally speaking, a well-specified model which incorporates such visuo-attentional mechanisms as well as higher-level orthographic processing can provide valuable insights and testable predictions about how these processes interact.
Text reading is generally studied with the use of eye-movement tracking. In the literature on reading and eye-movements, the degree to which all words in the visual field are processed is still under debate (e.g., ; ; ). Several studies report when a word is fixated, the subsequent word influences its processing, especially when the fixated word is short. As in the WWI task (), high frequency of the fixated and non-fixated words are facilitatory for target processing (; ) and have an additive effect (; ). Future research could further explore the similarities between performance in the WWI task and in the task of text reading. Given a sufficiently high overlap in the underlying cognitive processing, the WWI could serve as an experimental task to study the processes underlying text reading.
Conclusion
In summary, performance on the Stroop, PWI and WWI tasks reflects an important problem that is relevant to speech production and text reading. In all three tasks, information about the stimulus identity needs to be bound to the task-relevant visual information. We describe a specified model, based on a previous proposal by , that is capable of performing these tasks, and draws from literature of visual attention (; ), object recognition (; ), written word recognition (), speech production (; ; ), and working memory ().
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Statements
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1
AllportD. A. (1977). “On knowing the meaning of words we are unable to report: the effects of visual masking,” in Attention and Performance, Vol. 6, ed. DornicS. (London: Academic Press), 505–533.
2
AngeleB.SchotterE. R.SlatteryT. J.TenenbaumT. L.BicknellK.RaynerK. (2015). Do successor effects in reading reflect lexical parafoveal processing? Evidence from corpus-based and experimental eye movement data. J. Mem. Lang.79, 76–96. 10.1016/j.jml.2014.11.003
3
BowmanH.WybleB. (2007). The simultaneous type, serial token model of temporal attention and working memory. Psychol. Rev.114, 38. 10.1037/0033-295X.114.1.38
4
CarrT. H. (1999). How does WEAVER pay attention?Behav. Brain Sci.22, 39–40. 10.1017/S0140525X99231779
5
CohenJ. D.DunbarK.McClellandJ. L. (1990). On the control of automatic processes: a parallel distributed processing account of the Stroop effect. Psychol. Rev.97, 332. 10.1037/0033-295X.97.3.332
6
ColtheartM. (2004). Are there lexicons?Q. J. Exp. Psychol. A57, 1153–1171. 10.1080/02724980443000007
7
ColtheartM.RastleK.PerryC.LangdonR.ZieglerJ. (2001). DRC: a dual route cascaded model of visual word recognition and reading aloud. Psychol. Rev.108, 204–256. 10.1037//0033-295X.108.1.204
8
ElmanJ. L. (2004). An alternative view of the mental lexicon. Trends Cogn. Sci.8, 301–306. 10.1016/j.tics.2004.05.003
9
ElmanJ. L. (2009). On the meaning of words and dinosaur bones: lexical knowledge without a lexicon. Cogn. Sci.33, 547–582. 10.1111/j.1551-6709.2009.01023.x
10
ElmanJ. L. (2011). Lexical knowledge without a lexicon?Ment. Lex.6, 1. 10.1075/ml.6.1.01elm
11
EngbertR.NuthmannA.RichterE. M.KlieglR. (2005). SWIFT: a dynamical model of saccade generation during reading. Psychol. Rev.112, 777. 10.1037/0033-295X.112.4.777
12
FinkbeinerM.CaramazzaA. (2006). Lexical selection is not a competitive process: a reply to La Heij et al. (2006). Cortex42, 1032–1036. 10.1016/S0010-9452(08)70210-7
13
GlaserW. R.GlaserM. O. (1989). Context effects in Stroop-like word and picture processing. J. Exp. Psychol. Gen.118, 13. 10.1037/0096-3445.118.1.13
14
HayworthK. J.LescroartM. D.BiedermanI. (2011). Neural encoding of relative position. J. Exp. Psychol. Hum. Percept. Perform.37, 1032. 10.1037/a0022338
15
KahnemanD.TreismanA.GibbsB. J. (1992). The reviewing of object files: object-specific integration of information. Cogn. Psychol.24, 175–219. 10.1016/0010-0285(92)90007-O
16
KennedyA.PynteJ. (2005). Parafoveal-on-foveal effects in normal reading. Vis. Res.45, 153–168. 10.1016/j.visres.2004.07.037
17
KleinG. S. (1964). Semantic power measured through the interference of words with color-naming. Am. J. Psychol.77, 576–588. 10.2307/1420768
18
KlieglR.NuthmannA.EngbertR. (2006). Tracking the mind during reading: the influence of past, present, and future words on fixation durations. J. Exp. Psychol. Gen.135, 12–35. 10.1037/0096-3445.135.1.12
19
La HeijW. (1988). Components of Stroop-like interference in picture naming. Mem. Cogn.16, 400–410. 10.3758/BF03214220
20
La HeijW.HappelB.MulderM. (1990). Components of Stroop-like interference in word reading. Acta Psychol.73, 115–129. 10.1016/0001-6918(90)90074-P
21
La HeijW.KuipersJ.-R.StarreveldP. A. (2006). In defense of the lexical-competition account of picture–word interference: a comment on Finkbeiner and Caramazza (2006). Cortex42, 1028–1031. 10.1016/S0010-9452(08)70209-0
22
LeveltW. J.RoelofsA.MeyerA. S. (1999). A theory of lexical access in speech production. Behav. Brain Sci.22, 1–38. 10.1017/S0140525X99001776
23
LupkerS. J. (1979). The semantic nature of response competition in the picture–word interference task. Mem. Cogn.7, 485–495. 10.3758/BF03198265
24
MacLeodC. M. (1991). Half a century of research on the Stroop effect: an integrative review. Psychol. Bull.109, 163. 10.1037/0033-2909.109.2.163
25
MahonB. Z.CostaA.PetersonR.VargasK. A.CaramazzaA. (2007). Lexical selection is not by competition: a reinterpretation of semantic interference and facilitation effects in the picture–word interference paradigm. J. Exp. Psychol. Learn. Mem. Cogn.33, 503. 10.1037/0278-7393.33.3.503
26
MortonJ. (1969). Interaction of information in word recognition. Psychol. Rev.76, 165. 10.1037/h0027366
27
MulattiC.CeccheriniL.ColtheartM. (2015). What can we learn about visual attention to multiple words from the word–word interference task?Mem. Cogn.43, 121–132. 10.3758/s13421-014-0450-x
28
RoelofsA. (1993). Testing a non-decompositional theory of lemma retrieval in speaking: retrieval of verbs. Cognition47, 59–87.
29
RoelofsA. (2003). Goal-referenced selection of verbal action: modeling attentional control in the Stroop task. Psychol. Rev.110, 88. 10.1037/0033-295X.110.1.88
30
SaitoS.BaddeleyA. D. (2004). Irrelevant sound disrupts speech production: exploring the relationship between short-term memory and experimentally induced slips of the tongue. Q. J. Exp. Psychol. A57, 1309–1340. 10.1080/02724980343000783
31
SchotterE. R.AngeleB.RaynerK. (2012). Parafoveal processing in reading. Attent. Percept. Psychophys.74, 5–35. 10.3758/s13414-011-0219-2
32
SchriefersH.MeyerA. S.LeveltW. J. (1990). Exploring the time course of lexical access in language production: picture–word interference studies. J. Mem. Lang.29, 86–102. 10.1016/0749-596X(90)90011-N
33
SchroyensW.VituF.BrysbaertM.d’YdewalleG. (1999). Eye movement control during reading: foveal load and parafoveal processing. Q. J. Exp. Psychol. A52, 1021–1046. 10.1080/713755859
34
StroopJ. R. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol.18, 643. 10.1037/h0054651
35
WaechterS.BesnerD.StolzJ. A. (2011). Basic processes in reading: spatial attention as a necessary preliminary to orthographic and semantic processing. Vis. Cogn.19, 171–202. 10.1080/13506285.2010.517228
36
XuY.ChunM. M. (2009). Selecting and perceiving multiple visual objects. Trends Cogn. Sci.13, 167–174. 10.1016/j.tics.2009.01.008
Summary
Keywords
word–word interference, picture–word interference, Stroop test, lexical selection by competition, mental lexicon, selective attention
Citation
Schmalz X, Treccani B and Mulatti C (2015) Distinguishing Target From Distractor in Stroop, Picture–Word, and Word–Word Interference Tasks. Front. Psychol. 6:1858. doi: 10.3389/fpsyg.2015.01858
Received
22 May 2015
Accepted
16 November 2015
Published
15 December 2015
Volume
6 - 2015
Edited by
Simone Sulpizio, University of Trento, Italy
Reviewed by
Kyrana Tsapkini, Johns Hopkins Medicine, USA; F-Xavier Alario, Centre National de la Recherche Scientifique – Aix-Marseille Université, France
Updates
Copyright
© 2015 Schmalz, Treccani and Mulatti.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xenia Schmalz, xenia.schmalz@gmail.com
This article was submitted to Language Sciences, a section of the journal Frontiers in Psychology.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.