Abstract
Eye-tracking and electroencephalogram (EEG) recordings provide a window into the human mind. Combining both methods through co-registration offers a powerful and innovative approach for examining how cognitive and neural processes unfold in real time. While both EEG and eye-tracking have independently advanced our understanding of bilingual language processing, co-registration research in the field of bilingualism remains scarce. Given the potential of co-registration methodology to integrate multiple sources of information, this article provides a theoretically and empirically informed perspective on how it can be applied to bilingualism research. Drawing on findings from EEG and eye-tracking studies on bilingual language processing, as well as co-registration research in reading, we identify key areas of bilingualism, such as crosslinguistic activation and inference revision, where co-registration can help address existing gaps. We also discuss several methodological challenges associated with co-registration and offer practical recommendations for its effective implementation in future studies. We conclude that co-registration can move research on bilingual language processing toward a more integrated perspective, one that better captures the dynamic interplay between language and cognition.
1 Introduction
Imagine trying to fully appreciate a symphony by only listening to the violins or percussion instruments separately, rather than listening to how they interact over time. The melody might still be recognizable, but the full depth, aesthetic power, and emotion of the composition would be lost. Similarly, research on bilingual language processing has benefited from behavioral, eye-tracking, and electroencephalogram (EEG) approaches, each offering complementary insights into bilingualism and cognition. Behavioral paradigms involving language switching, picture naming, or priming (e.g., Declerck and Philipp, 2015; Jared and Kroll, 2001; Meuter and Allport, 1999) have been instrumental in characterizing performance outcomes, typically indexed by response times and accuracy rates (Grey and Tagarelli, 2018). However, behavioral outcomes primarily reflect the end products of language processing and not the underlying mechanisms that produce them. To move beyond the limitations of behavioral measures, psycholinguists have widely implemented non-invasive techniques such as eye-tracking and electroencephalography (EEG). Eye-tracking records eye movements and pupil dilation while participants process words or visual scenes, allowing researchers to track, with millisecond precision, gaze direction and duration in real time. From eye-movement recordings, researchers can extract a range of metrics that act as indicators of different stages of linguistic and cognitive processing, from early lexical access (e.g., via first fixation duration) to later processing difficulty (e.g., via regression path duration, pupil dilation). Eye-tracking thus offers a window into how individuals anticipate, process, and integrate linguistic information (Conklin et al., 2018). EEG, on the other hand, records patterns of electrical brain activity through electrodes placed on the scalp. With its high temporal resolution, EEG allows researchers to track the brain processes that underpin language comprehension and production (Light et al., 2010). Event-related potentials (ERPs), derived from EEG recordings, serve as markers of specific cognitive processes and provide precise temporal information about when and how language-related mechanisms are engaged (Kutas and Federmeier, 2011).
Eye-tracking and EEG have each significantly advanced the field of psycholinguistics, improving methodological rigor and precision in the study of language processing (see Payne et al., 2020 for a review on EEG; and Godfroid, 2020 for a review on eye-tracking). Yet, both methods have traditionally been employed in isolation (see Figure 1). Combining EEG and eye-tracking through co-registration allows researchers to leverage the methodological strengths of both techniques to more effectively investigate the effects of language processing on broader cognitive functioning and to investigate the implications of these effects for theoretical models of bilingual language processing. Co-registration improves rigor of experimental research in several ways. First, when EEG and eye-tracking are combined, the information obtained is more than the sum of the individual measures, creating a dataset in which interactions between gaze patterns and brain activity can be examined. Moreover, eye-tracking and EEG provide complementary sources of information: eye-tracking indexes gaze patterns that reflect visual processing, whereas EEG captures patterns of brain activity in response to stimulus processing. By integrating the two methods, researchers can leverage their combined strengths to monitor where attention is directed and for how long, identify the stages of cognitive processing involved, and capture the associated neural responses. In psycholinguistics, co-registration is particularly useful because it enables researchers to record the brain activity of participants during natural viewing tasks, such as reading and scene viewing (Dimigen et al., 2011; Ossandón et al., 2010). As a result, co-registration has the potential to provide fine-grained and ecologically valid insights into the mechanisms underlying language and cognitive processing.
Figure 1
By combining neural and eye-tracking data, co-registration can help evaluate and improve theoretical accounts of bilingual language processing. For instance, experimental studies in bilingualism suggest that during comprehension, both languages are simultaneously activated [i.e., a non-selective view; (Marian and Spivey, 2003a,b; Schwartz and Kroll, 2006)]. These findings have prompted the development of several connectionist and computational models of word comprehension (e.g., Dijkstra and van Heuven, 1998; Dijkstra and Van Heuven, 2002), production (e.g., Kroll and Stewart, 1994), or both (e.g., Dijkstra et al., 2019). In the present review, we adopt the Bilingual Language Interaction Network for Comprehension of Speech (BLINCS; Shook and Marian, 2013) as a framework for illustrating how model-based predictions can be evaluated using co-registration.
BLINCS is a contemporary computational model that builds on earlier monolingual and bilingual interactive frameworks to capture the dynamic nature of bilingual language processing. The model assumes parallel activation of both languages and emphasizes crosslinguistic competition across multiple levels of representation (i.e., phonological, phono-lexical, ortho-lexical and semantic) during spoken word comprehension. BLINCS also incorporates the influence of visual information on language processing. Through bidirectional interactions across levels, the model can be used to generate time-sensitive predictions about how bilinguals allocate attentional resources during speech comprehension, making BLINCS particularly well-suited for evaluation using both neural and eye-tracking techniques (Thierry and Wu, 2007; Shook and Marian, 2012). A central feature of BLINCS is its focus on variability within the bilingual language system. The model incorporates both long-term experiential factors (e.g., age of acquisition, proficiency, language dominance) and short-term contextual factors (e.g., language exposure), as well as lexical properties known to influence language processing (e.g., word frequency, neighborhood density). By linking these sources of variability to dynamic interactions across levels of representation, BLINCS provides a principled framework for testing hypotheses about bilingual language processing. In this context, co-registration allows for a precise examination of the temporal relationship between visual attention and neural processing, capturing in real time the dynamics of crosslinguistic activation during language comprehension.
Despite its strengths, relatively few psycholinguistic studies have employed co-registration. Recently, however, technological improvements have reduced previous limitations (for a review see Beres, 2017), making co-registration a promising new methodology for use in psycholinguistics research. The present article highlights the potential of combining brain activity and eye movement data to address questions in bilingual language processing research. We first outline key findings from bilingualism research that have employed EEG and eye-tracking independently. We then briefly review a sample of studies on co-registration in psycholinguistics and identify theoretical and practical gaps in bilingualism research that could benefit from this approach. Finally, we discuss methodological challenges of integrating EEG and eye-tracking and propose strategies to overcome these barriers to advance psycholinguistic research with bilingual populations.
2 EEG insights into bilingual language processing: current evidence from psycholinguistic research
EEG is widely used in cognitive and linguistic research due to its ability to capture the brain's rapid response to a variety of stimuli while remaining relatively easy to implement and cost-effective (Delogu et al., 2019). Nevertheless, EEG signals are inherently complex, requiring careful preprocessing to isolate the neural patterns associated with specific experimental task conditions. Event-related potentials (ERPs) address this challenge by capturing systematic, time-locked changes in the EEG signal in response to specific events, such as hearing a word, seeing a picture, or making a decision. By averaging EEG responses across events, researchers can identify consistent peaks and valleys (i.e., ERP components) in brain activity that reflect underlying neural processes elicited by each event.
Research using ERPs in language processing has revealed several “canonical” components that are consistently observed across psycholinguistic studies (Payne et al., 2020). While some ERP components are associated with early, perceptual stages of language processing, those emerging in later time windows (200–600 ms) are often sensitive to experimental manipulations that affect semantic processing and the need for reanalysis during comprehension. Late ERP components are especially relevant to research on bilingualism, as they reflect the cognitive mechanisms that underlie and support language. In the following subsections, we briefly review four ERP components: N400 (semantic processing; Kutas and Federmeier, 2011), P600 (syntactic processing and reanalysis; Declerck et al., 2021), N2 (cognitive control and conflict monitoring; Morrison et al., 2019), and P300 (updating and working memory; Morrison et al., 2019), all of which have been shown to be shaped by bilingualism (see Grundy and Chung-Fat-Yim, 2023 for a review) and are relevant for understanding the potential of co-registration. For each ERP component, we describe its functional characteristics (see Table 1) and review key empirical findings related to bilingual language processing. Finally, we also consider recent findings in bilingualism research that leverage neural oscillatory analyses (Rossi et al., 2023).
Table 1
| Measure | Description | Associated processes |
|---|---|---|
| N400 | ~400 ms; centro-parietal (modality-dependent) | Semantic processing, lexical access, and prediction |
| P600 | ~500–800 ms; centro-parietal/sometimes frontal | Syntactic reanalysis, conflict monitoring, and integration |
| N2 | ~200–350 ms; fronto-central | Conflict detection, inhibition, and early control |
| P300 | ~300–600 ms; centro-parietal | Working memory, context updating, and proactive control |
Key ERP components associated with bilingual language processing and control.
2.1 N400
The N400 ERP component is a negative-going waveform that typically peaks around 400 ms. First reported by Kutas and Hillyard (1980), the N400 has been widely interpreted as a neural marker of semantic processing and integration. For example, incongruent words in semantically constraining sentences (e.g., “He spread his toast with socks”) elicit larger N400 amplitudes than congruent words (e.g., “He spread his toast with butter”). The N400 is not limited to linguistic input and has been observed across different modalities (Delogu et al., 2019). For instance, semantically incongruent facial expressions (e.g., Debruille et al., 1996) evoke similar N400 effects as incongruent words, indicating that the component is not limited to linguistic processing. This finding supports the view that the N400 is a domain-general marker of semantic processing (for a review, see Kutas and Federmeier, 2011). The N400 has also been linked to predictive processing, as the brain uses context to anticipate upcoming information (Brothers et al., 2017; Nieuwland, 2019). The N400, therefore, serves as an index of semantic processing, sensitive to both context and prediction across modalities.
In bilinguals, the N400 tends to be smaller in amplitude and delayed in the second language (L2) compared to the first language (L1) (e.g., Hahne and Friederici, 2001; Midgley et al., 2009; Newman et al., 2012), indicating that processing semantic information in the L2 is generally less automatic and requires greater cognitive effort. The N400 is also sensitive to crosslinguistic activation, with reduced amplitudes for target words overlapping phonologically or semantically with their translation equivalents in the non-target language (Chen et al., 2017; Hoshino and Thierry, 2012; Thierry and Wu, 2007). Furthermore, bilinguals perceive unrelated concepts as more semantically related than monolinguals do, as shown in a smaller N400 effect (i.e., reduced N400 amplitudes for related compared to unrelated pictures) (e.g., Friesen et al., 2016; Ning et al., 2020). N400 effects are also modulated by individual differences in language experience such as proficiency, age of acquisition, and daily exposure (e.g., Kotz and Elston-Güttler, 2004; Moreno and Kutas, 2005). In sum, the N400 reveals how semantic information is processed across languages and different bilingual experiences.
2.2 P600
The P600, first reported by Osterhout and Holcomb (1992), is a positive-going waveform that typically peaks around 500 ms post-stimulus onset and can persist for several hundred milliseconds. This positivity appears in response to ungrammatical sentences and other anomalies (Kaan et al., 2000). The P600 is elicited across both written and spoken modalities by a variety of syntactic violations, such as those found in garden-path sentences (Osterhout et al., 1994), and has also been linked to thematic role anomalies, discourse integration, and pragmatic processing (Osterhout et al., 1994; Burkhardt, 2007; Delogu et al., 2018).
In studies on bilingual language processing, the P600 has been shown to be smaller in amplitude or delayed in the L2 compared to the L1 (Midgley et al., 2009; Hoeks et al., 2004). Greater P600 amplitudes have also been observed in response to less frequent but grammatical L2 structures (Zheng and Lemhöfer, 2019). In both cases, researchers have suggested that these patterns reflect increased processing effort and less engagement of control mechanisms during syntactic reanalysis in L2. These P600 effects vary by age of acquisition and proficiency, with early and highly proficient bilinguals showing neural responses that closely resemble those of monolingual native speakers (Sabourin and Stowe, 2008; Rossi et al., 2006). Similarly, P600 effects have been found during code-switching (Weber-Fox and Neville, 1996), reflecting the engagement of cognitive control processes, as bilinguals must manage competition between two active languages. Together, these findings suggest that P600 modulations can index either syntactic processing difficulty (e.g., when processing in the L2) or the engagement of cognitive control processes (e.g., during code-switching).
2.3 N2
The N2 is a negative-going waveform peaking around 200–350 ms post-stimulus onset and reflects early engagement of cognitive control mechanisms (Moreno et al., 2002). For instance, in Go/No-Go paradigms participants respond to go trials and withhold their response to no-go trials. Compared to go trials, infrequent no-go trials elicit a larger N2, reflecting the recruitment of inhibitory control and conflict monitoring (Heidlmayr et al., 2020; Donkers and Van Boxtel, 2004). Therefore, the N2 serves as a neural marker of cognitive control, which is relevant for studying how bilinguals manage competition between simultaneously activated languages (Jonkman, 2006).
Research on bilingual language processing has shown that the N2 is sensitive to language-switching demands. For example, Jackson et al. (Jackson et al., 2001) observed larger N2 amplitudes during language switches, suggesting the involvement of control processes in language selection. Subsequent studies confirmed this switch effect, linking the N2 to greater demands in conflict monitoring (Verhoef et al., 2010). Training in language switching has been shown to enhance conflict monitoring efficiency. This is evidenced by shorter N2 latencies (Verhoef et al., 2010; Kang et al., 2018, 2023) and increased N2 amplitudes for non-trained executive control tasks (Zhang et al., 2015), suggesting transfer effects of language training to broader cognitive control functions.
N2 modulations in bilinguals have also been observed in non-linguistic tasks (Grundy et al., 2017b). Compared to monolinguals, bilinguals often show larger N2 amplitudes and earlier latencies in Go/No-Go and Flanker tasks, suggesting enhanced domain-general conflict monitoring abilities (Barac et al., 2016; Morales et al., 2015). However, language group differences are not always observed. A meta-analysis by Kousaie and Phillips (2012) revealed that differences in N2 amplitudes between monolinguals and bilinguals are often task-dependent and tend to emerge most clearly under conditions of high conflict (see Comishen and Bialystok, 2021 for similar effects in the P300 component).
Finally, factors such as L2 proficiency and age of second language acquisition modulate N2 responses. Higher proficiency has been linked to larger N2 amplitudes in auditory no-go trials (Fernandez et al., 2013, 2014), while both early L2 learners (Sullivan et al., 2014) and bilingual children (Barac et al., 2016) show earlier N2 onset latencies than monolinguals, suggesting more efficient conflict detection. Overall, the N2 emerges as a reliable marker of early control processes in bilinguals, reflecting adaptation to the demands of managing two active languages.
2.4 P300
Studies exploring the N2 component frequently report effects on the P300 component, which is a positive deflection emerging between 300 and 600 ms after stimulus onset (Antoniou, 2023). The P300 is commonly divided into P3a and P3b (Polich, 2007). The P3a, with a frontal distribution and shorter latency, is generally associated with attentional capture and response inhibition (Folstein and Van Petten, 2008; Pires et al., 2014). The P3b, with a centro-parietal distribution, appears later and is closely linked to updating and working memory processes (Polich, 2012).
Studies using nonverbal executive control tasks have consistently shown that bilinguals exhibit larger P300 amplitudes and shorter latencies than monolinguals, particularly in high-conflict conditions (e.g., Go/No-Go or Flanker tasks; Moreno et al., 2014; Fernandez et al., 2013; López-Rojas et al., 2022). These findings have been interpreted as more efficient stimulus categorization and faster engagement of attentional control in bilinguals. Moreover, bilinguals immersed in dual-language contexts show increased P3b amplitudes during memory tasks (López-Rojas et al., 2022), suggesting greater engagement of context monitoring and updating mechanisms under highly demanding conditions. However, tasks involving linguistic conflict (e.g., Stroop) sometimes show greater P300 amplitudes for monolinguals, possibly reflecting differences in neural recruitment strategies (Comishen and Bialystok, 2021). Together, these findings highlight the P300 as a valuable neural marker for tracking how bilinguals allocate control resources when managing two language systems and adapting to varying task demands (Kousaie and Phillips, 2012).
2.5 Neural oscillations in bilingualism research
EEG recordings not only capture ERPs, but they also allow the analysis of neural oscillations, offering complementary information about brain activity (Buzsáki and Draguhn, 2004). Neural oscillations are rhythmic patterns of neural activity that support communication between different brain regions and cognitive systems. Through time-frequency or synchronization analyses, neural oscillations are typically characterized in terms of frequency bands (e.g., theta, beta, gamma) and their associated power (i.e., the magnitude of oscillatory activity within a given frequency band). Importantly, neuroscience research has shown that distinct patterns of brain oscillations are linked to different cognitive processes (Ward, 2003). For example, theta oscillations have been associated with memory processes, whereas alpha oscillations are commonly linked to attentional allocation and control mechanisms.
In terms of language processing, theta-band activity has been consistently linked to word learning, lexical access, and memory consolidation (Lisman, 2010; Lisman and Jensen, 2013). Previous studies have shown that newly learned words elicit increased theta power, suggesting a role of theta oscillations in memory encoding (Bakker-Marshall et al., 2018; Grabner et al., 2007). Similar theta modulations have been observed in bilingual contexts, such as during word translation, in which theta oscillations are associated with the activation of semantic representations (Grabner et al., 2007). Beyond word-level processing, neural oscillations also capture higher-level processing. While decreases in alpha and beta power are associated with increased syntactic and semantic demands, increases in theta and delta activity are associated with the coordination of working memory processes during semantic processing (Bastiaansen and Hagoort, 2006). Importantly, bilinguals often show reduced alpha and beta modulations compared to monolinguals despite similar behavioral performance, which has been interpreted as more efficient neural processing during sentence comprehension (Kielar et al., 2014).
Neural oscillations are also sensitive to individual differences and task demands during bilingual language processing (e.g., Morucci et al., 2025). For example, Blanco-Elorrieta et al. (2019) found that during sentence processing, delta activity was modulated by language proficiency, with more proficient L2 speakers being better able to track sentences under more demanding noise conditions. Other studies have highlighted how oscillatory dynamics capture language-related differences in broader cognitive domains, such as creativity. For instance, Jończyk et al. (2024) found lower alpha power when bilinguals completed a creative task in L1 compared to L2, along with greater beta desynchronization in L2 than in L1, suggesting that operating in an L2 is associated with reduced interference from competing mental representations. Another commonly used methodological approach to analyze neural oscillations involves resting-state recordings (Custo et al., 2017). In psycholinguistics research, resting-state recordings have already been examined in a growing number of studies exploring the impact of prior bilingual experience on neural oscillations (e.g., Bice et al., 2020; Calvo et al., 2023). For instance, Amoruso et al. (2024) found that delta and beta power can distinguish bilinguals from monolinguals, pointing to experience-related changes in brain organization. Complementing these findings, resting-state EEG work has shown that age of acquisition and patterns of language use are associated not only with changes in oscillatory power (beta, gamma), but also with connectivity measures across theta, alpha, and gamma bands (Soares et al., 2021). Overall, these studies provide evidence that bilingualism reorganizes neural networks.
Taken together, EEG research provides converging evidence that bilingual language processing engages a set of language-relevant and domain-general neural mechanisms that unfold over time and are shaped by language experience. ERP components capture distinct stages of semantic processing, syntactic reanalysis, conflict monitoring, and context updating, while oscillatory analyses reveal complementary frequency-based dynamics related to memory, attention, and control. These studies highlight the value of EEG for creating theoretically grounded predictions that can be further tested using EEG and eye-tracking co-registration. Note that in this paper, we will focus on ERP measures when formulating predictions for open questions in the field of bilingualism (refer to Sections 4.1 and 4.2), as ERPs have been more widely used in previous co-registration work in psycholinguistic research. The potential contribution of neural oscillations is discussed in the section on future directions (refer to Section 5). Next, we move from EEG to eye tracking and briefly review a sample of eye-tracking research that has advanced our understanding of bilingual language processing.
3 Eye-tracking insights into bilingual language processing: current evidence from psycholinguistic research
Eye-tracking captures, with millisecond precision, where and for how long individuals fixate on specific stimuli. Because eye-movements are tightly linked to attentional and other cognitive processes, eye-tracking offers a window into the mechanisms that shape human cognition and language processing [i.e., the eye-mind hypothesis (Just and Carpenter, 1980)]. For example, by mapping eye-movement patterns during reading, researchers can determine whether and when a word is being considered, as well as the cognitive effort required (Conklin and Pellicer-Sánchez, 2016; Pickering et al., 2004). This link between gaze and cognition has made eye-tracking a widely used method in psycholinguistics, particularly suited to examining the rapid and transient mechanisms that unfold during language processing (Conklin et al., 2018; Huettig et al., 2011). Eye-tracking is also a non-invasive method that offers strong ecological validity, allowing participants to engage with tasks that closely resemble everyday activities such as reading a book or inspecting a visual scene (Berends et al., 2015). In doing so, eye-tracking bridges laboratory rigor with real-world language use, making it an especially useful tool for investigating bilingualism and its impact on cognition.
To translate gaze behavior into quantitative data, researchers rely on a set of measures that serve as indices of attention and cognitive effort. The three most basic eye-tracking measures analyzed in psycholinguistic studies are fixations (i.e., when the eyes stop on a stimulus), saccades (i.e., rapid eye movements between fixations), and regressions (i.e., backward movements in the text; see Table 2). These gaze events are informative for understanding both auditory and written comprehension processes at multiple linguistic levels, including at the phonological, morpho-syntactic, and discourse levels (see Huettig et al., 2011 for a review of the auditory modality; see Keating, 2014 for a review of the written modality). From these key measures, additional metrics can be calculated to investigate different stages of language processing (Godfroid, 2020). Broadly, these metrics fall into two categories: early measures (e.g., first fixation duration, first-pass reading time), which are generally associated with processes of word recognition and lexical access (Reingold and Rayner, 2006), and late measures (Mitchell et al., 2008), which often capture processes of integration and reanalysis.
Table 2
| Measure | Description | Associated tasks |
|---|---|---|
| Basic measures | ||
| Saccade | Rapid movement of the eye | Visual Scene Perception; Reading |
| Fixation | Pause of the eye on a specific location in the visual display | Visual Scene Perception; Reading |
| Regression | Eye movement that returns to a previously viewed location in the visual display (i.e., backward saccade) | Visual Scene Perception; Reading |
| Early measures | ||
| First fixation duration | The duration of the first fixation on an area of interest (AOI) | Visual Scene Perception; Reading |
| First pass reading time | The duration of all fixations on an area of interest (AOI) before the gaze exits | Reading |
| Late measures | ||
| Total fixation duration | The duration of all fixations on an area of interest (AOI) during a trial | Visual Scene Perception |
| Total reading time | The duration of all fixations on an area of interest (AOI) during a trial | Reading |
| Fixation count | Sum of all fixations on an area of interest (AOI) during a trial | Visual Scene Perception; Reading |
| Second pass reading time | Sum of all fixations on an area of interest (AOI) after it has been exited for the first time | Reading |
| Regression-path duration | Sum of all fixations, including regressions to earlier parts of a sentence, before moving forward to the next region in the text | Reading |
Eye-tracking measures by type: basic movements, early, and late fixation measures.
In the following sections, we review studies that applied eye-tracking to investigate bilingual language processing across different psycholinguistics paradigms. Specifically, we examine how eye-tracking measures have been interpreted in studies employing the visual world paradigm and reading tasks. As with EEG, outlining these measures is essential for understanding how eye-tracking can be effectively combined with electrophysiological recordings in co-registration paradigms.
3.1 Crosslinguistic lexical activation and competition: insights from the Visual World Paradigm
The Visual World Paradigm (VWP; Tanenhaus et al., 1995) has become a valuable method for studying spoken language comprehension. In a typical VWP experiment, participants listen to auditory stimuli while viewing a display containing a set of objects that vary in their relation to the speech input. For example, in studies examining spoken word recognition, the display may include: (1) a target item (e.g., beaker), whose label appears in the speech signal; (2) a competitor item (e.g., beetle), whose label overlaps with the target's word form or meaning; and (3) control items (e.g., carriage), whose labels are unrelated to the speech input and serve as baselines (Allopenna et al., 1998). The objects are often presented as line drawings, photographs, or realistic visual scenes on a computer screen (see Huettig et al., 2011 for a review).
Crucially, adding eye-tracking to the VWP has allowed researchers to address different questions in language processing (e.g., Altmann and Kamide, 1999; Chambers et al., 2004; Huettig and McQueen, 2008). By manipulating the relationship between what participants see and hear, this approach can be used to examine how eye movements are influenced by the timing and location of visual input relative to speech (Tanenhaus, 2007). As speech unfolds, listeners may shift their gaze from one object to another (e.g., from the competitor to the target), revealing the dynamics of real-time language processing. This interaction between gaze and the unfolding speech signal enables users of the VWP to investigate the time course of language processing, including mechanisms such as lexical activation, competition, and prediction. In the VWP, common early measures include fixation proportions, total fixation time, and the number of fixations and saccades time-locked to key points in the auditory input (refer to Conklin et al., 2018 as well as Godfroid, 2020 for reviews).
Applied to bilingualism, the VWP has been particularly useful for uncovering parallel activation and competition across languages. (Marian and Spivey 2003b) discovered that when Russian-English bilinguals heard an English word like marker, they showed a higher proportion of eye movements to a visual competitor whose Russian label (marka, “stamp”) was phonologically related, even though the task was conducted entirely in English. This finding, replicated across modalities and in a variety of language pairs, provides compelling evidence that bilinguals activate lexical candidates in both of their languages (e.g., Canseco-Gonzalez et al., 2010; Cutler et al., 2006; Ju and Luce, 2004; Shook and Marian, 2012). Subsequent visual world studies have shown that crosslinguistic activation varies with individual differences in proficiency, language dominance, and cognitive control (e.g., Blumenfeld and Marian, 2007; Botezatu et al., 2022). For instance, Blumenfeld and Marian (2013) found that bilinguals' fixation patterns to between-language competitors (e.g., pool—pulgar, “thumb” in Spanish) differed systematically by language proficiency. Bilinguals with higher proficiency in a second language directed more fixations to crosslinguistic competitors, indicating greater parallel activation across languages. Similarly, Sarrett et al. (2022) showed that target fixation latencies were delayed when crosslinguistic competitors were present, highlighting the cost of resolving lexical competition for bilinguals. These findings underscore how the VWP's temporal precision allows researchers to trace not only when crosslinguistic competition emerges but also how individual differences influence its resolution.
The VWP has also been used to study other cognitive processes in bilinguals including memory. Fernandez-Duque et al. (2023) showed that Spanish-English bilinguals with high Spanish proficiency made more fixations to Spanish phonological competitors and subsequently remembered them better than control items, suggesting that heightened crosslinguistic competition can enhance both visual attention and memory for competing items. These findings highlight how eye movements can reveal not only the dynamics of crosslinguistic competition, but also the long-term effects of dual-language processing in shaping broader cognitive function.
3.2 Semantic processing and comprehension: insights from reading tasks
Eye-tracking has also played a central role in uncovering the cognitive mechanisms underlying reading in bilinguals (Rayner, 2009). During reading, fixations are essential for recognizing words and integrating them into the overall meaning of the text (Clifton et al., 2007). Consequently, the temporal precision of eye-tracking has become instrumental in studies on reading for differentiating (early) word identification from (late) integration processes.
The distinction between early word identification vs. late integration processes has been particularly useful for addressing a central question in bilingual reading research: whether bilinguals activate only one language when reading (selective access) or whether both languages are activated in parallel (non-selective access). Evidence strongly supports the non-selective view, indicating that bilinguals' two languages interact during visual word recognition. For example, interlingual homographs (e.g., pie in English vs. pie “foot” in Spanish) elicit longer first-pass reading times than control words, reflecting between-language competition (e.g., Libben and Titone, 2009; Whitford and Titone, 2015). In contrast, cognates (e.g., piano in English and Spanish) yield shorter first fixation durations, indicating facilitation due to shared form and meaning (e.g., Duyck et al., 2007; Van Assche et al., 2009). Early fixation measures are also sensitive to lexical frequency, age of acquisition, and language proficiency, revealing how both individual and linguistic factors shape visual word processing (Cop et al., 2015; Hessel et al., 2021; Liversedge et al., 1998; Whitford and Titone, 2019). Late measures, on the other hand, capture the cognitive demands involved in reading, including the detection of processing difficulty and the resolution of linguistic and contextual ambiguity (for a review see Keating and Jegerski, 2014). For instance, regression-path duration and total reading times increase when bilinguals encounter ambiguous syntactic structures, reflecting the costs of integration (Cop et al., 2017; Whitford and Titone, 2019). These measures are thus highly informative for understanding morphosyntactic processing in bilinguals (e.g., Dussias and Sagarra, 2007; Dussias et al., 2013). Examining both early and late measures provides detailed information about the different stages of bilingual language processing. Whereas early measures reveal how bilinguals manage crosslinguistic activation and competition during word recognition and lexical access, late measures capture the integration of syntactic and contextual information.
Across a variety of paradigms, eye-movement measures index both early stages of word recognition and later stages of semantic and syntactic processing, revealing robust evidence for parallel crosslinguistic activation in bilingual individuals (Shook and Marian, 2013). By testing theoretical predictions with real-time measures of visual attention during spoken and written language comprehension, eye-tracking provides a methodological bridge between model-based assumptions and empirical observations. Importantly, the temporal precision of eye-tracking closely matches that of EEG, making it possible to directly link eye-tracking measures to ERP components during naturalistic tasks. In the next section, we review studies that have applied co-registration of eye movements and ERPs to study language processing and discuss the methodological strength of co-registration for bilingualism research.
4 Co-registration in psycholinguistics and bilingualism research: current knowledge and open questions
Co-registration with EEG and eye-tracking allows researchers to study how neural activity and gaze behavior unfold over time during language processing. A key advantage of this approach is that it enables the measurement of saccade- and fixation-related potentials (SRPs and FRPs), which are EEG signals time-locked to the onset of individual saccades and fixations. These measures make it possible to isolate neural responses associated with specific eye movements during experimental tasks, including those that require natural reading or scene viewing (Dimigen et al., 2011). By combining EEG and eye-tracking measures, co-registration preserves ecological validity while providing the temporal precision needed to track how linguistic information is processed in real time.
Despite the potential of co-registration to offer new insights into the processes that are involved in human cognition (e.g., Ossandón et al., 2010; Ries et al., 2018), relatively few psycholinguistic studies have adopted this approach. Most studies to date have focused on monolingual populations, primarily within the domain of reading, examining how readers process words when directly fixated in the foveal region as well as when previewing upcoming words in the parafoveal region (i.e., the area outside the fixation point that can be previewed without direct gaze). For example, Kretzschmar et al. (2009) demonstrated that readers begin to semantically evaluate words even before they are directly fixated, as evidenced by parafoveal N400 effects. In contrast, Dimigen et al. (2012) found that the N400 only emerged when semantically related words were fixated, highlighting the limits of parafoveal semantic access. Their findings also revealed an early positive component (200–280 ms) when readers previewed an identical word parafoveally. Beyond reading, co-registration has also been applied to other tasks involving scene viewing (Coco et al., 2020) and spoken language comprehension in monolingual populations (Huizeling et al., 2023), further highlighting the method's utility. Nevertheless, despite developments in monolingual language processing, to date, co-registration research to study bilingual language processing remains extremely limited.
To our knowledge, only two studies have used co-registration of eye movements and brain activity with bilinguals. The first study, conducted by Antúnez et al. (2021), examined whether bilinguals extract and integrate semantic information from words in the parafovea during reading. In this study, Basque-Spanish bilinguals read words in Spanish while previewing words in Basque that were either translations or unrelated words. The combined use of EEG and eye-tracking allowed the authors to derive FRPs time-locked to eye movements on the target word, revealing greater N400 effects for semantically unrelated words in the parafovea. The findings show not only the early stages of semantic processing, but also how activation extends across languages, underscoring the value of co-registration for studying lexico-semantic access.
A second study by Egurtzegi et al. (2022) used co-registration to look at gaze patterns and EEG band power oscillations during sentence planning in bilinguals. The authors found that Basque-German speakers began organizing sentence structures earlier in Basque, as indicated by longer fixations on the agent and increased frequency synchronization in the theta and alpha bands. In contrast, when speaking German, sentence planning was delayed, as indicated by greater desynchronization in these power bands. However, while both EEG and eye-tracking data were simultaneously recorded, Egurtzegi et al. (2022) analyzed the eye tracking and EEG data independently, rather than using co-registration to integrate the two measures (e.g., fixation-related oscillations, Himmelstoss et al., 2020).
Next, we provide examples of research domains (e.g., crosslinguistic co-activation and inference revision) where co-registration can help address current gaps in bilingualism. In particular, we discuss the implementation of co-registration in the Visual World Paradigm (Tanenhaus et al., 1995) to study the influence of co-activation in higher-order cognitive domains, such as memory, decision making, and semantic processing. We also consider other areas where co-registration can be applied in research with bilinguals, such as the Situation Model Revision Task (Pérez et al., 2019). Critically, these research domains represent questions that cannot be fully addressed using EEG or eye-tracking in isolation. While each technique provides valuable information, co-registration allows researchers to determine how neural activity and gaze patterns unfold during language processing, offering theoretical power beyond either method alone.
4.1 Investigating crosslinguistic co-activation through co-registration
One promising application of co-registration lies in its potential to extend findings of parallel crosslinguistic activation derived from studies using the VWP (e.g., Sarrett et al., 2022; Andras et al., 2022; Spivey and Marian, 1999). Because eye-tracking provides a precise index of visual attention and perception during language processing, integrating eye-tracking with EEG in the VWP makes it possible to time-lock shifts in attention with corresponding neural responses.
A clear benefit of combining the two techniques in the VWP is that they provide complementary information on how task stimuli are processed. In studies of crosslinguistic co-activation, for example, a bilingual Spanish-English speaker listening to the auditory target word cow (/ka℧/) may look not only at the target picture of a cow, but also to a crosslinguistic phonological competitor (e.g., helmet, in Spanish “casco”,/'kasko/). These gaze patterns reveal attentional engagement, as well as lexical access and competition through gaze behavior. The addition of EEG allows researchers to determine whether the phonological competitor was processed semantically (e.g., via an N400), inhibited (e.g., via a P300), or reanalyzed (e.g., via a P600; see illustration in Figure 2). The combined approach can also be valuable because the activation of the non-target language may not always impact gaze behavior or lead to significant differences between fixations on target and competitor items. Instead, co-registration may allow researchers to capture the brain activity elicited by both types of items, revealing neural responses to language co-activation not evident in eye movement metrics. This constitutes a clear case where neither EEG nor eye-tracking alone can determine whether co-activation engaged automatic or controlled processes.
Figure 2
Similarly, as the field moves toward understanding how individual differences in bilingual language experience shape cognition (de Bruin, 2019), co-registration offers the opportunity to disentangle overlapping individual-difference effects in crosslinguistic co-activation. Specifically, bilinguals with different profiles (e.g., proficiency, age of acquisition, language use and exposure) may show similar gaze patterns while differing in their underlying neural responses (i.e., neural–gaze decoupling; see Grundy et al., 2017a for a similar pattern with behavioral outcomes), or conversely, comparable neural responses accompanied by distinct attentional strategies. When using co-registration in the VWP, there is the possibility that low-proficiency L2 speakers may show eye movements comparable to high-proficiency bilinguals when resolving crosslinguistic competition. However, the low-proficiency bilingual group may still exhibit delayed or enhanced ERP responses (e.g., larger N400 or P600 amplitudes) compared to the high-proficiency group, reflecting increased processing effort or reduced efficiency. In contrast, highly proficient bilinguals may show a tighter coupling between gaze behavior and neural indices of competition, reflecting more efficient coordination between visual strategies and neural processes.
Despite its potential, using co-registration with the VWP presents several methodological challenges. Unlike visual stimuli, an auditory stimulus unfolds over time, making it difficult to define a clear onset for time-locking ERPs. Additionally, due to the high number of ocular artifacts, spiked potentials associated with saccades could overlap with ERP components of interest and contaminate the data. To address these concerns, researchers can extract FRPs at multiple key timepoints (Dimigen et al., 2011), which helps identify different brain responses elicited as the word is gradually presented. For example, first fixations to a phonological or semantic competitor may reflect early stages of lexical access and semantic processing. In the time window anchored to this fixation, researchers could expect modulations in the N400, which is sensitive to semantic processing and the ease of connecting auditory input with visual information (Dimigen et al., 2022). In contrast, longer fixation durations preceding a behavioral response (e.g., mouse click) may indicate later processes, such as conflict resolution or reanalysis, which are likely going to be associated with components such as the P600. By comparing EEG activity across different gaze events, co-registration can help clarify when and how bilinguals undergo shifts in neurocognitive processing.
Another key challenge that researchers face when combining EEG and eye-tracking in the VWP is the large number of eye movements it elicits. As in other visual search tasks (e.g., Chabal and Marian, 2015), participants explore the visual display freely, often directing multiple fixations to different areas in the display before and after hearing the target word. Eye movements introduce muscular ocular artifacts into the EEG signal, compromising the quality of the signal and making it difficult to isolate ERPs (Degno et al., 2021). Several strategies can help mitigate this issue. One common approach is to apply independent component analysis (ICA) to identify and remove artifacts related to eye movements (Chaumon et al., 2015). This process is often guided by signals from electrooculogram (EOG) electrodes, which are placed above and below the eye (for vertical movements) and at the outer corners of the eyes (for horizontal movements). Collecting data from the EOG channels improves the accuracy of artifact removal and helps preserve the underlying neural signal. Recent developments have optimized ICA for free viewing by adjusting preprocessing parameters and using eye-tracking data to guide component rejection (Dimigen, 2020; OPTICAT code available). There are also useful tutorials and resources online showing how eye tracking data can guide ocular artifact detection and correction (Degno et al., 2021). As noted previously in Section 4, another effective solution is to analyze FRPs, which allows researchers to isolate time windows of brain activity that have been previously cleaned from blinks and saccadic eye movements (i.e., during periods of gaze stability; Dimigen and Ehinger, 2021). Furthermore, researchers can simplify the visual complexity of the task. For instance, presenting two items instead of four reduces the number of eye movements needed to inspect the display, while still eliciting meaningful competition between referents. Arranging stimuli closer to the screen center can also minimize peripheral scanning.
Beyond advancing our understanding of how bilinguals manage the parallel activation of both languages, co-registration holds promise for elucidating complex cognitive processes such as prediction and updating during comprehension.
4.2 Investigating prediction and revision processes through co-registration
Research on high-level comprehension processes in bilinguals have employed reading comprehension tasks based on situation model theories (Bower and Morrow, 1990; Zwaan, 2001) to investigate how bilinguals manage inferential processing across their two languages. In the Situation Model Revision task (Pérez et al., 2019, 2024), participants build an initial mental representation of a narrative and subsequently update it when new, conflicting information arises. The Situation Model Revision task captures bilinguals' ability to monitor and update mental representations in both their L1 and L2. By aligning eye movements with brain activity elicited during the task, we can gain a better understanding of the monitoring and updating processes involved in bilingual comprehension during inference revision. For instance, previous studies have found that when readers encounter a word that contradicts their initial inference (e.g., “violin” after having inferred “guitar”), they often show longer fixation durations and regressions to earlier parts of the text (Pérez et al., 2016). These eye-movement patterns reflect processing difficulty and reanalysis. With co-registration, researchers can examine whether such fixations and regressions reflect successful semantic processing. For example, a larger N400 time-locked to the first fixation on the unexpected word would indicate a semantic mismatch with the current mental model (Kuperberg et al., 2011; Pérez et al., 2015). However, if that word is subsequently fixated after rereading the sentence, and the N400 is significantly reduced, this may suggest successful integration of the updated inference. Therefore, co-registration can help distinguish between automatic inference updating and controlled processing strategies during comprehension, beyond what can be inferred from behavioral or neural measures alone.
Regarding the impact of different bilingual experiences on comprehension, co-registration can also provide insightful findings. Bilinguals with higher proficiency or earlier age of acquisition may show a better temporal correspondence between eye-movement indices of reanalysis (e.g., fewer regressions and shorter fixation durations on the critical word) and neural markers of inference updating (e.g., reduced N400 amplitudes), reflecting a more automatized revision process (Luk et al., 2011; Prior et al., 2014). In contrast, less proficient bilinguals may exhibit longer or more frequent regressions while still showing typical N400 or P600 responses, suggesting the engagement of compensatory mechanisms to achieve successful comprehension (Pérez et al., 2019). By capturing both convergent and divergent neural–gaze patterns, co-registration allows psycholinguistics to disentangle how prior bilingual experience modulates the engagement of automatic and controlled processes during inference revision and comprehension.
Additionally, given the role of the P3b in updating processes (Polich, 2007, 2003), examining whether and when it emerges after an unexpected word is encountered can shed light on how bilinguals update their mental representations. Correlating P3b amplitude with regression patterns and fixation durations on the updated sentence could help disentangle the cognitive cost of revising information during reading across both languages. Similarly, P600 effects associated with reanalysis may appear in sentences with longer total reading times and more regressions, indicating effortful suppression of the initial inference and the construction of new situation models (Burkhardt, 2007).
To implement co-registration effectively in an inference revision task, several methodological challenges need to be addressed. As with the VWP (see section 4.2), ocular artifacts and neural signals need to be aligned with precise task events. However, a more specific concern about this task is its similarity to naturalistic reading paradigms, where participants read continuous text at their own pace (Hasson and Egidi, 2015). The self-paced reading procedure introduces variability in fixation times and regression patterns, complicating the alignment of eye-movement measures with ERP components elicited by specific task events. This issue is especially problematic when multiple regressions or fixations occur around critical regions of interest. Recent co-registration studies in psycholinguistics using natural reading tasks offer some solutions. For instance, FRPs time-locked to fixations on target words can be used to observe the brain activity evoked when the item is specifically fixated, as well as when processing begins. Moreover, strategies such as correlating regression patterns with specific ERP components allow researchers to distinguish different processing phases during reading (Himmelstoss et al., 2020; Dimigen and Ehinger, 2021; Metzner et al., 2016).
While the natural flow of reading introduces complexity, the growing literature on co-registration in reading provides tools and frameworks that can be adapted to bilingual comprehension paradigms. There are also specific strengths that make inference-revision tasks suitable for co-registration. For example, texts in inference revision tasks are often presented sentence-by-sentence or word-by-word, which makes them more appropriate for EEG and eye-tracking than free-reading paradigms while still maintaining some degree of ecological validity. Researchers can take advantage of this presentation format by introducing triggers that mark sentence or word onset to improve the time-locking of brain activity and its synchronization with gaze data. In addition, synchronization can be further improved by using shared event markers between EEG and eye-tracking recordings. Thus, co-registration can enhance the interpretation of results regarding the revision of the mental model and how the revision process is modulated when reading in L2.
5 Future directions and methodological considerations for the application of co-registration in bilingualism research
Co-registration of EEG and eye-tracking holds considerable promise for advancing research on bilingual language processing and its impact on cognition more broadly. In the field of memory, previous studies have examined the role of language as a contextual cue that can either hinder or facilitate the encoding and retrieval of information in bilinguals (e.g., Marian and Neisser, 2000). Co-registration could clarify whether the effects of language on memory result from shifts in attention allocation during the task (captured via eye-tracking measures) or from differential engagement of semantic and updating processes (e.g., reflected in N400, P3b, P600). Additionally, in the domain of moral decision-making, research has shown that bilinguals often make different moral judgments in their native language (L1) vs. their foreign language (L2; e.g., Costa et al., 2014, 2017), frequently favoring more utilitarian responses in their L2. Co-registration could clarify whether these patterns of utilitarian responses reflect changes in emotional engagement (e.g., indexed by pupil size) or in controlled evaluation (e.g., P600). Similarly, in emotion perception tasks, bilinguals sometimes show reduced sensitivity to emotional cues in L2 (e.g., Ferré et al., 2022). Co-registration could help disentangle whether these differences in emotionality arise from reduced visual attention to emotional features or from attenuated emotional engagement when working in L2, as reflected in ERP responses like the N300 (e.g., Wu et al., 2022). In sum, numerous areas of bilingual language processing research may benefit from combining brain activity and eye-movement recordings.
In this paper, we have highlighted specific topics in bilingualism research that can benefit from the implementation of co-registration. More broadly, however, the potential of this method for the field lies in its ability to address wider questions, such as how underlying cognitive mechanisms are reflected in observable behavior during language processing. The ability to map attentional behavior onto underlying neural processes represents a qualitative advance over single-method approaches. Co-registration enables researchers to ask which mechanisms support successful performance, when they are engaged, and how they vary across conditions. As such, co-registration can contribute to integrating theoretical models of bilingual language processing with empirical measures of both brain and gaze behavior.
Our approach to guiding the implementation of EEG and eye-tracking co-registration in bilingualism research is to build on existing knowledge from previous co-registration studies with monolingual populations (see Section 4) and extend it to future studies exploring bilingualism and cognition. Accordingly, we consider that studies exploring ERPs are the natural first step, as they allow clearer predictions and more robust interpretations. Alternatively, or as a complementary approach, neural oscillations can also be analyzed to understand the brain dynamics of bilingual language processing and how they interact with gaze behavior. Similar to eye-tracking, neural oscillations provide a continuous tracking of neural activity. This correspondence makes their joint analyses highly informative to understand the brain networks engaged during bilingual language processing and how these networks modulate visual attention. Based on previous literature, we suggest that oscillatory activity in the theta and beta bands would be particularly informative for examining crosslinguistic co-activation (Bakker et al., 2015; Bakker-Marshall et al., 2018), whereas delta and alpha-beta bands may be especially relevant for sentence-level inferences and comprehension (Kielar et al., 2014; Blanco-Elorrieta et al., 2019; Jończyk et al., 2024).
Despite the promise of co-registration, its application with bilingual populations involves several practical and interpretive challenges. Addressing these challenges is essential to fully realize the potential of co-registration and advance the field of psycholinguistics. Eye-tracking and EEG provide distinct types of information. While eye movements offer indices of attentional shifts, EEG captures neural activity that may precede, parallel, or follow those attentional shifts. As a result, it is possible to observe mismatches between gaze behavior and ERP components. For instance, a fixation pattern suggesting re-evaluation may not be accompanied by P3b or N400 effects. Researchers must therefore interpret combined data cautiously, grounding their analyses in well-specified models of bilingualism to avoid misalignment or misinterpretation of combined measures. Beyond these interpretive considerations, the practical implementation of co-registration also introduces several technical and analytical challenges.
EEG and eye-tracking systems differ in their sampling rates, temporal resolution, and event-logging methods, requiring accurate cross-system alignment and calibration. Additionally, pre-processing each modality involves separate workflows: EEG demands procedures such as ICA, filtering, and artifact correction, while eye-tracking requires fixation parsing, saccade identification, downsampling, processing, and segmentation by area of interest. Therefore, co-registration requires dual expertise that may not yet be common among psycholinguistic researchers. To address this, the field would benefit from the development and dissemination of open-source pipelines and documentation, as well as shared standards for data formatting and analysis. Tools such as the EYE-EEG toolbox (Dimigen et al., 2011) provide a starting point, yet community-driven validation and adaptation for bilingualism research remain limited.
While most studies in psycholinguistics using EEG and eye-tracking co-registration have been conducted with adult participants, co-registration is well-suited for examining developmental changes in language processing. Co-registration could also help determine how early co-activation emerges and which linguistic factors modulate its appearance (e.g., age of second language acquisition, type of bilingual acquisition). Similarly, research on bilingual children's comprehension (Grüter, 2018) requires the adoption of online techniques to obtain more direct measures of the underlying cognitive mechanisms involved in bilingual language processing. Despite co-registration's potential, there are methodological challenges that arise when using this approach with infants and children. A major challenge is that infants and children are constantly moving, which introduces higher levels of noise and artifacts into the EEG recordings and makes stable calibration for eye-tracking difficult. Second, ICA algorithms are typically developed for adults, reducing their accuracy in detecting signal artifacts in infants and children (Haresign et al., 2021). Third, infants' eyes tend to be more reflective, further hindering the eye-tracker's ability to track eye movement patterns (Kulke, 2015). Beyond these technical issues, there are also practical constraints that must be considered. For example, EEG and eye-tracking setup requires a considerable amount of time, and with infants, this time should be minimized to avoid shortening the experimental task. Despite these challenges, advances in child- and infant-friendly methodologies are increasingly enabling reliable measurement of neural and visual processes across early development (see Kulke, 2025 a comprehensive review).
Advancing co-registration in bilingual language processing also depends on the development of shared interpretative theoretical frameworks. The field lacks consensus on how to map cognitive constructs (e.g., interference, inhibitory control, updating) onto combined neural and eye-movement measures. For example, should successful control of crosslinguistic co-activation be identified through reduced N400 amplitudes, increased P600 responses, or a specific sequence of fixations and regressions? Each combination may reflect different cognitive mechanisms engaged, and these mechanisms may shift across languages or with individual differences (e.g., age of L2 acquisition, proficiency, etc.). Moving forward, research in bilingualism must aim to link theoretical constructs with combined neural and gaze-behavioral patterns, creating a framework that supports integration across studies.
A first approach to advance this goal could be to implement co-registration in empirical studies in order to test theoretical models of bilingual language processing. For example, in the BLINCS model, interactivity between levels of representation is mediated by bidirectional excitatory connections shaped by Hebbian learning (Hebb, 1949). According to this principle, units that are repeatedly co-activated strengthen their connections over time. Following this view, in BLINCS, representations that are closely mapped tend to be simultaneously activated, strengthening their connections. The model predicts that repeated crosslinguistic co-activation, especially among phonologically overlapping items, can reorganize the bilingual language system through experience-dependent plasticity (Shook and Marian, 2013). Empirical support for this prediction comes from studies using electrophysiological measures. Specifically, Ning et al. (2020) reported that bilinguals rated semantically unrelated word pairs as more related than monolinguals and showed a reduced N400 difference between related and unrelated words, suggesting that bilinguals may possess a more interconnected semantic network than monolinguals. Although these findings are consistent with BLINCS' prediction, they do not directly reveal what role crosslinguistic activation plays in the restructuring of bilingual semantic networks. Co-registration has the potential to address this gap by linking neural indices of semantic activation with concurrent eye-tracking indices of lexical access and cognitive effort. Examining the temporal alignment between neural responses (e.g., N400 amplitudes) and eye-movement patterns during bilingual language processing can therefore provide direct insight into how crosslinguistic co-activation shapes the organization of bilingual semantic networks. Together, these developments pave the way for co-registration to become a valuable cutting-edge tool for bilingualism research in both a theoretical and methodological way.
The present paper advances current efforts in psycholinguistics to refine and expand methodological tools for studying bilingual language processing. By highlighting the potential of co-registering brain activity and eye-movement data, we emphasize how this approach can advance our understanding of how managing two languages shapes cognitive functioning. As the field of bilingualism research progresses, co-registration provides a powerful means for investigating the dynamic interplay between language and cognition, offering a lens through which the complexity of the human mind can be more fully captured and better understood.
Statements
Author contributions
CL-R: Conceptualization, Funding acquisition, Investigation, Visualization, Writing – original draft, Writing – review & editing. CS: Conceptualization, Investigation, Writing – original draft, Writing – review & editing. AC-F-Y: Writing – review & editing. VM: Funding acquisition, Supervision, Writing – review & editing.
Funding
The author(s) declared that financial support was received for this work and/or its publication. The preparation of this manuscript was supported in part by the Eunice Kennedy Shriver National Institute of Child Health and Human Development of the National Institutes of Health under Award Number R01HD059858 to Viorica Marian and the HORIZON-MSCA-2023-PF-01 program under grant number 101150333 -ToDo-Brain to Cristina López-Rojas. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Additional funding was provided by the Mind, Brain and Behavior Research Center (CIMCYC), University of Granada, through CEX2023-001312-M/AEI/10.13039/501100011033 and UCE-PP2023-11/UGR.
Acknowledgments
The authors would like to thank Drs. Joshua Buffington, Matias Fernandez-Duque, and Renee Reilly for feedback on an earlier draft of the manuscript.
Conflict of interest
The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declared that generative AI was not used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1
AllopennaP. D.MagnusonJ. S.TanenhausM. K. (1998). Tracking the time course of spoken word recognition using eye movements: evidence for continuous mapping models. J. Mem. Lang.38, 419–439. doi: 10.1006/jmla.1997.2558
2
AltmannG. T. M.KamideY. (1999). Incremental interpretation at verbs: restricting the domain of subsequent reference. Cognition73, 247–264. doi: 10.1016/S0010-0277(99)00059-1
3
AmorusoL.GarcíaA. M.PusilS.TimofeevaP.QuiñonesI.CarreirasM. (2024). Decoding bilingualism from resting-state oscillatory network organization. Ann. N. Y. Acad. Sci. 1534, 106–117. doi: 10.1111/nyas.15113
4
AndrasF.RiveraM.BajoT.DussiasP. E.PaolieriD. (2022). Cognate facilitation effect during auditory comprehension of a second language: a visual world eye-tracking study. Int. J. Biling.26, 405–425. doi: 10.1177/13670069211033359
5
AntoniouK. (2023). The ups and downs of bilingualism: a review of the literature on executive control using event-related potentials. Psychon. Bull. Rev.30, 1187–1226. doi: 10.3758/s13423-023-02245-x
6
AntúnezM.ManciniS.Hernández-CabreraJ. A.HoverstenL. J.BarberH. A.CarreirasM. (2021). Cross-linguistic semantic preview benefit in Basque-Spanish bilingual readers: evidence from fixation-related potentials. Brain Lang.214:104905. doi: 10.1016/j.bandl.2020.104905
7
BakkerI.TakashimaA.van HellJ. G.JanzenG.McQueenJ. M. (2015). Changes in theta and beta oscillations as signatures of novel word consolidation. J. Cogn. Neurosci. 27, 1286–1297. doi: 10.1162/jocn_a_00801
8
Bakker-MarshallI.TakashimaA.SchoffelenJ. M.van HellJ. G.JanzenG.McQueenJ. M. (2018). Theta-band oscillations in the middle temporal gyrus reflect novel word consolidation. J. Cogn. Neurosci. 30, 621–633. doi: 10.1162/jocn_a_01240
9
BaracR.MorenoS.BialystokE. (2016). Behavioral and electrophysiological differences in executive control between monolingual and bilingual children. Child. Dev.87, 1277–1290. doi: 10.1111/cdev.12538
10
BastiaansenM. C. M.HagoortP. (2006). “Oscillatory neuronal dynamics during language comprehension,” in Event-Related Dynamics of Brain Oscillations, eds. C. Neuper, and W. Klimesch (Amsterdam: Elsevier), 179–196. doi: 10.1016/S0079-6123(06)59012-0
11
BerendsS. M.BrouwerS. M.SprengerS. A. (2015). “Eye-tracking and the visual world paradigm,” in Designing Research on Bilingual Development: Behavioural and Neurolinguistic Experiments, eds. M. S. Schmid, S. M. Berends, C. Bergmann, S. M. Brouwer, N. Meulman, B. J. Seton et al. (Cham: Springer), 55–78 (Springer Briefs in Linguistics).
12
BeresA. M. (2017). Time is of the essence: a review of electroencephalography (EEG) and event-related brain potentials (ERPs) in language research. Appl. Psychophysiol. Biofeedback42, 247–255. doi: 10.1007/s10484-017-9371-3
13
BiceK.YamasakiB. L.PratC. S. (2020). Bilingual language experience shapes resting-state brain rhythms. Neurobiol Lang. 1, 288–318. doi: 10.1162/nol_a_00014
14
Blanco-ElorrietaE.DingN.PylkkänenL.PoeppelD. (2019). Understanding requires tracking: Noise and knowledge interact in bilingual comprehension. bioRxiv [preprint]. bioRxiv:1101.609628. doi: 10.1101/609628
15
BlumenfeldH. K.MarianV. (2007). Constraints on parallel activation in bilingual spoken language processing: examining proficiency and lexical status using eye-tracking. Lang. Cogn. Process.22, 633–660. doi: 10.1080/01690960601000746
16
BlumenfeldH. K.MarianV. (2013). Parallel language activation and cognitive control during spoken word recognition in bilinguals. J. Cogn. Psychol.25, 547–567. doi: 10.1080/20445911.2013.812093
17
BotezatuM. R.KrollJ. F.TrachselM.GuoT. (2022). Discourse fluency modulates spoken word recognition in monolingual and L2 speakers. Biling. Lang. Cogn.25, 430–443. doi: 10.1017/S1366728921001024
18
BowerG. H.MorrowD. G. (1990). Mental models in narrative comprehension. Science247, 44–48. doi: 10.1126/science.2403694
19
BrothersT.SwaabT. Y.TraxlerM. J. (2017). Goals and strategies influence lexical prediction during sentence comprehension. J. Mem. Lang.93, 203–216. doi: 10.1016/j.jml.2016.10.002
20
BurkhardtP. (2007). The P600 reflects cost of new information in discourse memory. Neuroreport18, 1851–1854. doi: 10.1097/WNR.0b013e3282f1a999
21
BuzsákiG.DraguhnA. (2004). Neuronal oscillations in cortical networks. Science304, 1926–1929. doi: 10.1126/science.1099745
22
CalvoN.GrundyJ. G.BialystokE. (2023). Bilingualism modulates neural efficiency at rest through alpha reactivity. Neuropsychologia180:108486. doi: 10.1016/j.neuropsychologia.2023.108486
23
Canseco-GonzalezE.BrehmL.BrickC. A.Brown-SchmidtS.FischerK.WagnerK. (2010). Carpet or cárcel: the effect of age of acquisition and language mode on bilingual lexical access. Lang. Cogn. Process.25, 669–705. doi: 10.1080/01690960903474912
24
ChabalS.MarianV. (2015). Speakers of different languages process the visual world differently. J. Exp. Psychol. Gen.144, 539–550. doi: 10.1037/xge0000075
25
ChambersC. G.TanenhausM. K.MagnusonJ. S. (2004). Action-based affordances and syntactic ambiguity resolution. J. Exp. Psychol. Learn Mem. Cogn.30, 687–696. doi: 10.1037/0278-7393.30.3.687
26
ChaumonM.BishopD. V.BuschN. A. (2015). A practical guide to the selection of independent components of the electroencephalogram for artifact correction. J. Neurosci. Methods250, 47–63. doi: 10.1016/j.jneumeth.2015.02.025
27
ChenP.BobbS. C.HoshinoN.MarianV. (2017). Neural signatures of language co-activation and control in bilingual spoken word comprehension. Brain Res.1665, 50–64. doi: 10.1016/j.brainres.2017.03.023
28
CliftonC.StaubA.RaynerK. (2007). “Eye movements in reading words and sentences,” in Eye Movements: A Window on Mind and Brain, eds. R. P. G. van Gompel, M. H. Fischer, W. S. Murray, and R. L. Hill (Oxford: Elsevier), 443–469. doi: 10.1016/B978-008044980-7/50017-3
29
CocoM. I.NuthmannA.DimigenO. (2020). Fixation-related brain potentials during semantic processing of object–scene information. J. Cogn. Neurosci.32, 571–589. doi: 10.1162/jocn_a_01504
30
ComishenK. J.BialystokE. (2021). Increases in attentional demands are associated with language group differences in working memory performance. Brain Cogn.147:105658. doi: 10.1016/j.bandc.2020.105658
31
ConklinK.Pellicer-SánchezA. (2016). Using eye-tracking in applied linguistics and second language acquisition research. Second Lang. Res.32, 453–467. doi: 10.1177/0267658316637401
32
ConklinK.Pellicer-SánchezA.CarrolG. (2018). Eye-Tracking: A Guide for Applied Linguistics Research.Cambridge: Cambridge University Press. doi: 10.1017/9781108233279
33
CopU.DirixN.Van AsscheE.DriegheD.DuyckW. (2017). Reading a book in one or two languages? An eye movement study of cognate facilitation in L1 and L2 reading. Biling. Lang. Cogn.20, 747–769. doi: 10.1017/S1366728916000213
34
CopU.KeuleersE.DriegheD.DuyckW. (2015). Frequency effects in monolingual and bilingual natural reading. Psychon. Bull. Rev.22, 1216–1234. doi: 10.3758/s13423-015-0819-2
35
CostaA.FoucartA.ArnonI.ApariciM.ApesteguiaJ. (2014). ‘Piensa' twice: on the foreign language effect in decision making. Cognition130, 236–254. doi: 10.1016/j.cognition.2013.11.010
36
CostaA.VivesM. L.CoreyJ. D. (2017). On language processing shaping decision making. Curr. Dir. Psychol. Sci.26, 146–151. doi: 10.1177/0963721416680263
37
CustoA.Van De VilleD.WellsW. M.TomescuM. I.BrunetD.MichelC. M. (2017). Electroencephalographic resting-state networks: Source localization of microstates. Brain Connect. 7, 671–682. doi: 10.1089/brain.2016.0476
38
CutlerA.WeberA.OtakeT. (2006). Asymmetric mapping from phonetic to lexical representations in second-language listening. J. Phon.34, 269–284. doi: 10.1016/j.wocn.2005.06.002
39
de BruinA. (2019). Not all bilinguals are the same: a call for more detailed assessments and descriptions of bilingual experiences. Behav. Sci.9:33. doi: 10.3390/bs9030033
40
DebruilleJ. B.PinedaJ.RenaultB. (1996). N400-like potentials elicited by faces and knowledge inhibition. Cogn. Brain Res.4, 133–144. doi: 10.1016/0926-6410(96)00032-8
41
DeclerckM.MeadeG.MidgleyK. J.HolcombP. J.RoelofsA.EmmoreyK. (2021). Language control in bimodal bilinguals: evidence from ERPs. Neuropsychologia161:108019. doi: 10.1016/j.neuropsychologia.2021.108019
42
DeclerckM.PhilippA. M. (2015). A review of control processes and their locus in language switching. Psychon. Bull. Rev.22, 1630–1645. doi: 10.3758/s13423-015-0836-1
43
DegnoF.LobergO.LiversedgeS. P. (2021). Co-registration of eye movements and fixation-related potentials in natural reading: practical issues of experimental design and data analysis. Collabra. Psychol.7:1803. doi: 10.1525/collabra.18032
44
DeloguF.BrouwerH.CrockerM. W. (2019). Event-related potentials index lexical retrieval (N400) and integration (P600) during language comprehension. Brain Cogn.135:103569. doi: 10.1016/j.bandc.2019.05.007
45
DeloguF.DrenhausH.CrockerM. W. (2018). On the predictability of event boundaries in discourse: an ERP investigation. Mem. Cogn.46, 315–325. doi: 10.3758/s13421-017-0766-4
46
DijkstraT.van HeuvenW. J. B. (1998). “The BIA model and bilingual word recognition,” in Localist Connectionist Approaches to Human Cognition, eds. J. Grainger, and A. M. Jacobs (Mahwah, NJ: Lawrence Erlbaum), 189–225.
47
DijkstraT.Van HeuvenW. J. B. (2002). The architecture of the bilingual word recognition system: From identification to decision. Biling. Lang. Cogn. 5, 175–197. doi: 10.1017/S1366728902003012
48
DijkstraT.WahlA.BuytenhuijsF.Van HalemN.Al-JibouriZ.De KorteM.et al. (2019). Multilink: a computational model for bilingual word recognition and word translation. Biling Lang. Cogn. 22, 657–679. doi: 10.1017/S1366728918000287
49
DimigenO. (2020). Optimizing the ICA-based removal of ocular EEG artifacts from free viewing experiments. Neuroimage207:116117. doi: 10.1016/j.neuroimage.2019.116117
50
DimigenO.EhingerB. V. (2021). Regression-based analysis of combined EEG and eye-tracking data: theory and applications. J. Vis.21:3. doi: 10.1167/jov.21.1.3
51
DimigenO.KlieglR.SommerW. (2012). Trans-saccadic parafoveal preview benefits in fluent reading: a study with fixation-related brain potentials. Neuroimage62, 381–393. doi: 10.1016/j.neuroimage.2012.04.006
52
DimigenO.SchildU.HohlfeldA.SommerW. (2022). Auditory language comprehension during saccadic eye movements: an investigation using the N400 event-related brain potential. bioRxiv [preprint]. bioRxiv:2022.04.05.487157. doi: 10.1101/2022.04.05.487157
53
DimigenO.SommerW.HohlfeldA.JacobsA. M.KlieglR. (2011). Co-registration of eye movements and EEG in natural reading: analyses and review. J. Exp. Psychol. Gen.140, 552–572. doi: 10.1037/a0023885
54
DonkersF. C. L.Van BoxtelG. J. M. (2004). The N2 in go/no-go tasks reflects conflict monitoring, not response inhibition. Brain Cogn.56, 165–176. doi: 10.1016/j.bandc.2004.04.005
55
DussiasP. E.KroffJ. V.GerfenC. (2013). “Visual world eye-tracking,” in Research Methods in Second Language Psycholinguistics, eds. J. Jegerski, and B. VanPatten (New York, NY: Routledge), 93–126.
56
DussiasP. E.SagarraN. (2007). The effect of exposure on syntactic parsing in Spanish–English bilinguals. Biling. Lang. Cogn.10, 101–116. doi: 10.1017/S1366728906002847
57
DuyckW.Van AsscheE.DriegheD.HartsuikerR. J. (2007). Visual word recognition by bilinguals in a sentence context: evidence for nonselective lexical access. J. Exp. Psychol. Learn. Mem. Cogn.33, 663–679. doi: 10.1037/0278-7393.33.4.663
58
EgurtzegiA.BlasiD. E.Bornkessel-SchlesewskyI.LakaI.MeyerM.BickelB.et al. (2022). Cross-linguistic differences in case marking shape neural power dynamics and gaze behavior during sentence planning. Brain Lang.230:105127. doi: 10.1016/j.bandl.2022.105127
59
FernandezM.AcostaJ.DouglassK.DoshiN.TartarJ. L. (2014). Speaking two languages enhances an auditory but not a visual neural marker of cognitive inhibition. AIMS Neurosci.1, 145–157. doi: 10.3934/Neuroscience.2014.2.145
60
FernandezM.TartarJ. L.PadronD.AcostaJ. (2013). Neurophysiological marker of inhibition distinguishes language groups on a non-linguistic executive function test. Brain Cogn.83, 330–336. doi: 10.1016/j.bandc.2013.09.010
61
Fernandez-DuqueM.HayakawaS.MarianV. (2023). Speakers of different languages remember visual scenes differently. Sci. Adv.9:eadh0064. doi: 10.1126/sciadv.adh0064
62
FerréP.GuaschM.Stadthagen-GonzalezH.ComesañaM. (2022). Love me in L1, but hate me in L2: how native speakers and bilinguals rate the affectivity of words when feeling or thinking about them. Biling. Lang. Cogn.25, 786–800. doi: 10.1017/S1366728922000189
63
FolsteinJ. R.Van PettenC. (2008). Influence of cognitive control and mismatch on the N2 component of the ERP: a review. Psychophysiology45, 152–170. doi: 10.1111/j.1469-8986.2007.00602.x
64
FriesenD. C.Chung-Fat-YimA.BialystokE. (2016). Lexical selection differences between monolingual and bilingual listeners. Brain Lang.152, 1–13. doi: 10.1016/j.bandl.2015.11.001
65
GodfroidA. (2020). Eye Tracking in Second Language Acquisition and Bilingualism: A Research Synthesis and Methodological Guide. London: Routledge. doi: 10.4324/9781315775616
66
GrabnerR. H.BrunnerC.LeebR.NeuperC.PfurtschellerG. (2007). Event-related EEG theta and alpha band oscillatory responses during language translation. Brain Res. Bull. 72, 57–65. doi: 10.1016/j.brainresbull.2007.01.001
67
GreyS.TagarelliK. M. (2018). “Psycholinguistic methods,” in The Palgrave Handbook of Applied Linguistics Research Methodology, eds. A. Phakiti, P. De Costa, L. Plonsky, and S. Starfield (London: Palgrave Macmillan), 287–312. doi: 10.1057/978-1-137-59900-1_14
68
GrundyJ. G.AndersonJ. A. E.BialystokE. (2017a). Bilinguals have more complex EEG brain signals in occipital regions than monolinguals. NeuroImage159, 280–288. doi: 10.1016/j.neuroimage.2017.07.063
69
GrundyJ. G.AndersonJ. A. E.BialystokE. (2017b). Neural correlates of cognitive processing in monolinguals and bilinguals. Ann. N. Y. Acad. Sci.1396, 183–201. doi: 10.1111/nyas.13333
70
GrundyJ. G.Chung-Fat-YimA. (2023). “Domain-general electrophysiological changes associated with bilingualism,” in Understanding Language and Cognition through Bilingualism, eds. J. A. E. Anderson, G. Luk, and J. G. Grundy (Amsterdam: John Benjamins Publishing Company), 236–262. doi: 10.1075/sibil.64.12gru
71
GrüterT. (2018). “Processing at higher levels,” in The Listening Bilingual: Speech Perception, Comprehension, and Bilingualism, eds. F. Grosjean, K. Byers-Heinlein, M. Antoniou, T. Grüter, R. J. Hartsuiker, E. D. Peña, L. M. Bedore, and L.-F. Shi (Hoboken, NJ: John Wiley & Sons), 199–219. doi: 10.1002/9781118835722.ch10
72
HahneA.FriedericiA. D. (2001). Processing a second language: late learners' comprehension mechanisms as revealed by event-related brain potentials. Biling. Lang. Cogn.4, 123–141. doi: 10.1017/S1366728901000232
73
HaresignI. M.PhillipsE.WhitehornM.NoreikaV.JonesE.LeongV.et al. (2021). Automatic classification of ICA components from infant EEG using MARA. Dev. Cogn. Neurosci.52:101024. doi: 10.1016/j.dcn.2021.101024
74
HassonU.EgidiG. (2015). “What are naturalistic comprehension paradigms teaching us about language?” in Cognitive Neuroscience of Natural Language Use, ed R. Willems (Cambridge: Cambridge University Press), 228–255. doi: 10.1017/CBO9781107323667.011
75
HebbD. O. (1949). The Organization of Behavior: A Neuropsychological Theory. New York, NY: John Wiley & Sons.
76
HeidlmayrK.KihlstedtM.IselF. (2020). A review on the electroencephalography markers of Stroop executive control processes. Brain Cogn.146:105637. doi: 10.1016/j.bandc.2020.105637
77
HesselA. K.NationK.MurphyV. A. (2021). Comprehension monitoring during reading: an eye-tracking study with children learning English as an additional language. Sci. Stud. Read.25, 159–178. doi: 10.1080/10888438.2020.1740227
78
HimmelstossN. A.SchusterS.HutzlerF.MoranR.HawelkaS. (2020). Co-registration of eye movements and neuroimaging for studying contextual predictions in natural reading. Lang. Cogn. Neurosci.35, 595–612. doi: 10.1080/23273798.2019.1616102
79
HoeksJ. C. J.StoweL. A.DoedensG. (2004). Seeing words in context: the interaction of lexical and sentence level information during reading. Cogn. Brain Res.19, 59–73. doi: 10.1016/j.cogbrainres.2003.10.022
80
HoshinoN.ThierryG. (2012). Do Spanish–English bilinguals have their fingers in two pies – or is it their toes? an electrophysiological investigation of semantic access in bilinguals. Front. Psychol.3:9. doi: 10.3389/fpsyg.2012.00009
81
HuettigF.McQueenJ. M. (2008). “Retrieval and use of components of lexical knowledge depend on situational demands,” in AMLaP 2008 Conference. Cambridge.
82
HuettigF.RommersJ.MeyerA. S. (2011). Using the visual world paradigm to study language processing: a review and critical evaluation. Acta Psychol.137, 151–171. doi: 10.1016/j.actpsy.2010.11.003
83
HuizelingE.AldayP. M.PeetersD.HagoortP. (2023). Combining EEG and 3D-eye-tracking to study the prediction of upcoming speech in naturalistic virtual environments: a proof of principle. Neuropsychologia191:108730. doi: 10.1016/j.neuropsychologia.2023.108730
84
JacksonG. M.SwainsonR.CunningtonR.JacksonS. R. (2001). ERP correlates of executive control during repeated language switching. Biling. Lang. Cogn.4, 169–178. doi: 10.1017/S1366728901000268
85
JaredD.KrollJ. F. (2001). Do bilinguals activate phonological representations in one or both of their languages when naming words?J. Mem. Lang.44, 2–31. doi: 10.1006/jmla.2000.2747
86
JończykR.KrzysikI.WitczakO.Bromberek-DyzmanK.ThierryG. (2024). Operating in a second language lowers cognitive interference during creative idea generation: evidence from brain oscillations in bilinguals. NeuroImage297:120752. doi: 10.1016/j.neuroimage.2024.120752
87
JonkmanL. M. (2006). The development of preparation, conflict monitoring and inhibition from early childhood to young adulthood: a Go/Nogo ERP study. Brain Res.1097, 181–193. doi: 10.1016/j.brainres.2006.04.064
88
JuM.LuceP. A. (2004). Falling on sensitive ears: constraints on bilingual lexical activation. Psychol. Sci.15, 314–318. doi: 10.1111/j.0956-7976.2004.00675.x
89
JustM. A.CarpenterP. A. (1980). A theory of reading: from eye fixations to comprehension. Psychol. Rev.87, 329–354. doi: 10.1037/0033-295X.87.4.329
90
KaanE.HarrisA.GibsonE.HolcombP. (2000). The P600 as an index of syntactic integration difficulty. Lang. Cogn. Process.15, 159–201. doi: 10.1080/016909600386084
91
KangC.MaF.GuoT. (2018). The plasticity of lexical selection mechanism in word production: ERP evidence from short-term language switching training in unbalanced Chinese–English bilinguals. Biling. Lang. Cogn.21, 296–313. doi: 10.1017/S1366728917000037
92
KangC.MaF.LiS.GuoT. (2023). Bilingual language control adapts to language switching training: more ERP evidence from late unbalanced bilinguals. J. Neurolinguistics67:101141. doi: 10.1016/j.jneuroling.2023.101141
93
KeatingG.JegerskiJ. (2014). Experimental designs in sentence processing research. Stud. Second Lang. Acquis.37, 1–32. doi: 10.1017/S0272263114000187
94
KeatingG. D. (2014). “Eye-tracking with text,” in Research Methods in Second Language Psycholinguistics, eds. J. Jegerski, and B. VanPatten (London: Routledge), 69–92.
95
KielarA.MeltzerJ. A.MorenoS.AlainC.BialystokE. (2014). Oscillatory responses to semantic and syntactic violations. J. Cogn. Neurosci. 26, 2840–2862. doi: 10.1162/jocn_a_00670
96
KotzS. A.Elston-GüttlerK. (2004). The role of proficiency on processing categorical and associative information in the L2 as revealed by reaction times and event-related brain potentials. J. Neurolinguistics17, 215–235. doi: 10.1016/S0911-6044(03)00058-7
97
KousaieS.PhillipsN. A. (2012). Conflict monitoring and resolution: are two languages better than one? Evidence from reaction time and event-related brain potentials. Brain Res.1446, 71–90. doi: 10.1016/j.brainres.2012.01.052
98
KretzschmarF.Bornkessel-SchlesewskyI.SchlesewskyM. (2009). Parafoveal versus foveal N400s dissociate spreading activation from contextual fit. Neuroreport20, 1613–1618. doi: 10.1097/WNR.0b013e328332c4f4
99
KrollJ. F.StewartE. (1994). Category interference in translation and picture naming: evidence for asymmetric connections between bilingual memory representations. J. Mem. Lang. 33, 149–174. doi: 10.1006/jmla.1994.1008
100
KulkeL. (2015). Cortical mechanisms of visual attention in typically developing infants and adults. Doctoral thesis, University College London. UCL Discovery. Available online at: https://discovery.ucl.ac.uk/id/eprint/1471117/ (Accessed December 16, 2025).
101
KulkeL. (2025). Coregistration of EEG and eye-tracking in infants and developing populations. Atten. Percept. Psychophys.87, 228–237. doi: 10.3758/s13414-024-02857-y
102
KuperbergG. R.PaczynskiM.DitmanT. (2011). Establishing causal coherence across sentences: an ERP study. J. Cogn. Neurosci.23, 1230–1246. doi: 10.1162/jocn.2010.21452
103
KutasM.FedermeierK. D. (2011). Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu. Rev. Psychol.62, 621–647. doi: 10.1146/annurev.psych.093008.131123
104
KutasM.HillyardS. A. (1980). Reading senseless sentences: brain potentials reflect semantic incongruity. Science207, 203–205. doi: 10.1126/science.7350657
105
LibbenM. R.TitoneD. A. (2009). Bilingual lexical access in context: evidence from eye movements during reading. J. Exp. Psychol. Learn. Mem. Cogn.35, 381–390. doi: 10.1037/a0014875
106
LightG. A.WilliamsL. E.MinowF.SprockJ.RisslingA.SharpR.et al. (2010). Electroencephalography (EEG) and event-related potentials (ERPs) with human participants. Curr. Protoc. Neurosci.52, 6.25.1–6.25.24. doi: 10.1002/0471142301.ns0625s52
107
LismanJ. (2010). Working memory: the importance of theta and gamma oscillations. Curr. Biol. 20, R490–R492. doi: 10.1016/j.cub.2010.04.011
108
LismanJ. E.JensenO. (2013). The θ-γ neural code. Neuron77, 1002–1016. doi: 10.1016/j.neuron.2013.03.007
109
LiversedgeS. P.PatersonK. B.PickeringM. J. (1998). “Eye movements and measures of reading time,” in Eye Guidance in Reading and Scene Perception, ed G. Underwood (Oxford: Elsevier Science Ltd), 55–75. doi: 10.1016/B978-008043361-5/50004-3
110
López-RojasC.RossiE.MarfulA.BajoM. T. (2022). Prospective memory in bilinguals and monolinguals: ERP and behavioural correlates of prospective processing in bilinguals. Brain Lang.225:105059. doi: 10.1016/j.bandl.2021.105059
111
LukG.De SaE.BialystokE. (2011). Is there a relation between onset age of bilingualism and enhancement of cognitive control?Biling. Lang. Cogn.14, 588–595. doi: 10.1017/S1366728911000010
112
MarianV.NeisserU. (2000). Language-dependent recall of autobiographical memories. J. Exp. Psychol. Gen.129, 361–368. doi: 10.1037/0096-3445.129.3.361
113
MarianV.SpiveyM. (2003a) Bilingual monolingual processing of competing lexical items. Appl. Psycholinguist. 24, 173–193. 10.1017/S0142716403000092
114
MarianV.SpiveyM. (2003b). Competing activation in bilingual language processing: Within- and between-language competition. Biling. Lang. Cogn. 6, 97–115. doi: 10.1017/S1366728903001068
115
MetznerP.von der MalsburgT.VasishthS.RöslerF. (2016). The importance of reading naturally: evidence from combined recordings of eye movements and electric brain potentials. Cogn. Sci.41, 1232–1263. doi: 10.1111/cogs.12384
116
MeuterR. F.AllportA. (1999). Bilingual language switching in naming: asymmetrical costs of language selection. J. Mem. Lang.40, 25–40. doi: 10.1006/jmla.1998.2602
117
MidgleyK. J.HolcombP. J.GraingerJ. (2009). Language effects in second-language learners and proficient bilinguals investigated with event-related potentials. J. Neurolinguistics22, 281–300. doi: 10.1016/j.jneuroling.2008.08.001
118
MitchellD. C.ShenX.GreenM. J.HodgsonT. L. (2008). Accounting for regressive eye-movements in models of sentence processing: a reappraisal of the selective reanalysis hypothesis. J. Mem. Lang.59, 266–293. doi: 10.1016/j.jml.2008.06.002
119
MoralesJ.YudesC.Gómez-ArizaC. J.BajoM. T. (2015). Bilingualism modulates dual mechanisms of cognitive control: evidence from ERPs. Neuropsychologia66, 157–169. doi: 10.1016/j.neuropsychologia.2014.11.014
120
MorenoE. M.FedermeierK. D.KutasM. (2002). Switching languages, switching palabras (words): an electrophysiological study of code switching. Brain Lang.80, 188–207. doi: 10.1006/brln.2001.2588
121
MorenoE. M.KutasM. (2005). Processing semantic anomalies in two languages: an electrophysiological exploration in both languages of Spanish–English bilinguals. Cogn. Brain Res.22, 205–220. doi: 10.1016/j.cogbrainres.2004.08.010
122
MorenoS.WodnieckaZ.TaysW.AlainC.BialystokE. (2014). Inhibitory control in bilinguals and musicians: event-related potential (ERP) evidence for experience-specific effects. PLoS ONE9:e94169. doi: 10.1371/journal.pone.0094169
123
MorrisonC.KamalF.TalerV. (2019). The influence of bilingualism on working memory event-related potentials. Biling. Lang. Cogn.22, 191–199. doi: 10.1017/S1366728918000391
124
MorucciP.GiannelliF.RichterC. G.MolinaroN. (2025). Spoken words affect visual object recognition via the modulation of alpha and beta oscillations. Front. Neurosci. 19:1467249. doi: 10.3389/fnins.2025.1467249
125
NewmanA. J.TremblayA.NicholsE. S.NevilleH. J.UllmanM. T. (2012). The influence of language proficiency on lexical semantic processing in native and late learners of English. J. Cogn. Neurosci.24, 1205–1223. doi: 10.1162/jocn_a_00143
126
NieuwlandM. S. (2019). Do ‘early' brain responses reveal word form prediction during language comprehension? a critical review. Neurosci. Biobehav. Rev.96, 367–400. doi: 10.1016/j.neubiorev.2018.11.019
127
NingS.HayakawaS.BartolottiJ.MarianV. (2020). On language and thought: bilingual experience influences semantic associations. J. Neurolinguistics56:100932. doi: 10.1016/j.jneuroling.2020.100932
128
OssandónJ. P.HeloA. V.Montefusco-SiegmundR.MaldonadoP. E. (2010). Superposition model predicts EEG occipital activity during free viewing of natural scenes. J. Neurosci.30, 4787–4795. doi: 10.1523/JNEUROSCI.5769-09.2010
129
OsterhoutL.HolcombP. J. (1992). Event-related brain potentials elicited by syntactic anomaly. J. Mem. Lang.31, 785–806. doi: 10.1016/0749-596X(92)90039-Z
130
OsterhoutL.HolcombP. J.SwinneyD. A. (1994). Brain potentials elicited by garden-path sentences: evidence of the application of verb information during parsing. J. Exp. Psychol. Learn. Mem. Cogn.20, 786–803. doi: 10.1037/0278-7393.20.4.786
131
PayneB. R.NgS.ShantzK.FedermeierK. D. (2020). “Event-related brain potentials in multilingual language processing: the N's and P's,” in Psychology of Learning and Motivation, ed J. F. Rhodes (Vol. 72, San Diego, CA: Academic Press), 75–118. doi: 10.1016/bs.plm.2020.03.003
132
PérezA.CainK.CastellanosM. C.BajoT. (2015). Inferential revision in narrative texts: an ERP study. Mem. Cogn.43, 1105–1135. doi: 10.3758/s13421-015-0528-0
133
PérezA.HansenL.BajoT. (2019). The nature of first and second language processing: the role of cognitive control and L2 proficiency during text-level comprehension. Biling. Lang. Cogn.22, 930–948. doi: 10.1017/S1366728918000846
134
PérezA.JosephH. S.BajoT.NationK. (2016). Evaluation and revision of inferential comprehension in narrative texts: an eye movement study. Lang. Cogn. Neurosci.31, 549–566. doi: 10.1080/23273798.2015.1115883
135
PérezA. I.SchmidtE.TsimpliI. M. (2024). Inferential evaluation and revision in L1 and L2 text comprehension: an eye movement study. Biling. Lang. Cogn.27, 585–598. doi: 10.1017/S136672892300069X
136
PickeringM. J.FrissonS.McElreeB.TraxlerM. J. (2004). “Eye movements and semantic composition,” in The On-line Study of Sentence Comprehension: Eyetracking, ERPs and Beyond, eds. M. Carreiras, and C. Clifton, Jr. (Hove: Psychology Press), 33–50.
137
PiresL.LeitãoJ.GuerriniC.SimõesM. R. (2014). Event-related brain potentials in the study of inhibition: cognitive control, source localization and age-related modulations. Neuropsychol. Rev.24, 461–490. doi: 10.1007/s11065-014-9275-4
138
PolichJ. (2003). “Theoretical overview of P3a and P3b,” in Detection of Change: Event-related Potential and fMRI Findings, ed J. Polich (Boston, MA: Springer), 83–98. doi: 10.1007/978-1-4615-0294-4_5
139
PolichJ. (2007). Updating P300: an integrative theory of P3a and P3b. Clin. Neurophysiol.118, 2128–2148. doi: 10.1016/j.clinph.2007.04.019
140
PolichJ. (2012). “Neuropsychology of P300,” in The Oxford Handbook of Event-Related Potential Components, eds. S. J. Luck, and E. S. Kappenman (Oxford: Oxford University Press), 159–188.
141
PriorA.GoldinaA.ShanyM.GevaE.KatzirT. (2014). Lexical inference in L2: Predictive roles of vocabulary knowledge and reading skill beyond reading comprehension. Read. Writ.27, 1467–1484. doi: 10.1007/s11145-014-9501-8
142
RaynerK. (2009). Eye movements and attention in reading, scene perception, and visual search. Q. J. Exp. Psychol.62, 1457–1506. doi: 10.1080/17470210902816461
143
ReingoldE. M.RaynerK. (2006). Examining the word identification stages hypothesized by the EZ Reader model. Psychol. Sci.17, 742–746. doi: 10.1111/j.1467-9280.2006.01775.x
144
RiesA.SlaybackD.TouryanJ. (2018). Effects of saccade magnitude, spatial frequency, and ocular artifact removal on the fixation-related lambda response. J. Vis.18, 522–522. doi: 10.1167/18.10.522
145
RossiE.SoaresS. M. P.PrystaukaY.NakamuraM.RothmanJ. (2023). Riding the (brain) waves! using neural oscillations to inform bilingualism research. Biling. Lang. Cogn.26, 202–215. doi: 10.1017/S1366728922000451
146
RossiS.GuglerM. F.FriedericiA. D.HahneA. (2006). The impact of proficiency on syntactic second-language processing of German and Italian: evidence from event-related potentials. J. Cogn. Neurosci.18, 2030–2048. doi: 10.1162/jocn.2006.18.12.2030
147
SabourinL.StoweL. A. (2008). Second language processing: when are first and second languages processed similarly?Second Lang. Res.24, 397–430. doi: 10.1177/0267658308090186
148
SarrettM. E.SheaC.McMurrayB. (2022). Within- and between-language competition in adult second language learners: implications for language proficiency. Lang. Cogn. Neurosci.37, 165–181. doi: 10.1080/23273798.2021.1952283
149
SchwartzA. I.KrollJ. F. (2006). Bilingual lexical activation in sentence context. J. Mem. Lang. 55, 197–212. doi: 10.1016/j.jml.2006.03.004
150
ShookA.MarianV. (2012) Bimodal bilinguals co-activate both languages during spoken comprehension. Cognition124, 314–324. doi: 10.1016/j.cognition.2012.05.014
151
ShookA.MarianV. (2013). The bilingual language interaction network for comprehension of speech. Biling. Lang. Cogn. 16, 304–324. doi: 10.1017/S1366728912000466
152
SoaresS. M.KubotaM.RossiE.RothmanJ. (2021). Determinants of bilingualism predict dynamic changes in resting state EEG oscillations. Brain. Lang. 223:105030. doi: 10.1016/j.bandl.2021.105030
153
SpiveyM. J.MarianV. (1999). Cross talk between native and second languages: partial activation of an irrelevant lexicon. Psychol. Sci.10, 281–284. doi: 10.1111/1467-9280.00151
154
SullivanM. D.JanusM.MorenoS.AstheimerL.BialystokE. (2014). Early stage second-language learning improves executive control: evidence from ERP. Brain Lang.139, 84–98. doi: 10.1016/j.bandl.2014.10.004
155
TanenhausM. K. (2007). “Eye movements and spoken language processing,” in Eye Movements: A Window on Mind and Brain, eds. R. P. G. van Gompel, M. H. Fischer, W. S. Murray, and R. L. Hill (Oxford: Elsevier), 443–469. doi: 10.1016/B978-008044980-7/50022-7
156
TanenhausM. K.Spivey-KnowltonM. J.EberhardK. M.SedivyJ. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science268, 1632–1634. doi: 10.1126/science.7777863
157
ThierryG.WuY. J. (2007). Brain potentials reveal unconscious translation during foreign-language comprehension. Proc. Natl. Acad. Sci. USA. 104, 12530–12535. doi: 10.1073/pnas.0609927104
158
Van AsscheE.DuyckW.HartsuikerR. J.DiependaeleK. (2009). Does bilingualism change native-language reading? Cognate effects in a sentence context. Psychol. Sci.20, 923–927. doi: 10.1111/j.1467-9280.2009.02389.x
159
VerhoefK. M.RoelofsA.ChwillaD. J. (2010). Electrophysiological evidence for endogenous control of attention in switching between languages in overt picture naming. J. Cogn. Neurosci.22, 1832–1843. doi: 10.1162/jocn.2009.21291
160
WardL. M. (2003). Synchronous neural oscillations and cognitive processes. Trends Cogn. Sci. 7, 553–559. doi: 10.1016/j.tics.2003.10.012
161
Weber-FoxC. M.NevilleH. J. (1996). Maturational constraints on functional specializations for language processing: ERP and behavioral evidence in bilingual speakers. J. Cogn. Neurosci.8, 231–256. doi: 10.1162/jocn.1996.8.3.231
162
WhitfordV.TitoneD. (2015). Second-language experience modulates eye movements during first- and second-language sentence reading: evidence from a gaze-contingent moving window paradigm. J. Exp. Psychol. Learn. Mem. Cogn.41, 1118–1129. doi: 10.1037/xlm0000093
163
WhitfordV.TitoneD. (2019). Lexical entrenchment and cross-language activation: two sides of the same coin for bilingual reading across the adult lifespan. Biling. Lang. Cogn.22, 58–77. doi: 10.1017/S1366728917000554
164
WuC.ZhangJ.YuanZ. (2022). An ERP investigation on the second language and emotion perception: the role of emotion word type. Int. J. Biling. Educ. Biling.25, 539–551. doi: 10.1080/13670050.2019.1703895
165
ZhangH.KangC.WuY.MaF.GuoT. (2015). Improving proactive control with training on language switching in bilinguals. Neuroreport26, 354–359. doi: 10.1097/WNR.0000000000000353
166
ZhengX.LemhöferK. (2019). The “semantic P600” in second language processing: when syntax conflicts with semantics. Neuropsychologia127, 131–147. doi: 10.1016/j.neuropsychologia.2019.02.010
167
ZwaanR. (2001). “Situation models,” in International Encyclopedia of the Social and Behavioral Sciences, eds. N. J. Smelser, and P. B. Baltes (Oxford: Pergamon Press), 14137–14141. doi: 10.1016/B0-08-043076-7/01550-3
Summary
Keywords
bilingual language processing, bilingualism, co-registration, EEG, event-related potentials (ERPs), eye-tracking
Citation
López-Rojas C, Soto C, Chung-Fat-Yim A and Marian V (2026) Co-registration of EEG and eye-tracking in psycholinguistics and bilingualism research. Front. Lang. Sci. 5:1750939. doi: 10.3389/flang.2026.1750939
Received
20 November 2025
Revised
21 January 2026
Accepted
26 January 2026
Published
13 February 2026
Volume
5 - 2026
Edited by
Seana Coulson, University of California, San Diego, CA, United States
Reviewed by
Sergio Miguel Pereira Soares, Max Planck Institute for Psycholinguistics, Netherlands
Aahana Bajracharya, Yale University, United States
Updates
Copyright
© 2026 López-Rojas, Soto, Chung-Fat-Yim and Marian.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Cristina López-Rojas, lopezrojas@ugr.es
†These authors have contributed equally to this work and share first authorship
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.