Original Research ARTICLE
Neurophysiological Correlates of the Rubber Hand Illusion in Late Evoked and Alpha/Beta Band Activity
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, United Kingdom
The rubber hand illusion (RHI) allows insights into how the brain resolves conflicting multisensory information regarding body position and ownership. Previous neuroimaging studies have reported a variety of neurophysiological correlates of illusory hand ownership, with conflicting results likely originating from differences in experimental parameters and control conditions. Here, we overcome these limitations by using a fully automated and precisely-timed visuo-tactile stimulation setup to record evoked responses and oscillatory responses in participants who felt the RHI. Importantly, we relied on a combination of experimental conditions to rule out confounds of attention, body-stimulus position and stimulus duration and on the combination of two control conditions to identify neurophysiological correlates of illusory hand ownership. In two separate experiments we observed a consistent illusion-related attenuation of ERPs around 330 ms over frontocentral electrodes, as well as decreases of frontal alpha and beta power during the illusion that could not be attributed to changes in attention, body-stimulus position or stimulus duration. Our results reveal neural correlates of illusory hand ownership in late and likely higher-order rather than early sensory processes, and support a role of premotor and possibly intraparietal areas in mediating illusory body ownership.
Philosophy, psychology and neuroscience continue to debate the sources and modulators of conscious experience. The scientific study of consciousness has long been focussed on the visual domain, but recent decades have seen a rise of interest in bodily self-consciousness and the integration of bodily signals with other multisensory information (Jeannerod, 2007). Bodily self-consciousness refers to the integrated, pre-reflexive experience of being a self in a body and has been related to tactile, vestibular, proprioceptive, as well as visual and motor information (Tsakiris and Haggard, 2005; Blanke, 2012). One extensively investigated aspect of bodily self-consciousness is the experience that our body and its parts belong to us and are distinguished from non-body objects and other people’s bodies, so-called body ownership. A widely used paradigm to study body ownership is the rubber hand illusion (RHI; Botvinick, 2004) during which participants watch an artificial rubber hand being stroked in synchrony with strokes on their own occluded hand. This synchronous visuo-tactile stimulation alters bodily experience as it induces the illusion that the rubber hand is one’s own hand.
Several functional magnetic resonance imaging (fMRI) studies have aimed to identify the neural correlates of illusory hand ownership. The experience of illusory hand ownership has been linked to activity in frontal brain regions, such as the premotor cortex (Ehrsson et al., 2004; Petkova et al., 2011; Bekrater-Bodmann et al., 2014), occipito-temporal regions such as the extrastriate body area (Limanowski et al., 2014), intraparietal areas (Petkova et al., 2011), the anterior insula (Limanowski et al., 2014), and the temporoparietal junction (Guterstam et al., 2013). However, given the nature of the fMRI signal, these studies have not been able to provide a functionally specific picture that assigns these neural correlates to a specific part of the sensory-perceptual cascade, for example by assigning the relevant neural activations to a specific latency following each repeat of the visuo-tactile stimulation.
Overcoming these limitations, several electroencephalographic (EEG) studies have aimed to reveal the physiological correlates of illusory hand ownership at higher temporal precision. One such study has described the relative attenuation of somatosensory-evoked responses during the Illusion about 55 ms after stimulus onset (Zeller et al., 2015). This attenuation was localized to the primary somatosensory cortex and the anterior intraparietal sulcus, and was interpreted by the authors as an attenuated precision of the relevant proprioceptive representations involved in the RHI. However, another EEG study using a similar experimental paradigm reported illusion-related changes in ERPs only at much longer latencies of around 460 ms over frontal electrodes (Peled et al., 2003). Furthermore, studies on oscillatory power showed a decrease in frontal-parietal alpha power and fronto-parietal beta power to be associated with illusory hand ownership (Faivre et al., 2017). This was interpreted as reflecting increased activation in sensorimotor cortices due to the illusion. Further support for a role of alpha band activity was provided by Lenggenhager et al. (2011) who reported a correlation between alpha band oscillations and a measure of illusory body ownership. In contrast to this, Kanayama et al. (2007, 2009) only found greater interelectrode phase synchrony in the gamma band range (40–50 Hz) to be correlated with the perceived intensity of illusory hand ownership. Overall, it remains unclear whether neural correlates of the RHI include aspects of early sensory encoding, hence at shorter latencies relative to stimulus onset, or mostly involve higher cognitive processes emerging at longer latencies relative to the touch stimulus.
The lack of clear insights from the existing EEG studies on the RHI may in part result from the use of distinct control conditions and different stimulation parameters, and confounding factors that may have emerged as a consequence of these. Two widely used control conditions for the RHI are the Incongruent condition, in which the rubber hand is placed as an anatomically incongruent angle, and the Real condition, in which the rubber hand is absent and stimulation occurs on the real hand in view (Ehrsson et al., 2004; Tsakiris et al., 2007; Schmalzl et al., 2014; Olivé et al., 2015; Zeller et al., 2015, 2016). Unfortunately, these control conditions carry inherent confounds by differing from the illusion condition by more than just the absence of the illusion. In the Real condition, the hand position is changed and the rubber hand is completely absent from the setup, hence all seen potential body parts are indeed a natural part of the participant’s body. In the Incongruent condition the visual stimulation of the Rubber Hand and the somatosensory stimulation on the real hand occur in two different locations, while in the Illusion condition these stimulations are perceived to occur on one location, i.e., on the rubber hand. It is hence possible that spatial attention in the Illusion condition is focused on one location, while in the Incongruent condition attention is divided across two locations. As a result, changes in spatial attention may confound some of the previous results. In addition, in the Illusion condition, the visual stimulus is perceived to occur on the participant’s body, i.e., the embodied rubber hand. The visual stimulus in the Incongruent condition however is perceived to occur not on the body, but on the non-embodied rubber hand. Previous studies have suggested that visual stimuli are processed differently when the stimuli is placed near the hand, rather than when it is not (Langerak et al., 2013). Thus, visual processing due to body-stimulus position between Illusion and Incongruent condition may differ substantially. As a result it remains unclear whether illusion-related effects reported in previous studies are indeed only related to the illusory body experience, or rather originate from confounding factors introduced by the control conditions, such as changes in attention or body-stimulus position. We here directly investigated the role of these confounding factors by including manipulations of these in our experimental design (Experiment 1).
Differing stimulation parameters in regard to stimulus duration might have added to the discrepancy among results. Peled et al. (2003), Zeller et al. (2015) and Faivre et al. (2017) relied on manual stimulation applied by an experimenter, with inconsistent and unspecified stimulus duration, while Kanayama et al. (2007, 2009) administered automated visuo-tactile stimuli of 300 ms duration. The differing stimuli durations across studies pose a problem for the identification of evoked responses related to the RHI. The use of a fixed stimulation duration as in Kanayama et al. (2007, 2009) limits the scope of the results in that the location and latency of the identified modulation related to the RHI might be specific to the respective stimulus duration. Varying and undetermined stimulus durations across trials as used by Zeller et al. (2015) and Peled et al. (2003) are problematic due to the differences in stimulus offset times and their possible influence on shape and amplitudes of evoked responses (Spackman et al., 2006; Woodman, 2010). For these reasons, it remains very difficult to collate findings across studies and to reliably identify the electrophysiological correlates of illusionary hand ownership. To overcome this problem we relied on a temporally precise stimulation setup and explicitly manipulated the duration of the individual stimulation events (Experiment 2).
All in all, our goal was to study the neural correlates of the RHI in EEG brain activity by refining the typical protocol used to induce the RHI in three ways: first, by introducing a temporally precise stimulation apparatus that allows the recording of evoked activity that is precisely-time locked to the somatosensory stimulus; second, by comparing neural correlates of the RHI across different control conditions to rule out confounds of attention and body-stimulus position; and third, by testing if the identified neural correlates of the RHI are robust against changes in stimulus duration. Given that previous studies have reported illusion-related effects both in evoked responses (Peled et al., 2003; Zeller et al., 2015) and in induced oscillatory activity (Kanayama et al., 2007, 2009; Faivre et al., 2017), we here focused on both these markers of neural processing. In the first experiment we recorded EEG activity during the Illusion, the Real and Incongruent control conditions and two further conditions which varied in attention focus and body-stimulus position. We identified neurophysiological correlates of illusionary hand ownership that were consistent across both control conditions and then differentiated these from the two confounds by comparing the respective contrasts. In a second experiment, we expected to replicate these neurophysiological correlates of illusionary hand ownership, and hypothesized that these were robust against changes in stimulus duration.
Materials and Methods
A total of 52 right-handed volunteers participated in this study. We first ran a pilot study on all 52 participants, which involved 2 min of synchronous visuo-tactile stimulation identical to the Illusion condition described below. After the stimulation participants filled out a standard RHI questionnaire (Botvinick and Cohen, 1998). Thirty-two of the 52 total participants agreed or strongly agreed to the statement “During the last trial I felt as if the rubber hand were my hand” (Botvinick and Cohen, 1998) and showed mean negative scores for the control statements. Only the 32 participants who showed this response pattern were included in the subsequent two experiments, with eight participants participating in both experiments. The presented data is from 20 participants each (Experiment 1: n = 20 participants including 13 female, mean age = 23.1 years, SD = 3.1; Experiment 2: n = 20 participants including 13 female, mean age = 22.1 years, SD = 2.9 years). All participants gave written informed consent before participation in this study in accordance with the Declaration of Helsinki. All protocols conducted in this study were approved by the Ethics Committee of the College of Science and Engineering of the University of Glasgow.
Participants sat on a comfortable chair in front of a one-compartment, open-ended box placed on a two-storey wooden platform. Their left arm was placed on an arm rest. Visual stimulation was delivered by a red light-emitting diode (LED; Seeedstudio, 10 mm diameter) positioned 5 cm to the right of the box on the top storey. Tactile stimulation was delivered by a vibration motor placed close to the subject’s skin (Permanent magnet coreless DC motor, Seeedstudio, 10 mm diameter). Visual and tactile stimulation were controlled via Matlab and an Arduino prototyping platform.
In Experiment 1 five conditions were administered in a randomized order for each subject (Figure 1A). The conditions differed in presence or absence of illusion, body-stimulus position (visual stimulus on body, visual stimulus not on body) and attention (focused, divided). Illusion condition: the participant’s left hand was placed in the box with the tip of the middle finger positioned on a vibration motor. The right hand was placed at the other end of the platform in reaching distance of the keyboard. A lifelike rubber hand was positioned in an anatomically congruent orientation next to the box in a distance of 15 cm to the participant’s hidden left hand. The middle finger of the rubber hand was placed on a dummy vibration motor. The LED was positioned 5 mm above the dummy motor. This condition is typically used to induce the RHI. Incongruent condition: the rubber hand was placed at an angle of 45°. Besides this the setup was similar to the setup described in Illusion (Ehrsson et al., 2004; Press et al., 2008; Olivé et al., 2015; Zeller et al., 2015, 2016). Real condition: no rubber hand was present. The middle finger of the left hand was placed in view on a vibration motor positioned 5 mm below the LED. The right hand was in the same position as in the Illusion and Incongruent conditions (Zeller et al., 2015, 2016). Hand under condition: the participant’s left hand was placed on the lower storey of the platform with the middle finger placed on a vibration motor. The vibration motor was positioned right below the dummy vibration motor on the top storey. The vertical distance between the two motors was 10 cm. Besides this, the setting was identical to the Incongruent condition. Two hands condition: no rubber hand was present. The middle finger of the participant’s right hand was placed on a dummy vibration motor below the LED. Besides this, the setting was identical to the Incongruent condition. Throughout all conditions view of the left arm, and the trunk of the rubber hand where applicable, was obstructed by an opaque piece of fabric.
Figure 1. (A) Stimulation setup during the five conditions. Illusion condition: congruently placed rubber hand on dummy vibration motor below light-emitting diode (LED), left hand on vibration motor. Incongruent condition: incongruently placed rubber hand on dummy vibration motor below LED, left hand on vibration motor. Hand under condition: incongruently placed rubber hand on dummy vibration motor below LED, left hand on vibration motor below dummy vibration motor and LED. Two hands condition: no rubber hand, left hand on vibration motor, right hand on dummy vibration below LED. Real condition: no rubber hand, left hand on vibration motor under LED. The four non-illusion conditions were additionally grouped in a 2 × 2 design according to the factors attention and body-stimulus position. (B) Experiment 1: illusion effect, Attention and Body-stimulus position contrasts and the experimental conditions they are based on. (C) Experimental setup in Experiment 1 (top panel) and in Experiment 2 (bottom panel). The order of blocks was randomized for every subject.
For subsequent analysis the differences in hand and stimuli location across conditions allow for a grouping of Incongruent, Real, Hand under and Two hands in regards to attentional and body-stimulus related processing (Figure 1B). In the Incongruent and Two hands conditions attention is divided, since in both conditions visual and somatosensory stimuli occur at distant locations. In the Real and Hand under conditions attention is focused, since visual and somatosensory stimuli occur at the same location. For body-stimulus related processing, Incongruent and Hand under can be grouped as the visual stimulus does not occur on the subject’s body, while the Real and Two hands conditions can be grouped as the visual stimulus does occur on the participant’s body.
In Experiment 1 one block of each condition was administered. Each block included 200 stimulation events. The visuo-tactile stimulus duration was 100 ms and the inter-stimulus interval varied randomly and evenly between 700 ms and 1500 ms. Each block lasted approximately 3.5 min. Experiment 2 contained three blocks of each, the Illusion and Incongruent condition administered in a pseudorandom order. Each block included 291 stimulation events. On a given stimulation event visuo-tactile stimulus duration was either 100 ms, 125 ms, 150 ms or 175 ms (pseudo-randomly assigned). Every block contained at least 64 events of each stimulus duration. The inter-stimulus interval varied randomly and evenly between 700 ms and 1500 ms. Each block lasted approximately 5 min (Figure 1C).
In both experiments participants were instructed to use their right hand to press the right arrow key on a computer keyboard when they felt the onset of the illusion and the left arrow key when they lost the feeling of the illusion. Participants sat with their gaze fixed on the LED and wore ear plugs throughout the experiment to reduce the noise caused by the vibration motors.
Experiments were performed in a darkened and electrically shielded room. EEG signals were continuously recorded using an active 64 channel BioSemi (BioSemi, B.V., Netherlands) system with Ag-AgCl electrodes mounted on an elastic cap (BioSemi) according to the 10/20 system. Four additional electrodes were placed at the outer canthi and below the eyes to obtain the electro-occulogram (EOG). Electrode offsets were kept below 25 mV. Data were acquired at a sampling rate of 500 Hz using a low pass filter of 208 Hz.
Data analysis was carried out offline with MATLAB (The MathWorks Inc., Natick, MA, USA) using the FieldTrip toolbox (Oostenveld et al., 2011). Stimulation events and their corresponding triggers were sorted based on condition, presence or absence of the illusion and stimulus length (Experiment 2 only). For the analysis of the Illusion condition only events in which the illusion was present, as indicated by the subjects, were used. This amounted to 163 ± 29 (mean ± SD) events in Experiment 1, and 248 ± 34 (mean ± SD) events in Experiment 2. For analysis of all other conditions only events in which the illusion was absent were used. Since no occurrence of the illusion was reported in any of these conditions in either experiment, all respective events were included in the analysis. EEG data was segmented into epochs of 700 ms (200 ms pre-stimulus to 500 ms post-stimulus) and pre-processed as follows: the data were band-pass filtered between 0.5 Hz and 30 Hz, re-sampled to 200 Hz and subsequently de-noised using independent component analysis (ICA; Debener et al., 2010). In addition, for some subjects highly localized components reflecting muscular artifacts were detected and removed (O’Beirne and Patuzzi, 1999; Hipp and Siegel, 2013). To detect potential artifacts pertaining to remaining blinks or eye movements we computed horizontal, vertical and radial EOG signals following established procedures (Keren et al., 2010; Hipp and Siegel, 2013). We rejected trials on which the peak signal amplitude on any electrode exceeded a level of ±75 μV, or during which potential eye movements were detected based on a threshold of 3 standard deviations above mean of the high-pass filtered EOGs using procedures suggested by Keren et al. (2010). Together these criteria led to the rejection of 34 ± 8% of trials (mean ± SD) in Experiment 1 and of 25 ± 11% of trials (mean ± SD) of trials in Experiment 2. For further analysis the EEG signals were referenced to the common average reference.
Condition averages of the evoked responses (ERPs) and oscillatory power (see below) were computed by randomly sampling the same number of stimulation events from each condition. This was necessary as the number of available trials differed across conditions. Condition averages were obtained by averaging 500 times trial-averages obtained from 80% of the minimally available number of trials.
To analyze oscillatory activity, we extracted single trial spectral power for alpha (8–12 Hz) and beta (13–25 Hz) using a discrete Fourier transformation on sliding Hanning windows with a length of 200 ms. Power values in the range of 100 ms pre-stimulus and 350 ms post-stimulus were averaged across trials. No baseline normalization was performed but within-subject statistical comparisons were used (see below), which make the subtraction of a common baseline unnecessary. As we did not monitor eye movements we decided to not include gamma band activity in our analysis, due to their particular susceptibility to miniature saccade artifacts (Muthukumaraswamy, 2013).
In Experiment 1 our primary aims were to determine ERP and oscillatory signatures of the illusion and to compare these to ERP and time-frequency signatures of attentional and body-stimulus position related processes. While we expected to find significant differences in evoked activity between Illusion and control conditions over parietal and centrofrontal areas (Peled et al., 2003; Zeller et al., 2015) our stimulation parametres and experimental setup differed from previous studies to such an extent that we decided to employ an unbiased approach and to test for statistical effects across all electrodes and a wide time range. We hence used spatio-temporal Cluster-based Permutation Analysis to detect significant condition differences. As is standard in many similar EEG studies, a two-tailed paired t-test was performed for each electrode, and the cluster statistic was defined as the sum of the t-values of all spatially adjacent electrodes exceeding a critical value corresponding to an alpha level of 0.05, and a minimal cluster size of 2 (Maris and Oostenveld, 2007; Kayser et al., 2015). The cluster statistic was compared with the maximum cluster statistic of 2000 random permutations, based on an overall p-value of 0.05. To identify illusion effects we compared Illusion vs. Incongruent and Illusion vs. Real conditions. For obtaining Body-stimulus position and Attention contrasts we used the four conditions Incongruent, Hand under, Two hands, Real, which differed along the factors of Attention (focused, divided) and Body-stimulus position (visual stimulus on body, visual stimulus not on body) in a 2 × 2 design (Figure 1B). To obtain the contrasts for each factor we averaged over the respective conditions belonging to each level and then compared the averages with a cluster permutation test. To calculate the interaction of Attention and Body-stimulus position factors, that is the difference between the differences between the means of one factor, across the levels of the other factor, we subtracted Two hands from Real, and Incongruent from Hand under, and compared these differences with a cluster permutation test.
In Experiment 2 our primary aims were to replicate the illusion effect from Experiment 1 and to investigate if stimulus duration modulates this effect. For the analysis of evoked responses we selected the time point with the biggest overlap of significant electrodes between Illusion vs. Incongruent and Illusion vs. Real contrasts as found in Experiment 1. We conducted a 2 × 4 repeated measures analysis of variance (ANOVA) with the factors illusion presence and stimulus duration on data averaged over the significant electrodes at this time point. For the analysis of oscillatory power we selected the electrodes in the overlap of significant electrodes between Illusion vs. Incongruent and Illusion vs. Real time-frequency contrasts in alpha and beta band as found in Experiment 1. We conducted a 2 × 4 repeated measures ANOVA on power in each band. Greenhouse–Geisser correction was applied where sphericity was violated.
Illusion onset occurred on average 41.3 ± 32.3 s (mean ± SD) after the start of stimulation onset in the Illusion block. Four participants lost the feeling of the illusion after its initial onset. The resulting non-illusion sequences lasted on average 41.8 ± 29.4 s (mean ± SD). No illusion sequences were reported in any other block.
Significant differences (cluster-permutation test, at least p < 0.05) between the Illusion condition and the Incongruent condition emerged around two time points: at 120 ms the Illusion condition showed lower amplitudes in right frontal regions (Tsum = −659.0, p < 0.05) and more positive amplitudes in left parietal areas (Tsum = 490.9, p < 0.05) compared to the Incongruent condition (Figure 2A). At 330 ms the Illusion condition showed lower amplitudes in frontocentral regions compared to the Incongruent condition and this frontocentral negativity was centered around electrode FCz (Tsum = −404.4, p < 0.05, Figure 2A). Significant differences between the Illusion condition and the Real condition emerged around 330 ms and were also centered around electrode FCz (Tsum = −823.1, p < 0.05; Figure 2B). The respective ERPs at electrode FCz suggest that the illusion is characterized by a more pronounced negativity of the evoked activity around 330 ms in compared to the two control conditions (Figure 2C).
Figure 2. Illusion effect. T-maps and scalp topographies of t-values of (A) the Illusion vs. Incongruent contrast and (B) the Illusion vs. Real contrast. Significant clusters are highlighted in black. Significant clusters common to both contrasts are highlighted in yellow. (C) Grand-averaged event-related potentials at FCz of Illusion (blue), Incongruent (red) and Real (green). The shaded areas indicate the standard errors of the mean. (D) Overlap of significant electrodes between Illusion vs. Incongruent contrast and Illusion vs. Real contrast at 330 ms post-stimulus.
To better localize the illusion effect, we determined those electrodes that were part of both significant effects around 330 ms, i.e., which were part of the significant time-electrode clusters in both, the Illusion-Incongruent and Illusion-Real contrast. The resulting electrodes comprised the medial central and centrofrontal electrodes (Figure 2D).
Illusion Effect—Oscillatory Activity
The illusion contrasts applied to the power of oscillatory activity revealed significant clusters of 19 electrodes in parietal areas where alpha power (8–12 Hz) was lower in the Illusion compared to the Incongruent condition (Tsum = −77.4, p < 0.05; Figure 3A, top left topography), and lower in the Illusion compared to the Real condition (Tsum = −80.4, p < 0.05, Figure 3A, bottom left topography). In the beta band (13–25 Hz) a cluster of 38 electrodes over frontoparietal regions also showed reduced power during the Illusion condition compared to the Incongruent (Tsum = −109.1, p < 0.05, Figure 3A, top right topography) and Real conditions (Tsum = −178.2, p < 0.05, Figure 3A, bottom right topography). The overlap of significant illusion effects for each band is shown in Figure 3B.
Figure 3. (A) Scalp topographies of t-values for differences in alpha (8–12 Hz, left panel) and beta power (13–25 Hz, right panel) for the Illusion vs. Incongruent (top panel) and Illusion vs. Real (bottom panel) contrast. Significant clusters (permutation statistics; p < 0.05, n = 20) are highlighted in black. (B) Overlap of significant clusters between the Illusion vs. Incongruent and Illusion vs. Real contrasts.
Attention and Body-Stimulus Position Contrasts
Potential confounding effects of changes in spatial attention and body-stimulus position were quantified using four additional experimental conditions analyzed in a 2 × 2 design (Figure 1B). In the time domain no significant effects were found when analyzing the interaction between the factors Attention and Body-stimulus position. However, significant effects emerged in the attention contrast around 100 ms (Positive cluster: Tsum = 701.0, p < 0.05; Negative cluster: Tsum = 728.0, p < 0.05) and 250 ms (Positive cluster: Tsum = 687.7, p < 0.05; Negative cluster: Tsum = −470.4, p < 0.05; Figure 4A) in frontal and parietal regions. Significant effects in the body-stimulus position contrast emerged around 180 ms centered around electrode FCz (Tsum = −474.6, p < 0.05; Figure 4B).
Figure 4. Attention and Body-stimulus position effects. T-maps and scalp topographies for Attention (A) and Body-stimulus position contrasts (B). Significant clusters (permutation statistics; p < 0.05, n = 20) are highlighted in black. (C) Overlap of significant clusters between the illusion effect (from Figure 2D) and the body-stimulus position effect.
While the timing and location of the attention effects do not resemble the illusion effect, the topography of significant effects in the body-stimulus position contrast closely resembles the topography of the illusion effect (see Figure 2D). The electrodes consistently involved in both effects comprised medial central and centrofrontal electrodes (Figure 4C), making it possible that potentially similar regions are involved in mediating the illusion and body-stimulus effects, but reflect these at distinct latencies relative to the stimulus.
We found no significant differences in oscillatory responses in the attention and body-stimulus position contrasts in either the alpha (8–12 Hz) or beta band (13–25 Hz).
Illusion onset occurred on average 46.7 ± 32.7 s (mean ± SD) after the start of stimulation onset in the illusion blocks. Five participants lost the feeling of the illusion after its initial onset. This occurred either in all three of the blocks (Participant 1, 2) or a single block (Participant 3, 4, 5). The resulting non-illusion sequences lasted on average 30.2 ± 27.1 s (mean ± SD). No illusion sequences were reported in any Incongruent blocks.
In the second experiment, we compared the Illusion to the Incongruent condition while manipulating the duration of the visuo-tactile stimulation. We then performed a repeated-measures ANOVA on the ERP amplitudes at the time-electrode cluster identified by the illusion effect in Experiment 1 (see Figure 2D) to test the effects of illusion and stimulus duration (Table 1). This confirmed a main effect of illusion at 330 ms in this second dataset (F(1,19) = 16.08, p < 0.05, = 0.46), and revealed an effect of stimulus duration (F(1.63,31.02) = 21.318, p < 0.05, = 0.53) but no significant interaction (F(2.81,53.40) = 0.235, p = 0.860, = 0.012).
Table 1. Group means and standard deviations of amplitudes (μV) at 330 ms post-stimulus in Experiment 2.
Illusion Effect—Oscillatory Activity
For alpha power, we found a main effect of illusion (F(1.00,19.00) = 16.407, p < 0.05, = 0.46) but no effect of stimulus duration (F(2.69,51.08) = 2.822, p = 0.053, = 0.13) and no significant interaction (F(2.36,44.85) = 2.860, p = 0.059, = 0.13). For beta power we found a main effect of illusion (F(1.00,19.00) = 15.337, p < 0.05, = 0.45) but no main effect of stimulus duration (F(2.36,44.84) = 2.917, p = 0.056, = 0.13). However, a significant interaction between illusion presence and stimulus duration was present (F(2.28,43.33) = 7.533, p < 0.05, = 0.28). This interaction appeared to be driven by higher beta power for the stimulus duration of 100 ms compared to the other durations in the illusion condition (Table 2).
Table 2. Mean values and standard deviations of oscillatory power in alpha (8–12 Hz) and beta band (13–25 Hz) in Experiment 2.
We studied the neurophysiological correlates of the RHI using a fully automated and precisely-timed visuo-tactile setup and a combination of experimental conditions. Across two studies and two control conditions we reliably found an illusion-related attenuation of ERPs around 330 ms over frontocentral electrodes. This effect was not related to attention or body-stimulus position confounds and was robust against changes in stimulus duration. We furthermore found that oscillatory activity in the alpha and beta bands was reliably reduced during the illusion. We thereby provide multiple neural markers of the RHI.
Illusion Effects in Evoked Responses
Several previous EEG studies have aimed to understand the neural correlates and mechanisms underlying the illusory percept of body ownership in the RHI. These studies compared the evoked responses associated with the tactile stimulus on the participant’s hand between conditions inducing the illusion and control conditions. The rationale behind this approach is to see whether and how the cortical representation of the tactile stimulus changes when its subjective location changes from the actual hand to the rubber hand. Previous studies differed regarding the latency of such an illusion-correlate in ERPs, reporting either early effects around 55 ms (Zeller et al., 2015) or much later effects around 460 ms (Peled et al., 2003). However, both studies relied on the manual stimulation by a brush handled by an experimenter, whereby each individual brush stroke can differ in timing and intensity. This variability in the sensory stimulus can be detrimental for measuring the timing and shape of the respective sensory evoked responses. To overcome this problem, we here designed an automated setup that allows visuo-tactile stimulation with great temporal fidelity and consistency across trials. Furthermore, we asked subjects to indicate the onset of the RHI during each trial and hence were able to include only those stimulation events in the analysis during which subjects actually reported the presence of the RHI. To facilitate this we only considered participants that had previously and reliably experienced ownership over a rubber hand and were familiar with the sensations associated with onset and presence of the RHI as determined by a pilot session.
To establish neural correlates of the RHI a comparison of the illusion condition with a control condition is required. Most previous ERP studies relied on the Incongruent condition in which the rubber hand is placed at an anatomically incongruent angle, or relied on the Real condition in which the rubber hand is absent and stimulation occurs on the real hand in view (Peled et al., 2003; Zeller et al., 2015, 2016). Using only one control condition makes the implicit and critical assumption that the illusion and control conditions differ only in a single factor, the presence of the subjective illusion. Yet, closer inspection of these conditions suggests that these may differ by other factors as well, such as focus of attention and body-stimulus position in the Incongruent condition, or the absence of a rubber hand in the Real condition. We therefore relied on the combination of control conditions to identify potential changes in evoked activity that are reliably associated with the illusion. The need to consider multiple control conditions is further demonstrated by the observation that some significant ERP effects were observed only in one of the two contrasts (see Figure 2). For example, the Illusion-Incongruent difference revealed a significant effect around 150 ms, which was absent in the Illusion-Real difference, and hence unlikely is a correlate of the subjective illusion. This suggests that results on the neural correlates of illusory body ownership that were obtained using a single control condition have to be considered with care.
We found neural activations that were reliably associated with the illusion only at longer latencies (here 330 ms) over frontocentral regions. Furthermore, this illusion effect did not interact with changes in stimulus duration. Together this suggests that these activations do not reflect processes related to early sensory encoding but rather reflect late and higher-order processes. Thereby our results differ from Zeller et al. (2015) who reported illusion related activity as early as 55 ms, but also differ from those of Peled et al. (2003), who found illusion related activity around 460 ms. The discrepancies are possibly due to several factors: first, these previous studies relied on the manual stimulation by a brush, as opposed to the automated visual-tactile stimuli in the current study. Second, Zeller et al. (2015) restricted their analysis to activity before 300 ms post-stimulus, while Peled et al. (2003) only tested at specific time points not including 330 ms. This makes it difficult to compare significant effects across studies, as each relied on distinct time windows where potential effects were expected and contrasted using methods for multiple comparison. Third, the study by Zeller et al. (2015) relied on a rather small sample size (n = 13), while we here relied on a sample size of n = 20 participants in each experiment, which is considered to be the minimal sample size for neuroimaging studies based on concerns of reporting false positive results (Simmons et al., 2011; Poldrack et al., 2017). Fourth, the study of Zeller et al. (2015) reported significant illusion effects only for stimulation on the right hand, while we here focused on the subject’s left hand, as previous studies have suggested a strong link between the right hemisphere and awareness of the subjective experience of body ownership (Tsakiris et al., 2007; Frassinetti et al., 2008; Karnath and Baier, 2010). Last but not least, we replicated the illusion effect around 330 ms in two independent studies, providing further evidence for the robustness of our result.
Neural Origins of Illusion-Related Activations
While the exact local neurophysiological sources of the illusion effect in the current study cannot be identified, its frontocentral location provides support for a pivotal role of premotor and possibly intraparietal areas in illusory hand ownership. Several studies have consistently associated activity in the ventral premotor and/or posterior parietal cortex with the illusory percept of ownership and hand position in the RHI (Petkova et al., 2011; Brozzoli et al., 2012; Guterstam et al., 2015; Limanowski and Blankenburg, 2015; Kanayama et al., 2017). Furthermore, Limanowski and Blankenburg (2015) and Guterstam et al. (2015) reported increased functional coupling between intra-parietal regions and premotor cortices during the illusion compared to control conditions. Both regions are ideal candidates for mediating the multisensory integrative processes that underlie the RHI. They process signals involved in self-attribution of the hand (Ehrsson et al., 2004; Tsakiris et al., 2007; Evans and Blanke, 2013) and analogous regions in the monkey brain have been found to contain trimodal neurons that integrate tactile, visual and proprioceptive signals (Fogassi et al., 1996; Iriki et al., 1996; Graziano et al., 1997; Graziano and Gandhi, 2000). Based on the topography of illusion-related ERP effects our data further corroborate a central role of motor-related regions in the body illusion.
This interpretation is further supported by the timing of the illusion effect, which matches results from intracranial recording studies, which have reported correlates of multisensory integration between 280 ms and 330 ms over precentral and postcentral regions adjacent to premotor cortex and IPS (Quinn et al., 2014). Similar late latencies were also reported for the integration of visual and somatosensory in parietal association cortex (Lippert et al., 2013). The attenuation of the evoked potential at 330 ms during the illusion condition observed here could thus be indicative of the integration of visual, tactile and proprioceptive information within the parietal-premotor network, which then results in the illusory percept of ownership and hand position in the RHI.
We did not administer any behavioral or physiological measures to measure the RHI, such as proprioceptive drift measurements or changes in body temperature. The reason for this was twofold. First, we relied on a subjective measure of the illusion, as it allowed for uninterrupted recording of EEG data across all conditions. Second, our study aimed to identify the correlates of the ownership aspect of the RHI. As shown recently, proprioceptive drift does not provide a reliable assessment of this ownership aspect (Rohde et al., 2011; Asai, 2015). Rather, subjective ownership and the proprioceptive drift can be dissociated, with the latter measuring the spatial updating of the body in space rather than the strength of ownership over the rubber hand itself.
Illusion, Attention and Body-Stimulus Position
We used additional control conditions to reliably dissociate the neural correlates of the RHI from attention and body-stimulus position related activity. Specifically, we identified the timing and location of attention/body-stimulus position related effects and compared these to the activations revealed by the two statistical contrasts obtained from the Illusion. By comparing conditions where the visual stimulus was near the body with conditions where the visual stimulus was far from the body, we found body-stimulus position related processing to be associated with activity in frontocentral areas around 180 ms. This is in line with previous studies investigating the influence of proximity of hands and visual stimuli. For example, Reed et al. (2013) recorded ERPs during a visual detection task in which the hand was placed near or kept far from the stimuli. Similar to the results of the current study, they found increased negativity in the Nd1 component around 180 ms in the near hand condition (see also Sambo and Forster, 2009). The timing of the body-stimulus position related activity (~180 ms) was notably different from that of the illusion effect (~330 ms). This differentiates the illusion effect from body-stimulus position related activity. However, the topography of the body-stimulus position related activity at 180 ms was highly similar to that of our illusion effect at 330 ms. Thus, it is possible that both effects may emanate from the same cortical networks related to body processing. Support for this comes from a study by Brozzoli et al. (2012) who measured BOLD response while presenting participants with visual stimuli occurring next or distant from their hands. Their results indicated increased activity in premotor and intraparietal cortices in the condition where the stimulus was close to the hand compared to the condition where the stimulus was distant form the hand. Similar results were obtained when the participant’s hand was replaced by a rubber hand on which the RHI was induced (Brozzoli et al., 2012). This suggests that both, the effects of body-stimulus position and the illusion may originate from processing in the intraparietal-premotor network but do so at different latencies relative to stimulus onset, further corroborating that the ERP correlates of the illusory percept reflect sensory integration processes in the parietal-premotor network.
We found attention related activity in frontal and parietal regions around 100 ms and around 250 ms. This timing is in agreement with previous ERP studies on visual-tactile attention which presented simultaneous stimuli in close proximity or at distant locations (Eimer and Driver, 2000; Sambo and Forster, 2009) and reported modulations of amplitudes between 80–125 ms and 200–280 ms associated with the induced changes in spatial attention. Interestingly the timing and location of activity related to attentional processing in our study is similar to the timing and location of early differences between Illusion and Incongruent. This could mean that these early differences in evoked potentials between Illusion and Incongruent condition are not directly related to the illusion but rather reflect the difference in attention focus between the two conditions. This underlines that the Incongruent condition, one of the most commonly used control condition in EEG experiments on the RHI, should be used with caution when trying to determine the neurophysiological correlates of the RHI.
Illusion Effects in Oscillatory Activity
The analysis of oscillatory activity revealed that illusory hand ownership resulted in a relative decrease of oscillatory power in the alpha and beta bands. Modulations of alpha power have previously been implicated in the RHI (Evans and Blanke, 2013) as well as the full body illusion (Lenggenhager et al., 2011). Our results are also in good agreement with those from a recent study on the somatic RHI (Faivre et al., 2017), a variant of the conventional RHI. Very similar to our results this study found a relative decrease in alpha power over frontocentral regions contralateral to stimulation site and a relative decrease in beta power bilaterally over frontoparietal regions during the illusion. Combined with the consistency of these power decreases across two control conditions and two experiments as shown here, this implicates that the decrease in alpha and beta power during the illusion is not associated with visual information or a specific control condition. Instead, it is likely to be directly tied to the feeling of ownership during the illusion itself, and hence constitutes a robust physiological marker of body ownership.
We developed a fully-automated, temporally precise stimulation apparatus for induction of the RHI in our study. This allowed for the recording of evoked activity time-locked to the administered visuo-tactile stimuli, but resulted in a less naturalistic stimulation compared to the conventional manual stimulation (Peled et al., 2003; Zeller et al., 2015). This unnaturalness was consistent across the Illusion and control conditions and thus is very unlikely to have introduced differences between conditions in the current results. Yet it could potentially account for differences between the current and previous results. Future studies could explore this possibility by e.g., using an automated stimulation apparatus with motor-driven rods/brushes, providing a more naturalistic stimulation in addition to temporal precision.
All participants in the study were familiar with the illusion as they had previously indicated the experience of this illusion and had completed the RHI Questionnaire (Botvinick and Cohen, 1998). We only tested previously screened participants to facilitate the analysis of brain activity in response to the illusion, as this necessary requires participants that reliably experience the illusion for a sufficiently long period of time.
While this selection of participants was necessary to test for statistical differences between the Illusion and control conditions, future research should examine the neurophysiological processes that differ between subjects who experience the illusion and subjects who do not, or could test how illusion-related brain activity builds up in response to experiencing the illusion the first time, or over multiple times of exposure.
Finally, and this pertains all research on the neurophysiological correlates of illusory hand ownership, it is important to keep in mind that the illusion condition might differ from any control condition in factors not easily measured, such as a participant’s increased state of introspection or arousal. This illustrates the importance of improving the quality of control conditions in further research on the subjective experience of the RHI.
We identified neurophysiological correlates of the RHI in a reduction of alpha and beta power as well as in an attenuation of evoked responses around 330 ms over central electrodes. The attenuation of evoked responses is likely to reflect the integration of visual, somatosensory and proprioceptive information during the illusion, which then leads to the experience of ownership over the rubber hand. Our results furthermore emphasize the need to consider multiple control conditions in studies on body illusions, to avoid misidentifying effects related to changes in body-stimulus position or attention for correlates of illusory body ownership.
ISR and CK designed the study; analyzed the data and wrote the manuscript. ISR ran the experiments.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
This work was supported by the European Research Council (to CK ERC-2014-CoG; grant No. 646657) and a studentship from the UK Economic and Social Research Council ESRC (to ISR, award No. 1612065).
Bekrater-Bodmann, R., Foell, J., Diers, M., Kamping, S., Rance, M., Kirsch, P., et al. (2014). The importance of synchrony and temporal order of visual and tactile input for illusory limb ownership experiences—an fMRI study applying virtual reality. PLoS One 9:e87013. doi: 10.1371/journal.pone.0087013
Brozzoli, C., Gentile, G., and Ehrsson, H. H. (2012). That’s near my hand! Parietal and premotor coding of hand-centered space contributes to localization and self-attribution of the hand. J. Neurosci. 32, 14573–14582. doi: 10.1523/JNEUROSCI.2660-12.2012
Eimer, M., and Driver, J. (2000). An event-related brain potential study of cross-modal links in spatial attention between vision and touch. Psychophysiology 37, 697–705. doi: 10.1111/1469-8986.3750697
Faivre, N., Döenz, J., Scandola, M., Dhanis, H., Bello Ruiz, J., Bernasconi, F., et al. (2017). Self-grounded vision: hand ownership modulates visual location through cortical β and γ oscillations. J. Neurosci. 37, 11–22. doi: 10.1523/JNEUROSCI.0563-16.2016
Frassinetti, F., Maini, M., Romualdi, S., Galante, E., and Avanzi, S. (2008). Is it mine? Hemispheric asymmetries in corporeal self-recognition. J. Cogn. Neurosci. 20, 1507–1516. doi: 10.1162/jocn.2008.20067
Guterstam, A., Björnsdotter, M., Bergouignan, L., Gentile, G., Li, T.-Q., and Ehrsson, H. H. (2015). Decoding illusory self-location from activity in the human hippocampus. Front. Hum. Neurosci. 9:412. doi: 10.3389/fnhum.2015.00412
Guterstam, A., Gentile, G., and Ehrsson, H. H. (2013). The invisible hand illusion: multisensory integration leads to the embodiment of a discrete volume of empty space. J. Cogn. Neurosci. 25, 1078–1099. doi: 10.1162/jocn_a_00393
Kanayama, N., Morandi, A., Hiraki, K., and Pavani, F. (2017). Causal dynamics of scalp electroencephalography oscillation during the rubber hand illusion. Brain Topogr. 30, 122–135. doi: 10.1007/s10548-016-0519-x
Kayser, S. J., Ince, R. A. A., Gross, J., and Kayser, C. (2015). Irregular speech rate dissociates auditory cortical entrainment, evoked responses, and frontal α. J. Neurosci. 35, 14691–14701. doi: 10.1523/JNEUROSCI.2243-15.2015
Keren, A. S., Yuval-Greenberg, S., and Deouell, L. Y. (2010). Saccadic spike potentials in γ-band EEG: characterization, detection and suppression. Neuroimage 49, 2248–2263. doi: 10.1016/j.neuroimage.2009.10.057
Lenggenhager, B., Halje, P., and Blanke, O. (2011). α band oscillations correlate with illusory self-location induced by virtual reality. Eur. J. Neurosci. 33, 1935–1943. doi: 10.1111/j.1460-9568.2011.07647.x
Lippert, M. T., Takagaki, K., Kayser, C., Ohl, F. W., and Bale, M. (2013). Asymmetric multisensory interactions of visual and somatosensory responses in a region of the rat parietal cortex. PLoS One 8:e63631. doi: 10.1371/journal.pone.0063631
Olivé, I., Tempelmann, C., Berthoz, A., and Heinze, H. J. (2015). Increased functional connectivity between superior colliculus and brain regions implicated in bodily self-consciousness during the rubber hand illusion. Hum. Brain Mapp. 36, 717–730. doi: 10.1002/hbm.22659
Oostenveld, R., Fries, P., Maris, E., and Schoffelen, J.-M. (2011). FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput. Intell. Neurosci. 2011:156869. doi: 10.1155/2011/156869
Peled, A., Pressman, A., Geva, A. B., and Modai, I. (2003). Somatosensory evoked potentials during a rubber-hand illusion in schizophrenia. Schizophr. Res. 64, 157–163. doi: 10.1016/s0920-9964(03)00057-4
Petkova, V. I., Björnsdotter, M., Gentile, G., Jonsson, T., Li, T.-Q., and Ehrsson, H. H. (2011). From part- to whole-body ownership in the multisensory brain. Curr. Biol. 21, 1118–1122. doi: 10.1016/j.cub.2011.05.022
Poldrack, R. A., Baker, C. I., Durnez, J., Gorgolewski, K. J., Matthews, P. M., Munafò, M. R., et al. (2017). Scanning the horizon: towards transparent and reproducible neuroimaging research. Nat. Rev. Neurosci. 18, 115–126. doi: 10.1038/nrn.2016.167
Press, C., Heyes, C., Haggard, P., and Eimer, M. (2008). Visuotactile learning and body representation: an ERP study with rubber hands and rubber objects. J. Cogn. Neurosci. 20, 312–323. doi: 10.1162/jocn.2008.20022
Quinn, B. T., Carlson, C., Doyle, W., Cash, S. S., Devinsky, O., Spence, C., et al. (2014). Intracranial cortical responses during visual-tactile integration in humans. J. Neurosci. 34, 171–181. doi: 10.1523/JNEUROSCI.0532-13.2014
Reed, C. L., Leland, D. S., Brekke, B., and Hartley, A. A. (2013). Attention’s grasp: early and late hand proximity effects on visual evoked potentials. Front. Psychol. 4:420. doi: 10.3389/fpsyg.2013.00420
Sambo, C. F., and Forster, B. (2009). An ERP investigation on visuotactile interactions in peripersonal and extrapersonal space: evidence for the spatial rule. J. Cogn. Neurosci. 21, 1550–1559. doi: 10.1162/jocn.2009.21109
Schmalzl, L., Kalckert, A., Ragnö, C., and Ehrsson, H. H. (2014). Neural correlates of the rubber hand illusion in amputees: a report of two cases. Neurocase 20, 407–420. doi: 10.1080/13554794.2013.791861
Simmons, J. P., Nelson, L. D., and Simonsohn, U. (2011). False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol. Sci. 22, 1359–1366. doi: 10.1177/0956797611417632
Tsakiris, M., and Haggard, P. (2005). The rubber hand illusion revisited: visuotactile integration and self-attribution. J. Exp. Psychol. Hum. Percept. Perform. 31, 80–91. doi: 10.1037/0096-1518.104.22.168
Tsakiris, M., Hesse, M. D., Boy, C., Haggard, P., and Fink, G. R. (2007). Neural signatures of body ownership: a sensory network for bodily self-consciousness. Cereb. Cortex 17, 2235–2244. doi: 10.1093/cercor/bhl131
Keywords: rubber hand illusion, multisensory integration, body ownership, body representation, EEG
Citation: Rao IS and Kayser C (2017) Neurophysiological Correlates of the Rubber Hand Illusion in Late Evoked and Alpha/Beta Band Activity. Front. Hum. Neurosci. 11:377. doi: 10.3389/fnhum.2017.00377
Received: 12 April 2017; Accepted: 06 July 2017;
Published: 25 July 2017.
Edited by:Lorenzo Pia, University of Turin, Italy
Reviewed by:Tomohisa Asai, ATR, Japan
Anke Ninija Karabanov, Danish Research Center for Magnetic Resonance, Denmark
Copyright © 2017 Rao and Kayser. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Isa S. Rao, email@example.com