ORIGINAL RESEARCH article
Suppressing Systemic Interference in fNIRS Monitoring of the Hemodynamic Cortical Response to Motor Execution and Imagery
- 1School of Information and Optoelectronic Science and Engineering, South China Normal University (SCNU), Guangzhou, China
- 2Guangdong Provincial Key Laboratory of Optical Information Materials and Technology, Center for Optical and Electromagnetic Research, South China Academy of Advanced Optoelectronics, South China Normal University (SCNU), Guangzhou, China
Hemodynamic response to motor execution (ME) and motor imagery (MI) was investigated using functional near-infrared spectroscopy (fNIRS). We used a 31 channel fNIRS system which allows non-invasive monitoring of cerebral oxygenation changes induced by cortical activation. Sixteen healthy subjects (mean-age 24.5 yeas) were recruited and the changes in concentration of hemoglobin were examined during right and left hand finger tapping tasks and kinesthetic MI. To suppress the systemic physiological interference, we developed a preprocessing procedure which prevents over-activated reporting in NIRS-SPM. In the condition of ME, more activation was observed in the anterior part of the motor cortex including the pre-motor and supplementary motor area (pre-motor and SMA), primary motor cortex (M1) and somatosensory motor cortex (SMC; t(15) > 2.27), however, in the condition of MI, more activation was found in the posterior part of motor cortex including SMC (t(15) > 1.81), which is in line with previous observations with functional magnetic resonance imaging (fMRI).
Functional near-infrared spectroscopy (fNIRS; Jöbsis, 1977; Lloyd-Fox et al., 2010) is a non-invasive optical technique that uses either continuous, intensity-modulated, or pulsed near infrared light to monitor oxyhemoglobin (HbO2), deoxyhemoglobin (HbR) and total hemoglobin (HbT) in the cerebral cortex. With low-cost, safety, high temporal resolution and acceptable spatial resolution, fNIRS has been widely adopted to record brain activation in response to motor execution (ME) and motor imagery (MI) with potential applications in more naturalistic social environments than other brain computer interfaces (BCI; Coyle et al., 2007; Sitaram et al., 2007; Doud et al., 2011; Naseer and Hong, 2013; Koo et al., 2015; Acqualagna et al., 2016). Compared with EEG-based BCI, fNIRS-based is more sensitive to the localized activation, but slower due to the nature of metabolic response (Coyle et al., 2007; Sitaram et al., 2007). In the most general sense, MI refers to the “mental rehearsal of a simple or complex motor act that is not accompanied by overt body movements” (Solodkin et al., 2004). MI corresponds to a motor preparation process where motor programs are recruited to simulate motor performance without executing the movement. This so-called “simulation hypothesis” has been well established by psychophysiological (Decety et al., 1989; Pfurtscheller et al., 1997; Danckert et al., 2002) and neuroimaging studies in human subjects (Lotze et al., 1999; Naito et al., 2002; Ehrsson et al., 2003; Solodkin et al., 2004).
A number of studies using the functional magnetic resonance imaging (fMRI) or positron emission tomography (PET) have observed that MI activates several cortical regions similar to those activated by ME (Boecker et al., 2002; Lacourse et al., 2005; Hanakawa et al., 2008; Guillot et al., 2009). The cortical areas of ME and MI involved include the contralateral premotor area, primary motor cortex (M1), premotor cortex (PMC), supplementary motor area (SMA), anterior cingulate cortex (ACC), inferior and superior parietal lobule (IPL/SPL) and the cerebellum (CB; Grezes and Decety, 2001; Hétu et al., 2013).
Recently, fNIRS has been used for MI study and its further application on BCI and neurofeedback. However, the fNIRS results achieved so far regarding hemodynamic signal changes induced by MI are not very consistent. For example, in a study (Wriessnegger et al., 2008) higher oxygenation was observed in the motor areas (M1) as compared to the prefrontal cortex (PFC) for ME, but not for MI. Whereas, An et al found that MI induced a moderate activation in the M1. They also observed differences between ME and MI in the activation of the bilateral and lateral regions (An et al., 2013). Some studies have reported that cortical hemodynamic changes are more pronounced over the contralateral cortex (Watanabe et al., 1996; Hirth et al., 1997; Horovitz and Gore, 2003; Strangman et al., 2003; Holper et al., 2009; Leff et al., 2011). However, typical activation patterns have also been found over the ipsilateral cortex, Wriessnegger et al. (2008) found the oxygenation level was bilaterally represented for both tasks but with temporal differences.
These inconsistencies need to be addressed for efficient fNIRS-based BCI classification and feedback training. A possible reason for the inconsistency in fNIRS measurements might be due to the systematic physiological drift on the measured optical signals for a variety of reasons, including cardiac pulsations (~1–2 Hz), respiration (~0.2–0.4 Hz), Mayer waves (~0.1 Hz) and other very low-frequency fluctuations (0.01–0.05 Hz; Boas et al., 2004; Zhang et al., 2015). The amplitude of the systematic physiological drift is often comparable to that of the signal associated with brain activation (Gagnon et al., 2011). A band-pass filter can remove some components of the systemic interference such as those arising from cardiac pulsations and respiration. However, the low frequency components with frequency less than 0.1 Hz are usually mixed with the response hemodynamic signal, thus it cannot be eliminated by the filter, but deteriorating the response signal. Therefore, in fNIRS data analysis, it is critical to efficiently extract task-related hemodynamic signal in cortex from measured data mixed with the systemic interference.
The purpose of this study was to measure the hemodynamic response with fNIRS to motor tasks including ME and imagery. We expected by developing a suitable data analysis method, it might be possible to effectively suppress the systemic hemodynamic interference, thus uncovering the unbiased activation patterns induced by ME and MI, which would be similar to those revealed by fMRI studies. The result achieved will guide future motor-related fNIRS-based BCI.
Materials and Methods
Sixteen healthy participants (nine males and seven females) were recruited for this study. Participants ranged in age from 19 years to 52 years old (24.5 ± 7.4 years). All participants were right-handed according to a modified Edinburgh Handedness Questionnaire (Oldfield, 1971), and had no history of neurological or psychiatric disease. Written informed consents were obtained from all participants, and the protocol of the present study was approved by the Institutional Review Board of South China Normal University (No. 177).
During measurements, all the participants were asked to sit on a comfortable chair, place their hands on the table in front of them, and relax for about 5 min before the experiment to get rid of any existing hemodynamic response induced by their previous activation. The participants were instructed to perform motor tasks with four conditions in two different sessions: ME and MI with the right and left hand. The orders of the two sessions were counter-balanced (Figure 1). The experiment protocol was a block design including 20 trails of 10 s of task and 15 s of rest in each condition. During ME task, participants were instructed to tap the indicated hand once per second. During MI task, they were instructed to imagine the same actions as they performed during ME but refrain from any movement. They were also instructed to use kinesthetic imagery that requires individuals to “feel the movement”, i.e., to perceive the sensations associated with its execution such as muscle stretching and contractions (Hétu et al., 2013). During the rest period, participants were instructed to relax, refrain from moving, and not think about anything in particular. Prior to the measurements, subjects practiced both ME and MI tasks, guided by the experimental program and experimenter, in order to familiarize themselves with the protocol and tasks.
Figure 1. Experiment design. (A) Four blocks in a session. (B) Five trails of 10 s task and 15 s rest in each block. The experiment was performed under four conditions: motor execution (ME); motor imagery (MI) with the right or left hand.
In this study, 31 channels of a commercial continuous-wave (CW) fNIRS image system (FOIRE-3000, Shimadzu Corporation, Kyoto, Japan) were used to measure the cortical activity of the parietal lobe. The absorption of three wavelengths (780 nm, 805 nm and 830 nm) of near infrared light were measured with a sampling rate of 7.14 Hz and then transformed into concentration changes of the HbO2, HbR and HbT by the modified Beer-Lambert law (Owenreece et al., 1999). The optical probes consisted of 10 sources and 10 detectors, building up 31 channels. We determined the probe locations by the international 10-10 system (Koessler et al., 2009), which were further confirmed by a 3D digitizer (FASTRAK-Polhemus, Polhemus, VT, USA) and NIRS-SPM (Ye et al., 2009). We applied the 3D digitizer to record the exact spatial coordinates of four reference points of the 10-10 system (NZ, CZ, AL, RL), as well as the 20 optical probes. We converted these coordinates into locations of the 31 channels in an estimated MNI space by NIRS-SPM (Tsuzuki et al., 2007; Ye et al., 2009). With these probe locations in MNI, we used BrainNet Viewer (Xia et al., 2013) to generate Figure 2 in which all optical channels were shown on the measured brain regions. Since NIRS-SPM gave a set of probability values for the measured anatomical region of each channel, we chose 80% probability as the threshold (Zhu et al., 2017) to determine the channel location. The area of arrays of optodes was 9 cm × 12 cm with the inter-optode distance of 3 cm.
Figure 2. Channel configuration of the optical probes. Panel (A) illustrates the locations of 31 optical channels. Panel (B) illustrates the measured anatomical regions and the corresponding Brodmann areas (BAs).
Data Preprocessing and Statistical Analysis
Directly using the NIRS-SPM to analyze the raw temporal data (e.g., HbO2) resulted in over-activation. We thought this came from the systemic interference whose time scale was overlapped with our task period (~25 s). To suppress this systematic drift, we designed a preprocessing procedure before using NIRS-SPM. The data processing steps are schematically illustrated in Figure 3. For each measurement channel, we applied a one-dimensional median filter (window width = 3) to the raw temporal data of HbO2 to eliminate outliers such as those with sudden jumps or drops. Then the temporal data were detrended with a second order polynomial fit to remove the slow drift. Each time-series of HbO2 was converted to its Z score (i.e., Z = (HbO2 − mean (HbO2))/std (HbO2)), a measure of data with its own variance. This conversion is important for achieving an unbiased group average for the hemoglobin data recorded by our fNIRS setup (FOIRE 3000). Because the data provided by the FOIRE 3000 includes an unknown parameter L as a multiplying factor (e.g., LHbO2). L is the photon average path length from the source to the detector, which does not only depend on the wavelength, but also varies from subject to subject, even from channel to channel for the same subject. By normalizing with its own variance, the unknown parameter L is canceled out in the Z score.
Figure 3. Flow chart of the data processing. The data preprocessing includes six steps before NIRS-SPM.
To get rid of task-unrelated systemic components, such as cardiac cycles (~1 Hz), venous pressure waves due to respiration (~0.2 Hz) and arterial pressure oscillations (Mayer waves ~0.1 Hz), we applied a low pass filter (zero-phase second order Butterworth) with the cutoff frequency of 0.08 Hz to the time-series of Z score (White et al., 2009; Mesquita et al., 2010).
After the steps above, we divided data into two groups: ME and MI according to each type of marks made during the measurement. In our experimental design, each trail consisted of 10 s task followed by 15 s rest period. Thus, the expected response frequency is around 0.04 Hz, which is in the low frequency band (e.g., <0.1 Hz) in which there are plenty of undetermined hemodynamic components. To suppress the potential adverse influence of these components on the task-related response, we designed a regression method in which the task-unrelated systemic hemodynamic components were removed. In this regression method, we calculated the temporal correlation function between each channel and the task function (a squared-waveform is equal to 1 when task is on, 0 when the task is off), and then selected task-unrelated channels identified by low correlation with the task (absolute value of the correlation coefficient <0.2). The average value of these task-unrelated channels was taken as the regressor. We performed this regression procedure for each hemisphere separately, the left regressor was estimated from channels located in the left hemisphere, and used only for the left hemisphere, and vice versa.
To demonstrate the efficacy of the regression, we present an example in Figure 4. Before the regression, most of the measurement channels are highly correlated (Figure 4A), which was possibly due to the systemic interference mixed in each channel. Therefore, if the removal of the systemic drift is not very effective, such as our case where the time scale of the task period (~25 s) overlaps with the systemic hemodynamic oscillations, there must be an overall effect on the result of the cortical hemodynamic response. After the regression, the overall correlation was reduced (Figure 4B), but the activation channels (e.g., Ch18, 22, 26, 27 and 31 in this example for the left hand execution) locating at the right M1 and somatosensory motor cortex (SMC) were still correlated (Figure 4C). This implies that the regression did suppress the systemic drift, but had no (or less) influence on the activation channels.
Figure 4. Correlation maps of oxyhemoglobin (HbO2) for a subject performing the left hand execution task. (A) Before the preprocessing, (B) after the preprocessing and (C) correlation map for the activation channels (Ch18, 22, 26, 27, 31) after the regression. The numbers along the x-axis and y-axis indicate the optical channels. Each pixel value is the correlation coefficient between the two corresponding channels.
After the regression, the processed data which had less (or no) influence from the systematic interference, were sent to the public software NIRS-SPM to get the β value for each block of tasks. The β value indicates the magnitude of activation during task period in each block. By averaging β values across 10 blocks for each task, we obtained mean activation magnitude for the ME and imagery. The t-value for each channel was obtained by performing the Student-t-test over all subjects. For visualizing the activation, a pseudo-colored t-map was plotted for each task to show the activation pattern.
Since the HbR signal has lower signal to noise ratio, in the data analysis, we only analyzed HbO2.
To investigate the activation of four different conditions including ME and MI in both hands, we applied a one sample t-test to the β values with and without the preprocessing, including a multiple-testing correction based on Benjamini false discovery rate (FDR; Benjamini and Hochberg, 1995).
Two-way repeated ANOVA was employed to investigate the effect of task (ME vs. MI) and hand (left hand vs. right hand) in each regions of interest (ROIs), and then a post hoc test was performed with paired t-test (with Bonferroni correction). The ROIs were defined as follows: Ch1, 2, 5, 6 (left hemisphere) and Ch3, 4, 7, 8 (right hemisphere) corresponding to prefrontal regions (PFC); Ch10, 11, 15 (left hemisphere) and Ch12, 13, 17 (right hemisphere) correspond to the pre-motor and supplementary motor area (pre-motor and SMA); Ch14, 19, 20 (left hemisphere) and Ch18, 21, 22 (right hemisphere) correspond to the M1; Ch23, 24, 28, 29 (left hemisphere) and Ch26, 27, 30, 31 (right hemisphere) correspond to the SMC. The Statistical Product and Service Solutions (SPSS) software package was used for statistical analysis, and statistical significance level was defined as p < 0.05.
Activation in the Four Conditions
In the condition of Left ME (Figure 5A), without the preprocessing, almost all channels were activated except Ch1, 4, 23; while with the preprocessing, the activated channels included Ch15, 18, 27, 29, 31 (t(15) = 2.43, 3.56, 2.45, 2.27, 3.27, p < 0.05, FDR corrected), corresponding to the left pre-motor, SMA, M1, SMC and right M1, SMC.
Figure 5. Hemodynamic activation maps with and without the preprocessing. Left ME (A), Left MI (B), right ME (C) and right MI (D). For comparison, in each sub-figure the left panel shows activation without the preprocessing, the right shows activation with the preprocessing.
In the condition of Left MI (Figure 5B), without the preprocessing, the activated channels were Ch2, 6, 7, 15; However, with the preprocessing, no channels were statistically active. Two channels (Ch7 and 30), corresponding to the center of pre-motor and right SMC, were marginally activated (t(15) = 1.90, 1.81, p < 0.1).
In the condition of Right ME (Figure 5C), without the preprocessing, almost all channels were activated except Ch4, 8, 9, 22 and 25; With the preprocessing, Ch12, 14, 19, 23 were activated (t(15) = 2.70, 3.00, 3.13, 2.43, p < 0.05, FDR corrected), corresponding to the right M1, left pre-motor and SMA and SMC.
In the condition of Right MI (Figure 5D), without the preprocessing, Ch1, 2, 6, 7, 15, 19, 23, 27, 28 were activated; with the preprocessing, Ch23, 27 were activated (t(15) = 2.58, 2.54, p < 0.05, FDR adjusted), corresponding to the bilateral SMC.
The results showed that in the condition of ME, more activation was observed in the anterior part of the motor cortex including the pre-motor, SMA, M1 and SMC, however, in the condition of MI, more activation was observed in the posterior part of the motor cortex, namely, the SMC.
For the conditions of the left hand task, although there were no overlapping channels activated significantly by both ME and MI, Ch31 activated by ME, and Ch30, activated by MI are both located in the SMC. Therefore, for the left hand task, the right SMC was an overlapping area activated by both ME and MI. For the right hand task, the only overlapping channel activated by both ME and MI was Ch23, locating at the left SMC.
A significant main effect of the task was found in the left PFC and right PFC (left PFC: F(1,15) = 7.02, p = 0.02, = 0.32; right PFC: F(1,15) = 8.63, p = 0.01, = 0.37). The post hoc test indicated that the HbO2 levels were more active during the task of MI compared to the task of ME in the PFC (mean difference (MD) = 0.04, p = 0.02; MD = 0.04, p = 0.01, respectively); whereas no main effects of the hand were observed in the PFC (left PFC: F(1,15) = 1.16, p = 0.30, = 0.07; right PFC: F(1,15) = 1.52, p = 0.24, = 0.09), and no interaction effects were significant for the task and hand in the PFC (left PFC: F(1,15) = 0.00, p = 0.96, < 0.00; right PFC: F(1,15) = 2.14, p = 0.16, = 0.13).
In the pre-motor and SMA, only one significant main effect was observed in the left SMA (left SMA: F(1,15) = 5.31, p = 0.04, = 0.26; right SMA: F(1,15) = 0.09, p = 0.77, = 0.01). The post hoc test indicated that in the left SMA, the HbO2 level was more active during the ME compared to MI (MD = 0.03, p = 0.04); no main effects of the hand were observed in the pre-motor and SMA (left SMA: F(1,15) = 0.10, p = 0.76, = 0.01; right SMA: F(1,15) = 0.37, p = 0.55, = 0.02), and no interaction effects were significant for the task and hand in the SMA (left SMA: F(1,15) = 0.30, p = 0.59, = 0.02; right PFC: F(1,15) = 0.60, p = 0.45, = 0.04).
For the hemodynamic changes in the M1 (Figure 6), the HbO2 level in the right M1 increased significantly during the contralateral ME, and there was a significant interaction effect between task and hand (F(1,15) = 11.34, p = 0.00, = 0.43). In the left M1 there was no interaction effect between task and hand (F(1,15) = 1.74, p = 0.21, = 0.10). There were no main effects of hand and task observed in left M1 (task: F(1,15) = 2.91, p = 0.11, = 0.16, hand: F(1,15) = 2.95, p = 0.11, = 0.17) and right M1 (task: F(1,15) = 1.95, p = 0.18, = 0.12, hand: F(1,15) = 2.89, p = 0.11, = 0.16).
Figure 6. Changes in HbO2 concentration (in terms of β value) during the task in the left (A) and right (B) primary motor cortex (M1). The HbO2 level of the primary motor cortex increased significantly only during the right ME but not during MI.
In addition, neither main effect nor interactions were significant for the left SMC (task: F(1,15) = 0.53, p = 0.48, = 0.03, hand: F(1,15) = 1.42, p = 0.25, = 0.09; interaction: F(1,15) = 1.84, p = 0.20, = 0.11) and right SMC (task: F(1,15) = 1.44, p = 0.26, = 0.09, hand: F(1,15) = 0.95, p = 0.35, = 0.06; interaction: F(1,15) = 0.59, p = 0.45, = 0.04).
In the present study, we measured hemodynamic changes with fNIRS during ME and MI of a simple finger tapping task. In the condition of ME, the activation areas included the pre-motor and SMA, M1 and SMC. In the condition of MI, the SMC and posterior of the motor cortex were activated. This observation has not been reported in fNIRS, but is consistent with fMRI studies.
In the present study, we adopted an experimental protocol with 10 s as the task and 15 s as the rest period. For data analysis, we first used the publicly available software NIRS-SPM (Tak et al., 2011) to analyze the raw fNIRS data. NIRS-SPM is based on the general linear model (GLM), widely used for analyzing time-series of fNIRS data. In this software, to get rid of possible systemic interference, a detrending algorithm named wavelet-MDL (minimum description length) was used. The β value of the GLM for different trials were extracted and averaged to account for the brain activity. However, we found that directly using NIRS-SPM to analyze our data resulted in over-activation (see Figure 5) due to the interference of the systemic hemodynamic component. Removing systemic hemodynamics is difficult since its time scale overlaps with the task period. This interference also obscured the real activation patterns, such as that in MI (Figure 5D). Though the wavelet-MDL detrending algorithm was developed and has been demonstrated to be useful in eliminating the systemic interferences (Tak et al., 2011), we found it was not very effective in processing our data (see left column of each subfigure in Figure 5). It is probably because that the central frequency of our response signal is too close to that of the low frequency components of the systemic interference. By preprocessing the data with our preprocessing method prior to using NIRS-SPM, the activation was revealed, which was consistent with the fMRI observation. Considering our data with and without preprocession, it is plausible that the inconsistency in fNIRS studies on ME and MI might come from the interference of the systemic hemodynamic oscillation, which is hard to remove, and needs to be treated very carefully.
Previous studies have shown that the cortical response to MI depends on the type of MI. There are two primary types of the MI: visual imagery and kinesthetic imagery. In the scenario of visual imagery, the subject self-visualizes the movement; while in the kinesthetic imagery, the subject imagines the feelings and sensations produced by the movement (Batula et al., 2017). A meta-analysis suggested that kinesthetic tasks may increase more activation in motor and associated areas (Hétu et al., 2013). Therefore, in the present study we chose the kinesthetic imagery as imagery task, and observed the activation in the SMC and posterior of the motor cortex.
For the four conditions, there was less activation in terms of HbO2 in PFC as compared to the other ROIs; however, we observed more activation in the condition of MI compared to the ME (Figure 5). This indicates that the PFC plays a more important role in MI than ME, especially the left PFC. This observation is in line with previous studies (Fiehler et al., 2007; Vry et al., 2012) reporting that imagery-specific cognitive functions are implemented in the ventral system. Since the MI is a subliminal cognitive process, it is associated with short-term maintenance of kinesthetic information. The kinesthetic working memory involves a neural network that activates the ventrodorsal part of the left hemisphere (Fiehler et al., 2007). The networks include the dorsolateral prefrontal cortex (DLPFC), which plays an important role in keeping MI as the representations of a given motor act are internally prepared during imagery.
Pre-Motor and SMA
We observed that the pre-motor and SMA were activated only in the ME. This result is similar to those observed in previous studies, in which the activation was measured by PET or fMRI (Stephan et al., 1995; Hikosaka et al., 1996; Ruby and Decety, 2003; Solodkin et al., 2004).
SMA is known to be involved in ME. Studies in primates have shown that the ventral and dorsal premotor cortices play important roles in the planning, preparation and execution of motor acts (Hoshi and Tanji, 2007; Hétu et al., 2013). Previous imaging studies have shown that the activity in SMA is directly related to movement output (Obrig et al., 1996; Christensen et al., 2000). It has been reported that the SMA is involved in motor preparation and is activated not only during ME, but also during the preparation and inhibition of movements (Kasess et al., 2008; Guillot et al., 2012; Iso et al., 2016). Some studies also suggest that MI requires a similar amount of time as the execution does (Guillot and Collet, 2005), implying that they are produced through the analogous computational steps in the brain (Hétu et al., 2013). However, some studies suggest that the SMA is responsible not only for the preparation and execution of intended movements, but also for suppressing movements that are represented in the motor system, but not to be performed (Enzinger et al., 2008; Kasess et al., 2008). This may explain why the SMA is only activated in ME but not in MI.
In the present study, the M1 was activated in the contralateral hemisphere during ME, but not activated during MI.
In the condition of ME, even though there is only a significant interaction effect in right M1, we can see from Figure 5A that the right hand ME induces a more significant hemodynamic change than the left hand ME. Whether the M1 is consistently activated during MI is a continuing argument. In some studies, the activation was found in the M1 during MI, but in other studies it was not. In a meta-analysis review, Hétu et al. (2013) have noted that, though the MI seems to use similar structures as ME, M1 is not consistently activated during MI.
Numerous transcranial magnetic stimulation (TMS) studies have provided strong evidence that MI can enhance the excitability of the M1 (Menz et al., 2009; Loporto et al., 2011), which implies that there might be a link between MI and function of the M1. However, some fMRI and PET studies have indicated that there is no activation in the M1 during MI (Binkofski et al., 2000; Gerardin et al., 2000; Hanakawa et al., 2002). This is consistent with what we observed. The reason that MI is not activated during MI might be due to the fact that the SMA exerts an inhibitory influence on the M1 during kinesthetic MI (Kasess et al., 2008). On the other hand, there is individual difference in response to MI. Some studies have reported that although there is no group activation in the M1, single-subject analysis may clearly show activation in the M1 in a few participants (Gerardin et al., 2000; Dechent et al., 2004; Hétu et al., 2013), which in fact was observed in the present study. Individual characteristics that affect the cortical response to the MI may include motor expertise (Milton et al., 2008; Chang et al., 2010), age (Skoura et al., 2009; Personnier et al., 2010), sex (Schuster et al., 2011), and experience/practice (Guillot et al., 2008; Malouin and Richards, 2010; Hétu et al., 2013). Various factors may exert influence on the activation of M1 during MI, which needs further exploration and clarification.
In this study, we found that ME had more activation in the anterior part of the motor cortex. However, in the condition of MI, more activation was observed in the posterior part of motor cortex. Moreover, for the left hand task, the right SMC was an overlapping area activated by both ME and MI, while for the right hand task, the overlapping channel activated by both ME and MI was Ch23, locating at the left SMC.
Numerous imaging studies have observed that there is an activation in the SPLs (BA 7) or inferior parietal lobules (BA 40) in participants performing MI tasks (Decety et al., 1994; Stephan and Frackowiak, 1996), which supports the results we observed. The specific role of the SMC in MI that emerges here is consistent with neuropsychological studies. For example, Sirigu et al. (1996) demonstrated that patients with parietal lesions lose the ability to predict duration of a movement through mental rehearsal, contrary to normal subjects and patients with damage in the primary motor area. Moreover, patients with left parietal lesions were impaired when imagining movements of both the left and the right hand, while patients with right parietal lesions only showed an imagination deficit of the contralateral hand (Gerardin et al., 2000). Thus, the SMC could play an important role in MI.
During the MI, though we carefully observed the hand of subjects to ensure that there is no movement-related data for the analysis of MI, however, due to the lack of Electromyographic (EMG) recordings on the muscle, slight and invisible movement of fingers might be ignored. EMG is a useful tool for monitoring and rating muscle movement, however, fMRI studies have demonstrated EMG signal is not well correlated with the activation of the associated motor cortex (Porro et al., 1996; Wriessnegger et al., 2008). Therefore it is not very likely that EMG is appropriate measure for grading the MI which is eventually reflected by the cortical hemodynamics. In our fNIRS recording, the signal-to-noise ratio was poor for HbR, thus we did not analyze HbR for each task. This might be another limitation of this work.
In summary, we used fNIRS to measure the cortical response to ME and MI. To analyze the measured fNIRS data, we used a task-unrelated regression algorithm prior to the NIRS-SPM to suppress the systemic interference. With this data analysis method, we observed that ME induced more activation in the anterior portion of the motor cortex, including the pre-motor and supplementary motor, primary motor and somatosensory cortices. MI induced more activation in the posterior part of the motor cortex, such as the somatosensory cortex. These observations were in line with previous fMRI studies.
SW, JL, CC and SH designed the study. SW and LG performed the experiments. SW, JL and SH analyzed the data and wrote the article.
This work was supported by the Guangdong Provincial Key Laboratory of the Optical Information Materials and Technology (Grant No. 2017B030301007) and the National Natural Science Foundation of China (Nos. 11621101, 81771876). The authors are grateful to Dr. Julian Evans for helpful discussions.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acqualagna, L., Botrel, L., Vidaurre, C., Kubler, A., and Blankertz, B. (2016). Large-scale assessment of a fully automatic co-adaptive motor imagery-based brain computer interface. PLoS One 11:e0148886. doi: 10.1371/journal.pone.0148886
An, J., Jin, S. H. Y., Lee, S. H., Jang, G., Abibullaev, B., Lee, H., et al. (2013). “Cortical activation pattern for grasping during observation, imagery, execution, fes, and observation-fes integrated bci: an fNIRS pilot study,” in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Osaka, Japan).
Batula, A. M., Mark, J. A., Kim, Y. E., and Ayaz, H. (2017). Comparison of brain activation during motor imagery and motor movement using fNIRS. Comput. Intell. Neurosci. 2017:5491296. doi: 10.1155/2017/5491296
Binkofski, F., Amunts, K., Stephan, K. M., Posse, S., Schormann, T., Freund, H., et al. (2000). Broca’s region subserves imagery of motion: a combined cytoarchitectonic and fmri study. Hum. Brain Mapp. 11, 273–285. doi: 10.1002/1097-0193(200012)11:4<273::aid-hbm40>3.0.co;2-0
Boas, D. A., Dale, A. M., and Franceschini, M. A. (2004). Diffuse optical imaging of brain activation: approaches to optimizing image sensitivity, resolution, and accuracy. Neuroimage 23, S275–S288. doi: 10.1016/j.neuroimage.2004.07.011
Boecker, H., Ceballos-Baumann, A. O., Bartenstein, P., Dagher, A., Forster, K., Haslinger, B., et al. (2002). A h215O positron emission tomography study on mental imagery of movement sequences—the effect of modulating sequence length and direction. Neuroimage 17, 999–1009. doi: 10.1016/s1053-8119(02)91139-0
Christensen, L. O. D., Johannsen, P., Sinkjaer, T., Petersen, N. H. T., Pyndt, H. S., and Nielsen, J. B. (2000). Cerebral activation during bicycle movements in man. Exp. Brain Res. 135, 66–72. doi: 10.1007/s002210000493
Decety, J., Perani, D., Jeannerod, M., Bettinardi, V., Tadary, B., Woods, R., et al. (1994). Mapping motor representations with positron emission tomography. Nature 371, 600–602. doi: 10.1038/371600a0
Doud, A. J., Lucas, J. P., Pisansky, M. T., and He, B. (2011). Continuous three-dimensional control of a virtual helicopter using a motor imagery based brain-computer interface. PLoS One 6:e26322. doi: 10.1371/journal.pone.0026322
Ehrsson, H. H., Geyer, S., and Naito, E. (2003). Imagery of voluntary movement of fingers, toes and tongue activates corresponding body-part-specific motor representations. J. Neurophysiol. 90, 3304–3316. doi: 10.1152/jn.01113.2002
Enzinger, C., Ropele, S., Fazekas, F., Loitfelder, M., Gorani, F., Seifert, T., et al. (2008). Brain motor system function in a patient with complete spinal cord injury following extensive brain-computer interface training. Exp. Brain Res. 190, 215–223. doi: 10.1007/s00221-008-1465-y
Gagnon, L., Perdue, K. L., Greve, D. N., Goldenholz, D. M., Kaskhedikar, G., and Boas, D. A. (2011). Improved recovery of the hemodynamic response in diffuse optical imaging using short optode separations and state-space modeling. Neuroimage 56, 1362–1371. doi: 10.1016/j.neuroimage.2011.03.001
Gerardin, E., Sirigu, A., Lehericy, S., Poline, J., Gaymard, B., Marsault, C., et al. (2000). Partially overlapping neural networks for real and imagined hand movements. Cereb. Cortex 10, 1093–1104. doi: 10.1093/cercor/10.11.1093
Grezes, J., and Decety, J. (2001). Functional anatomy of execution, mental simulation, observation, and verb generation of actions: a meta-analysis. Hum. Brain Mapp. 12, 1–19. doi: 10.1002/1097-0193(200101)12:1<1::aid-hbm10>3.0.co;2-v
Guillot, A., Collet, C., Nguyen, V. A., Malouin, F., Richards, C. L., and Doyon, J. (2008). Functional neuroanatomical networks associated with expertise in motor imagery. Neuroimage 41, 1471–1483. doi: 10.1016/j.neuroimage.2008.03.042
Guillot, A., Collet, C., Nguyen, V. A., Malouin, F., Richards, C. L., and Doyon, J. (2009). Brain activity during visual versus kinesthetic imagery: an fmri study. Hum. Brain Mapp. 30, 2157–2172. doi: 10.1002/hbm.20658
Guillot, A., Di Rienzo, F., Macintyre, T., Moran, A., and Collet, C. (2012). Imagining is not doing but involves specific motor commands: a review of experimental data related to motor inhibition. Front. Hum. Neurosci. 6:247. doi: 10.3389/fnhum.2012.00247
Hanakawa, T., Dimyan, M. A., and Hallett, M. (2008). Motor planning, imagery, and execution in the distributed motor network: a time-course study with functional mri. Cereb. Cortex 18, 2775–2788. doi: 10.1093/cercor/bhn036
Hanakawa, T., Immisch, I., Toma, K., Dimyan, M. A., Van Gelderen, P., and Hallett, M. (2002). Functional properties of brain areas associated with motor execution and imagery. J. Neurophysiol. 89, 989–1002. doi: 10.1152/jn.00132.2002
Hétu, S., Grégoire, M., Saimpont, A., Coll, M., Eugène, F., Michon, P., et al. (2013). The neural network of motor imagery: an ale meta-analysis. Neurosci. Biobehav. Rev. 37, 930–949. doi: 10.1016/j.neubiorev.2013.03.017
Hikosaka, O., Sakai, K., Miyauchi, S., Takino, R., Sasaki, Y., and Putz, B. (1996). Activation of human presupplementary motor area in learning of sequential procedures: a functional mri study. J. Neurophysiol. 76, 617–621. doi: 10.1152/jn.1922.214.171.1247
Hirth, C., Obrig, H., Valdueza, J. M., Dirnagl, U., and Villringer, A. (1997). Simultaneous assessment of cerebral oxygenation and hemodynamics during a motor task. A combined near infrared and transcranial doppler sonography study. Adv. Exp. Med. Biol. 411, 461–469. doi: 10.1007/978-1-4615-5865-1_59
Holper, L., Biallas, M., and Wolf, M. (2009). Task complexity relates to activation of cortical motor areas during uni- and bimanual performance: a functional NIRS study. Neuroimage 46, 1105–1113. doi: 10.1016/j.neuroimage.2009.03.027
Horovitz, S. G., and Gore, J. C. (2003). “Studies of the sensitivity of near infrared spectroscopy to detect changes in levels of brain activation due to manipulations of motor tasks,” in Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cancun, Mexico).
Hoshi, E., and Tanji, J. (2007). Distinctions between dorsal and ventral premotor areas: anatomical connectivity and functional properties. Curr. Opin. Neurobiol. 17, 234–242. doi: 10.1016/j.conb.2007.02.003
Iso, N., Moriuchi, T., Sagari, A., Kitajima, E., Iso, F., Tanaka, K., et al. (2016). Monitoring local regional hemodynamic signal changes during motor execution and motor imagery using near-infrared spectroscopy. Front. Physiol. 6:416. doi: 10.3389/fphys.2015.00416
Kasess, C. H., Windischberger, C., Cunnington, R., Lanzenberger, R., Pezawas, L., and Moser, E. (2008). The suppressive influence of sma on m1 in motor imagery revealed by fmri and dynamic causal modeling. Neuroimage 40, 828–837. doi: 10.1016/j.neuroimage.2007.11.040
Koessler, L., Maillard, L., Benhadid, A., Vignal, J. P., Felblinger, J., Vespignani, H., et al. (2009). Automated cortical projection of EEG sensors: anatomical correlation via the international 10–10 system. Neuroimage 46, 64–72. doi: 10.1016/j.neuroimage.2009.02.006
Koo, B., Lee, H., Nam, Y., Kang, H., Koh, C. S., Shin, H., et al. (2015). A hybrid NIRS-EEG system for self-paced brain computer interface with online motor imagery. J. Neurosci. Methods 244, 26–32. doi: 10.1016/j.jneumeth.2014.04.016
Lacourse, M. G., Orr, E. L. R., Cramer, S. C., and Cohen, M. J. (2005). Brain activation during execution and motor imagery of novel and skilled sequential hand movements. Neuroimage 27, 505–519. doi: 10.1016/j.neuroimage.2005.04.025
Leff, D., Orihuelaespina, F., Elwell, C. E., Athanasiou, T., Delpy, D. T., Darzi, A., et al. (2011). Assessment of the cerebral cortex during motor task behaviours in adults: a systematic review of functional near infrared spectroscopy (fNIRS) studies. Neuroimage 54, 2922–2936. doi: 10.1016/j.neuroimage.2010.10.058
Lloyd-Fox, S., Blasi, A., and Elwell, C. E. (2010). Illuminating the developing brain: the past, present and future of functional near infrared spectroscopy. Neurosci. Biobehav. Rev. 34, 269–284. doi: 10.1016/j.neubiorev.2009.07.008
Loporto, M., McAllister, C. J., Williams, J., Hardwick, R. M., and Holmes, P. S. (2011). Investigating central mechanisms underlying the effects of action observation and imagery through transcranial magnetic stimulation. J. Mot. Behav. 43, 361–373. doi: 10.1080/00222895.2011.604655
Lotze, M., Montoya, P., Erb, M., Hülsmann, E., Flor, H., Klose, U., et al. (1999). Activation of cortical and cerebellar motor areas during executed and imagined hand movements: an fMRI study. J. Cogn. Neurosci. 11, 491–501. doi: 10.1162/089892999563553
Mesquita, R. C., Franceschini, M. A., and Boas, D. A. (2010). Resting state functional connectivity of the whole head with near-infrared spectroscopy. Biomed. Opt. Express 1, 324–336. doi: 10.1364/boe.1.000324
Naito, E., Roland, P. E., and Ehrsson, H. H. (2002). I feel my hand moving: a new role of the primary motor cortex in somatic perception of limb movement. Neuron 36, 979–988. doi: 10.1016/S0896-6273(02)00980-7
Naseer, N., and Hong, K. (2013). Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain-computer interface. Neurosci. Lett. 553, 84–89. doi: 10.1016/j.neulet.2013.08.021
Obrig, H., Hirth, C., Junge-Hülsing, J., Döge, C., Wolf, T., Dirnagl, U., et al. (1996). Cerebral oxygenation changes in response to motor stimulation. J. Appl. Physiol. 81, 1174–1183. doi: 10.1152/jappl.19126.96.36.1994
Personnier, P., Ballay, Y., and Papaxanthis, C. (2010). Mentally represented motor actions in normal aging: III. Electromyographic features of imagined arm movements. Behav. Brain Res. 206, 184–191. doi: 10.1016/j.bbr.2009.09.011
Porro, C. A., Francescato, M. P., Cettolo, V., Diamond, M. E., Baraldi, P., Zuiani, C., et al. (1996). Primary motor and sensory cortex activation during motor performance and motor imagery: a functional magnetic resonance imaging study. J. Neurosci. 16, 7688–7698.
Ruby, P., and Decety, J. (2003). What you believe versus what you think they believe: a neuroimaging study of conceptual perspective-taking. Eur. J. Neurosci. 17, 2475–2480. doi: 10.1046/j.1460-9568.2003.02673.x
Schuster, C., Hilfiker, R., Amft, O., Scheidhauer, A., Andrews, B. J., Butler, J., et al. (2011). Best practice for motor imagery: a systematic literature review on motor imagery training elements in five different disciplines. BMC Med. 9:75. doi: 10.1186/1741-7015-9-75
Sirigu, A., Duhamel, J., Cohen, L., Pillon, B., Dubois, B., and Agid, Y. (1996). The mental representation of hand movements after parietal cortex damage. Science 273, 1564–1568. doi: 10.1126/science.273.5281.1564
Sitaram, R., Zhang, H., Guan, C., Thulasidas, M., Hoshi, Y., Ishikawa, A., et al. (2007). Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain-computer interface. Neuroimage 34, 1416–1427. doi: 10.1016/j.neuroimage.2006.11.005
Solodkin, A., Hlustik, P., Chen, E. E., and Small, S. L. (2004). Fine modulation in network activation during motor execution and motor imagery. Cereb. Cortex 14, 1246–1255. doi: 10.1093/cercor/bhh086
Stephan, K. M., Fink, G. R., Passingham, R. E., Silbersweig, D., Ceballosbaumann, A. O., Frith, C. D., et al. (1995). Functional anatomy of the mental representation of upper extremity movements in healthy subjects. J. Neurophysiol. 73, 373–386. doi: 10.1152/jn.19188.8.131.523
Strangman, G. E., Franceschini, M. A., and Boas, D. A. (2003). Factors affecting the accuracy of near-infrared spectroscopy concentration calculations for focal changes in oxygenation parameters. Neuroimage 18, 865–879. doi: 10.1016/s1053-8119(03)00021-1
Tak, S., Yoon, S. J., Jang, J., Yoo, K., Jeong, Y., and Ye, J. C. (2011). Quantitative analysis of hemodynamic and metabolic changes in subcortical vascular dementia using simultaneous near-infrared spectroscopy and fmri measurements. Neuroimage 55, 176–184. doi: 10.1016/j.neuroimage.2010.11.046
Tsuzuki, D., Jurcak, V., Singh, A. K., Okamoto, M., Watanabe, E., and Dan, I. (2007). Virtual spatial registration of stand-alone fNIRS data to mni space. Neuroimage 34, 1506–1518. doi: 10.1016/j.neuroimage.2006.10.043
Vry, M. S., Saur, D., Rijntjes, M., Umarova, R., Kellmeyer, P., Schnell, S., et al. (2012). Ventral and dorsal fiber systems for imagined and executed movement. Exp. Brain Res. 219, 203–216. doi: 10.1007/s00221-012-3079-7
Watanabe, E., Yamashita, Y., Maki, A., Ito, Y., and Koizumi, H. (1996). Non-invasive functional mapping with multi-channel near infra-red spectroscopic topography in humans. Neurosci. Lett. 205, 41–44. doi: 10.1016/0304-3940(96)12376-4
White, B. R., Snyder, A. Z., Cohen, A. L., Petersen, S. E., Raichle, M. E., Schlaggar, B. L., et al. (2009). Resting-state functional connectivity in the human brain revealed with diffuse optical tomography. Neuroimage 47, 148–156. doi: 10.1016/j.neuroimage.2009.03.058
Wriessnegger, S. C., Kurzmann, J., and Neuper, C. (2008). Spatio-temporal differences in brain oxygenation between movement execution and imagery: a multichannel near-infrared spectroscopy study. Int. J. Psychophysiol. 67, 54–63. doi: 10.1016/j.ijpsycho.2007.10.004
Zhang, Y., Tan, F., Xu, X., Duan, L., Liu, H., Tian, F., et al. (2015). Multiregional functional near-infrared spectroscopy reveals globally symmetrical and frequency-specific patterns of superficial interference. Biomed. Opt. Express 6, 2786–2802. doi: 10.1364/BOE.6.002786
Zhu, H., Xu, J., Li, J., Peng, H., Cai, T., Li, X., et al. (2017). Decreased funtional connectivity and disrupted neural network in the prefrontal cortex of affective disorders: a resting-state fnirs study. J. Addict. Disord. 221, 132–144. doi: 10.1016/j.jad.2017.06.024
Keywords: fNIRS, motor execution, motor imagery, systemic physiological interference, data preprocessing algorithm
Citation: Wu S, Li J, Gao L, Chen C and He S (2018) Suppressing Systemic Interference in fNIRS Monitoring of the Hemodynamic Cortical Response to Motor Execution and Imagery. Front. Hum. Neurosci. 12:85. doi: 10.3389/fnhum.2018.00085
Received: 25 November 2017; Accepted: 19 February 2018;
Published: 05 March 2018.
Edited by:Mikhail Lebedev, Duke University, United States
Reviewed by:Atsuhiro Tsubaki, Niigata University of Health and Welfare, Japan
Antonio Pereira, Universidade Federal do Pará, Brazil
Copyright © 2018 Wu, Li, Gao, Chen and He. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sailing He, email@example.com
† These authors have contributed equally to this work.