Clinical Trial ARTICLE
A Multi-Target Motor Imagery Training Using Bimodal EEG-fMRI Neurofeedback: A Pilot Study in Chronic Stroke Patients
- 1Univ Rennes, Inria, CNRS, Inserm, IRISA, Rennes, France
- 2Departement of Physical and Rehabilitation Medicine, Centre Hospitalier Universitaire (CHU) Rennes, Rennes, France
- 3Departement of Radiology, CHU Rennes, Rennes, France
Traditional rehabilitation techniques present limitations and the majority of patients show poor 1-year post-stroke recovery. Thus, Neurofeedback (NF) or Brain-Computer-Interface applications for stroke rehabilitation purposes are gaining increased attention. Indeed, NF has the potential to enhance volitional control of targeted cortical areas and thus impact on motor function recovery. However, current implementations are limited by temporal, spatial or practical constraints of the specific imaging modality used. In this pilot work and for the first time in literature, we applied bimodal EEG-fMRI NF for upper limb stroke recovery on four stroke-patients with different stroke characteristics and motor impairment severity. We also propose a novel, multi-target training approach that guides the training towards the activation of the ipsilesional primary motor cortex. In addition to fMRI and EEG outcomes, we assess the integrity of the corticospinal tract (CST) with tractography. Preliminary results suggest the feasibility of our approach and show its potential to induce an augmented activation of ipsilesional motor areas, depending on the severity of the stroke deficit. Only the two patients with a preserved CST and subcortical lesions succeeded in upregulating the ipsilesional primary motor cortex and exhibited a functional improvement of upper limb motricity. These findings highlight the importance of taking into account the variability of the stroke patients’ population and enabled to identify inclusion criteria for the design of future clinical studies.
Neurofeedback (NF) consists of training self-regulation of a specific brain function by providing a subject with real-time information about his own brain activity (Sitaram et al., 2017). This is thought to have an impact on the related behavioral or pathological condition. The majority of NF (or brain-computer interfaces, BCIs) approaches have relied solely on one imaging technique, historically on EEG recordings. In applications intended for motor recovery, subjects are usually asked to perform motor imagery since imagining the movement and executing it are considered to involve similar brain areas. This is particularly true if the mental practice is oriented towards a kinesthetic (rather than visual) motor imagery (Solodkin et al., 2004).
EEG offers the advantages of practicability and high time resolution but suffers from limited spatial resolution and access to deep brain structures. This has prompted to explore the implementation of NF approaches with other sensing techniques such as fMRI (Sitaram et al., 2012; Liew et al., 2016), granting high spatial resolution and more precise identification of cortical targets. Thus, fMRI allows for regulation of better circumscribed subcortical structures as compared to other techniques used for NF. However, fMRI is a costly and cumbersome imaging technique, which severely limits scanning time and all the more so training time, while EEG represents a practical and affordable technology, which allows for numerous training sessions and potentially increased efficacy of rehabilitation.
These two imaging techniques appear to be highly complementary from various perspectives. In order to exploit the full potential of both EEG and fMRI for NF training, the work of two groups (including ours: Zotev et al., 2014; Perronnet et al., 2017, 2018) has gone further integrating EEG and fMRI to achieve a more specific and effective regulation during NF. Thus, in these studies, EEG and fMRI signals were simultaneously recorded and fed back by means of visual feedback, allowing the subject to self-regulate jointly the electrical activity of determined scalp regions and the blood-oxygen-level-dependent (BOLD) signal of specifically targeted cortical areas. If Zotev et al. (2014) focused on psychiatric rehabilitation, our group was the first to integrate fMRI and EEG NF to train regulation of motor areas and suggested, in a sample of ten subjects, the added value of combined EEG-fMRI NF (with respect to unimodal EEG or fMRI NF) in terms of brain activation and engagement of the subjects (Perronnet et al., 2017).
Other recent studies have revealed the potential of NF and BCI training for stroke rehabilitation (Cervera et al., 2018), as an alternative or in addition to traditional therapies (Wang et al., 2017), to stimulate neural plasticity and support functional improvement (Grosse-Wentrup et al., 2011). Previous works have also shown that NF can enhance the efficacy of motor imagery training, in terms of eliciting brain patterns relevant to the task (Zich et al., 2015; Bagarinao et al., 2018). These works have implemented unimodal EEG or fMRI NF. In this exploratory study, and for the first time in literature, multisession bimodal EEG-fMRI NF for upper limb motor recovery was tested in four stroke-patients. Given the cost and complexity of performing bimodal sessions and in order to guarantee a sufficient cumulated training time to the patients, they underwent a first bimodal NF session, followed by three unimodal EEG-only NF sessions and a final bimodal NF training. We expected that the patient would develop a strategy during bimodal EEG-fMRI NF training, receiving enhanced information, and then “transfer” it to unimodal EEG sessions, to reach a sufficient training intensity.
Besides, the choice of the cortical target of NF training has a critical impact on the rehabilitation outcome. If ipsilesional primary motor cortex (M1) has been suggested to be the most promising target for an efficient motor recovery (Favre et al., 2014), supplementary motor area (SMA) is easier to engage during motor imagery (Sharma et al., 2006; Mehler et al., 2019) than M1 (Berman et al., 2012; Chiew et al., 2012; Blefari et al., 2015) and may play an important role in restoring motor function in more severely affected patients (Di Pino et al., 2014; Plow et al., 2015). In particular, while several studies have shown robust SMA activation during kinesthetic motor imagery, it is still unclear whether M1 can be consistently activated. Some motor imagery studies reported significant activation (Sharma et al., 2008), however, fMRI NF studies found non-conclusive results at group level (Chiew et al., 2012; Blefari et al., 2015) and one recent study showed deactivation of M1 during kinesthetic motor imagery-based upregulation training of the SMA and M1 (Mehler et al., 2019). M1 involvement may depend on the subject and the nature of performed motor imagery task and there is no evidence that it is consistently activated, at least in short training protocols (Hétu et al., 2013). On these premises, the second important novelty of this study is the definition of an adaptive, multi-target training that more strongly rewarded SMA activation in the first NF training session, yet increased the M1 contribution in later sessions. To this end, we defined an adaptive cortical region of interest (ROI) based on a weighted combination of ipsilesional SMA and M1 activities. We varied the weights across the training sessions in order to guide the patient training towards an improved activation of M1 and neighboring ipsilesional motor areas.
The first aim of this pilot work was to test the feasibility of the multisession EEG-fMRI NF training in stroke patients, in view of designing a randomized controlled trial on chronic stroke patients involving a longer training protocol. Second, we aimed at testing if the multi-target bimodal strategy was implementable and efficient in guiding the patients towards the upregulation of the ipsilesional M1. The relation between NF training efficacy and the integrity of the ipsilesional corticospinal tract (CST) reconstructed from diffusion tensor imaging (DTI) imaging was also investigated. Finally, functional tests were performed in order to evaluate the potential for clinical improvement of multi-target, bimodal NF training.
Four chronic stroke patients (aged between 54 and 76 years, two females) with mild to severe left hemiparesis (Fugl-Meyer score in the range 14–50) and without major cognitive deficits took part in the study (Table 1). All participants gave their written informed consent and the study was approved by the institutional review board Poitiers III Ouest. This being an exploratory experiment, we referred to a previous clinical trial register (NCT01677091) and asked the patients to sign additional consent before taking part in this pilot. All patients had participated to the registered study, however, they were screened again before enrollment and were all included in this pilot.
NF Training Protocol
The NF training protocol included two bimodal EEG-fMRI NF sessions interleaved with three unimodal EEG NF sessions (Figure 1) and a final motor assessment (MA), within 10 days from inclusion. Patients were informed at the inclusion, verbally and by an explanatory note, about the goals and the timeline of the study. Instructions were repeated before each training session. Instructions for mental imagery oriented the patients towards a technique of kinesthetic motor imagery, without mentioning a specific strategy. For each bimodal NF session, the protocol included a calibration step (motor imagery of hemiplegic hand) and three NF training runs (5 min 20 s each). Each NF run consisted of epochs of rest (20 s) alternated to a period of closed-loop motor imagery training (20 s). Details about the protocol have been previously published by our group (Perronnet et al., 2018). Similarly, the unimodal EEG NF sessions consisted of a calibration period followed by three NF runs with a block-design alternating rest and task during 5 min, with an amount of training time and protocol structure equivalent to bimodal training sessions.
Figure 1. Experimental protocol of multisession Neurofeedback (NF) training procedure. Motor assessment (MA) and NF training sessions timeline is shown in the first row (bimodal EEG-FMRI b-s1 and b-s5 and unimodal EEG s2, s3 and s4). The second row is a schematic of the training protocol that was repeated at each session; finally, the third row shows the time-course of an NF run (block design alternating 20 s rest and 20 s NF training). Abbreviations: b-s, bimodal NF session; s, EEG only NF session; NFT, Neurofeedback training.
Data Acquisition and Experimental Setup
EEG and fMRI data were simultaneously acquired with a 64-channel MR-compatible EEG solution from Brain Products (Brain Products GmbH, Gilching, Germany) on a 3T Prisma Siemens scanner running VE11C with a 64-channel head coil. EEG data were sampled at 5 kHz with FCz as the reference electrode and AFz as the ground electrode. fMRI acquisitions were performed using echo-planar imaging (EPI) with the following parameters: repetition time (TR)/echo time (TE) = 1,000/23 ms, FOV = 230 × 230 mm2, 16 4 mm-slices, voxel size = 2.2 × 2.2 × 4 mm3, matrix size = 105 × 105, flip angle = 90°. During rest, the screen displayed a cross and participants were asked to concentrate on the cross and not perform the task. During the task, the screen showed the NF metaphor. The feedback was visual and consisted of a yellow ball moving in a one-dimensional gauge proportionally to the average of the EEG and the fMRI features (Figure 2). As a structural reference for the fMRI analysis, a high-resolution 3D T1 MPRAGE sequence was acquired with the following parameters: TR/TI/TE = 1,900/900/2.26 ms, GRAPPA 2, FOV = 256 × 256 mm2 and 176 slabs, voxel size = 1 × 1 × 1 mm3, flip angle = 9°. The EEG/fMRI-NF platform in place integrates and synchronizes EEG and fMRI data streams by means of an NF control unit (Mano et al., 2017). EEG data were pre-processed on-line with BrainVision Recview software 2.1.2 (Brain Products GmbH, Gilching, Germany) for gradient and BCG artifact correction (Allen et al., 2000) and sent to the NF control unit for further processing. fMRI data were pre-processed online for motion correction and EEG and fMRI NF features were then computed in the NF control unit using a custom made script developed in Matlab 2017 and SPM8 (The Math-Works, Inc., Natick, MA, USA) and translated as a visual feedback with Psychtoolbox 31.
Figure 2. NF calculation schematic. The visual NF at time †* is equal to the average of EEG and fMRI NF scores, updated respectively every 250 ms and 1 s. The fMRI NF score, in turn, is equal to the weighted sum of blood-oxygen-level-dependent (BOLD) activations (contrast NF TASK > REST) in the supplementary motor area (SMA) and primary motor cortex (M1) regions of interest (ROIs) (in blue and red on a normalized anatomical scan, with calibration a priori masks in black). The weights assigned to the two contributions M1 and SMA vary from the first training session (a = 0.5, b = 0.5) to the second (a = 0.25, b = 0.75). The EEG score was obtained computing the Event Related Desynchronization (ERD) on a combination of electrodes given by Common Spatial Pattern (CSP) or laplacian filter weights.
At the beginning of each experimental session, a motor imagery task without NF was performed to calibrate both fMRI and EEG signals. Immediately at the end of this motor imagery run, EEG and fMRI data were pre-processed and analyzed to estimate subject-specific EEG and fMRI NF calibration features.
For the EEG calibration, only 18 channels located over the motor regions were selected for further analysis. The power in the 8–30 Hz frequency band was computed and a Common Spatial Pattern (CSP; Ramoser et al., 2000) filter was estimated. In cases where the CSP filter did not look physiologically plausible [visual inspection to check if the Event-Related Desynchronization (ERD) computed from filtered data was correlated with the task (Pfurtscheller and Lopes da Silva, 1999)], we used a laplacian filter over the ipsilesional motor electrode C4 (more details in Perronnet et al., 2018). An ERD feature was then computed from filtered data and the threshold for the EEG NF was set equal to the ERD value reached at least 30% of the time. The threshold was computed with the rationale of adapting the NF difficulty to individual performances for each session and make the training engaging.
For the fMRI calibration and the definition of ROIs, data of the motor imagery session were pre-processed for motion correction, slice-time correction, spatial realignment with the structural scan and spatial smoothing (6 mm FHWM Gaussian kernel). A first-level general linear model analysis was then performed. The corresponding activation map was used to define two ROIs around the maximum of activation in the ipsilesional M1 and SMA respectively. To this end two large apriori masks were defined (see Figure 2) and the respective ROIs identified taking a box of 9 × 9 × 3 voxels (20 × 20 × 12 mm3) centered around the peak of activation inside the apriori masks. A weighted sum of the BOLD activity in the two ROIs was then used to compute the fMRI NF (Figure 2). Also for the fMRI NF, a threshold was set by estimating the value reached 30% of the time during the calibration session.
NF Online Calculation
Calibration parameters were estimated before the first NF training run for each training session in order to properly compute the NF features. NF calculation, which has been described in detail elsewhere (Perronnet et al., 2018), was performed on the two synchronized data streams (EEG and fMRI) in the NF control unit. EEG data were firstly filtered with the subject-specific spatial filter selected during the calibration phase. The band power (BP) in the 8–30 Hz band was then computed and normalized with respect to the power in the last 5 s of the previous rest block (prev-rest) with the following event-related desynchronization (ERD; Pfurtscheller and Lopes da Silva, 1999) formula:
EEG-NF values were smoothed, divided by the calibration threshold and normalized between 0 and 1 in order to return only positive values to the subject. The EEG feature was eventually translated as visual feedback (position along the gauge) every 250 ms.
The fMRI NF feature (equation 2) was calculated as the difference between percentage signal change in the two ROIs (SMA and M1) and a large deep background region (slice 3 out of 16) whose activity is not correlated with the NF task, in order to reduce the impact of global signal changes (i.e., breathing, heart rate changes and head movements; Thibault et al., 2018).
Bsma is the average bold signal in the SMA ROI, Bm1 in the M1 ROI and Bbg in the background slice. During the 1st week, the same weight was given to both ROIs (a = b = 0.5) while in the second session a higher weight was assigned to the BOLD signal of the M1 ROI (a = 0.25, b = 0.75), in order to guide the training towards upregulation of the ipsilesional motor cortex. The fMRI feature was smoothed over the previous three volumes, divided by the individual threshold and eventually translated as visual feedback every repetition time (1 s). The total position of the ball on the gauge was at every instant equal to the mean between the EEG and fMRI NF features (Figure 2).
We used the Mensia Modulo (MENSIA TECHNOLOGIES2) hardware solution to perform the unimodal EEG-NF sessions. Mensia Modulo is equipped with an 8-channel EEG cap that can be rapidly set up and is designed for a high number of training sessions. The patient received the visual feedback metaphor on a computer screen. The gauge was accompanied by a puzzle game that was completed less or more rapidly depending on the feedback score. Pre-processing included filtering and eye blink artifacts removal (details about the data pre-processing pipeline can be found in the patent US 2017/0311832). An analysis based on the covariance matrix of the ipsilesional motor channels EEG signals was then applied and the ERD NF score was extracted based on the Riemannian distance (Förstner and Moonen, 1999) between motor imagery task and resting blocks.
Evaluation of Outcome Measures
Before and after the NF training protocol upper limb motor function was assessed by a certified physiotherapist by means of the Fugl-Meyer upper extremity test (FMA-UE; Fugl-Meyer et al., 1975), which evaluates motor activity skills and selectivity of the movement. The FMA-UE score ranges between 0 and 66, with scores lower than 20 indicating severe deficit and scores higher than 48 associated with mild motor impairments (Woodbury et al., 2013).
Subjective ratings on motivation and satisfaction with NF protocol features (i.e., number and length of training sessions, NF metaphor) were evaluated with qualitative questionnaires, based on a 5-point Likert scale (Likert, 1932). Additional comments mainly regarding the motor imagery strategy were noted too.
Assessment of Corticospinal Tract Integrity
The integrity of the CST is a well-established predictor of the potential for motor improvement (Stinear et al., 2007). In order to assess the asymmetry between the ipsilesional and contralesional CST, diffusion imaging (TR/TE = 11,000/99 ms, FOV 256 × 256 mm2, 60 slices, matrix 128 × 128, voxel size, 2 × 2 × 2 mm3, 30 directions, b = 1,000 s/mm2) was performed at inclusion. The diffusion tensor model was estimated and the fractional anisotropy (FA) calculated. The CST was then reconstructed using the method of Jong et al. (2005) using the software medInria3: After estimating the FA maps, two regions of interest were segmented to isolate the CST: the posterior limb of the upper internal capsule and a the CST at the lower pons. FA asymmetry between the affected and unaffected CST was then calculated. FA is a measure of white matter fibers integrity and a disruption of the structural fibers is associated with an FA decrease. An index of FA asymmetry = (FAcontralesional − FAipsilesional)/(FAcontralesional + FAipsilesional) gives therefore important indications about the structural deficit in the ipsilesional CST. Such an index ranges between −1.0 and +1.0, where positive values indicate reduced FA in the affected CST, and a value of 0 indicates symmetrical FA, i.e. preserved ipsilesional CST. In particular it has been shown that a FA asymmetry index value greater than 0.15 is a “point of no return,” beyond which limited capacity for recovery is expected (Stinear et al., 2007, 2012).
fMRI and EEG Outcomes
For each patient, in order to evaluate the effect of NF training on upregulation of BOLD activity, we assessed the difference between SMA and M1 NF scores in session b-s1 and b-s5 by means of a Wilcoxon test across NF runs. We also computed equivalent NF scores for a “neutral” ROI, whose activity is not expected to be upregulated after the motor NF training. Using the Montreal Neurological Institute (MNI) atlas, a 9 × 9 × 3-voxel ROI around the peak of activation in the right medial superior frontal cortex was identified: NF scores were then computed applying the same algorithm as for SMA and M1.
A whole-brain analysis was also performed to characterize cortical areas engaged during NF and describe the reorganization of motor maps at the end of the protocol. Pre-processing (slice-time and motion correction, co-registration to the 3D T1, followed by spatial smoothing with a 6 mm FWHM Gaussian kernel and normalization to MNI template) and a first-level general linear model analysis were performed. The activations maps were voxel-wise Family-Wise error (FWE) corrected (p < 0.05).
Similarly, for the EEG analysis data were first pre-processed offline with a semi-automatic artifact rejection procedure implemented in Brain Products Analyzer (version 184.108.40.2067) and fieldtrip-201912314; data were then filtered between 8 and 30 Hz using a Butterworth zero-phase filter (48 dB slope). For each subject, mean NF scores per session and the ERD scalp distributions over motor channels were computed for both the bimodal and unimodal training sessions.
For additional details on the methodology of acquisition, processing and analysis of data, including toolbox and software used see Mano et al. (2017); Perronnet et al. (2017, 2018). Data and materials are available upon request to interested researchers.
Overall, in all the patients motor imagery elicited activation, with respect to rest, in the SMA (p = 0.004, Wilcoxon test) and M1 (p = 0.006, Wilcoxon test) areas (Figure 3A). Two over four patients showed a significant increase in ipsilesional M1 activation (NF score) in the second training session as compared to the first one (Table 2). Interestingly these two also improved their clinical FMA-UE score (Figure 3B). The fourth patient, on the other hand, significantly increased its activation in the SMA area, but decreased it in the ipsilesional M1, and showed a decrease in FMA-UE score. Changes in regulation of the “neutral” ROI in the frontal superior cortex were not significant or in contrast with the upregulation of the motor areas.
Figure 3. Group results. (A) fMRI NF scores values (mean ± standard error across subjects and NF runs) with relative statistics; *indicates statistically significant difference (p < 0.01) between rest and NF task as assessed with a Wilcoxon test across subjects. (B) Scatter plot relating change in the clinical outcome (FMA-UE score) and ipsilesional M1 BOLD regulation for the four patients.
Table 2. Multi-target fMRI control: individual results of blood-oxygen-level-dependent Neurofeedback (BOLD NF) scores (normalized percent signal change from baseline-rest).
Qualitative questionnaire results indicated that generally patients were highly motivated to engage in NF training and very interested by this type of reeducation, which they found complementary with traditional rehabilitation therapies. They were also satisfied with the visual feedback appearance and how it translated their motor imagery effort. Concerning the strategies employed by the patients to control the ball movement, they all used motor imagery of the affected limb. While some of them evoked simple and repetitive tasks (i.e., P01: thought of opening and closing the hand, P04: holding something with the hand), some others engaged in the imagery of a more complex task (P02: imagined hair combing, P03: ironing). Interestingly enough, these more elaborated strategies were also the most effective.
The patient was a 62 years old male with right ischemic capsulo-lenticular lesion (Figure 4D) with important loss of ipsilesional CST integrity (Figure 4C) at the level of the posterior limb of the internal capsule (FA asymmetry index = 0,105). Time since stroke was 5 years and the initial FMA-UE score was 14. This patient increased his NF score in the ipsilesional M1 in the second session as compared to the first one, but its activation was relatively weak (Figures 4A,B). The whole-brain analysis revealed a bilateral activation of M1 and SMA during the NF training (Figure 4E). Its EEG activation was bilateral too, and he showed a positive, relatively strong ERD across the three unimodal training sessions (Figure 4G). EEG acquired during the bimodal NF sessions was particularly noisy in session b-s1, and the ERD calculated over ipsilesional electrodes (C2, C4, C6) was negative. In the second session b-s5 the average ERD was positive but relatively small (Figure 4F). No changes in the FMA-UE score were observed at the end of the training.
Figure 4. Patient P01 outcome measures. (A) M1 regulation during NF training: Normalized NF scores as showed to the patient (mean + standard error across NF sessions—NF1, NF2, NF3- for sessions b-s1 (orange) and b-s5 (blue). Resting blocks are indicated in white, NF training blocks in gray. (B) Bar plots of mean normalized NF scores in SMA (left bar plot) and M1 (right) with relative standard error and statistics for b-s1 and b-s5. *Indicates statistically significant difference (p < 0.01) between b-s1 and b-s5 as assessed with a Wilcoxon test across blocks of the same training session. (C) Corticospinal tract (CST) reconstruction from diffusion MRI imaging. Ipsilesional CST is represented in red and contralesional CST in green. (D) Manual Lesion Segmentation (in red) on an anatomical scan. (E) Individual contrast activation maps (NF TASK > REST, voxel-wise Family-Wise error (FWE) corrected, p < 0.05) during NF training in session b-s1 (orange) and b-s5 (blue). (F) Scalp plots of mean EEG ERD (across NF runs) in b-s1 (left) and b-s5 (right; bimodal EEG-fMRI sessions). (G) Unimodal EEG-NF outcomes: mean and standard error ERD estimated from the ipsilesional motor electrode (C4) for the three unimodal EEG-NF training sessions (left) with topoplot of the mean ERD values over motor electrodes (right). Results shown in panels (F,G) were obtained offline. For each motor channel (18 for the bimodal sessions, five for the unimodal EEG-NF runs) ERD was computed as the normalized difference in the 8–30 Hz band power (BP) between the rest block and the following training block. The mean ERD value for each channel is displayed in scalp plots representing “ERD activation maps.” For panel (G), in order to have a synthetic view of the ERD across the three unimodal sessions, only the ERD from channel C4, the electrode corresponding to the ipsilesional M1, was shown.
Patient 2 was a 76 years old woman with a right ischemic capsulo-lenticular lesion with a high ipsilesional CST integrity (FA asymmetry index = 0.04; Figures 5C,D). Time since stroke was 3 years and initial FMA-UE score was of 19. Even if showing a vast bilateral activation during motor imagery (Figure 5E), the patient significantly improved volitional control of ipsilesional M1 at the end of the training (p < 0.001, Wilcoxon test across 24 training blocks, Figures 5A,B) exhibiting very effective and robust NF trends in the second bimodal training session b-s5. ERD maps of unimodal EEG NF indicate a positive and bilateral activation of the motor channels and ipsilesional ERD was positive for all the unimodal sessions (Figures 5F,G). These functional changes were accompanied by a clinically relevant (Page et al., 2012) increase in the FMA-UE score from 19 to 25 (Table 2).
Figure 5. Patient 02 outcome measures. Legend as for Figure 4.
Patient 3 was a 68 years old woman with a right hemorrhagic subcortical lesion (Figure 6D) and a mild hemiparesis (FMA-UE score 50). Time since stroke was 1 year and the symmetry of CST quite well preserved (FA asymmetry index = 0.06, Figure 6C). The patient showed a strong SMA activation, which increased along with the two sessions, as revealed by the BOLD analysis. She significantly increased the activation of the ipsilesional M1 at the end of the training (p < 0.001, Wilcoxon test, Figures 6A,B) and exhibited a larger involvement of the ipsilesional motor and premotor areas, with respect to contralesional ones, during the second NF training, as revealed by BOLD activation maps in Figure 6E. The fMRI NF scores during the second session exhibited higher regularity and amplitude, with respect to the first one. During both unimodal and bimodal training, EEG activation was higher for midline motor electrodes (Figures 6E–G). These functional changes were associated with an increase of 3 points of the FMA-UE score (Table 2).
Figure 6. Patient 03 outcome measures. Legend as for Figure 4.
Patient 4 was a 51 years old male affected by a right ischemic-cortical stroke (Figure 7D), which occurred 12 months before the onset of the study. His initial FMA-UE score was 41 and he showed high integrity of the ipsilesional CST, with an FA asymmetry index of 0.05. This patient showed a relatively weak BOLD motor activation during NF training, in particular in the ipsilesional motor cortex (Figure 7E). He exhibited an increase in SMA activation in the final session associated however with a down-regulation of ipsilesional M1 activation, in contradiction with the designed training strategy (Figures 7A,B). This was associated with a negative ipsilesional EEG ERD during the second bimodal NF training session (Figure 7F), and to scarce performances during unimodal EEG sessions (in one session the average ERD was negative and average scalp plot revealed an ERD smaller than 20%, Figure 7G). These counteractive functional changes were associated with a modest deterioration (−9, 7%) of the FMA-UE score.
Figure 7. Patient 04 outcome measures. Legend as for Figure 4.
In this exploratory study, the feasibility and efficacy of multisession bimodal EEG-fMRI NF training for upper limb motor recovery after stroke was tested. The pilot study involved four chronic patients with various degrees of motor impairment and stroke characteristics.
In recent years, few studies have explored the potential of real-time NF for improving motor performances in stroke using different imaging modality such as fMRI (Liew et al., 2016), EEG (Pichiorri et al., 2015; Zich et al., 2017) or functional Near-Infrared Spectroscopy -NIRS (Mihara et al., 2013). A recent systematic review on fMRI NF for motor training in healthy subjects and stroke patients (Wang et al., 2017) indicated that real-time fMRI is effective in promoting self-regulation of targeted areas and has potential to improve motor outcomes. However, the efficacy of fMRI-NF was shown in some but not all studies and depended on function and respective cortical areas engaged. Another factor that severely limits the efficacy of fMRI training is that, due to the cost of MR scanning, in most fMRI-NF studies only short training protocols are usually implemented or tested. This, together with the high complementarity of EEG and fMRI techniques, motivated our effort to integrate these two modalities in view of designing more specific, feasible and effective multi-session training protocols for upper limb motor recovery after stroke.
Feasibility of Bimodal NF
For the first time in literature, we tested bimodal EEG-fMRI for stroke rehabilitation. Bimodal EEG-fMRI NF poses various challenges: technological (as it requires a complex and high-performance installation), practical (for the relatively long preparation time of the patients, of around 40 min) and mental for the participants (NF is cognitively demanding, particularly in the unfamiliar MRI environment, that the patients usually associate with negative emotions). Results confirmed the feasibility and safety of this protocol on stroke patients with mild to severe hemiparesis: patients managed to upregulate the BOLD activity in the targeted motor areas during NF training. The EEG activity was harder to modulate during bimodal sessions, but all patients successfully upregulated the activity recorded at motor electrodes during unimodal EEG-NF sessions.
In general, a positive response to the training protocol emerged from the questionnaires. Patients were interested and motivated by NF training and the associated challenge and very satisfied with the NF metaphor. They also perceived this type of training as potentially complementary to traditional rehabilitation techniques.
Multi-target Strategy and Its Relation to Stroke Deficit
One crucial aspect when designing an NF protocol is the choice of target regions. Whether the M1 is activated during motor imagery is still debated (Chiew et al., 2012; Blefari et al., 2015), while SMA seems to be more robustly and easily recruited. This work provides new pieces of evidence that M1 can be activated during motor imagery, especially when the patient is guided to this target through NF.
In this pilot work, we proposed a novel multi-target strategy for a guided rehabilitation of ipsilesional primary motor areas. Such a selective regulation of motor areas is only possible for the fMRI modality, which allows for a more precise spatial identification of activated areas than EEG. The multi-target training was effective in three out of four patients, who improved the activation of ipsilesional M1 in the second training session with respect to the beginning of the protocol. Remarkably, if we consider that the protocol was 1 week long, for two of these patients the improvement of ipsilesional M1 control was associated with an increase of motor performances, as assessed by the FMA-UE score (Figure 3B).
Those two patients exhibited a high degree of symmetry of the CST, and therefore a preserved ipsilesional CST. On the other hand, the patient having a severely impaired CST, with an FA asymmetry index close to the threshold indicating very poor recovery potential, did not exhibit functional improvement.
Patient 04 showed a high integrity of the ipsilesional CST but did not exhibit functional improvement. He presents a large cortical lesion including M1. In addition, the CST (segmented between the posterior limb of the internal capsule and the lower pons) does not seem to reach M1 (Figure 7C). This may be the main reason why the patient fails to activate M1, which is severely damaged while being able to activate SMA (preserved because vascularized by the anterior cerebral artery).
It has been shown that the recovery after partial lesion of M1 at the chronic stage of stroke is associated with reorganization within the surrounding motor cortex (Jaillard et al., 2005). We can hypothesize that, in patients with a large cortical stroke including M1, either recovery of ipsilesional activation would certainly require a much longer NF training, or we should consider changing the cortical target. In this case, contralesional M1 (via the cortico-reticulo-propriospinal pathway) would be a relevant alternative target (Bradnam et al., 2013).
These findings highlight the importance of taking into account various factors when designing a clinical protocol. In particular, they confirm the critical role of the preserved neural pathways (the so-called “structural reserve”; Di Pino et al., 2014) in the recovery process and indicate that this is importantly related also to functional brain regulation of the ipsilesional motor cortex, giving useful indications for future studies inclusion criteria.
This is an exploratory work and presents various limitations. The first concerns the challenge of obtaining good quality EEG recordings in the noisy environment of fMRI, which represents the main issue in simultaneous EEG-fMRI recording. Great effort was put to reduce the impedances of the electrodes during patient preparation, strictly following the manufacturer guidelines. However, completely getting rid of BCG and motion artifacts in real-time remains a challenge. BCG artifact correction maybe even more challenging for stroke patients, as they are often affected by atrial fibrillation and therefore have an irregular heart rate, in comparison with the healthy population. The development of more efficient real-time methods to correct these artifacts is the object of current research (Wu et al., 2016) and will considerably improve the quality of bimodal EEG-fMRI NF in the near future. Artifacts and noise are part of the reason why EEG activity regulation during bimodal NF is more challenging if compared to fMRI (Perronnet et al., 2017). Electrophysiological activity may also be intrinsically harder to control than metabolic activity since brain “naturally” regulates and processes feedbacks (i.e., blood pressure or flow) from the vascular system, while there are no equivalent “sensors” for brain electrophysiological activity (Birbaumer et al., 2013).
Another limitation of this study was that we did not control for movements of the affected limb during the motor imagery task by measuring the electromyographic (EMG) signal. This choice was made not to increase the burden and complexity of the simultaneous EEG-fMRI setup, as measuring EMG requires the installation of an additional amplifier at the bottom of the MR bore and, to arrange cables in a straight line, needs custom cable lengths for each individual in order to fulfill the safety regulations and follow the manufacturer guidelines. We have therefore decided to monitor upper limb movements by means of a camera inside the MR bore and repeatedly instructed the patients to remain still during NF training.
Here we present results from a pilot study and further research is required to validate its findings and assess the efficacy of bimodal EEG-fMRI for stroke rehabilitation. The lack of blinded assessment and the absence of a control group (for instance a group receiving sham NF or a treatment-as-usual group) does not allow to rigorously assess if patients upregulated their brain activity by means of the NF training neither to determine if the observed clinical effects are a result of the NF intervention, as the observed improvement may be related to other uncontrolled factors (Sorger et al., 2018).
This is an exploratory study whose main aims were to test the feasibility of the bimodal EEG-fMRI NF training in stroke patients and identify critical aspects for the design of a randomized controlled study. Our preliminary results are however encouraging and indicate that motor improvements were obtained after a relatively short training duration (1 week) in two out of four chronic patients at more than 1 year from the stroke episode, where spontaneous recovery has stopped. They also support the hypothesis that in these patients NF may trigger functional reorganization of the affected motor areas by exploiting the residual brain plasticity. Finally, this pilot study was useful to identify crucial aspects and inclusion criteria for the design of a larger randomized controlled trial on chronic stroke patients.
In this exploratory study, the feasibility and efficacy of bimodal EEG-fMRI NF training for upper limb motor recovery was tested in four chronic stroke patients. Preliminary results indicate that success in upregulating the activity of target motor areas depends on the type and severity of the stroke damage and stress the importance of taking into account the variability of the stroke patients’ population when designing a clinical protocol. These findings give useful indications for the design of future clinical studies with NF.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding author.
The studies involving human participants were reviewed and approved by Comité de Protection des Personnes de Poitiers Ouest III. The patients/participants provided their written informed consent to participate in this study.
All authors contributed to the study design, read and commented the manuscript. GL performed data collection, analysis and wrote the first draft of the manuscript. SB performed patients’ enrollment, screening and motor assessment, contributed to the discussion of results and revised the manuscript. MF contributed to data collection and revised the manuscript. EB provided assistance in designing the study and in data collection and revised the manuscript. AL, IB, and CB provided feedback on data analysis and interpretation, discussed the results and revised the manuscript.
MRI data acquisition was performed at the Neurinfo MRI research facility from the University of Rennes I, University Hospital of Rennes, Inria, CNRS and the Rennes Cancer Center. Neurinfo is also supported by the Brittany Council, Rennes Metropole, and GIS IBISA. Preliminary results from these studies were presented at OHBM 20195 and at the ISPRM Congress (Lioi et al., 2018). The project was supported by the National Research Agency in the “Investing for 540 the Future” program under reference Agence Nationale de la Recherche (ANR)-10-LABX-07-0, and by the “Fondation pour la Recherche Médicale” under the convention #DIC20161236427.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
- ^ http://psychtoolbox.org/
- ^ https://www.mensia.com/
- ^ http://med.inria.fr/
- ^ www.fieldtriptoolbox.org
- ^ https://www.pathlms.com/ohbm/courses/12238/sections/15843/video_presentations/137855
Bagarinao, E., Yoshida, A., Ueno, M., Terabe, K., Kato, S., Isoda, H., et al. (2018). Improved volitional recall of motor-imagery-related brain activation patterns using real-time functional MRI-based neurofeedback. Front. Hum. Neurosci. 12:158. doi: 10.3389/fnhum.2018.00158
Berman, B. D., Horovitz, S. G., Venkataraman, G., and Hallett, M. (2012). Self-modulation of primary motor cortex activity with motor and motor imagery tasks using real-time fMRI-based neurofeedback. NeuroImage 59, 917–925. doi: 10.1016/j.neuroimage.2011.07.035
Blefari, M. L., Sulzer, J., Hepp-Reymond, M. C., Kollias, S., and Gassert, R. (2015). Improvement in precision grip force control with self-modulation of primary motor cortex during motor imagery. Front. Behav. Neurosci. 9:18. doi: 10.3389/fnbeh.2015.00018
Bradnam, L. V., Stinear, C. M., and Byblow, W. D. (2013). Ipsilateral motor pathways after stroke: implications for non-invasive brain stimulation. Front. Hum. Neurosci. 7:184. doi: 10.3389/fnhum.2013.00184
Cervera, M. A., Soekadar, S. R., Ushiba, J., del Millán, J. R., Liu, M., Birbaumer, N., et al. (2018). Brain-computer interfaces for post-stroke motor rehabilitation: a meta-analysis. Ann. Clin. Transl. Neurol. 5, 651–663. doi: 10.1002/acn3.544
Chiew, M., LaConte, S. M., and Graham, S. J. (2012). Investigation of fMRI neurofeedback of differential primary motor cortex activity using kinesthetic motor imagery. NeuroImage 61, 21–31. doi: 10.1016/j.neuroimage.2012.02.053
Di Pino, G., Pellegrino, G., Assenza, G., Capone, F., Ferreri, F., Formica, D., et al. (2014). Modulation of brain plasticity in stroke: a novel model for neurorehabilitation. Nat. Rev. Neurol 10, 597–608. doi: 10.1038/nrneurol.2014.162
Favre, I., Zeffiro, T. A., Detante, O., Krainik, A., Hommel, M., and Jaillard, A. (2014). Upper limb recovery after stroke is associated with ipsilesional primary motor cortical activity: a meta-analysis. Stroke 45, 1077–1083. doi: 10.1161/STROKEAHA.113.003168
Förstner, W., and Moonen, B. (1999). “A metric for covariance matrices,” in Quo Vadis Geodesia…? eds F. Krumm and V. S. Schwarze (Stuttgart: TR Dept. of Geodesy and Geoinformatics, Stuttgart University), 113–128.
Fugl-Meyer, A. R., Jaasko, L., Leyman, I., Olsson, S., and Steglind, S. (1975). The post-stroke hemiplegic patient. 1. A method for evaluation of physical performance. Scand. J. Rehabil. Med. 7, 13–31.
Hétu, S., Grégoire, M., Saimpont, A., Coll, M. P., Eugène, F., Michon, P. E., et al. (2013). The neural network of motor imagery: an ALE meta-analysis. Neurosci. Biobehav. Rev. 37, 930–949. doi: 10.1016/j.neubiorev.2013.03.017
Jaillard, A., Martin, C. D., Garambois, K., and Franc, J. (2005). Vicarious function within the human primary motor cortex? A longitudinal fmri stroke study. Brain 128, 1122–1138. doi: 10.1093/brain/awh456
Jong, S. L., Han, M. K., Sung, H. K., Kwon, O. K., and Jae, H. K. (2005). Fiber tracking by diffusion tensor imaging in corticospinal tract stroke: topographical correlation with clinical symptoms. NeuroImage 26, 771–776. doi: 10.1016/j.neuroimage.2005.02.036
Liew, S.-L., Rana, M., Cornelsen, S., de Barros Filho, M. F., Birbaumer, N., Sitaram, R., et al. (2016). Improving motor corticothalamic communication after stroke using real-time fMRI connectivity-based neurofeedback. Neurorehabil. Neural Repair 30, 671–675. doi: 10.1177/1545968315619699
Lioi, G., Fleury, M., Butet, S., Lécuyer, A., Barillot, C., and Bonan, I. (2018). Bimodal EEG-fMRI neurofeedback for stroke rehabilitation: a case report. Ann. Phys. Rehabil. Med. 61, e482–e483. doi: 10.1016/j.rehab.2018.05.1127
Mano, M., Lécuyer, A., Bannier, E., Perronnet, L., Noorzadeh, S., and Barillot, C. (2017). How to build a hybrid neurofeedback platform combining EEG and fMRI. Front. Neurosci. 11:140. doi: 10.3389/fnins.2017.00140
Mehler, D. M. A., Williams, A. N., Krause, F., Lührs, M., Wise, R. G., Turner, D. L., et al. (2019). The BOLD response in primary motor cortex and supplementary motor area during kinesthetic motor imagery based graded fMRI neurofeedback. NeuroImage 184, 36–44. doi: 10.1016/j.neuroimage.2018.09.007
Mihara, M., Hattori, N., Hatakenaka, M., Yagura, H., Kawano, T., and Miyai, I. (2013). Near-infrared spectroscopy-mediated neurofeedback enhances efficacy of motor imagery-based training in poststroke victims A pilot study. Stroke 44, 1091–1098. doi: 10.1161/STROKEAHA.111.674507
Page, S. J., Fulk, G. D., and Boyne, P. (2012). Clinically important differences for the upper-extremity fugl-meyer scale in people with minimal to moderate impairment due to chronic stroke. Phys. Ther. 92, 791–798. doi: 10.2522/ptj.20110009
Perronnet, L., Anatole, L., Mano, M., Bannier, E., Clerc, M., Barillot, C., et al. (2017). Unimodal versus bimodal EEG-fMRI neurofeedback of a motor imagery task. Front. Hum. Neurosci. 11:193. doi: 10.3389/fnhum.2017.00193
Pfurtscheller, G., and Lopes da Silva, F. H. (1999). Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110, 1842–1857. doi: 10.1016/s1388-2457(99)00141-8
Pichiorri, F., Morone, G., Petti, M., Toppi, J., Pisotta, I., Molinari, M., et al. (2015). Brain-computer interface boosts motor imagery practice during stroke recovery. Ann. Neurol. 77, 851–865. doi: 10.1002/ana.24390
Plow, E., Dunningham, D., Varnerin, N., and Machado, A. G. (2015). Rethinking stimulation of the brain in stroke rehabilitation: why higher motor areas might be better alternatives for patients with greater impairments. Neuroscientist 21, 225–240. doi: 10.1177/1073858414537381
Ramoser, H., Müller-Gerking, J., and Pfurtscheller, G. (2000). Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Trans. Rehabil. Eng. 8, 441–446. doi: 10.1109/86.895946
Sitaram, R., Ros, T., Stoeckel, L., Haller, S., Scharnowski, F., Lewis-Peacock, J., et al. (2017). Closed-loop brain training: the science of neurofeedback. Nat. Rev. Neurosci. 18, 86–100. doi: 10.1038/nrn.2016.164
Sitaram, R., Veit, R., Stevens, B., Caria, A., Gerloff, C., Birbaumer, N., et al. (2012). Acquired control of ventral premotor cortex activity by feedback training: an exploratory real-time fMRI and TMS study. Neurorehabil. Neural Repair 26, 256–265. doi: 10.1177/1545968311418345
Solodkin, A., Hlustik, P., Chen, E. E., and Small, S. L. (2004). Fine modulation in network activation during motor execution and motor imagery. Cereb. Cortex 14, 1246–1255. doi: 10.1093/cercor/bhh086
Sorger, B., Kamp, T., Weiskopf, N., Peters, J. C., and Goebel, R. (2018). When the brain takes ‘BOLD’ steps: real-time fmri neurofeedback can further enhance the ability to gradually self-regulate regional brain activation. Neuroscience 378, 71–88. doi: 10.1016/j.neuroscience.2016.09.026
Stinear, C. M., Barber, P. A., Petoe, M., Anwar, S., and Byblow, W. D. (2012). The PREP algorithm predicts potential for upper limb recovery after stroke. Brain 135, 2527–2535. doi: 10.1093/brain/aws146
Stinear, C. M., Barber, P. A., Smale, P. R., Coxon, J. P., Fleming, M. K., and Byblow, W. D. (2007). Functional potential in chronic stroke patients depends on corticospinal tract integrity. Brain 130, 170–180. doi: 10.1093/brain/awl333
Woodbury, M. L., Velozo, C. A., Richards, L. G., and Duncan, P. W. (2013). Rasch analysis staging methodology to classify upper extremity movement impairment after stroke. Arch. Phys. Med. Rehabil. 94, 1527–1533. doi: 10.1016/j.apmr.2013.03.007
Wu, X., Wu, T., Zhan, Z., Yao, L., and Wen, X. (2016). A real-time method to reduce ballistocardiogram artifacts from eeg during fmri based on optimal basis sets (OBS). Comput. Methods Programs Biomed. 127, 114–125. doi: 10.1016/j.cmpb.2016.01.018
Zich, C., Debener, S., Kranczioch, C., Bleichner, M. G., Gutberlet, I., and De Vos, M. (2015). Real-time EEG feedback during simultaneous EEG-fMRI identifies the cortical signature of motor imagery. NeuroImage 114, 438–447. doi: 10.1016/j.neuroimage.2015.04.020
Zich, C., Debener, S., Schweinitz, C., Sterr, A., Meekes, J., and Kranczioch, C. (2017). High intensity chronic stroke motor imagery neurofeedback training at home: three case reports. Clin. EEG Neurosci. 48, 403–412. doi: 10.1177/1550059417717398
Keywords: neurofeedback, fMRI, EEG, stroke, rehabilitation, multimodal neuroimaging
Citation: Lioi G, Butet S, Fleury M, Bannier E, Lécuyer A, Bonan I and Barillot C (2020) A Multi-Target Motor Imagery Training Using Bimodal EEG-fMRI Neurofeedback: A Pilot Study in Chronic Stroke Patients. Front. Hum. Neurosci. 14:37. doi: 10.3389/fnhum.2020.00037
Received: 11 September 2019; Accepted: 27 January 2020;
Published: 18 February 2020.
Edited by:Michal Ramot, National Institute of Mental Health (NIMH), United States
Reviewed by:Anna Seydell-Greenwald, Georgetown University Medical Center, United States
David M. A. Mehler, University of Münster, Germany
Copyright © 2020 Lioi, Butet, Fleury, Bannier, Lécuyer, Bonan and Barillot. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Giulia Lioi, email@example.com