BCI-FES With Multimodal Feedback for Motor Recovery Poststroke
Alexander B. Remsik1,2,3* 
Peter L. E. van Kan3,4 
Shawna Gloe1 Klevest Gjini1,5 
Leroy Williams Jr.1,6 Veena Nair1 Kristin Caldera7 
Justin C. Williams8,9 
Vivek Prabhakaran1,4,5,10,11,12- 1Department of Radiology, University of Wisconsin–Madison, Madison, WI, United States
- 2School of Medicine and Public Health, Institute for Clinical and Translational Research, University of Wisconsin–Madison, Madison, WI, United States
- 3Department of Kinesiology, University of Wisconsin–Madison, Madison, WI, United States
- 4Neuroscience Training Program, University of Wisconsin–Madison, Madison, WI, United States
- 5Department of Neurology, University of Wisconsin–Madison, Madison, WI, United States
- 6Department of Educational Psychology, University of Wisconsin–Madison, Madison, WI, United States
- 7Department of Orthopedics and Rehabilitation, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
- 8Department of Biomedical Engineering, University of Wisconsin–Madison, Madison, WI, United States
- 9Department of Neurological Surgery, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
- 10Department of Psychiatry, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
- 11Medical Scientist Training Program, School of Medicine and Public Health, University of Wisconsin–Madison, Madison, WI, United States
- 12Department of Psychology, University of Wisconsin–Madison, Madison, WI, United States
An increasing number of research teams are investigating the efficacy of brain-computer interface (BCI)-mediated interventions for promoting motor recovery following stroke. A growing body of evidence suggests that of the various BCI designs, most effective are those that deliver functional electrical stimulation (FES) of upper extremity (UE) muscles contingent on movement intent. More specifically, BCI-FES interventions utilize algorithms that isolate motor signals—user-generated intent-to-move neural activity recorded from cerebral cortical motor areas—to drive electrical stimulation of individual muscles or muscle synergies. BCI-FES interventions aim to recover sensorimotor function of an impaired extremity by facilitating and/or inducing long-term motor learning-related neuroplastic changes in appropriate control circuitry. We developed a non-invasive, electroencephalogram (EEG)-based BCI-FES system that delivers closed-loop neural activity-triggered electrical stimulation of targeted distal muscles while providing the user with multimodal sensory feedback. This BCI-FES system consists of three components: (1) EEG acquisition and signal processing to extract real-time volitional and task-dependent neural command signals from cerebral cortical motor areas, (2) FES of muscles of the impaired hand contingent on the motor cortical neural command signals, and (3) multimodal sensory feedback associated with performance of the behavioral task, including visual information, linked activation of somatosensory afferents through intact sensorimotor circuits, and electro-tactile stimulation of the tongue. In this report, we describe device parameters and intervention protocols of our BCI-FES system which, combined with standard physical rehabilitation approaches, has proven efficacious in treating UE motor impairment in stroke survivors, regardless of level of impairment and chronicity.
Introduction
Stroke is most often caused by a reduction or interruption of blood supply to parts of the brain resulting in sustained damage, which may produce a variety of symptoms including weakness or paralysis of an extremity. Each year, ~795,000 people experience a new or recurrent stroke in the United States (Virani et al., 2020). Approximately 610,000 of these are first attacks, and 185,000 are recurrent attacks, making stroke a leading cause of serious long-term acquired disability in the United States. Potential recovery from stroke follows an important initial timeline as recovery potential decreases the more time passes since the initial stroke. Spontaneous recovery may occur; however, natural recovery and recovery potential plateau, leaving some stroke survivors with a lifetime need for care.
Stroke-related economic burden is immense and increasing at a rapid rate. In 2014–2015, the direct and indirect cost of stroke in the United States totaled $45.5 billion (Virani et al., 2020). The estimated direct cost of stroke was $28 billion and indirect cost (lost future productivity) $17.5 billion (Virani et al., 2020). Between 2015 and 2035, total direct medical stroke-related costs are projected to increase significantly, to $94.3 billion, with much of the projected increase in costs arising from those >80 years of age (Virani et al., 2020). Stroke-related costs, therefore, are disproportionally associated with long-term care and rehabilitation. Paradoxically, long-term stroke rehabilitation is disproportionately difficult to obtain as most healthcare payers cover only a limited number of rehabilitation visits, leaving an unmet need for affordable care options beyond the standard clinical care window for patients living with acquired motor disabilities. Therefore, an urgent need exists to reduce cost of care, improve efficacy of existing poststroke rehabilitative therapies, and develop novel therapeutic approaches so as to offer stroke survivors more cost-effective and better treatment outcomes and increased functional independence.
Conventional stroke rehabilitation approaches are interdisciplinary in nature. Dominated by physical therapy (PT), often provided in combination with occupational and speech therapies, and constraint-induced movement therapy (CIMT) (Fleet et al., 2014; Kwakkel et al., 2015), the main aim of traditional therapeutic approaches is recovery of speech and improved functional use of impaired extremities in an effort to facilitate activities of daily living (ADLs) and foster survivors' functional independence, thereby enhancing quality of life. Strong evidence exists that rehabilitation approaches that promote intense, highly repetitive active functional use of the impaired limb result in the largest therapeutic benefits (Pollock et al., 2014; Veerbeek et al., 2014). Gains in movement capability that result from physical exercise, however, are mostly task-specific and restricted to the trained functions and activities. Moreover, participation in active movement training and CIMT requires sufficient residual motor capabilities, which precludes participation of severely impaired individuals, especially during the time-critical, early phases poststroke.
Clinical interest in new therapeutic approaches in which physical exercise is combined with innovative, BCI-based treatments that may induce and/or facilitate experience-dependent brain plasticity, such as transcranial direct current stimulation (tDCS) (Lindenberg et al., 2010), transcranial magnetic stimulation (TMS) (Smith and Stinear, 2016), robot-aided therapy (Babaiasl et al., 2016; Baniqued et al., 2021), virtual reality (VR) (Laver et al., 2015; Johnson et al., 2018), and other BCI-mediated interventions is growing rapidly [for recent reviews, please see (Bockbrader et al., 2018; Bai et al., 2020; Simon et al., 2021)]. BCI-mediated interventions offer the unique potential to rehabilitate motor dysfunction following brain injury, such as stroke, regardless of level of impairment or time since the injury occurred. For example, some stroke survivors retain the capability to attempt movements with their impaired extremity during all phases poststroke and, therefore, it may be prudent to guide BCI-mediated rehabilitation toward adaptive neuroplastic changes associated with BCI-induced restoration of functional capacities rather than improved physical abilities. Importantly, BCI-based treatments allow rehabilitation of stroke survivors to commence during crucial (early) time windows poststroke and would provide alternatives for more severely impaired individuals or those who have not yet regained any overt movement capacity and, therefore, are not able to benefit from traditional PT.
Despite recommendations from the 2009 workshop sponsored by the NIH Blueprint for Neuroscience Research that heralded the translation of neuroplasticity as key to developing guidelines for innovative, effective clinical therapies in rehabilitation (Cramer et al., 2011), widespread adoption of BCI-mediated therapeutic approaches clinically has not (yet) been realized, in part because of insufficient evidence supporting their effectiveness, and in part because of practical, technological, and mechanistic factors, including high equipment costs, limited portability of equipment and the need for extensive expert supervision (Baniqued et al., 2021; Simon et al., 2021). In order for more widespread use clinically, BCI-mediated interventions must not only provide high quality rehabilitation, but they must also be evidence-based, cost-effective, user-friendly, and they must be able to actively engage both patients and caregivers while, ultimately, be adaptable for home use (Remsik et al., 2016; Simon et al., 2021).
With regard to the above list of requirements for wide-spread adoption of BCI-mediated therapeutic approaches, recent meta-analyses and reviews have highlighted EEG-based BCIs as most promising in the rehabilitation of stroke survivors (Cervera et al., 2018; Bai et al., 2020; Simon et al., 2021). Moreover, BCI paradigms utilizing FES and/or attempted voluntary movements of the impaired extremity are most effective in the rehabilitation of upper extremity (UE) motor function poststroke (Ackerley et al., 2007, 2011, 2014; Ramos-Murguialday et al., 2013; Jang et al., 2016; Biasiucci et al., 2018; Cervera et al., 2018; Nishimoto et al., 2018; Remsik et al., 2018; Tabernig et al., 2018; Bai et al., 2020) because they may induce and/or facilitate neuroplastic changes that directly link movement intent with muscle contraction (Pundik et al., 2015; Bai et al., 2020; Simon et al., 2021).
Closed-loop, EEG-based BCIs employ multimodal sensory feedback in order to provide a non-invasive neural interface that is used therapeutically to substitute or augment native neuromuscular outputs by translating user-controlled neural activity into functionally relevant and therapeutically viable command signals. More specifically, user-generated unique and measurable modulations in sensorimotor rhythms (SMRs) (i.e., event-related synchronization, ERS and/or event-related desynchronization, ERD), extracted from EEG activity associated with movement intent during voluntary real, attempted, and/or imagined movements (Wilson et al., 2009; Nam et al., 2011) are translated into external command signals which, in turn, are used to control movement of a virtual cursor (e.g., ball) on a screen (Wolpaw et al., 1991; Schalk et al., 2004, 2008; Wilson et al., 2009) or functional electrical stimulation (FES) of specifically targeted muscles or muscle synergies (De Marchis et al., 2016). Furthermore, by monitoring multimodal sensory feedback (e.g., vision of the ball on the screen, somatosensory feedback associated with FES-induced movements, etc.), BCI users are able to learn through consequence how to adjust modulations in their SMRs to improve and fine-tune command signals.
In this report, we present device parameters and intervention protocols of our closed-loop, EEG-based BCI-FES system which, combined with standard physical rehabilitation approaches, has been validated and proven efficacious in the rehabilitation of UE motor function poststroke in our ongoing cross-over controlled clinical trial (ClinicalTrials.gov study ID NCT02098265) (Young et al., 2014a, 2015; Remsik et al., 2018, 2019, 2021). This BCI-FES system elicits positive changes in the primary outcome measure (ARAT score: Arm Reach Action Test) (Lyle, 1981) as well as beneficial physiological changes in secondary outcome measures of neural activity (e.g., Mu ERD) (Remsik et al., 2018, 2019, 2021). The system's efficacy relies on specific targeting of neuromuscular activity contingent on intent-to-move neural signals, recorded with scalp electrodes overlying cerebral cortical sensorimotor areas (Figure 1), as well as concurrent delivery of multimodal sensory feedback through implementation of a chain of straightforward operating procedures described in this report. The scalp EEG signals provide an efficient and practical way to extract, in real-time, the relevant control features, and to deliver the desired feedback to the patients as part of an interactive and closed-loop neural activity-triggered application. We also present illustrative intervention data from three stroke survivors for the purpose of illustrating the utility of this BCI-FES design in rehabilitation at various levels of impairment and chronicity. The present BCI-FES protocol, integrated with standard rehabilitation approaches, may provide a substantial improvement toward sensorimotor functional recovery of the impaired extremity in stroke survivors (Remsik et al., 2018, 2019, 2021).
Figure 1. EEG electrode arrangement. International 10-20 electrode array. Yellow circle denotes ground, blue circle denotes reference electrode (on the right ear), green circles denote electrodes used from the array by the BCI.
Materials and Equipment
The Multimodal BCI-FES
A conventional EEG-based BCI system presents the user with a visual display that represents modulation in SMRs related to movement intent (Pfurtscheller and Berghold, 1989; Wolpaw et al., 1991; Pfurtscheller and Lopes da Silva, 1999; Leuthardt et al., 2004; Schalk et al., 2004; Pfurtscheller et al., 2005; Daly and Wolpaw, 2008; Young et al., 2014). The BCI-FES system design presented here extends this standard paradigm by presenting the user with a virtual environment in which goal-directed motor learning is reinforced explicitly. The BCI-FES design also allows for FES-induced UE movement facilitation contingent on the cerebral cortical motor signals associated with movement intent, and for multimodal sensory feedback (e.g., visual, electro-tactile, and somatosensory) (Figures 2, 3).
Figure 2. BCI setup and task block design. (A) Participant set up with BCI interface for open-loop trials. Setup includes monitor, EEG cap, and amplifier. (B) Session and block design: Every session starts with an open-loop condition, followed by the intervention (closed-loop) condition which is followed by a repeat of the open-loop condition. Open-Loop, Participants are notified that the run will begin. First the cue appears on the screen with corresponding auditory instruction for the open-loop screening condition; Closed-loop, The target appears on one side of the monitor, followed by the cursor ball in the closed-loop. Once the participant guides the ball into the target, the trial is complete.
Figure 3. Intervention Setup and Cursor Ball Display. (A) Cursor appears in the middle of the screen following target presentation on one side or the other. The target is represented by the blue strip on one side of the monitor. EEG cap, FES box, FES electrodes, and TDU box are labeled to show device setup. (B) Cursor ball moves toward the target as cued by EEG-recorded intent-to-move brain signals. If the target is not hit in the maximum time allowed (e.g., 2.5–5 s) the trial is aborted. If the user moves the cursor into the target, the trial is a success. There are 10 trials in one run. Following 10 runs of visual stimulus only, FES is added, and 10 trials of BCI+FES later, the TDU adjuvant is included.
EEG Cap Configuration & Signal Acquisition
EEG electrodes are positioned on the scalp according to the standard 10–20 system, grounded to Fpz, and referenced to an electrode placed on the back of the participant's right ear. Signals from the C3, C4, and Cz electrodes, overlying the sensorimotor cortices, are recorded in every session and are used to drive horizontal cursor movement (Schalk et al., 2004, 2008; Wilson et al., 2009) (Figure 3). EEG activity is recorded from 16 locations with sintered Ag/AgCl active electrodes using a sensor cap attached to a 16-channel bipolar recording system (g.LADYbird-g.GAMMAcap, Guger Technologies, Graz, Austria) (Figure 1). Electrode signals are amplified (g.USBamp, Guger Technologies, Graz, Austria) and digitized by 16 independent 24-bit A/D converters at 38.4 kHz per channel. EEG activity is sampled at 256 Hz, using a 0.1–100 Hz band-pass filter, and a 58–62 Hz notch filter.
Signal Processing
Signal acquisition, online signal processing, and behavioral task (cursor movement and virtual targets) are controlled using custom software developed on the BCI2000 platform (Schalk et al., 2004). Following basic filtering, the signal enters into a spectral estimator which computes a continually updated estimate of the spectrum of its input data. For each updated computation, the module uses a 0.5 s window of past data and applies an autoregressive (AR) algorithm to estimate spectral amplitude. The AR algorithm computes an autoregressive model of its input data using the maximum entropy method (Marple and Carey, 1989) and outputs an estimated power spectrum collected into bins. Bins are of 2 Hz width each with the center of the first bin being 0 Hz and the center of the last bin being 40 Hz. This results in 21 bins, with the first bin covering the DC range −1 to +1 Hz (which due to symmetry of the transfer function is twice the integral from 0 to 1 Hz) and the last bin covering 39–41 Hz.
Results of the spectral estimator are used in a linear classifier through a process of feature extraction and translation. The linear classifier computes a projection of a high-dimensional signal feature into a low-dimensional classification space. In our implementation, spectrum amplitudes from C3, and C4 at both 8 and 18 Hz, are translated into the one dimension of the classification space. The classifier output enters a normalization transformation of the form: output = (input - o)g, in which “o” is the normalizer offset value, and “g” is the normalizer gain. Adjusting the offsets for bias of cursor movement in the right or left direction, and gain, controls the speed at which the cursor moves. In essence, the classifier output undergoes a normalization transformation, and is then used as a control signal that specifies one-dimensional horizontal cursor movement in the user application module (Wilson et al., 2009).
User Application (Visual Presentation)
Following normalization, the control signal is passed to the user application. Throughout the BCI design the user-generated modulation in SMRs is time-locked to the FES and/or output of the tongue-display unit (TDU) (Kaczmarek, 2011; Wilson et al., 2012) and the visual display presentation. Recognition of attempted right-hand and left-hand movements results in concordant horizontal cursor movement in right and left directions, respectively (Wilson et al., 2009). Cursor and TDU parameters may be updated once per block of data acquisition. Data is acquired at 256 Hz, and 12 samples compose a single block. This means that the user application is updated at a frequency of 21.3 Hz or every 46.8 ms.
Functional Electrical Stimulation (FES)
FES of the UE (Popovic et al., 2002a,b, 2004; Peckham and Knutson, 2005; Ragnarsson, 2008; Page et al., 2009; Takahashi et al., 2012; Howlett et al., 2015; McCabe et al., 2015; Vafadar et al., 2015; De Marchis et al., 2016; Jang et al., 2016; Kim et al., 2016; Biasiucci et al., 2018; Tabernig et al., 2018; Annetta et al., 2019; Wilson et al., 2019), an established means for treating neuromuscular treatment following central nervous system (CNS) injury, is delivered in this design through a pair of square electrodes up to 2″ × 2″ in size (Figure 3), placed securely on the affected forearm using highly conductive electrolyte spray. Stimuli are produced by a LG-7500 Digital muscle Stimulator (LGMedSupply, Cherry Hill, NJ, USA). Commercially available stimulus isolation units ensure clean, opto-electrical isolation. The FES electrodes are placed superficial to the flexor digitorum superficialis muscle in order to facilitate repeated whole-hand grasping (i.e., hand and finger flexion) or superficial to extensor digitorum communis in order to facilitate repeated whole-hand opening (i.e., hand and finger extension), according to participant preference at individual BCI-FES sessions. The FES is computer-controlled using an Arduino Uno R3 microcontroller board (Adafruit Industries, New York, NY, USA) and a simple reed relay circuit. FES amplitude is set to elicit observable muscle contractions (e.g., whole-hand grasping or extension) without pain to the user. The pulse rate of the stimulation is 60 Hz, in order to produce tetanic contraction of the muscles, and the pulse width is 150 μs. Stimulation intensity is initially set to zero and is adjusted in steps of 0.5 mA, unless the stimulation becomes uncomfortable for the participant. In the event of discomfort, the stimulation intensity is returned to the nearest previous level not producing discomfort. The device is never set to deliver an output >50 mA.
Tongue-Display Unit (TDU)
The TDU (Figure 3A), has been described in detail previously (Kaczmarek, 2011; Wilson et al., 2012). The TDU is battery-operated and generates patterned, low-voltage stimulation to a 12 × 12 electrode array that is positioned on the anterior dorsal portion of the participant's tongue (Kaczmarek, 2011; Wilson et al., 2012). Similar to the FES, the TDU intensity is set, prior to any trials, to the highest level of intensity not producing discomfort in the participant. The TDU electrode grid supplements the visual cursor and target task; it aids participants with potential visual field impairments (Bach-y-Rita, 2004). When the target appears on either the left or right side of the display screen, the TDU electrode array is activated concurrently and concordantly. The stimulation persists on the side of the tongue according to target location until the user successfully drives the virtual cursor into the target area (Figure 3B). In the event of a successful attempt (i.e., cursor enters target area), the entire electrode array is activated until the trial times out. In the event of an unsuccessful attempt, in which the user is unable to drive the cursor into the target area before the trial time expires, the TDU ceases to deliver stimulation to the side of the tongue corresponding to the side of the screen where the target was presented.
Stimulation intensity may be adjusted after each run to ensure that the subject is able to perceive the stimulation and correctly interpret the target presentation without discomfort. All stimuli are presented within the participant's preferred stimulus intensity range, from sensation threshold to below maximum level, without discomfort. In case the stimulus-evoked sensation becomes aversive, stimulus intensity is reduced, or the stimulus array is removed from the subject's mouth. No data are available on the effects of long-term electro-tactile stimulation of the tongue; however, the study group has neither observed, nor reported any tissue irritation following tongue stimulation from over 200 subjects tested over a 10-year period (conducted under previous UW-Madison HS-IRB Protocols 2000-0119, 2000-0527, 2001-364, 2004-375, 2005-0187, 2005-0192, and 2007-0251).
Multimodal BCI-FES Intervention
Task Schedule
The BCI tasks (Figures 2, 3) consists of an open-loop (Li et al., 2014) task and two closed-loop tasks (i.e., BCI with visual feedback only, and BCI with visual feedback & electro-tactile stimulation). The general difference between the open- and closed-loop tasks is the absence or presence, respectively, of SMR-driven feedback to the participant in the form of movement of a virtual cursor on the display screen toward a target or goal area (Schalk et al., 2008; Wilson et al., 2009) and associated electro-tactile sensory feedback. Such feedback is understood to aid participants in learning to control SMR modulation and successfully perform the task. As no feedback is given during the open-loop task, no learning is expected to occur during that condition. The open-loop task is designed as an initial assessment to establish, and train, the optimal SMR features that the participant will use to control the behavior of the SMR-driven feedback (i.e., the cursor/ball) during the closed-loop tasks.
Familiarization With the BCI Device and Procedures
The first BCI session aims to introduce the participant to the BCI device and protocol. During this initial session, the EEG cap, FES device, and TDU device are administered as described above. Stroke survivors may present with a myriad of cognitive, affective, and physical impairments (Tsao et al., 2022) and out of respect for individual participants' needs and abilities, the researchers may allow a few runs of each BCI task condition for the purpose of introducing participants to the task requirements and feedback sensations. During these preliminary sessions, the study protocol will be faithfully administered as described. Subsequent runs in all sessions aim for all BCI task conditions to be performed consistent with protocol demands.
Participant Criteria
Participants are individuals with motor impairments due to stroke, regardless of stroke severity, stroke chronicity (i.e., time since injury), or gender. The effectiveness of the present BCI-FES intervention in the rehabilitation of motor impairments poststroke has been validated as part of on-going clinical trial NCT02098265, in which stroke survivors participated in 9–15 BCI-FES intervention sessions (2–3 sessions per week) lasting up to 2 h, for a maximum of 30 h of intervention. Participants also contributed to behavioral testing prior to the first BCI session (i.e., Pre), at the midpoint of intervention (i.e., Mid), immediately following the last intervention session (i.e., Post), and at a 1-month, post-intervention follow-up (i.e., Follow-up) (Table 1).
Table 1. Motor capacity at baseline (Pre), middle of intervention (Mid), at completion of intervention (Post), one month after completion of intervention (Follow-up), and calculations of change from baseline to the two endpoints, Post and Follow-up, respectively.
Methods
Setup
The EEG cap must be positioned on the user's scalp such that the electrode locations correspond with those specified by the 10–20 international system (Figure 1). All 16 electrodes used must record electrophysiological signals with optimal signal-to-noise ratios (Wilson et al., 2009).
Protocol
Open-Loop Screening Task
A session begins with an open-loop hand movement assessment task, in which no performance feedback is given. The first two runs of the pre-intervention screening phase incorporate “actual, attempted” hand movements (Ackerley et al., 2011, 2014) in response to written cues displayed on the computer screen, and corresponding verbal instructions (i.e., Left, Right, Rest) (Figure 2). The last two runs of the pre-intervention screening phase incorporate “imagined” hand movements in response to the same written cues and corresponding verbal instructions (Figure 2). To accommodate initial movement capacity and the nature of each participant's motor impairment, participants are instructed to execute hand movements according to their individual treatment goals and physical capabilities but are instructed to execute repeated hand grasping motions in either hand when cued. Each screening EEG data file contains 15 trials of rest, left-hand and right-hand movements (i.e., five trials for each of the three conditions), separated by an interstimulus interval of 1.5–2 s. The order of trials in a run is random. Each of the trials has a duration of 4 s (Remsik et al., 2018, 2019). Coefficients of determination (r-squared) are calculated in order to evaluate the spectral difference at each frequency bin between the attempted left- and right-hand movement conditions. Finally, control features are selected as the left and right channel-frequency pairs (i.e., C3–Cz & C4–Cz electrodes as shown in Figure 1) for both the Mu (8–12 Hz) and Beta (18–26 Hz) frequency bands.
EEG Calibration
Data recorded during the initial screening task may be analyzed using BCI2000's Offline Analysis MATLAB-based tool in order to determine the optimal SMR features for online control of the subsequent closed-loop tasks (Schalk et al., 2004; Wilson et al., 2009; Schalk and Mellinger, 2010). The channels and frequency bands chosen should be consistent with known properties of cortical SMRs associated with attempted hand movements (i.e., locations and frequencies consistent with the contralateral cerebral cortical motor areas and the corresponding electrodes (e.g., C3, C4), and centered near the Mu (8–12 Hz), and Beta (18–26 Hz) frequency bands (Pfurtscheller and Berghold, 1989; Wolpaw et al., 1991, 2002; Pfurtscheller et al., 1997; Pfurtscheller, 1999; Pfurtscheller and Lopes da Silva, 1999; McFarland et al., 2000; Neuper and Pfurtscheller, 2001; Schalk et al., 2004, 2008; Neuper et al., 2005, 2006; Daly and Wolpaw, 2008; Ackerley et al., 2011, 2014). Control features may be standardized across subjects (i.e., 8 and 22 Hz) or optimized for each individual participant at each session. This procedure is designed to determine the features that optimize subject-specific signals that are used to drive the cursor movement and deliver concurrent FES to the stroke-impaired musculature. Although selected control features may differ between participants, the common underlying principles are that the features selected are overlying sensorimotor cortices, and that they are in the expected physiological range of motor output (i.e., ~6–30 Hz) so as to ensure they represent user-driven motor signals associated with movement intent.
Closed-Loop Cursor & Target Task
The control features are translated into feedback (i.e., ball/cursor movement) of the subsequent BCI tasks as described by Schalk and Mellinger (Schalk et al., 2004; Schalk and Mellinger, 2010). An autoregressive spectral analysis (Marple and Carey, 1989) first estimates the spectral power of the control features. The resulting control feature signals are then put into a classification algorithm that performs a linear transformation of these signals, which are translated into the feedback behavior of the cursor on the screen, the FES adjuvant, and the TDU stimulation. The prevailing logic is that the strongest SMR features [within the prespecified Mu (8–12 Hz) and Beta (18–26 Hz) frequency bands (Pfurtscheller and Berghold, 1989; Wolpaw et al., 1991; Pfurtscheller et al., 1997; Pfurtscheller, 1999; Pfurtscheller and Lopes da Silva, 1999; McFarland et al., 2000; Neuper and Pfurtscheller, 2001; Neuper et al., 2006; Ackerley et al., 2011; Babiloni et al., 2016)] of attempted movement define the control features used for each participant in the subsequent closed-loop (i.e., Cursor Task) condition (Wilson et al., 2009).
Visual Feedback Only
The first ten runs of the closed-loop BCI task condition present the user with visual feedback of their modulated SMR features through a virtual ball-and-target game (i.e., closed-loop Cursor Task) (Figures 2, 3). During this task, users perform the same type of repeated attempted hand movements as in the screening task described in Open-Loop Screening Task (above). Participants learn to control the movement of the virtual ball (i.e., cursor) displayed on the computer screen by modulating their SMR activity as they perform the task. The SMR activity, related to attempted left- or right-hand movements, are translated into leftward (or rightward) ball movement (Figures 3A,B). At the start of each trial, the participant is instructed to look at the center of the blank screen. Two seconds later, a virtual target appears randomly on the left or right side of the screen. After the target is displayed for 2 s, the cursor (ball) appears in the center of the screen and the participant is instructed to move the ball toward the target by eliciting SMR modulation using attempted repeated hand movements, as described in Open-Loop Screening Task. For a trial to be considered successful, the ball must hit the target within 2.5–5 s of its appearance. If the attempt is successful, the target appears to illuminate and maintains this “reward” presentation for 0.5 s (Figure 3). If the trial is unsuccessful after the maximum time allowed (5 s), the cursor and target disappear within the subsequent 0.5 s interval. Immediately following task completion (hit or miss), an intertrial interval of 4 s commences and the presentation sequence is repeated. Each run consists of 10 trials.
Adjuvant Stimulus Administration
Following 10 completed runs (i.e., 100 trials) with visual feedback only, FES and TDU (tongue-display unit) (Kaczmarek, 2011; Wilson et al., 2012) are incorporated (Figures 3A,B). Driven by the modulation in SMRs generated by engagement with the virtual ball-and-target task, FES is applied to the targeted muscles of the impaired hand and electro-tactile feedback is presented through the TDU. In this way, participants can incorporate visual, electro-tactile, and proprioceptive feedback, when possible, associated with muscle activation for the purpose of modulation and monitoring of volitional movements. The ensemble of multimodal feedback serves as adjuvant stimulus to engage paretic musculature and somato-motor circuitry in improved, more natural execution of the motor plan (e.g., attempted voluntary hand flexion) and to provide enhanced multimodal performance feedback to the user. The modulation of SMR activity needed to perform the task well directly links movement intent to the facilitated muscle contraction. Rewarding this linkage via the cursor-and-target task is hypothesized to facilitate motor learning and potential recovery (Bach-y-Rita, 1981, 1990; Nudo et al., 1996, 2001; Nudo, 1999, 2003a,b, 2011, 2015; Nudo and Friel, 1999; Kleim et al., 2002; Schaechter et al., 2002; Rossini and Dal Forno, 2004a,b; Plautz and Nudo, 2005; Strangman et al., 2005; Cramer and Riley, 2008; Jayaram and Stinear, 2008; Murphy and Corbett, 2009; Popovic et al., 2009; Wang et al., 2010; Ackerley et al., 2011; Cramer et al., 2011; Dimyan and Cohen, 2011; Pekna et al., 2012; Takeuchi and Izumi, 2012a,b, 2013; Wolpaw, 2012; Jiang et al., 2013; Soekadar et al., 2014; Volz et al., 2014; Reinkensmeyer et al., 2016; Biasiucci et al., 2018; Mohanty et al., 2018). BCI-driven FES is only applied to muscles of the impaired limb and is delivered only and concurrently with cursor movement toward the targeted side in order to ensure that muscle stimulation never occurs while participants attempt to move the ball toward their unimpaired side.
Functional Electrical Stimulation
Following 10 complete runs of BCI (visual only feedback), BCI+FES trials are initiated (Figures 2, 3A,B). FES settings are adjusted at a safe and effective intensity level as described above. The appropriate muscle(s) for targeted stimulation is (are) identified and electrodes are attached accordingly. The aim is to elicit motor responses in the impaired hand that reflect whole-hand flexion or extension. If some fingers are moving more than others, the electrodes are repositioned until fingers open/close evenly when stimulated manually. With help of the participant, the appropriate level of stimulation is established that is both comfortable for the participant and produces recognizable grasping movement of the impaired hand as described in Open-Loop Screening Task.
Tongue Display Unit (TDU)
Following 10 complete BCI+FES runs, BCI+FES+TDU runs are initiated (Figure 3).
Open-Loop Exit Screening Task
Sessions end with a repetition of the open-loop screening task as described above and in Figure 2.
Minimizing Risks
Subjects are under supervision at all times during the experiments and are easily able to communicate discomfort or a need for respite. The preferred stimulus intensity range for FES is determined by beginning with low amplitude stimulation and gradually increasing the amplitude until the participant demonstrates a motor response or indicates that their maximal comfort level has been reached, as described previously. The amplitude threshold for eliciting a motor response generally occurs well below the amplitude threshold for stimulation discomfort. The preferred range of tongue stimulation intensity is similarly specified, but rather than looking for a motor response, the maximal range is that which provides a clear sensory percept without producing discomfort in the participant. Stimulus intensity range is determined by beginning with low-amplitude stimulation and gradually increasing the amplitude until the participant indicates their maximal comfort amplitude has been reached, as described previously. It is imperative that one listens to and engages with participants to meet their needs and maintain honorable adherence to essential principles of care such as respect for individual persons, beneficence, and justice.
Results
Clinical efficacy of the present BCI-FES intervention in the rehabilitation of motor impairments poststroke has been validated as part of on-going clinical trial NCT02098265, in which stroke survivors participated in 9–15 BCI-FES intervention sessions lasting up to 2 h, for a maximum of 30 h of intervention per participant (Young et al., 2014a, 2015; Remsik et al., 2018). We have published evidence demonstrating improvements in both objective and subjective measures of behavioral outcomes used to assess stroke-related motor impairments (Remsik et al., 2018, 2019). For example, we have reported moderate improvements in Action Research Arm Test/Fugl-Meyer scores (Remsik et al., 2018) as compared to a control group and significantly increased grip strength (Remsik et al., 2019). Moreover, we have presented neurophysiological evidence that our BCI-FES design is able to generate significant and adaptive changes in EEG activity and brain connectivity (Mazrooyisebdani et al., 2018; Mohanty et al., 2018; Remsik et al., 2019, 2021). Specifically, increases in task-related ipsilesional Mu (8–12 Hz) ERD, were significantly correlated with improvements in measurements of motor recovery and functional connectivity (Remsik et al., 2019, 2021).
We present example data from three participants, selected post-hoc from the larger cohort of participants of on-going clinical trial NCT02098265, for the specific purposes of illustrating utility and demonstrating expected outcomes of the BCI-FES intervention described in the present report—the data presented are not intended as evidence to prove the intervention's clinical efficacy. Instead, the example data illustrate outcomes of participants who differed in level of severity of stroke-induced motor impairments, from mild (Participant A), to moderate (Participant B), to severe (Participant C), and time poststroke (i.e., chronicity), from 5 months (acute, participant A), to 12 months (intermediate, Participant C) to 92 months (chronic, Participant B) (Table 2). Metrics of task performance (i.e., how many times out of 10 a participant was able to successfully move the cursor to the target) (Figure 4 and Table 3), and a primary outcome measure of functional recovery commonly used in stroke research, the Arm Research Action Test (ARAT), are included (Table 1).
Table 2. Participant demographics from three exemplar BCI-FES participants.
Figure 4. BCI Task Performance. Out of a possible 10 trials in each run, participant average BCI performance scores (i.e., how many trials a user successfully moved the cursor into the target area, x/10) for a given session across sessions are plotted with a best fit line for each participant in their own color. Y axis values represent the average performance score of all trials during the given session by a given participant. Participants improved their average BCI task performance over time. These data are representative of exemplar BCI-FES participants and is not intended as evidence of efficacy of this device in these participants.
Table 3. BCI task performance summary.
Table 4 summarizes a sample of validated outcome measures designed to test and quantify different functional domains that may be affected by stroke or brain injury resulting in motor loss and may be affected by this BCI-FES device design. The list is not exhaustive. In addition to behavioral and task performance measures specific to a given rehabilitation target, such as grip strength, foot-drop, spasticity, etc., it is important researchers and clinicians consider assessments of outcome measures in other domains because of the rich functional interconnectedness of the sensorimotor cortex with the rest of the brain (Simon et al., 2021).
Table 4. Contemporary assessments of stroke impact.
Objective and subjective measures of motor capacity and function, measures of task and brain activity, and ADLs (e.g., Barthel Index, Motor Activity Log, etc.), are important metrics to consider when assessing the impact of BCI-FES on users (Simon et al., 2021) (please see Table 4).
Discussion
BCI-FES systems: (1) have the potential to be significantly more cost-effective than traditional rehabilitations (i.e., naturally modifiable and can be configured to address individuals' needs or environmental constraints such as budget, space or location), (2) provide therapy that supplements, and potentially shortens or replaces conventional poststroke care, and (3) provide rehabilitative therapy that may be superior to present day standards of care, particularly in both the most severely impaired and chronic survivors of stroke. Primary outcome scores (e.g., Action Research Arm Test, Fugl-Meyer Test) following intervention suggest that the present BCI-FES design is able to deliver moderate improvements in UE motor function supported by evidence of similar improvements in several other subjective and objective measures of stroke impact (Song et al., 2014, 2015; Young et al., 2014,a, 2015, 2016; Remsik et al., 2018, 2019, 2021).
The present non-invasive, EEG-based BCI-FES intervention has the potential to improve rehabilitation poststroke over and above the conventional standards of care in use at the present time. Each of the three example participants included herein demonstrated an increased capacity to perform the BCI-FES task accurately (Figure 4 and Table 3) over the course of intervention. Although it may take time for a user to become proficient at the BCI-FES task requirements (i.e., volitional control of the cursor's movement across the screen), nearly all users who are able to understand the instructions are able to use and benefit from the technology. While the features of rehabilitation might differ from person to person, the mechanisms of motor learning and brain-computer interfacing are ubiquitous as they rely on native CNS functioning. The BCI-FES concept is generalized across participants in that the means for using a BCI naturally exist in most all participants, yet the application of the intervention may be personalized. Thus, the BCI-FES intervention presented here allows for clinical translation of BCI-FES technology in a manner that tailors the therapy to the needs and circumstances of specific individuals, thereby providing a basis for personalized, precision medicine.
Recovery of motor function poststroke follows specific neurological patterns and is so far limited in capacity by, among other factors, the individual participant's presenting functional abilities. None the less, BCI devices can be used by participants regardless of severity of stroke lesion or motor impairment and offer a novel tool for delivering treatment options to those who are unable to participate in or benefit from more traditional means of motor rehabilitation. Further, the BCI intervention design presents a means to investigate and improve participant motor performance, beyond the capacity of conventional methods and expectations of care. The portability, adaptability (i.e., gamification) and efficacy of our BCI-FES design are ideally suited to extend windows of care for chronic severely-impaired stroke survivors by providing continued care options beyond traditional clinical settings into, for example, the participant's own home.
The potential therapeutic benefits of using closed-loop neural activity-triggered feedback systems (i.e., BCI-FES) for motor rehabilitation are being investigated in stroke survivors (Feng and Belagaje, 2013). Either FES, which targets specific muscle sets via myotic stimulation, or robotic assistance, which acts to replace control of the impaired limb, are able to produce movement of the paretic limb. BCI-FES designs can be configured to drive volitional UE movement rehabilitation and may be tailored to precisely modulate the strength and timing of muscle activity of the recovering motor system (Cho et al., 2011; Stinear, 2016). Recent evidence suggest that BCI-FES is an effective means of delivering treatment beyond traditional clinical windows and BCI-FES designs may be more effective than other existing BCI designs (Biasiucci et al., 2018; Simon et al., 2021). The optimal inclusion of adjuvants and the physical design of a BCI system for stroke motor rehabilitation are yet undefined in the field. Evidence suggests that BCI-FES systems, in combination with traditional PT (e.g., goal-directed motor behaviors, functionally relevant movements as compared to imagined movements, etc.), may facilitate superior improvements in motor recovery by inducing neuroplastic changes in appropriate control circuitry, compared to traditional BCIs, occupational therapies, or robotic rehabilitations (Cervera et al., 2018; Carvalho et al., 2019; Simon et al., 2021). Multimodal feedback from visual, somatosensory, and electro-tactile afference, contingent on EEG-signals related to voluntary movement intent, drives sensorimotor integration and may represent a mechanism, motor learning, responsible for BCI-FES induced motor recovery (Biasiucci et al., 2018). To date, of the various configurations of BCI devices in use for motor recovery, BCI-FES designs have demonstrated superior clinical efficacy (Bai et al., 2020; Simon et al., 2021). In other procedures, FES is used therapeutically to aid voluntary motor function during motor rehabilitation (Merletti et al., 1975; Popovic et al., 2002a,b, 2004, 2009; Popovic, 2014) and contingent integration may be important for successful rehabilitation (Iftime-Nielsen et al., 2012). As demonstrated by Biasiucci and colleagues, in their BCI-FES vs. sham FES experimental design, the inclusion of the FES adjuvant incorporates somatosensory contributions to the BCI user's goal-directed motor plan that are thought to encode afferent information of consequence to the brain facilitating a closed-feedback loop (Biasiucci et al., 2018).
Specifically, in our BCI-FES design, the facilitation of myotic activation contingent on EEG-recorded intent-to-move neuromodulations may foster multimodal—cutaneous, proprioceptive, and visual—afference that aids in enhancing adaptive intra- and interhemispheric network connectivity changes (Remsik et al., 2021). Suitable activation of sensorimotor feedback loops may drive conditioning as well as activity-dependent, Hebbian plasticity (Bach-y-Rita, 1981; Bergquist et al., 2011; Wolpaw, 2012). Whereas our study design (NCT02098265) does not allow us to draw the same conclusions as Biasiucci and colleagues with respect to the precise mechanisms or clinical significance of the FES adjuvant, our results and our BCI-FES device are similar to those of Biasiucci and colleagues (Biasiucci et al., 2018; Remsik et al., 2021). Therefore, it is likely that the clinically-relevant functional gains obtained with the BCI-FES system described here are due to similar strict contingency of BCI-driven FES detailed by Biasiucci and colleagues. However, while Biasiucci and colleagues offer evidence for such a mechanism, the specific sensorimotor substrates and mechanisms that underlie the observed improvements in motor learning remain unknown (Christensen and Grey, 2013).
The present evidence-based protocol delivers meaningful functional improvements; however, additional research is needed to identify the neural circuitry and mechanisms responsible (Biasiucci et al., 2018; Bai et al., 2020). Future research must be directed toward identification and tracking of the genesis and progression of associated neuroplastic changes, and the relative importance of changes in intra- and interhemispheric network connectivity. Continued research into the mechanistic origins of any such neuroplasticity will help improve rehabilitation strategies in order to enable caregivers to provide maximal benefit to patients (Bai et al., 2020; Simon et al., 2021).
Limitations
While small-scale, observational findings in the use of BCIs for motor rehabilitation have highlighted the promise of this technology for stroke survivors, a standardized BCI-FES intervention schedule and dosing regimen has yet to be recognized for optimal treatment of hemiparesis (Remsik et al., 2016; Bai et al., 2020; Simon et al., 2021). Development of a standard rehabilitation protocol requires large cohort studies and increased monitoring in clinical settings beyond the laboratory.
Heterogeneity in intervention effects may be compounded by the limitations of any given outcome measure (i.e., sensitivity, suitability), and the large variability in location and extent of stroke-induced damage among survivors. As stroke may affect either multiple aspects of one's life, or a stereotyped movement (e.g., hand grasping), it is important to employ a diverse battery of neuropsychological assessments in order to capture adaptive or maladaptive effects that may result from the intervention (Table 4).
Design
Adjustments to various components of the BCI-FES intervention design (e.g., more intervention, more frequent intervention, etc.), display enrichment (e.g., enhanced gameplay and graphical presentation), or improvements in functional (i.e., task) relevance (e.g., simple instructed wrist supination and pronation, compared to pouring a virtual glass of liquid into another virtual glass etc.) might further facilitate motor recovery in stroke participants using a BCI-FES with multimodal feedback. Such enhancements to BCI intervention designs might improve participants' engagement, attention, and motivation during the intervention sessions, potentially increasing their neuroplastic effects (Seo et al., 2019). Participants might also benefit from increased monitoring of self-reported fatigue or motivation throughout the intervention sessions. BCI-FES is most effective when participants are actively engaged in the task and, therefore, it may be important to measure changes in engagement due to fatigue, boredom, or other limitations, and lapses in concentration (Seo et al., 2019). Additional research on the effects of these and other considerations not raised here, may help to increase the effectiveness of BCI-FES interventions for UE motor recovery in stroke survivors.
Control Features
Although the specific control features that are selected to trigger FES may vary from participant to participant, the common principle between participants is that the features selected derive from EEG frequency bands and cerebral cortical areas known to be associated with sensorimotor processing and voluntary motor output. Thus, the BCI device is adapted to each participant individually, which aids participants with different motor capacities and brain volumes to use the device (Bundy et al., 2012).
Dose
Data presented in other work from our laboratory (Young et al., 2014a, 2015, 2016; Song et al., 2015; Mazrooyisebdani et al., 2018; Mohanty et al., 2018; Remsik et al., 2018, 2019, 2021) suggest that a dose of 2-h sessions for up to 30 h with this BCI-FES intervention design is sufficient to positively effect motor recovery in stroke participants. Furthermore, a larger number of runs of this BCI-FES intervention results in greater brain and behavioral changes associated with recovery (Remsik et al., 2018, 2019, 2021). Further research, specifically investigating how behavioral improvements depend on dosage categories (i.e., low, medium, or high) is needed to optimize dosage for specific individuals.
Supplemental Stimulation Adjuvants
Incorporating an adjuvant stimulus component (e.g., FES, TDU, haptic feedback, etc.) and multimodal feedback into the BCI intervention design may engender a more dynamic rehabilitative approach (Bach-y-Rita, 1990). Clinical fidelity is thought to depend largely on the sensory feedback that establishes the non-invasive closed-loop system (Biasiucci et al., 2018; Simon et al., 2021). The feedback of the BCI-FES design can help shape the motor efference produced in cerebral cortical motor areas, and when this association remains consistent over time, the brain will adapt. The BCI-FES design presented here can drive that adaptation toward useful recovery of motor function. Inclusion of adjuvants may also pose specific limitations, such as managing consistent placement of the FES electrodes across subjects, across sessions, as well as variations in sensitivity threshold and willingness of participants to receive adjuvants that deliver stimulation. The present BCI-FES design limits participants to simple whole-hand flexion or extension of the fingers (i.e., repeated hand grasping) and some stroke survivors may benefit from practicing different or more complex movements, which the current BCI-FES configuration is not designed to support.
Conclusion
BCI-FES designs are cost-effective and superior means of delivering poststroke care that are capable of supplementing or partially replacing traditional PT regimens. The BCI-FES is a most promising design for the future of BCI-mediated rehabilitation of stroke. Further improvements in BCI design, such as updating to wireless communication between system components, decreasing system size and cost, as well as gamification and simplification of the user interface, will further minimize costly healthcare supervision and, therefore, will increasingly satisfy requirements of healthcare payers for more cost-effective means to supplement and enhance conventional PT for stroke survivors within and beyond traditional care windows.
The multisensory closed-loop BCI-FES intervention design described here has been shown to be safe and effective for stroke survivors at all timepoints after their initial insult. This intervention design effectively enables users to either continue their recovery beyond standard clinical care windows (i.e., well after their CNS insult—e.g., chronic stroke) or it can function as a supplement to standard of care therapies available within standard clinical care settings (e.g., acute stroke). The closed-loop nature of this BCI-FES design may enhance experience-dependent neuroplasticity (Bach-y-Rita, 1981, 1990; Nudo, 2003a; Wolpaw, 2012), especially in the sensorimotor system, driving neurophysiological changes that promote functional recovery of stroke-impaired UE, regardless of other factors. In this BCI-FES intervention design, FES of the stroke-impaired muscles contingent on participant-generated control features in the recorded EEG signals associated with movement intent elicits subsequent signaling in multiple native sensory (cutaneous, proprioceptive, visuo-motor, etc.) and motor circuits that likely enhance and refine subsequent intent-to-move signals (i.e., motor command signals) and efficacy of subsequent motor behavior. This work represents a first step toward clinical translation of a standardized design for BCI-FES interventions.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary files, further inquiries can be directed to the corresponding author/s.
Ethics Statement
The studies involving human participants were reviewed and approved by University of Wisconsin Health Sciences Institutional Review Board (Study ID 2015-0469). The patients/participants provided their written informed consent to participate in this study.
Author Contributions
AR, LW, and SG were involved in all aspects of this manuscript. PK and KG contributed to manuscript writing and editing as well as intellectual content. VN was involved in participant recruitment, data collection, manuscript editing and intellectual content. KC, JW, and VP are co-PIs and were involved in all aspects of the study as well as manuscript conception, design, editing and intellectual content. All authors contributed to the writing of this manuscript. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by NIH grants 1R01NS105 646-01A1, RC1MH090912-01, T32GM008692, UL1TR000427, K23NS086852, T32EB011434, R01EB000856-06, R01EB009103-01, and R01EB009103-01 and by the DARPA RCI Program (MTO) N66001-12-C-4025 and HIST Program (MTO) N66001-11-1-4013. Additional funding was also provided through a Coulter Translational Research Award, the American Heart Association Grant 1T32EB011434-01A1, AHA Innovative Research Award—National (Marcus Foundation) 15IRG22760009, AHA Midwest Grant in Aid Award 15GRNT25780033, the Foundation of ASNR, UW Milwaukee-Madison Intercampus Grants, the UW Graduate School, and by Shapiro Foundation Grants.
Conflict of Interest
JW is a scientific board member and has stock interests in NeuroOne Medical Inc., a company developing next generation epilepsy monitoring devices. JW also has an equity interest in NeuroNexus technology Inc., a company that supplies electrophysiology equipment and multichannel probes to the neuroscience research community. JW also has an equity interest in Neuraworx Medical Technologies Inc., a company developing non-invasive neuromodulation devices for treating cognitive impairments. None of these associations are directly relevant to the work presented in this manuscript.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The authors would like to thank all the study participants and their families for their time and efforts participating in this study. The authors would also like to extend thank to Justin Sattin and KC for referrals of stroke survivors and clinical documentation.
References
Ackerley, S. J., Stinear, C. M., Barber, P. A., and Byblow, W. D. (2014). Priming sensorimotor cortex to enhance task-specific training after subcortical stroke. Clin. Neurophysiol. 125, 1451–1458. doi: 10.1016/j.clinph.2013.11.020
Ackerley, S. J., Stinear, C. M., and Byblow, W. D. (2007). The effect of coordination mode on use-dependent plasticity. Clin. Neurophysiol. 118, 1759–1766. doi: 10.1016/j.clinph.2007.04.020
Ackerley, S. J., Stinear, C. M., and Byblow, W. D. (2011). Promoting use-dependent plasticity with externally-paced training. Clin. Neurophysiol. 122, 2462–2468. doi: 10.1016/j.clinph.2011.05.011
Annetta, N. V., Friend, J., Schimmoeller, A., Buck, V. S., Friedenberg, D. A., Bouton, C. E., et al. (2019). A high definition noninvasive neuromuscular electrical stimulation system for cortical control of combinatorial rotary hand movements in a human with tetraplegia. IEEE Trans. Biomed. Eng. 66, 910–919. doi: 10.1109/TBME.2018.2864104
Babaiasl, M., Mahdioun, S. H., Jaryani, P., and Yazdani, M. (2016). A review of technological and clinical aspects of robot-aided rehabilitation of upper-extremity after stroke. Disabil. Rehabil. Assist. Technol. 11, 263–280. doi: 10.3109/17483107.2014.1002539
Babiloni, C., Del Percio, C., Vecchio, F., Sebastiano, F., Di Gennaro, G., Quarato, P. P., et al. (2016). Alpha, beta and gamma electrocorticographic rhythms in somatosensory, motor, premotor and prefrontal cortical areas differ in movement execution and observation in humans. Clin. Neurophysiol. 127, 641–654. doi: 10.1016/j.clinph.2015.04.068
Bach-y-Rita, P.. (1981). Brain plasticity as a basis of the development of rehabilitation procedures for hemiplegia. Scand. J. Rehabil. Med. 13, 73–83. doi: 10.1016/0028-3932(90)90033-K
Bach-y-Rita, P.. (1990). Brain plasticity as a basis for recovery of function in humans. Neuropsychologia 28, 547–554. doi: 10.1016/0028-3932(90)90033-k
Bach-y-Rita, P.. (2004). Tactile sensory substitution studies. Ann. N. Y. Acad. Sci. 1013, 83–91. doi: 10.1196/annals.1305.006
Bai, Z., Fong, K. N. K., Zhang, J. J., Chan, J., and Ting, K. H. (2020). Immediate and long-term effects of BCI-based rehabilitation of the upper extremity after stroke: a systematic review and meta-analysis. J. Neuroeng. Rehabil. 17, 57. doi: 10.1186/s12984-020-00686-2
Baniqued, P. D. E., Stanyer, E. C., Awais, M., Alazmani, A., Jackson, A. E., Mon-Williams, M. A., et al. (2021). Brain-computer interface robotics for hand rehabilitation after stroke: a systematic review. J. Neuroeng. Rehabil. 18, 15. doi: 10.1186/s12984-021-00820-8
Beebe, J. A., and Lang, C. E. (2009). Relationships and responsiveness of six upper extremity function tests during the first six months of recovery after stroke. J. Neurol. Phys. Ther. 33, 96–103. doi: 10.1097/NPT.0b013e3181a33638
Benedict, R. H., Schretlen, D., Groninger, L., and Brandt, J. (1998). Hopkins verbal learning test–revised: normative data and analysis of inter-form and test-retest reliability. Clin. Neuropsychol. 12, 43–55. doi: 10.1076/clin.12.1.43.1726
Bergquist, A. J., Clair, J. M., Lagerquist, O., Mang, C. S., Okuma, Y., and Collins, D. F. (2011). Neuromuscular electrical stimulation: implications of the electrically evoked sensory volley. Eur. J. Appl. Physiol. 111, 2409–2426. doi: 10.1007/s00421-011-2087-9
Biasiucci, A., Leeb, R., Iturrate, I., Perdikis, S., Al-Khodairy, A., Corbet, T., et al. (2018). Brain-actuated functional electrical stimulation elicits lasting arm motor recovery after stroke. Nat. Commun. 9, 2421. doi: 10.1038/s41467-018-04673-z
Bockbrader, M. A., Francisco, G., Lee, R., Olson, J., Solinsky, R., and Boninger, M. L. (2018). Brain computer interfaces in rehabilitation medicine. PM R 10(9 Suppl. 2), S233–S243. doi: 10.1016/j.pmrj.2018.05.028
Boissy, P., Bourbonnais, D., Carlotti, M. M., Gravel, D., and Arsenault, B. A. (1999). Maximal grip force in chronic stroke subjects and its relationship to global upper extremity function. Clin. Rehabil. 13, 354–362. doi: 10.1191/026921599676433080
Bundy, D. T., Wronkiewicz, M., Sharma, M., Moran, D. W., Corbetta, M., and Leuthardt, E. C. (2012). Using ipsilateral motor signals in the unaffected cerebral hemisphere as a signal platform for brain-computer interfaces in hemiplegic stroke survivors. J. Neural Eng. 9, 036011. doi: 10.1088/1741-2560/9/3/036011
Carvalho, R., Dias, N., and Cerqueira, J. J. (2019). Brain-machine interface of upper limb recovery in stroke patients rehabilitation: a systematic review. Physiother. Res. Int. 24, e1764. doi: 10.1002/pri.1764
Cervera, M. A., Soekadar, S. R., Ushiba, J., Millan, J. D. R., Liu, M., Birbaumer, N., et al. (2018). Brain-computer interfaces for post-stroke motor rehabilitation: a meta-analysis. Ann. Clin. Transl. Neurol. 5, 651–663. doi: 10.1002/acn3.544
Chiu, T. T., Lin, C. L., Young, K. Y., Lin, C. T., Hsu, S. H., Yang, B. S., et al. (2011). A study of Fitts' law on goal-directed aiming task with moving targets. Percept. Mot. Skills 113, 339–352. doi: 10.2466/05.06.25.Pms.113.4.339-352
Cho, W., Vidaurre, C., Hoffmann, U., Birbaumer, N., and Ramos-Murguialday, A. (2011). Afferent and efferent activity control in the design of brain computer interfaces for motor rehabilitation. Conf. Proc. IEEE Eng. Med. Biol. Soc. 2011, 7310–7315. doi: 10.1109/iembs.2011.6091705
Christensen, M. S., and Grey, M. J. (2013). Modulation of proprioceptive feedback during functional electrical stimulation: an fMRI study. Eur. J. Neurosci. 37, 1766–1778. doi: 10.1111/ejn.12178
Collin, C., Wade, D., Davies, S., and Horne, V. (1988). The Barthel ADL Index: a reliability study. Int. Disabil. Stud. 10, 61–63. doi: 10.3109/09638288809164103
Cramer, S. C., and Riley, J. D. (2008). Neuroplasticity and brain repair after stroke. Curr. Opin. Neurol. 21, 76–82. doi: 10.1097/WCO.0b013e3282f36cb6
Cramer, S. C., Sur, M., Dobkin, B. H., O'Brien, C., Sanger, T. D., Trojanowski, J. Q., et al. (2011). Harnessing neuroplasticity for clinical applications. Brain 134(Pt 6), 1591–1609. doi: 10.1093/brain/awr039
Daly, J. J., and Wolpaw, J. R. (2008). Brain-computer interfaces in neurological rehabilitation. Lancet Neurol. 7, 1032–1043. doi: 10.1016/S1474-4422(08)70223-0
De Marchis, C., Santos Monteiro, T., Simon-Martinez, C., Conforto, S., and Gharabaghi, A. (2016). Multi-contact functional electrical stimulation for hand opening: electrophysiologically driven identification of the optimal stimulation site. J. Neuroeng. Rehabil. 13, 22. doi: 10.1186/s12984-016-0129-6
Dimyan, M. A., and Cohen, L. G. (2011). Neuroplasticity in the context of motor rehabilitation after stroke. Nat. Rev. Neurol. 7, 76–85. doi: 10.1038/nrneurol.2010.200
Duncan, P. W., Wallace, D., Lai, S. M., Johnson, D., Embretson, S., and Laster, L. J. (1999). The stroke impact scale version 2.0. Evaluation of reliability, validity, and sensitivity to change. Stroke 30, 2131–2140. doi: 10.1161/01.str.30.10.2131
Eriksen, B. A., and Eriksen, C. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Percept. Psycho. 16, 143–149. doi: 10.3758/BF03203267
Feng, W., and Belagaje, S. R. (2013). Recent advances in stroke recovery and rehabilitation. Semin. Neurol. 33, 498–506. doi: 10.1055/s-0033-1364215
Fleet, A., Page, S. J., MacKay-Lyons, M., and Boe, S. G. (2014). Modified constraint-induced movement therapy for upper extremity recovery post stroke: what is the evidence? Top. Stroke Rehabil. 21, 319–331. doi: 10.1310/tsr2104-319
Fugl-Meyer, A. R., Jääskö, L., Leyman, I., Olsson, S., and Steglind, S. (1975). A method for evaluation of physical performance. Scand. J. Rehabil. Med. 7, 13–31.
Golden, C. J., Freshwater, S. M., and Zarabeth, G. (2003). Stroop Color and Word Test Children's Version for ages 5-14: A Manual for Clinical and Experimental Uses. Wood Dale, IL: Stoelting Co.
Gregson, J. M., Leathley, M., Moore, A. P., Sharma, A. K., Smith, T. L., and Watkins, C. L. (1999). Reliability of the Tone Assessment Scale and the modified Ashworth scale as clinical tools for assessing poststroke spasticity. Arch. Phys. Med. Rehabil. 80, 1013–1016. doi: 10.1016/s0003-9993(99)90053-9
Howlett, O. A., Lannin, N. A., Ada, L., and McKinstry, C. (2015). Functional electrical stimulation improves activity after stroke: a systematic review with meta-analysis. Arch. Phys. Med. Rehabil. 96, 934–943. doi: 10.1016/j.apmr.2015.01.013
Iftime-Nielsen, S. D., Christensen, M. S., Vingborg, R. J., Sinkjaer, T., Roepstorff, A., and Grey, M. J. (2012). Interaction of electrical stimulation and voluntary hand movement in SII and the cerebellum during simulated therapeutic functional electrical stimulation in healthy adults. Hum. Brain Mapp. 33, 40–49. doi: 10.1002/hbm.21191
Jang, Y. Y., Kim, T. H., and Lee, B. H. (2016). Effects of brain-computer interface-controlled functional electrical stimulation training on shoulder subluxation for patients with stroke: a randomized controlled trial. Occup. Ther. Int. 23, 175–185. doi: 10.1002/oti.1422
Jayaram, G., and Stinear, J. W. (2008). Contralesional paired associative stimulation increases paretic lower limb motor excitability post-stroke. Exp. Brain Res. 185, 563–570. doi: 10.1007/s00221-007-1183-x
Jiang, L., Xu, H., and Yu, C. (2013). Brain connectivity plasticity in the motor network after ischemic stroke. Neural Plast. 2013, 924192–924192. doi: 10.1155/2013/924192
Johnson, N. N., Carey, J., Edelman, B. J., Doud, A., Grande, A., Lakshminarayan, K., et al. (2018). Combined rTMS and virtual reality brain-computer interface training for motor recovery after stroke. J. Neural Eng. 15, 016009. doi: 10.1088/1741-2552/aa8ce3
Kaczmarek, K. A.. (2011). The tongue display unit (TDU) for electrotactile spatiotemporal pattern presentation. Sci. Iran D Comput. Sci. Eng. Electr. Eng. 18, 1476–1485. doi: 10.1016/j.scient.2011.08.020
Katzman, R., Brown, T., Fuld, P., Peck, A., Schechter, R., and Schimmel, H. (1983). Validation of a short Orientation-Memory-Concentration Test of cognitive impairment. Am. J. Psychiatry 140, 734–739. doi: 10.1176/ajp.140.6.734
Kauffman, M. J., Cagnacci, F., Chamaille-Jammes, S., Hebblewhite, M., Hopcraft, J. G. C., Merkle, J. A., et al. (2021). Mapping out a future for ungulate migrations. Science 372, 566–569. doi: 10.1126/science.abf0998
Kim, T., Kim, S., and Lee, B. (2016). Effects of action observational training plus brain-computer interface-based functional electrical stimulation on paretic arm motor recovery in patient with stroke: a randomized controlled trial. Occup. Ther. Int. 23, 39–47. doi: 10.1002/oti.1403
Kleim, J. A., Barbay, S., Cooper, N. R., Hogg, T. M., Reidel, C. N., Remple, M. S., et al. (2002). Motor learning-dependent synaptogenesis is localized to functionally reorganized motor cortex. Neurobiol. Learn. Mem. 77, 63–77. doi: 10.1006/nlme.2000.4004
Kwakkel, G., Veerbeek, J. M., van Wegen, E. E., and Wolf, S. L. (2015). Constraint-induced movement therapy after stroke. Lancet Neurol. 14, 224–234. doi: 10.1016/S1474-4422(14)70160-7
Lang, C. E., Wagner, J. M., Dromerick, A. W., and Edwards, D. F. (2006). Measurement of upper-extremity function early after stroke: properties of the action research arm test. Arch. Phys. Med. Rehabil. 87, 1605–1610. doi: 10.1016/j.apmr.2006.09.003
Laver, K., George, S., Thomas, S., Deutsch, J. E., and Crotty, M. (2015). Virtual reality for stroke rehabilitation: an abridged version of a Cochrane review. Eur. J. Phys. Rehabil. Med. 51, 497–506
Leuthardt, E. C., Schalk, G., Wolpaw, J. R., Ojemann, J. G., and Moran, D. W. (2004). A brain-computer interface using electrocorticographic signals in humans. J. Neural Eng. 1, 63–71. doi: 10.1088/1741-2560/1/2/001
Li, M., Liu, Y., Wu, Y., Liu, S., Jia, J., and Zhang, L. (2014). Neurophysiological substrates of stroke patients with motor imagery-based Brain-Computer Interface training. Int. J. Neurosci. 124, 403–415. doi: 10.3109/00207454.2013.850082
Lindenberg, R., Renga, V., Zhu, L., Nair, D., and Schlaug, G. (2010). Bihemispheric brain stimulation facilitates motor recovery in chronic stroke patients. Neurology 75, 2176–2184. doi: 10.1212/WNL.0b013e318202013a
Lyden, P., Raman, R., Liu, L., Emr, M., Warren, M., and Marler, J. (2009). National Institutes of Health Stroke Scale certification is reliable across multiple venues. Stroke 40, 2507–2511. doi: 10.1161/STROKEAHA.108.532069
Lyle, R. C.. (1981). A performance test for assessment of upper limb function in physical rehabilitation treatment and research. Int. J. Rehabil. Res. 4, 483–492. doi: 10.1097/00004356-198112000-00001
Marple, S. L. Jr., and Carey, W. M. (1989). Digital spectral analysis with applications. J. Acoust. Soc. Am. 86, 2043.
Mathiowetz, V., Weber, K., Kashman, N., and Volland, G. (1985). Adult norms for the nine hole peg test of finger dexterity. Occup Ther J Res 5, 24–38. doi: 10.1177/153944928500500102
Mazrooyisebdani, M., Nair, V. A., Loh, P. L., Remsik, A. B., Young, B. M., Moreno, B. S., et al. (2018). Evaluation of changes in the motor network following BCI therapy based on graph theory analysis. Front. Neurosci. 12:861. doi: 10.3389/fnins.2018.00861
McCabe, J., Monkiewicz, M., Holcomb, J., Pundik, S., and Daly, J. J. (2015). Comparison of robotics, functional electrical stimulation, and motor learning methods for treatment of persistent upper extremity dysfunction after stroke: a randomized controlled trial. Arch. Phys. Med. Rehabil. 96, 981–990. doi: 10.1016/j.apmr.2014.10.022
McFarland, D. J., Miner, L. A., Vaughan, T. M., and Wolpaw, J. R. (2000). Mu and beta rhythm topographies during motor imagery and actual movements. Brain Topogr. 12, 177–186. doi: 10.1023/a:1023437823106
Merletti, R., Acimovic, R., Grobelnik, S., and Cvilak, G. (1975). Electrophysiological orthosis for the upper extremity in hemiplegia: feasibility study. Arch. Phys. Med. Rehabil. 56, 507–513.
Mohanty, R., Sinha, A. M., Remsik, A. B., Dodd, K. C., Young, B. M., Jacobson, T., et al. (2018). Early findings on functional connectivity correlates of behavioral outcomes of brain-computer interface stroke rehabilitation using machine learning. Front. Neurosci. 12:624. doi: 10.3389/fnins.2018.00624
Murphy, T. H., and Corbett, D. (2009). Plasticity during stroke recovery: from synapse to behaviour. Nat. Rev. Neurosci. 10, 861–872. doi: 10.1038/nrn2735
Nam, C. S., Jeon, Y., Kim, Y. J., Lee, I., and Park, K. (2011). Movement imagery-related lateralization of event-related (de)synchronization (ERD/ERS): motor-imagery duration effects. Clin. Neurophysiol. 122, 567–577. doi: 10.1016/j.clinph.2010.08.002
Neuper, C., and Pfurtscheller, G. (2001). Event-related dynamics of cortical rhythms: frequency-specific features and functional correlates. Int. J. Psychophysiol. 43, 41–58. doi: 10.1016/s0167-8760(01)00178-7
Neuper, C., Scherer, R., Reiner, M., and Pfurtscheller, G. (2005). Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. Brain Res. Cogn. Brain Res. 25, 668–677. doi: 10.1016/j.cogbrainres.2005.08.014
Neuper, C., Wortz, M., and Pfurtscheller, G. (2006). ERD/ERS patterns reflecting sensorimotor activation and deactivation. Prog. Brain Res. 159, 211–222. doi: 10.1016/S0079-6123(06)59014-4
Nishimoto, A., Kawakami, M., Fujiwara, T., Hiramoto, M., Honaga, K., Abe, K., et al. (2018). Feasibility of task-specific brain-machine interface training for upper-extremity paralysis in patients with chronic hemiparetic stroke. J. Rehabil. Med. 50, 52–58. doi: 10.2340/16501977-2275
Nudo, R. J.. (1999). Recovery after damage to motor cortical areas. Curr. Opin. Neurobiol. 9, 740–747. doi: 10.1016/s0959-4388(99)00027-6
Nudo, R. J.. (2003a). Adaptive plasticity in motor cortex: implications for rehabilitation after brain injury. J. Rehabil. Med. 41, 7–10. doi: 10.1080/16501960310010070
Nudo, R. J.. (2003b). Functional and structural plasticity in motor cortex: implications for stroke recovery. Phys. Med. Rehabil. Clin. N. Am. 14, S57–S76. doi: 10.1016/s1047-9651(02)00054-2
Nudo, R. J.. (2011). Neural bases of recovery after brain injury. J. Commun. Disord. 44, 515–520. doi: 10.1016/j.jcomdis.2011.04.004
Nudo, R. J., and Friel, K. M. (1999). Cortical plasticity after stroke: implications for rehabilitation. Rev. Neurol. 155, 713–717.
Nudo, R. J., Plautz, E. J., and Frost, S. B. (2001). Role of adaptive plasticity in recovery of function after damage to motor cortex. Muscle Nerve 24, 1000–1019. doi: 10.1002/mus.1104
Nudo, R. J., Wise, B. M., SiFuentes, F., and Milliken, G. W. (1996). Neural substrates for the effects of rehabilitative training on motor recovery after ischemic infarct. Science 272, 1791–1794. doi: 10.1126/science.272.5269.1791
Page, S. J., Maslyn, S., Hermann, V. H., Wu, A., Dunning, K., and Levine, P. G. (2009). Activity-based electrical stimulation training in a stroke patient with minimal movement in the paretic upper extremity. Neurorehabil. Neural Repair 23, 595–599. doi: 10.1177/1545968308329922
Peckham, P. H., and Knutson, J. S. (2005). Functional electrical stimulation for neuromuscular applications. Annu. Rev. Biomed. Eng. 7, 327–360. doi: 10.1146/annurev.bioeng.6.040803.140103
Pekna, M., Pekny, M., and Nilsson, M. (2012). Modulation of neural plasticity as a basis for stroke rehabilitation. Stroke 43, 2819–2828. doi: 10.1161/STROKEAHA.112.654228
Pfurtscheller, G.. (1999). “EEG event-related desynchronization (ERD) and event-related synchronization (ERS),” in Electroencephalography: Basic Principles, Clinical Applications and Related Fields, 4th Edn, eds E. Niedermeyer, and F. H. Lopes da Silva (Baltimore, MD: Williams and Wilkins), 958–967.
Pfurtscheller, G., and Berghold, A. (1989). Patterns of cortical activation during planning of voluntary movement. Electroencephalogr. Clin. Neurophysiol. 72, 250–258. doi: 10.1016/0013-4694(89)90250-2
Pfurtscheller, G., and Lopes da Silva, F. H. (1999). Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin. Neurophysiol. 110, 1842–1857. doi: 10.1016/s1388-2457(99)00141-8
Pfurtscheller, G., Neuper, C., Andrew, C., and Edlinger, G. (1997). Foot and hand area mu rhythms. Int. J. Psychophysiol. 26, 121–135. doi: 10.1016/s0167-8760(97)00760-5
Pfurtscheller, G., Neuper, C., and Birbaumer, N. (2005). “Human brain-computer interface,” in Motor Cortex in Voluntary Movements: A Distributed System for Distributed Functions, eds. A. Riehle, and E. Vaadia (Washington, DC: CRC Press), 367–401.
Plautz, E., and Nudo, R. (2005). Neural plasticity and functional recovery following cortical ischemic injury. Conf. Proc. IEEE Eng. Med. Biol. Soc. 4, 4145–4148. doi: 10.1109/IEMBS.2005.1615376
Pollock, A., Farmer, S. E., Brady, M. C., Langhorne, P., Mead, G. E., Mehrholz, J., et al. (2014). Interventions for improving upper limb function after stroke. Cochrane Database Syst. Rev. 11, CD010820. doi: 10.1002/14651858.CD010820.pub2
Popovic, D. B.. (2014). Advances in functional electrical stimulation (FES). J. Electromyogr. Kinesiol. 24, 795–802. doi: 10.1016/j.jelekin.2014.09.008
Popovic, D. B., Sinkaer, T., and Popovic, M. B. (2009). Electrical stimulation as a means for achieving recovery of function in stroke patients. NeuroRehabilitation 25, 45–58. doi: 10.3233/NRE-2009-0498
Popovic, M. B., Popovic, D. B., Schwirtlich, L., and Sinkjaer, T. (2004). Functional electrical therapy (FET): clinical trial in chronic hemiplegic subjects. Neuromodulation 7, 133–140. doi: 10.1111/j.1094-7159.2004.04017.x
Popovic, M. B., Popovic, D. B., Sinkjaer, T., Stefanovic, A., and Schwirtlich, L. (2002a). Restitution of reaching and grasping promoted by functional electrical therapy. Artif. Organs. 26, 271–275. doi: 10.1046/j.1525-1594.2002.06950.x
Popovic, M. R., Popovic, D. B., and Keller, T. (2002b). Neuroprostheses for grasping. Neurol. Res. 24, 443–452. doi: 10.1179/016164102101200311
Pundik, S., McCabe, J. P., Hrovat, K., Fredrickson, A. E., Tatsuoka, C., Feng, I. J., et al. (2015). Recovery of post stroke proximal arm function, driven by complex neuroplastic bilateral brain activation patterns and predicted by baseline motor dysfunction severity. Front. Hum. Neurosci. 9:394. doi: 10.3389/fnhum.2015.00394
Radloff, L. S.. (1977). The CES-D scale: a self-report depression scale for research in the general population. Appl. Psychol. Meas. 1, 385–401. doi: 10.1177/014662167700100306
Ragnarsson, K.. (2008). Functional electrical stimulation after spinal cord injury: current use, therapeutic effects and future directions. Spinal Cord 46, 255–274. doi: 10.1038/sj.sc.3102091
Ramos-Murguialday, A., Broetz, D., Rea, M., Laer, L., Yilmaz, O., Brasil, F. L., et al. (2013). Brain-machine interface in chronic stroke rehabilitation: a controlled study. Ann. Neurol. 74, 100–108. doi: 10.1002/ana.23879
Reinkensmeyer, D. J., Burdet, E., Casadio, M., Krakauer, J. W., Kwakkel, G., Lang, C. E., et al. (2016). Computational neurorehabilitation: modeling plasticity and learning to predict recovery. J. Neuroeng. Rehabil. 13, 42. doi: 10.1186/s12984-016-0148-3
Remsik, A., Young, B., Vermilyea, R., Kiekhoefer, L., Abrams, J., Evander Elmore, S., et al. (2016). A review of the progression and future implications of brain-computer interface therapies for restoration of distal upper extremity motor function after stroke. Expert Rev. Med. Devices 13, 445–454. doi: 10.1080/17434440.2016.1174572
Remsik, A. B., Dodd, K., Williams, L. Jr., Thoma, J., Jacobson, T., et al. (2018). Behavioral outcomes following brain-computer interface intervention for upper extremity rehabilitation in stroke: a randomized controlled trial. Front. Neurosci. 12:752. doi: 10.3389/fnins.2018.00752
Remsik, A. B., Gjini, K., Williams, L. Jr., van Kan, P. L. E., Gloe, S., et al. (2021). Ipsilesional mu rhythm desynchronization correlates with improvements in affected hand grip strength and functional connectivity in sensorimotor cortices following BCI-FES intervention for upper extremity in stroke survivors. Front. Hum. Neurosci. 15:725645. doi: 10.3389/fnhum.2021.725645
Remsik, A. B., Williams, L Jr., Gjini, K., Dodd, K., Thoma, J., et al. (2019). Ipsilesional mu rhythm desynchronization and changes in motor behavior following post stroke bci intervention for motor rehabilitation. Front. Neurosci. 13:53. doi: 10.3389/fnins.2019.00053
Rossini, P. M., and Dal Forno, G. (2004a). Integrated technology for evaluation of brain function and neural plasticity. Phys. Med. Rehabil. Clin. N. Am. 15, 263–306. doi: 10.1016/s1047-9651(03)00124-4
Rossini, P. M., and Dal Forno, G. (2004b). Neuronal post-stroke plasticity in the adult. Restor. Neurol. Neurosci. 22, 193–206. doi: 10.3233/RNN-211222
Schaechter, J. D., Kraft, E., Hilliard, T. S., Dijkhuizen, R. M., Benner, T., Finklestein, S. P., et al. (2002). Motor recovery and cortical reorganization after constraint-induced movement therapy in stroke patients: a preliminary study. Neurorehabil. Neural Repair 16, 326–338. doi: 10.1177/154596830201600403
Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., and Wolpaw, J. R. (2004). BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans. Biomed. Eng. 51, 1034–1043. doi: 10.1109/TBME.2004.827072
Schalk, G., and Mellinger, J. (2010). A Practical Guide to Brain–Computer Interfacing with BCI2000: General-Purpose Software for Brain–Computer Interface Research, Data Acquisition, Stimulus Presentation, and Brain Monitoring. London: Springer.
Schalk, G., Miller, K. J., Anderson, N. R., Wilson, J. A., Smyth, M. D., Ojemann, J. G., et al. (2008). Two-dimensional movement control using electrocorticographic signals in humans. J. Neural Eng. 5, 75–84. doi: 10.1088/1741-2560/5/1/008
Seo, S.-P., Lee, M.-H., Williamson, J., and Lee, S.-W. (2019). “Changes in fatigue and EEG amplitude during a longtime use of brain-computer interface,” in 2019 7th International Winter Conference on Brain-Computer Interface (BCI) (IEEE), 1–3.
Simon, C., Bolton, D. A. E., Kennedy, N. C., Soekadar, S. R., and Ruddy, K. L. (2021). Challenges and opportunities for the future of brain-computer interface in neurorehabilitation. Front. Neurosci. 15:699428. doi: 10.3389/fnins.2021.699428
Smith, M. C., and Stinear, C. M. (2016). Transcranial magnetic stimulation (TMS) in stroke: ready for clinical practice? J. Clin. Neurosci. 31, 10–14. doi: 10.1016/j.jocn.2016.01.034
Soekadar, S. R., Birbaumer, N., Slutzky, M. W., and Cohen, L. G. (2014). Brain-machine interfaces in neurorehabilitation of stroke. Neurobiol. Dis. 83, 172–179. doi: 10.1016/j.nbd.2014.11.025
Song, J., Nair, V. A., Young, B. M., Walton, L. M., Nigogosyan, Z., Remsik, A., et al. (2015). DTI measures track and predict motor function outcomes in stroke rehabilitation utilizing BCI technology. Front. Hum. Neurosci. 9:195. doi: 10.3389/fnhum.2015.00195
Song, J., Young, B. M., Nigogosyan, Z., Walton, L. M., Nair, V. A., Grogan, S. W., et al. (2014). Characterizing relationships of DTI, fMRI, and motor recovery in stroke rehabilitation utilizing brain-computer interface technology. Front. Neuroeng. 7:31. doi: 10.3389/fneng.2014.00031
Stinear, C. M.. (2016). Stroke rehabilitation research needs to be different to make a difference. F1000Res 5, F1000. doi: 10.12688/f1000research.8722.1
Strangman, G., O'Neil-Pirozzi, T. M., Burke, D., Cristina, D., Goldstein, R., Rauch, S. L., et al. (2005). Functional neuroimaging and cognitive rehabilitation for people with traumatic brain injury. Am. J. Phys. Med. Rehabil. 84, 62–75. doi: 10.1097/01.phm.0000150787.26860.12
Tabernig, C. B., Lopez, C. A., Carrere, L. C., Spaich, E. G., and Ballario, C. H. (2018). Neurorehabilitation therapy of patients with severe stroke based on functional electrical stimulation commanded by a brain computer interface. J. Rehabil. Assist. Technol. Eng. 5, 2055668318789280. doi: 10.1177/2055668318789280
Takahashi, M., Takeda, K., Otaka, Y., Osu, R., Hanakawa, T., Gouko, M., et al. (2012). Event related desynchronization-modulated functional electrical stimulation system for stroke rehabilitation: a feasibility study. J. Neuroeng. Rehabil. 9, 56. doi: 10.1186/1743-0003-9-56
Takeuchi, N., and Izumi, S. (2012a). Maladaptive plasticity for motor recovery after stroke: mechanisms and approaches. Neural Plast. 2012, 359728. doi: 10.1155/2012/359728
Takeuchi, N., and Izumi, S. (2012b). Noninvasive brain stimulation for motor recovery after stroke: mechanisms and future views. Stroke Res. Treat. 2012, 584727. doi: 10.1155/2012/584727
Takeuchi, N., and Izumi, S. (2013). Rehabilitation with poststroke motor recovery: a review with a focus on neural plasticity. Stroke Res. Treat. 2013, 128641. doi: 10.1155/2013/128641
Toglia, J., Fitzgerald, K. A., O'Dell, M. W., Mastrogiovanni, A. R., and Lin, C. D. (2011). The Mini-Mental State Examination and Montreal Cognitive Assessment in persons with mild subacute stroke: relationship to functional outcome. Arch. Phys. Med. Rehabil. 92, 792–798. doi: 10.1016/j.apmr.2010.12.034
Tombaugh, T. N., and McIntyre, N. J. (1992). The mini-mental state examination: a comprehensive review. J. Am. Geriatr. Soc. 40, 922–935. doi: 10.1111/j.1532-5415.1992.tb01992.x
Tsao, C. W., Aday, A. W., Almarzooq, Z. I., Alonso, A., Beaton, A. Z., Bittencourt, M. S., et al. (2022). Heart disease and stroke statistics-2022 update: a report from the American Heart Association. Circulation 145, e153–e639. doi: 10.1161/CIR.0000000000001052
Tulsky, D., Zhu, J., and Ledbetter, M. (1997). WAIS-III/WMS-III Technical Manual. San Antonio, TX: Psychological Corporation.
Vafadar, A. K., Cote, J. N., and Archambault, P. S. (2015). Effectiveness of functional electrical stimulation in improving clinical outcomes in the upper arm following stroke: a systematic review and meta-analysis. Biomed Res. Int. 2015, 14. doi: 10.1155/2015/729768
Van der Lee, J., Beckerman, H., Knol, D., De Vet, H., and Bouter, L. (2004). Clinimetric properties of the motor activity log for the assessment of arm use in hemiparetic patients. Stroke 35, 1410–1414. doi: 10.1161/01.STR.0000126900.24964.7e
Veerbeek, J. M., van Wegen, E., van Peppen, R., van der Wees, P. J., Hendriks, E., Rietberg, M., et al. (2014). What is the evidence for physical therapy poststroke? A systematic review and meta-analysis. PLoS ONE 9:e87987. doi: 10.1371/journal.pone.0087987
Virani, S. S., Alonso, A., Benjamin, E. J., Bittencourt, M. S., Callaway, C. W., Carson, A. P., et al. (2020). Heart disease and stroke statistics-2020 update: a report from the American Heart Association. Circulation 141, e139–e596. doi: 10.1161/CIR.0000000000000757
Volz, L. J., Sarfeld, A. S., Diekhoff, S., Rehme, A. K., Pool, E. M., Eickhoff, S. B., et al. (2014). Motor cortex excitability and connectivity in chronic stroke: a multimodal model of functional reorganization. Brain Struct. Funct. 220, 1093–1107. doi: 10.1007/s00429-013-0702-8
Wang, W., Collinger, J. L., Perez, M. A., Tyler-Kabara, E. C., Cohen, L. G., Birbaumer, N., et al. (2010). Neural interface technology for rehabilitation: exploiting and promoting neuroplasticity. Phys. Med. Rehabil. Clin. N. Am. 21, 157–178. doi: 10.1016/j.pmr.2009.07.003
Weintraub, S., and Mesulam, M. -M. (1985). "Mental state assessment of young and elderly adults in behavioral neurology," in Principles of Behavioral Neurology, ed M. -M. Mesulam (Philadelphia, PA: F. A. Davis), 71–123.
Wilson, J. A., Schalk, G., Walton, L. M., and Williams, J. C. (2009). Using an EEG-based brain-computer interface for virtual cursor movement with BCI2000. J. Vis. Exp. 21, 1319. doi: 10.3791/1319
Wilson, J. A., Walton, L. M., Tyler, M., and Williams, J. (2012). Lingual electrotactile stimulation as an alternative sensory feedback pathway for brain-computer interface applications. J. Neural Eng. 9, 045007. doi: 10.1088/1741-2560/9/4/045007
Wilson, R. D., Bryden, A. M., Kilgore, K. L., Makowski, N., Bourbeau, D., Kowalski, K. E., et al. (2019). Neuromodulation for functional electrical stimulation. Phys. Med. Rehabil. Clin. N. Am. 30, 301–318. doi: 10.1016/j.pmr.2018.12.011
Wolpaw, J. R.. (2012). Harnessing neuroplasticity for clinical applications. Brain 135(Pt 4), e215; author reply e216. doi: 10.1093/brain/aws017
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., and Vaughan, T. M. (2002). Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 767–791. doi: 10.1145/1941487.1941506
Wolpaw, J. R., McFarland, D. J., Neat, G. W., and Forneris, C. A. (1991). An EEG-based brain-computer interface for cursor control. Electroencephalogr. Clin. Neurophysiol. 78, 252–259. doi: 10.1016/0013-4694(91)90040-b
Wong, D. L., and Baker, C. M. (1988). Pain in children: comparison of assessment scales. Okla. Nurse 33, 8.
Yesavage, J. A., Brink, T. L., Rose, T. L., Lum, O., Huang, V., Adey, M., et al. (1982). Development and validation of a geriatric depression screening scale: a preliminary report. J. Psychiatr. Res. 17, 37–49. doi: 10.1016/0022-3956(82)90033-4
Young, B. M., Nigogosyan, Z., Remsik, A., Walton, L. M., Song, J., Nair, V. A., et al. (2014a). Changes in functional connectivity correlate with behavioral gains in stroke patients after therapy using a brain-computer interface device. Front. Neuroeng. 7:25. doi: 10.3389/fneng.2014.00025
Young, B. M., Nigogosyan, Z., Walton, L. M., Remsik, A., Song, J., Nair, V. A., et al. (2015). Dose-response relationships using brain-computer interface technology impact stroke rehabilitation. Front. Hum. Neurosci. 9:361. doi: 10.3389/fnhum.2015.00361
Young, B. M., Stamm, J. M., Song, J., Remsik, A. B., Nair, V. A., Tyler, M. E., et al. (2016). Brain-computer interface training after stroke affects patterns of brain-behavior relationships in corticospinal motor fibers. Front. Hum. Neurosci. 10:457. doi: 10.3389/fnhum.2016.00457
Keywords: brain-computer interface, functional electrical stimulation, stroke, motor functional recovery, closed-loop system, open-loop system, neurorehabilitation, motor recovery
Citation: Remsik AB, van Kan PLE, Gloe S, Gjini K, Williams L Jr, Nair V, Caldera K, Williams JC and Prabhakaran V (2022) BCI-FES With Multimodal Feedback for Motor Recovery Poststroke. Front. Hum. Neurosci. 16:725715. doi: 10.3389/fnhum.2022.725715
Received: 15 June 2021; Accepted: 26 May 2022;
Published: 06 July 2022.
Edited by:
Takufumi Yanagisawa, Osaka University, JapanReviewed by:
Bradley Jay Edelman, Max Planck Institute of Neurobiology (MPIN), GermanyMurat Akcakaya, University of Pittsburgh, United States
Copyright © 2022 Remsik, van Kan, Gloe, Gjini, Williams, Nair, Caldera, Williams and Prabhakaran. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alexander B. Remsik, aremsik@wisc.edu