Front. Neurol., 04 September 2017
Sec. Stroke

Neural Patterns of Reorganization after Intensive Robot-Assisted Virtual Reality Therapy and Repetitive Task Practice in Patients with Chronic Stroke

  • 1Human Performance and Engineering Research, Kessler Foundation, West Orange, NJ, United States
  • 2Department of Rehabilitation and Movement Science, Rutgers University, Newark, NJ, United States
  • 3Department of Biomedical Engineering, NJIT, Newark, NJ, United States
  • 4Department of Physical Therapy, Movement, and Rehabilitation Science, Northeastern University, Boston, MA, United States
  • 5Department of Bioengineering, Northeastern University, Boston, MA, United States
  • 6Department of Biology, Northeastern University, Boston, MA, United States

Several approaches to rehabilitation of the hand following a stroke have emerged over the last two decades. These treatments, including repetitive task practice (RTP), robotically assisted rehabilitation and virtual rehabilitation activities, produce improvements in hand function but have yet to reinstate function to pre-stroke levels—which likely depends on developing the therapies to impact cortical reorganization in a manner that favors or supports recovery. Understanding cortical reorganization that underlies the above interventions is therefore critical to inform how such therapies can be utilized and improved and is the focus of the current investigation. Specifically, we compare neural reorganization elicited in stroke patients participating in two interventions: a hybrid of robot-assisted virtual reality (RAVR) rehabilitation training and a program of RTP training. Ten chronic stroke subjects participated in eight 3-h sessions of RAVR therapy. Another group of nine stroke subjects participated in eight sessions of matched RTP therapy. Functional magnetic resonance imaging (fMRI) data were acquired during paretic hand movement, before and after training. We compared the difference between groups and sessions (before and after training) in terms of BOLD intensity, laterality index of activation in sensorimotor areas, and the effective connectivity between ipsilesional motor cortex (iMC), contralesional motor cortex, ipsilesional primary somatosensory cortex (iS1), ipsilesional ventral premotor area (iPMv), and ipsilesional supplementary motor area. Last, we analyzed the relationship between changes in fMRI data and functional improvement measured by the Jebsen Taylor Hand Function Test (JTHFT), in an attempt to identify how neurophysiological changes are related to motor improvement. Subjects in both groups demonstrated motor recovery after training, but fMRI data revealed RAVR-specific changes in neural reorganization patterns. First, BOLD signal in multiple regions of interest was reduced and re-lateralized to the ipsilesional side. Second, these changes correlated with improvement in JTHFT scores. Our findings suggest that RAVR training may lead to different neurophysiological changes when compared with traditional therapy. This effect may be attributed to the influence that augmented visual and haptic feedback during RAVR training exerts over higher-order somatosensory and visuomotor areas.


Recovery of hand function is challenging after stroke. Empirical data suggest that treatment can be beneficial if it includes many repetitions of challenging and meaningful tasks (13). Several approaches to delivering high volume, intense, and salient rehabilitation activities have emerged over the last two decades. These treatments, which include repetitive task practice (RTP), robotically assisted rehabilitation, and virtual rehabilitation activities, produce improvements in hand function that exceed the standard of care in the US (4, 5).

Although a strong case has been made that virtual reality (VR) and robotics can be useful technologies for delivering challenging, meaningful, and mass practice, outcome studies investigating the true benefits of VR/robotics as compared to dose-matched RTP remain mixed (6, 7). For example, we have shown significant group-level improvement in hand and arm function of chronic stroke survivors in response to RTP and robot-assisted VR (RAVR) training to be similar for both groups (8), a finding that agrees with group-level effects in other clinical studies (9, 10). However, whether the underlying neural patterns of reorganization that are induced by the different training regimes are also similar remains unknown. This becomes important to understand because it may inform researchers and clinicians whether RAVR versus RTP may preferentially facilitate distinct neural patterns of reorganization. If so, then perhaps the therapy choice can be tailored more appropriately to individuals to elicit optimal benefits.

The goal of this study was to compare the effect of RAVR- and RTP-based interventions on neural pattern reorganization. Because neural reorganization likely reflects complex processes that include the formation of new connections and/or re-weighting of existing connections, the patterns that emerge are unlikely to be reliably captured using one proxy of activation. For example, while numerous studies have shown training-induced changes in the extent of brain activity, the results of those studies conflict in terms of whether the changes reflect an increase or a decrease in brain activity (1115). Second, there seems to be a relationship between the pattern of reorganization (increase or decrease in ipsilesional somatosensory activation) and intactness of the hand knob area of M1 and its descending motor fibers (16), and a dependence on whether the lesion is cortical or subcortical (17). Connectivity measures may be a complementary way to understand neural reorganization patterns underlying stroke recovery (18) by providing additional information about dynamic network-level changes above and beyond what can be inferred from extent and laterality of activation (19, 20).

In this study, we therefore characterize the pattern of neural reorganization using multiple measures that included the magnitude of change in brain activation, the extent of activation, the re-lateralization of brain activation in a set of homologous interhemispheric regions of interest, and interactions between multiple regions of interest based on measures of functional and effective connectivity. To our knowledge, this is the first study to characterize brain reorganization at the ROI and network interaction level with multiple functional magnetic resonance imaging (fMRI) measures before and after RAVR and RTP training. In order to delineate the relevance of brain reorganization after training, we also correlated the brain activation outcomes with clinical outcome measures.

We hypothesized that both treatments might have similar effects on the magnitude and laterality of activation in a given region of interest. However, because RAVR training provides a training environment that is enriched and augmented with visual and haptic feedback, we expected that the functional and effective connectivity between motor/premotor cortices and visuomotor areas like the superior parietal lobule may show stronger effects in the RAVR group, as compared to the RTP-based training group (2125). We propose that identifying the neurophysiologic correlates of behavioral motor function improvement might allow strategic refinement of existing training approaches and the development of individually tailored interventions.

Materials and Methods


Data for a total of 19 subjects, who participated in a previous non-randomized controlled trial (8) and who were eligible for MRI, were analyzed to study neural reorganization associated with each type of therapy. Ten subjects participated in the RAVR group (2F, mean age ±1 SD: 59.6 ± 10.6 years), and nine subjects participated in the RTP group (3F, 57 ± 12.8 years). Table 1 shows subjects’ demographics and baseline clinical information, including a sum of the Modified Ashworth Scale scores for elbow flexors, wrist flexors, and finger flexors (26), and Chedoke-McMaster Impairment Inventory stages for the arm and hand (27, 28). All subjects had ischemic stroke except S7 in the RTP group, whose stroke was hemorrhagic. Inclusion criteria included (1) age between 18 and 80 years, (2) chronic phase of stroke (>6 months), (3) at least 20° of active wrist extension, (4) at least 10° of active finger extension, and (5) meeting safety standards for participating in fMRI. Exclusion criteria included (1) aphasia that would limit the ability to follow verbal instructions, (2) spatial neglect rendering a patient unable to interact with a 28-inch wide workspace and with the robot safely, and (3) participation in other upper extremity therapies during the study. Subjects for the RTP group of the study were recruited consecutively in a period of few months, while subjects in the RAVR group were chosen from a larger sample of subjects participating in a study of virtually simulated UE rehabilitation based on eligibility to participate in MRI testing.


Table 1. Subjects’ clinical information.


Subjects in both groups were trained 4 days a week, 3 h per day, for 2 weeks. Every effort was made to match to the dosage of training in both groups and to adapt the level of difficulty to each individual’s performance within and across sessions so that all subjects remained engaged and appropriately challenged.

RAVR Group

Subjects participated in a 2-week training program known as New Jersey Institute of Technology RAVR (NJIT-RAVR) training. Training involved reaching for and interacting with stationary and moving virtual targets and objects in 3D space (Figure 1). Robot assistance was tailored to the individual needs of each patient and was dynamically monitored by sensor instrumentation on the robot during each movement trial. An algorithm was used to adjust the assistance based on real-time evaluation of hand velocity or active force, i.e., if the subject did not produce movement (based on recorded velocity and force) above predefined thresholds, or did not respond within 5 s of movement cue onset, the robot was actuated to provide assistance. The NJIT-RAVR intervention is explained in greater details in our previous publications (29, 30).


Figure 1. (A,B) The robotic arm, a data glove and force-reflecting hand system used in the robot-assisted virtual reality therapy. (C) Virtual reality feedback during the fMRI movement task. For each hand, one arrow points to the starting position of the hand (open) and another arrow defines the magnitude of finger flexion during the task.

RTP Group

The 2-week training was designed based on the shaping component from the EXCITE trial (31) and a taxonomy of activities (32). Training included “reach and grasp” exercises and functional tasks. Some of the tasks required unilateral movements (e.g., coin sorting, writing, carrying objects, feeding, and using a calculator), and others required bilateral hand and arm coordination (e.g., cooking, dressing, and building with small and large objects). The RTP training is described in more details in Ref. (8).

Outcome Measures

Outcome measures included a battery of clinical tests to characterize functional changes and fMRI to characterize neural patterns of reorganization. The main outcome measurements were collected 1 day before the start of training (pre-test) and 1 day after the end of training (post-test).

Clinical Tests

Jebsen Taylor Hand Function Test (JTHFT) (33, 34) was used in quantifying motor function. The test is widely used in the literature and has excellent validity and reliability (35, 36).

Neurophysiology Test

Functional magnetic resonance imaging data were collected before and after subjects’ enrollment in the interventions, using the same protocols in both groups; data acquisition and outcome measures are described later.

MRI Data Acquisition

MRI data were acquired using a 3-T Siemens Allegra head-only scanner with a Siemens standard head coil. High-resolution structural images (T1-weighted images) were acquired using Magnetization-Prepared Rapid Gradient-Echo sequence (37), with TR = 2 s, TE = 4.38 ms, voxel size 0.938 × 0.938 × 1, 176 slices, and 1 mm slice thickness. T2-weighted images (echo planar imaging sequence) were acquired with TR = 2s, TE = 30 ms, FOV 220 mm × 220 mm, voxel size = 3.4 mm × 3.4 mm × 4 mm, 32 slices, and 62 ms inter-slice time.

Task during fMRI

During the fMRI experiments, subjects performed whole hand finger flexion with the paretic hand. Initiation and termination cues were provided by displaying the text cues “Go” or “Rest,” respectively. Two MRI-compatible fiber-optic instrumented gloves (5DT) were used to record 14 joint angles of both hands in real time to track finger flexion. Streaming data from the data gloves animated VR hand models displayed on the screen, thereby providing subjects with real-time visual feedback of their movement (38, 39). Subjects were cued to flex their fingers to meet a set of two visual targets, angled at 40 and 80% of their maximum range of motion, in a VR simulation. Prior to the experiment, each subject’s active range of finger motion was evaluated in order to set the targets’ angle properly. On each virtual hand, one arrow pointed to the starting position (hand open) and another pointed to the target (either 40 or 80% of the active range of motion). The starting position target prompted the subjects to return to the same starting position after each trial, and the goal target ensured that subjects were engaged in the experiment and performed consistent movements (Figure 1C). Non-paretic hand movement was also recorded to identify any uninstructed or mirror movements that could confound the fMRI results. The task trials’ (16 trials per target, 32 total) duration was 3 s; the trials were randomly interleaved within each functional run with inter-trial rest periods jittered and ranging in duration from 3 to 7 s. Data were collected from three functional runs for all subjects except two subjects who got tired after the second run. A total of 156 volumes were collected in each functional run.

fMRI Data Analysis


Functional magnetic resonance imaging data were preprocessed and analyzed using the Matlab®-based statistical parameter modeling software (SPM8; revision 4667). Structural and functional volumes of subjects with a left side lesion were flipped before preprocessing so that all subjects had a right-sided virtual lesion, enabling group-level averaging and statistics. Each subject’s functional volume was manually re-oriented to the AC-PC line, realigned to the first volume, and co-registered with the structural image. Realignment to the first volume showed that motion did not exceed 3 mm in all X, Y, or Z directions, in all subjects’ datasets; therefore, no data were excluded based on motion artifacts. Stroke lesions were mapped in MRIcron using the high-resolution structural image, and unified segmentation (40) was used to segment structural images after masking out the lesioned area. Normalization of the data was optimized by using the DARTEL toolbox (41) consistent with established approaches and using cost function masking (4043). Functional images were smoothed using an 8-mm full width at half maximum Gaussian kernel.

General Linear Modeling (GLM) Analysis

Data of the two testing sessions, before and after therapy, were incorporated in one GLM to correlate brain activity with the hand movement functional task. Movement kinematics (movement amplitude and movement duration) were analyzed, and trials in which subjects did not comply with task instructions were excluded. Trial onset and duration were defined based on recorded finger movement data instead of onset and duration of movement cues.

Magnitude of Activation

Regression maps based on GLM analysis were analyzed, and the main contrasts of interest included (a) move > rest in the pre-test session, (b) move > rest in the post-test session, (c) post-test > pre-test, (d) pre-test > post-test, and (e) effect of interest (F test). The contrasts were done within a region of interest that included gray matter.

Interhemispheric Balance

Laterality index (LI) is a measure of balance in brain activity between the two brain hemispheres; a value of 1 indicates the complete dominance of the contralesional (left) hemisphere and a value of −1 indicates complete dominance of the ipsilesional (right) hemisphere (44, 45). Interhemispheric balance was computed using the LI toolbox and included the sensorimotor areas (pre-central + post-central gyri) as a region of interest (46). The following equation shows the formula used to calculate LI:

LI=contralesional hemisphere # of voxelsipsilesional hemisphere # of voxelscontralesional hemisphere # of voxels+ipsilesional hemisphere # of voxels

Functional Connectivity of Ipsilesional Motor Cortex (iMC)

Changes in functional connectivity between the iMC and the rest of the brain were investigated using generalized psychophysiological interaction (gPPI) (47) analysis. The seed voxel for gPPI analysis was defined as the most active cluster (eight voxels within the cluster) in the iMC (contralateral to the moving hand). This analysis was used to compare the regression maps of iMC before and after therapy (in both groups): (a) regression map post-test > regression map pre-test and (b) regression map pretest > regression map post-test.

Effective Connectivity

Functional connectivity measures the correlation among brain regions regardless of the direction of influence, while effective connectivity measures the dynamic (time dependent) influence of one region on the other (48). Effective connectivity between bilateral motor areas and unidirectional connectivity from ipsilesional premotor, supplementary motor, and somatosensory areas to ipsilesional MC was analyzed using dynamic causal modeling (49, 50). The regions of interests were picked from the average move > rest contrast in each group. One model was created, assuming bilateral connectivity between contralesional motor cortex (cMC) and iMC, and unilateral modulatory input from ipsilesional premotor (iPMv), ipsilesional primary sensory (iS1), and ipsilesional supplementary motor area (iSMA) to iMC. This full model was estimated (in SPM8, DCM10) for each of the datasets. DCM A parameters represent the endogenous connectivity between nodes in the full model, and B parameters represent the modulation (increase or decrease) of this endogenous connectivity during the moving task. A and B parameters were added, and the DCM (A + B) parameters were compared between the two testing days and between the two groups using non-parametric Mann–Whitney U test. Subject 8 in the RTP group was excluded from this analysis because his brain lesion involved major ipsilesional hemisphere ROIs included in the DCM analysis.

Statistical Tests

Non-parametric statistical tests were used to compare the changes in outcome measures. The statistical non-parametric modeling toolbox (51, 52) was used to compare the change in brain activity after training in each group. Possible interaction between training group and training effect was tested using the Sandwich Estimator (SwE) toolbox (53), which is a tool for longitudinal and repeated measures fMRI data. Statistical threshold was set at p < 0.05 with family-wise error correction. Change in LI, the extent of brain activity, and DCM parameters were studied using the non-parametric Mann–Whitney U test in STATVIEW software. Within group, between sessions paired comparison tests were performed using Wilcoxon signed rank test. The statistical threshold in the Mann–Whitney U test and Wilcoxon signed rank test was set at p < 0.05. The relationship between changes in neurophysiology (extent of activity, lateralization, and connectivity) and (1) lesion volume, (2) performance after training based on JTHFT, and (3) ratio of change in JTHFT after training (post-test score–pre-test score) normalized to the pre-test score was studied using a non-parametric Spearman rank correlation test. Regression analysis was performed using the STATVIEW toolbox as well, and statistical threshold was set at p < 0.05.



The main outcomes of the JTHF clinical test are shown in Table 2. At baseline, there was no statistical difference in the JTHFT between the two groups (Z = −0.41, p = 0.68). Both groups showed improvement in the JTHFT score, with the percentage change reaching statistical significance in the RAVR (Z = −2.8, p = 0.005) but not in the RTP group. There was no significant between-group difference in the change in JTHFT scores.


Table 2. Percent change in Jebsen Taylor Hand Function Test (JTHFT) score in both groups.

Movement Performance during fMRI

Repeated measures ANOVA showed no significant difference in movement kinematics (movement amplitude and duration) during the fMRI task between the two testing days and between the groups, suggesting that subjects performed similarly consistent movements during fMRI. Thus, any differences in brain activation (across days or groups) are unlikely to be attributed to in-scan performance but rather due to training-induced patterns in activation.

Between-Group and Within-Group Comparisons of fMRI Data across Sessions

Change in Extent and Magnitude of Activation

The SwE toolbox (53), for non-parametric contrast comparisons, was used to analyze changes in activation magnitude for factors: training group and test time. The activation magnitude in the cerebellum, left temporal lobe, and right precentral gyrus was significantly reduced after RAVR-based training (Figure 2A, Table 3) but did not change in the RTP group (not shown). Figure 2B shows that there was also a significant decrease in the extent of activity in the RAVR group after training (Mann–Whitney U test, Z = −2.894, p = 0.0038) but did not significantly change in the RTP group (Mann–Whitney U test, Z = −1.04, p = 0.296).


Figure 2. (A) Within-subject non-parametric ANOVA test comparing pre-test and post-test functional magnetic resonance imaging BOLD signals (robot-assisted virtual reality group, family-wise error corrected p < 0.05). (B) Extent of activity in the gray matter, in terms of number of active voxels, in both groups sorted based on group and time.


Table 3. Functional magnetic resonance imaging (fMRI) results of robot-assisted virtual reality group effect of interest contrast (non-parametric within-subject comparison).

Interhemispheric Dominance

Interhemispheric dominance (44, 45), also referred to as a LI, represents a measure of which hemisphere is predominantly active over the other hemisphere, with a value of 0 representing equal activation, positive values representing greater activity contralesionally, and negative values representing greater activity ipsilesionally. Figure 3 shows considerable variability at the individual subject level in the pre-to-post changes in interhemispheric dominance; some subjects exhibited decreases in dominance of the contralesional hemisphere, while others exhibited increases in dominance of the ipsilesional hemisphere. This result is noteworthy, however, in the sense that both patterns represent a reduction of the dominance in the contralesional hemisphere—either bringing the balance closer to 0 between the two hemispheres after training or facilitating the dominance of the ipsilesional hemisphere. The change in LI after training was significantly different between groups (RAVR group LI median = −0.125, RTP group LI median = 0.07, Z = −2.21, p = 0.027), knowing that the baseline LI values were not significantly different between groups (Z = −1.68, p = 0.09).


Figure 3. Change in laterality index in the repetitive task practice and the robot-assisted virtual reality groups.

Change in Functional Connectivity with iMC

The connectivity maps with iMC as the seed region exhibited increases and decreases across different subjects. No significant difference between groups, or between the two testing days for both groups, and the pattern of change in the connectivity map for iMC was not related to lesion side (right or left), lesion site (cortical or subcortical), or impairment severity.

Change in Effective Connectivity

DCM parameters showed varying patterns of change across subjects of both groups. Figure 4A shows the DCM model that was tested for the effective connectivity analysis. Figure 4B shows the change in DCM parameters for both groups, including connectivity parameters from cMC, iPMv, iSMA, and iS1 to iMC. In the RAVR group, DCM connectivity parameters became consistently facilitatory subsequent to training, with facilitation of iMC by iS1 significantly increasing after training (Z = −2.07, p = 0.038). In the RTP group, none of the effective connectivity parameters changed significantly after training.


Figure 4. (A) DCM full model used to study connectivity between contralesional motor cortex, iS1, ipsilesional supplementary motor area, iPMv, and iM1. (B) Average change in DCM parameters (A + B) in both groups for each connectivity edge. Error bars show the SD. * denotes statistically significant difference.

Relationship between Neurophysiological and Clinical Measures

Relationship to Activation Extent

We explored the relationship between clinical outcomes and magnitude of brain activation for both groups by performing a regression analysis (using non-parametric Spearman rank correlation) between the ratio of change in the beta values of brain activation for seven ROIs (bilateral premotor, sensory, and motor areas and iSMA) and the ratio of change in JTHFT scores, final JTHFT scores after training, and lesion volume. The ROIs were selected based on the main contrast (move versus rest, combining both testing sessions) and on their anatomical location and role in sensorimotor control. We noted a significant correlation in the RAVR group but not in the RTP group for iMC (rho = −0.78, p = 0.0061), ventral premotor area (iPMv) (rho = −0.77, p = 0.009), and bilateral primary sensory areas [iS1 (rho = −0.79, p = 0.0006) and cS1 (rho = −0.85, p = 0.006)] (see Figure 5).


Figure 5. Regression analysis, the correlation between changes in BOLD signal beta signals, and ratio of change in Jebsen Taylor Hand Function Test in the robot-assisted virtual reality group. Solid lines show the fit of the data to shown equations.

Relationship to Interhemispheric Dominance

Combining the RAVR and RTP group data showed a positive correlation between the shift in LI toward the ipsilesional hemisphere (difference in LI between post-test and pre-test) and improvement in the clinical score (rho = 0.47, p = 0.048). The relationship between interhemispheric dominance and the change in JTHFT was not statistically significant within each group.

Relationship to Functional and Effective Connectivity of iMC

We found no significant relationship between the change in functional connectivity with iMC and the change in JTHFT after training, or with the lesion volume in both groups. Similarly, we found no significant correlation between the changes in DCM parameters and change in JTFHT. However, we did note that the change in DCM parameters from iS1 to iM1 significantly correlated with the post-test JTFHT score (rho = 0.73, p = 0.03), suggesting that there may be some importance to the connection between sensory and motor cortex in predicting the level of recovery.


The aim of this study was to investigate the effect of robot-assisted VR training, compared to RTP, on patterns of brain reorganization. Both training groups showed similar levels of functional recovery, consistent with other published studies comparing VR with other interventions (8, 54, 55). We hypothesized, however, that VR may engage different neural networks than RTP training and our hypothesis was partially supported. In the following sections, we discuss the results of each fMRI outcome measure (extent and magnitude of activity, lateralization, functional connectivity of iMC, and effective connectivity) and its relationship with change in clinical outcome measures.

Extent and Magnitude of BOLD Activity

Our data revealed a decrease in magnitude and extent of brain activation in the RAVR group that correlated with improvement in the JTHFT clinical score. Similar findings have been noted by others. For example, Johansen-Berg et al. (56) showed a positive correlation between motor improvement (using grip strength as outcome measure) and Z stats of magnitude of activity in premotor cortex, and sensory areas [see also Ref. (5759)]. It has been suggested that a reduction in brain activity that is observed after training might be attributed to the diminished overactivation such that less substitution is required to compensate for the lost function of injured areas (60, 61).

Interhemispheric Dominance

We noted a difference between the groups in the change in LI after training. The change was higher in the RAVR group, shifting toward more dominance of the ipsilesional hemisphere. The above change is consistent with what is typical observed with regard to interhemispheric balance over recovery. Specifically, in the early stages following a stroke, the shift in dominance toward the contralesional hemisphere is thought to arise because of compensatory processes that allow the non-lesioned hemisphere to compensate (59, 62). Over the course of recovery, contralesional dominance tends to decrease, or shifts toward the ipsilesional hemisphere (58, 63). Interestingly, RTP training did not lead to a pronounced change in interhemispheric dominance, suggesting that the greater visuomotor feedback received by the subjects in the RAVR group may have facilitated a shift of activation back to the lesioned hemisphere.

Functional and Effective Connectivity

Our DCM results, showing a strengthening between the iS1 and iMC ROIs, are consistent with (64), who also identified an association between higher levels of sensorimotor processing and higher levels of motor performance in persons with stroke. It is interesting that we did not note significant changes in connectivity between other nodes and iMC, for example, in contrast to Ref. (65) who noted a correlation between iSMA → iMC and cM1 → iM1 connectivity and hand performance, or Ref. (66) who noted a correlation between changes in iSMA → iMC and iPMv → iMC and motor recovery. It is possible that this difference in results between our study and those mentioned earlier may be due to the difference in the motor task used—single joint finger movement in the case of Grefkes et al. (65) and a naturalistic task that is part of the JTHFT used in our study, which may be characterized by greater variability of performance; and a difference in the stage of stroke—which <32 weeks in the case of Rehme et al. (66) and >36 weeks in the case of our study. The complex relationship between changes in the network and recovery and how this interacts with task and stage of recovery is an important issue that warrants significantly more investigation.

Study Limitations

One of the limitations of this study is the heterogeneity of the subject pool in terms of lesion characterization, time since stroke, and motor performance. While the sample heterogeneity may have made our results more generalizable, it likely also added variability to all of the outcome measures. Another limitation is that subjects were not randomly assigned to groups. The clinical results of that investigation have been published (8). While we acknowledge that random assignment would have been preferable, the clinical measures were similar at baseline for both groups. Any differences in brain activation patterns were unlikely to be explained potential differences in baseline status since these were consistent between groups. In addition, regression analysis was performed using several parameters (lesion volume, JTHFT after training, and ratio of change in JTHFT), but the lack of correlation between some of the neurophysiological variables and these measures might be due to the small sample size, the choice of ROIs, or the measure of recovery. While functional and effective connectivity measures were used to understand dynamic changes in neural networks after training, we did not acquire DTI tractography measures and resting-state functional connectivity, and this limitation hinders the ability to relate neurophysiological changes to cortico-spinal structural connectivity and interhemispheric and intra-hemispheric resting-state functional connectivity (67). Nonetheless, though it is tempting to attribute changes in neural reorganization to the intervention, these results should be interpreted with caution until larger scale RCT designs confirm these effects.


We found different patterns of reorganization for each group, with the RAVR group changes correlating with better improvement on clinical measures. The patterns of brain reorganization suggest that clinical improvement in the RTP group might have been driven by an adaptive compensatory process in the contralesional hemisphere, while improvement in the RAVR group may have been attributed more to reinstatement of activity of ipsilesional sensorimotor networks. As is often the case, there was no consistent single pattern of recovery exhibited by every subject, highlighting the need to understand patient-specific effects of interventions. However, the neural reorganization that was observed in the RAVR group was generally in line with expected patterns of recovery and suggests that VR and robotic assisted training may be a viable means of providing therapy to reinstate desirable changes in the brain.

Ethics Statement

All subjects provided written and verbal informed consents approved by Institutional Review Boards of the New Jersey Institute of Technology and Rutgers University prior to participating.

Author Contributions

SS did the fMRI data collection and data analysis and worked with SA and ET on disseminating the findings and with GF, SA, and ET on writing the manuscript. GF was involved in recruiting and screening participants, in administering the training interventions, collecting clinical data, and writing the manuscript. QQ performed the design and implementation of the virtual reality video games used in the interventions and in administering the training interventions. AM and SA were involved in designing and supervising the training interventions. ET designed the protocol of fMRI testing and was involved in data collection and data analysis and helped in disseminating the findings and in writing the manuscript.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.


The authors thank Dr. David Cunningham for his review and feedback on this article.


This work was supported by National Institute of Health grants R01NS085122 (ET), K01HD059983 (ET), and R01HD58301 (SA) and by NIDILRR grant 90RE5021 (SA and GF).


1. Kerr AL, Cheng SY, Jones TA. Experience-dependent neural plasticity in the adult damaged brain. J Commun Disord (2011) 44(5):538–48. doi:10.1016/j.jcomdis.2011.04.011

CrossRef Full Text | Google Scholar

2. Kleim JA, Jones TA. Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. J Speech Lang Hear Res (2008) 51(1):S225–39. doi:10.1044/1092-4388(2008/018)

CrossRef Full Text | Google Scholar

3. Nudo RJ. Recovery after brain injury: mechanisms and principles. Front Hum Neurosci (2013) 7:887. doi:10.3389/fnhum.2013.00887

CrossRef Full Text | Google Scholar

4. Mehrholz J, Werner C, Kugler J, Pohl M. Electromechanical-assisted training for walking after stroke. Cochrane Database Syst Rev (2007):(4). doi:10.1002/14651858.CD006185.pub2

CrossRef Full Text | Google Scholar

5. Pollock A, Farmer SE, Brady MC, Langhorne P, Mead GE, Mehrholz J, et al. Interventions for improving upper limb function after stroke. Cochrane Database Syst Rev (2014) 11:CD010820. doi:10.1002/14651858.CD010820.pub2

CrossRef Full Text | Google Scholar

6. Veerbeek JM, Langbroek-Amersfoor AC, van Wegen EE, Meskers CG, Kwakkel G. Effects of robot-assisted therapy for the upper limb after stroke: a systematic review and meta-analysis. Neurorehabil Neural Repair (2016) 31(2):107–21. doi:10.1177/1545968316666957

CrossRef Full Text | Google Scholar

7. Winstein CJ, Stein J, Arena R, Bates B, Cherney LR, Cramer SC, et al. Guidelines for adult stroke rehabilitation and recovery. Stroke (2016) 47(6):e98–169. doi:10.1161/STR.0000000000000098

CrossRef Full Text | Google Scholar

8. Fluet GG, Merians AS, Qiu Q, Rohafaza M, VanWingerden AM, Adamovich SV. Does training with traditionally presented and virtually simulated tasks elicit differing changes in object interaction kinematics in persons with upper extremity hemiparesis? Top Stroke Rehabil (2015) 22(3):176–84. doi:10.1179/1074935714Z.0000000008

CrossRef Full Text | Google Scholar

9. Henderson A, Korner-Bitensky N, Levin M. Virtual reality in stroke rehabilitation: a systematic review of its effectiveness for upper limb motor recovery. Top Stroke Rehabil (2007) 14(2):52–61. doi:10.1310/tsr1402-52

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Saposnik G, Teasell R, Mamdani M, Hall J, McIlroy W, Cheung D, et al. Effectiveness of virtual reality using WII gaming technology in stroke rehabilitation: a pilot randomized clinical trial and proof of principle. Stroke (2010) 41(7):1477–84. doi:10.1161/STROKEAHA.110.584979

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Cho S-H, Shin H-K, Kwon Y-H, Lee MY, Lee Y-H, Lee C-H, et al. Cortical activation changes induced by visual biofeedback tracking training in chronic stroke patients. NeuroRehabilitation (2007) 22(2):77–84.

PubMed Abstract | Google Scholar

12. Liepert J, Hamzei F, Weiller C. Lesion-induced and training-induced brain reorganization. Restor Neurol Neurosci (2004) 22(3–5):269–77.

PubMed Abstract | Google Scholar

13. Murayama T, Numata K, Kawakami T, Tosaka T, Oga M, Oka N, et al. Changes in the brain activation balance in motor-related areas after constraint-induced movement therapy; a longitudinal fMRI study. Brain Inj (2011) 25(11):1047–57. doi:10.3109/02699052.2011.607785

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Seitz RJ. How imaging will guide rehabilitation. Curr Opin Neurol (2010) 23(3):79–86. doi:10.1097/WCO.0b013e328334c84d

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Stark A, Meiner Z, Lefkovitz R, Levin N. Plasticity in cortical motor upper-limb representation following stroke and rehabilitation: two longitudinal multi-joint FMRI case-studies. Brain Topogr (2012) 25(2):205–19. doi:10.1007/s10548-011-0201-2

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Hamzei F, Liepert J, Dettmers C, Weiller C, Rijntjes M. Two different reorganization patterns after rehabilitative therapy: an exploratory study with fMRI and TMS. Neuroimage (2006) 31(2):710–20. doi:10.1016/j.neuroimage.2005.12.035

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Renner CIE, Schubert M, Jahn M, Hummelsheim H. Intracortical excitability after repetitive hand movements is differentially affected in cortical versus subcortical strokes. J Clin Neurophysiol (2009) 26(5):348–57. doi:10.1097/WNP.0b013e3181baaa86

CrossRef Full Text | Google Scholar

18. Grefkes C, Fink GR. Connectivity-based approaches in stroke and recovery of function. Lancet Neurol (2014) 13(2):206–16. doi:10.1016/S1474-4422(13)70264-3

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Veldsman M, Cumming T, Brodtmann A. Beyond BOLD: optimizing functional imaging in stroke populations. Hum Brain Mapp (2015) 36(4):1620–36. doi:10.1002/hbm.22711

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Westlake KP, Nagarajan SS. Functional connectivity in relation to motor performance and recovery after stroke. Front Syst Neurosci (2011) 5:8. doi:10.3389/fnsys.2011.00008

CrossRef Full Text | Google Scholar

21. Bagce HF, Saleh S, Adamovich SV, Tunik E. Visuomotor discordance in virtual reality: effects on online motor control. IEEE Eng Med Biol Soc (2011) 2011:7262–65. doi:10.1109/IEMBS.2011.6091835

CrossRef Full Text | Google Scholar

22. Cameirão MS, Badia SBI, Oller ED, Verschure PFMJ. Neurorehabilitation using the virtual reality based rehabilitation gaming system: methodology, design, psychometrics, usability and validation. J Neuroeng Rehabil (2010) 7(1):1. doi:10.1186/1743-0003-7-48

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Nirme J, Duff A, Verschure PF. Adaptive rehabilitation gaming system: on-line individualization of stroke rehabilitation. IEEE Eng Med Biol Soc (2011) 2011:6749–52. doi:10.1109/IEMBS.2011.6091665

CrossRef Full Text | Google Scholar

24. Rehme AK, Grefkes C. Cerebral network disorders after stroke: evidence from imaging-based connectivity analyses of active and resting brain states in humans. J Physiol (2013) 591(1):17–31. doi:10.1113/jphysiol.2012.243469

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Tunik E, Saleh S, Adamovich SV. Visuomotor discordance during visually-guided hand movement in virtual reality modulates sensorimotor cortical activity in healthy and hemiparetic subjects. IEEE Trans Neural Syst Rehabil Eng (2013) 21(2):198–207. doi:10.1109/TNSRE.2013.2238250

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Brashear A, Zafonte R, Corcoran M, Galvez-Jimenez N, Gracies JM, Gordon MF, et al. Inter- and intrarater reliability of the Ashworth scale and the disability assessment scale in patients with upper-limb poststroke spasticity. Arch Phys Med Rehabil (2002) 83(10):1349–54. doi:10.1053/apmr.2002.35474

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Gowland C, Stratford P, Ward M, Moreland J, Torresin W, Van Hullenaar S, et al. Measuring physical impairment and disability with the Chedoke-McMaster stroke assessment. Stroke (1993) 24(1):58–63. doi:10.1161/01.STR.24.1.58

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Gowland CK, Griffiths J, Stratford P, Barclay-goddard R. Chedoke-McMaseter Stroke Assessment; Development, Validation and Administration Manual (1995). Hamilton, ON: Chedoke-Mcmaster Hospitals (1995).

Google Scholar

29. Adamovich SV, August K, Merians A, Tunik E. A virtual reality-based system integrated with FMRI to study neural mechanisms of action observation-execution: a proof of concept study. Restor Neurol Neurosci (2009) 27(3):209–23. doi:10.3233/RNN-2009-0471

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Adamovich SV, Fluet GG, Merians AS, Mathai A, Qiu Q. Incorporating haptic effects into three-dimensional virtual environments to train the hemiparetic upper extremity. IEEE Trans Neural Syst Rehabil Eng (2009) 17(5):512–20. doi:10.1109/TNSRE.2009.2028830

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Wolf SL, Winstein CJ, Miller JP, Taub E, Uswatte G, Morris D, et al. Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: the EXCITE randomized clinical trial. JAMA (2006) 296(17):2095–104. doi:10.1001/jama.296.17.2095

CrossRef Full Text | Google Scholar

32. Hoffman LR, Field-Fote EC. Cortical reorganization following bimanual training and somatosensory stimulation in cervical spinal cord injury: a case report. Phys Ther (2007) 87(2):208–23. doi:10.2522/ptj.20050365

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Jebsen RH, Taylor N, Trieschmann RB, Trotter MJ, Howard LA. An objective and standardized test of hand function. Arch Phys Med Rehabil (1969) 50(6):311–19.

Google Scholar

34. Agnew P, Maas F. An Interim Australian Version of the Jebsen Test of hand function. Aust J Physiother (1982) 28(2):23–9. doi:10.1016/S0004-9514(14)60767-4

CrossRef Full Text | Google Scholar

35. Beebe JA, Lang CE. Relationships and responsiveness of six upper extremity function tests during the first six months of recovery after stroke. J Neurol Phys Ther (2009) 33(2):96–103. doi:10.1097/NPT.0b013e3181a33638

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Whitall J, Savin DN, Harris-Love M, Waller SM. Psychometric properties of a modified wolf motor function test for people with mild and moderate upper-extremity hemiparesis. Arch Phys Med Rehabil (2006) 87(5):656–60. doi:10.1016/j.apmr.2006.02.004

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Wang J, He L, Zheng H, Lu ZL. Optimizing the magnetization-prepared rapid gradient-echo (MP-RAGE) sequence. PLoS One (2014) 9(5):e96899. doi:10.1371/journal.pone.0096899

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Adamovich SV, Fluet GG, Mathai A, Qiu Q, Lewis J, Merians AS. Design of a complex virtual reality simulation to train finger motion for persons with hemiparesis: a proof of concept study. J Neuroeng Rehabil (2009) 6:28. doi:10.1186/1743-0003-6-28

PubMed Abstract | CrossRef Full Text | Google Scholar

39. August K, Lewis JA, Chandar G, Merians A, Biswal B, Adamovich S. FMRI analysis of neural mechanisms underlying rehabilitation in virtual reality: activating secondary motor areas. Conf Proc IEEE Eng Med Biol Soc (2006) 1:3692–5. doi:10.1109/IEMBS.2006.260144

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Ashburner J, Friston KJ. Unified segmentation. Neuroimage (2005) 26(3):839–51. doi:10.1016/j.neuroimage.2005.02.018

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Ashburner J. A fast diffeomorphic image registration algorithm. Neuroimage (2007) 38(1):95–113. doi:10.1016/j.neuroimage.2007.07.007

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Andersen SM, Rapcsak SZ, Beeson PM. Cost function masking during normalization of brains with focal lesions: still a necessity? Neuroimage (2010) 53(1):78–84. doi:10.1016/j.neuroimage.2010.06.003

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Brett M, Leff AP, Rorden C, Ashburner J. Spatial normalization of brain images with focal lesions using cost function masking. Neuroimage (2001) 14:486–500. doi:10.1006/nimg.2001.0845

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Jansen A, Menke R, Sommer J, Förster AF, Bruchmann S, Hempleman J, et al. The assessment of hemispheric lateralization in functional MRI-robustness and reproducibility. Neuroimage (2006) 33(1):204–17. doi:10.1016/j.neuroimage.2006.06.019

CrossRef Full Text | Google Scholar

45. Seghier ML. Laterality index in functional MRI: methodological issues. Magn Reson Imaging (2008) 26(5):594–601. doi:10.1016/j.mri.2007.10.010

CrossRef Full Text | Google Scholar

46. Wilke M, Lidzba K. LI-tool: a new toolbox to assess lateralization in functional MR-data. J Neurosci Methods (2007) 163(1):128–36. doi:10.1016/j.jneumeth.2007.01.026

CrossRef Full Text | Google Scholar

47. McLaren DG, Ries ML, Xu G, Johnson SC. A generalized form of context-dependent psychophysiological interactions (gPPI): a comparison to standard approaches. Neuroimage (2012) 61(4):1277–86. doi:10.1016/j.neuroimage.2012.03.068

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Friston KJ. Functional and effective connectivity: a review. Brain Connect (2011) 1(1):13–36. doi:10.1089/brain.2011.0008

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Friston KJ, Harrison L, Penny W. Dynamic causal modelling. Neuroimage (2003) 19(4):1273–302. doi:10.1016/S1053-8119(03)00202-7

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Stephan KE, Penny WD, Moran RJ, den Ouden HEM, Daunizeau J, Friston KJ. Ten simple rules for dynamic causal modeling. Neuroimage (2010) 49(4):3099–109. doi:10.1016/j.neuroimage.2009.11.015

CrossRef Full Text | Google Scholar

51. Nichols T, Holmes A. Nonparametric permutation tests for functional neuroimaging. In: Human Brain Function. 2nd ed. Academic Press (2003). p. 887–910.

Google Scholar

52. Winkler AM, Ridgway GR, Webster MA, Smith SM, Nichols TE. Permutation inference for the general linear model. Neuroimage (2014) 92:381–97. doi:10.1016/j.neuroimage.2014.01.060

CrossRef Full Text | Google Scholar

53. Guillaume B, Hua X, Thompson PM, Waldorp L, Nichols TE; Alzheimer’s Disease Neuroimaging Initiative. Fast and accurate modelling of longitudinal and repeated measures neuroimaging data. Neuroimage (2014) 94:287–302. doi:10.1016/j.neuroimage.2014.03.029

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Blefari ML, Sulzer J, Hepp-Reymond M-C, Kollias S, Gassert R. Improvement in precision grip force control with self-modulation of primary motor cortex during motor imagery. Front Behav Neurosci (2015) 9:18. doi:10.3389/fnbeh.2015.00018

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Kwakkel G, Kollen BJ, Krebs HI. Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review. Neurorehabil Neural Repair (2015) 22(2):111–21. doi:10.1177/1545968307305457

CrossRef Full Text | Google Scholar

56. Johansen-Berg H, Dawes H, Guy C, Smith SM, Wade DT, Matthews PM. Correlation between motor improvements and altered fMRI activity after rehabilitative therapy. Brain (2002) 125(12):2731–42. doi:10.1093/brain/awf282

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Carel C, Loubinoux I, Boulanouar K, Manelfe C, Rascol O, Celsis P, et al. Neural substrate for the effects of passive training on sensorimotor cortical representation: a study with functional magnetic resonance imaging in healthy subjects. J Cereb Blood Flow Metab (2000) 20(3):478–84. doi:10.1097/00004647-200003000-00006

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Pelicioni MCX, Novaes MM, Peres ASC, Lino De Souza AA, Minelli C, Fabio SRC, et al. Functional versus nonfunctional rehabilitation in chronic ischemic stroke: evidences from a randomized functional MRI study. Neural Plast (2016) 2016. doi:10.1155/2016/6353218

CrossRef Full Text | Google Scholar

59. Ward NS, Brown MM, Thompson AJ, Frackowiak RSJ. Neural correlates of motor recovery after stroke: a longitudinal fMRI study. Brain (2003) 126(Pt 11):2476–96. doi:10.1093/brain/awg245

CrossRef Full Text | Google Scholar

60. Baron J-C, Cohen LG, Cramer SC, Dobkin BH, Johansen-Berg H, Loubinoux I, et al. Neuroimaging in stroke recovery: a position paper from the first international workshop on neuroimaging and stroke recovery. Cerebrovasc Dis (2004) 18(3):260–7. doi:10.1159/000080293

CrossRef Full Text | Google Scholar

61. Ward NS, Brown MM, Thompson AJ, Frackowiak RSJ. Neural correlates of outcome after stroke: a cross-sectional fMRI study. Brain (2003) 126(6):1430–48. doi:10.1093/brain/awg145

CrossRef Full Text | Google Scholar

62. Bütefisch CM, Kleiser R, Körber B, Müller K, Wittsack H-J, Hömberg V, et al. Recruitment of contralesional motor cortex in stroke patients with recovery of hand function. Neurology (2005) 64(6):1067–9. doi:10.1212/01.WNL.0000154603.48446.36

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Feydy A, Carlier R, Roby-Brami A, Bussel B, Cazalis F, Pierot L, et al. Longitudinal study of motor recovery after stroke: recruitment and focusing of brain activation. Stroke (2002) 33(6):1610–7. doi:10.1161/01.STR.0000017100.68294.52

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Campfens SF, Zandvliet SB, Meskers CG, Schouten AC, van Putten MJ, van der Kooij H. Poor motor function is associated with reduced sensory processing after stroke. Exp Brain Res (2015) 233(4):1339–49. doi:10.1007/s00221-015-4206-z

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Grefkes C, Nowak DA, Eickhoff SB, Dafotakis M, Küst J, Karbe H, et al. Cortical connectivity after subcortical stroke assessed with functional magnetic resonance imaging. Ann Neurol (2008) 63(2):236–46. doi:10.1002/ana.21228

CrossRef Full Text | Google Scholar

66. Rehme AK, Eickhoff SB, Wang LE, Fink GR, Grefkes C. Dynamic causal modeling of cortical activity from the acute to the chronic stage after stroke. Neuroimage (2011) 55(3):1147–58. doi:10.1016/j.neuroimage.2011.01.014

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Carter AR, Shulman GL, Corbetta M. Why use a connectivity-based approach to study stroke and recovery of function? Neuroimage (2012) 62(4):2271–80. doi:10.1016/j.neuroimage.2012.02.070

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: stroke, virtual reality, rehabilitation, motor control and learning/plasticity, functional magnetic resonance imaging neuroimaging, connectivity analysis

Citation: Saleh S, Fluet G, Qiu Q, Merians A, Adamovich SV and Tunik E (2017) Neural Patterns of Reorganization after Intensive Robot-Assisted Virtual Reality Therapy and Repetitive Task Practice in Patients with Chronic Stroke. Front. Neurol. 8:452. doi: 10.3389/fneur.2017.00452

Received: 27 March 2017; Accepted: 15 August 2017;
Published: 04 September 2017

Edited by:

Pavel Lindberg, FR3636 Fédération de Recherche en Neurosciences des Saints Pères, France

Reviewed by:

Assia Jaillard, Université Grenoble Alpes, France
Michele Linda Callisaya, University of Tasmania, Australia

Copyright: © 2017 Saleh, Fluet, Qiu, Merians, Adamovich and Tunik. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Soha Saleh, ssaleh@kesslerfoundation.org