Personalized Motor-Cognitive Exergame Training in Chronic Stroke Patients—A Feasibility Study
Simone K. Huber
Jeremia P. O. Held
Eling D. de Bruin
Ruud H. Knols- 1Physiotherapy and Occupational Therapy Research Center, Directorate of Research and Education, University Hospital Zurich, Zurich, Switzerland
- 2Department of Health Science and Technology, Institute of Human Movement Sciences and Sport, Swiss Federal Institute of Technology, ETH Zurich, Zurich, Switzerland
- 3Vascular Neurology and Neurorehabilitation, Department of Neurology, University Hospital Zurich, University Zurich, Zurich, Switzerland
- 4Division of Physiotherapy, Department of Neurobiology, Care Sciences and Society, Karolinska Institute, Stockholm, Sweden
- 5Department of Health, OST-Eastern Swiss University of Applied Sciences, St. Gallen, Switzerland
Purpose: Exergame training may be beneficial for improving long-term outcome in stroke patients. Personalized training prescription applying progression rules, is missing. We adapted a theory-based taxonomy for a rehabilitation approach using user-centered exergames. The aims were primarily to investigate the feasibility of this rehabilitation approach, and secondarily to evaluate its performance of personalizing training progression, as well as explore the effects on secondary outcomes.
Methods: Chronic stroke patients (≥ 18 years) were included, who were able to walk 10 meters and stand for 3 min. The rehabilitation approach was administered twice per week for 8 weeks. As primary outcome, feasibility was evaluated by comparing achieved rates of inclusion, adherence, compliance, attrition, motivation, and satisfaction to pre-defined thresholds for acceptance. Secondary outcomes were (1) perceived motor and cognitive task difficulty throughout the intervention; (2) measures collected during baseline and post-measurements—a gait analysis, the Timed-up-and-go test (TUG), several cognitive tests assessing attentional, executive, and visuospatial functions.
Results: Thirteen patients [median: 68.0 (IQR: 49.5–73.5) years, median: 34.5 (IQR: 12.25–90.75) months post-stroke] were included, of whom ten completed the study. Rates for inclusion (57%), adherence (95%), compliance (99%), motivation (77%), and satisfaction (74%) were acceptable, however, the attrition rate was high (23%). The perceived motor and cognitive task difficulty predominantly moved below the targeted range. We found a significant change in the TUG (p = 0.05, r = 0.46) and medium-to-large effect sizes (p > 0.05) for swing time of the affected leg, the asymmetry index, time needed for the Trail-making test (TMT) A and accuracy for the TMT B and the Mental Rotation Test (MRT; 0.26 ≤ r ≤ 0.46).
Discussion: The intervention was feasible with minor modifications necessary, which warrants a larger trial investigating the effects of the rehabilitation approach following the adapted taxonomy on mobility, gait and cognitive functions. Two main limitations of the rehabilitation approach were; (1) the taxonomy decoupled motor and cognitive progression, which may be improper as motor and cognitive learning is coupled; (2) separate subjective ratings were used to guide the progression. Future studies should develop an instrument to objectively assess motor-cognitive task difficulty for monitoring the progression of an exergame-based training.
Introduction
Stroke is a dominant global health burden and a major cause of long-term disability in adults (Feigin et al., 2016; Katan and Luft, 2018; Benjamin et al., 2019; Johnson et al., 2019). It can cause motor and cognitive impairments, depending on the involved brain region (Sun et al., 2014; Ursin et al., 2019). Despite carefully considered rehabilitation programs in the months following a stroke, full recovery is achieved only in a small proportion of stroke survivors (Gadidi et al., 2011). The majority of them, however, seem to reach a recovery plateau 6 months after stroke, which is typically at a lower functional level than before the stroke (Gadidi et al., 2011; McKevitt et al., 2011; Bernhardt et al., 2017). Intensive rehabilitation programs are then often terminated, leaving patients with residual impairments (Page et al., 2004; McKevitt et al., 2011). This can manifest by reduced mobility, gait functioning and cognitive ability, which limits stroke survivors in their independence and reduces quality of life (Mayo et al., 2002, 2009; De Wit et al., 2017). A further problem in chronic stroke survivors is physical deconditioning (Smith et al., 2012; Lennon et al., 2021), which increases the risk for secondary cerebrovascular diseases (Boulanger et al., 2018; Johnson et al., 2019; Lennon et al., 2021).
With intensive and continued rehabilitation, it is possible for chronic stroke patients to further regain and manage their impaired mobility, gait and cognitive functions (Ferrarello et al., 2011; Teasell et al., 2012; Lund et al., 2018; Cicerone et al., 2019). For continued rehabilitation interventions, physical exercise and cognitive training are recommended (Ferrarello et al., 2011; Gallanagh et al., 2011; Cumming et al., 2013). Different physical exercise regimes such as cardiorespiratory training, strength training, and neuromuscular training have improved mobility and gait in chronic stroke patients (Barak et al., 2016; Saunders et al., 2020). Moreover, physical activity has been found to improve cognitive functioning in chronic stroke (Oberlin et al., 2017). For cognitive rehabilitation, paper-and-pencil tasks and computerized cognitive training have been shown to beneficially affect specific cognitive abilities (e.g., working memory, attention and processing speed) (Yoo et al., 2015; Wentink et al., 2016; Cicerone et al., 2019). However, these programs often fail to show meaningful transfer effects to other cognitive domains or to daily-life tasks (Tiozzo et al., 2015; van de Ven et al., 2017). Recently, evidence has been emerging that approaches which combine motor and cognitive training, beneficially affect mobility, gait and cognitive functioning in older adults and neurological populations (Fritz et al., 2015; Levin et al., 2017; Stanmore et al., 2017; Mura et al., 2018). Such training approaches may, therefore, add to the possibilities to improve mobility, gait and cognitive outcome in chronic stroke (An et al., 2014; Tiozzo et al., 2015; Lee et al., 2017; Bo et al., 2019).
So-called Exergames are promising for simultaneous training of motor and cognitive functions (Herold et al., 2018). Exergames are active video games designed for a purpose beyond play (Michael and Chen, 2005; Rego et al., 2010), which require the trainee to perform whole-body movements (in contrast to finger movements in console gaming) to play the game and simultaneously challenge cognitive abilities (Herold et al., 2018). Their game-based character and the use of virtual reality (VR) can increase patients' motivation, therapy engagement and training intensity (Burdea, 2002; Shin et al., 2015; Swanson and Whittinghill, 2015; Johnson et al., 2016; Matallaoui et al., 2017; Zeng et al., 2017; Felipe et al., 2019; Lee et al., 2019). Exergames and VR methods in general were found to be feasible, safe and enjoyable in stroke patients, leading to higher adherence rates in rehabilitation interventions and may, thereby, promote improvements in functional outcome in the chronic stage after stroke (Iruthayarajah et al., 2017; Faria et al., 2018; Mura et al., 2018; Lee et al., 2019).
Personalization is important for rehabilitation programs, as it optimizes results and improves long-term adherence to the programs (Billinger et al., 2014). Exergames may be a powerful tool to personalize rehabilitation interventions, as they allow personalized therapy prescription according to the “FITT-VP” principles, including Frequency, Intensity, Time, Type, total Volume and Progression (Ruud et al., 2016; Medicine ACo et al., 2017). Nevertheless, a gap in current knowledge are schedules that enable such personalized therapy prescription for exergames, especially regarding personalized progression (Borghese et al., 2013). First steps to address this gap have been done using ‘Gentile’s taxonomy of motor learning' as a template for creating a personalized rehabilitation program using exergames (Borghese et al., 2013; Wüest et al., 2014) (more detailed information on this can be found in section “Adaption of Gentile's Taxonomy”). “Gentile's taxonomy of motor learning” is a systematic classification categorizing motor skills and movement according to two general dimensions of actions (Gentile, 1987; Laguna, 2008). So far, however, applications of this taxonomy were restricted to tailored progression and variability of motor tasks. As exergames are integrated motor-cognitive trainings and also cognitive training should be carefully and personally prescribed (Herold et al., 2018; Cicerone et al., 2019), it can be hypothesized that additionally considering cognitive tasks for the personalized progression may add further benefits in the long-term rehabilitation of chronic stroke patients. We, therefore, adapted “Gentile's taxonomy of motor learning” by adding a third cognitive dimension using customized and purpose-centered exergames.
The primary aim of this study was to examine the feasibility of this adapted taxonomy for use in the rehabilitation of mobility, gait, and cognitive functions in chronic stroke patients. We assumed that application of the adapted taxonomy would result in acceptable inclusion, adherence, compliance and attrition rates and that motivation and satisfaction with the training would be and stay high throughout the intervention period. As secondary aims, we (1) assessed whether applying the adapted taxonomy would ensure personalized perceived task difficulty throughout the intervention; and (2) wanted to gain first insight into possible effects of the rehabilitation approach on mobility, gait and cognitive functions in chronic stroke patients.
Materials and Methods
Study Design and Procedures
This study was a feasibility trial. The recruitment was facilitated by a physiotherapy center and a senior home in the Canton Zürich (Switzerland). Instructed physiotherapists and care staff pre-screened the patients and older adults at the study sites on having suffered a stroke and interest in a study participation and if so, made contact to the researchers. Participants were then screened on all eligibility criteria face-to-face or by phone call (see section “Participants and Sample Size Considerations” for a more detailed description) by trained movement scientists of the study team. If meeting all criteria, participants were informed about the study procedures, benefits, and risks and subsequently, if willing to participate, signed informed consent and underwent baseline measurements. Depending on their baseline time for the timed-up-and-go test, participants were assigned either to a basic or to an advanced training group. Participants who completed the test in more than 10 s were assigned to the basic group, while participants who needed 10 s or less were assigned to the advanced group (Bohannon, 2006). The intervention lasted 8 weeks and sessions were performed twice per week for 15–45 min. All sessions were performed on separate days of the week and in case possible, with at least one resting day between sessions (e.g., always on Monday and Wednesday). The session duration was progressed over time, adding 3 min of intervention after every week. The basic group started with 15 min of training in the first week and ended with 36 min in the last week, while the advanced group went from 24 to 45 min. This meets the lower border of recommendations for exergame and VR interventions in stroke patients and healthy older adults (Lee et al., 2019; Stojan and Voelcker-Rehage, 2019). As motor learning and cognitive functions were the target of the intervention, the intensity of the trainings was monitored by perceived task difficulty and guided by the adapted taxonomy (see section Adaptation of Gentile's Taxonomy). The study procedures are summarized in the Study Flowchart (Figure 1). This study was approved by the Ethical Committee of the ETH Zürich (approval nr. 2019-N-180).
Figure 1. Study flowchart, shows all study procedures and intervention details. B, basic training group; A, Advanced training group; Min, minutes of training in the respective week; VAS, visual analog scale; BREQ-3, Behavioral Regulation in Exercise Questionnaire; SSK, Sport- and Movement-specific Self-Concordance scale; TUG, Timed-up-and-go test; TMT, Trail making test; TAP, Test of attentional performance; MRT, mental rotation test.
Participants and Sample Size Considerations
Participants had suffered a stroke at least 6 months ago, and were adult (≥ 18 years), able to walk ten meters as well as stand for 3 min without assistance and German speaking. Participants were excluded if they suffered from a neglect, a hemi-anopsia, other neurological diseases or other progressive and uncontrolled diseases. Additionally, as this study was conducted during the COVID-19 pandemic, further eligibility criteria regarding high risk for a serious course of disease had to be complied with (acute, rapidly progressing or terminal illnesses, chronic respiratory disease, therapy or status weakening the immune system, cancer, adipositas, BMI ≥ 40). A sample size of 12 or more participants was targeted as for pilot and feasibility trials, at least 12 participants are recommended (Julious, 2005; Moore et al., 2011).
Exergame Device
The Dividat SENSO (Dividat AG, Schindellegi, Switzerland) exergame device, which consists of a pressure-sensitive plate and screen, was used. Trainees perform body weight shifts and step-based movements on the plate, which are used to control the cognitively demanding video games presented on the screen in front of them (Figure 2A). The plate is divided into five sub-plates, under which twenty sensors are placed to detect information on center of pressure position and movement timing (Figure 2B). This information is used by the system to provide real-time feedback to the gamer's performance. Visual and auditory feedback is given by the games on the screen, while the sub-plates vibrate to additionally give tactile feedback and pronounce the visual and auditory feedbacks. This enables the participant to interact with the video games. A selection of games is available, each of which is specified and graded for different motor and cognitive functions. The plate is equipped with a handrail on three sides to ensure safety of the participant and prevent falls (Figure 2A).
Figure 2. (A) A participant training on the Dividat SENSO (Dividat AG, Schindellegi, Switzerland). (B) Top view of the pressure-sensitive plate of the Dividat SENSO, showing the position of the sensors.
Adaptation of Gentile's Taxonomy
The rehabilitation approach was based on ‘Gentile’s taxonomy of motor learning' (Gentile, 1987; Laguna, 2008), which is a skill progression platform structured along two dimensions with four sub-dimensions each: environmental context (stationary vs. in-motion scheme and inter-trial variability vs. no inter-trial variability) and action function (body stability vs. body transport each with and without object manipulation), resulting in 16 motor skill categories (Laguna, 2008). This two-dimensional structure can easily be adapted to training using virtual environments. For patients with low skill levels an environment can be designed with low action task constraints and no distracting features in the virtual environment. When a game under these initial conditions is performed well, the environment, the action function, or both can be manipulated and made more complex. This enables stepwise progression through the framework. Used this way Gentile's taxonomy provides an “ecologically valid” practical and daily-life relevant way of motor learning. Due to the properties of the exergame device, the sub-dimensions “stationary vs. in-motion” as well as “without object manipulation vs. with object manipulation” were not distinguished within the adapted taxonomy for this study.
The adaption was performed in two steps. (1) We added one sub-dimension to both axes (environment, action) to provide variability in levels and to fully exploit the variety in possible motor and cognitive tasks of the Dividat SENSO. This defined three sub-dimensions for the environmental context (no inter-trial variability, partial inter-trial variability, inter-trial variability) and three sub-dimensions for the action function context (body stability, partial body transport, body transport). For the latter, we defined the three sub-dimensions as follows (see also Table 1); (1) body stability contained tasks during which the center of pressure (COP) moved within stable limits of stability; (2) in partial body transport, the COP moved within moderately changing limits of stability; and (3) in body transport, the COP moved within constantly and rapidly changing limits of stability. This resulted in nine motor skill categories with different levels regarding “body stability vs. body transport” and “no inter-trial variability vs. inter-trial variability” (Table 1). (2) For adding a cognitive dimension, we further sub-divided each of these motor skill categories into four sub-categories; one for each of four different cognitive domains, which are targeted with the available games (attention, executive, memory, and visuo-spatial functions). Finally, the adapted taxonomy consisted of 36 skill sub-categories, which offered different motor skill levels in combination with different cognitive challenges (Figure 3A). Due to limited possibilities to adapt all games to all skill categories and a lack of games targeting the domain memory, some of these 36 skill sub-categories remained empty for this study (Figure 3A).
Table 1. Adapted taxonomy with 9 motor skill categories (after step 1 of the adaptation).
Figure 3. (A) The final adapted taxonomy and two “position squares” of a first and second training. (B) Visual analog scale, which were used to rate perceived motor and cognitive task difficulty after each training session, and the scale indicating the ranges for no (green), soft (yellow), and hard (red) progression. Two possible rating locations are indicated (red lines), which would lead to the shift of the red “position square” of the first training to the green “position square” for the second training in (A).
To comply with the training principles of personalized intensity and progression [FITT-VP principles for training prescription (Ruud et al., 2016; American College of Sports et al., 2018)], we developed progression rules guided by subjective ratings of the “perceived task difficulty” (Bratfisch, 1972; Paas et al., 2003; Sweller et al., 2011), rated on a visual analog scale (VAS) from 0 (“very very easy”) to 9 (“very very difficult”) after each training session (Figure 3B) by the participants. These ratings were used to propose the next training session. Based on the “Cognitive Load Theory,” we targeted a task difficulty ranging from “neither easy nor difficult” to “difficult” (Sweller, 2011). Therefore, a rating within this range resulted in no progression, meaning no shift of the “position square” (compare section Intervention/Personalized Exergame Training) before the next training. Was the rating lower than the target range, either a soft progression (Figure 3B, yellow range) or a hard progression (Figure 3B, red range) was administered, increasing the level by moving to the right and to the bottom of the table, respectively. A soft progression moved the “position square” one sub-category and a hard progression moved it two sub-categories. In case of a rating higher than the target range, the soft or hard progression was administered in opposite direction, decreasing the level of difficulty. The location of the cognitive rating guided the progression on the y-axis of the taxonomy, while the motor rating was used to guide the progression on the x-axis (see example Figure 3B).
Intervention/Personalized Exergame Training
A “position square” defined both motor skill difficulty levels and cognitive content of each training session (see Figure 3A, e.g., red square). Each training session consisted of a 3-min warm-up, a main part (9–39 min depending on group assignment and time point in the intervention) and a 3-min cool-down. Both, the warm-up and cool-down games were chosen from the top-left sub-category within the “position square,” as this contained the games with the lowest motor and cognitive levels according to the taxonomy. The warm-up and cool-down games should provide a motivating start and a feeling of success at the end of the session, respectively. The main part of the training was composed of games from the remaining three sub-categories, which lasted between 60 and 180 s each. The games were arranged so that sufficient variability was provided and that the perceived task difficulty increased after the warm-up, reached a peak in the last third of the main part and then decreased again toward the cool-down. Participants could take breaks or end the training session at all times, if the sessions were too long, if they were overcharged with the tasks or if they felt they did not intend to continue. All training sessions were supervised one-to-one by trained movement scientists of the study team and took place face-to-face in the physiotherapy center and senior home.
Measures
All data collection including primary and secondary outcomes was performed by trained movement scientists of the study team and took place face-to-face in the physiotherapy center and senior home. As primary outcome, the feasibility data were collected during the screening process and the training sessions (see Table 3). Regarding adherence, sixteen training sessions were planned for all participants. In case a session had to be canceled, it was replaced if possible, which could lead to a moderate extension of the 8 weeks intervention period. To determine compliance, completed training time was divided by the total planned training time, which was defined by the group assignment (basic or advanced) and the time point in the intervention (see section Study Design and Procedures). As participants could end training sessions earlier, completed training time could be lower than planned training time. To assess motivation and satisfaction with the trainings, participants rated their motivation and satisfaction on visual analog scales ranging from 0, “Not all motivated/satisfied” to 10, “Totally motivated/satisfied” collected after each training session (Supplementary Material 1).
To further explore the performance of the taxonomy and progression rules, the secondary outcomes included the VAS ratings of the perceived motor and cognitive task difficulty and the individual trajectories through the taxonomy of the participants. Further secondary outcomes were motor and cognitive assessments conducted during the baseline and post-measurements to gain a first insight into possible training effects. Two movement scientists were present during each measurement session, one of them performing the assessments and the other one securing the participant during upright activities to prevent falls. A gait analysis was conducted using Physilog® sensors (Gait up Sàrl, Lausanne, Switzerland), which have been shown to deliver valid and reproducible results for spatiotemporal gait analysis in stroke patients (Lefeber et al., 2019). The assessment followed the protocol for the “Figure-of-8 Walk Test” (F8W) by Hess et al. (2010), which is feasible and meaningful in stroke patients (Wong et al., 2013). Participants completed one F8W according to the protocol, while time was measured with a stopwatch. Then, the Physilog® sensors were switched on and the participants walked five F8Ws in a row to measure spatiotemporal gait parameters during straight and curved steady state walking. This procedure (1x F8W; 5x F8W) was repeated three times to capture at least fifty gait cycles, which is recommended for a reliable assessment of spatio-temporal gait parameters (Konig et al., 2014). From the output of the Physilog® gait analysis, values on “time needed for one F8W,” gait speed, asymmetry index (based on stride time), stride length variability, stride time variability, double support time, swing time, and swing width were collected. A Timed-up-and-go test (TUG) was conducted to measure functional mobility, following methods described previously (Ng and Hui-Chan, 2005)1. The participants performed the test three times, and the scores were then averaged. The TUG has been shown to be feasible, reliable and valid in stroke patients (Ng and Hui-Chan, 2005).
Cognitive outcomes included the Trail-making-test A and B [TMT A & B (Reitan and Skills, 1958; Bowie and Harvey, 2006)], the Mental-rotation-test [MRT, “Shepard and Metzler paradigm” (Shepard and Metzler, 1971)] and three sub-tests of the Test of Attentional Performance [TAP (Zimmermann and Fimm, 1992)], namely (i) Alertness test, (ii) Go-NoGo test and (iii) Incompatibility test. The TMT A and B are sub-tests to assess the general information-processing speed and executive functions, particularly mental flexibility, respectively. The TMT was found to be a valid and reliable test of these functions (Reitan and Skills, 1958; Wagner et al., 2011). The MRT is a measure of visuo-spatial skills, particularly the ability for mental rotation (Shepard and Metzler, 1971). The TMT and the MRT were conducted using a computer with PEBL software (Mueller and Piper, 2014). The TAP allows an appropriate and differentiated diagnosis of attentional deficits and the used sub-tests provide data on the simple reaction time, selective attention and inhibition as well as the reaction to an incompatible stimulus (Zimmermann and Fimm, 1992). The subtests of the TAP have been widely used in various populations including stroke survivors (Starovasnik Zagavec et al., 2015; Spaccavento et al., 2019).
Motivation for physical activity was assessed at baseline and post measurements to observe the influence of the exergame training on general motivation for being active. Participants answered the Behavioral Regulation in Exercise Questionnaire [BREQ-3, German version of the BREQ-2 (Mullan et al., 1997; Markland and Tobin, 2004)] and the Sport- and Movement-specific Self-concordance scale [SSK (Fuchs et al., 2005)]. Both assess the degree of self-determination in terms of exercise behavior. However, while the BREQ-3 covers motivational aspects for physical activity in general, the SSK is directed into the future and, therefore, provides information about the future intention toward physical activity. The analysis of the BREQ-3 and the SSK scale leads to scores for different sub-types of motivation, which can be used to evaluate the degree of self-determination participants have toward physical activity. Intrinsic, integrated and identified motivation represent different forms of self-determined motives for physical activity, while introjected and external motivation are linked to less self-determined motives (Markland and Tobin, 2004; Fuchs et al., 2005; Chemolli and Gagne, 2014). The BREQ-3 additionally investigates amotivation, which can be used to explain low ratings in other motivational domains (Markland and Tobin, 2004). For the SSK scale, the SSK index was additionally calculated, which is a summary score integrating all motivation subtypes. A higher SSK index stands for higher self-determination in physical activity and vice versa (Fuchs et al., 2005).
Feasibility Analysis
The feasibility of the rehabilitation approach was determined using a pre-defined feasibility protocol including six parameters with thresholds (see Supplementary Material 2). The feasibility criteria were defined to detect problems with the recruitment process (inclusion rate), the intervention itself (attrition and satisfaction rates), the frequency and time applied (adherence, compliance and attrition rates), as well as the personalized progression (adherence, compliance, motivation and satisfaction rates). Thresholds for the feasibility criteria were based on guidelines for inclusion (≥50%), adherence (≥80%), compliance (≥80%), and attrition (≤15%) (Nyman and Victor, 2011) and established from results from comparable studies for motivation (≥60%) and satisfaction (≥60%) (Bernardoni et al., 2019; Spildooren et al., 2019; van Beek et al., 2019). The feasibility protocol contained instructions on how to interpret the results in all possible scenarios according to the different feasibility outcomes as well as on how to continue with the rehabilitation approach in a subsequent study (Thabane et al., 2010).
Analysis of Secondary Outcomes
The evaluation of the perceived motor and cognitive task difficulty and the individual trajectories was performed to discover reasons why the rehabilitation approach did or did not achieve personalized progression of task difficulty. Therefore, the VAS ratings of perceived motor and cognitive task difficulty were averaged for each session and compared to a pre-defined target range of perceived task difficulty (Sweller, 2011). This and the exploration of the individual trajectories of each participant should give in-depth insight in the development of the perceived task difficulty and reveal over- and undercharging of the participants. The data of the remaining secondary outcomes were reported and analyzed non-parametrically (Field, 2013), therefore descriptive data were reported and represented as median and interquartile range. Within-subject changes from baseline to post measurements were analyzed with the Wilcoxon signed-rank test. Median differences with interquartile range, the test statistics T, p-values and effect sizes were provided for each outcome. As recommended for pilot feasibility trials the main emphasis of our trial was placed on feasibility and not on statistical significance (Thabane et al., 2010). Thus, due to the exploratory nature of the analysis for the secondary outcomes in this study, no correction for multiple comparisons was performed (Rothman, 1990; Bender and Lange, 2001; Althouse, 2016). Consequently, p-values must be interpreted with caution. The level of statistical significance was set to p < 0.05. Effect sizes were interpreted to be small (r < 0.30), medium (0.30 ≤ r < 0.5) and large (r ≥ 0.50) (Fritz et al., 2012). All statistical analyzes were performed using SPSS Statistics (version 26 for windows; IBM, Chicago, IL, USA).
Results
Participants Overview
Twenty-three possible participants were screened in March 2020 and from September to October 2020 of whom 13 were included (Figure 4). After having started recruiting, the study had to be postponed between April and August 2020 because of a national shutdown due to the COVID19 pandemic. The most common reason for non-inclusion was the inability of the participants to come to the study centers for the training sessions (Figure 4). Additionally, one screened patient had suffered a transient ischemic attack and was therefore excluded. Twelve participants of the included participants were recruited from the physiotherapy center and one participant lived in the senior home. This entailed that the majority (12 out of 13) of the participants received regular physical therapy (1 or 2 sessions of 30–60 min) beyond the training sessions of this study. Of the 13 initially included participants, 10 completed post-measurements while three dropped out of the study earlier. The reasons for the dropouts were the following; one participant wanted to stop the study participation due to fear of COVID19 infection at the study center; one participant suffered a severe flu (adverse event unrelated to the intervention) and was absent for several weeks, which made a continuation of the training impossible; one participant experienced an uncomfortable worsening of their head tremor after the first two trainings (adverse event related to the intervention), which forced them to stop the intervention. The participant flow is shown in Figure 4 and baseline characteristics are presented in Table 2.
Figure 4. CONSORT diagram of the participant flow.
Table 2. Baseline characteristics.
Feasibility
We found acceptable rates of inclusion (57%), adherence (95%), compliance (99%), motivation (77%), and satisfaction (74%), of which the highest was the compliance rate with almost full completion of planned training time (Table 3). The attrition rate (23%), however, was higher than the pre-study defined threshold set for acceptance. Mean motivation and satisfaction were rated “rather high” to “high” over the whole course of the intervention (Figure 5).
Table 3. Feasibility results.
Figure 5. Mean motivation and satisfaction ratings over all participants.
Secondary Outcomes
The mean perceived motor and cognitive task difficulty were rated from “rather easy” to “rather difficult” throughout the intervention period (Figure 6). The mean motor demand was generally rated higher than the mean cognitive demand. Participants moved in the taxonomy in individual ways (Figure 7 shows two example trajectories).
Figure 6. Mean ratings for perceived motor and cognitive task difficulty over all participants. Green area: targeted range of perceived task difficulty.
Figure 7. Trajectories of two participants (red, blue) showing their “path” through the taxonomy from the first to the sixteenth training session. Black dots represent the center of the respective “position squares”.
The parameters of the gait analysis remained similar from pre- to post-measurements and no meaningful changes were observed with predominantly small effect sizes (Table 4). The swing time of the affected leg showed a medium effect size (p = 0.21, r = 0.32) and the asymmetry index a small-to-medium effect size (p = 0.29, r = 0.26). The TUG improved significantly from pre- to post-measurements with a medium-to-large effect size (p = 0.05, r = 0.46, Table 4). None of the cognitive assessments showed changes from pre- to post-measurements, however, medium effect sizes were found for improvements in time needed for TMT A (p = 0.11, r = 0.35), in accuracy in the TMT B (p = 0.18, r = 0.30) and accuracy in the MRT (p = 0.15, r = 0.33, Table 5). Additionally, medium to large effect sizes were found for increased reaction times in the TAP incompatibility test for both, compatible (p = 0.12, r = 0.46) and incompatible (p = 0.25, r = 0.33) stimuli (Table 5). One participant was not able to perform the TMT with the computer mouse and therefore, the paper-and-pencil version was administered as an alternative. Differences in the number of participants who were included in the analyzes of the different assessments were caused by several reasons; (1) technical problems with the Physilog® sensors during one measurement (spatio-temporal gait analysis, Table 4); (2) inability of one participant to perform the motor assessments at the post measurements due to a temporary worsening of the physical condition (TUG and gait analysis, Table 4); and (3) inability of four participants to perform the cognitive tests with both hands (TAP Incompatibility, MRT, Table 5).
Table 4. Results secondary motor outcomes.
Table 5. Results secondary cognitive outcomes.
According to the BREQ-3, the intrinsic motivation for general physical activity of the participants decreased over the course of the intervention with a trend toward significance and a medium effect size, while the other types of motivation for physical activity were maintained (Table 6). The SSK showed a significant decrease in identified motivation for physical activity with a medium to large effect size and a non-significant decrease in external motivation with a medium effect size. The SSK index did not change (Table 6).
Table 6. Results secondary motivational outcomes.
Discussion
This study investigated the feasibility of a rehabilitation approach using exergames and following an adapted skill-progression taxonomy in chronic stroke patients. Furthermore, possible effects of the rehabilitation approach on mobility, gait, cognitive functions, and motivation for physical activity in chronic stroke patients were explored. We found that the rehabilitation approach was feasible in terms of inclusion, adherence, compliance, motivation and satisfaction, and that, however, the attrition rate exceeded the pre-defined threshold. Each participant moved on an individual path through the taxonomy, however, the VAS ratings of perceived motor and cognitive task difficulty moved below the targeted range. This and the high adherence, compliance, motivation and satisfaction rates indicate that the adapted taxonomy enabled personalized progression, which, however, still has potential for improvement in achieving optimal task difficulty. A significant improvement was found for the TUG test, while none of the other motor and cognitive outcomes showed changes. However, medium to large effect sizes were found for improvements in the swing time on the affected side, the time needed for the TMT A and the accuracy in the TMT B as well as in the MRT. No changes in the degree of self-determination was observed for general physical activity in the BREQ-3 and future intention toward physical activity in the SSK scale.
Primary Outcome—Feasibility
The inclusion, adherence and compliance rates as well as mean motivation and mean satisfaction during the trainings all reached or exceeded the thresholds set for feasibility (see Table 3, Figure 5), while the attrition rate was higher than the targeted threshold (see Table 3). This is in line with the results from other studies investigating exergame interventions in stroke patients and healthy older adults, where a similar recruitment process was implemented (Rozental-Iluz et al., 2016) and comparable adherence and compliance rates were observed (Anderson-Hanley et al., 2012; Schoene et al., 2013; Rebsamen et al., 2019; Burdea et al., 2020). Moreover, our results are in line with results in stroke and other neurological patients, where exergames and VR methods were found to be feasible for rehabilitation purposes and increased the motivation and satisfaction with rehabilitation interventions (Lange et al., 2010; Hamari, 2014; Cheok et al., 2015; Matallaoui et al., 2017; Dietlein et al., 2018; Mura et al., 2018; Garcia-Agundez et al., 2019; Wiley et al., 2020). The high attrition rate, however, indicates a problem with the exergame intervention itself. Other studies with exergame interventions reported lower attrition rates compared to this study (Fritz et al., 2013; Schattin et al., 2016). A possible reason therefore may be that this study took place during the time of the COVID-19 pandemic. This may have influenced the feasibility outcomes—in particular the inclusion and attrition rate—of this study as people were advised to shield and participants as well as investigators may have experienced limited allowance and emotional safety for contacts (Sloan et al., 2021). This is supported by the finding that one dropout was caused by the fear of getting infected with the Corona virus at the study center (see section Participants Overview). Moreover, several screened patients refused to participate, as they feared of an infection on the way or at the study center. However, the pandemic situation does not explain all dropouts, as one of them was caused by a training-related adverse event (see section Participants Overview). Exergames are generally reported to be safe (Cheok et al., 2015; Givon et al., 2016; Mura et al., 2018; Norouzi-Gheidari et al., 2019), which implies that this adverse event may be a rare case. Particularly, the participant concerned suffered an uncomfortable intensification of a pre-existing head tremor, possibly caused by the challenging simultaneous motor and cognitive actions required for the training. Therefore, the intervention could not be continued, however, it did not cause the head tremor but rather intensified the pre-existing condition. Nevertheless, such an adverse event should be prevented in a future study and how this may be done, is discussed below (section Future Directions).
Secondary Outcomes—Strengths, and Limitations of the Adapted Taxonomy
A strength of the rehabilitation approach was the careful adaption of the taxonomy based on theoretical reasoning, that consistently applied principles of motor learning (Gentile, 2000). The personalization of the progression was a further strength, however, as can be concluded from the mean ratings of perceived task difficulty predominantly moving below the targeted range, the adapted taxonomy did not achieve optimal task difficulty throughout the intervention (Figure 6). Three limitations of the adapted taxonomy were identified. (1) The design of the taxonomy may have linked motor and cognitive progression in an improper way, as separate subjective ratings for motor and cognitive task difficulty and the separate progression on two axes rather decoupled motor and cognitive learning. This led to problems, particularly in patients who were cognitively rather fit and had motor impairments or, vice versa, struggled a lot with the cognitive tasks while being physically rather fit. We observed that in these cases, being unable to progress on one axis in the taxonomy, hindered progression on the other axis, which led to under-challenge of the stronger function. However, motor learning already contains a cognitive component, as it usually passes through three different stages, a cognitive phase, an associative phase, and an autonomous phase, in which the perception about motor and cognitive task difficulty will depend on the stage of learning an individual is in (Weaver, 2015). This would imply that it would be better to not decouple motor and cognitive components of motor-cognitive training and therefore, use one instrument for the determination of motor-cognitive task difficulty progression. However, currently there is no suitable instrument that can be recommended (Shishov et al., 2017). (2) Therefore, out of lack of a suitable alternative, subjective ratings of perceived motor and cognitive task difficulty were used to guide the progression in this study (Sweller, 2011). Subjective ratings bear the risk for over- or underestimation of the personal ability and performance. To prevent this, we used visual analog scales, as using a VAS has the advantage that the raters are not dependent on given options but can choose from a continuum to give their answer (Voutilainen et al., 2016). VAS may therefore result in greater responsiveness and be less vulnerable to bias from confounding factors (Pfennings et al., 1995; Voutilainen et al., 2016). Nevertheless, based on the obtained results of perceived task difficulty, we conclude that subjective ratings may not be the proper instrument to guide individualized progression in chronic stroke patients. Moreover, these subjective ratings may have been collected at the wrong time-point. Participants rated their perceived task difficulty at the very end of the session, after having completed the cool-down game. This time point was chosen to not interrupt the training session and therefore disturb the concentration and flow of the participants. Nevertheless, as this cool-down game was less difficult than the rest of the session (see section Intervention/Personalized Exergame Training), this may have influenced the ratings. The last game may have been most present in the thoughts of the participants when they rated their perceived task difficulty, which may have resulted in lower ratings than would have matched the actual perceived task difficulty during the main part. How therefore task difficulty should be progressed in a future trail is discussed below (section Future Directions). (3) Due to limited possibilities to adjust all games to all levels and a lack of games, which train memory functions, several skill sub-categories of the adapted taxonomy remained empty. This may have influenced the personalized progression, as in case an empty sub-category should have provided a game, this was substituted by a game from one of the surrounding sub-categories. As this was a feasibility study, this limitation was accepted, however, for a future study, it should be ensured that all sub-categories of the adapted taxonomy contain at least one game.
Secondary Outcomes-Motor, Cognitive, and Motivational Outcomes
The secondary aim of this study was to get insight into possible treatment effects of the rehabilitation approach in chronic stroke patients. Therefore, we explored changes from before to after the intervention and compared the meaningfulness of change values and confidence intervals to comparable literature (Tables 4–6).
The significant improvement in the TUG from pre- to post-measurements with a medium to large effect size is in line with other studies using exergames in chronic stroke patients, which found significant improvements in the TUG and comparable changes and confidence intervals to our results (Singh et al., 2013; Cheok et al., 2015). These changes in the TUG were significantly greater in groups with additional exergame training compared to the control groups receiving standard care, which corresponds with the conditions of this study (Cheok et al., 2015). We found a medium effect size for the non-significant decrease in swing time on the affected side, while no change and a very small effect size was observed for swing time on the unaffected side. A review on spatio-temporal gait parameters in chronic stroke patients found that the changes in swing time are more often observed on the paretic side compared to non-paretic side (Wonsetler and Bowden, 2017). Significant changes were generally greater compared to our findings. Swing time is an important gait parameter in stroke patients as it is associated with single limb support and postural stability (Chisholm et al., 2014). Furthermore, we found a small to medium effect size for the improvement in the asymmetry index, which is a parameter of special interest in chronic stroke patients (Patterson et al., 2008). A temporal asymmetry index between 0.9 and 1.1 is considered normative, while 1.1–1.5 indicates mild asymmetry and >1.5 severe asymmetry (Patterson et al., 2008). The median asymmetry index of the participants moved within the normative range closer to 1. Little is yet known about possible effects of exergame training on gait symmetry in stroke patients, however, high intensity exercise has been found to affect gait symmetry in stroke patients. A meta-analysis reported a trend toward significance (Luo et al., 2019) and our study seems to support this finding. The results of these motor outcomes seem a promising finding indicating that these chronic individuals still have room to improve their mobility and gait if adequate intervention content is provided. The TUG, swing time and the asymmetry index may serve as possible outcomes for a future study.
Among the cognitive outcomes, we found medium to large effect sizes for reduced time needed for the TMT A and accuracy in the TMT B and the MRT. These results are in line with two reviews, which found beneficial effects of exergames on cognitive functions including global cognition, executive functions and visuo-spatial perception in neurological patients and any population, respectively (Stanmore et al., 2017; Mura et al., 2018). In chronic stroke patients, highly significant improvements in time for TMT A and B were found after a dual-task training intervention (Park and Lee, 2019). This gives rise to the presumption that attentional processing speed and cognitive flexibility may be affected by motor-cognitive interventions in general and therefore may be recommendable outcomes for a future randomized controlled trial (RCT). Furthermore, we found moderate effect sizes for increased reaction times in the TAP Incompatibility. The TAP Incompatibility and the MRT, however, are intended to be completed with two hands, which more than half of the stroke patients included in this study were not able to do due to paretic arms. Therefore, some skipped the tests and a few used one hand to operate both buttons. This may have influenced the results, even though the procedures from the baseline measurements were repeated exactly in the post measurements to ensure comparability of the results between the two time points. Due to operational limitations for these tests, we do not recommend them for being used in a future RCT despite the promising effect sizes. To cover attentional performance on incompatible stimuli and mental rotation, other tests should be chosen, which do not require action of both hands.
In the BREQ-3, we found a trend toward significance and a medium effect size for a decrease in intrinsic motivation for general physical activity, while the other motivation sub-types and a motivation were maintained. In the SSK scale, identified motivation for future physical activity decreased significantly and showed a medium to large effect size, while the SSK index showed no change. These results are in line with a meta-analysis on the motivational effects of exergames, which found no difference between exergames and alternative instructional methods (Wouters et al., 2013). This stands in contrast to literature, which states that exergames are expected to increase self-determination of exercise (Lange et al., 2010; Matallaoui et al., 2017; Sailer et al., 2017) and have been found to be superior in improving intrinsic motivation compared to a non-gaming condition (Fitzgerald et al., 2010). It is argued that specific gaming elements such as points, badges and leader boards are important for raising self-determination for exercise (Sailer et al., 2017). Such gaming elements not being present or not being noticed enough by the trainees may be an explanation for lower self-determined motivation during exergame interventions (Sailer et al., 2017). This aspect may apply for the games used in this study, as several participants expressed the wish for more feedback during and after the games. These considerations suggest to further investigate self-determined motivation for exercise in future trials with exergames and to improve the choice and implementation of the motivational elements in exergames (Matallaoui et al., 2017).
Implications, Strengths, and Limitations of This Study
To our knowledge, this is one of the first studies to assess the feasibility of a rehabilitation approach using exergames and following a skill-progression taxonomy in chronic stroke patients. Therefore, this study contributes to the advancement of long-term care for stroke survivors, addressing motor and cognitive impairments. Progressing individually through the taxonomy based on current skills may be a motivating factor for the trainees that taps on the things they are currently able to do. In this scenario, the progression through the taxonomy may be based on patterns of recovery shared by similar patients. Future studies applying larger samples may be well-advised to also consider data mining approaches with the aim to uncover patterns of recovery (Marcano-Cedeño et al., 2013; Chu et al., 2020). Strengths of this study were the clear and pre-defined feasibility protocol, the rather long study duration for a feasibility study and the combination of motor and cognitive outcomes. Nevertheless, several limitations should be considered when reading this study. (1) As being a feasibility trial, this study was designed without a control group, with a total N and treatment duration sufficient to evaluate feasibility but not treatment effects. Therefore, the results in the secondary outcomes must be interpreted with caution and not generalized to other populations. Nevertheless, the derived data and effect sizes can be used for future sample size calculations. (2) The study sample was rather high functioning in mobility and cognitive assessments, highly educated and all but one participant attended regular physiotherapy (see baseline values, Table 2), which may have been a reason for the few changes observed in the secondary outcomes. As this was a feasibility study, the training principle “initial value” (Hoffman, 2002), which relates to the baseline performance of a trainee, was not considered as an inclusion criterion. Particularly, this did not hinder the primary outcome of this study—feasibility—to be evaluated. Nevertheless, for a future study, further eligibility criteria regarding “initial values” may be considered to increase the potential for detecting treatment effects (see section Future Directions). (3) Moreover, as participants in this study were recruited in a physiotherapy center and a senior home, the study team did not have contact to the participants' clinicians. Therefore, several diagnostic information, which is traditionally included in reports of studies conducted in a stroke population (e.g., ischemic/haemorrhagic stroke, affected territory) is missing in this report. This was considered acceptable as this study primarily investigated feasibility. In a future RCT, however, with the aim to investigate treatment effects, this information should be included (Kwakkel et al., 2017). (4) One participant was not able to perform the computer-based version of the TMT, as they were not proficient enough with a computer mouse (so that the test performance would probably have been limited by their speed to use the mouse and not by cognitive skills to accomplish the task). To prevent missing data, we administered a paper-and-pencil version of the test. This should, however, be prevented in a future trial, therefore careful considerations regarding the choice of the test version in the targeted study population and sample size should be undertaken. (5) Several assessments exhibited missing data, which were caused by reasons described above (section Secondary Outcomes). Several participants were not able to perform the cognitive tests, which required use of both hands. This should be prevented in a future study by choosing cognitive assessments, which can be completed with one hand. (6) A possible effect of the two study centers could not be investigated, as only one participant was finally recruited in the senior home and was therefore the only participant, who did not receive other therapy or attend therapeutical activities besides the study sessions.
Future Directions
As the rehabilitation approach was feasible with minor modifications and promising results were found for some outcomes, which are relevant for stroke rehabilitation, we recommend the conduction of a well-designed randomized-controlled trial to investigate the effects of the rehabilitation approach using exergames and following a skill-progression taxonomy in comparison to a control intervention. To achieve appropriate credible training effects in such a trial, an appropriate sample size should be achieved, and the intervention duration should be increased to at least 12 weeks (Lauenroth et al., 2016). To account for the training principle “initial value,” further eligibility criteria regarding the motor and cognitive impairments of the participants may be considered (e.g., particularly participants with mild to moderate cognitive impairment may be included). To ensure the safety of the intervention, patients experiencing any problems during the use of VR or during challenging simultaneous motor and cognitive action should be excluded. To support this, a familiarization session with the training system for all interested participants may be helpful to foresee adverse reactions to the training. Moreover, before conducting a following study, the taxonomy should be revised. Specifically, we recommend expanding and refining the taxonomy to include a greater range of different motor and cognitive levels by adding more games, in particular for memory functions. Moreover, it may be recommendable to couple motor and cognitive progression more closely, e.g., by using a motor-cognitive parameter for guiding the progression instead of two separate outcomes for motor and cognitive task difficulty, respectively. To improve the progression rules, objective measures may be identified to monitor task difficulty during the training and replace the subjective ratings. Possible parameters therefore may be the reaction times to the stimuli in the games or the accuracy achieved in the cognitive tasks. Moreover, in future research, it may be preferable to combine external load measures with measures approximating internal load (Paas et al., 2003; Herold et al., 2020a). Conceivalbe solutions may be measuring eye activity such as cognitive pupillary response (Paas et al., 2003), galvanic skin response (Jaiswal et al., 2020) or functional near-infrared spectroscopy (fNIRS) (Herold et al., 2020b). Furthermore, the possibility to transfer the intervention into a tele-rehabilitation setting may be promising as stroke patients but also other neurological patients may generally be limited in their ability to reach study centers. Additionally, this would also improve the access to rehabilitation interventions during situations such as the COVID-19 pandemic or COVID-19 patients who are quarantined (Paneroni et al., 2021).
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.
Ethics Statement
The studies involving human participants were reviewed and approved by the Ethical Committee of the ETH Zürich (approval no. 2019-N-180). The patients/participants provided their written informed consent to participate in this study.
Author Contributions
SH developed the taxonomy, the methodology and study protocol under the supervision of EB and RK. JH facilitated the recruitment process by providing contacts to the physiotherapy center in Zürich. SH performed data acquisition and analysis, the first interpretation of the data, the writing of the first version of the manuscript and manuscript revision. JH, EB, and RK were involved in in-depth interpretation of the data, revision of the scientific content and manuscript revision. The final manuscript was read and approved by all authors.
Funding
This work was enabled by resources of the University Hospital of Zurich and ETH Zürich. The study device in one study center was provided by Dividat AG, however, Dividat AG was not involved in any decisions regarding study-related decisions including the determination of the study design, the collection, management, analysis, and interpretation of the data, and writing this study report.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We would like to thank Manuela Adcock Ph.D., Patrick Manser M.Sc., and Patrick Arnet M.Sc. for their contribution to the development of the taxonomy as well as Paige Howell and Florence von Ziegler for their work during data acquisition and analysis. We would like to express our special thanks to the study centers Segeten Neurorehab and Oase Effretikon for helping us with the recruitment process and hosting our study sessions. Furthermore, we would like to thank all participants for their patience and enthusiasm during our study.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnagi.2021.730801/full#supplementary-material
Footnotes
1. ^Timed-up-and-go test. Available online at: https://www.physio-pedia.com/Timed_Up_and_Go_Test_(TUG).
References
Althouse, A. D. (2016). Adjust for multiple comparisons? It's not that simple. Annals Thoracic Surgery 101, 1644–1645. doi: 10.1016/j.athoracsur.2015.11.024
American College of Sports, M., Riebe, D., Ehrman, J. K., Liguori, G., and Magal, M. (2018). ACSM's Guidelines for Exercise Testing and Prescription.
An, H.-J., Kim, J.-I., Kim, Y.-R., Lee, K.-B., Kim, D.-J., Yoo, K.-T., et al. (2014). The effect of various dual task training methods with gait on the balance and gait of patients with chronic stroke. J. Phys. Therapy Sci. 26, 1287–1291. doi: 10.1589/jpts.26.1287
Anderson-Hanley, C., Arciero, P. J., Brickman, A. M., Nimon, J. P., Okuma, N., Westen, S. C., et al. (2012). Exergaming and older adult cognition: a cluster randomized clinical trial. Am. J. Prev. Med. 42, 109–119. doi: 10.1016/j.amepre.2011.10.016
Barak, S., Hutzler, Y., and Dubnov-Razi, G. (2016). Physical exercise after stroke: effects, recommendations and barriers. Harefuah 155:84.
Bender, R., and Lange, S. (2001). Adjusting for multiple testing-when and how? J. Clin. Epidemiol. 54, 343–349. doi: 10.1016/S0895-4356(00)00314-0
Benjamin, E. J., Muntner, P., Alonso, A., Bittencourt, M. S., Callaway, C. W., Carson, A. P., et al. (2019). Heart disease and stroke statistics-2019 update: a report from the American Heart Association. Circulation 139, e56–e528. doi: 10.1161/CIR.0000000000000659
Bernardoni, F., Buetler, K., and Marchal-Crespo, L. (eds). (2019). “Virtual reality environments and haptic strategies to enhance implicit learning and motivation in robot-assisted training,” in 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR) (2019). p. 24–8. doi: 10.1109/ICORR.2019.8779420
Bernhardt, J., Hayward, K. S., Kwakkel, G., Ward, N. S., Wolf, S. L., Borschmann, K., et al. (2017). Agreed definitions and a shared vision for new standards in stroke recovery research: the stroke recovery and rehabilitation roundtable taskforce. Neurorehabil. Neural Repair. 31, 793–799. doi: 10.1177/1545968317732668
Billinger, S. A., Arena, R., Bernhardt, J., Eng, J. J., Franklin, B. A., Johnson, C. M., et al. (2014). Physical activity and exercise recommendations for stroke survivors: a statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 45, 2532–2553. doi: 10.1161/STR.0000000000000022
Bo, W., Lei, M., Tao, S., Jie, L. T., Qian, L., Lin, F. Q., et al. (2019). Effects of combined intervention of physical exercise and cognitive training on cognitive function in stroke survivors with vascular cognitive impairment: a randomized controlled trial. Clin. Rehabil. 33, 54–63. doi: 10.1177/0269215518791007
Bohannon, R. W. (2006). Reference values for the timed up and go test: a descriptive meta-analysis. J. Geriatr. Phys. Ther. 29, 64–8. doi: 10.1519/00139143-200608000-00004
Borghese, N. A., Pirovano, M., Lanzi, P. L., Wuest, S., and de Bruin, E. D. (2013). Computational intelligence and game design for effective at-home stroke rehabilitation. Games Health J. 2, 81–88. doi: 10.1089/g4h.2012.0073
Boulanger, M., Bejot, Y., Rothwell, P. M., and Touze, E. (2018). Long-term risk of myocardial infarction compared to recurrent stroke after transient ischemic attack and ischemic stroke: systematic review and meta-analysis. J. Am. Heart Assoc. 7:e007267. doi: 10.1161/JAHA.117.007267
Bowie, C. R., and Harvey, P. D. (2006). Administration and interpretation of the trail making test. Nat. Protoc. 1, 2277–2281. doi: 10.1038/nprot.2006.390
Bratfisch, O. (1972). Perceived Item-Difficulty in Three Tests of Intellectual Performance Capacity. ERIC. doi: 10.1037/e420862004-001
Burdea, G. (ed.). (2002). “Keynote address: Virtual rehabilitation-benefits and challenges,” in 1st International Workshop on Virtual Reality Rehabilitation (Mental Health, Neurological, Physical, Vocational) VRMHR: sn.
Burdea, G. C., Grampurohit, N., Kim, N., Polistico, K., Kadaru, A., Pollack, S., et al. (2020). Feasibility of integrative games and novel therapeutic game controller for telerehabilitation of individuals chronic post-stroke living in the community. Top. Stroke Rehabil. 27, 321–336. doi: 10.1080/10749357.2019.1701178
Chemolli, E., and Gagne, M. (2014). Evidence against the continuum structure underlying motivation measures derived from self-determination theory. Psychol. Assess. 26, 575–585. doi: 10.1037/a0036212
Cheok, G., Tan, D., Low, A., and Hewitt, J. (2015). Is nintendo wii an effective intervention for individuals with stroke? A systematic review and meta-analysis. J. Am. Med. Directors Assoc. 16, 923–932. doi: 10.1016/j.jamda.2015.06.010
Chisholm, A. E., Makepeace, S., Inness, E. L., Perry, S. D., McIlroy, W. E., and Mansfield, A. (2014). Spatial-temporal gait variability poststroke: variations in measurement and implications for measuring change. Arch. Phys. Med. Rehabil. 95, 1335–1341. doi: 10.1016/j.apmr.2014.02.014
Chu, C.-L., Chen, Y.-P., Chen, C. C. P., Chen, C.-K., Chang, H.-N., Chang, C.-H., et al. (2020). Functional recovery patterns of hemorrhagic and ischemic stroke patients under post-acute care rehabilitation program. Neuropsychiatr. Dis. Treat. 16, 1975–1985. doi: 10.2147/NDT.S253700
Cicerone, K. D., Goldin, Y., Ganci, K., Rosenbaum, A., Wethe, J. V., Langenbahn, D. M., et al. (2019). Evidence-based cognitive rehabilitation: systematic review of the literature from 2009 through 2014. Arch. Phys. Med. Rehabil. 100, 1763–1778. doi: 10.1016/j.apmr.2019.02.011
Cumming, T. B., Marshall, R. S., and Lazar, R. M. (2013). Stroke, cognitive deficits, and rehabilitation: still an incomplete picture. Int. J. Stroke 8, 38–45. doi: 10.1111/j.1747-4949.2012.00972.x
De Wit, L., Theuns, P., Dejaeger, E., Devos, S., Gantenbein, A. R., Kerckhofs, E., et al. (2017). Long-term impact of stroke on patients' health-related quality of life. Disabil. Rehabil. 39, 1435–1440. doi: 10.1080/09638288.2016.1200676
Dietlein, C., Eichberg, S., Fleiner, T., and Zijlstra, W. (2018). Feasibility and effects of serious games for people with dementia: a systematic review and recommendations for future research. Gerontechnology 17, 1–17. doi: 10.4017/gt.2018.17.1.001.00
Faria, A. L., Cameirão, M. S., Couras, J. F., Aguiar, J. R. O., Costa, G. M., and Bermúdez I Badia, S. (2018). Combined cognitive-motor rehabilitation in virtual reality improves motor outcomes in chronic stroke - a pilot study. Front. Psychol. 9:854. doi: 10.3389/fpsyg.2018.00854
Feigin, V. L., Roth, G. A., Naghavi, M., Parmar, P., Krishnamurthi, R., Chugh, S., et al. (2016). Global burden of stroke and risk factors in 188 countries, during 1990-2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet Neurol. 15, 913–924. doi: 10.1016/S1474-4422(16)30073-4
Felipe, F. A., de Carvalho, F. O., Silva, É. R., Santos, N. G. L., Fontes, P. A., de Almeida, A. S., et al. (2019). Evaluation instruments for physical therapy using virtual reality in stroke patients: a systematic review. Physiotherapy 106, 194–210. doi: 10.1016/j.physio.2019.05.005
Ferrarello, F., Baccini, M., Rinaldi, L. A., Cavallini, M. C., Mossello, E., Masotti, G., et al. (2011). Efficacy of physiotherapy interventions late after stroke: a meta-analysis. J. Neurol. Neurosurg. Psychiatr. 82, 136–143. doi: 10.1136/jnnp.2009.196428
Fitzgerald, D., Trakarnratanakul, N., Smyth, B., and Caulfield, B. (2010). Effects of a wobble board-based therapeutic exergaming system for balance training on dynamic postural stability and intrinsic motivation levels. J. Orthop. Sports Phys. Ther. 40, 11–19. doi: 10.2519/jospt.2010.3121
Fritz, C. O., Morris, P. E., and Richler, J. J. (2012). “Effect size estimates: current use, calculations, and interpretation,” in Correction to Fritz et al. (2011). J. Exp. Psychol. 141:30. doi: 10.1037/a0026092
Fritz, N. E., Cheek, F. M., and Nichols-Larsen, D. S. (2015). Motor-cognitive dual-task training in persons with neurologic disorders: a systematic review. J. Neurol. Phys. Ther. 39, 142–153. doi: 10.1097/NPT.0000000000000090
Fritz, S. L., Peters, D. M., Merlo, A. M., and Donley, J. (2013). Active video-gaming effects on balance and mobility in individuals with chronic stroke: a randomized controlled trial. Top. Stroke Rehabil. 20, 218–225. doi: 10.1310/tsr2003-218
Fuchs, R., Seelig, H., and Kilian, D. (2005). Selbstkonkordanz und Sportteilnahme. Zeitschrift für Gesundheitspsychol. 13, 126–138. doi: 10.1026/0943-8149.13.3.126
Gadidi, V., Katz-Leurer, M., Carmeli, E., and Bornstein, N. M. (2011). Long-term outcome poststroke: predictors of activity limitation and participation restriction. Arch. Phys. Med. Rehabil. 92, 1802–1808. doi: 10.1016/j.apmr.2011.06.014
Gallanagh, S., Quinn, T. J., Alexander, J., and Walters, M. R. (2011). Physical activity in the prevention and treatment of stroke. ISRN Neurol. 2011:953818. doi: 10.5402/2011/953818
Garcia-Agundez, A., Folkerts, A. K., Konrad, R., Caserman, P., Tregel, T., Goosses, M., et al. (2019). Recent advances in rehabilitation for parkinson's disease with exergames: a systematic review. J. Neuroeng. Rehabil. 16:17. doi: 10.1186/s12984-019-0492-1
Gentile, A. (1987). “Skill acquisition: action, movement, and neuromotor processes,” in Movement Science Foundations for Physical Therapy In Rehabilitation, 1st Edn, eds J. H. Carr, R. B. Shepherd, J. Gordon, A. M. Gentile, and J. M. Hiad (Jones and Bartlett Publishers Inc.), 93–154.
Gentile, S. (2000). Skill Acquisition: Action, Movement, and Neuromotor Processes in Carr J. Shepherd R. Movement Science, Foundations for Physical Therapy in Rehabilitation.
Givon, N., Zeilig, G., Weingarden, H., and Rand, D. (2016). Video-games used in a group setting is feasible and effective to improve indicators of physical activity in individuals with chronic stroke: a randomized controlled trial. Clin. Rehabil. 30, 383–392. doi: 10.1177/0269215515584382
Hamari, J., Koivisto, J., and Sarsa, H. (eds.). (2014). Does Gamification Work?-A Literature Review of Empirical Studies on Gamification. HICSS. doi: 10.1109/HICSS.2014.377
Herold, F., Gronwald, T., Scholkmann, F., Zohdi, H., Wyser, D., Müller, N. G., et al. (2020b). New directions in exercise prescription: is there a role for brain-derived parameters obtained by functional near-infrared spectroscopy? Brain Sci. 10:342. doi: 10.3390/brainsci10060342
Herold, F., Hamacher, D., Schega, L., and Müller, N. G. (2018). Thinking while moving or moving while thinking - concepts of motor-cognitive training for cognitive performance enhancement. Front. Aging Neurosci. 10:228. doi: 10.3389/fnagi.2018.00228
Herold, F., Törpel, A., Hamacher, D., Budde, H., and Gronwald, T. (2020a). A discussion on different approaches for prescribing physical interventions - four roads lead to rome, but which one should we choose? J. Pers. Med. 10:55. doi: 10.3390/jpm10030055
Hess, R. J., Brach, J. S., Piva, S. R., and VanSwearingen, J. M. (2010). Walking skill can be assessed in older adults: validity of the Figure-of-8 Walk Test. Phys. Ther. 90, 89–99. doi: 10.2522/ptj.20080121
Hoffman, J. (Ed.). (2002). Physiological Aspects of Sport Training and Performance. Champaign, IL: Human Kinetics Publishers. doi: 10.5040/9781492596806
Iruthayarajah, J., McIntyre, A., Cotoi, A., Macaluso, S., and Teasell, R. (2017). The use of virtual reality for balance among individuals with chronic stroke: a systematic review and meta-analysis. Top. Stroke Rehabil. 24, 68–79. doi: 10.1080/10749357.2016.1192361
Jaiswal, D., Moulick, M., Chatterjee, D., Ranjan, R., Ramakrishnan, R. K., Pal, A., et al. (2020). “Assessment of cognitive load from bio-potentials measured using wearable endosomatic device,” in Proceedings of the 6th ACM Workshop on Wearable Systems and Applications. Toronto, ON: Association for Computing Machinery. p. 13–8. doi: 10.1145/3396870.3400012
Johnson, C. O., Nguyen, M., Roth, G. A., Nichols, E., Alam, T., Abate, D., et al. (2019). Global, regional, and national burden of stroke, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet Neurol. 18, 439–458.
Johnson, D., Deterding, S., Kuhn, K.-A., Staneva, A., Stoyanov, S., and Hides, L. (2016). Gamification for health and wellbeing: a systematic review of the literature. Internet Intervent. 6, 89–106. doi: 10.1016/j.invent.2016.10.002
Julious, S. A. (2005). Sample size of 12 per group rule of thumb for a pilot study. Pharm. Stat. 4, 287–291. doi: 10.1002/pst.185
Katan, M., and Luft, A. (2018). Global Burden of Stroke. Semin. Neurol. 38, 208–211. doi: 10.1055/s-0038-1649503
Konig, N., Singh, N. B., von Beckerath, J., Janke, L., and Taylor, W. R. (2014). Is gait variability reliable? An assessment of spatio-temporal parameters of gait variability during continuous overground walking. Gait Posture 39, 615–617. doi: 10.1016/j.gaitpost.2013.06.014
Kwakkel, G., Lannin, N. A., Borschmann, K., English, C., Ali, M., Churilov, L., et al. (2017). Standardized measurement of sensorimotor recovery in stroke trials: consensus-based core recommendations from the stroke recovery and rehabilitation roundtable. Neurorehabil. Neural Repair. 31, 784–792. doi: 10.1177/1545968317732662
Laguna, P. L. (2008). Task complexity and sources of task-related information during the observational learning process. J. Sports Sci. 26, 1097–1113. doi: 10.1080/02640410801956569
Lange, B. S., Requejo, P., Flynn, S. M., Rizzo, A. A., Valero-Cuevas, F. J., Baker, L., et al. (2010). The potential of virtual reality and gaming to assist successful aging with disability. Phys. Med. Rehabil. Clin. N. Am. 21, 339–356. doi: 10.1016/j.pmr.2009.12.007
Lauenroth, A., Ioannidis, A. E., and Teichmann, B. (2016). Influence of combined physical and cognitive training on cognition: a systematic review. BMC Geriatr. 16:141. doi: 10.1186/s12877-016-0315-1
Lee, H. C., Huang, C. L., Ho, S. H., and Sung, W. H. (2017). The effect of a virtual reality game intervention on balance for patients with stroke: a randomized controlled trial. Games Health J. 6, 303–311. doi: 10.1089/g4h.2016.0109
Lee, H. S., Park, Y. J., and Park, S. W. (2019). The effects of virtual reality training on function in chronic stroke patients: a systematic review and meta-analysis. Biomed Res. Int. 2019:7595639. doi: 10.1155/2019/7595639
Lefeber, N., Degelaen, M., Truyers, C., Safin, I., Beckwee, D. (2019). Validity and reproducibility of inertial physilog sensors for spatiotemporal gait analysis in patients with stroke. IEEE Trans. Neural. Syst. Rehabil. Eng. 27, 1865–1874. doi: 10.1109/TNSRE.2019.2930751
Lennon, O., Hall, P., and Blake, C. (2021). Predictors of adherence to lifestyle recommendations in stroke secondary prevention. Int. J. Environ. Res. Public Health 18:4666. doi: 10.3390/ijerph18094666
Levin, O., Netz, Y., and Ziv, G. (2017). The beneficial effects of different types of exercise interventions on motor and cognitive functions in older age: a systematic review. Eur. Rev. Aging Phys. Activity 14:20. doi: 10.1186/s11556-017-0189-z
Lund, C., Dalgas, U., Grønborg, T. K., Andersen, H., Severinsen, K., Riemenschneider, M., et al. (2018). Balance and walking performance are improved after resistance and aerobic training in persons with chronic stroke. Disabil. Rehabil. 40, 2408–2415. doi: 10.1080/09638288.2017.1336646
Luo, L., Zhu, S., Shi, L., Wang, P., Li, M., and Yuan, S. (2019). High intensity exercise for walking competency in individuals with stroke: a systematic review and meta-analysis. J. Stroke Cerebrovascular Dis. 28:104414. doi: 10.1016/j.jstrokecerebrovasdis.2019.104414
Marcano-Cedeño, A., Chausa, P., García, A., Cáceres, C., Tormos, J. M., and Gómez, E. J. (2013). Data mining applied to the cognitive rehabilitation of patients with acquired brain injury. Expert Syst. Appl. 40, 1054–1060. doi: 10.1016/j.eswa.2012.08.034
Markland, D., and Tobin, V. (2004). A modification to the Behavioral regulation in exercise questionnaire to include an assessment of amotivation. J. Sport Exerc. Psychol. 26, 191–196. doi: 10.1123/jsep.26.2.191
Matallaoui, A., Koivisto, J., Hamari, J., and Zarnekow, R. (eds.). (2017). “How effective is “Exergamification?” a systematic review on the effectiveness of gamification features in exergames,” in Proceedings of the 50th Hawaii International Conference on System Sciences. doi: 10.24251/HICSS.2017.402
Mayo, N. E., Wood-Dauphinee, S., Ahmed, S., Carron, G., Higgins, J., McEwen, S., et al. (2009). Disablement following stroke. Disabil. Rehabil. 21, 258–268. doi: 10.1080/096382899297684
Mayo, N. E., Wood-Dauphinee, S., Cote, R., Durcan, L., and Carlton, J. (2002). Activity, participation, and quality of life 6 months poststroke. Arch. Phys. Med. Rehabil. 83, 1035–1042. doi: 10.1053/apmr.2002.33984
McKevitt, C., Fudge, N., Redfern, J., Sheldenkar, A., Crichton, S., Rudd, A. R., et al. (2011). Self-reported long-term needs after stroke. Stroke 42, 1398–1403. doi: 10.1161/STROKEAHA.110.598839
Medicine ACo, S., Riebe, D., Ehrman, J., Liguori, G., and Magal, M. (2017). ACSM's Guidelines for Exercise Testing and Prescription, 10th Edn. Philadelphia: Lippincott Williams and Wilkins.
Michael, D. R., and Chen, S. L. (2005). Serious Games: Games That Educate, Train, and Inform: Muska and Lipman/Premier-Trade. Boston, MA: Thomson Course Technology), 29–43.
Moore, C. G., Carter, R. E., Nietert, P. J., and Stewart, P. W. (2011). Recommendations for planning pilot studies in clinical and translational research. Clin. Transl. Sci. 4, 332–337. doi: 10.1111/j.1752-8062.2011.00347.x
Mueller, S. T., and Piper, B. J. (2014). The Psychology experiment building language (Version 0.14) [Computer experiment programming language]. Retrieved from: http://pebl.sourceforge.net.
Mullan, E., Markland, D., and Ingledew, D. K. (1997). A graded conceptualisation of self-determination in the regulation of exercise behavior: Development of a measure using confirmatory factor analytic procedures. Pers. Individ. Dif. 23, 745–752. doi: 10.1016/S0191-8869(97)00107-4
Mura, G., Carta, M. G., Sancassiani, F., Machado, S., and Prosperini, L. (2018). Active exergames to improve cognitive functioning in neurological disabilities: a systematic review and meta-analysis. Eur. J. Phys. Rehabil. Med. 54, 450–462. doi: 10.23736/S1973-9087.17.04680-9
Ng, S. S., and Hui-Chan, C. W. (2005). The timed up and go test: its reliability and association with lower-limb impairments and locomotor capacities in people with chronic stroke. Arch. Phys. Med. Rehabil. 86, 1641–1647. doi: 10.1016/j.apmr.2005.01.011
Norouzi-Gheidari, N., Hernandez, A., Archambault, P. S., Higgins, J., Poissant, L., and Kairy, D. (2019). Feasibility, safety and efficacy of a virtual reality exergame system to supplement upper extremity rehabilitation post-stroke: a pilot randomized clinical trial and proof of principle. Int. J. Environ. Res. Public Health 17:113. doi: 10.3390/ijerph17010113
Nyman, S. R., and Victor, C. R. (2011). Older people's recruitment, sustained participation, and adherence to falls prevention interventions in institutional settings: a supplement to the Cochrane systematic review. Age Ageing 40, 430–436. doi: 10.1093/ageing/afr016
Oberlin, L. E., Waiwood, A. M., Cumming, T. B., Marsland, A. L., Bernhardt, J., and Erickson, K. I. (2017). Effects of physical activity on poststroke cognitive function: a meta-analysis of randomized controlled trials. Stroke 48, 3093–3100. doi: 10.1161/STROKEAHA.117.017319
Paas, F., Tuovinen, J. E., Tabbers, H., and Van Gerven, P. W. M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educ. Psychol. 38, 63–71. doi: 10.1207/S15326985EP3801_8
Page, S. J., Gater, D. R., and Bach, Y. R. P. (2004). Reconsidering the motor recovery plateau in stroke rehabilitation. Arch. Phys. Med. Rehabil. 85, 1377–1381. doi: 10.1016/j.apmr.2003.12.031
Paneroni, M., Vitacca, M., Bernocchi, P., Bertacchini, L., and Scalvini, S. (2021). Feasibility of tele-rehabilitation in survivors of COVID-19 pneumonia. Pulmonology 27, 423–437 doi: 10.1016/j.pulmoe.2021.03.009
Park, M. O., and Lee, S. H. (2019). Effect of a dual-task program with different cognitive tasks applied to stroke patients: a pilot randomized controlled trial. NeuroRehabilitation 44, 239–249. doi: 10.3233/NRE-182563
Patterson, K. K., Parafianowicz, I., Danells, C. J., Closson, V., Verrier, M. C., Staines, W. R., et al. (2008). Gait asymmetry in community-ambulating stroke survivors. Arch. Phys. Med. Rehabil. 89, 304–310. doi: 10.1016/j.apmr.2007.08.142
Pfennings, L., Cohen, L., and van der Ploeg, H. (1995). Preconditions for sensitivity in measuring change: visual analog scales compared to rating scales in a Likert format. Psychol. Rep. 77, 475–480. doi: 10.2466/pr0.1995.77.2.475
Rebsamen, S., Knols, R. H., Pfister, P. B., and de Bruin, E. D. (2019). Exergame-driven high-intensity interval training in untrained community dwelling older adults: a formative one group quasi- experimental feasibility trial. Front. Physiol. 10:1019. doi: 10.3389/fphys.2019.01019
Rego, P., Moreira, P. M., and Reis, L. P. (Eds.). (2010). “Serious games for rehabilitation: a survey and a classification towards a taxonomy,” in 5th Iberian Conference on Information Systems and Technologies, (Santiago de Compostela)
Reitan, R. M. J. P., and Skills, M. (1958). Validity of the trail making test as an indicator of organic brain damage. Perceptual Motor Skills 8, 271–276. doi: 10.2466/pms.1958.8.3.271
Rothman, K. J. (1990). No adjustments are needed for multiple comparisons. Epidemiology 1, 43–46. doi: 10.1097/00001648-199001000-00010
Rozental-Iluz, C., Zeilig, G., Weingarden, H., and Rand, D. (2016). Improving executive function deficits by playing interactive video-games: secondary analysis of a randomized controlled trial for individuals with chronic stroke. Eur. J. Phys. Rehabil. Med. 52, 508–515.
Ruud, H., Knols, T. V., Verra, M. L., and de Bruin, E. D. (2016). Exergames for patients in acute care settings: systematic review of the reporting of methodological quality, FITT components, and program intervention details. Games Health J. 5, 224–235. doi: 10.1089/g4h.2015.0067
Sailer, M., Hense, J. U., Mayr, S. K., and Mandl, H. (2017). How gamification motivates: an experimental study of the effects of specific game design elements on psychological need satisfaction. Comput. Human Behav. 69, 371–380. doi: 10.1016/j.chb.2016.12.033
Saunders, D. H., Sanderson, M., Hayes, S., Johnson, L., Kramer, S., Carter, D. D., et al. (2020). Physical fitness training for stroke patients. Cochrane Database Syst. Rev. 3:1–306. doi: 10.1002/14651858.CD003316.pub7
Schattin, A., Arner, R., Gennaro, F., and de Bruin, E. D. (2016). Adaptations of prefrontal brain activity, executive functions, and gait in healthy elderly following exergame and balance training: a randomized-controlled study. Front. Aging Neurosci. 8:278. doi: 10.3389/fnagi.2016.00278
Schoene, D., Lord, S. R., Delbaere, K., Severino, C., Davies, T. A., and Smith, S. T. (2013). A randomized controlled pilot study of home-based step training in older people using videogame technology. PLoS ONE 8:e57734. doi: 10.1371/journal.pone.0057734
Shepard, R. N., and Metzler, J. (1971). Mental rotation of three-dimensional objects. Science 171, 701–703. doi: 10.1126/science.171.3972.701
Shin, J.-H., Bog Park, S., and Ho Jang, S. (2015). Effects of game-based virtual reality on health-related quality of life in chronic stroke patients: a randomized, controlled study. Comput. Biol. Med. 63, 92–98. doi: 10.1016/j.compbiomed.2015.03.011
Shishov, N., Melzer, I., and Bar-Haim, S. (2017). Parameters and measures in assessment of motor learning in neurorehabilitation; a systematic review of the literature. Front. Hum. Neurosci. 11:82. doi: 10.3389/fnhum.2017.00082
Singh, D. K. A., Mohd Nordin, N. A., Aziz, N. A. A., Lim, B. K., and Soh, L. C. (2013). Effects of substituting a portion of standard physiotherapy time with virtual reality games among community-dwelling stroke survivors. BMC Neurol. 13:199. doi: 10.1186/1471-2377-13-199
Sloan, M., Gordon, C., Lever, E., Harwood, R., Bosley, M. A., Pilling, M., et al. (2021). COVID-19 and shielding: experiences of UK patients with lupus and related diseases. Rheumatol. Adv. Pract. 5:rkab003. doi: 10.1093/rap/rkab003
Smith, A. C., Saunders, D. H., and Mead, G. (2012). Cardiorespiratory fitness after stroke: a systematic review. Int. J. Stroke 7, 499–510. doi: 10.1111/j.1747-4949.2012.00791.x
Spaccavento, S., Marinelli, C. V., Nardulli, R., Macchitella, L., Bivona, U., Piccardi, L., et al. (2019). Attention deficits in stroke patients: the role of lesion characteristics, time from stroke, and concomitant neuropsychological deficits. Behav. Neurol. 2019:7835710. doi: 10.1155/2019/7835710
Spildooren, J., Speetjens, I., Abrahams, J., Feys, P., and Timmermans, A. (2019). A physical exercise program using music-supported video-based training in older adults in nursing homes suffering from dementia: a feasibility study. Aging Clin. Exp. Res. 31, 279–285. doi: 10.1007/s40520-018-0954-5
Stanmore, E., Stubbs, B., Vancampfort, D., de Bruin, E. D., and Firth, J. (2017). The effect of active video games on cognitive functioning in clinical and non-clinical populations: a meta-analysis of randomized controlled trials. Neurosci. Biobehav. Rev. 78, 34–43. doi: 10.1016/j.neubiorev.2017.04.011
Starovasnik Zagavec, B., Mlinaric Lesnik, V., and Goljar, N. (2015). Training of selective attention in work-active stroke patients. Int. J. Rehabil. Res. 38, 370–372. doi: 10.1097/MRR.0000000000000127
Stojan, R., and Voelcker-Rehage, C. (2019). A systematic review on the cognitive benefits and neurophysiological correlates of exergaming in healthy older adults. J. Clin. Med. 8:734. doi: 10.3390/jcm8050734
Sun, J. H., Tan, L., and Yu, J. T. (2014). Post-stroke cognitive impairment: epidemiology, mechanisms and management. Ann. Transl. Med. 2:80. doi: 10.3978/j.issn.2305-5839.2014.08.05
Swanson, L. R., and Whittinghill, D. M. (2015). Intrinsic or extrinsic? Using videogames to motivate stroke survivors: a systematic review. Games Health J. 4, 253–258. doi: 10.1089/g4h.2014.0074
Sweller, J. (2011). Cognitive load theory. Psychol. Learn. Motivat. 55, 37–76. doi: 10.1016/B978-0-12-387691-1.00002-8
Sweller, J., Ayres, P., and Kalyuga, S. (2011). Measuring Cognitive Load. Cognitive Load Theory. Springer. p. 71–85. doi: 10.1007/978-1-4419-8126-4_6
Teasell, R., Mehta, S., Pereira, S., McIntyre, A., Janzen, S., Allen, L., et al. (2012). Time to rethink long-term rehabilitation management of stroke patients. Top. Stroke Rehabil. 19, 457–462. doi: 10.1310/tsr1906-457
Thabane, L., Ma, J., Chu, R., Cheng, J., Ismaila, A., Rios, L. P., et al. (2010). A tutorial on pilot studies: the what, why and how. BMC Med. Res. Methodol. 10:1. doi: 10.1186/1471-2288-10-1
Tiozzo, E., Youbi, M., Dave, K., Perez-Pinzon, M., Rundek, T., Sacco, R. L., et al. (2015). Aerobic, resistance, and cognitive exercise training poststroke. Stroke 46, 2012–2016. doi: 10.1161/STROKEAHA.114.006649
Ursin, M. H., Bergland, A., Fure, B., Thommessen, B., Hagberg, G., Oksengard, A. R., et al. (2019). Gait and balance one year after stroke; relationships with lesion side, subtypes of cognitive impairment and neuroimaging findings-a longitudinal, cohort study. Physiotherapy 105, 254–261. doi: 10.1016/j.physio.2018.07.007
van Beek, J. J. W., van Wegen, E. E. H., Bohlhalter, S., and Vanbellingen, T. (2019). Exergaming-based dexterity training in persons with parkinson disease: a pilot feasibility study. J. Neurol. Phys. Ther. 43, 168–174. doi: 10.1097/NPT.0000000000000278
van de Ven, R. M., Buitenweg, J. I., Schmand, B., Veltman, D. J., Aaronson, J. A., Nijboer, T. C., et al. (2017). Brain training improves recovery after stroke but waiting list improves equally: a multicenter randomized controlled trial of a computer-based cognitive flexibility training. PLoS ONE 12:e0172993. doi: 10.1371/journal.pone.0172993
Voutilainen, A., Pitkäaho, T., Kvist, T., and Vehviläinen-Julkunen, K. (2016). How to ask about patient satisfaction? The visual analog scale is less vulnerable to confounding factors and ceiling effect than a symmetric Likert scale. J. Adv. Nursing 72, 946–957. doi: 10.1111/jan.12875
Wagner, S., Helmreich, I., Dahmen, N., Lieb, K., and Tadic, A. (2011). Reliability of three alternate forms of the trail making tests a and B. Arch. Clin. Neuropsychol. 26, 314–321. doi: 10.1093/arclin/acr024
Weaver, J. (2015). Motor learning unfolds over different timescales in distinct neural systems. PLoS Biol. 13:e1002313. doi: 10.1371/journal.pbio.1002313
Wentink, M. M., Berger, M. A. M., de Kloet, A. J., Meesters, J., Band, G. P. H., Wolterbeek, R., et al. (2016). The effects of an 8-week computer-based brain training programme on cognitive functioning, QoL and self-efficacy after stroke. Neuropsychol. Rehabil. 26, 847–865. doi: 10.1080/09602011.2016.1162175
Wiley, E., Khattab, S., and Tang, A. (2020). Examining the effect of virtual reality therapy on cognition post-stroke: a systematic review and meta-analysis. Disabil. Rehabil. 1–11. doi: 10.1080/17483107.2020.1755376. [Epub ahead of print].
Wong, S. S. T., Yam, M.-S., and Ng, S. S. M. (2013). The Figure-of-Eight Walk test: reliability and associations with stroke-specific impairments. Disabil. Rehabil. 35, 1896–1902. doi: 10.3109/09638288.2013.766274
Wonsetler, E. C., and Bowden, M. G. (2017). A systematic review of mechanisms of gait speed change post-stroke. Part 1: spatiotemporal parameters and asymmetry ratios. Top. Stroke Rehabil. 24, 435–446. doi: 10.1080/10749357.2017.1285746
Wouters, P., van Nimwegen, C., van Oostendorp, H., and van der Spek, E. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. J. Educ. Psychol. 105, 249–265. doi: 10.1037/a0031311
Wüest, S., van de Langenberg, R., and de Bruin, E. D. (2014). Design considerations for a theory-driven exergame-based rehabilitation program to improve walking of persons with stroke. Eur. Rev. Aging Phys. Activity 11, 119–129. doi: 10.1007/s11556-013-0136-6
Yoo, C., Yong, M. H., Chung, J., and Yang, Y. (2015). Effect of computerized cognitive rehabilitation program on cognitive function and activities of living in stroke patients. J. Phys. Ther. Sci. 27, 2487–2489. doi: 10.1589/jpts.27.2487
Keywords: stroke, mobility, training, cognition, gaming, virtual reality, rehabilitation, feasibility
Citation: Huber SK, Held JPO, de Bruin ED and Knols RH (2021) Personalized Motor-Cognitive Exergame Training in Chronic Stroke Patients—A Feasibility Study. Front. Aging Neurosci. 13:730801. doi: 10.3389/fnagi.2021.730801
Received: 25 June 2021; Accepted: 20 September 2021;
Published: 20 October 2021.
Edited by:
Dennis Qing Wang, Southern Medical University, ChinaReviewed by:
Fabian Herold, Helmholtz Association of German Research Centers (HZ), GermanyNotger G. Müller, Helmholtz Association of German Research Centers (HZ), Germany
Copyright © 2021 Huber, Held, de Bruin and Knols. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Eling D. de Bruin, eling.debruin@hest.ethz.ch