Original Research ARTICLE
Patient-Active Control of a Powered Exoskeleton Targeting Upper Limb Rehabilitation Training
- 1College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
- 2College of Mechanical Engineering, Southeast University, Nanjing, China
Robot-assisted therapy affords effective advantages to the rehabilitation training of patients with motion impairment problems. To meet the challenge of integrating the active participation of a patient in robotic training, this study presents an admittance-based patient-active control scheme for real-time intention-driven control of a powered upper limb exoskeleton. A comprehensive overview is proposed to introduce the major mechanical structure and the real-time control system of the developed therapeutic robot, which provides seven actuated degrees of freedom and achieves the natural ranges of human arm movement. Moreover, the dynamic characteristics of the human-exoskeleton system are studied via a Lagrangian method. The patient-active control strategy consisting of an admittance module and a virtual environment module is developed to regulate the robot configurations and interaction forces during rehabilitation training. An audiovisual game-like interface is integrated into the therapeutic system to encourage the voluntary efforts of the patient and recover the neural plasticity of the brain. Further experimental investigation, involving a position tracking experiment, a free arm training experiment, and a virtual airplane-game operation experiment, is conducted with three healthy subjects and eight hemiplegic patients with different motor abilities. Experimental results validate the feasibility of the proposed scheme in providing patient-active rehabilitation training.
Stroke is a severe neurological disease caused by the blockages or rupture of cerebral blood vessels, leading to significant physical disability and cognitive impairment (1, 2). The recent statistics from the World Health Organization indicate that worldwide 15 million people annually suffer from the effect of stroke, and more than 5 million stroke patients survive and, however, require a prolonged physical therapy to recover motor function. Recent trends predict increased stroke incidence at younger ages in the upcoming years (3, 4). Approximately four-fifths of all survived stroke patients suffer from the problems of hemiparesis or hemiplegia and, as a result, have difficulties in performing activities of daily living (ADL). Stroke causes tremendous mental and economic pressure on the patients and their families (5). Medical research has proved that, owing to the neural plasticity of the human brain, appropriate rehabilitation trainings are beneficial for stroke survivors to recover musculoskeletal motor abilities. Repetitive and task-oriented functional activities have substantial positive effects on improving motor coordination and avoiding muscle atrophy (6, 7). Traditional stroke rehabilitation therapy involves many medical disciplines, such as orthopedics, physical medicine, and neurophysiology (8, 9). Physiotherapists and medical personnel are required to provide for months one-on-one interactions to patients that are labor intensive, time consuming, patient-passive, and costly. Besides, the effectiveness of traditional therapeutic trainings is limited by the personal experiences and skills of therapists (10, 11).
In recent decades, robot-assisted rehabilitation therapies have attracted increasing attention because of their unique advantages and promising applications (12, 13). Compared with the traditional manual repetitive therapy, the use of robotic technologies helps improve the performance and efficiency of therapeutic training (14). Robot-assisted therapy can deliver high-intensive, long-endurance, and goal-directed rehabilitation treatments and reduce expense. Besides, the physical parameters and the training performance of patients can be monitored and evaluated via built-in sensing systems that facilitate the improvement of the rehabilitation strategy (15, 16). Many therapeutic robots have been developed to improve the motor functions of the upper extremity of disabled stroke patients exhibiting permanent sensorimotor arm impairments (17). The existing robots used for upper limb training can be basically classified into two types: end-point robots and exoskeleton robots. End-point robots work by applying external forces to the distal end of impaired limbs, and some examples are MIME (18), HipBot (19), GENTLE/s (20), and TA-WREX (21). Comparatively, exoskeleton robots have complex structures similar to anatomy of the human skeleton; some examples of such robots are NMES (22), HES (23), NEUROExos (24), CAREX-7 (25), IntelliArm (26), BONES (27), and RUPERT (28). The joints of the exoskeleton need to be aligned with the human anatomical joints for effective transfer of interactive forces.
The control strategies applied in therapeutic robots are important to ensure the effectiveness of rehabilitation training. So far, according to the training requirement of patients with different impairment severities, many control schemes have been developed to perform therapy and accelerate recovery. Early rehabilitation robot systems implemented patient-passive control algorithms to imitate the manual therapeutic actions of therapists. These training schemes are suitable for patients with severe paralysis to passively execute repetitive reaching tasks along predefined trajectories. Primary clinical results indicate that patient-passive training contributes to motivating muscle contraction and preventing deterioration of arm functions. The control of the human–robot interaction system is a great challenge due to its highly nonlinear characteristics. Many control algorithms have been proposed to enhance the tracking accuracy of passive training, such as the robust adaptive neural controller (29), fuzzy adaptive backstepping controller (30), neural proportional–integral–derivative (PID) controller (31), fuzzy sliding mode controller (32), and neuron PI controller (33).
The major disadvantage of patient-passive training is that the active participation of patients is neglected during therapeutic treatment (34). Several studies suggest that, for the patients who have regained parts of motor functions, the rehabilitation treatment integrated with the voluntary efforts of patients facilitates the recovery of lost motor ability (35). The patient-active control, normally referred as patient-cooperative control and assist-as-needed control, is capable of regulating the human–robot interaction depending on the motion intention and the disability level of patients. Keller et al. proposed an exoskeleton for pediatric arm rehabilitation. A multimodal patient-cooperative control strategy was developed to assist upper limb movements with an audiovisual game-like interface (36). Duschauwicke et al. proposed an impedance-based control approach for patient-cooperative robot-aided gait rehabilitation. The affected limb was constrained with a virtual tunnel around the desired spatial path (37). Ye et al. proposed an adaptive electromyography (EMG) signals-based control strategy for an exoskeleton to provide efficient motion guidance and training assistance (38). Oldewurtel et al. developed a hybrid admittance–impedance controller to maximize the contribution of patients during rehabilitation training (39). Banala et al. developed a force-field assist-as-need controller for intensive gait rehabilitation training (40). However, there are two limitations in the existing patient-cooperative control strategies. Firstly, the rehabilitation training process is not completely patient-active, as the patient needs to perform training tasks along a certain predefined trajectory. Secondly, existing control strategies are executed in self-designed virtual scenarios that are generally too simple, rough, and uninteresting. Besides, applying a certain control strategy to different virtual reality scenarios is difficult.
Taking the above issues into consideration, the main contribution of this paper is to develop a control strategy for an upper limb exoskeleton to assist disabled patients in performing active rehabilitation training in a virtual scenario based on their own active motion intentions. Firstly, the overall structure design and the real-time control system of the exoskeleton system are briefly introduced. A dynamic model of the human–robot interaction system is then established using the Lagrangian approach. After that, an admittance-based patient-active controller combined with an audiovisual therapy interface is proposed to induce the active participation of patients during training. Existing commercial virtual games without a specific predetermined training trajectory can be integrated into the controller via a virtual keyboard unit. Finally, three types of experiments, namely the position tracking experiment without interaction force, the free arm movement experiment, and the virtual airplane-game operation experiment, are conducted with healthy and disabled subjects. The experimental results demonstrate the feasibility of the proposed exoskeleton and control strategy.
Materials and Methods
Exoskeleton Robot Design
The architecture of the proposed exoskeleton is shown in Figure 1. This wearable force-feedback exoskeleton robot has seven actuated degrees of freedom (DOFs) and two passive DOFs covering the natural range of movement (ROM) of humans in ADL. The robot has been designed with an open-chain structure to mimic the anatomy of the human right arm and provide controllable assistance torque to each robot joint. There are three actuated DOFs at the shoulder for internal/external rotation, abduction/adduction, and flexion/extension; two DOFs at the elbow for flexion/extension and pronation/supination; and two DOFs at the wrist for flexion/extension and ulnal/radial deviation. Besides, since the center of rotation of the glenohumeral joint varies with the shoulder girdle movement, the robot is mounted on a self-aligning platform with two passive translational DOFs to compensate the human–robot misalignment and to guarantee interaction comfort.
Figure 1. Architecture of upper limb rehabilitation exoskeleton (1-Self-aligning platform; 2-AC servo motor; 3-Bowden cable components; 4-Support frame; 5-Wheelchair; 6-Elbow flexion/extension; 7-Proximal force/torque sensor; 8-Wrist flexion/extension; 9-Wrist ulnal/radial deviation; 10-Distal force/torque sensor; 11-Forearm pronation/supination; 12-Auxiliary links; 13-Shoulder flexion/extension; 14-Shoulder abduction/adduction; 15-Shoulder internal/external; 16-Free-length spring).
The lengths of the upper arm and the forearm as well as the shoulder height of the exoskeleton can be adjusted to satisfy the dimensions of patients with body heights in the range of 1.6 m to 1.9 m. The revolute robot joints at the shoulder and the elbow are actuated by the flexible Bowden-cable actuation systems located on the remote support frame (41). The schematic of the Bowden-cable actuator is depicted in Figure 2. It mainly consists of a servo AC motor (SGMAV-04A, YASKAWA) combined with a planetary gear reducer (Yantong, transmission ratio: 40) used to produce a maximum torque of 35 Nm, two bendable Bowden-cable transmission units used to transmit driving torque from the proximal pulley to the distal pulley, and a pretension device used to adjust cable pretension and eliminate the slacking problem resulting from cable elasticity. In addition, the wrist joints of the exoskeleton are actuated by two high-precision coreless DC servo motors (JG-37, ASLONG).
Figure 2. Schematic of the Bowden-cable actuation system (1-Servo motor and planetary gear reducer; 2-Pretension device; 3-Outer sheath; 4-Inner cable; 5- Proximal pulley; 6-Cable supports; 7-Distal pulley; 8-Exoskeleton link).
A passive gravity-compensation mechanism made up of two zero free-length springs and two auxiliary parallel links is integrated into the exoskeleton to balance the gravity of the entire system [detailed description can be found in (42)]. The configuration of the exoskeleton is measured by using a rotary potentiometer (WDJ22A-10K) encapsulated in each robot joint. Two six-axis force/torque (F/T) sensors (NANO-25, ATI) are located at the upper arm and the end-effector to acquire the interaction forces between the robot and the operator. The custom Velcro fasteners attached to the upper arm and the forearm of the exoskeleton facilitate the connection and separation between the human arm and the robot. For safety, the available ROM of each actuated joint is limited via a mechanical stop to avoid collisions and excessive motion. Two dead-man buttons are available to both the patient and physiotherapists to immediately shut down the motor power in the case of an emergency.
Electrical Control System
The closed-loop real-time control system of the therapeutic exoskeleton is built in the MATLAB/Real-Time-Workshop (RTW) environment with a hierarchical architecture, as shown in Figure 3. Two industrial personal computers (IPC-610H, Advantech Inc.) are used as the host and target computers. The host computer is capable of transforming the Simulink control model to the executable codes, while the target computer takes charge of implementing the embedded targeted codes and regulating the operation of the robot system. The analog feedback signals from the potentiometers and F/T sensors are amplified by power amplifiers (LKM-66, FMS) and acquired via three industrial analog-to-digital converters (PCL-818, Advantech Inc.). The control algorithm running in the target computer is converted into analog output signals by two industrial digital-to-analog cards (PCL-726, Advantech Inc.) The output analog signals are transmitted to the servo drivers to control servo motors with a sampling rate of 1 kHz.
Figure 3. The MATLAB/Real-Time-Workshop/xPC control system. (A) Hardware architecture diagram. (B) Experimental setup.
It is important to analyze the dynamic characteristics of the exoskeleton equipped on the right arm of the operator to improve the control system performance. The overall dynamic model of the exoskeleton with human–robot interaction forces can be established based on the Lagrangian approach as follows:
where denote the vectors of generalized positions, velocities, and accelerations of actuated joints. M(θ) represents the symmetric positive-defined system inertia matrix. denotes the vector of centrifugal and Coriolis torque. is the friction vector of the robot system. Du represents the lumped effects of uncertainties. and Γ2 represent the Cartesian interaction forces acting on the upper arm and the end-effector of the exoskeleton, respectively. Jacobian matrixes, J1(θ) and J2(θ), provide the mapping from the interaction forces to the torques at robot joints, and they can be derived from the kinematics model of the exoskeleton (43). The vector τ is the output driving torques of servo motors.
It should be pointed out that the vector of gravitational torque is eliminated in Equation (1), as the proposed exoskeleton robot is kept in a static balanced state during the operation (42). Note that since the movement range of the passive self-aligning platform is fairly limited and small during rehabilitation training, the platform is assumed to be stationary while developing the system dynamic model. The experimental results obtained in our previous work have verified the rationality of this assumption.
The friction existing in the exoskeleton system can be basically subdivided into three parts: the friction from Bowden-cable transmission systems , the friction from the reducers of motors , and the friction from robot joints . Thus, we have
The friction of the Bowden-cable transmission can be derived from the torque transmission model presented in our previous research (41). The relation between the motor-driving torque acting on the ith proximal pulley, i.e., τin, i, and the output torque acting on the ith robot joint, i.e., τout, i, can be described using the following equation:
where Ti and λi are the cable pretension and the bending angle of the ith Bowden-cable unit. The term μi represents the Coulomb friction coefficient. r1 and r2 denote the radiuses of the proximal pulley and the distal pulley. Note that the values of r1 and r2 of the presented exoskeleton are equal to 25 mm. Thus, Equation (3) can be refined as
where τb, i is the friction torque from the ith Bowden-cable transmission unit.
According to the existing research results (44), the friction of the motor reducers and robot joints can be simplified as a Coulomb-viscous model as follows:
where τr, i and τj, i represent the friction torques from the ith reducer and robot joint. bi is the coefficient of viscosity. τc, i denotes the Coulomb friction torque.
Therefore, by inserting Equations (4, 5) into Equation (2), the ith element of the integrated system friction vector can be obtained and expressed as
Here, τe, i represents the equivalent parameter for the Coulomb friction torque.
Patient-Active Admittance Control
Robot-assisted rehabilitation training with games played in virtual reality environments has positive effects on inducing active patient participation and encouraging the neural plasticity of the brain (36). Thus, in our research, a patient-active training strategy is developed by integrating an admittance control module and a virtual environment module. The overall block diagram describing the major components of the proposed control scheme is depicted in Figure 4. The exoskeleton system is equipped with a graphical guidance interface running on a commercial computer with different virtual games. During rehabilitation training, the operator was seated on a chair with the upper arm connected to the exoskeleton via a custom-made cuff and the palm grasping the end-effector. Instructions were presented on the screen placed in front of the therapeutic robot. The visual and acoustical feedbacks from the virtual environment provide effective guidance for the operator to enhance the awareness of training performance and execute the required training tasks. The system can provide quantitatively evaluated reports for proposed exercises. The statistical training results facilitate therapists to modulate the exercise difficulty levels and training intensity based on the practical recovery status of patients and therapeutic goals.
The real-time information about robot configuration and human–robot interaction, which are acquired from F/T sensors, position sensors, as well as the switches and pushbuttons mounted at the end-effector, are transmitted into a virtual keyboard unit to handle the virtual game process. The virtual keyboard unit was developed in the Microsoft Visual C++ programming environment and used as the interface between the operator and the virtual environment, allowing patient-active training during rehabilitation. In other words, the disabled patient can play the virtual game by actively manipulating the exoskeleton, and this is beneficial to the recovery of motor function and mental confidence. Communication between the RTW control system and the virtual environment was established via the transmission control protocol/internet protocol (TCP/IP).
The admittance control module is developed to regulate the robot configurations and human–robot interaction forces at the end-effector while executing patient-active training. The fed-back forces from the end-effector, Fe(t), measured by the distal F/T sensor are transformed into the actual forces in basic Cartesian space, F(t), through coordinate conversion. The force errors, ΔF(t), between the desired interaction forces, Fd(t), and the actual interaction forces at the end-effector are transmitted into an admittance filter to compute the value of position regulation, ΔP(t). The desired impedance characteristic describing the relationship between interaction force and end-effector position can be expressed as
Here Pd (t) denotes the desired inertial training position of the end-effector predefined according to the virtual game scenes; Pc (t) denotes the corresponding control position of the end-effector in Cartesian space; Md, Bd, and Kd are the objective inertia, damping, and stiffness of the admittance filter.
Thus, in the frequency domain, Equation (7) can be represented as
The resultant control position, Pc (t), which depends on the distal interaction forces and admittance parameters, can be converted to the angular position in joint coordinates, θc (t), via the inverse kinematics of the robot. A detailed description of the analytical inverse kinematic resolution of the proposed redundant exoskeleton has been analyzed in (43).
Thus, from Equations (7, 8), we have
where Inv (·) denotes the inverse kinematic calculation. The inner position controller is implemented to move the robot to the desired position expressed by θc (t). The position control was realized by using a fuzzy sliding mode control (FSMC) scheme developed based on the system dynamics model, and it was proposed in our previous research (45).
According to Equation (1), since the inertia matrix is symmetric and positive definite, the dynamic model is refined as
The switching function of sliding surface S(t) can be defined as
where e(t) = θc(t) − θ(t) denotes the position tracking error. denotes the velocity tracking error. λ and η represent the positive diagonal matrixes of proportional gain and derivative gain.
Combining Equations (10, 11), the deviation of the sliding variable can be calculated as
And then, the control law can be designed as
where sgn (·) means the sign function. ε represents a positive switching gain computed by a fuzzy controller (45).
For the purpose of demonstrating the stability of the proposed patient-active control algorithm, a positive definite Lyapunov function candidate is defined as
Differentiating Equation (14) with respect to time t and combining Equations (10) with Equation (13) yields Equation (15) as follows.
Here, the lumped effects of uncertainties Du are supposed to satisfy the following assumption.
Assumption 1: The boundary of the uncertainty term can be given as (46)
If the positive switching gain is selected as
then (16) can be rewritten as
Here, it can be observed that is negative definite. Thus, the proposed controller satisfies the Lyapunov stability criteria, and the position tracking error gradually converges to the sliding surface S(t) = 0 in finite time.
Upon completing the hardware design, dynamic modeling, and controller development, three typical experiments were conducted on the exoskeleton to validate the feasibility of the proposed patient-active admittance control strategy. In the first case, the position tracking experiment without the operator and external interactions was carried out to analyze the control performance of the inner fuzzy sliding mode position controller. In the second case, the free arm movement training experiment with different admittance parameters was conducted with three healthy subjects. In the third case, the virtual airplane-game operation training with graphical guidance was carried out with two healthy subjects and eight stroke patients with different Fugl-Meyer assessment (FMA) scores (47). The ethical approval of the implemented experimental approaches have been obtained from the Human Subjects Ethics Subcommittee of the Nanjing University of Aeronautics and Astronautics. The participants of this research were recruited from the local districts through advertisement. The research on the developed patient-active control strategy had been conducted since February 2017. The upper limb rehabilitation exoskeleton system was designed by Qingcong Wu and Xingsong Wang.
Position Tracking Experiments
According to the control diagram illustrated in Figure 4, the proposed admittance-based patient-active control scheme will be converted into a position controller to track the predefined training trajectory, if the desired force and the actual human–robot interaction force are equal to zero. Actually, the inner position controller is one of the kernel algorithms of the patient-active control method, as it is responsible for modulating the exoskeleton configuration based on the position regulation value output from the admittance filter. Therefore, it is necessary to demonstrate the feasibility of the proposed FSMC-based inner position control strategy.
The position tracking experiment without the participation of the subject was carried out to evaluate the position control performance. The desired position trajectory of the end-effector, which is defined in the base robot coordinate frame of the exoskeleton and parallel to the coronal plane, is shown in Figure 5A. There are four waypoints (A, B, C, and D) defined in the available workspace of the exoskeleton, and the initial location of the end-effector is set to Point A. The overall trajectory can be divided into four continuous subtrajectories. Firstly, the end-effector is controlled to move horizontally from point A to point B in 4 s. It also takes 4 s to move from point B to point C. The third subtrajectory is designed to follow the path from point C to point D in 4 s. Finally, the end-effector is returned from point D to point A in the last 4 s. It should be pointed out that, to guarantee the smoothness of the trajectory and avoid undesirable impact phenomena, the subtrajectory between two points is determined based on the minimum jerk cost principle (48). The terminal motion states of the former subtrajectory, including the positions, velocities, and accelerations, are the same as the initial motion states of the next subtrajectory.
Figure 5. Experimental results of position tracking tests with different control schemes. (A) The comparison among desired trajectory, the trajectory with PID controller, and the trajectory with fuzzy sliding mode controller (FSMC). (B) Time histories of position tracking errors.
The experimental performance of the proposed FSMC algorithm was compared to that of a conventional PID controller. The selected control parameters of the PID controller (i.e., proportional gain, integral gain, and derivative gain) were estimated via the Ziegler–Nichols method and carefully optimized by trial and error. The control parameters of the FSMC algorithm were optimally adjusted by intensive tests to improve control accuracy and ensure system stability. The results of trajectory tracking experiments with different control strategies are compared in Figure 5A. In addition, the time histories of position tracking errors, which are defined as the absolute distance between the desired and actual coordinates of the end-effector, are illustrated in Figure 5B. As can be observed, the tracking performance of the FSMC scheme has turned out to be far more effective than that of the PID controller. More specifically, the average output-tracking error declines from 10.42 mm (PID) to 5.21 mm (FSMC), while the root-mean-square error (RMSE) declines from 11.56 mm (PID) to 5.78 mm (FSMC) during the experiments. The peak-to-peak error is smaller (10.15 mm) with the FSMC strategy in comparison with that with the PID algorithm (18.75 mm). Therefore, the obtained results of position tracking experiments confirm the validity of the inner position controller.
Free Arm Training Experiment
The fundamental purpose of developing the patient-active control framework is to encourage the voluntary efforts and active participations of patients during rehabilitation training. The basic function of the admittance control module, as the core component of the patient-active controller, is to modulate the configuration of the exoskeleton according to the detected real-time human–robot interaction force and the desired mechanical admittance characteristic. Hence, the second experiment was conducted to evaluate the feasibility of the admittance controller in free arm operation training.
In this experiment, three healthy neurologically intact volunteers with various anthropometric parameters and ages (subject H1: male, height/1.7 m, weight/62.5 kg, age/29 years; subject H2: male, height/1.76 m, weight/66.2 kg, age/22 years; subject H3: female, height/1.62 m, weight/51.8 kg, age/46 years) were asked to undergo free arm movement trainings with different admittance parameters. The volunteers were comfortably positioned in the therapeutic system with their right arms wearing the exoskeleton. The limb lengths and the joint axes of the upper arm and the forearm of the exoskeleton were adjusted in accordance with the anthropometric parameters of wearers. Next, the subjects grasped the end-effector of the exoskeleton and actively performed horizontal reciprocating movements along the x-axis of the base coordinate system. The relation between the interaction force, measured by the distal F/T sensor of the end-effector, and the position deviation Δx, calculated from the positions of the robot's joints and inverse kinematics, reflects the corresponding training difficulty and intensity. The range of position deviation was generally restricted within the interval of [−400, 400 mm].
To compare and investigate the training performance with different admittance parameters, three different groups of parameters (E1, E2, and E3) were implemented to the admittance filter during the free arm movement experiments, as shown in Table 1. The subjects were required to repeat the aforementioned training task six times for each condition.
Existing study results indicate that the EMG signals provide information on the scale of muscular power and activation patterns (49). Besides, the results from our previous tests show that the EMG signal strength from the bicipital muscle and the brachioradialis muscle were larger than those from the brachialis muscle and the triceps muscle during free arm operation. Therefore, to analyze and compare the training intensity with different admittance parameters, the surface EMG signals from the bicipital and brachioradialis muscles of the wearers were acquired during the free arm training process. The measurement system mainly consists of active bipolar surface electrodes and sensors (Sunlephant-6 EMG System, Sichiray) used to obtain original signals, an integrated processing unit (SHIELD-EKG, Olimex) used for signal acquisition, amplification, and filtering, and a data analysis system running the Microsoft Visual Studio environment used for offline analysis. Before data acquisition, the exposed skin areas over the bicipital muscle and the brachioradialis muscle were cleaned with an alcohol pad to decrease contact resistance. The surface electrodes, with an effective area of 10 × 10 mm for each unit, were attached to the skin via double-faced adhesive tape. The EMG signals were sampled at 1 kHz with 12-bit resolution and filtered by using a third-order Butterworth high-pass filter with a cut-off frequency of 20 Hz. The processed signals were wirelessly transmitted to the data analysis system via a Bluetooth network.
As shown in Figure 6, the experimental results of subject H1 (single trial) present the relationships between the interaction force and position variation with different admittance parameters. It can be clearly observed that during the patient-active operation experiments, the changing tendency of position deviation is basically consistent with that of the interaction force. The active forces, from the subject and applied to the end-effector, lead to a corresponding modulation of robot configuration and, as a result, realize the active participation in rehabilitation training. Furthermore, increases in admittance parameters cause larger interaction forces for the same free arm training task. Figure 7 compares the EMG activity levels of subject H1 under different experimental conditions. The RMS approach is used for the feature extraction of raw EMG signals in this research. The RMS EMG value of the bicipital muscle under experimental condition E1 (0.466 V) turned out to be larger than those under condition E2 (0.281 V) and condition E3 (0.165 V).
Figure 6. Experimental results of free arm training tests conducted with healthy subject H1 with different admittance parameters. (A) Results under condition E1. (B) Results under condition E2. (C) Results under condition E3.
Figure 7. Time histories of EMG activity levels of bicipital muscle during free arm training tests conducted with healthy subject H1 for different admittance parameters. (A) EMG signals under condition E1. (B) EMG signals under condition E2. (C) EMG signals under condition E3.
Moreover, the experimental results (six trials) of the RMS EMG values from the bicipital muscle of different subjects and admittance parameters are compared in Figure 8. It can be concluded that the increase in the admittance parameters of the proposed patient-active control scheme leads to the increase of EMG activity levels. However, the specific surface EMG activity levels vary from person to person during the same experiment. The statistical results for the bicipital muscle and brachioradialis muscle are compared in Table 2. The experimental results indicate that by modulating the admittance filter, motion resistance and training intensity during patient-active rehabilitation therapy can be rationally adjusted to meet the capabilities and requirements of different patients.
Figure 8. Comparison results of RMS EMG values of bicipital muscles for different subjects and admittance parameters.
Table 2. Comparison of statistical results of RMS EMG values of bicipital muscle and brachioradialis muscle under different experimental conditions.
Virtual Airplane-Game Operation Experiment
The purpose of the third experiment was to evaluate the practical feasibility by applying the proposed admittance-based patient-active controller to rehabilitation training in a virtual reality environment. Figure 9 presents the experimental scenarios in which a healthy volunteer wearing an exoskeleton actively plays the virtual airplane-game with visual and acoustical feedback instructions. There were ten volunteers (two healthy subjects and eight post-stroke chronic patients) with various FMA scores participating in the virtual airplane-game operation experiment. The detailed anthropometry parameters and the motor ability of each subject are presented in Table 3.
Figure 9. Experimental scenarios of a healthy volunteer conducting virtual airplane-game operation experiment.
During the trial, the participants were required to actively manipulate the exoskeleton system and control the virtual airplane prototype displayed on the screen to accomplish the requested actions along the predesigned trajectory, including the taking-off operation, landing operation, and free-flight operation. To modulate the sensitivity of game control and improve the maneuverability of virtual training, the predefined thresholds of position variation (100 mm) and interaction force (10 N) were integrated into the virtual keyboard program. Only if the position variation and detected force exceed the respective threshold simultaneously, the virtual keyboard unit will trigger the corresponding keys to regulate the game process. In this way, the virtual keyboard acts as the interface that maps the human–robot interaction force and the robot configuration to the operations in the airplane game.
In this experiment, the admittance parameters were set as follows: Md = diag [0.03, 0.04, 0.06] Ns2/mm, Bd = diag [0.05, 0.04, 0.08] Ns/mm, Kd = diag [0.05, 0.06, 0.08] N/mm. All the subjects were required to make their best efforts to complete the airplane operation task six times. Figure 10 presents the experimental results of virtual airplane-game operations performed by healthy subject H1 in a single trial. More specifically, Figures 10A,B present the comparisons of interaction forces and position deviations in different directions of the base coordinate system. Further, the resultant interaction forces and combined position deviations are compared in Figure 10C. It can be seen that the variation tendencies of human–robot interaction forces are consistent with those of position deviations. The time history of the amplitude of EMG signals is depicted in Figure 10D, and the calculated RMS EMG value of the bicipital muscle is ~0.407 V. The subject wearing the exoskeleton system was able to actively handle the motion of the virtual airplane during rehabilitation training. Thus, experimental results substantiate the feasibility of the proposed control strategy.
Figure 10. Experimental results of virtual airplane-game operation training executed by healthy subject H1. (A) Interaction forces in different directions. (B) Position deviations in different directions. (C) Comparisons of the resultant interaction force and combined position deviation. (D) Time history of EMG activity levels of bicipital muscle.
The execution time required to finish the airplane operation task reflects the difficulty of the game for a specific participant. The execution times for the subjects with different FMA scores were recorded and compared (Figure 11). The average execution time for each subject was obtained (H1: 25.6 s; H2: 23.9 s, P1: 42.7 s; P2: 56.8 s; P3: 88.6 s; P4: 93.2 s; P5: 145.3 s; P6: 173.5 s). It should be pointed out that subjects P7 and P8 with severe paralysis were not able to complete the required training task and hence their data were excluded from the statistical data. The experimental results show that, with the proposed exoskeleton system and patient-active control strategy, a subject with adequate motor function capacity is able to actively handle the motion of virtual airplane and complete the requested training task in the virtual environment. The required execution time increases with decreasing motor function capacity of patients. The active participation of patients can be encouraged. However, the developed patient-active control scheme is not suitable for severely paralyzed patients, who require passive repetition training with the assistance of an exoskeleton.
Figure 11. Comparison results of execution times for subjects with different FMA scores required to complete the virtual airplane-game operation task.
From the results of three different experiments—the position tracking experiment, the free arm training experiment, and the virtual airplane-game operation experiment—it can be observed that the proposed FSMC-based admittance control strategy is capable of providing patient-active mode training during rehabilitation. More specifically, from the results of position tracking tests, it can be seen that the inner FSMC position controller is capable of achieving smaller tracking errors and better control performance when compared with the conventional PID controller, and can ensure the modulation accuracy of robot configuration based on the output value of the admittance filter. From the results of the free arm training experiment conducted with three healthy participants with different admittance parameters, it can be observed that the developed FSMC-based admittance controller can assist the patient actively undergo the free arm movement trainings with desired training difficulty and intensity. Moreover, it is able to encourage the voluntary efforts and active participations of patients during rehabilitation training. The increase of the admittance parameters of patient-active controller leads to the increase of motion resistance and the EMG activity levels of the bicipital muscle. According to the results of virtual airplane-game operation experiment conducted with two healthy volunteers and eight post-stroke chronic patients with various FMA scores, it can be found that, with the developed admittance-based patient-active control strategy, the volunteer wearing the exoskeleton system is able to actively handle the motion of virtual airplane during rehabilitation training. The rehabilitation training integrated with commercial virtual games without a specific predefined trajectory has valid impact on enhancing the interestingness of physical therapy and, furthermore, contributes to neurological rehabilitation and psychotherapy. The experimental results for different disabled patients indicate that the required execution time of the same operation task increases with the decrease of motor functions of patients. Besides, the feasibility in encouraging active participation has been proved from the statements of volunteers. In the actual performance, the protocol for each patient should be selected based on several factors, such as the detailed FMA scores of patient, the desired rehabilitation training programs, the quantitatively statistical training reports from the evaluation system, and the experience of physiotherapists.
There are several limitations in the proposed exoskeleton and control strategy. Firstly, the proposed patient-active controller can be used with patients with good cognitive function, fair sitting balance, and good upper limb motor performance; it cannot be applied to severely paralyzed subjects without any motor functions. The resistance from the exoskeleton needs to be overcome during patient-active training. Secondly, the proposed exoskeleton can be used only for patients with right-sided weakness, thus limiting the range of applicability. An extension of this research will be to improve the control strategy to be suitable for severely paralyzed patients. The mechanical structure will be further optimized to realize the switch between right arm training and left arm training. The effectiveness of the proposed rehabilitation exoskeleton system and control strategy will be tested and demonstrated via a more substantial trial in future works. Besides, the perceived value and motivation of patient will be qualitatively evaluated by using electroencephalography (EEG) sensor. A rational rehabilitation evaluation system will be developed to estimate recovery progress. The controller parameters, such as the admittance filter, should be optimized based on the evaluation of patients to improve treatment efficiency. In addition, the therapeutic training of the human hand will be integrated into the rehabilitation system.
This paper dealt with the development and validation of an upper limb exoskeleton and a patient-active admittance control strategy, which can be applied to assist the patients with affected arm motor functions in performing active training in virtual environments. Firstly, the major hardware of the wearable exoskeleton system, including the gravity-balanced mechanical structure with 7 + 2 DOFs and the MATLAB/RTW real-time control system, was briefly introduced. Then, the system dynamic model was established using the Lagrangian method. To encourage the active participation of patients during rehabilitation training, a patient-active controller was proposed based on the dynamic model. A patient wearing the exoskeleton can undergo active rehabilitation training with the guidance of a graphical interface, and the training trajectory is not constrained to a specific predetermined trajectory. Different kinds of existing commercial virtual games, which are far more realistic and interesting than the simple self-designed ones, can be integrated into the proposed control strategy via a virtual keyboard unit. The feasibilities of the proposed therapeutic system and control strategy were verified via three pilot tests. A position tracking experiment was carried out to evaluate the performance of the inner fuzzy sliding mode position control strategy. A free arm training experiment was conducted with three healthy subjects to study the functionality of the admittance module during free arm operation. To verify the practical feasibility of applying the patient-active control strategy to the training within virtual environments, a virtual airplane-game operation experiment was conducted with ten volunteers with different FMA scores.
QW and XW participated in the design of this study. QW and BC carried out the experiments and analyzed the experimental data. HW contributed in the exoskeleton development and maintenance. QW wrote and modified the manuscript. All authors read and approved the manuscript.
This work was supported in part by the National Natural Science Foundation of China (Grant No. 51705240), the Natural Science Foundation of Jiangsu Province (Grant No. BK20170783), the Aeronautical Science Foundation of China (Grant No. 2017ZC52037), and the State Key Laboratory of Robotics and System (HIT).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
1. Writing Group M, Mozaffarian D, Benjamin EJ, Go AS, Arnett DK, Blaha MJ, et al. Executive summary: heart disease and stroke statistics – 2016 update: a report from the American Heart Association. Circulation (2016) 133:447–54. doi: 10.1161/cir.0000000000000366
3. Vanbellingen T, Filius SJ, Nyffeler T, van Wegen EEH. Usability of videogame-based dexterity training in the early rehabilitation phase of stroke patients: a pilot study. Front Neurol. (2017) 8:654. doi: 10.3389/fneur.2017.00654
5. Niu J, Yang Q, Wang X, Song R. Sliding mode tracking control of a wire-driven upper-limb rehabilitation robot with nonlinear disturbance observer. Front Neurol. (2017) 8:646. doi: 10.3389/fneur.2017.00646
9. Pollock A, Farmer SE, Brady MC, Langhorne P, Mead GE, Mehrholz J, et al. Interventions for improving upper limb function after stroke. Cochrane Database Syst Rev. (2014) 11:CD010820. doi: 10.1002/14651858.CD010820.pub2
10. Meng W, Liu Q, Zhou ZD, Ai QS, Sheng B, Xie SQ. Recent development of mechanisms and control strategies for robot-assisted lower limb rehabilitation. Mechatronics (2015) 31:132–45. doi: 10.1016/j.mechatronics.2015.04.005
13. Wagner TH, Lo AC, Peduzzi P, Bravata DM, Huang GD, Krebs HI, et al. An economic analysis of robot-assisted therapy for long-term upperlimb impairment after stroke. Stroke (2011) 42:2630–2. doi: 10.1161/STROKEAHA.110.606442
14. Wilkins KB, Owen M, Ingo C, Carmona C, Dewald JPA, Yao J. Neural plasticity in moderate to severe chronic stroke following a device-assisted task-specific arm/hand intervention. Front Neurol. (2017) 8:284. doi: 10.3389/fneur.2017.00284
16. Wu QC, Wang XS, Chen B, Wu HT. Development of a minimal-intervention-based admittance control strategy for upper extremity rehabilitation exoskeleton. IEEE Trans Syst Man Cy-S (2018) 48:1005-16. doi: 10.1109/TSMC.2017.2771227
17. Qian Q, Hu X, Lai Q, Ng SC, Zheng Y, Poon W. Early stroke rehabilitation of the upper limb assisted with an electromyography-driven neuromuscular electrical stimulation-robotic arm. Front Neurol. (2017) 8:447. doi: 10.3389/fneur.2017.00447
18. Burgar CG, Lum PS, Scremin AME, Garber SL, Van der Loos HFM, Kenney D, et al. Robot-assisted upper-limb therapy in acute rehabilitation setting following stroke: department of veterans affairs multisite clinical trial. J Rehabil Res Dev. (2011) 48:445–58. doi: 10.1682/JRRD.2010.04.0062
19. Guzmán-Valdivia CH, Blanco-Ortega A, Oliver-Salazar MA, Gomez-Becerra FA, Carrera-Escobedo JL. HipBot – the design, development and control of a therapeutic robot for hip rehabilitation. Mechatronics (2015) 30:55–64. doi: 10.1016/j.mechatronics.2015.06.007
22. Nam C, Rong W, Li W, Xie Y, Hu X, Zheng Y. The effects of upper-limb training assisted with an electromyography-driven neuromuscular electrical stimulation robotic hand on chronic stroke. Front Neurol. (2017) 8:679. doi: 10.3389/fneur.2017.00679
25. Cui X, Chen W, Jin X, Agrawal SK. Design of a 7-DOF cable-driven arm exoskeleton (CAREX-7) and a controller for dexterous motion training or assistance. IEEE-ASME Trans Mech. (2017) 22:161–72. doi: 10.1109/TMECH.2016.2618888
26. Ren YP, Kang SH, Park HS, Wu YN, Zhang LQ. Developing a multi-joint upper limb exoskeleton robot for diagnosis, therapy, and outcome evaluation in neurorehabilitation. IEEE Trans Neural Syst Rehabil Eng. (2013) 21:490–9. doi: 10.1109/TNSRE.2012.2225073
27. Klein J, Spencer S, Allington J, Bobrow JE, Reinkensmeyer DJ. Optimization of a parallel shoulder mechanism to achieve a high-force, low-mass, robotic-arm exoskeleton. IEEE Trans Robot. (2010) 26:710–5. doi: 10.1109/TRO.2010.2052170
28. Huang J, Tu XK, He JP. Design and evaluation of the RUPERT wearable upper extremity exoskeleton robot for clinical and in-home therapies. IEEE Trans Syst Man Cybern Syst. (2016) 46:926–35. doi: 10.1109/TSMC.2015.2497205
30. Li ZJ, Su CY, Li GL, Su H. Fuzzy approximation-based adaptive backstepping control of an exoskeleton for human upper limbs. IEEE Trans Fuzzy Syst. (2015) 23:555–66. doi: 10.1109/TFUZZ.2014.2317511
33. Jiang XZ, Huang XH, Xiong CH, Sun RL, Xiong YL. Position control of a rehabilitation robotic joint based on neuron proportion-integral and feedforward control. J Comput Nonlin Dyn. (2012) 7:024502. doi: 10.1115/1.4005436
34. Hu XL, Tong KY, Song R, Zheng XJ, Leung WW. A comparison between electromyography-driven robot and passive motion device on wrist rehabilitation for chronic stroke. Neurorehabil Neural Repair (2009) 23:837–46. doi: 10.1177/1545968309338191
35. Kim B, Deshpande AD. An upper-body rehabilitation exoskeleton Harmony with an anatomical shoulder mechanism: Design, modeling, control, and performance evaluation. Int J Robot Res. (2017) 36:414–35. doi: 10.1177/0278364917706743
36. Keller U, van Hedel HJA, Klamroth-Marganska V, Riener R. ChARMin: the first actuated exoskeleton robot for pediatric arm rehabilitation. IEEE-ASME Trans Mech. (2016) 21:2201–13. doi: 10.1109/TMECH.2016.2559799
37. Duschauwicke A, Von ZJ, Caprez A, Lunenburger L, Riener R. Path control: a method for patient-cooperative robot-aided gait rehabilitation. IEEE Trans Neural Syst Rehabil Eng. (2010) 18:38–48. doi: 10.1109/TNSRE.2009.2033061
38. Ye WJ, Li ZJ, Yang CG, Chen F, Su CY. Motion detection enhanced control of an upper limb exoskeleton robot for rehabilitation training. Int J Hum Robot. (2017) 14:1650031. doi: 10.1142/S0219843616500316
42. Wu QC, Wang XS, Du FP. Development and analysis of a gravity-balanced exoskeleton for active rehabilitation training of upper limb. Proc Inst Mech Eng C J Mech Eng Sci. (2016) 230:3777–90. doi: 10.1177/0954406215616415
44. Ju MS, Lin CC, Lin DH, Hwang IS, Chen SM. A rehabilitation robot with force-position hybrid fuzzy controller: hybrid fuzzy control of rehabilitation robot. IEEE Trans Neural Syst Rehabil Eng. (2005) 13:349–58. doi: 10.1109/TNSRE.2005.847354
45. Wu QC, Wang XS, Du FP, Xi RR. Modeling and position control of a therapeutic exoskeleton targeting upper extremity rehabilitation. Proc Inst Mech Eng C J Mech Eng Sci. (2017) 231:4360–73. doi: 10.1177/0954406216668204
46. Amer AF, Sallam EA, Elawady WM. Adaptive fuzzy sliding mode control using supervisory fuzzy control for 3 DOF planar robot manipulators. Appl Soft Comput J. (2011) 11:4943–53. doi: 10.1016/j.asoc.2011.06.005
47. Gladstone DJ, Danells CJ, Black SE. The Fugl-Meyer assessment of motor recovery after stroke: a critical review of its measurement properties. Neurorehabil Neural Repair (2002) 16:232–40. doi: 10.1177/154596802401105171
Keywords: upper limb exoskeleton, robot-assisted, rehabilitation training, patient-active control, intention-driven, virtual environment
Citation: Wu Q, Wang X, Chen B and Wu H (2018) Patient-Active Control of a Powered Exoskeleton Targeting Upper Limb Rehabilitation Training. Front. Neurol. 9:817. doi: 10.3389/fneur.2018.00817
Received: 03 June 2018; Accepted: 10 September 2018;
Published: 11 October 2018.
Edited by:Nicola Smania, Università degli Studi di Verona, Italy
Reviewed by:Denise Taylor, Auckland University of Technology, New Zealand
Ru-Lan Hsieh, Shin Kong Wu Ho-Su Memorial Hospital, Taiwan
Copyright © 2018 Wu, Wang, Chen and Wu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Qingcong Wu, email@example.com