Sec. Biomedical Robotics
Volume 4 - 2017 | https://doi.org/10.3389/frobt.2017.00057
A Partitioning Algorithm for Extracting Movement Epochs from Robot-Derived Kinematic Data
- 1Department of Biostatistics, Yale School of Public Health, New Haven, CT, United States
- 2Cooperative Studies Program, Department of Veterans Affairs, West Haven, CT, United States
- 3Statistical Center for HIV/AIDS Research and Prevention, Fred Hutchinson Cancer Research Center, Seattle, WA, United States
- 4Department of Rehabilitation Sciences, University of Hartford, West Hartford, CT, United States
Point-to-point exercising of the upper-limb, as elicited through the presentation of visual targets on a computer screen, is a ubiquitous paradigm in the robot-assisted rehabilitation of motor-impaired individuals. Kinematic data collected from the robot’s sensors can be used to assess motor function; these data allow objective quantification of motor performance, an approach that shows promise both for guiding therapy and documenting patient progress. It is imperative that these datasets be fully understood and that tools be continually developed to support analysis and proper interpretation of robot-generated data. It is our experience that data collected from kinematic robots and partitioned according to target achievement may be prone to errors in analysis and interpretation because the movements of highly spastic individuals rarely stop within the target. Here, we propose that it is preferable to partition serial movement data based on local minima in velocity rather than target achievement; this design reflects the convention that movement epochs start and end at low or zero velocity, an assumption that is prevalent even in severely impaired individuals. Using a commercially available robot (MIT-Manus, Interactive Motion Technologies), we recorded movements from 16 moderate to severely impaired chronic stroke patients. Data partitioned according to target presentation typically interrupted movements in mid-motion: velocity at file start was 32.6 ± 26.4% of the overall velocity range. By re-apportioning, we obtained velocity at file start of 7.4 ± 9.5% of total range. Across 3,200 movements, 12.4 ± 10.4% of data points were re-allocated on average. Thus, our routine is capable of re-partitioning to more accurately reflect observed behavior. Our study is thus the first to identify and propose a solution to the problem of high relevance to the community of robot-aided rehabilitation specialists, i.e., sub-optimal partitioning according to target achievement. Through the algorithm described in this paper, we were able to re-partition the data so that movement epochs were properly demarcated at velocity minima, thus adhering to the fundamental assumptions of human motor behavior and facilitating analysis of patient performance on a per-movement basis.
Description of the Problem
For healthy individuals, directional sensitivity is seen in small, but measurable differences in speed, accuracy, and precision of movements made across a range of targets (Schmidt et al., 1979; Georgopoulos et al., 1982, 1986; Bullock and Grossberg, 1988; Zelaznik et al., 1988; Mushiake et al., 1991; Schwartz, 1992, 1993; Bootsma et al., 1994; Scott et al., 1997; Shadmehr et al., 1998; Patton and Mussa-Ivaldi, 2004; Yarosh et al., 2004; Yamamoto et al., 2006; Richardson et al., 2008; Brown et al., 2010; Coderre et al., 2010; Hewitt et al., 2011; Scott and Dukelow, 2011; Turnham et al., 2012; Berniker et al., 2014; Muceli et al., 2014). For people with impaired neuromotor systems, performance discrepancies between targets can be profound and also highly variable (Mattingley et al., 1994; Ghika et al., 1998; Wu et al., 2001; Azouvi et al., 2002; Gauthier et al., 2008; Swayne et al., 2008; Dipietro et al., 2009; Thies et al., 2009). Thus, the ability to stop on-target depends on (1) the specific task demands, (2) their level of motor impairment, and (3) the position of the target in space. Given the propensity for highly impaired individuals to overshoot a target (Acosta et al., 2011; Hu et al., 2011; Merlo et al., 2013; Mani et al., 2013), it is problematic that data extracted from rehabilitation robots is commonly partitioned based on target presentation.
Typically, once the robot’s cursor is held within the target for a pre-defined window, the movement is presumed complete, and the next target is presented; this window is often a small fraction of a second and constant across all targets. For highly impaired individuals, who move slowly, erratically, or overshoot their target, mere target achievement may be an inappropriate criterion for partitioning movement units. Consider the example of a multi-point movement task, where patients are instructed to move around a wheel of targets (Figure 1A). Suppose the patient moves through one target but is unable to stop on-target and instead continues beyond the target before transitioning to the next targeted movement. The movement record will reset upon target achievement, with the last portions of the movement being truncated and inappropriately pre-pended to the file containing the next movement (Figure 1B). Thus, our goal is to re-organize data into epochs that reflect the complete movement unit and not necessarily what is windowed according to the robot’s programmed target presentation (Figure 1C).
Figure 1. Schematic of subject performing a robot-driven multi-target task (A); and kinematic record (velocity versus time) of data collected through serial targets (B,C). Raw data obtained from the robot may not coincide with the subject’s transition between targets (B); the time-series may require conditioning so that each movement is bounded by a local minimum of velocity (C). Direction annotations in figure legends are Nt = North toward (from center target toward North target), Nb = North back (from North target back to center target), NEt = Northeast toward (toward the NE target), NEb = Northeast back, and Et = East toward; see Section “Patient Population and Protocol.”
Importance of the Problem
There is obvious benefit to automated partitioning of the continuous data stream by the robot. While we make no assumption about the intent of the robot manufacturer and it would be unusual for a technology to be described with the level of granularity that it’s process for file writing is full detailed, there are many products that suggest that they are, or could be, programmed to write out data based on target presentation (Hogan et al., 1995; Lockery et al., 2011; Csaba, 2013; Crainic et al., 2014) and note that this is so in our own device, for which four identical robots were purchased from the same entity, for use in a multi-site clinical trial. Furthermore, we assume that the end-user would prefer the data be partitioned into movement epochs, not strictly by target achievement; as seen in Figure 1, these two criteria may yield two different datasets. Obviously, there is need to partition the movement data collected from patients in a way that is intuitive and commensurate with how the task both performed (by the patient) and observed (by the clinician); a substantial portion of the robot’s utility is in providing accurate quantitative support to guiding therapy in real-time and supporting offline analysis. Moreover, considering that in adaptive robotics, early-session data are used to train the robot’s force-impedance settings for optimized re-training (Patton and Mussa-Ivaldi, 2004; Xu et al., 2011; Song et al., 2015), the ongoing inquiry into movement decomposition (modeling the speed profile as a series of log-normal curves) (Rohrer et al., 2002; Dipietro et al., 2009; Balasubramanian et al., 2012, 2015), or the robotic manipulandums prevalent in industrial applications (Gao and Zhang, 2015; Chen et al., 2016; He et al., 2017). These arenas are just a few examples of where boundary conditions are critically important parameters. Whereas initial and final position and velocity are typically integral to modeling and intelligent robotics, it is imperative that the data from the robots provide robustly partitioned movements, with reliable estimates of position and velocity at the time of movement start and end.
In substantiation of this enterprise, there is a single primary assumption, i.e., movements start and end at a period of low or zero velocity. This has been demonstrated repeatedly to be true for healthy individuals (Flash and Hogan, 1985; Plamondon, 1991; Harris and Wolpert, 1998; Pattacini et al., 2010). More relevant to rehabilitation robotics, this framework has been shown to apply even in severely impaired individuals: movement onset and cessation is from rest or at low speed if transitioning in a movement re-direction; velocity profiles are typically single or multiple peaked (Trombly, 1993; Cirstea and Levin, 2000; Rohrer et al., 2002; Wininger et al., 2009). To wit, this principle is embedded in robot-based assistive technology (Patton and Mussa-Ivaldi, 2004; Kahn et al., 2006; Velliste et al., 2008; Mazzoleni et al., 2014). And while not an explicit requirement for our algorithm, we note that a bell-shaped velocity profile is typical of a healthy actor, and conformity to a bell-shaped template is an indication of motoric recovery (Trombly, 1993; Rohrer et al., 2002).
Patient Population and Protocol
The data used in this study represent a sample from a larger pool of data collected during the VA-ROBOTICS randomized clinical trial (Lo et al., 2009, 2010; Wu et al., 2016). Participants were seated in the study robot, the MIT-Manus system (InMotion Technologies, Cambridge, MA, USA), which utilized pre-programmed exercise regimens (Aisen et al., 1997). Inclusion and exclusion criteria for the main trial are described fully elsewhere (Lo et al., 2009), but are summarized as follows: inclusion on the basis of index stroke >6 months prior, 18 years of age or older, moderate-to-severe impairment (Fugl–Meyer score between 7 and 38 points, inclusive), cognitive and language acuity to understand the instructions, willingness to avoid new rehabilitation activities during the study, and provision of informed consent; exclusion included circumstances that prevented participation in or completion of the study, co-enrollment in a competing trial, and prior exposure to robotic therapy. No additional criteria were imposed for the purposes of this sub-study. Not all participants provided a complete recorded sample across the full target wheel in the point-to-point movement task; the participants analyzed here are thus a convenience sample of those who performed the same task at least once in their time in the trial. We analyzed movements performed in a cyclic point-to-point movement task where participants moved their affected arm within the transverse plane, in order to place a cursor within a target on a computer screen above the robot. The target moved in a predictable fashion around eight directions (N, NE, E, SE, S, SW, W, and NW); for each direction, there was a “toward” target (e.g., North toward) and “back” to center (North back) movement, yielding 16 movements per cycle. Participants recorded five cycles (80 total movements) per visit. The robot’s operating system was programmed to provide kinematic data in separate files on a per-movement basis, with the movement direction indicated in the file name. Data were sampled at 200 Hz and were not processed prior to file writing.
Data Acquisition and Processing
Raw planar position data (x- and y-position versus time) were conditioned via Tukey’s 3R smoother (Bryc and Peligrad, 1992), differentiated to instantaneous velocity, converted into a one-dimensional instantaneous velocity via Euclidean distance calculation, and smoothed again. The smoother used here is “3R” meaning that it computes a replacement value based on running medians of length 3; the process is repeated until convergence (Tukey, 2000). Data conversion into tab-delimited files was performed using a custom routine in Octave numerical computing environment (v3.2.4); all data processing and algorithmic activities were performed using custom routines in the R statistical software (v 3.3.1).
The objective of our algorithm is to identify landmarks in the kinematic record where the subject is most likely to be transitioning between targets. Our main assumption is that targeted movements begin and end at a local velocity minimum (Jeannerod, 1990; Culmer et al., 2009; Perfetti et al., 2011). Our two secondary assumptions are (1) patients’ true transition point is most likely to be found after the file terminus and not before; and (2) the local minimum associated with the true transition point is a deep valley offset by relatively large decrease and/or large increase in velocity.
Data files were loaded two-at-a-time, in serial order, i.e., Northeast toward + Northeast back (NEb), then NEb + East toward, etc. As a precaution against artifact, data were smoothed with an additional local polynomial regression fitting (LOESS) with a 0.5-s (100-sample) window.
Following the main assumption: local maxima Mj and minima mk were extracted as ordered pairs of time and instantaneous velocity:
The plus-or-minus 2 reflects that this difference is taken over a signed value (value is either +1 or −1, so the difference between adjacent points across a transition will yield ±2).
Following secondary assumption 1: local minima were retained if they occurred late in the first file or prior to the peak velocity of the second file; “late” is defined as within 0.5 s (100 samples) of the first file terminus.
Following secondary assumption 2: for each local minimum in the velocity versus time portrait, the greater valley depth, δ, was calculated as the maximum of (i) the vertical distance, d1, from nearest preceding local maximum versus (ii) the vertical distance, d2, from nearest succeeding local maximum, i.e., δ = max(d1, d2), where
where ⟨tj, vj⟩ = Mj and ⟨tk, vk⟩ = mk. Any minima such that δ was greater than 10% of the total range of velocity across the two files were retained as candidate transition points (Figure 2). Given the prioritization of the main assumption, if there were no “substantial” minima, then the set of candidate minima was re-defined to include any local minima. Figure 2 highlights identification of d1 and d2 for one local minima (at time approximately t = 1.2 s), but per secondary assumption 1, the local minima at t = 1.5 and 1.9 s would both yield their own d1 and d2s.
Figure 2. Illustration of Steps 1–3: two serial movement records are concatenated; all local extrema were extracted (circles and squares; Step 1) and retained if occurring later than 0.5-s before the terminus of file 1 (diamond) or before the peak velocity in file 2 (last square; Step 2), and local min–max ranges were calculated (Step 3, dashed lines). Direction annotations in figure legend is Eb = East back (from East target back to center target), and SEt = Southeast toward (from center target toward Southeast target); see Section “Patient Population and Protocol.”
Among all surviving candidate minima, the following rule was used to identify the transition point.
Within 1 s (200 samples) of the first candidate minimum, the single candidate with the least absolute instantaneous velocity was retained as the transition point. If multiple candidates shared the same instantaneous velocity value, then the earliest candidate was retained.
If there were no local minima whatsoever, the original file terminus was retained as the transition point.
We summarize our algorithm in Figure 3.
In order to measure both the extent to which target-partitioned files deviate from expectation, and also the effectiveness of our algorithm, we extracted several features from the raw- and re-conditioned data including average velocity and instantaneous velocity at movement onset and cessation. Additionally, given the template of an approximately bell-shaped velocity profile, we measured the goodness-of-fit of a second-order polynomial function to log-transformed velocity data via the coefficient of determination (R2). Lastly, we report on the number of samples relocated to a new file. All hypothesis tests were performed via a paired t-test on samples.
A total of 16 participants met our inclusion criteria; several participants met these criteria on multiple days, yielding 40 datasets total. The participant pool at the time of study entry was 14 (88%) male, 65.8 ± 14.9 years of age, 63.4 ± 47.5 months poststroke, 23.9 ± 10.1 Fugl–Meyer scores.
Results from our analysis of the data packaged by the robot (“raw”) and re-packaged by our algorithm (“conditioned”) are shown in Table 1.
Average velocity does not change following adjustment of the file boundaries (8.0 ± 3.9 versus 7.9 ± 3.9 cm/s, P > 0.05). Raw data files started and ended with high velocities: 6.1 ± 6.0 and 6.9 ± 6.2 cm/s, respectively, equivalent to 32–36% of the total velocity range. Following file reapportionment, start- and end-velocities were reduced to 1.3 ± 1.7 and 1.2 ± 1.4 cm/s, respectively, equivalent to 7% total velocity range.
The average improvement in fit to a bell-shaped profile was 16.3% (0.50 ± 0.29 versus 0.43 ± 0.25, difference greater than zero per paired t-test: P < 0.001); however, the absolute value of change was >30% (|ΔR2| = 0.15 ± 0.15), showing that some raw data, when partitioned by the robot, yielded deceivingly large R2, when the movements, where not quite so bell-shaped. While the improvement of the fit to the bell-shape was interesting to us, we find the absolute value of change to be more compelling: a per-movement change of more than 30% suggests a remarkable susceptibility to error in assessing motor performance by this metric when the data are partitioned by target achievement as opposed to the nearest movement reversal. The high SD indicates that this effect is highly variable cycle-to-cycle and that the effect of re-partitioning does not incur uniform change on extracted features. We note the substantial transfer of data between files: 12.4 ± 10.4% of data were re-allocated to different files, corresponding to 6.3 ± 14.2% of total movement range.
In Figure 4, we show two complete exemplars before and after re-partitioning.
Figure 4. Exemplars of complete target cycles: 16 movements each. Top panels show movement cycles as partitioned by the robot; bottom panels show movement cycles conditioned post hoc: all boundaries coincide with local minima.
In Figure 5, we show two exemplars plotted in the plane of movement, i.e., x and y within the transverse plane, demonstrating conditioned data partitioned at movement reversals.
Figure 5. Exemplars in the plane of movement: data from two files are plotted. Raw data (left) show partitioning within the bounds of center target (data break near origin); conditioned data (right) show partitioning at movement reversals.
There is increasing interest in understanding kinematic movements of the upper-limb in motor-impaired individuals (Averta et al., 2017); while not all studies involve targeted movements, target training is a ubiquitous paradigm in rehabilitation. Furthermore, identification of single movements by velocity threshold algorithms are widely used (Burdet et al., 2000; Yoon et al., 2001; Casellato et al., 2012). To our knowledge, we are the first to raise issue with the convention of imposing a constant time criterion over all movement directions, given that many patients exhibit directionally dependent movement characteristics and propensity to move slowly through a target overshoot. We show that data outputted by a popular, commercially available robot, measuring impaired persons, yield highly counter-intuitive file sets when partitioned according to target presentation does not yield data files partitioned near movement reversals. Despite the erratic nature of data collected from impaired individuals, we obtained robust results through a simple algorithm involving straightforward calculations with only three assumptions. This study is most relevant to those extracting kinematic data from rehabilitation robots situated in a clinic with moderately to severely impaired clientele: a fixed and brief time criterion for target achievement may coincide with movement reversals in highly skilled and healthy individuals, but we should expect that for most patients with neurological deficit, movement reversals will lag target achievement across some or all of the targets.
Advantages and Limitations
This method is intended to allow for enhanced accuracy in extracting data from biomedical robotic devices. In any scenario where it is desirable to analyze motor skill on a per-movement basis, this method will allow for high-fidelity partitioning of data from movement start to movement end, not per se from target presentation to target achievement. The main limitation of this method is that it requires three embedded assumptions about the velocity profile: onset and cessation of movement at velocity minima; transition of movement at the point of target achievement or after; and the local minimum will occur in a “deep valley” where at least one “valley wall” is tall (10% of total velocity). While the first two assumptions are intuitive and compatible with commonly held expectations of human motor performance, the third assumption is potentially problematic, as the optimal threshold may change, depending on the sampling rate, filter characteristics, and raw performance of the human actor. While within our own dataset, δ equivalent to 10% velocity range provided adequate threshold, we recognize that this is at best a rule-of-thumb and that threshold selection may be empiric from study to study. Nevertheless, we believe that this is a feature of the algorithm that is easy to modify ad hoc and does not impact interpretation of results.
Regarding our assumptions, it is instructive to contemplate scenarios where the assumptions come into jeopardy. Given the apparently universal precept that movement epochs begin and end with—at minimum—a change in movement direction, and more typically, a pause in motion, the assertion of a local minimum in velocity at the movement boundaries seems robust. There may be higher-dimensional movement tasks where high velocity in one dimension obscures a velocity minimum in another dimension, but this may be addressed by selective filtering for minima. On the other hand, there is the implicit expectation here that the target is always achieved. In cases where the target is not achieved, but the user changes direction anyways, this autonomous over-ride will not be detected: it’s the robot’s acquisition of target achievement that guides our algorithm. We believe this to be valid, since the robot-aided rehabilitation paradigm assumes that the user attends to the presented target until achievement, i.e., until such time that the robot presents a new target. Our secondary assumptions are not as straightforward: in particular, the designation of 0.5 s and 10% velocity range as thresholds for winnowing candidate minima was arbitrary, albeit informed from inspection of the data. Surely, there are plausible circumstances where these conditions may prove sub-optimal; we urge vigilance on the part of the investigator, and a willingness to take an empiric approach to threshold setting.
We do not necessarily suggest that the native data obtained from robots are flawed. However, given the evidence that this problem pervades other studies (Perfetti et al., 2011; Huang and Ahmed, 2014; Muceli et al., 2014), we believe that our findings may add impetus to revisit prior inquiries into directional-specific movement. It is beyond the scope of this paper to speculate on which scenarios may make this issue more likely. Investigators would be well-advised to check their data in all cases to verify their assumptions.
Whereas the algorithm presented here is the first of its kind, it remains to be determined whether other approaches may provide yet improved results, particularly on more challenging datasets. Of further interest to the community would be establishing normative ranges for multi-target datasets so that further developments in this arena can be objectively measured against empirical benchmarks. We believe that this algorithm may provide additional tools to those wishing to study the directional dependency of movement exhibited by healthy and impaired actors. While it would be ideal to test the need for this algorithm in healthy persons, such exploration is beyond the scope of this article. However, we speculate that most healthy individuals, given a reasonable task (adequately sized target and adequate target achievement time within sub-maximal velocity range, etc.), would yield data that were suited for partitioning by target achievement: it would be expected that in most cases the actor would have no physiological impediment to stopping on-target.
In this work, we draw attention to the potential for error consequent from the partitioning of kinematic data obtained from rehabilitation robots: human actors start- and stop movements at low velocity, including severely impaired individuals; at the same time, impaired persons are unlikely to stop on-target. Thus, in target-tracking tasks, it is likely preferable to partition data at velocity minima. In our own dataset, we found that data partitioned according to target presentation exhibited features inconsistent with the basic assumptions of human motor control. Re-partitioning the data resulted in the re-assignment of >10% of data points, but a substantial restoration of boundary conditions to levels commensurate with expectation.
In this study, we identify a problem endemic to robotic tracking of targeted movements in impaired persons: the inappropriately parsed datasets when partitioned according to target presentation in the setting of a constant time target achievement criterion. We propose an algorithm for re-partitioning these data according to finding local minima of velocity near the file terminus, yielding new data series segmented naturalistically in conformance with the assumption that targeted movements begin and end with a movement reversal. We encourage others to consider incorporating a re-partitioning step in analysis of robot data, and in cases where re-partitioning is not undertaken, to justify that the data were partitioned properly by the robot.
The study protocol was approved by the institutional review boards at each participating site and the human rights committee at the coordinating center, listed as follows: VA Maryland Health Care System (Baltimore), North Florida/South Georgia Veterans Health System (Gainesville), VA Puget Sound Health Care System (Seattle), and VA Connecticut Healthcare System (West Haven). All participants gave written informed consent prior to study participation. The study was registered on ClinicalTrials.gov (ClinicalTrials.gov identifier, NCT 00372411). The contents do not represent the views of the U.S. Department of Veterans Affairs or the United States Government.
This secondary study was initially conceived and conducted by MW and AB. Original trial design and operations was overseen by PG and PP. All authors were involved in the drafting and approving of this manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
This study was conducted by the United States (U.S.) Department of Veterans Affairs, Office of Research and Development, Cooperative Studies Program. Additional support for this analysis was through the Veterans Affairs Connecticut Research and Education Foundation.
Acosta, A. M., Dewald, H. A., and Dewald, J. P. A. (2011). Pilot study to test effectiveness of video game on reaching performance in stroke. J. Rehabil. Res. Dev. 48, 431–444. doi: 10.1682/JRRD.2010.04.0052
Aisen, M. L., Krebs, H. I., Hogan, N., McDowell, F., and Volpe, B. T. (1997). The effect of robot-assisted therapy and rehabilitative training on motor recovery following stroke. Arch. Neurol. 54, 443–446. doi:10.1001/archneur.1997.00550160075019
Averta, G., Della Santina, C., Battaglia, E., Felici, F., Bianchi, M., and Bicchi, A. (2017). Unvealing the principal modes of human upper limb movements through functional analysis. Front. Robot. AI. 4:37. doi:10.3389/frobt.2017.00037
Azouvi, P., Samuel, C., Louis-Dreyfus, A., Bernati, T., Bartolomeo, P., Beis, J. M., et al. (2002). Sensitivity of clinical and behavioural tests of spatial neglect after right hemisphere stroke. J. Neurol. Neurosurg. Psychiatry 73, 160–166. doi:10.1136/jnnp.73.2.160
Balasubramanian, S., Melendez-Calderon, A., and Burdet, E. (2012). A robust and sensitive metric for quantifying movement smoothness. IEEE Trans. Biomed. Eng. 59, 2126–2136. doi:10.1109/TBME.2011.2179545
Balasubramanian, S., Melendez-Calderon, A., Roby-Brami, A., and Burdet, E. (2015). On the analysis of movement smoothness. J. NeuroEng. Rehabil. 12, 112. doi:10.1186/s12984-015-0090-9
Berniker, M., Franklin, D. W., Flanagan, J. R., Wolpert, D. M., and Kording, K. (2014). Motor learning of novel dynamics is not represented in a single global coordinate system: evaluation of mixed coordinate representations and local learning. J. Neurophysiol. 111, 1165–1182. doi:10.1152/jn.00493.2013
Bootsma, R., Marteniuk, R., MacKenzie, C., and Zaal, F. J. M. (1994). The speed-accuracy trade-off in manual prehension: effects of movement amplitude, object size and object width on kinematic characteristics. Exp. Brain Res. 98, 535–541. doi:10.1007/BF00233990
Brown, L. E., Wilson, E. T., Obhi, S. S., and Gribble, P. L. (2010). Effect of trial order and error magnitude on motor learning by observing. J. Neurophysiol. 104, 1409–1416. doi:10.1152/jn.01047.2009
Bryc, W., and Peligrad, M. (1992). The central limit theorem for Tukey’s 3R smoother. Stat. Probab. Lett. 13, 29–37. doi:10.1016/0167-7152(92)90233-U
Bullock, D., and Grossberg, S. (1988). Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. Psychol. Rev. 95, 49–90. doi:10.1037/0033-295X.95.1.49
Burdet, E., Osu, R., Franklin, D. W., Yoshioka, T., Milner, T. E., and Kawato, M. (2000). A method for measuring endpoint stiffness during multi-joint arm movements. J. Biomech. 33, 1705–1709. doi:10.1016/S0021-9290(00)00142-1
Casellato, C., Tagliabue, M., Pedrocchi, A., Papaxanthis, C., Ferrigno, G., and Pozzo, T. (2012). Reaching while standing in microgravity: a new postural solution to oversimplify movement control. Exp. Brain Res. 216, 203–215. doi:10.1007/s00221-011-2918-2
Chen, D., Zhang, X., and Lai, Z. (2016). “Energy-optimal trajectory generation for robot manipulators via Hamilton-Jacobi theory,” in 2016 13th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI) (Xi’an, China: IEEE), 371–376.
Cirstea, M. C., and Levin, M. F. (2000). Compensatory strategies for reaching in stroke. Brain J. Neurol. 123(Pt 5), 940–953. doi:10.1093/brain/123.5.940
Coderre, A. M., Zeid, A. A., Dukelow, S. P., Demmer, M. J., Moore, K. D., Demers, M. J., et al. (2010). Assessment of upper-limb sensorimotor function of subacute stroke patients using visually guided reaching. Neurorehabil. Neural Repair 24, 528–541. doi:10.1177/1545968309356091
Crainic, M.-F., Preitl, S., Sandru, L. A., and Dolga, V. (2014). “Secure handwriting using a robot arm for educational purpose,” in Methods and Models in Automation and Robotics (MMAR), 2014 19th International Conference On (Miedzyzdroje: IEEE), 58–63. doi:10.1109/MMAR.2014.6957325
Csaba, G. (2013). “Improvement of an adaptive fuzzy-based obstacle avoidance algorithm using virtual and real kinect sensors,” in Computational Cybernetics (ICCC), 2013 IEEE 9th International Conference on (Tihany: IEEE), 113–120. doi:10.1109/ICCCyb.2013.6617572
Culmer, P. R., Levesley, M. C., Mon-Williams, M., and Williams, J. H. G. (2009). A new tool for assessing human movement: the kinematic assessment tool. J. Neurosci. Methods 184, 184–192. doi:10.1016/j.jneumeth.2009.07.025
Dipietro, L., Krebs, H. I., Fasoli, S. E., Volpe, B. T., and Hogan, N. (2009). Submovement changes characterize generalization of motor recovery after stroke. Cortex 45, 318–324. doi:10.1016/j.cortex.2008.02.008
Flash, T., and Hogan, N. (1985). The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5, 1688–1703.
Gao, Z., and Zhang, D. (2015). Performance analysis, mapping, and multiobjective optimization of a hybrid robotic machine tool. IEEE Trans. Ind. Electron. 62, 423–433. doi:10.1109/TIE.2014.2327008
Gauthier, L. V., Taub, E., Perkins, C., Ortmann, M., Mark, V. W., and Uswatte, G. (2008). Remodeling the brain: plastic structural brain changes produced by different motor therapies after stroke * supplemental material. Stroke 39, 1520–1525. doi:10.1161/STROKEAHA.107.502229
Georgopoulos, A., Schwartz, A., and Kettner, R. (1986). Neuronal population coding of movement direction. Science 233, 1416–1419. doi:10.1126/science.3749885
Georgopoulos, A. P., Kalaska, J. F., Caminiti, R., and Massey, J. T. (1982). On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex. J. Neurosci. 2, 1527–1537.
Ghika, J., Ghika-Schmid, F., and Bogousslasvky, J. (1998). Parietal motor syndrome: a clinical description in 32 patients in the acute phase of pure parietal strokes studied prospectively. Clin. Neurol. Neurosurg. 100, 271–282. doi:10.1016/S0303-8467(98)00054-7
Harris, C. M., and Wolpert, D. M. (1998). Signal-dependent noise determines motor planning. Nature 394, 780–784. doi:10.1038/29528
He, W., Ouyang, Y., and Hong, J. (2017). Vibration control of a flexible robotic manipulator in the presence of input deadzone. IEEE Trans. Ind. Inform. 13, 48–59. doi:10.1109/TII.2016.2608739
Hewitt, A. L., Popa, L. S., Pasalar, S., Hendrix, C. M., and Ebner, T. J. (2011). Representation of limb kinematics in Purkinje cell simple spike discharge is conserved across multiple tasks. J. Neurophysiol. 106, 2232–2247. doi:10.1152/jn.00886.2010
Hogan, N., Krebs, H. I., Sharon, A., and Charnnarong, J. (1995). Interactive Robotic Therapist. United States Patent: 5466213. Available at: http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO1&Sect2=HITOFF&d=PALL&p=1&u=%2Fnetahtml%2FPTO%2Fsrchnum.htm&r=1&f=G&l=50&s1=5466213.PN.&OS=PN/5466213&RS=PN/5466213 [accessed July 17, 2014].
Hu, X. L., Tong, K. Y., Li, R., Chen, M., Xue, J. J., Ho, S. K., et al. (2011). “Post-stroke wrist rehabilitation assisted with an intention-driven functional electrical stimulation (FES)-robot system,” in 2011 IEEE International Conference on Rehabilitation Robotics (ICORR) (Zurich, Switzerland: IEEE), 1–6.
Huang, H. J., and Ahmed, A. A. (2014). Reductions in muscle coactivation and metabolic cost during visuomotor adaptation. J. Neurophysiol. 112, 2264–2274. doi:10.1152/jn.00014.2014
Jeannerod, M. (1990). The Neural and Behavioural Organization of Goal-Directed Movements. Oxford, England; New York: Clarendon Press; Oxford University Press.
Kahn, L. E., Lum, P. S., Rymer, W. Z., and Reinkensmeyer, D. J. (2006). Robot-assisted movement training for the stroke-impaired arm: does it matter what the robot does? J. Rehabil. Res. Dev. 43, 619–630. doi:10.1682/JRRD.2005.03.0056
Lo, A. C., Guarino, P., Krebs, H. I., Volpe, B. T., Bever, C. T., Duncan, P. W., et al. (2009). Multicenter randomized trial of robot-assisted rehabilitation for chronic stroke: methods and entry characteristics for VA ROBOTICS. Neurorehabil. Neural Repair 23, 775–783. doi:10.1177/1545968309338195
Lo, A. C., Guarino, P. D., Richards, L. G., Haselkorn, J. K., Wittenberg, G. F., Federman, D. G., et al. (2010). Robot-assisted therapy for long-term upper-limb impairment after stroke. N. Engl. J. Med. 362, 1772–1783. doi:10.1056/NEJMoa0911341
Lockery, D., Peters, J. F., and Taswelly, C. (2011). CTGaming: a problem-Oriented registry for clinical teleGaming rehabilitation and intervention. J. Emerg. Technol. Web Intell. 3, 28–37. doi:10.4304/jetwi.3.1.28-37
Mani, S., Mutha, P. K., Przybyla, A., Haaland, K. Y., Good, D. C., and Sainburg, R. L. (2013). Contralesional motor deficits after unilateral stroke reflect hemisphere-specific control mechanisms. Brain 136, 1288–1303. doi:10.1093/brain/aws283
Mattingley, J. B., Phillips, J. G., and Bradshaw, J. L. (1994). Impairments of movement execution in unilateral neglect: a kinematic analysis of directional bradyskinesia. Neuropsychologia 32, 1111–1134. doi:10.1016/0028-3932(94)90157-0
Mazzoleni, S., Buono, L., Dario, P., and Posteraro, F. (2014). “Upper limb robot-assisted therapy in subacute and chronic stroke patients: preliminary results on initial exposure based on kinematic measures,” in 2014 5th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (Sao Paulo, Brazil: IEEE), 265–269.
Merlo, A., Longhi, M., Giannotti, E., Prati, P., Giacobbi, M., Ruscelli, E., et al. (2013). Upper limb evaluation with robotic exoskeleton. Normative values for indices of accuracy, speed and smoothness. NeuroRehabilitation 33, 523–530. doi:10.3233/NRE-130998
Muceli, S., Falla, D., and Farina, D. (2014). Reorganization of muscle synergies during multidirectional reaching in the horizontal plane with experimental muscle pain. J. Neurophysiol. 111, 1615–1630. doi:10.1152/jn.00147.2013
Mushiake, H., Inase, M., and Tanji, J. (1991). Neuronal activity in the primate premotor, supplementary, and precentral motor cortex during visually guided and internally determined sequential movements. J. Neurophysiol. 66, 705–718.
Pattacini, U., Nori, F., Natale, L., Metta, G., and Sandini, G. (2010). “An experimental evaluation of a novel minimum-jerk cartesian controller for humanoid robots,” in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (Taipei, Taiwan: IEEE), 1668–1674.
Patton, J. L., and Mussa-Ivaldi, F. A. (2004). Robot-assisted adaptive training: custom force fields for teaching movement patterns. IEEE Trans. Biomed. Eng. 51, 636–646. doi:10.1109/TBME.2003.821035
Perfetti, B., Moisello, C., Landsness, E. C., Kvint, S., Pruski, A., Onofrj, M., et al. (2011). Temporal evolution of oscillatory activity predicts performance in a choice-reaction time reaching task. J. Neurophysiol. 105, 18–27. doi:10.1152/jn.00778.2010
Plamondon, R. (1991). “On the origin of asymmetric bell-shaped velocity profiles in rapid-aimed movements,” in Tutorials in Motor Neuroscience, eds J. Requin, and G. E. Stelmach (Dordrecht: Springer Netherlands), 283–295. doi:10.1007/978-94-011-3626-6_23
Richardson, A. G., Lassi-Tucci, G., Padoa-Schioppa, C., and Bizzi, E. (2008). Neuronal activity in the cingulate motor areas during adaptation to a new dynamic environment. J. Neurophysiol. 99, 1253–1266. doi:10.1152/jn.01096.2007
Rohrer, B., Fasoli, S., Krebs, H. I., Hughes, R., Volpe, B., Frontera, W. R., et al. (2002). Movement smoothness changes during stroke recovery. J. Neurosci. 22, 8297–8304.
Schmidt, R. A., Zelaznik, H., Hawkins, B., Frank, J. S., and Quinn, J. T. (1979). Motor-output variability: a theory for the accuracy of rapid motor acts. Psychol. Rev. 47, 415–451. doi:10.1037/0033-295X.86.5.415
Schwartz, A. B. (1992). Motor cortical activity during drawing movements: single-unit activity during sinusoid tracing. J. Neurophysiol. 68, 528–541.
Schwartz, A. B. (1993). Motor cortical activity during drawing movements: population representation during sinusoid tracing. J. Neurophysiol. 70, 28–36.
Scott, S. H., and Dukelow, S. P. (2011). Potential of robots as next-generation technology for clinical assessment of neurological disorders and upper-limb therapy. J. Rehabil. Res. Dev. 48, 335. doi:10.1682/JRRD.2010.04.0057
Scott, S. H., Sergio, L. E., and Kalaska, J. F. (1997). Reaching movements with similar hand paths but different arm orientations. II. Activity of individual cells in dorsal premotor cortex and parietal area 5. J. Neurophysiol. 78, 2413–2426.
Shadmehr, R., Brandt, J., and Corkin, S. (1998). Time-dependent motor memory processes in amnesic subjects. J. Neurophysiol. 80, 1590–1597.
Song, A., Pan, L., Xu, G., and Li, H. (2015). Adaptive motion control of arm rehabilitation robot based on impedance identification. Robotica 33, 1795–1812. doi:10.1017/S026357471400099X
Swayne, O. B. C., Rothwell, J. C., Ward, N. S., and Greenwood, R. J. (2008). Stages of motor output reorganization after hemispheric stroke suggested by longitudinal studies of cortical physiology. Cereb. Cortex 18, 1909–1922. doi:10.1093/cercor/bhm218
Thies, S. B., Tresadern, P. A., Kenney, L. P., Smith, J., Howard, D., Goulermas, J. Y., et al. (2009). Movement variability in stroke patients and controls performing two upper limb functional tasks: a new assessment methodology. J. Neuroeng. Rehabil. 6, 2. doi:10.1186/1743-0003-6-2
Trombly, C. A. (1993). Observations of improvement of reaching in five subjects with left hemiparesis. J. Neurol. Neurosurg. Psychiatry 56, 40–45. doi:10.1136/jnnp.56.1.40
Tukey, J. W. (2000). Exploratory Data Analysis. Reading, MA: Addison-Wesley.
Turnham, E. J. A., Braun, D. A., and Wolpert, D. M. (2012). Facilitation of learning induced by both random and gradual visuomotor task variation. J. Neurophysiol. 107, 1111–1122. doi:10.1152/jn.00635.2011
Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S., and Schwartz, A. B. (2008). Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098–1101. doi:10.1038/nature06996
Wininger, M., Kim, N.-H., and Craelius, W. (2009). Spatial resolution of spontaneous accelerations in reaching tasks. J. Biomech. 42, 29–34. doi:10.1016/j.jbiomech.2008.10.015
Wu, C. Y., Wong, M. K., Lin, K. C., and Chen, H. C. (2001). Effects of task goal and personal preference on seated reaching kinematics after stroke. Stroke 32, 70–76. doi:10.1161/01.STR.32.1.70
Wu, X., Guarino, P., Lo, A. C., Peduzzi, P., and Wininger, M. (2016). Long-term effectiveness of intensive therapy in chronic stroke. Neurorehabil. Neural Repair 30, 583–590. doi:10.1177/1545968315608448
Xu, G., Song, A., and Li, H. (2011). Adaptive impedance control for upper-limb rehabilitation robot using evolutionary dynamic recurrent fuzzy neural network. J. Intell. Robot. Syst. 62, 501–525. doi:10.1007/s10846-010-9462-3
Yamamoto, K., Hoffman, D. S., and Strick, P. L. (2006). Rapid and long-lasting plasticity of input-output mapping. J. Neurophysiol. 96, 2797–2801. doi:10.1152/jn.00209.2006
Yarosh, C. A., Hoffman, D. S., and Strick, P. L. (2004). Deficits in movements of the wrist ipsilateral to a stroke in hemiparetic subjects. J. Neurophysiol. 92, 3276–3285. doi:10.1152/jn.00549.2004
Yoon, H.-S., Soh, J., Bae, Y. J., and Seung Yang, H. (2001). Hand gesture recognition using combined features of location, angle and velocity. Pattern Recognit. 34, 1491–1501. doi:10.1016/S0031-3203(00)00096-0
Zelaznik, H. N., Mone, S., McCabe, G. P., and Thaman, C. (1988). Role of temporal and spatial precision in determining the nature of the speed-accuracy trade-off in aimed-hand movements. J. Exp. Psychol. Hum. Percept. Perform. 14, 221–230. doi:10.1037/0096-15184.108.40.206
Keywords: rehabilitation, velocity, position, target, overshoot, stroke, spasticity
Citation: Beed AT, Peduzzi P, Guarino P and Wininger M (2017) A Partitioning Algorithm for Extracting Movement Epochs from Robot-Derived Kinematic Data. Front. Robot. AI 4:57. doi: 10.3389/frobt.2017.00057
Received: 28 July 2017; Accepted: 17 October 2017;
Published: 20 November 2017
Edited by:Elena De Momi, Politecnico di Milano, Italy
Reviewed by:Ioannis Georgilas, University of Bath, United Kingdom
Claudia Casellato, University of Pavia, Italy
Copyright: © 2017 Beed, Peduzzi, Guarino and Wininger. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Michael Wininger, email@example.com