- 1College of Intelligent Science and Engineering, Hubei Minzu University, Enshi, Hubei, China
- 2Sports Health and Collaborative Intelligent Engineering Research Center, Hubei Minzu University, Enshi, China
- 3Department of Electrical Engineering and Information Systems, Graduate School of Engineering, The University of Tokyo, Tokyo, Japan
- 4Hubei Engineering Research Center of Selenium Food Nutrition and Health Intelligent Technology, Enshi, Hubei, China
Introduction: To address the lack of integrated and clinically applicable motion capture systems for hand function assessment, we developed a wearable device capable of simultaneously recording finger curvature and surface electromyography (sEMG) signals from both healthy individuals and patients with motor impairments.
Methods: The dataset comprises 900 measurements of six predefined gestures collected from 15 participants using a six-channel sEMG motion-capture glove. Data were obtained through hospital-based field acquisition, ensuring clinical relevance and independence of the hardware–database framework. The recorded signals were processed using a Savitzky–Golay filter, followed by Short-Time Fourier Transform (STFT) for spectrogram generation. Multiple machine learning models, including SVM, LightGBM, and MLP, were employed for gesture classification.
Results: Most models achieved over 90% precision on both cross-validation and test sets, demonstrating robust classification performance across different gesture types and subject conditions.
Discussion: These results confirm that the proposed system maintains high recognition accuracy even in severely impaired subjects. The dataset presented here offers substantial value for gesture recognition research, rehabilitation assessment, and neuromuscular signal analysis.
1 Introduction
Finger motor dysfunction is commonly caused by neurological, muscular, or skeletal disorders, including stroke, spinal cord injury, neurodegenerative diseases (e.g., Parkinson’s disease), and trauma (Castelli et al., 2020). Such conditions disrupt neural signaling and muscular coordination, ultimately impairing fine motor control. While conventional clinical assessments remain standard practice, there is increasing interest in quantitative and objective evaluation technologies. These methods hold promise for early diagnosis, disease progression monitoring, and identification of condition-specific motor patterns (Nunes et al., 2022). Integrating such systems can automate traditional assessment procedures, provide objective biomarkers, and establish a closed-loop evaluation framework that improves diagnostic consistency and reduces clinician-dependent variability.
Recent developments in quantitative assessment methods for finger motor dysfunction can be broadly divided into two biosignal-driven approaches: surface electromyography (sEMG) for neuromuscular intent decoding and finger joint kinematics for motion tracking. sEMG enables non-invasive identification of motor intention by capturing muscle electrophysiological activity (Sadikoglu et al., 2017), whereas kinematic sensors supplement this by quantifying overt joint movement. These advancements align with the rapid progress in neurorobotics, encompassing areas such as motion intent decoding and haptic feedback systems (Li et al., 2023), as well as the assessment of patient muscle activity to enhance human-robot interaction in rehabilitation (Zhang et al., 2025; Cao et al., 2025). Prior studies have demonstrated that multi-objective optimization improves the robustness and accuracy of sEMG-based myoelectric control (Shaikh et al., 2024). Recent innovations include high-density electrode arrays for enhanced spatial resolution (Yeung et al., 2024), durable flexible sEMG sensors (Gao et al., 2024), and adaptive processing algorithms that mitigate motion artifacts and electrode displacement (Li et al., 2021). Meanwhile, multiphysics sensing technologies—such as FBG-based strain sensors for scalable finger-angle tracking (Kim et al., 2020) and dual IMU-EM frameworks for micro-gesture recognition (Liang et al., 2021)—further advance the precision of joint motion capture.
Existing methods for evaluating hand function commonly rely on either sEMG or kinematic signals (Suo et al., 2024), (De Smedt et al., 2016), yet each modality presents inherent limitations. sEMG is highly susceptible to noise interference and cannot adequately represent movement dynamics, whereas kinematic data alone fail to capture underlying neural control. Although recent studies indicate that multimodal fusion offers a more comprehensive assessment, its clinical translation remains challenging (Duan et al., 2024; Samui et al., 2023). To address these issues, we introduce a synchronised sEMG–kinematic acquisition system together with a multimodal learning framework capable of achieving robust gesture recognition across varying levels of motor impairment.
These innovations tackle the scarcity of synchronized multimodal data and reduce reliance on healthy subject models. We developed a thin-film resistive sensor integrated into a fiber-woven glove with six high-density sEMG channels, enabling simultaneous muscle and joint motion capture without spatiotemporal mismatch. To support real-world diagnosis, data were collected from 10 patients with myelitis, cerebral infarction, and cerebral hemorrhage during standardized gestures (Figure 1). Unlike public datasets focused on healthy subjects (Mukhopadhyay and Samui, 2020; Ozdemir et al., 2022; Furmanek et al., 2022; Salter et al., 2024). Our dataset incorporates impaired patients, improving clinical relevance. Meanwhile, multimodal sEMG fusion continues to demonstrate superiority in robustness and decoding performance, as shown in EMG–vision hybrid inference for prosthetic grasp intention (Zandigohar et al., 2024). Consistent with this trend, our multimodal fusion of sEMG and finger movement achieved 93.6% average precision in classifying motor neuron lesions and severity, outperforming sEMG-only (87.8%) or motion-only (87.8%) methods. The innovation highlights of our work are summarized as follows:
1. Novel Wearable System Integration: Developed a low-cost multichannel sEMG acquisition module integrated into a flexible data glove, enabling synchronous and multimodal capture of muscle activity and kinematic finger movement signals.
2. Clinically-Grounded Multimodal Dataset: Constructed a unique multimodal dataset comprising sEMG and motion data from 15 participants with varying degrees of hand motor function—including healthy individuals and patients with severe, moderate, and mild impairments—ensuring broad clinical relevance and ecological validity.
3. Robust and Reproducible Evaluation Framework: Consistent >90% accuracy across conventional ML models under cross-validation and independent testing confirms the dataset’s reliability for clinical rehabilitation, even in severe cases.
Figure 1. Measure the standard of action (a): right hand fist, indicating “0” (b); extend the index finger and bend the other four fingers to indicate “1” (c); raise your index and middle fingers to indicate “2” (d); the thumb and index finger are matched, as if indicating “OK” gesture, and the other three fingers are raised, indicating “3” (e); the thumb is bent to the palm center, and the other four fingers are straight, indicating “4” (f); the fingers are extended and the palm is facing outward, indicating “5”.
2 Methods
A six-channel sEMG sensor and a motion capture glove were used to collect gesture data from 15 participants, including healthy individuals and people with movement disorders. The sampling rate of sEMG signals is 225 Hz, and the data are preprocessed by the Savitzky–Golay filter and STFT for subsequent algorithm analysis.
2.1 Data acquisition
All experimental protocols involving human participants in this study were reviewed and approved by the Medical Ethics Committee of Hubei University for Nationalities [Ethics Approval Number: (2025) 05]. Before the study commenced, the researchers explained the study objectives in detail to all participants or their legal guardians to ensure full understanding of the research. All participants voluntarily signed written informed consent forms. During the study, participants’ personal identifying information was replaced with Subject IDs instead of real names.
The dataset consists of 15 participants, including healthy individuals and patients with varying degrees of hand motor impairment, rated from 0 (no movement) to 4 (normal function) (Table 1). Motor ability was assessed based on observable voluntary control: 0 indicates a complete loss of voluntary movement with no observable joint motion; 1 indicates slight voluntary movement that can perform the intended action, but with poor coordination and noticeably slow execution; 2 represents the ability to perform simple movements with limited strength, amplitude, and precision; 3 denotes the ability to carry out most daily movements with near-normal function, though mild deficits may still appear in fine or rapid actions; and 4 corresponds to normal, well-coordinated movement without observable impairment.
Data were collected at the Affiliated Hospital of Hubei University for Nationalities and Laifeng County People’s Hospital using a six-channel sEMG sensor and a motion-capture glove. Participants performed six standardised gestures (0–5, Figure 1) while sEMG signals and finger-curvature data were recorded. Electrodes were placed over three target muscles—flexor pollicis longus (thumb), flexor digitorum superficialis (fingers 2–5) and flexor digitorum profundus (fingers 2–3)—following established placement guidelines (Ferrante et al., 2024). Pearson correlation analysis (Table 2) showed that channels 2, 3 and 6 had the strongest association with finger flexion, and were therefore used for further analysis. Electrode positions are shown in Figure 2.
Figure 2. Muscle and sEMG patch placement; the location of (a) the relevant muscles of the right upper limb and their corresponding channels (Samui et al., 2023), and (b) the location of the sEMG patch on the arm.
All participants performed six predefined gestures after viewing the demonstration video. During execution, they maintained a relaxed posture with forearms resting naturally on the table or bed to minimise postural interference. Healthy subjects completed the movements independently based on visual cues, while testers provided verbal instructions and demonstrations for subjects with motor impairments to ensure correct understanding and maximise task completion.
2.2 Acquisition equipment
Figure 3 shows the equipment used for this data collection. Figure 4 shows the data transmission process of the data acquisition device, which is based on the STM32F103VET6 microcontroller (Tong et al., 2024) and integrates the finger curvature sensor and the six-channel sEMG acquisition module (Sapsanis et al., 2013). The finger curvature sensor acquires finger movement data by detecting resistance changes (Yin et al., 2018), while the sEMG acquisition module records EMG signals from forearm muscles through six electrodes with a sampling rate of 225 Hz. All data are transmitted through the serial port and saved as CSV files for subsequent processing and analysis.
Figure 3. The system comprises a sensor-equipped glove linked to a compact processing unit. The glove captures hand postures—from extended to clenched positions—while the unit integrates a multi-channel EMG acquisition module and a microcontroller (the left image). Acquired signals are processed in real-time, with muscle activity displayed on the built-in screen (the right image).
Figure 4. The finger movement acquisition system consists of a glove-integrated bending sensor module and a six-channel sEMG module. The glove module uses Flex 2.2 sensors to capture finger flexion, while the sEMG module acquires muscular activity signals. Both signals are processed by a central unit to produce the final output.
2.3 Signals pre-processing
A preliminary cleaning step was applied to remove erroneous entries, missing values, and outliers, thereby reducing noise and improving data reliability. The cleaned data were then standardised and stored in CSV format to facilitate subsequent processing and analysis.
Following data cleaning, all signals were smoothed using the Savitzky–Golay filter. Each dataset file contains eight time-series channels, each corresponding to one signal stream. All channels underwent the same filtering procedure to retain key waveform characteristics while suppressing high-frequency noise. The mathematical expression of the Savitzky–Golay filter is shown in Equation 1 (Lei, 2014).
In Equation 1, 2M+1 is the filter window length (optimised to 101 in this study, M = 50).
Figure 5 presents a comparison of raw and filtered signals for gesture 0 from Subject 9. As shown in Figure 5, the filtered data exhibit visibly smoother trajectories with reduced high-frequency fluctuations, particularly near peak regions. These results, further supported by Figure 6, confirm that the Savitzky–Golay filter effectively suppresses noise while maintaining the essential temporal structure of both finger-curvature and sEMG channels.
Figure 5. Comparison of selected channels before and after filtering for subject 0 is shown herein. Eight subplots display original versus filtered signals across three channels and five finger movements. The filtered data (orange lines) exhibit substantially reduced noise compared to the original signals (blue dashed lines), while preserving underlying signal morphology.
Figure 6. Comparison of filtered finger curvature and muscle electrical data from action 0 between healthy individuals and patients with hand injuries.
As shown in Figure 6, subjects with motor function level 4 exhibit the strongest hand mobility, characterised by clear waveform fluctuations in both finger-curvature and sEMG channels, indicating active neuromuscular engagement. Individuals at level 3 retain relatively good coordination and movement amplitude, with pronounced activity in the thumb and index finger. In contrast, subjects with levels 1–2 show markedly reduced movement, reflected by weaker and less stable signal variations. The level 0 subject displays almost no detectable hand motion, with minimal fluctuations across all channels, indicating near-complete functional loss.
From these analysis results, it can be seen that the degree of impairment of hand function is closely related to the fluctuation of channel and finger data. The more frequent and larger the fluctuation, the better the motor function of the hand. In contrast, hand function may be limited or lost. These data can be used to help assess and track recovery from hand function in patients and provide a basis for rehabilitation treatment.
2.4 Spectrogram rendering based on STFT
The Short-Time Fourier Transform (STFT) was applied to perform time-frequency analysis on the processed data. The STFT formula (Wang et al., 2020) is given by Equation 2.
In Equation 2,
Time–frequency features are widely used to reduce limb-position interference in sEMG recognition tasks (Khushaba et al., 2014). Since the raw samples vary in length, direct processing is cumbersome; therefore, STFT was applied to convert the signals into spectrograms with unified dimensions. Compared with the original waveform, spectrograms provide a clearer depiction of temporal frequency variations, reduce noise interference, and enhance model recognition performance (Xie et al., 2012). As shown in Figure 7, spectrograms were generated using matplotlib, with time and frequency as axes and colour intensity representing spectral energy, enabling intuitive observation of dynamic signal changes.
Figure 7. Time-frequency spectrograms of eight distinct data columns from Subject 9 (derived from acquired and filtered signals) are shown. The horizontal axis represents time, the vertical axis frequency, and spectral intensity is indicated by a color gradient (purple for lowest, yellow for highest).
2.5 Effect of preprocessing parameters
We evaluated the impact of the preprocessing parameters on classification performance. The effects of the STFT and Savitzky–Golay filter configurations are detailed in Tables 3, 4 respectively.
2.5.1 STFT parameter variation
As shown in Table 3, the STFT parameters nperseg and noverlap have a clear impact on model performance. The optimal cross-validation accuracy (0.9274) was obtained with nperseg = 64 and noverlap = 32, while the highest test accuracy (0.9444) was achieved at nperseg = 64 and noverlap = 48. Overall, larger segment lengths tended to reduce accuracy, likely due to the loss of temporal resolution.
2.5.2 Savitzky–Golay filter parameter variation
As shown in Table 4, the Savitzky–Golay filter parameters (window length and polyorder) also had a notable effect on model performance. The best results were obtained with a window length of 101 and a polynomial order of 4, yielding cross-validation and test accuracies of 0.9177 and 0.9222, respectively. This is consistent with expectations—larger windows enhance smoothing, while a moderate polynomial order preserves key signal features.
In summary, we found the optimal performance with an STFT configuration of nperseg = 64, noverlap = 32 and an SG filter configuration of window length = 101, polyorder = 4.
3 Experiment
Experiments were conducted on a Windows 10 (version 22H2) platform with an Intel Core i3-9100 CPU (3.60 GHz). All algorithms were implemented in Python 3.8. Five machine learning models—KNN, SVM, MLP, LightGBM, and Random Forest—were used to evaluate the performance of our self-built dataset.
3.1 Technical validation
We used the KNN model to classify subjects with different levels of motor impairment, with the classification performance for each level shown in Figures 8, 9. Figure 8 displays the accuracy heatmaps corresponding to five impairment levels, while Figure 9 illustrates the results in line-chart form. As shown, the KNN model achieved the highest accuracy for subjects with motor function scores of 3 and 4.
Figure 8. The heat map illustrates the cross-validation and test set accuracy of motor function classification using the KNN model.
Figure 9. Line graph of cross-validation accuracy and test set accuracy of motor function on the KNN model. In the legend, the blue solid line represents cross-validation accuracy, and the orange dotted line represents test set accuracy.
However, clear differences in signal properties and model performance were observed across impairment levels. Subjects with a motor function score of 0 showed almost no voluntary movement and produced weak, unstable sEMG activity, resulting in highly similar patterns across gestures and poor classification accuracy. In contrast, subjects with higher function levels generated more distinguishable signals, leading to stronger model performance. Overall, these results indicate that sEMG remains effective for differentiating motor function states, even among individuals with notable impairment.
3.2 Model construction
We used five machine learning models (KNN (Zhang and Li, 2021), SVM (Pisner et al., 2020), MLP (Taud et al., 2018), LightGBM (Sun et al., 2018), and Random Forest (Liu et al., 2012)) to test the classification of our self-built dataset.
Figure 10 shows the confusion matrices of the five classification models. While the models differ in classification performance, most exhibit relatively low misclassification rates, reflecting good overall recognition performance.
Figure 10. Confusion matrices for the five models (SVM, Random Forest, MLP, LightGBM, and KNN) are presented, each illustrating the classification performance of true labels versus predicted labels. Each row represents a true label, and each column represents a predicted label.
Table 5 presents the performance evaluation of five models—SVM, Random Forest, MLP, LightGBM, and KNN—on both multi-modal fusion sensor and single-sensor test sets. The F1-score, defined as the harmonic mean of precision and recall, reflects the overall effectiveness of a model in classification tasks (Lam et al., 2023). MCC takes into account true and false positives and negatives, making it particularly suitable for evaluating imbalanced datasets (Itaya et al., 2024). Cohen’s Kappa measures classification consistency by accounting for random agreement (McHugh, 2012). Recall evaluates the ability of the model to identify positive instances, that is, the proportion of actual positives correctly captured (Saito and Rehmsmeier, 2015).
Table 5. Performance evaluation results of five models on multi-modal fusion sensors and single sensor test sets.
As illustrated in Table 5, the multi-sensor fusion strategy achieves the highest performance in all models. Among these, SVM and MLP deliver the best classification results, demonstrating strong robustness, especially in handling imbalanced data. LightGBM follows closely with competitive performance, while KNN and Random Forest show moderate results. These findings underscore the importance of model selection in improving classification accuracy, particularly in tasks that require high recall and consistency, for which SVM and MLP emerge as preferable options.
Finger movement data and electromyography signals from different subjects performing specified actions were input into five machine learning models. Figure 11 illustrates the cross-validation accuracy and test accuracy of the five machine learning models under different sensor configurations. The cross-validation accuracy reflects the stability of the model in the training set, while the test accuracy evaluates its performance on unseen data. The results indicate that the multi-sensor fusion approach yields the best performance across all models. Specifically, SVM, LightGBM, and MLP achieve high performance in both cross-validation and test sets, each exceeding 95% accuracy. The KNN model shows a slight decrease in the test set, but still maintains high accuracy. In contrast, Random Forest performs relatively poorly in this task, which may be attributed to its sensitivity to high-dimensional feature spaces.
Figure 11. (a) Accuracy for Flex Sensor Data (b) Accuracy for sEMG Sensor Data (c) Accuracy for Combined Sensor Data. Comparison of classification accuracy of each model under different sensor configurations.
To evaluate performance on an external dataset, we conducted comparative experiments, as shown in Table 6. We used the Mendeley sEMG Gesture dataset (Ozdemir et al., 2022), selecting electromyography data corresponding to six standard gesture categories from 15 subjects as experimental samples. In model training and testing, for five machine learning classifiers, the same preprocessing pipeline as our self-collected dataset, with parameters adjusted according to the dataset characteristics. As seen from the tabular data, these classifiers performed well on the Mendeley dataset, achieving an average accuracy of 87.34%. This suggests that the adopted preprocessing and classification strategy remains effective when applied to another publicly available sEMG dataset.
The data acquisition glove used in this study is made of elastic knitted fabric, offering a comfortable fit for most adult users, though performance may decline in individuals with severe muscle atrophy. Durability tests indicate that the integrated flexible sensors withstand up to one million bending cycles before noticeable performance degradation occurs, suggesting suitability for regular household or community use. However, the sEMG electrode pads may loosen due to perspiration and require timely replacement to maintain data continuity. Tests performed outside controlled hospital environments also revealed that noise and interference increase under less stable conditions. Therefore, measurements are recommended in quiet settings with steady posture for optimal signal quality.
3.3 Limitations
This study presents a self-built multimodal dataset consisting of sEMG and finger-movement signals, demonstrating its value in hand function assessment. Nonetheless, several limitations exist. First, the sample size is relatively small (15 subjects) with an uneven distribution of impairment types, and variations in neuromuscular patterns across different pathologies may affect model reliability. Therefore, larger and more diverse clinical cohorts are required to further validate the findings. Second, although the textile glove and adhesive electrodes provide good wearability, fit instability may occur in patients with muscle atrophy, and long-term use can reduce sensor sensitivity. Signal quality also fluctuates with sweat, posture, and other external factors. Future work will address these issues by expanding participant diversity, improving glove durability, and enhancing robustness against interference.
3.4 Conclusion and future work
This work presents a device capable of synchronously acquiring sEMG and finger-movement signals, together with a dataset collected from subjects with different levels of hand motor function. The multimodal data provide a more complete representation of neuromuscular activity and physical movement, supporting applications in gesture recognition, rehabilitation assessment, and user identification. Benchmark experiments demonstrate that the dataset is reliable and suitable for multiple analytical tasks.
Future efforts will focus on increasing the participant pool, enriching impairment categories, and integrating additional sensing modalities. Improvements in glove durability and anti-interference performance will also be explored. These developments are expected to further advance research in motor-function assessment and contribute to the design of intelligent assistive rehabilitation systems.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by Medical Ethics Committee of Hubei University for Nationalities (Ethics Approval Number: (2025) 05). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
XY: Software, Investigation, Writing – original draft. LZ: Software, Writing – original draft, Methodology. FW: Resources, Writing – review and editing. XW: Writing – original draft, Investigation. HH: Investigation, Writing – original draft. JL: Project administration, Conceptualization, Funding acquisition, Writing – review and editing. TH: Writing – review and editing.
Funding
The author(s) declared that financial support was received for this work and/or its publication. This work was supported by Hubei Provincial Key Research and Development Project under Grant 2025BEB003, Hubei Province Natural Science Foundation of China under Grants 2025AFD161 and 2023AFD061, the Outstanding Youth Science and Technology Innovation Team Project for Colleges and Universities of Hubei Province of China under Grant T2023013, and Hubei Engineering Research Center of Selenium Food Nutrition and Health Intelligent Technology under Grant PT082402.
Acknowledgements
The authors would like to thank the Affiliated Hospital of Hubei Minzu University and the People’s Hospital of Laifeng County for providing data support.
Conflict of interest
The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Generative AI statement
The author(s) declared that generative AI was not used in the creation of this manuscript.
Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fbioe.2025.1751763/full#supplementary-material
References
Cai, T. J., and Tang, H. (2011). A review of the least squares fitting principle of the savitzky-golay smoothing filter. Digit. Commun. 38 (01), 63–68.
Cao, Y., Ma, S., Zhang, M., Liu, J., Huang, J., and Zhang, Z. Q. (2025). Neuro-fuzzy musculoskeletal model-driven assist-as-needed control via impedance regulation for rehabilitation robots. IEEE Trans. Fuzzy Syst. 33, 4277–4288. doi:10.1109/tfuzz.2025.3611266
Castelli, G., Desai, K. M., and Cantone, R. E. (2020). Peripheral neuropathy: evaluation and differential diagnosis. Am. Fam. Physician 102 (12), 732–739.
De Smedt, Q., Wannous, H., and Vandeborre, J.-P. (2016). “Skeleton-based dynamic hand gesture recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) workshops.
Duan, J. W., Xiong, J. Q., Li, Y. H., and Ding, W. P. (2024). Deep learning based multimodal biomedical data fusion: an overview and comparative review. Inf. Fusion 112, 102536. doi:10.1016/j.inffus.2024.102536
Ferrante, L., Sridharan, M., Zito, C., and Farina, D. (2024). Toward impedance control in human–machine interfaces for upper-limb prostheses. IEEE Trans. Biomed. Eng. 71 (9), 2630–2641. doi:10.1109/TBME.2024.3384340
Furmanek, M. P., Mangalam, M., Yarossi, M., Lockwood, K., and Tunik, E. (2022). A kinematic and EMG dataset of online adjustment of reach-to-grasp movements to visual perturbations. Sci. Data 9 (23), 23. doi:10.1038/s41597-021-01107-2
Gao, Z. Q., Wang, F., and Bai, Y. J. (2024). Flexible surface electromyography electrode based on fiber skeleton reinforcement. China Plast. 38 (7), 68. doi:10.19491/j.issn.1001-9278.2024.07.012
Itaya, Y., Tamura, J., Hayashi, K., and Yamamoto, K. (2024). Asymptotic properties of matthews correlation coefficient. arXiv Prepr. doi:10.48550/arXiv.2405.12622
Khushaba, R. N., Takruri, M., Miro, J. V., and Kodagoda, S. (2014). Towards limb position invariant myoelectric pattern recognition using time-dependent spectral features. Neural Netw. 55, 42–58. doi:10.1016/j.neunet.2014.03.007
Kim, J. S., Kim, B. K., Jang, M., Kang, K., Kim, D. E., Ju, B.-K., et al. (2020). Wearable hand module and real-time tracking algorithms for measuring finger joint angles of different hand sizes with high accuracy using FBG strain sensor. Sensors 20 (7), 1921. doi:10.3390/s20071921
Lam, K. F. Y., Gopal, V., and Qian, J. (2023). Confidence intervals for the F1 score: a comparison of four methods. arXiv Preprint. doi:10.48550/arXiv.2309.14621
Lei, L. P. (2014). Curve smoothing and denoising based on the Savitzky-golay algorithm. Comput. Inf. Technol. 22 (05), 30–31. doi:10.19414/j.cnki.1005-1228.2014.05.011
Li, Q., Zhang, A. Y., Li, Z. L., and Wu, Y. (2021). Improvement of EMG pattern recognition model performance in repeated uses by combining feature selection and incremental transfer learning, Front. Neurorobot. 15. doi:10.3389/fnbot.2021.699174
Li, M., Secco, E. L., Zheng, Y., Dai, C., Xiong, P., and Xu, G. (2023). Advances in haptic feedback for neurorobotics applications. Front. Neurosci. 17, 1189749. doi:10.3389/fnins.2023.1189749
Liang, C., Yu, C., Qin, Y., Wang, Y. T., and Shi, Y. C. (2021). DualRing: enabling subtle and expressive hand interaction with dual IMU rings. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5 (3), 1–27. doi:10.1145/3478114
Liu, Y., Wang, Y., and Zhang, J. (2012). “New machine learning algorithm: random forest,”. Information computing and applications. Editors B. Liu, M. Ma, and J. Chang (Springer), 7473, 281–292. doi:10.1007/978-3-642-34062-8_32
McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochem. Medica 22 (3), 276–282. doi:10.11613/bm.2012.031
Mukhopadhyay, A. K., and Samui, S. (2020). An experimental study on upper limb position invariant EMG signal classification based on deep neural network. Biomed. Signal Process. Control 58, 101669. doi:10.1016/j.bspc.2019.101669
Nunes, A. S., Kozhemiako, N., Stephen, C. D., Schmahmann, J. D., Khan, S., and Gupta, A. S. (2022). Automatic classification and severity estimation of ataxia from finger tapping videos. Front. Neurology 12, 795258. doi:10.3389/fneur.2021.795258
Ozdemir, M. A., Kisa, D. H., Guren, O., and Akan, A. (2022). Dataset for multi-channel surface electromyography (sEMG) signals of hand gestures. Data in brief. Amsterdam, The Netherlands: Elsevier Inc., 41, 107921.
Pisner, D. A., and Schnyer, D. M. (2020). “Support vector machine,” in Machine learning. Editors A. Mechelli, and S. Vieira (Academic Press), 101–121. doi:10.1016/B978-0-12-815739-8.00006-7
Sadikoglu, F., Kavalcioglu, C., and Dagman, B. (2017). Electromyogram (EMG) signal detection, classification of EMG signals and diagnosis of neuropathy muscle disease. Procedia Comput. Sci. 120, 422–429. doi:10.1016/j.procs.2017.11.259
Saito, T., and Rehmsmeier, M. (2015). The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PloS One 10 (3), e0118432. doi:10.1371/journal.pone.0118432
Salter, S., Warren, R., Schlager, C., Spurr, A., Han, S., Bhasin, R., et al. (2024). emg2pose: a large and diverse benchmark for surface electromyographic hand pose estimation. Adv. Neural Inf. Process. Syst. 37, 55703–55728. doi:10.52202/079017-1770
Samui, S., Garai, S., Ghosh, A., and Mukhopadhyay, A. K. (2023). “Heterogeneous stacked ensemble framework for surface electromyography signal classification,” in Proceedings of the international conference on pattern recognition and machine intelligence (PReMI) (Kolkata, India: Springer), 681–689. doi:10.1007/978-3-031-45170-6_70
Sapsanis, C., Georgoulas, G., and Tzes, A. (2013). “EMG based classification of basic hand movements based on time-frequency features,” in 21st mediterranean conference on control and automation, 716–722. doi:10.1109/MED.2013.6608802
Shaikh, A. A., Mukhopadhyay, A. K., Poddar, S., and Samui, S. (2024). Towards robust and accurate myoelectric controller design based on multi-objective optimization using evolutionary computation. IEEE Sensors J. 24 (2), 1234–1245. doi:10.1109/JSEN.2023.3347949
Sun, X. L., Liu, M. X., and Sima, Z. Q. (2018). A novel cryptocurrency price trend forecasting model based on LightGBM. Finance Res. Lett. 32, 191–198. doi:10.1016/j.frl.2018.12.032
Suo, M. R., Zhou, L. N., Wang, J. Z., Huang, H. G., Zhang, J., Sun, T. Z., et al. (2024). The application of surface electromyography technology in evaluating paraspinal muscle function. Diagnostics 14 (11), 1086. doi:10.3390/diagnostics14111086
Taud, H., and Mas, J. (2018). “Multilayer perceptron (MLP),” in Geomatic approaches for modeling land change scenarios. Editors M. Camacho Olmedo, M. Paegelow, J. F. Mas, and F. Escobar (Springer), 451–455. doi:10.1007/978-3-319-60801-3_27
Tong, Z., Zhang, J., and Zhang, W. (2024). Hardware and software design of programmable medium and high-speed data acquisition (DAQ) board of fiber optic signal for partial discharge acquisition. Electronics 13 (11), 2176. doi:10.3390/electronics13112176
Wang, X. B., Ying, T., and Tian, W. (2020). “Spectrum representation based on STFT,” in 2020 13th international congress on image and signal processing, BioMedical engineering and informatics (CISP-BMEI), 435–438. doi:10.1109/CISP-BMEI51763.2020.9263516
Xie, H., Lin, J., Lei, Y. G., and Liao, Y. H. (2012). Fast-varying AM–FM components extraction based on an adaptive STFT. Digit. Signal Process. 22 (5), 896–903. doi:10.1016/j.dsp.2012.02.007
Yeung, D., Negro, F., and Vujaklija, I. (2024). Adaptive HD-sEMG decomposition: towards robust real-time decoding of neural drive. J. Neural Eng. 21 (2), 026012. doi:10.1088/1741-2552/ad33b0
Yin, S. R., Yang, J., Qu, Y. K., Liu, W. J., Guo, Y. F., Liu, H. T., et al. (2018). “Research on gesture recognition technology of data glove based on joint algorithm,” in 2018 international conference on mechanical, electronic, control and automation engineering, 41–50. doi:10.2991/mecae-18.2018.8
Zandigohar, M., Han, M., Sharif, M., Günay, S. Y., Furmanek, M. P., Yarossi, M., et al. (2024). Multimodal fusion of EMG and vision for human grasp intent inference in prosthetic hand control. Front. Robotics AI 11, 1312554. doi:10.3389/frobt.2024.1312554
Zhang, S. C., and Li, J. Y. (2021). KNN classification with one-step computation. IEEE Trans. Knowl. Data Eng. 35 (3), 2711–2723. doi:10.1109/tkde.2021.3119140
Keywords: classification, finger movement, machine learning algorithms, rehabilitation, sEMG
Citation: Yang X, Zhang L, Wu F, Wei X, Huang H, Li J and Hu T (2026) Assisting hand gesture classification and rehabilitation assessment via sEMG and finger motion data. Front. Bioeng. Biotechnol. 13:1751763. doi: 10.3389/fbioe.2025.1751763
Received: 22 November 2025; Accepted: 17 December 2025;
Published: 08 January 2026.
Edited by:
Yu Cao, University of Leeds, United KingdomReviewed by:
Jun Huo, Huazhong University of Science and Technology, ChinaXingyu Zhang, University of Leeds, United Kingdom
Copyright © 2026 Yang, Zhang, Wu, Wei, Huang, Li and Hu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jun Li, bGlqdW43MjIxM0AxNjMuY29t
Lingfeng Zhang1,2,3