Skip to main content

ORIGINAL RESEARCH article

Front. Comput. Neurosci., 12 June 2024
Volume 18 - 2024 | https://doi.org/10.3389/fncom.2024.1414462

SS-DRPL: self-supervised deep representation pattern learning for voice-based Parkinson's disease detection

Tae Hoon Kim1* Moez Krichen2* Stephen Ojo3 Gabriel Avelino Sampedro4,5 Meznah A. Alamro6
  • 1School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou, Zhejiang, China
  • 2FCSIT, Al-Baha University, Al-Baha, Saudi Arabia
  • 3Department of Electrical and Computer Engineering, College of Engineering, Anderson University, Anderson, SC, United States
  • 4Faculty of Information and Communication Studies, University of the Philippines Open University, Los Baños, Philippines
  • 5Gokongwei College of Engineering, De La Salle University, Manila, Philippines
  • 6Department of Information Technology, College of Computer and Information Science, Princess Nourah Bint Abdul Rahman University, Riyadh, Saudi Arabia

Parkinson's disease (PD) is a globally significant health challenge, necessitating accurate and timely diagnostic methods to facilitate effective treatment and intervention. In recent years, self-supervised deep representation pattern learning (SS-DRPL) has emerged as a promising approach for extracting valuable representations from data, offering the potential to enhance the efficiency of voice-based PD detection. This research study focuses on investigating the utilization of SS-DRPL in conjunction with deep learning algorithms for voice-based PD classification. This study encompasses a comprehensive evaluation aimed at assessing the accuracy of various predictive models, particularly deep learning methods when combined with SS-DRPL. Two deep learning architectures, namely hybrid Long Short-Term Memory and Recurrent Neural Networks (LSTM-RNN) and Deep Neural Networks (DNN), are employed and compared in terms of their ability to detect voice-based PD cases accurately. Additionally, several traditional machine learning models are also included to establish a baseline for comparison. The findings of the study reveal that the incorporation of SS-DRPL leads to improved model performance across all experimental setups. Notably, the LSTM-RNN architecture augmented with SS-DRPL achieves the highest F1-score of 0.94, indicating its superior ability to detect PD cases using voice-based data effectively. This outcome underscores the efficacy of SS-DRPL in enabling deep learning models to learn intricate patterns and correlations within the data, thereby facilitating more accurate PD classification.

1 Introduction

The neurological disorder known as Parkinson's disease (PD) has a substantial impact on a considerable proportion of the worldwide population (Muangpaisan et al., 2011; Rocca, 2018). The dopaminergic neurons in the substantia nigra region of the brain gradually deteriorate, which distinguishes them. As a consequence, individuals have motor symptoms, including tremors, bradykinesia, stiffness, and postural instability, which have a substantial influence on their daily functioning and overall quality of life. Due to the chronic nature of the condition and the way these symptoms are advancing over time, comprehensive therapy and care are necessary. Timely detection and prompt intervention play a critical role in minimizing the consequences of PD and maximizing the effectiveness of treatment. The ability to identify the subtle indications and manifestations of PD at its early stages enables the implementation of suitable therapeutic measures with the goal of mitigating symptoms, maintaining motor abilities, and enhancing the overall quality of life (Kanagaraj et al., 2024; Xia et al., 2024).

Individuals with PD may benefit from early intervention measures such as lifestyle adjustments, rehabilitative therapy, and pharmaceutical interventions that are specifically designed to address their unique requirements and limitations (Olanrewaju et al., 2014; Bhat et al., 2018; Lang and Espay, 2018). In order to effectively address a broader spectrum of non-motor symptoms, including cognitive impairment, psychiatric symptoms, and autonomic dysfunction, neurologists, movement disorder specialists, rehabilitation therapists, nurses, social workers, and other healthcare professionals must collaborate in a multidisciplinary approach to care (Seppi et al., 2019). The progress made in diagnostic technology, neuroimaging techniques, and biomarker identification has greatly contributed to the timely and precise identification of PD, allowing healthcare practitioners to intervene during the initial phases of the condition. Nevertheless, there are still obstacles that remain, such as the requirement for more accurate diagnostic biomarkers, the advancement of neuroprotective medicines, and the enhancement of customized therapy approaches for each patient. The increasing societal and economic impact of PD highlights the imperative for ongoing research, lobbying, and public awareness campaigns aimed at improving healthcare accessibility, enhancing treatment efficacy, and finally achieving a cure for this incapacitating disorder (Liu et al., 2024; Sardar and Pahari, 2024).

Recent developments in the field of deep learning have demonstrated potential for enhancing the precision and effectiveness of PD identification (Ali et al., 2023). The use of Self Supervised Representation learning (SSRL) has become increasingly prominent as an effective methodology for acquiring representations from data that lacks labels (Ericsson et al., 2021). The SSRL technique has become a reliable approach for extracting significant representations from data that lacks labels. This method shows potential for enhancing the effectiveness of voice-based PD detection systems. SSRL fundamentally entails acquiring representations from data without the need for explicit supervision (Mohamed et al., 2022). SSRL algorithms differ from standard supervised learning approaches in that they can predict a specific part of the input data based on another part without requiring explicitly defined target outputs. The utilization of this self-supervised methodology allows models to exploit the intrinsic structure and patterns that exist within the data, resulting in enhanced learning efficiency and effectiveness. The success of SSRL algorithms in several areas is indicative of their adaptability since they have exhibited the capacity to improve the efficiency of learning tasks by enhancing sample efficiency (Zhang et al., 2017).

SSRL shows potential in the field of voice-based PD identification. Through the utilization of unlabeled data, these algorithms can reveal latent patterns and characteristics that are suggestive of PD, consequently enhancing the precision of predictive models (Nekoui and Cheng, 2021). It is noteworthy that the numerous benefits of improved PD identification are made possible by self-supervised deep representational learning (Jiang et al., 2021). The timely identification and Early diagnosis of PD is very important so that treatments can be started right away, which could slow the disease's progression and improve patient outcomes (Mei et al., 2021; Öksüz et al., 2022). SSRL algorithms are very important for making detection methods more accurate and reliable, which speeds up the process of early diagnosis and allows healthcare practitioners to intervene during the initial phases of the disease. Moreover, the economic and systemic consequences of improved Parkinson's disease identification are of utmost importance. The utilization of more precise diagnostic instruments not only leads to enhanced patient care but also holds the capacity to substantially mitigate healthcare expenses linked to misdiagnosis or delayed diagnosis (Painuli et al., 2022). SSRL-driven breakthroughs in PD detection enhance healthcare delivery by simplifying the diagnostic procedure and increasing the efficiency of healthcare systems. Furthermore, the utilization of SSRL approaches not only enhances the precision of PD identification but also exhibits the potential for furthering our comprehension of the fundamental mechanisms associated with this condition. These algorithms offer valuable insights into the subtle connections and biomarkers linked to voice-based PD by revealing intricate patterns and representations within unlabeled data. This enhanced comprehension can contribute to the advancement of therapeutic approaches and therapies designed to alleviate the consequences of the condition (Güvenç Paltun et al., 2021).

Motivation: PD is a significant healthcare challenge, demanding precise and timely diagnostic methods for effective intervention. Traditional approaches may lack accuracy, prompting the exploration of advanced techniques like self-supervised deep representation pattern learning (SS-DRPL) to extract meaningful features from voice data. By integrating SS-DRPL with deep learning algorithms, this study aims to enhance the accuracy of voice-based PD detection. Evaluation of various machine learning models seeks to identify optimal approaches for early PD identification, ultimately improving patient outcomes through timely intervention and personalized treatment strategies.

Contributions: This paper makes the following contributions.

Self-supervised deep representational pattern learning technique: Propose Self-supervised representational pattern learning techniques for the extraction of latent features and structures from data, resulting in enhanced discriminative capabilities of the models. Self-supervised learning has enabled the more efficient utilization of available data in prediction for Parkinson's disease detection by predicting one part of the input data based on another part without relying on manually provided target outputs.

Voice-based PD classification with machine learning classifier: Proposed SS-DRPL based LSTM-RNN, DNN, trained on voice dataset for the detection of PD. The DNN demonstrated a performance of 0.85% in terms of accuracy. The LSTM-RNN, with a score of 0.93%, addresses the issue of overfitting and enhances generalization by integrating many models. Likewise, it resulted in improved predicted accuracy. The LSTM-RNN model demonstrated a good accuracy of 0.93%.

Paper organization: The paper is organized in a manner that thoroughly examines the study. The study begins with an introduction that provides an overview of the context and importance of the research. The following parts then provide a detailed explanation of the suggested approach. Subsequently, the study presents its findings, demonstrating the efficacy of the proposed methodology. Similarly, the study backs up its conclusions with visual aids and statistical measurements to help people understand better. The study will conduct a detailed assessment of its advantages and constraints and analyze its practical ramifications for future endeavors. Finally, the report provides a concise overview of the research's accomplishments and the study's prospective implications.

2 Related work

SS-DRPL has become a popular and interesting method in machine learning over the past few years (Ericsson et al., 2022). It may be better than traditional guided methods in some ways (Feng et al., 2019). However, when looking at how it can be used for more challenging tasks like predicting Parkinson's disease, the theories behind SS-DRPL seem less developed than those behind traditional guided learning paradigms (Zhang et al., 2017). Likewise, the goal of this review of the literature is to look into the pros and cons of using SS-DRPL to predict voice-based PD, emphasizing new research and evaluations that have been done recently. The basic idea behind normal supervised learning is to figure out how well a model should do on data it has yet to see (Jiang et al., 2020; Sen et al., 2020). On the other hand, SS-DRPL methods are hard because the training loss is usually optimized for a pretext task, but the downstream task's success metric is different. In addition, this misalignment brings up important questions about how learned models in SS-DRPL can be transferred and used in other situations. Because SS-DRPL has some problems when it comes to predicting Parkinson's disease, experts have done much real-world testing using different neural network architectures and datasets. For example, convolutional neural networks have been used in recent studies to sort large amounts of spectrogram images that contain gait patterns (Cetin, 2023; Nafiz et al., 2023). Deeply dense artificial neural networks have also been used to look at voice recordings and guess when Parkinson's disease will start or get worse.

The investigations conducted have yielded empirical findings that indicate encouraging results. The proposed models consistently surpass the current advanced methods in terms of categorization accuracy. Similarly, the VGFR spectrogram detector had a notable accuracy rate of 0.88, while the voice impairment classifier displayed an even better accuracy rate of 0.89 (Johri et al., 2019). This suggests the possibility of utilizing SS-DRPL approaches to improve predictive accuracy in the diagnosis and monitoring of PD. In addition, researchers have investigated different approaches to enhance the representation of features and the accuracy of classification in tasks related to predicting PD. Moreover, one way to do this is to use correlation maps made by principal component analysis, information gain, and other methods for feature selection to make the feature space bigger (Sharma and Mishra, 2022). It is important to note that the classification results obtained by using extended feature sets have been better than those obtained by using original features. This underscores the significance of feature engineering in augmenting prediction performance. More precisely, Researchers have investigated various supervised AI algorithms, such as Decision Trees, K-Nearest Neighbors, Random Forests, Bagging, AdaBoosting, and Gradient Boosting, in order to improve classifier accuracy and predictive performance in PD classification (Sabu et al., 2022; Shastry, 2023). These techniques utilize permutation computations to optimize model performance and improve the accuracy of receiver operating characteristic (ROC) curves, which is a crucial parameter for evaluating classifier performance.

In order to enhance the accuracy of feature representation and the results of classification, authors in Malekroodi et al. (2024) have implemented three separate component selection procedures. These strategies enable each of the 23 features to identify and pick the top 10 most effective features. The DT classifier has shown remarkable accuracy, reaching 0.94%, even in datasets with 23 features, similar to those with only 11 features. Specifically, the exceptional performance has been validated through the examination of the ROC curve, which has demonstrated a noteworthy area under the curve of 0.98. The implication of these findings are of great importance for clinical practice, as they highlight the effectiveness of computer-based algorithms in reliably differentiating people with PD from those without PD at the individual level. Clinicians can utilize advanced AI techniques and careful feature selection strategies to utilize computer-based findings. This enables them to improve patient care and outcomes in the management of PD by facilitating early diagnosis, personalized treatment planning, and ongoing disease monitoring. SS-DRPL opens up new ways to improve the prediction of voice-based PD. However, there are still some problems to solve before the theoretical foundations of SS-DRPL can be used in real-life medical tasks (Tripathi et al., 2024). Overall, by tackling these problems, SS-DRPL can be fully useful for better diagnosing, treating, and predicting Parkinson's disease, which will eventually improve patient outcomes and quality of life.

3 Proposed methodology

This section will provide an overview of the research design, paradigm, data collection methods, and analysis tools employed in the study. Ensuring accuracy in the approach is crucial for establishing the reliability and validity of the findings. Following that, this section provides a brief yet thorough summary of the strategic method, establishing the foundation for a thorough empirical investigation and significant contributions to the area. Figure 1 illustrates the methodology employed. The proposed approach starts with dataset collection, then pre-processing, then label encoding and the employing SSRL-based deep learning models for training and testing, and finally, results analysis.

Figure 1
www.frontiersin.org

Figure 1. Employed methodology.

The dataset used in this study consists of 707 voice samples obtained from individuals with various traumatic, biological, and neurological disorders, including Parkinson's disease, along with 53 samples from healthy individuals serving as controls. Each sample, averaging 2 s in duration, was recorded in controlled, quiet acoustic settings. The dataset encompasses multiple voice features such as fundamental frequency (MDVP:Fo), frequency variations (MDVP:Fhi, MDVP:Flo), jitter (MDVP:Jitter), shimmer (MDVP:Shimmer), noise-to-harmonic ratio (NHR), and harmonics-to-noise ratio (HNR), among others. These features provide comprehensive information about voice signals. Likewise, to ensure uniformity in feature scales, the data underwent preprocessing steps, including downsampling from 50 to 25 kHz and scaling using Min Max scaling (Ali et al., 2014). By bringing all features into a common numerical range, this preprocessing helps improve the convergence of machine learning models (Little et al., 2007). Algorithm 1 presents an overview of the entire pipeline of the proposed approach, which begins with collecting data, preprocessing it and evaluating results.

Algorithm 1
www.frontiersin.org

Algorithm 1. SS-DRPL for voice-based Parkinson's disease detection.

The utilization of conventional machine learning models, including Support Vector Machine (SVM), Decision Tree (DT), Logistic Regression (LR), and Gaussian Naive Bayes (GNB), did not incorporate SS-DRPL. Following this, the research employed SS-DRPL techniques, specifically DNN and LSTM-RNN. The classification of Parkinson's disease was performed by training these models using preprocessed voice samples, utilizing the retrieved features. The study utilizes a DNN structure consisting of numerous dense layers for representation learning and fully linked layers for self-supervised learning and transfer learning. To extract varied representations from input voice data, the model employs parallel, thick layers consisting of 256 neurons each. The representations are refined using separate, fully connected layers with 64 neurons and then flattened and concatenated for transfer learning. In order to do binary classification, a sigmoid activation function is employed in a final, fully linked layer consisting of 256 neurons. Subsequently, the model was made with the Adam optimizer and the binary cross-entropy loss function. Early stopping techniques were used to lower the risk of overfitting during training.

The study also includes an LSTM-RNN architecture for learning representations. The suggested model has two layers, LSTM and RNN, running in parallel. Each layer has 256 neurons, and they work together to capture the temporal dependencies in the voice data. The outputs of the layers listed above are combined and then sent to the extra LSTM and RNN layers, each of which has 128 neurons, improving the accuracy of the representations. Self-supervised learning is implemented using fully connected layers consisting of 64 neurons each. These layers are applied using a time-distributed wrapper to process each time step separately. In the context of transfer learning, the outputs undergo a process of flattening and concatenation. Subsequently, fully connected layers with 256 neurons are employed for binary classification, utilizing a sigmoid activation function. The experimental setup involves training the model using the Adam optimizer and binary cross-entropy loss function. To mitigate the risk of overfitting, early halting is employed. Figures 2, 3 show the architectures of DNN and LSTM-RNN. These models possess the ability to independently acquire significant representations straight from unprocessed voice signals, obviating the necessity for manually designed features. In addition, the preprocessed samples were used to train the DNN and LSTM-RNN models. Throughout the training process, the models acquired the ability to extract complex characteristics from the unprocessed voice signals, effectively capturing detailed patterns that are known to be indicative of Parkinson's disease. The inherent characteristic of self-supervised learning allows the models to acquire representations independently without the need for explicitly labeled input to extract features.

Figure 2
www.frontiersin.org

Figure 2. DNN architecture.

Figure 3
www.frontiersin.org

Figure 3. LSTM-RNN architecture.

Both classical machine learning models and self-supervised deep representation learning models were tested to see how well they worked. These tests included accuracy, precision, recall, F1-score, ROC curve, and confusion matrix analysis. This set of measures offers significant insights into the outcomes of the algorithms to detect Parkinson's disease based on speech samples precisely. SS-DRPL algorithms can assist in early diagnosis by improving the accuracy and reliability of detection methods. This enables healthcare practitioners to intervene during the early stages of the disease. By taking a proactive approach, not only are patient outcomes improved, but effective treatment techniques may be implemented promptly, eventually boosting the overall management of the condition.

4 Results and experimentation

The outcomes of the study are presented and interpreted in the results and experimentation section, taking into consideration the research objectives. Similarly, this part provides the results and offers valuable perspectives, explanations, and ramifications of the findings. The dataset was split into 80% for training and 20% for testing. Likewise, voice-based PD poses a complicated diagnostic dilemma owing to its diverse range of manifestations. The objective of this study is to utilize SS-DRPL in order to create reliable classification models that can effectively detect voice-based PD using a wide range of features derived from patient data. The study utilized several machine learning algorithms, such as DT, LR, SVM, and GNB, as well as deep learning algorithms, such as LSTM-RNN and DNN, each possessing distinct strengths and capabilities. The LSTM-RNN models exhibited outstanding performance, showcasing impressive precision, recall, and F1-score metrics, all reaching a value of 0.94. Using recurrent neural networks to find complex linkages in the data is a good way to classify Parkinson's disease cases accurately. The improved models demonstrate strong performance, which shows great potential for clinical applications. In these contexts, early and precise diagnosis plays a critical role in effectively managing diseases and implementing intervention measures. Table 1 shows the performance metrics of employed models.

Table 1
www.frontiersin.org

Table 1. Classification reports for selected models.

Nevertheless, the LSTM-RNN demonstrated better performance; the DNN model displayed somewhat poorer precision, recall, and F1-score metrics, but it still achieved satisfactory levels of accuracy. Figures 4, 5 show the confusion matrix and ROC curves of the employed models. Subsequently, the observed disparity can be attributed to the model's proficiency in extracting pertinent features from the data or its aptitude for generalizing to unfamiliar examples. However, the performance of DNN highlights its potential usefulness in voice-based PD classification tasks, although there is still some opportunity for enhancement. Moreover, our examination of conventional machine learning algorithms showed various degrees of effectiveness. The Logistic Regression and Decision Tree models demonstrated high accuracy rates of 0.92 and 0.86, respectively, indicating their suitability for voice-based PD classification tasks. In contrast, the SVM and Gaussian NB models had somewhat lower percentages of accuracy, specifically 0.80 and 0.73, respectively. This indicates the necessity for further optimization or feature engineering in order to enhance their diagnostic capabilities for Parkinson's disease. These findings provide useful insights into the advantages and constraints of various machine learning methods for classifying Parkinson's disease.

Figure 4
www.frontiersin.org

Figure 4. Confusion matrix of (A) SVM, (B) DT, (C) LR, (D) Gaussian NB, (E) LSTM-RNN, and (F) Deep DNN models.

Figure 5
www.frontiersin.org

Figure 5. ROC curves of (A) SVM, (B) DT, (C) LR, (D) Gaussian NB, (E) LSTM-RNN, and (F) Deep DNN models.

The LSTM-RNN performs strongly, highlighting their potential usefulness in clinical environments where precise and prompt diagnosis is crucial for patient care. Also, comparing different types of traditional machine learning models gives us much useful information about how well they work and where we can find new research and development opportunities. In summary, this research showcases the considerable potential of machine learning in the categorization of voice-based PD, with sophisticated models like the LSTM-RNN exhibiting significant potential. Utilizing these models' advantageous aspects and acknowledging their constraints can provide a pathway toward enhanced voice-based PD, thereby leading to enhanced patient outcomes and improved quality of life. Figures 6, 7 shows the training and validation accuracy and loss curves provide a visual representation of the DNN performance during training, offering insights into its learning progress and potential overfitting or underfitting and assessing the convergence and generalization capabilities of the model, aiding in the optimization of hyperparameters and the identification of training issues.

Figure 6
www.frontiersin.org

Figure 6. DNN training and validation accuracy curves.

Figure 7
www.frontiersin.org

Figure 7. DNN training and validation loss.

Figures 8, 9 show the training and validation accuracy and loss curves of LSTM-RNN performance during training, offering insights into its learning progress and potential overfitting or underfitting and assessing the convergence and generalization capabilities of the model, aiding in the optimization of hyperparameters and the identification of training issues.

Figure 8
www.frontiersin.org

Figure 8. LSTM-RNN training and validation accuracy.

Figure 9
www.frontiersin.org

Figure 9. LSTM-RNN training and validation loss.

Table 2 provides the comparison of the base study with our proposed approach SS-DRPL-based LSTM-RNN approach. The results reveal that the proposed approach provides the best accuracy of 0.94% in comparison with a base study suggesting our approach for voice-based PD detection.

Table 2
www.frontiersin.org

Table 2. Comparison with base study.

5 Conclusion and future work

This study explored the potential of deep learning techniques and SS-DRPL in voice-based PD classification. This study demonstrated the effectiveness of these models in identifying patterns within the dataset, thereby enabling accurate classification of PD individuals. Furthermore, the experiment of deep learning models yields significant findings regarding their relative effectiveness and possible applicability in clinical environments. Results reveal that the hybrid LSTM-RNN method effectively identifies voice-based PD using different sets of patient data features. Although this study offers useful insights into the classification of PD, there are still various areas for further research and development that need to be investigated. Similarly, combining different types of data sources, such as genetic markers, imaging data, and patient demographics, could improve the accuracy of classification models and give a fuller picture of the risk factors connected to PD. Furthermore, using longitudinal studies that track the progress of diseases over a long period could reveal important information about how voice-based PD develops and help the development of more personalized treatment methods. The establishment of collaborative partnerships among data scientists, physicians, and healthcare providers will play a crucial role in the translation of research findings into practical insights, thereby enhancing patient outcomes and advancing our comprehension of PD. This will ultimately result in a more precise diagnosis, tailored treatment strategies, and enhanced quality of life for individuals affected by this condition.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding authors.

Author contributions

TK: Writing – original draft. MK: Writing – original draft. SO: Writing – original draft. GS: Writing – original draft. MA: Writing – original draft.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2024R503), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Ali, P. J. M., Faraj, R. H., Koya, E., Ali, P. J. M., and Faraj, R. H. (2014). Data normalization and standardization: a technical report. Mach. Learn. Tech. Rep. 1, 1–6.

Google Scholar

Ali, S., Hashmi, A., Hamza, A., Hayat, U., and Younis, H. (2023). Dynamic and static handwriting assessment in Parkinson's disease: a synergistic approach with C-Bi-GRU and VGG19. J. Comput. Theor. Appl. 1, 151–162. doi: 10.33633/jcta.v1i2.9469

Crossref Full Text | Google Scholar

Arjmandi, M. K., Pooyan, M., Mikaili, M., Vali, M., and Moqarehzadeh, A. (2011). Identification of voice disorders using long-time features and support vector machine with different feature reduction methods. J. Voice 25, e275–e289. doi: 10.1016/j.jvoice.2010.08.003

PubMed Abstract | Crossref Full Text | Google Scholar

Bhat, S., Acharya, U. R., Hagiwara, Y., Dadmehr, N., and Adeli, H. (2018). Parkinson's disease: cause factors, measurable indicators, and early diagnosis. Comput. Biol. Med. 102, 234–241. doi: 10.1016/j.compbiomed.2018.09.008

PubMed Abstract | Crossref Full Text | Google Scholar

Cetin, O. (2023). Accent recognition using a spectrogram image feature-based convolutional neural network. Arab. J. Sci. Eng. 48, 1973–1990. doi: 10.1007/s13369-022-07086-9

Crossref Full Text | Google Scholar

Ericsson, L., Gouk, H., Loy, C. C., and Hospedales, T. M. (2021). Self-supervised representation learning: introduction, advances and challenges. arXiv:2110.09327. doi: 10.48550/arXiv.2110.09327

Crossref Full Text | Google Scholar

Ericsson, L., Gouk, H., Loy, C. C., and Hospedales, T. M. (2022). Self-supervised representation learning: introduction, advances, and challenges. IEEE Sign. Process. Mag. 39, 42–62. doi: 10.1109/MSP.2021.3134634

Crossref Full Text | Google Scholar

Feng, Z., Xu, C., and Tao, D. (2019). “Self-supervised representation learning by rotation feature decoupling,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (IEEE), 10364–10374.

Google Scholar

Güvenç Paltun, B., Kaski, S., and Mamitsuka, H. (2021). Machine learning approaches for drug combination therapies. Brief. Bioinformat. 22:bbab293. doi: 10.1093/bib/bbab293

PubMed Abstract | Crossref Full Text | Google Scholar

Jiang, H., Lim, W. Y. B., Ng, J. S., Wang, Y., Chi, Y., and Miao, C. (2021). “Towards Parkinson's disease prognosis using self-supervised learning and anomaly detection,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (Toronto, ON: IEEE), 3960–3964.

Google Scholar

Jiang, T., Gradus, J. L., and Rosellini, A. J. (2020). Supervised machine learning: a brief primer. Behav. Ther. 51, 675–87. doi: 10.1016/j.beth.2020.05.002

PubMed Abstract | Crossref Full Text | Google Scholar

Johri, A., Tripathi, A., Johri, A., and Tripathi, A. (2019). “Parkinson's disease detection using deep neural networks,” in 2019 Twelfth International Conference on Contemporary Computing (IC3) (Noida: IEEE), 1–4.

Google Scholar

Kanagaraj, S., Hema, M., and Guptha, M. N. (2024). An improved approach for early diagnosis of Parkinson's disease using advanced dl models and image alignment. Automatika 65, 911–924. doi: 10.1080/00051144.2023.2284030

Crossref Full Text | Google Scholar

Lang, A. E., and Espay, A. J. (2018). Disease modification in Parkinson's disease: current approaches, challenges, and future considerations. Mov. Disord. 33, 660–677. doi: 10.1002/mds.27360

PubMed Abstract | Crossref Full Text | Google Scholar

Little, M., Mcsharry, P., Roberts, S., Costello, D., and Moroz, I. (2007). Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Nat. Prec. 326:1. doi: 10.1038/npre.2007.326.1

PubMed Abstract | Crossref Full Text | Google Scholar

Liu, T. A., Koseoglu, N. D., and Jones, C. (2024). Self-supervised deep learning—the next frontier. J. Am. Med. Assoc. Ophthalmol. 2023:6650. doi: 10.1001/jamaophthalmol.2023.6650

PubMed Abstract | Crossref Full Text | Google Scholar

Malekroodi, H. S., Madusanka, N., Lee, B. I., and Yi, M. (2024). Leveraging deep learning for fine-grained categorization of Parkinson's disease progression levels through analysis of vocal acoustic patterns. Bioengineering 11:295. doi: 10.3390/bioengineering11030295

PubMed Abstract | Crossref Full Text | Google Scholar

Mei, J., Desrosiers, C., and Frasnelli, J. (2021). Machine learning for the diagnosis of Parkinson's disease: a review of literature. Front. Aging Neurosci. 13:633752. doi: 10.3389/fnagi.2021.633752

PubMed Abstract | Crossref Full Text | Google Scholar

Mohamed, A., Lee, H. Y., Borgholt, L., Havtorn, J. D., Edin, J., Igel, C., et al. (2022). Self-supervised speech representation learning: a review. IEEE J. Select. Top. Sign. Process. 16, 1179–1210. doi: 10.1109/JSTSP.2022.3207050

Crossref Full Text | Google Scholar

Muangpaisan, W., Mathews, A., Hori, H., and Seidel, D. (2011). A systematic review of the worldwide prevalence and incidence of Parkinson's disease. J. Med. Assoc. Thailand 94:749.

Google Scholar

Nafiz, M. F., Kartini, D., Faisal, M. R., Indriani, F., and Hamonangan, T. (2023). Automated detection of COVID-19 cough sound using MEL-spectrogram images and convolutional neural network. J. Ilm. Tek. Elektro Komput. Dan Inform. 9, 535–548.

Google Scholar

Nekoui, M., and Cheng, L. (2021). “Enhancing human motion assessment by self-supervised representation learning,” in BMVC, 322.

PubMed Abstract | Google Scholar

Öksüz, N., Öztürk, Ş., and Doğu, O. (2022). Future prospects in Parkinson's disease diagnosis and treatment. Archiv.Neuropsychiat. 59(Suppl.1):S36. doi: 10.29399/npa.28169

PubMed Abstract | Crossref Full Text | Google Scholar

Olanrewaju, R. F., Sahari, N. S., Musa, A. A., and Hakiem, N. (2014). “Application of neural networks in early detection and diagnosis of Parkinson's disease,” in 2014 International Conference on Cyber and IT Service Management (CITSM) (South Tangerang: IEEE), 78–82.

Google Scholar

Painuli, D., Bhardwaj, S., and Köse, U. (2022). Recent advancement in cancer diagnosis using machine learning and deep learning techniques: a comprehensive review. Comput. Biol. Med. 146:105580. doi: 10.1016/j.compbiomed.2022.105580

PubMed Abstract | Crossref Full Text | Google Scholar

Rocca, W. A. (2018). The burden of Parkinson's disease: a worldwide perspective. Lancet Neurol. 17, 928–929. doi: 10.1016/S1474-4422(18)30355-7

PubMed Abstract | Crossref Full Text | Google Scholar

Sabu, K., Ramnath, M., Choudhary, A., Raj, G., and Prakash Agrawal, A. (2022). “A comparison of traditional and ensemble machine learning approaches for Parkinson's disease classification,” in Machine Intelligence and Data Science Applications: Proceedings of MIDAS 2021 (Berlin: Springer), 25–33.

PubMed Abstract | Google Scholar

Sardar, S., and Pahari, S. (2024). “A study to find affordable ai techniques for early Parkinson's disease detection,” in Intelligent Technologies and Parkinson's Disease: Prediction and Diagnosis (Hershey, PA: IGI Global), 20–51.

Google Scholar

Sen, P. C., Hajra, M., and Ghosh, M. (2020). “Supervised classification algorithms in machine learning: a survey and review,” in Emerging Technology in Modelling and Graphics: Proceedings of IEM Graph 2018 (Berlin: Springer), 99–111.

Google Scholar

Seppi, K., Ray Chaudhuri, K., Coelho, M., Fox, S. H., Katzenschlager, R., Perez Lloret, S., et al. (2019). Update on treatments for nonmotor symptoms of Parkinson's disease—an evidence-based medicine review. Mov. Disord. 34, 180–198. doi: 10.1002/mds.27602

PubMed Abstract | Crossref Full Text | Google Scholar

Sharma, A., and Mishra, P. K. (2022). Performance analysis of machine learning based optimized feature selection approaches for breast cancer diagnosis. Int. J. Inform. Technol. 14, 1949–1960. doi: 10.1007/s41870-021-00671-5

Crossref Full Text | Google Scholar

Shastry, K. A. (2023). An ensemble nearest neighbor boosting technique for prediction of Parkinson's disease. Healthc. Analyt. 3:100181. doi: 10.1016/j.health.2023.100181

Crossref Full Text | Google Scholar

Tripathi, S., Acien, A., Holmes, A. A., Arroyo-Gallego, T., and Giancardo, L. (2024). Generalizing Parkinson's disease detection using keystroke dynamics: a self-supervised approach. J. Am. Med. Inform. Assoc. 2024:ocae050. doi: 10.1093/jamia/ocae050

PubMed Abstract | Crossref Full Text | Google Scholar

Xia, Y., Sun, H., Zhang, B., Xu, Y., and Ye, Q. (2024). Prediction of freezing of gait based on self-supervised pretraining via contrastive learning. Biomed. Sign. Process. Contr. 89:105765. doi: 10.1016/j.bspc.2023.105765

Crossref Full Text | Google Scholar

Zhang, P., Wang, F., and Zheng, Y. (2017). “Self supervised deep representation learning for fine-grained body part recognition,” in 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017) (Melbourne, VIC: IEEE), 578–582.

Google Scholar

Keywords: Parkinson's disease, artificial intelligence, self-supervised deep representation pattern learning, machine learning, FT-HV

Citation: Kim TH, Krichen M, Ojo S, Sampedro GA and Alamro MA (2024) SS-DRPL: self-supervised deep representation pattern learning for voice-based Parkinson's disease detection. Front. Comput. Neurosci. 18:1414462. doi: 10.3389/fncom.2024.1414462

Received: 08 April 2024; Accepted: 13 May 2024;
Published: 12 June 2024.

Edited by:

Sadique Ahmad, Prince Sultan University, Saudi Arabia

Reviewed by:

Farhan Ullah, Northwestern Polytechnical University, China
Misbah Abbas, Nencki Institute of Experimental Biology (PAS), Poland
Muhammad Imad, Ulster University, United Kingdom

Copyright © 2024 Kim, Krichen, Ojo, Sampedro and Alamro. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Tae Hoon Kim, 323020@zust.edu.cn; Moez Krichen, moez.krichen@redcad.org

Download