Your new experience awaits. Try the new design now and help us make it even better

ORIGINAL RESEARCH article

Front. Psychiatry, 16 July 2025

Sec. Sleep Disorders

Volume 16 - 2025 | https://doi.org/10.3389/fpsyt.2025.1591448

This article is part of the Research TopicThe Promise of Sleep TechnologyView all 5 articles

Predicting sleep quality with digital biomarkers and artificial neural networks

Hyolim LeeHyolim Lee1Minsung ChoMinsung Cho2Sang Won Lee,*Sang Won Lee3,4*Sungkyu Park*Sungkyu Park5*
  • 1Department of Artificial Intelligence Convergence, Kangwon National University, Gangwon, Republic of Korea
  • 2Seoul Asan Medical Center, Seoul, Republic of Korea
  • 3Department of Psychiatry, Kyungpook National University Chilgok Hospital, Daegu, Republic of Korea
  • 4Department of Psychiatry, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
  • 5KDI School of Public Policy and Management, Sejong, Republic of Korea

Introduction: Modern society's increasing stress and irregular lifestyles have led to rising insomnia prevalence, making sleep quality assessment crucial for health management. This study investigates the relationship between heart rate variability (HRV) collected from wearable devices and sleep quality, specifically focusing on wake-after-sleep-onset (WASO) as a critical marker of sleep fragmentation. We aimed to develop predictive models for next-day sleep quality using continuous digital biomarkers.

Methods: We conducted two experiments (winter and summer 2023) with 82 participants who wore Samsung Galaxy Watch Active 2 devices during wakefulness. Biometric data including HRV signals, daily step counts, and physiological indicators were collected alongside subjective questionnaire responses (PHQ-9, GAD-7, ISI, KNHANES, WHOQOL-BREF) and daily sleep logs. We analyzed seven days of preceding data to predict next-day WASO using various machine learning approaches including ARIMA, Random Forest, XGBoost, GRU, TCN, Transformers, and LSTM models.

Results: Among HRV features, the low-frequency to high-frequency (LF/HF) ratio emerged as the strongest correlate with WASO, showing statistically significant differences between groups (Lower LF/HF: 7.5±2.0 min vs. Higher LF/HF: 14.9±3.0 min, p=0.012). LSTM demonstrated superior predictive performance with 90.4% accuracy, 91.3% precision, and 89.9% recall for binary WASO classification. LIME analysis confirmed that LF/HF ratio, along with ISI and WHOQOL-BREF scores, were the most influential features for model predictions.

Discussion: This work introduces a novel approach for managing sleep health through continuous HRV monitoring and predictive modeling using wearable devices. The findings highlight the potential of the LF/HF ratio as a digital biomarker for sleep quality prediction, offering promise for personalized, data-driven healthcare interventions. The superior performance of deep learning methods underscores the value of temporal pattern recognition in sleep quality assessment, paving the way for proactive sleep health management in everyday life.

1 Introduction

Modern society, characterized by rapid technological advancements, heightened stress, irregular lifestyles, and excessive workloads, has led to a significant increase in the prevalence of insomnia among individuals (1, 2). According to the American Academy of Sleep Medicine (AASM), approximately 33% to 50% of adults have experienced symptoms of insomnia, with 6% to 10% showing clinically significant symptoms of insomnia (3, 4). Insomnia can considerably affect both an individual’s health and societal well-being. Prolonged sleep deprivation could induce a variety of physical and mental health problems, including chronic fatigue, an increased risk of cardiovascular disease, impaired cognitive performance (e.g., reduced concentration and memory), and depression (5, 6). Furthermore, difficulty sleeping is associated with higher healthcare expenditures than those who never experienced sleep issues, leading to an escalation in societal costs (7). As a result, many efforts have been made to alleviate insomnia symptoms.

Recent studies focus on tracking sleep quality and insomnia using wearable devices, such as smartwatches, to inform potential interventions. Wearable devices can continuously track vital signs, including heart rate (hereafter HR), activity levels, and sleep patterns, as part of a user’s daily routine. This ongoing data collection enables more accurate data-driven sleep analysis (8, 9). Data collected through photoplethysmography (hereafter PPG) sensors, a technology that detects changes in blood flow by shining light on the skin based on the principle that light absorption varies with blood flow during each heartbeat, can provide important physiological indicators, such as heart rate variability (hereafter HRV) (10). HRV reflects stress levels and autonomic nervous system activity and is used as an important indicator to assess the relationship between stress and sleep quality, which allows for the analysis of sleep status (11). Previous research reported that sleep deprivation adversely affects HRV, reflecting autonomic nervous system imbalance. A study showed a decline in HF (high-frequency band) associated with an increase in nLF (normalized low-frequency band) after partial sleep deprivation, indicating a decreased parasympathetic and increased sympathetic activity (12). HRV can be affected by stress and the balance of the autonomic nervous system. A study revealing how stress alters HRV during each sleep stage was conducted on healthy adults. When acute stress was given, levels of the LF/HF ratio increased during NREM sleep, implying a significant decrease in sleep maintenance. In the absence of stress, parasympathetic activity increased, particularly during successive NREM cycles. Whereas acute stress was associated with a decrease in parasympathetic activity. Researchers have suggested the need for further research into the relationships between HRV, psychological stress, and sleep (13).

There are several sleep measurement indices, including wake-after-sleep-onset (hereafter WASO), sleep latency, sleep efficiency, and total sleep time. Among these sleep measurements, WASO is widely recognized as one of the most reliable indicators of sleep quality, particularly in identifying sleep fragmentation and disturbances (14). It measures the total time a person spends awake after initially falling asleep, making it a crucial marker for assessing conditions. As WASO increases, it typically correlates with lower sleep efficiency and overall poorer sleep quality (15). WASO has shown a significant difference between the non-insomnia and insomnia groups. A study by Kristin et al. reported that people with insomnia had higher minutes of WASO than normal people on both sleep diary and actigraphy (16). Other research demonstrated that an increase in WASO was highly correlated with an increase in insomnia symptoms, including sleep maintenance and sleep quality (15).

Furthermore, few studies have researched how night-to-night variability affects sleep measurement indices, including WASO and sleep efficiency. Research conducted by Buysse et al. indicated that chronic insomnia subjects exhibited greater variability in WASO and sleep efficiency compared to non-insomnia subjects. Notably, while no correlation was found with values from the previous night, positive correlations were observed with the values from the two nights prior. However, evidence for positive correlation was weak, suggesting a need to track a greater number of nights to estimate stably. The results suggest that continuous tracking of sleep could enhance insomnia interventions (17).

In this study, we performed a statistical analysis of various HRV characteristics to identify factors that are significantly associated with WASO. Among the features examined, the low-frequency to high-frequency ratio (LF/HF ratio) demonstrated a statistically significant correlation with WASO. Based on this result, we utilized existing predictive models to estimate WASO, leveraging the LF/HF ratio as a key predictor.

The goal of our study is to predict WASO based on HRV data and biosignal data collected through wearable devices. We propose a model to predict the next day’s WASO using HRV data from the previous seven days and investigate the impact of HRV on the assessment of sleep quality. In addition, this study explores the possibility of providing personalized healthcare advice to people with insomnia in the future and aims to present a new paradigm for the management of sleep health through wearable devices.

2 Methods

2.1 Experimental setup

This study analyzed the relationship between sleep quality and vital sign data by conducting two experiments in 2023. The first experiment was the winter experiment, which lasted 28 days from January 5 to February 1, 2023, and the second was the summer experiment, which lasted 26 days from June 26 to July 21, 2023. All experiments were assessed and approved by the first author’s university’s Institutional Review Board (IRB). A total of 82 participants participated in the experiments, including 24 males and 17 females in the winter experiment and 21 males and 20 females in the summer experiment. The average age of the participants in each experiment was 26.3 ± 6.7 years and 24.2 ± 6.5 years, respectively; in this work, all reported values are in the form of ‘mean ± standard deviation (SD),’ providing a statistical summary of central tendency and variability. Among the 82 participants, 67 were undergraduate students and 15 were non-student adults. All participants were recruited through on-campus advertisements and flyers.

During the experiment, participants wore wearable devices, Samsung Galaxy Watch Active 2, that measured real-time vital signs, such as HR and PPG signals and activity levels. Participants were instructed to remove the smartwatch at bedtime to charge it and to re-wear the fully charged device after waking up; therefore, biometric data were collected exclusively during daytime wakefulness. Participants also periodically completed various clinical mental disorder questionnaires, together with a sleep-related log to rate sleep quality subjectively. The participants’ demographics and the experiment’s timeline are shown in Table 1. While the full experiment periods were 28 days (winter) and 26 days (summer), the actual data collection period varied by participant due to individual circumstances and technical issues. In total, 10 participants took part in both the winter and summer experiments.

Table 1
www.frontiersin.org

Table 1. Demographics of the participants and the timeline of the experiment.

2.2 System design

The system design of this study consists of three phases: data collection, data storage structure, and database structure. Figure 1 provides a visual representation of the entire process. This structure was designed to manage and analyze various vital signs and questionnaire data efficiently, establishing a comprehensive framework for data integration. It laid the foundation for the researcher to combine and explore the objective vital signs data alongside the participants’ subjective questionnaire data, enabling a holistic approach to data analysis.

Figure 1
Flowchart detailing data collection and analysis processes. It starts with data collection, including daily sleep logs and biometric data from wearables. Pre-processing involves handling missing data and normalizing it. Questionnaire data is merged with biometric data, generating 82 datasets. Exploratory analysis includes correlation analysis and hypothesis testing, leading to feature selection. Predictive analysis involves model selection and training/testing using ARIMA, Random Forest, and more, with performance evaluation. Post-hoc analysis includes LIME application for explaining predictions and visualizing outcomes.

Figure 1. Overall data storage structure. PHQ-9, Patient Health Questionnaire-9; GAD-7, Generalized Anxiety Disorder-7; ISI, Insomnia Severity Index; KNHANES, Stress Questionnaire for Korea National Health and Nutrition Examination Survey; WHOQOL-BREF, World Health Organization Quality-of-Life Brief Version; HR, Heart Rate; PPG, photoplethysmography; RMSSD, Root Mean Square of the Successive Differences; LF/HF, Low Frequency/High Frequency (ratio of HRV metrics); WASO, Wake After Sleep Onset; ARIMA, Autoregressive Integrated Moving Average; GRU, Gated Recurrent Unit; TCN, Temporal Convolutional Network; LSTM, Long Short-Term Memory; and LIME, Local Interpretable Model-Agnostic Explanations.

2.3 Data collection

Data collection can be divided into two parts: collecting biometric data via wearable devices and collecting questionnaire data provided by participants. This dual approach combines objective, quantitative physiological data with subjective, self-reported data to better understand participants’ physical and psychological states.

2.3.1 Biometric data collection

For the biometric data collection process, wearable devices that monitor various physiological signals were used. The data collected included Heart Rate (HR), Photoplethysmography (PPG), Steps, Distance Traveled, Accelerometer, Gyroscope, and Luminosity, each providing insights into participants’ physiological and daily activity patterns. The sampling rates for each biometric signal were as follows: heart rate at 1 Hz, photoplethysmography (PPG) at 10 Hz, acceleration and gyroscope at 50 Hz, and luminosity at 1 Hz.

Heart Rate (HR) refers to the number of beats per minute (BPM) and is an important indicator of cardiovascular activity. It is a direct measure of physical stress and provides real-time insights into a participant’s physiological state (18). For example, heart rate increases during exercise or stressful situations, making it a useful metric for monitoring physical stress levels. Heart Rate Variability (HRV) features were computed based on data collected from the PPG sensor, one of the sensors used in wearable devices. The resulting HRV data serve as a valuable metric for assessing the balance of the autonomic nervous system, which can be used to evaluate stress levels and recovery ability. By analyzing changes between heartbeats, HRV reflects the activity of the sympathetic and parasympathetic nerves (11, 12). Note that all HR and HRV data were computed from the target devices’ same PPG signals using the HeartPy library1 in Python.

Steps were used to represent the participant’s daily physical activity level. Distance Traveled was calculated based on the step count and provides valuable information for assessing mobility and overall activity levels. Together, these metrics offer a comprehensive understanding of participants’ physical activity and energy expenditure. Acceleration was derived from the accelerometer sensor and reflects the intensity and frequency of body movements. It can be used to analyze the intensity of different physical activities, such as walking, running, or more vigorous actions. Similarly, the Gyroscope Rate, measured by the gyroscope sensor, captures the angular velocity of movements and is used to analyze posture changes and movement patterns on a per-second basis. Luminosity, measured as illuminance, represents the amount of light in a participant’s environment.

In addition to physiological and activity data, these wearable devices automatically transmit data to a central server every 30 minutes for storage and analysis. This facilitates the examination of relationships between physical activity patterns, environmental factors, and vital signs, allowing for a deeper understanding of participants’ daily lives and overall well-being.

2.3.2 Questionnaire data collection

In addition to the biometric data, participants completed questionnaires at regular intervals throughout the experiment to report their subjective mental states. This questionnaire cycle enabled regular monitoring of the participants’ psychological and physical conditions, as well as their lifestyle patterns, while systematically collecting the data. Figure 2 shows the weekly protocol of the questionnaires administered, including the frequency of the self-report questionnaires used throughout the experiment.

Figure 2
Timeline diagram showing assessments at baseline, and after one, two, and four weeks. Assessments include PHQ-9, GAD-7, ISI, KNHANES, and WHOQOL-BREF, with sleep logs collected daily.

Figure 2. Collection frequency for the self-reported questionnaire data. PHQ-9, Patient Health Questionnaire-9; GAD-7, Generalized Anxiety Disorder-7; ISI, Insomnia Severity Index; KNHANES, Stress Questionnaire for Korea National Health and Nutrition Examination Survey; and WHOQOL-BREF, World Health Organization Quality-of-Life Brief Version.

Specifically, the PHQ-9, GAD-7, ISI, KNHANES, and WHOQOL-BREF were administered during the initial visit. After that, PHQ-9 and GAD-7 were administered weekly, while ISI and KNHANES were administered every two weeks. The data collected from the questionnaires included information on participants’ sleep experiences, including the number and total duration of WASOs as a proxy of sleep quality; the sleep logs were recorded daily. These questionnaire data play an important role in gaining a more comprehensive understanding of the interaction between participants’ mental and emotional states and their vital signs (19). Then, all types of data were unified and stored in a structured database, MongoDB (20) (for the detailed data storage structure, see the Integrated Data and Database Structure section in the Supplementary Material).

2.3.3 Data pre-processing

HRV data was extracted every five minutes throughout each day. If a given day contained fewer than 12 valid HRV entries (equivalent to one hour of data), that day was excluded from the analysis to ensure data quality. Only for days with sufficient data, to handle missing values in the time-series data, we applied a structured imputation strategy based on the k-nearest neighbors (KNN) algorithm, which estimates each missing value by averaging the values from the most similar neighbors, i.e., rows composed of five-minute chunks in the case of the HRV features and rows composed of daily chunks in the case of all other features, including activity, sleep, and questionnaires, where those neighbors are decided based on the smallest Euclidean distance among other features except the target one. We empirically set the number of neighbors k = 3, considering both performance and data stability. This approach allowed us to preserve signal consistency and avoid potential biases from arbitrary assumptions.

Especially with the HRV features, their imputation for the five-minute chunks impacts relatively less, as they are averaged to be daily chunks in the forthcoming analysis. For sleep logs, we confirm that there are fewer missing values (see Supplementary Figure S4) as we daily monitored during the experiment and asked 82 participants to answer if they had not input sleep logs within a certain period. To prevent data leakage, all imputation steps were strictly performed on the training and testing sets separately.

2.4 Statistical analysis

To analyze the relationship between WASO and HRV, we divided the LF/HF ratio data, one type of HRV variable, based on a cutoff value of 0.58; this value was set based on the median of the LF/HF ratio across all participants to achieve a balanced grouping. As a consequence, the participants were divided into two groups: Lower LF/HF ratio (n=40, 0.5 ± 0.1) and Higher (n=42, 0.7 ± 0.1). The LF/HF ratio, an established indicator of autonomic nervous system balance, reflects the interplay between sympathetic (low frequency) and parasympathetic (high frequency) activities (21). A lower ratio indicates parasympathetic dominance, while a higher ratio reflects sympathetic dominance.

We then analyzed whether there was any difference between the LF/HF ratio-based groupings on WASO. After checking the distribution of each feature using the Kolmogorov-Smirnov (K-S) test, we found that both WASO and LF/HF ratios deviated from a normal distribution (p < 0.05). Based on these results, we used a non-parametric approach, the Wilcoxon Rank-Sum Test.

Next, we performed a Pearson correlation coefficient analysis to analyze the correlation between the biosignals collected in the experiment. The correlation matrix (see the Supplementary Figures for the entire correlation matrix) provides a visual representation of the correlation between each biosignal, allowing us to address multicollinearity. If the correlation coefficient was relatively high, it was considered to contribute to redundancy in representation or potentially degrade model performance and was excluded as a feature. After excluding the strongly correlated signals, the remained ones were selected to be used as input variables for the forthcoming machine-learning model.

2.5 Modeling methods for predictive analytics

Based on the correlation coefficients and variance inflation factor (VIF) analysis (22), we selected a range of features (X) to predict WASO (y) of the next day. These features were carefully selected based on their correlation with the target variable (y) and with the LF/HF ratio, as well as their VIF scores, to minimize multicollinearity. Variables with VIF values greater than five were considered to indicate multicollinearity, and we implemented procedures to ensure that these variables were not included as features (i.e., independent variables) in the modeling process. To prevent data leakage, we performed feature selection process within the training/testing cross-validation folds using a nested cross-validation approach. This ensures that test data does not influence feature selection, enhancing model validity and reliability (23).

The modeling process leveraged the most appropriate combinations of features to ensure optimal predictive performance. For the prediction of WASO, we employed a variety of time-series analysis models and machine learning models, including Autoregressive Integrated Moving Average (ARIMA), Random Forest, XGBoost, Gated Recurrent Unit (GRU), Temporal Convolutional Network (TCN), Transformers, and Long Short-Term Memory (LSTM).

Each model was chosen based on the characteristics of the data and its unique strengths for predicting WASO. ARIMA is widely used for analyzing and forecasting time-series data, excelling at capturing trends and seasonality effectively, which is crucial for modeling temporal changes in WASO (24). Random Forest is an ensemble model capable of learning complex non-linear relationships while being robust to overfitting, making it suitable for handling diverse feature sets (25). XGBoost is a high-performance machine learning model that improves on the Gradient Boosting algorithm, providing fast learning speed and high prediction performance. It combines multiple weak learners based on a Decision Tree to create a strong predictive model (26). GRU, a type of recurrent neural network, efficiently captures long-term dependencies in sequential data with lower computational cost compared to other RNN variants (27). TCN leverages convolutional layers to model temporal dependencies in a highly parallelized manner, enabling efficient handling of time-series data (28). With their attention mechanisms, the Transformers model captures complex relationships within long sequences, offering flexibility in modeling intricate temporal patterns (29). Lastly, LSTM networks are designed to learn long-term dependencies and are particularly effective at modeling the persistent patterns in time-series data, making them a natural fit for WASO prediction (30).

The target variable, WASO, was categorized into two classes: 0 (Lower WASO) and 1 (Higher WASO). This binary classification was established due to the nature of sleep interruption. A WASO value of 0 indicates that the subject had uninterrupted sleep with no awakening episodes during the night, representing ideal sleep quality. On the other hand, any non-zero WASO value (i.e., 1) indicates certain degrees of wakefulness during the night (Min value: 2 min, Max: 38 min, Mean: 13.1 min; see Supplementary Figure S2 for the frequency distribution). The distribution of the two classes is as follows: 0 (Lower WASO) accounts for 41.5%, while 1 (Higher WASO) represents 58.5%. Since the data is relatively evenly distributed between the two classes, it is appropriate to use the dataset as-is for classification modelling without additional adjustments for class imbalance.

For the problem formulation, data from t −6 days to t day (a total of seven days) were used to predict the WASO on t +1 day. Fixing seven days as a window size and moving windows with stride=1 means that each user from the first (winter) experiment is represented by 22 sets of feature vectors (28 days – 7 win size + 1 = 22) and 20 sets (26 - 7 + 1 = 20) from the second (summer) experiment. The total number of possible input feature vectors (X) for the model is 1,722 (41 users × 22 sets + 41 users × 20 sets = 1722, note that we got WASO (y) until the day after the experiment, so we could use until the very last input feature vector for each subject) with batch size=32. This temporal window was selected to capture a full weekly cycle, as modern people often exhibit similar behavioral patterns on a weekly basis (31). Specifically, the inclusion of seven days ensures that the model incorporates weekend data, which may differ significantly from weekday patterns. People’s activity levels and sleep routines can vary between weekdays and weekends, so using a full week’s worth of data allows for more accurate modeling of these cyclical patterns in sleep behavior and their influence on wakefulness.

In summary, we tried to predict WASO using ARIMA, Random Forest, XGBoost, GRU, TCN, Transformers, and LSTM, with input data spanning from t −6 days to a t day. The binary classification of WASO, 0 (Lower WASO), and 1 (Higher WASO) was chosen based on its practical relevance, as it differentiates between uninterrupted and disturbed sleep. For ARIMA, classification was performed by setting a threshold based on the ROC curve, allowing us to determine the optimal cutoff point for distinguishing between the two classes. The use of a full week’s worth of data enhances the model’s ability to capture weekend effects, which may differ from weekday patterns.

3 Results

3.1 Comprehensive data overview

In the current work, experiments were conducted to monitor participants’ physiological, physical activity, and psychological states. The number of days of data collected per participant is summarized in Figure 3; (A) the majority of the participants participated on most days of the experiment, and (B) the average number of the retrieved five-minute HRV chunks is relatively steady across a week, so we conjecture less bias based on a certain day of the week. Data collected from wearable devices and self-reported questionnaires were analyzed to provide insights into participants’ daily patterns and overall health status. The results are summarized in Table 2.

Figure 3
Flowchart illustrating data collection and processing for biometric and questionnaire data. A subject's biometric data is collected via a wearable device application, which communicates with the Tornado REST Framework using API calls and responses. Questionnaire data is gathered on a webpage employing Vue.js and Django. Responses are recorded in a server using MongoDB and stored in the server file system.

Figure 3. Overview of HRV data availability. (A) illustrates the distribution of the number of valid days per participant contributing HRV data, binned in 3-day intervals. Note: the maximum number of valid days was 28 for the first experiment and 26 for the second; only days with at least one hour of HRV data (i.e., 12 or more five-minute samples) were considered valid. (B) presents the average number of valid 5-minute HRV chunks collected per day across the week. Error bars indicate the standard deviation across subjects.

Table 2
www.frontiersin.org

Table 2. User biometric and questionnaire data with Mean ± SD values and data counts.

The physiological data included Heart Rate (HR), Root Mean Square of the Successive Differences (RMSSD), and the LF/HF ratio. The daily average HR was 83.4 ± 11.2 bpm, reflecting participants’ baseline cardiovascular activity. RMSSD, an indicator of parasympathetic nervous system regulation, had a daily average of 135.4 ± 37.9 ms. The LF/HF ratio, which assesses the balance between sympathetic and parasympathetic nervous system activity, was measured at 0.6 ± 0.2 ms. Physical activities included steps and distance traveled data. The daily cumulative step count was 4953.8 ± 10200.8 steps, while the daily cumulative distance traveled was 3746.8 ± 7673.8 meters, both reflecting participants’ mobility and physical activity levels. The statistics of the full features, such as acceleration, gyroscope for physical activities, and luminosity for environmental traits, are listed in Table 2. Self-reported questionnaire data provided valuable insights into participants’ psychological and behavioral states. The mean scores for each questionnaire were as follows: PHQ-9 at 1.7 ± 2.6, GAD-7 at 1.1 ± 2.3, ISI at 5.8 ± 4.2, KNHANES at 28.7 ± 10.3, and WHOQOL-BREF at 99.4 ± 13.3. These scores reflect variations in mental health and overall quality of life among participants. Lastly, the sleep log data captured participants’ wakefulness after sleep onset (WASO), with an average of 13.1 ± 6.5 minutes per day. This metric provides a quantitative assessment of sleep quality and fragmentation. Also, we visualize the weekly distribution of the LF/HF ratio and WASO features to depict potential differences in weekdays and weekends (see Supplementary Figure S5); while LF/HF ratio is relatively steady, the WASO values tend to be greater on weekends.

3.2 Exploratory data analysis

The Wilcoxon Rank-Sum Test revealed a statistically significant difference in the distribution of WASO between groups categorized by the LF/HF ratio (Lower LF/HF ratio: 7.5 ± 2.0 min and Higher LF/HF ratio: 14.9 ± 3.0 min with W = −5.0, p = 0.012).Figure 4 depicts the mean WASO values for each LF/HF ratio group (Lower, Higher). The bars represent the mean WASO value for each group, and the error bars show the standard deviation, providing a visual indication of the data variability between groups.

Figure 4
Bar chart comparing mean Wake After Sleep Onset (WASO) in minutes for lower and higher LF/HF ratios. The lower ratio has a mean around 7.5 minutes, and the higher ratio around 17.5 minutes. The overall mean is 12.04 minutes, marked by a vertical line. A significant difference is indicated with an asterisk.

Figure 4. Mean WASO by LF/HF ratio groups. The error bar stands for standard deviation.

The Lower group had a lower WASO than the Higher group, suggesting that the group with a lower LF/HF ratio has better sleep quality. The dashed line represents the average WASO value across all participants, highlighting the difference between the two groups.

We then check the pairwise correlation coefficients across features to reduce the complexity of the prediction model. For instance, the correlation analysis revealed a relatively high correlation between distance traveled and steps, with a correlation coefficient of about 0.3. This suggests that the two variables are likely to provide some similar information. As a consequence, steps were selected and included in the list of independent variables. To further filter out features, we set up a threshold of the correlation coefficient of 0.2 and discarded one of the pairs that exceeded the threshold. As a consequence, a few features, including distance traveled and HR, were dropped.

3.3 Predictive analytics

Based on the significant results from the LF/HF ratio analysis in the previous section, we extended our analysis to include additional features for predictive modeling. Since LF/HF ratio was correlated with WASO (r = 0.22, p < 0.05; Supplementary Figure S6 also presents a scatter plot of continuous WASO values against LF/HF ratio to illustrate their relationship, including a regression line with R2 = 0.23), we wanted to use LF/HF ratio as a core feature and evaluate its interaction with other physiological variables to improve the model’s predictive capabilities. The goal was to explore which other variables, when combined with LF/HF ratio, could improve the accuracy of WASO prediction.

3.3.1 Optimal variable set via correlation coefficients and VIF analysis

After the filtering process from the correlation analysis, we further checked for multicollinearity issues by performing a VIF analysis. Based on the VIF analysis results, the optimized variable combinations were set according to three criteria: correlation coefficients less than 0.1, 0.2, and 0.3, each consisting of a specific combination of variables. In the < 0.1 correlation criterion, two combinations were set: the first combination A1 included LF/HF ratio, and steps variables; and the second combination A2 included RMSSD, steps, light level, and GAD-7 variables. These combinations were constructed so that the contribution of each variable could be analyzed independently while the correlation between the variables was very low. Predictions were made from different aspects, with combination A1 using the LF/HF ratio, which represents the balance of the autonomic nervous system, and combination A2 using RMSSD, which reflects the stability of the autonomic nervous system.

Combinations B1, B2, and B3 were set based on a correlation coefficient of less than 0.2. Combination B1 included LF/HF ratio, RMSSD, steps, acceleration, gyroscope, and WHOQOL-BREF; combination B2 included LF/HF ratio, RMSSD, steps, acceleration, gyroscope, ISI, and WHOQOLBREF variables; and combination B3 included LF/HF ratio, RMSSD, steps, acceleration, gyroscope, PHQ-9, and KNHANES variables. These combinations aimed to provide a more comprehensive prediction of awakenings during sleep by combining physiological and physical activity data and to further analyze the psychological factors of awakenings by including psychological variables such as anxiety and insomnia.

Finally, based on a correlation coefficient of less than 0.3, we constructed a single combination C that included LF/HF ratio, RMSSD, steps, acceleration, gyroscope, GAD-7, ISI, and WHOQOL-BREF variables. This combination was an approach to increase the precision of the prediction model by covering as many different vital signs and psychological factors as possible. Although the correlation coefficient may be somewhat high, the intention was to maximize the performance of the WASO prediction by incorporating more variables. Based on these six variable combinations, we evaluated the contribution of each variable to WASO prediction. From this analysis, we selected the optimal combination of variables for modeling.

3.3.2 Predictive modeling results

Based on the combination of variables (A1,A2,B1,B2,B3, and C), we applied various machine learning models to evaluate the performance of the WASO prediction model. The models used were Autoregressive Integrated Moving Average (ARIMA), Random Forest, XGBoost, Gated Recurrent Unit (GRU), Temporal Convolutional Network (TCN), Transformers, and Long Short-Term Memory (LSTM). Since binary classification is impossible for ARIMA models, we used ROC curves to determine the optimal threshold and then performed classification. The performance of each model was evaluated based on Accuracy, Precision, Recall, AUROC, and Loss. This performance evaluation aimed to understand how much each combination of variables contributes to the prediction and optimize the WASO prediction (see the Supplementary Tables for prediction of other target variables y).

Among the various combinations of variables, we present the results for Combination B2, as it demonstrated the best overall performance across all evaluation metrics. The results for the second best performing combination A1 can be found in the Supplementary Tables. We compared the performance among other prediction models based on B2 as presented in Table 3. The Random Forest model had an accuracy of 0.846 and provided stability in prediction by evaluating a wide range of variables. The XGBoost model performed favorably in predicting specific wakefulness states, with an Accuracy of 0.848 and Precision of 0.860, indicating that the XGBoost model is strong at reducing unnecessary false positives. The Gated Recurrent Unit (GRU) model had an accuracy of 0.831, lower than the LSTM. Still, its simple structure and low computational cost make it suitable for real-time prediction. The Long Short-Term Memory (LSTM) model performed best in Combination B2, with an Accuracy of 0.904, Precision of 0.913, and Recall of 0.899. The combination B2 includes LF/HF ratio, RMSSD, steps, acceleration, gyroscope, ISI, and WHOQOL-BREF, and comprehensively considers autonomic nervous system and physical activity data and psychological factors. By combining these variables, the LSTM model was able to accurately predict wakefulness during sleep by effectively reflecting time-dependent physiological changes.

Table 3
www.frontiersin.org

Table 3. Performance of the various models to predict WASO (as a binary classification) based on the independent variable combination B2.

Moreover, the physical activity level can be a potential confounder, as our experiment allowed participants to do anything freely. To address this, we stratified participants into three groups based on their average daily step counts: Low (n=27, 3314.4 steps in average), Middle (n=28, 5005.1 steps), and High (n=27, 7452.7 steps). We then compared model performance across these groups using the same evaluation process with our main model; for each group, we divided the data into 8:2 for train and test, then we trained and tested the LSTM model. The first to the third rows of Table 4 summarize that the prediction performance showed marginal variation across groups. These results may indicate that the physical activity level, as quantified by steps counted, did not significantly affect the model performance, and our model is robust across different activity levels.

Table 4
www.frontiersin.org

Table 4. First-third rows: Performance of the different steps groups to predict WASO (as a binary classification) based on the independent variable combination B2 and the LSTM model.

Additionally, to account for temporal behavioral differences, we conducted a subgroup analysis by training separate models for weekday and weekend data and evaluating separate models using the same feature set and model architecture but different input window size (X), such as 5 (Monday to Friday) for the weekday model trained to predict WASO on Saturday night and 2 (Saturday to Sunday) for the weekend to predict Monday night; since the number of weekdays was larger than that of weekends (each weekday occurred eight times during the study period, while each weekend day occurred seven times), we randomly sampled workdays (evenly from Monday to Friday) to be the same volume of weekends. As presented in the fourth to the fifth rows of Table 4, we found that as variable distributions differ, the overall model performance of weekdays was slightly better than that of weekends, although their performance was worse than other results in the same table, maybe linked to the relatively small input window size.

3.3.3 Explainable LIME analysis and forecast results

To increase the interpretability of the model, we analyzed the predicted WASO results based on the combination B2 using the Local Interpretable Model-Agnostic Explanations (LIME) technique. The LIME analysis provides a visual representation of which variables were dominant when the model made a particular prediction, allowing researchers to better understand the model’s decision-making process. Figure 5 shows the results of the LIME analysis, highlighting that the LF/HF ratio was a key predictor, suggesting that the balance and stability of the autonomic nervous system influence wakefulness during sleep. Additionally, the ISI metric for insomnia and the WHOQOL-BREF for quality of life were also found to be significant variables. ISI metrics reflect the impact of a user’s insomnia symptoms on wakefulness during sleep, and the LIME analysis showed that WASO values tended to increase with higher levels of insomnia, indicating that more severe insomnia symptoms are likely to result in longer wakefulness during sleep. The WHOQOL-BREF metrics also showed that a user’s overall life satisfaction is an important psychological factor that affects sleep quality. Suppose the WHOQOL-BREF metric is low. In that case, the user’s stress level may be higher, or quality of life may be lower, resulting in more frequent awakenings during sleep, which was visually confirmed by the LIME analysis in Figure 5. These findings suggest that physiological indicators (LF/HF ratio) and psychological indicators (ISI, WHOQOL-BREF) interact to play an important role in predicting awakening times during sleep. In particular, ISI and WHOQOL-BREF indicators, in addition to the autonomic nervous system and physical activity data, contributed to explaining the impact of psychological state on sleep quality. As a result, the model was able to predict users’ sleep status more accurately, providing useful information for developing personalized sleep management and intervention strategies.

Figure 5
Bar chart comparing seven metrics for individuals with and without awakening episodes. Metrics include LF/HF, ISI, WHOQOL-BREF, RMSSD, Gyroscope, Steps, and Accelerometer. Dark blue bars represent no awakening episodes, while light blue bars represent awakening episodes, with LF/HF showing the largest difference.

Figure 5. LIME analysis depicts important features contributing to the model’s inference. LF/HF, Low Frequency to High Frequency ratio (one of HRV metrics); ISI, Insomnia Severity Index; WHOQOLBREF, World Health Organization Quality-of-Life Brief Version; and RMSSD, Root Mean Square of the Successive Differences.

4 Discussion

About the daily average heart rate, 83.4 bpm, the value appears to be slightly higher compared to a previous study using ECG (32). However, our data were collected not only during resting conditions but also during daily activities, such as walking or exercising. A recent study using PPG signals reported real-world heart rate norms in healthy individuals (33); in that study, the median value of the average heart rate in individuals in their early 20s was around 80 bpm, which is similar to our findings.

We then showed that the low and high groups of the LF/HF ratio are significantly different in terms of the extent of the WASO. The result suggests that the dominance of the sympathetic nervous system is strongly associated with increased wakefulness during sleep, resulting in poorer sleep quality. In contrast, in the Lower group, where the parasympathetic activity is relatively dominant, wakefulness is shorter, indicating better sleep quality. Based on this statistical testing, we conducted predictive analyses, and as a consequence, the LF/HF ratio emerged as a significant HRV variable predicting WASO among healthy subjects. Individuals with a low LF/HF ratio showed lower WASO compared to those with a high LF/HF ratio. Our results suggest that an increase in the LF/HF ratio, reflecting greater dominance of the sympathetic activity, may result in poorer sleep quality. Additionally, incorporating the LF/HF ratio alongside self-reported symptom measures, such as the ISI, could enhance the predictive power of the model. These findings indicate that certain HRV measures, such as the LF/HF ratio obtained through continuous monitoring of PPG signals, could be used to predict sleep quality metrics like WASO.

For the predictive modeling results, recurrent neural networks-based LSTM showed the best performance across all metrics (Table 3) compared to more conventional time series analysis methods, such as ARIMA, as well as conventional machine-learning methods, such as Random Forest and XGBoost. In the current study, the deep-learning approach showed supremacy aligned with the results from other similar studies (34). However, due to the black-box nature of the deep-learning methods, we further used an explainable method, LIME, and presented that the LF/HF ratio was more crucial than other features – including questionnaires, other HRV features, and sensor data from the wearable devices – in inferring future sleep quality.

The results of the LF/HF ratio could be interpreted in two ways: direct and indirect. Although some controversies exist, the LF/HF ratio is commonly used as a measure of sympathetic to parasympathetic autonomic balance (21, 35, 36). Therefore, an increased LF/HF ratio could, firstly, be related to stressful events in daily life, which might indirectly affect sleep quality. Many studies have shown that chronic stress increases sympathetic activity and decreases parasympathetic activity, implying autonomic imbalance (3, 13, 37). Acute stress reduces parasympathetic activity during NREM and REM sleep, impairing sleep maintenance while increasing sympathetic activity and the LF/HF ratio during NREM. In contrast, the non-stress group shows enhanced parasympathetic activity (13). A recent study continuously using portable electrocardiography reported a relationship between subjective well-being and the LF/HF ratio (38). Additionally, sleep-related stressors, such as sleep deprivation, could be associated with the LF/HF ratio. A previous study showed that sleep deprivation leads to a decline in HF, associated with an increase in LF (12). In another study by Holmes et al., acute sleep deprivation led to an increase in sympathetic activity (39). However, interpretation should be cautious as several studies have reported different results (40, 41). Secondly, there was a direct relationship between HRV metrics, particularly LF/HF ratio, and WASO, although the evidence is limited. A previous study assessed the autonomic nervous system changes in participants with increased sleep onset latency and WASO, respectively. The normalized LF and LF/HF ratio increased in the longer WASO group, while normalized HF decreased. Participants with longer sleep onset latency showed higher normalized LF, particularly in young adults. These findings suggest that the autonomic nervous system can serve as a predictive marker for sleep indices related to sleep onset and maintenance (42).

In this study, the LF/HF ratio showed the most significant correlation with WASO, followed by the ISI and WHOQOL-BREF. The ISI is one of the most reliable and widely used indices for evaluating the severity of insomnia. It enables clinicians to diagnose insomnia using brief questions (43). However, the ISI was not the most significantly correlated variable in our study, and we believe there are several reasons for this. First, daily continuous HRV metrics related to the autonomic nervous system were more appropriate for predicting the next day’s WASO compared to weekly self-reported measurements, such as the ISI. Second, the ISI is more appropriate to predict sleep efficiency rather than WASO. Previous studies reported a moderately positive correlation between WASO and ISI, which was weaker than the correlation with sleep efficiency (44, 45).

Meanwhile, we acknowledge some weaknesses in the current work. First, since each feature has a different granularity, e.g., HRV features are aggregated daily while self-reported questionnaire data are gathered weekly or bi-weekly, the same values from questionnaire data are injected into the daily predictive models and may affect the predictive performance. Second, our subjects reported only a few sleep problems. For example, the low LF/HF ratio group showed shorter WASO (7.5 min) compared to the high LF/HF ratio group with longer WASO (15.0 min), but the overall mean value (13.1 min) was lower than the most commonly used WASO cutoff value (30.0 min) (42, 46). It indicates that the sleep traits of the subjects in our study were relatively healthier than those of the sleep disorder sufferers. Because of this distribution, we set the prediction problem formulation not as regression but as classification because a small value difference of WASO among healthy participants does not matter much in the current study. Third, it is hard to generalize our prediction results. It is because, also related to the second point, the cohort in the current study is young and healthy, lacking diversity and the full range of WASO and HRV. In that sense, we can propose future hypotheses based on our outcomes, such as considering the relationship between the LF/HF ratio and WASO in older individuals. In general, both the LF/HF ratio (47) and WASO (48) increase with age, and therefore, the relationship between the LF/HF ratio and WASO may vary across age groups. Last, in the current work, the sleep-related features, including WASO, are retrieved manually rather than through polysomnography or actigraphy. Therefore, human bias or subjectivity may be a confounding factor in our study (49). In that sense, we would expand the work by recruiting more diverse participants and sensing sleep data more passively from wearable devices.

5 Concluding remark

Unlike conventional short-term HRV features retrieved under lab or clinical settings, it has been reported that continuous HRV is capable of capturing aggregated levels of psychological traits such as daily wellbeing or mood (38, 50). To the best of our knowledge, this is the first line of work to utilize continuous HRV to learn and predict sleep quality. We first explored the associations between HRV and sleep features and then successfully inferred the next day’s sleep quality (WASO) with an accuracy of 90.4% in terms of the binary classification setting. We shed light on how continuous monitoring of HRV features can help enhance the quality of sleep in everyday life.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by Kangwon National University IRB (Approval date: Jan 11, 2023, Approval number: KWNUIRB-2022-11-007-002). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

HL: Data curation, Formal Analysis, Visualization, Writing – original draft. MC: Investigation, Visualization, Writing – original draft. SL: Conceptualization, Investigation, Supervision, Validation, Writing – review & editing. SP: Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research and/or publication of this article. This study was supported by the 2023 Research Grant from Kangwon National University. Also, this research was supported by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, the Republic of Korea (Grant No. HI22C0646), and by the National Institute of Health (NIH) research project (Project No. 2024ER080300).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declare that no Generative AI was used in the creation of this manuscript.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2025.1591448/full#supplementary-material

Footnotes

  1. ^ HeartPy. https://python-heart-rate-analysis-toolkit.readthedocs.io/en/latest/.

References

1. Nazir R. Introduction to sleep and sleep disorders. In: Sleep Medicine and Mental Health: A Guide for Psychiatrists and Other Healthcare Professionals. Cham, Switzerland: Springer (2020). p. 3–21. doi: 10.1007/978-3-030-44447-11

Crossref Full Text | Google Scholar

2. Costa G. Stress and sleepiness in the 24-h society. Sleepiness Hum impact Assess. (2014), 105–11. doi: 10.1007/978-88-470-5388-59

Crossref Full Text | Google Scholar

3. Dube S and Babar A. Stress and insomnia–a vicious circle. Curr Med Res Pract. (2024) 14:73–7. doi: 10.4103/cmrp.cmrp_130_23

Crossref Full Text | Google Scholar

4. Kupfer D, Regier D, Narrow D, Rubio-Stipec M, Carpenter W Jr., and Castellanos FX. Diagnostic and statistical manual of mental disorders: DSM-5 (American psychiatric association). (2013). doi: 10.1176/appi.books.9780890425596

Crossref Full Text | Google Scholar

5. Sarode R and Nikam PP. The impact of sleep disorders on cardiovascular health: mechanisms and interventions. Cureus. (2023) 15:e49703. doi: 10.7759/cureus.49703

PubMed Abstract | Crossref Full Text | Google Scholar

6. Kyle SD, Morgan K, and Espie CA. Insomnia and health-related quality of life. Sleep Med Rev. (2010) 14:69–82. doi: 10.1016/j.smrv.2009.07.004

PubMed Abstract | Crossref Full Text | Google Scholar

7. Grandner MA. Sleep, health, and society. Sleep Med Clinics. (2022) 17:117–39. doi: 10.1016/j.smc.2022.03.001

Crossref Full Text | Google Scholar

8. Pardo Otero E, Fernández-Garrido I, Fernández-Noriega-Balseiro S, Martínez Pérez M, and Nieto-Riveiro L. Solution for capturing data from wearable devices. In: VI Congreso Xove TIC: impulsando el talento científico. A Coruña, Spain: Universidade da Coruña, Servizo de Publicacións (2023). p. 327–33. doi: 10.17979/spudc.000024.49

Crossref Full Text | Google Scholar

9. Mirlou F and Beker L. Wearable electrochemical sensors for healthcare monitoring: A review of current developments and future prospects. IEEE Trans Molecular Biol Multi-Scale Commun. (2023) 9:364–73. doi: 10.1109/tmbmc.2023.3304240

Crossref Full Text | Google Scholar

10. Hao Z, Wang J, Zhang G, Gao L, Zhang X, Liu J, et al. Ppg heart rate extraction algorithm based on the motion artifact intensity classification and removal framework. Biomed Signal Process Control. (2024) 94:106287. doi: 10.1016/j.bspc.2024.106287

Crossref Full Text | Google Scholar

11. Nayak SK, Pradhan B, Mohanty B, Sivaraman J, Ray SS, Wawrzyniak J, et al. A review of methods and applications for a heart rate variability analysis. Algorithms. (2023) 16:433. doi: 10.3390/a16090433

Crossref Full Text | Google Scholar

12. Bourdillon N, Jeanneret F, Nilchian M, Albertoni P, Ha P, and Millet GP. Sleep deprivation deteriorates heart rate variability and photoplethysmography. Front Neurosci. (2021) 15:642548. doi: 10.3389/fnins.2021.642548

PubMed Abstract | Crossref Full Text | Google Scholar

13. Hall M, Vasko R, Buysse D, Ombao H, Chen Q, Cashmere JD, et al. Acute stress affects heart rate variability during sleep. Psychosomatic Med. (2004) 66:56–62. doi: 10.1097/01.psy.0000106884.58744.09

PubMed Abstract | Crossref Full Text | Google Scholar

14. Hermans LW, Leufkens TR, van Gilst MM, Weysen T, Ross M, Anderer P, et al. Sleep eeg characteristics associated with sleep onset misperception. Sleep Med. (2019) 57:70–9. doi: 10.1016/j.sleep.2019.01.031

PubMed Abstract | Crossref Full Text | Google Scholar

15. Levine DW, Lewis MA, Bowen DJ, Kripke DF, Kaplan RM, Naughton MJ, et al. Reliability and validity of women’s health initiative insomnia rating scale. psychol Assess. (2003) 15:137–48. doi: 10.1037/1040-3590.15.2.137

PubMed Abstract | Crossref Full Text | Google Scholar

16. Maich KH, Lachowski AM, and Carney CE. Psychometric properties of the consensus sleep diary in those with insomnia disorder. Behav sleep Med. (2018) 16:117–34. doi: 10.1080/15402002.2016.1173556

PubMed Abstract | Crossref Full Text | Google Scholar

17. Buysse DJ, Cheng Y, Germain A, Moul DE, Franzen PL, Fletcher M, et al. Night-to-night sleep variability in older adults with and without chronic insomnia. Sleep Med. (2010) 11:56–64. doi: 10.1016/j.sleep.2009.02.010

PubMed Abstract | Crossref Full Text | Google Scholar

18. Kleiger RE, Stein PK, Bosner MS, and Rottman JN. Time domain measurements of heart rate variability. Cardiol Clinics. (1992) 10:487–98. doi: 10.1016/s0733-8651(18)30230-3

Crossref Full Text | Google Scholar

19. Baig MZ and Kavakli M. A survey on psycho-physiological analysis & measurement methods in multimodal systems. Multimodal Technol Interaction. (2019) 3:37. doi: 10.3390/mti3020037

Crossref Full Text | Google Scholar

20. Qian A. (2023). Development and research of computer information management system based on mongodb, In: Proceedings of the 2023 2nd International Conference on Cloud Computing, Big Data Application and Software Engineering (CBASE). (Piscataway, NJ, USA: IEEE), pp. 362–5. IEEE. doi: 10.1109/cbase60015.2023.10439090

Crossref Full Text | Google Scholar

21. Von Rosenberg W, Chanwimalueang T, Adjei T, Jaffer U, Goverdovsky V, and Mandic DP. Resolving ambiguities in the lf/hf ratio: Lf-hf scatter plots for the categorization of mental and physical stress from hrv. Front Physiol. (2017) 8:36. doi: 10.3389/fphys.2017.0036

PubMed Abstract | Crossref Full Text | Google Scholar

22. Akinwande MO, Dikko HG, and Samson A. Variance inflation factor: as a condition for the inclusion of suppressor variable (s) in regression analysis. Open J Stat. (2015) 5:754. doi: 10.4236/ojs.2015.57075

Crossref Full Text | Google Scholar

23. Guyon I and Elisseeff A. An introduction to variable and feature selection. J Mach Learn Res. (2003) 3:1157–82.

Google Scholar

24. Ariyo AA, Adewumi AO, and Ayo CK. (2014). Stock price prediction using the arima model, In: Proceedings of the 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation. (Piscataway, NJ, USA: IEEE), pp. 106–12. doi: 10.1109/UKSim.2014.67

Crossref Full Text | Google Scholar

25. Belgiu M and Drăguţ L. Random forest in remote sensing: A review of applications and future directions. ISPRS J Photogrammetry Remote Sens. (2016) 114:24–31. doi: 10.1016/j.isprsjprs.2016.01.011

Crossref Full Text | Google Scholar

26. Chen T. Xgboost: extreme gradient boosting. R package version 0.4-2 1 (2015). Seattle, WA, USA: University of Washington.

Google Scholar

27. Dey R and Salem FM. (2017). Gate-variants of gated recurrent unit (gru) neural networks, In: Proceedings of the 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS). (Piscataway, NJ, USA: IEEE), pp. 1597–600. IEEE. doi: 10.1109/MWSCAS.2017.8053243

Crossref Full Text | Google Scholar

28. Hewage P, Behera A, Trovati M, Pereira E, Ghahremani M, Palmieri F, et al. Temporal convolutional neural (tcn) network for an effective weather forecasting using time-series data from the local weather station. Soft Computing. (2020) 24:16453–82. doi: 10.1007/s00500-020-04954-0

Crossref Full Text | Google Scholar

29. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. Adv Neural Inf Process Syst. (2017) 30:5998–6008.

Google Scholar

30. Greff K, Srivastava RK, Koutn´ık J, Steunebrink BR, and Schmidhuber J. Lstm: A search space odyssey. IEEE Trans Neural Networks Learn Syst. (2016) 28:2222–32. doi: 10.1109/tnnls.2016.2582924

PubMed Abstract | Crossref Full Text | Google Scholar

31. Park S, Li CT, Han S, Hsu C, Lee SW, and Cha M. (2019). Learning sleep quality from daily logs, In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2019). (New York, NY, USA: ACM (Association for Computing Machinery), pp. 2421–9. doi: 10.1145/3292500.3330792

Crossref Full Text | Google Scholar

32. Mason JW, Ramseth DJ, Chanter DO, Moon TE, Goodman DB, and Mendzelevski B. Electrocardiographic reference ranges derived from 79,743 ambulatory subjects. J electrocardiology. (2007) 40:228–34. doi: 10.1016/j.jelectrocard.2006.09.003

PubMed Abstract | Crossref Full Text | Google Scholar

33. Avram R, Tison GH, Aschbacher K, Kuhar P, Vittinghoff E, Butzner M, et al. Real-world heart rate norms in the health eheart study. NPJ digital Med. (2019) 2:58. doi: 10.1038/s41746-019-0134-9

PubMed Abstract | Crossref Full Text | Google Scholar

34. Rykov YG, Ng KP, Patterson MD, Gangwar BA, and Kandiah N. Predicting the severity of mood and neuropsychiatric symptoms from digital biomarkers using wearable physiological data and deep learning. Comput Biol Med. (2024) 180:108959. doi: 10.1016/j.compbiomed.2024.108959

PubMed Abstract | Crossref Full Text | Google Scholar

35. Heathers JA. Everything hertz: methodological issues in short-term frequency-domain hrv. Front Physiol. (2014) 5:177. doi: 10.3389/fphys.2014.00177

PubMed Abstract | Crossref Full Text | Google Scholar

36. Quintana DS and Heathers JA. Considerations in the assessment of heart rate variability in biobehavioral research. Front Psychol. (2014) 5:805. doi: 10.3389/fpsyg.2014.00805

PubMed Abstract | Crossref Full Text | Google Scholar

37. Takase B, Akima T, Satomura K, Mastui T, Ishihara M, Kurita A, et al. Effects of chronic sleep deprivation on autonomic activity by examining heart rate variability, plasma catecholamine, and intracellular magnesium levels. Biomedicine pharmacotherapy. (2004) 58:S35–9. doi: 10.1016/s0753-3322(04)80007-6

PubMed Abstract | Crossref Full Text | Google Scholar

38. Shiga K, Izumi K, Minato K, Sugio T, Yoshimura M, Kitazawa M, et al. Subjective well-being and month-long lf/hf ratio among deskworkers. PloS One. (2021) 16:e0257062. doi: 10.1371/journal.pone.0257062

PubMed Abstract | Crossref Full Text | Google Scholar

39. Holmes AL, Burgess HJ, and Dawson D. Effects of sleep pressure on endogenous cardiac autonomic activity and body temperature. J Appl Physiol. (2002) 92:2578–84. doi: 10.1152/japplphysiol.01106.2001

PubMed Abstract | Crossref Full Text | Google Scholar

40. Cosgrave J, Phillips J, Haines R, Foster RG, Steinsaltz D, and Wulff K. Revisiting nocturnal heart rate and heart rate variability in insomnia: a polysomnography-based comparison of young self-reported good and poor sleepers. J sleep Res. (2021) 30:e13278. doi: 10.1111/jsr.13278

PubMed Abstract | Crossref Full Text | Google Scholar

41. Spiegelhalder K, Fuchs L, Ladwig J, Kyle SD, Nissen C, Voderholzer U, et al. Heart rate and heart rate variability in subjectively reported insomnia. J sleep Res. (2011) 20:137–45. doi: 10.1111/j.1365-2869.2010.00863.x

PubMed Abstract | Crossref Full Text | Google Scholar

42. Nano M, Fonseca P, Overeem S, Vullings R, and Aarts RM. Lying awake at night: cardiac autonomic activity in relation to sleep onset and maintenance. Front Neurosci. (2020) 13:1405. doi: 10.3389/fnins.2019.01405

PubMed Abstract | Crossref Full Text | Google Scholar

43. Bastien CH, Vallieres` A, and Morin CM. Validation of the insomnia severity index as an outcome measure for insomnia research. Sleep Med. (2001) 2:297–307. doi: 10.1016/s1389-9457(00)00065-4

PubMed Abstract | Crossref Full Text | Google Scholar

44. Cho YW, Song ML, and Morin CM. Validation of a korean version of the insomnia severity index. J Clin Neurol. (2014) 10:210–5. doi: 10.3988/jcn.2014.10.3.210

PubMed Abstract | Crossref Full Text | Google Scholar

45. Castronovo V, Galbiati A, Marelli S, Brombin C, Cugnata F, Giarolli L, et al. Validation study of the italian version of the insomnia severity index (isi). Neurological Sci. (2016) 37:1517–24. doi: 10.1007/s10072-016-2620-z

PubMed Abstract | Crossref Full Text | Google Scholar

46. Lichstein K, Durrence H, Taylor D, Bush A, and Riedel B. Quantitative criteria for insomnia. Behav Res Ther. (2003) 41:427–45. doi: 10.1016/s0005-7967(02)00023-2

PubMed Abstract | Crossref Full Text | Google Scholar

47. Yeragani VK, Sobolewski E, Kay J, Jampala V, and Igel G. Effect of age on long-term heart rate variability. Cardiovasc Res. (1997) 35:35–42. doi: 10.1016/S0008-6363(97)00107-7

PubMed Abstract | Crossref Full Text | Google Scholar

48. Li J, Vitiello MV, and Gooneratne NS. Sleep in normal aging. Sleep Med Clinics. (2022) 17:161–71. doi: 10.1016/j.jsmc.2022.02.007

PubMed Abstract | Crossref Full Text | Google Scholar

49. Park S, Zhunis A, Constantinides M, Aiello LM, Quercia D, and Cha M. Social dimensions impact individual sleep quantity and quality. Sci Rep. (2023) 13:9681. doi: 10.1038/s41598-023-36762-5

PubMed Abstract | Crossref Full Text | Google Scholar

50. Park S, Constantinides M, Aiello LM, Quercia D, and Van Gent P. Wellbeat: A framework for tracking daily well-being using smartwatches. IEEE Internet Computing. (2020) 24:10–7. doi: 10.1109/mic.2020.3017867

Crossref Full Text | Google Scholar

Keywords: wearable devices, digital biomarkers, heart rate variability (HRV), sleep quality, artificial neural networks, explainable AI

Citation: Lee H, Cho M, Lee SW and Park S (2025) Predicting sleep quality with digital biomarkers and artificial neural networks. Front. Psychiatry 16:1591448. doi: 10.3389/fpsyt.2025.1591448

Received: 11 March 2025; Accepted: 18 June 2025;
Published: 16 July 2025.

Edited by:

Cathy Goldstein, University of Michigan, United States

Reviewed by:

Daniel M Roberts, The Pennsylvania State University (PSU), United States
Haoqi Sun, Beth Israel Deaconess Medical Center and Harvard Medical School, United States

Copyright © 2025 Lee, Cho, Lee and Park. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sang Won Lee, bGVlc2FuZ3dvbi5wc3lAa251LmFjLmty; Sungkyu Park, c2hhdW5Aa2Rpc2Nob29sLmFjLmty

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.