Skip to main content

ORIGINAL RESEARCH article

Front. Neurol., 04 March 2021
Sec. Sleep Disorders
This article is part of the Research Topic Sleep, Brain and Neuropsychiatric Disorders View all 15 articles

Accuracy of Actigraphy Compared to Concomitant Ambulatory Polysomnography in Narcolepsy and Other Sleep Disorders

  • 1Department of Clinical Neurophysiology, HUS Medical Imaging Center, Helsinki University Hospital, University of Helsinki, Helsinki, Finland
  • 2Faculty of Medicine and Health Technology, Tampere University, Tampere, Finland
  • 3Department Neurology and Rehabilitation, Tampere University Hospital, Tampere, Finland
  • 4Department of Neurology, Helsinki Sleep Clinic, Vitalmed Research Center, Helsinki, Finland
  • 5Department of Clinical Neurosciences, Clinicum, University of Helsinki, Helsinki, Finland

Actigraphy provides longitudinal sleep data over multiple nights. It is a less expensive and less cumbersome method for measuring sleep than polysomnography. Studies assessing accuracy of actigraphy compared to ambulatory polysomnography in different sleep-disordered patients are rare. We aimed to compare the concordance between these methods in clinical setting. We included 290 clinical measurements of 281 sleep laboratory patients (mean age 37.9 years, 182 female). Concomitant ambulatory polysomnography and actigraphy were analyzed to determine the agreement in patients with obstructive sleep apnea, narcolepsy, periodic leg movement disorder, hypersomnia, other rarer sleep disorders, or no organic sleep disorder. Bland-Altman plots showed excellent accuracy, but poor precision in single night results between the two methods in the measurement of sleep time, sleep efficiency, and sleep latency. On average, actigraphy tended to overestimate sleep time by a negligible amount, −0.13 min, 95% confidence interval [−5.9, 5.6] min in the whole sample. Overestimation was largest, −12.8 [−25.1, −0.9] min, in patients with obstructive sleep apnea. By contrast, in patients with narcolepsy, actigraphy tended to underestimate sleep time by 24.3 [12.4, 36.1] min. As for sleep efficiency, actigraphy underestimated it by 0.18 [−0.99, 1.35] % and sleep latency by 11.0 [8.5, 13.6] min compared to polysomnography. We conclude that, in measuring sleep time, actigraphy is reasonably reliable and helpful to be used for a week or two to exclude insufficient sleep in patients with the suspicion of narcolepsy. However, the effectiveness of actigraphy in determining sleep seems to decrease in subjects with low sleep efficiencies.

Introduction

Polysomnography (PSG) in a sleep laboratory has remained the gold standard in measuring the quality of sleep for decades. Technological advancements have refined the method throughout the years, but also produced alternative methods for sleep measurement that could have many advantages over PSG in terms of price and ease of usability in the habitual sleep environment (1).

One of the advantages of actigraphy (ACG) is that it provides longitudinal sleep data over multiple nights. ACG is less expensive, less cumbersome, and easier to use than PSG. ACG is clearly more accurate in estimating sleep time than sleep logs (2). It is probably the most widespread tool for assessing circadian rhythm sleep-wake disorders (2). In addition, its use in measuring different properties of sleep has increased. In a recent clinical practice guideline, American Academy of Sleep Medicine (AASM) introduced several recommendations about the use of ACG in the assessment of patients suspected with central disorders of hypersomnolence, insufficient sleep syndrome, sleep-disordered breathing, or insomnia disorders (3). These recommendations include the use of ACG integrated with home sleep apnea test devices to estimate total sleep time during recording in patients suspected of sleep apnea, and to monitor total sleep time prior to multiple sleep latency test (MSLT) in patients suspected of narcolepsy (3).

However, compared to PSG, ACG has been reported to be less reliable in recognizing short periods of wake and to overestimate measured sleep times (4). Based on previous studies, the validity of ACG somewhat decreases with the decline of sleep efficiency (2, 5, 6). An essential problem with the field is that ACG algorithms of different manufacturers lack shared technical solutions and terms, precluding direct comparisons (7). Quantitative criteria for the assessment of other aspects of sleep than circadian rhythm by ACG were missing for a long time (810).

The recent review by AASM set the clinical significance thresholds for the maximum allowable mean difference and the maximum allowable 95% confidence interval (CI) in sleep time between ACG vs. PSG to 40 min among patients with central disorders of hypersomnolence (2). Of note, the task force identified only one study about the concordance of ACG and PSG prior to MSLT among subjects with the suspicion of narcolepsy or hypersomnia (11), and the threshold was set to the same as in those diseases with more available ACG data, like insomnia and insufficient sleep syndrome. In addition, the threshold in sleep efficiency was set to 5% and in sleep latency to 30 min, but these limits were given only for insomnia patients (2).

Only a limited number of actigraphic studies with small number of subjects has been conducted with patients with central disorders of hypersomnolence. Over a decade ago, a study examined the concordance of ACG and PSG prior to MSLT among subjects with suspicion of narcolepsy or hypersomnia (11). Recently, effects of different sensitivity settings of actigraphy regarding its congruence with PSG among idiopathic hypersomnia patients were studied (12). In young operated patients with craniopharyngioma, in higher risk for narcolepsy, PSG, and ACG were also compared recently (13). Actigraphy in sleep apnea patients has been studied by several groups (8, 1416).

According to ICSD-3, narcolepsy is divided to narcolepsy type 1 (NT1) or narcolepsy type 2 (NT2). NT1 is caused by a selective destruction of hypothalamic hypocretin-producing neurons, while the etiology of NT2 is unknown and usually not hypocretin-related. Patients with NT2 do not have cataplexy, but the other symptoms—excessive daytime sleepiness, disturbed sleep, and parasomnias—are shared in NT1 and NT2.

We aimed to compare the concordance of ACG and ambulatory PSG in subjects having excessive daytime sleepiness (EDS) or other sleep-related symptoms with or without organic sleep disorders to see if ACG is reliable in all diagnostic groups, with a special interest in narcolepsy.

Methods

The Helsinki and Uusimaa Ethics Committee approved this study (7/2016). As the study was conducted based on documents completed during normally scheduled patient visits, no written informed consent was required.

Subjects

Initially, study material consisted of all consecutive concomitant ambulatory PSG and ACG recordings conducted at our sleep laboratory in routine clinical practice in the university hospital during 4.5 years, in total 314 recordings. Some of the PSGs failed and, consequently, we included 290 technically reliable enough sleep studies in the study material. Altogether, the data was gathered from 281 individual subjects with the remaining nine recordings being repeated measurements. Actigraphy recordings did not have any technical problems. Subjects were referred for suspicion of sleep-related breathing or movement disorders, central disorders of hypersomnolence, or parasomnias. The subjects were independent in activities of daily living and did not require the assistance of an aide.

Measurements

An Actiwatch (Cambridge Neurotechnology Ltd, Cambridgeshire, UK) or a MotionWare (CamNtech Ltd, Cambridge, UK) system were used as the ACG devices in this study. Of note, MotionWare system is the successor to Actiwatch made by the same manufacturer. Thus, all the parameters used in this study are identical, and comparable analysis settings were used. During the preceding afternoon, the subjects were carefully guided and prepared at the sleep laboratory for the ambulatory PSG and concomitant ACG and then sent home to sleep in their own beds for the night. The subjects would then return to the laboratory the next morning to return the equipment. In several cases, especially when a central disorder of hypersomnolence was suspected, the subjects were given the ACG device already a fortnight beforehand to be worn at all times so that their circadian rhythms and sleep time could also be evaluated over multiple nights. If there was no such suspicion, ACG was only studied one night, concomitantly with PSG.

The raw data from the ACG devices was processed using an analysis program provided by the manufacturer. The epoch length was 1 min. The definitions of the used ACG parameters were described in detail previously (17). As in PSG, sleep latency (SL) is the difference between bedtime and sleep start, and sleep efficiency (SE) is the percentage of time spent asleep between bedtime and get up time. Actual sleep time (AST) in ACG and total sleep time (TST) in PSG are analogous, both defined as the amount of sleep between sleep start and sleep end.

An Embla Titanium (Embla, Denver, CO, USA) ambulatory PSG system was used for the PSG measurements. Ambulatory PSG comprised six electroencephalography (EEG) derivations, two electro-oculography channels, submental muscle tonus, airflow by nasal pressure transducer, thoracoabdominal respiratory movements, pulse oximeter, body position, electrocardiogram, and electromyography from tibialis anterior muscles. PSG recordings were set to start about an hour before the subject intended to go to bed and to end well after their estimated get up time in the morning. At home, the subject wrote down the exact time for lights off and lights on and also marked them by pressing a button on the ACG device. Afterwards, the identical analyzed time for both PSG and ACG was the time from lights off to lights on. When central disorders of hypersomnolence were suspected and the subject had the MSLT the following day, they had to get up at least 1.5 h before the start of the test, while most of the subjects were able to sleep as long as they wanted. The PSG data was scored manually by medical specialists with experience in sleep scoring according to international criteria (18, 19).

Diagnostic Groups

Once the clinical examinations of a subject were complete and a diagnosis was set, the subject was categorized based on the diagnosed organic sleep disorder (if any). Narcolepsy was diagnosed according to ICSD-3 criteria (20). Those patients, who were diagnosed before 2014, were reclassified to NT1 or NT2 according to ICSD-3. Hypersomnia group comprised of idiopathic hypersomnia and other hypersomnia syndromes (ICD-10 code G47.1), and this diagnosis was set strictly according to ICSD-3 criteria (20). Obstructive sleep apnea (OSA) was diagnosed if the apnea-hypopnea index (AHI) had a value higher than 5 per hour. In addition, six patients with narcolepsy also had mild OSA, three had moderate OSA, and one had severe OSA as a co-morbidity, but as it did not affect the results, they were classified to the narcolepsy group. The slight difference in defining AHI according to older and newer hypopnea criteria did not affect the results (18, 19).

Periodic limb movement disorder (PLMD) was diagnosed if the periodic limb movement index during sleep was higher than 15 per hour. Of note, the diagnosis of PLMD cannot be set in the context of any other sleep disorder (20) and our subjects were categorized to this group only if they did not have OSA, narcolepsy, or hypersomnia. To be precise, some subjects in this group had restless legs syndrome (RLS) symptoms while awake together with periodic leg movements while sleeping and their clinical diagnosis was RLS, whereas subjects without RLS symptoms had PLMD (20). We combined these subgroups in the study and focused on PSG findings.

The “Others” group included six patients with NREM parasomnias, three with REM sleep behavior disorder, and two with irregular sleep-wake rhythm disorder. Subjects in the “No sleep disorder” group experienced various degrees of tiredness and/or sleepiness, but no sleep apnea, PLMD, narcolepsy, or hypersomnia were found in the sleep studies. Almost all of them slept objectively too little, and probably also the rest had need for longer sleep than they got. Some had mild depressive symptoms or stress, but no clinical diagnosis of depression or anxiety disorder.

Statistical Analyses

The statistical analysis of the data was carried out with IBM SPSS® Statistics 24.0 (IBM, Armonk, NY, USA), and Stata/SE 16.1 for Mac (StataCorp, College Station, TX, USA). The normality of variables were tested by inspecting the skewness and kurtosis from histograms and Shapiro-Wilk tests. To evaluate agreement between the two methods, Bland-Altman plots were drawn (21, 22). Due to non-parametric distribution of the majority of mean differences, quintile method and logarithmic transformation as proposed by Bland and Altman were used to determine additional limits of agreement (23, 24). To account for the proportional bias, Bland-Altman plots were adjusted for trend and regression lines as well as Passing-Bablok diagrams are shown (25). Mean differences were also plotted against PSG measures since the PSG is considered a golden standard in these measures. Lin's concordance correlation coefficients (CCC) with 95% CI using z transformation were calculated to investigate association (26).

Results

The study material comprised actigraphy and PSG recordings done to 281 subjects. Their ages varied between 16 and 90 years (mean 37.9 y) and 62.8% were female. In addition to first-time recordings, PSG was done twice to nine subjects. In six of those cases, the reason was a necessary repetition of an MSLT. In the three remaining cases, the repetition was done to clarify a finding after some minor technical problems. When analyzed separately, the results in the group of repeated recordings were consistent with the other results, and as our aim was to analyze concordance between the methods in different recordings, not subjects, we decided to include those repeated recordings, as well. Altogether, 290 recordings were included in this study. The distribution of diagnosed sleep disorders, which are described in detail in the methods section, is summarized in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Diagnostic groups and subgroups.

Mean differences between the ACG and PSG measures followed non-parametric distributions (Shapiro-Wilk P < 0.05) in the whole sample and in other subgroups than narcolepsy, NT1, NT2, and hypersomnia. Histograms demonstrated high kurtosis around zero with multiple outliers, which is seen also in Passing-Bablok plot (Figure 1). An extreme outlier e.g., demonstrated a subject with history of Parkinson's disease, restless legs, disturbed nocturnal sleep with only 80 min of total sleep in PSG and 386 min in ACG. Outliers were kept in the sample, and non-parametric methods were used as suggested by Bland and Altman (23). Logarithmic transformation did not change the distribution of mean differences.

FIGURE 1
www.frontiersin.org

Figure 1. Passing-Bablok of sleep time. Dashed line, 95% confidence interval. Solid line, Passing-Bablok regression line. Y, Passing-Bablok fit.

Sleep Time

A priori, we set the clinical significance threshold for mean difference in sleep time to ± 40 min based on the AASM guidelines (2, 3). The mean difference in the whole sample was only −0.13 min (95% CI −5.9 to 5.6) indicating very low bias and high accuracy (Table 2). The mean differences were also in the reference area in all the subgroups. Of all the individual measurements, 70.7% were in this AASM reference area.

TABLE 2
www.frontiersin.org

Table 2. Concordance of sleep time between actigraphy and ambulatory polysomnography.

The Passing-Bablok regression of sleep time showed some but rather low proportional bias in sleep time measures in ACG compared to PSG (slope estimate 0.92; 95% CI 0.88, 0.97) (Figure 1). In other words, there is a trend for actigraphy to overestimate sleep time especially when sleep time is short in PSG with few extreme outliers (Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. Difference in sleep time compared to total sleep time in PSG. Dashed line, ± 40 min according to AASM criteria. Gray area, 95% confidence interval for regression line. Solid line, mean difference. PSG, polysomnography; ACG, actigraphy.

While being very accurate, Bland-Altman plot showed rather wide (−97.49, 97.23) limits of agreement (LoA). Non-parametric distribution and outliers increase limits of agreement that are based on the standard deviation of the bias. In the subgroups where mean differences followed normal distribution (NT1, NT2, narcolepsy, and hypersomnia) LoA were clearly narrower. After removing 5% of the extreme mean differences from both ends—quintile method for non-parametric distributions as suggested by Bland and Altman (23)—LoA in the whole sample were −64.49 (95% CI −70.8, −58.1) and 52.24 (95% CI 46.0, 58.5).

In trend Bland-Altman plot, the mean difference was −53.26 + 0.13*average, and LoA ± 2.46*(56.49–0.06*average) (Figure 3).

FIGURE 3
www.frontiersin.org

Figure 3. Trend Bland-Altman plot: difference in sleep time compared to average of sleep time in PSG and ACG. Dashed line, mean difference. Gray area, 95% confidence interval for regression line. PSG, polysomnography; ACG, actigraphy.

As for concordance correlation, CCC showed high concordance in groups “no organic sleep disorder” and “others (parasomnia)” and also in smaller hypersomnia and NT2 subgroups but poor to moderate in other analyses (Table 2). In total sample, CCC was 0.8454 (95% CI 0.810 to 0.875) which can be considered as moderate.

Sleep Efficiency

Table 3 depicts the difference of average sleep efficiencies measured by PSG and ACG, i.e., SE in PSG—SE in ACG. Overall, ACG tended to underestimate SE by a very small amount, 0.18, 95% CI [−0.99, 1.35] % in the whole sample. The underestimation was larger, 6.24 [3.42, 9.05] %, in the NT1 subgroup than in the NT2 subgroup. The underestimation was also clear in the others group with mainly patients with parasomnias. By contrast, in patients with OSA, ACG tended to overestimate SE.

TABLE 3
www.frontiersin.org

Table 3. Concordance of sleep efficiency between actigraphy and ambulatory polysomnography.

AASM set the clinical the clinical significance thresholds for the maximum allowable 95% CI in sleep efficiency between ACG and PSG to 5% (2). In total, only 55.5% of the measurements were inside these limits. All the CCCs were poor, except in the NT2 group.

Sleep Latency

As is seen in Table 4, ACG seems to underestimate sleep latency in general, overall on average 11.0, 95% CI [8.5, 13.6] min. The underestimation was the largest, 16.8 [11.1, 22.4] min, in the OSA group. The underestimation was also clear among subjects with no organic sleep disorders. The sole exception to this underestimation by ACG was the narcolepsy group in which the actigraphic SL estimates were very close—on average only 0.049 min longer—to SL in PSG.

TABLE 4
www.frontiersin.org

Table 4. Concordance of sleep latency between actigraphy and ambulatory polysomnography.

AASM set the clinical significance thresholds for the maximum allowable 95% CI in sleep latency between ACG and PSG to 30 min (2). In total, 89.9% of the recordings were inside these limits. All the CCCs were poor.

Men and women as a group did not differ statistically significantly in any of the above-mentioned sleep parameters. Expectedly, older subjects had shorter sleep time, lower sleep efficiency, and longer sleep latency, both in PSG and in ACG. The differences in Bland-Altman analyses or CCC were negligible (data not shown).

Discussion

For our knowledge, this is the first study comparing ACG and PSG at home. Most people sleep better in familiar environment than in the sleep laboratory (27). As ACG is worn during daily life, including nights at home, this method gives a more exact view of how actigraphy typically performs in different sleep disorders, compared to validation studies with in-lab PSG.

Our results with sleep time were concurrent with previous findings. In previous studies looking at subjects with the suspicion of narcolepsy or hypersomnia, ACG underestimated sleep time by 15.1 min (13) or 15.6 min (11), while our result was 24.3 min for narcolepsy and 0.75 min for hypersomnia group. Further, the slight overestimation of TST by ACG in the OSA group is in line with the recent meta-analysis where ACG was found to overestimate the TST of patients with OSA by 14.5 min (2), while our result was 12.8 min. In our study, accuracy was similar in younger or older subjects, but also opposite results have been shown (28).

The findings in this study suggest that ACG is a reliable tool for estimating TST for many but not all patients with sleep disorders. On average, ACG excelled well in estimating TST with an extremely small bias, only 7.8 s and 95% CI of <6 min. Our mean results fit very well in the clinical significance thresholds for the maximum allowable 95% CI of the mean difference between ACG vs. PSG, set in the recent guidelines by AASM (2). Nevertheless, the large variety of the results is of specific concern. While mean differences between the methods are minor, the results are imprecise in the whole sample. The threshold for maximum allowable 95% CI in the difference in sleep time is too strict for 30% of the measurement pairs in our study. Especially, periodic leg movements and even mild sleep maintenance insomnia seemed to affect the accuracy of sleep time in our subjects.

As is seen in Figure 4, actigraphy is accurate when sleep efficiency is high but much less so when sleep efficiency decreases. When a subject has low sleep efficiency, they usually lie immobile but awake, and ACG interprets it as sleep, thus overestimating sleep time heavily. Figure 4 shows also the opposite situation: subjects with normal or good sleep efficiency where ACG underestimated sleep time. Most of these subjects had narcolepsy, especially NT1, or parasomnia. It is a logical finding when the operating principle of actigraphy is taken into consideration. Patients with narcolepsy and/or parasomnia may present abnormal motor behavior in REM and NREM sleep and periodic limb movements (17, 29). ACG would interpret these movements as patients being awake although they would in fact still be asleep.

FIGURE 4
www.frontiersin.org

Figure 4. Difference in sleep time compared to sleep efficiency in PSG. Solid line, mean difference. Gray area, 95% confidence interval for regression line. PSG, polysomnography; ACG, actigraphy.

As for sleep efficiency and sleep latency, there were clear differences between subjects with no sleep disorder and patients having narcolepsy or OSA. Our findings were concurrent with those in previous studies. ACG tends to underestimate sleep latency, probably since subjects usually lie immobile for a while before falling asleep (4). Surprisingly, the narcolepsy subgroup was an exception and was found to have ACG SL measurements that were very concordant with PSG equivalents. This is probably because patients with narcolepsy tend to fall asleep abnormally fast instead of lying immobile but awake. In some cases with narcolepsy, ACG showed even longer sleep latencies than PSG, which may be due to the combination of sleep onset REM and REM without atonia (17, 29). Narcolepsy differs from other sleep disorders in many ways, and the direction of misestimation of sleep time and sleep latency by ACG seems to be one of the differences, at least every now and then.

Periodic leg movements as a disorder or together with another sleep disorder seemed to deteriorate the agreement in all sleep parameters. Since periodic limb movements during sleep are often unrecognized by the patient, it is important to bear in mind this possibility, especially if there are discrepancies in the findings. More research is needed to clarify the effects of sleep-related movement disorders to the reliability of ACG.

To summarize our core findings, ACG shows excellent accuracy i.e., negligible bias or mean difference in sleep time and sleep efficiency, and low bias also in sleep latency. However, the precision of actigraphy in a single night measurement is rather poor as demonstrated by e.g., wide limits of agreement and only moderate number of measurement pairs fitting inside the AASM reference area (24). Still, precision increases with replication and since actigraphy is always done across 7–14 nights, regression toward mean and replication increase precision remarkably.

Insufficient sleep—either behaviorally induced or secondary to some problems with sleep—is a very common cause of EDS and, consequently, the background reason for many patient visits to sleep laboratories. Before conducting more complicated diagnostic tests, such as PSG or MSLT for narcolepsy diagnosis, ACG seems to be a practical tool to show that the cause of EDS could be the lack of adequate amount of sleep related to individual need instead of any specific sleep disorder. ACG is far from being perfect, but there is no better method to assess sleep time across several nights. Actigraphic data is more reliable than data derived from sleep logs (2, 30).

What is more, an actigraphy recording, lasting for 2 weeks or longer, is superior to most other methods in showing delayed sleep phase syndrome (DSPS) or other circadian rhythm sleep-wake disorders. DSPS is common in adolescents and young adults—the same age group where narcolepsy often starts. Actigraphy cannot distinguish between behavioral and genetic DSPS, but it shows the current sleep and wake times. DSPS with very late bedtimes often leads to difficulties in staying awake during the morning hours, and even REM sleep can occur in MSLT sessions if the patient usually sleeps until noon.

To avoid false positive diagnoses of narcolepsy, the use of ACG for at least a week should precede every diagnosis of narcolepsy based on MSLT results (3, 17, 20, 31). This is of the utmost importance for the diagnosis of NT2, where cataplexy and hypocretin deficiency are not found, and the differential diagnosis for insufficient sleep syndrome and DSPS is thus much more difficult than in NT1. Naturally, for a narcolepsy diagnosis, essential symptoms need to be present and all other possible causes excluded (20).

In our clinic, we always use ACG for a fortnight before MSLT so that the last night of ACG recording is the PSG night (ambulatory or in-lab) and we compare the concomitant findings. Consequently, we know if the PSG night was typical for the patient and if the results from the preceding 13 nights of ACG recording were accurate. This procedure substantially increases the reliability of ACG in everyday clinical practice.

Additionally to the help in diagnostics, ACG can be used to assess treatment responses, as the method is known to be highly sensitive in a within-subject design [see Sadeh and Acebo (32)]. There are several illustrative examples of the use of ACG to demonstrate drug-induced changes in PLMD or narcolepsy or CPAP-induced changes in OSA (3336).

Limitations

Some limitations of the study need to be acknowledged. Although we had an extensive subject base, which included patients having the most common clinical sleep disorders, we lacked patients with insomnia as their primary diagnosis. Additionally, the number of NT2 and hypersomnia patients were very small, as these diagnoses are rare, when strict diagnostic criteria are used. In comparing concordance of PSG and ACG, we were especially interested in whole-night measures used in clinical practice and we did not do an epoch-by-epoch comparison of the raw data, which would have enabled us to investigate the sensitivity and specificity of ACG in more detail.

Conclusions

Actigraphy can be a practical tool for measuring some aspects of sleep in situations where PSG is not available for multiple nights or when a full examination is unnecessary to start with. In addition to its established use in circadian rhythm studies, actigraphy is reasonably good at estimating TST. Thus, it is useful in the diagnostic examinations of narcolepsy to see if the subject slept sufficiently during the nights preceding an MSLT for the test to be reliable. However, extreme care should be taken in interpreting the reported values, if the subject has other sleep problems than central disorders of hypersomnolence, as then these values might be misestimated.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by Helsinki and Uusimaa Ethics Committee. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

All authors contributed significantly to the manuscript. AA and TJ contributed to study design, data collection, statistical analyses, interpreting the results, and writing the manuscript. TS and MP contributed to statistical analyses, interpreting the results, and writing the manuscript.

Funding

Open access publication fee was covered by University of Helsinki.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Abbreviations

AASM, American Academy of Sleep Medicine; ACG, actigraphy; AHI, apnea-hypopnea index; AST, actual sleep time (in actigraphy); CCC, Lin's concordance correlation coefficient; CI, confidence interval; DSPS, delayed sleep phase syndrome; EDS, excessive daytime sleepiness; EEG, electroencephalography; ICSD-3, International Classification of Sleep Disorders, third edition; LoA, limit of agreement; MSLT, multiple sleep latency test; NT1, narcolepsy type 1; NT2, narcolepsy type 2; OSA, obstructive sleep apnea; PLMD, periodic limb movement disorder; PSG, polysomnography; RLS, restless legs syndrome; SE, sleep efficiency; SL, sleep latency; ST, sleep time; TST, total sleep time (in polysomnography).

References

1. Collop NA, Tracy SL, Kapur V, Mehra R, Kuhlmann D, Fleishman SA, et al. Obstructive sleep apnea devices for out-of-center (OOC) testing: technology evaluation. J Clin Sleep Med. (2011) 7:531–48. doi: 10.5664/JCSM.1328

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Smith MT, McCrae CS, Cheung J, Martin JL, Harrod CG, Heald JL, et al. Use of actigraphy for the evaluation of sleep disorders and circadian rhythm sleep-wake disorders: an American Academy of Sleep Medicine systematic review, meta-analysis, and GRADE assessment. J Clin Sleep Med. (2018) 14:1209–30. doi: 10.5664/jcsm.7228

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Smith MT, McCrae CS, Cheung J, Martin JL, Harrod CG, Heald JL, et al. Use of actigraphy for the evaluation of sleep disorders and circadian rhythm sleep-wake disorders: an American Academy of Sleep Medicine clinical practice guideline. J Clin Sleep Med. (2018) 14:1231–7. doi: 10.5664/jcsm.7230

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Sadeh A. The role and validity of actigraphy in sleep medicine: an update. Sleep Med Rev. (2011) 15:259–67. doi: 10.1016/j.smrv.2010.10.001

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Khan CT, Woodwar SH. Calibrating actigraphy to improve sleep efficiency estimates. J Sleep Res. (2018) 27:e12613. doi: 10.1111/jsr.12613

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Conley S, Knies A, Batten J, Ash G, Miner B, Hwang Y, et al. Agreement between actigraphic and polysomnographic measures of sleep in adults with and without chronic conditions: a systematic review and meta-analysis. Sleep Med Rev. (2019) 46:151–60. doi: 10.1016/j.smrv.2019.05.001

PubMed Abstract | CrossRef Full Text | Google Scholar

7. te Lindert BHW, van Someren EJW. Sleep estimates using microelectromechanical systems (MEMS). Sleep. (2013) 36:781–9. doi: 10.5665/sleep.2648

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Wang D, Wong KK, Dungan GC II, Buchanan PR, Yee BJ, Grunstein RR. The validity of wrist actimetry assessment of sleep with and without sleep apnea. J Clin Sleep Med. (2008) 4:450–5. doi: 10.5664/jcsm.27281

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Marino M, Li Y, Rueschman MN, Winkelman JW, Ellenbogen JM, Solet JM, et al. Measuring sleep: accuracy, sensitivity, and specificity of wrist actigraphy compared to polysomnography. Sleep. (2013) 36:1747–55. doi: 10.5665/sleep.3142

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Natale V, Léger D, Martoni M, Bayon V, Erbacci A. The role of actigraphy in the assessment of primary insomnia: a retrospective study. Sleep Med. (2014) 15:111–5. doi: 10.1016/j.sleep.2013.08.792

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Bradshaw DA, Yanagi MA, Pak ES, Peery TS, Ruff GA. Nightly sleep duration in the 2-week period preceding multiple sleep latency testing. J Clin Sleep Med. (2007) 3:613–9. doi: 10.5664/jcsm.26972

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Cook JD, Eftekari SC, Leavitt LA, Prairie ML, Plante DT. Optimizing actigraphic estimation of sleep duration in suspected idiopathic hypersomnia. J Clin Sleep Med. (2019) 15:597–602. doi: 10.5664/jcsm.7722

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Niel K, LaRosa KN, Klages KN, Merchant TE, Wise MS, Witcraft SM, et al. Actigraphy versus polysomnography to measure sleep in youth treated for craniopharyngioma. Behav Sleep Med. (2019) 14:1–9. doi: 10.1080/15402002.2019.1635133

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Dick R, Penzel T, Fietze I, Partinen M, Hein H, Schulz J. AASM standards of practice compliant validation of actigraphic sleep analysis from SOMNOwatch versus polysomnographic sleep diagnostics shows high conformity also among subjects with sleep disordered breathing. Physiol Meas. (2010) 31:1623–33. doi: 10.1088/0967-3334/31/12/005

CrossRef Full Text | Google Scholar

15. Choi SJ, Kang M, Sung MJ, Joo EY. Discordant sleep parameters among actigraphy, polysomnography, and perceived sleep in patients with sleep-disordered breathing in comparison with patients with chronic insomnia disorder. Sleep Breath. (2017) 21:837–43. doi: 10.1007/s11325-017-1514-5

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Villanueva JA, Garmendia O, Farré R, Montserrat JM. Accuracy of one-night actigraphy for estimating sleep in patients with sleep apnea. Sleep Med. (2019) 63:3–4. doi: 10.1016/j.sleep.2019.05.007

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Alakuijala A, Sarkanen T, Partinen M. Polysomnographic and actigraphic characteristics of patients with H1N1-vaccine-related and sporadic narcolepsy. Sleep Med. (2015) 16:39–44. doi: 10.1016/j.sleep.2014.07.024

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Iber C, Ancoli-Israel S, Chesson A, Quan SF. The AASM Manual for the Scoring of Sleep & Associated Events: Rules, Terminology and Technical Specifications. Westchester, IL: American Academy of Sleep Medicine (2007).

PubMed Abstract | Google Scholar

19. Berry RB, Brooks R, Gamaldo CE, Harding SM, Marcus CL, Vaughn BV. The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications. Version 2.0. Darien, IL: American Academy of Sleep Medicine (2012).

Google Scholar

20. American Academy of Sleep Medicine. International Classification of Sleep Disorders. 3rd ed. Darien, IL: American Academy of Sleep Medicine (2014).

Google Scholar

21. Giavarina D. Understanding Bland Altman analysis. Biochem Med. (2015) 25:141–51. doi: 10.11613/BM.2015.015

CrossRef Full Text | Google Scholar

22. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. (1986) 1:307–10. doi: 10.1016/S0140-6736(86)90837-8

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. (1999) 8:135–60. doi: 10.1191/096228099673819272

CrossRef Full Text | Google Scholar

24. Montenij LJ, Buhre WF, Jansen JR, Kruitwagen CL, de Waal EE. Methodology of method comparsion studies evaluating the validity of cardiac output monitors: a stepwise approach and checklist. Br J Anaesth. (2016) 116:750–8. doi: 10.1093/bja/aew094

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Passing H, Bablok H. A new biometrical procedure for testing the equality of measurements from two different analytical methods. Application of linear regression procedures for method comparison studies in clinical chemistry, Part I. J Clin Chem Clin Biochem. (1983) 21:709–20. doi: 10.1515/cclm.1983.21.11.709

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Lin LI. A concordance correlation coefficient to evaluate reproducibility. Biometrics. (1989) 45:255–68. doi: 10.2307/2532051

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Fonareva I, Amen AM, Zajdel DP, Ellingson RM, Oken BS. Assessing sleep architecture in dementia caregivers at home using an ambulatory polysomnographic system. J Geriatr Psychiatry Neurol. (2011) 24:50–9. doi: 10.1177/0891988710397548

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Danzig R, Wang M, Shah A, Trotti LM. The wrist is not the brain: estimation of sleep by clinical and consumer wearable actigraphy devices is impacted by multiple patient- and device-specific factors. J Sleep Res. (2020) 29:e12926. doi: 10.1111/jsr.12926

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Dauvilliers Y, Jennum P, Plazzi G. Rapid eye movement sleep behaviour disorder and rapid eye movement sleep without atonia in narcolepsy. Sleep Med. (2013) 14:775–81. doi: 10.1016/j.sleep.2012.10.006

CrossRef Full Text | Google Scholar

30. Lawrence G, Muza R. Assessing the sleeping habits of patients in a sleep disorder centre: a review of sleep diary accuracy. J Thorac Dis. (2018) 10:S177–83. doi: 10.21037/jtd.2017.12.127

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Kretzschmar U, Werth E, Sturzenegger C, Khatami R, Bassetti CL, Baumann CR. Which diagnostic findings in disorders with excessive daytime sleepiness are really helpful? A retrospective study. J Sleep Res. (2016) 25:307–13. doi: 10.1111/jsr.12383

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Sadeh A, Acebo C. The role of actigraphy in sleep medicine. Sleep Med Rev. (2002) 6:113–24. doi: 10.1053/smrv.2001.0182

CrossRef Full Text | Google Scholar

33. Bruck D, Kennedy GA, Cooper A, Apel S. Diurnal actigraphy and stimulant efficacy in narcolepsy. Hum Psychopharmacol Clin Exp. (2005) 20:105–13. doi: 10.1002/hup.666

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Otake M, Miyata S, Noda A, Koike Y, Hara Y, Sugiura M, et al. Monitoring sleep-wake rhythm with actigraphy in patients on continuous positive airway pressure therapy. Respiration. (2011) 82:136–41. doi: 10.1159/000321238

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Tippin J, Aksan N, Dawson J, Anderson SW, Rizzo M. Sleep remains disturbed in patients with obstructive sleep apnea treated with positive airway pressure: a three-month cohort study using continuous actigraphy. Sleep Med. (2016) 24:24–31. doi: 10.1016/j.sleep.2016.07.008

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Filardi M, Pizza F, Antelmi E, Ferri R, Natale V, Plazzi G. In-field assessment of sodium oxybate in pediatric type 1 narcolepsy: an actigraphic study. Sleep. (2018) 41:1–7. doi: 10.1093/sleep/zsy050

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: actimetry, sleep quantity, diagnostics, central disorders of hypersomnolence, insufficient sleep

Citation: Alakuijala A, Sarkanen T, Jokela T and Partinen M (2021) Accuracy of Actigraphy Compared to Concomitant Ambulatory Polysomnography in Narcolepsy and Other Sleep Disorders. Front. Neurol. 12:629709. doi: 10.3389/fneur.2021.629709

Received: 15 November 2020; Accepted: 20 January 2021;
Published: 04 March 2021.

Edited by:

Ivana Rosenzweig, King's College London, United Kingdom

Reviewed by:

Sona Nevsimalova, Charles University, Czechia
Rexford Muza, Guy's and St Thomas' NHS Foundation Trust, United Kingdom

Copyright © 2021 Alakuijala, Sarkanen, Jokela and Partinen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Markku Partinen, markku.partinen@helsinki.fi; orcid.org/0000-0002-8182-9368

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.